Senior Databricks Data Engineer - Azure & Bloomberg Feeds

Artifintech; New York (NY); On-site; USD 150,000 - 190,000; Full time

Job summary

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC seeks an experienced data engineer to manage batch processes and data pipelines in Azure Databricks and Data Factory. You will integrate Bloomberg market data feeds into trading or analytics platforms, monitor issues, and optimize ETL pipelines using Python and SQL.

The role requires strong data handling skills, experience with Bloomberg feeds (BPIPE/TSIP/SFTP), and collaboration with cross-functional teams to ensure data quality and timely reporting.

Qualifications

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.
• Strong Python and SQL programming skills.
• Experience with Bloomberg data feeds (BPIPE, TSIP,SFTP).

Responsibilities

• Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
• Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
• Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
• Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.

Skills

Python

SQL

Data engineering

Tools

Azure Databricks

Azure Data Factory

Azure Storage

Logic Apps

Fabric

Bloomberg feeds

Job description

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC seeks an experienced data engineer to manage batch processes and data pipelines in Azure Databricks and Data Factory. You will integrate Bloomberg market data feeds into trading or analytics platforms, monitor issues, and optimize ETL pipelines using Python and SQL.

The role requires strong data handling skills, experience with Bloomberg feeds (BPIPE/TSIP/SFTP), and collaboration with cross-functional teams to ensure data quality and timely reporting.