Senior Data Engineer - Azure Databricks & Market Data

Quantum Technologies. LLC; New York, Northern (NY, KY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Equal opportunity employer

Job summary

Quantum Technologies LLC is seeking a senior data engineer to manage and optimize data pipelines in Azure Databricks and Data Factory, including Bloomberg market data integration. You will monitor and resolve data and system issues in trading environments and collaborate with operations and infrastructure teams to improve workflows.

Applicants should have 10+ years in data engineering within financial services, strong Python/SQL skills, and hands-on experience with Azure storage and Bloomberg

Qualifications

• 10+ years of experience in data engineering or production support within financial services or trading environments.

Responsibilities

• Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
• Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
• Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
• Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.

Skills

Python

SQL

Azure Databricks

Azure Data Factory

Spark

ETL

Bloomberg data feeds

Tools

Azure Storage

Logic Apps

Fabric

Job description

Quantum Technologies LLC is seeking a senior data engineer to manage and optimize data pipelines in Azure Databricks and Data Factory, including Bloomberg market data integration. You will monitor and resolve data and system issues in trading environments and collaborate with operations and infrastructure teams to improve workflows.

Applicants should have 10+ years in data engineering within financial services, strong Python/SQL skills, and hands-on experience with Azure storage and Bloomberg