Senior Data Engineer, Databricks & Bloomberg Data Pipelines

Ethereum Technologies LLC; New York (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology company in New York is seeking a skilled Data Engineer with over 10 years of experience in financial services or trading environments. The role involves managing and supporting batch processes and data pipelines in Azure Databricks and Azure Data Factory, integrating and processing Bloomberg market data, and optimizing ETL pipelines using Python and SQL. Ideal candidates will have hands-on experience with Azure tools and strong programming capabilities.

Qualifications

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage, Logic Apps, Fabric.
• Strong Python and SQL programming skills.
• Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP).

Responsibilities

• Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
• Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
• Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
• Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.

Skills

Data engineering experience

Python programming

SQL programming

Experience with Azure Databricks

Experience with Bloomberg data feeds

Tools

Azure Data Factory

Azure Storage

Logic Apps

Job description

A technology company in New York is seeking a skilled Data Engineer with over 10 years of experience in financial services or trading environments. The role involves managing and supporting batch processes and data pipelines in Azure Databricks and Azure Data Factory, integrating and processing Bloomberg market data, and optimizing ETL pipelines using Python and SQL. Ideal candidates will have hands-on experience with Azure tools and strong programming capabilities.