Senior Data Engineer - Databricks & Azure ETL

MACHINE LEARNING TECHNOLOGIES LLC; New York (NY); On-site; USD 90,000 - 130,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Data Engineer – Databricks in New York, NY for a 17-month project. Responsibilities include managing data pipelines in Azure Databricks and integrating Bloomberg market data feeds.

The ideal candidate will have over 10 years of experience in data engineering, strong skills in Python and SQL, and hands-on experience with Azure services. This role offers a dynamic work environment with opportunities for skill enhancement.

Qualifications

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Hands-on experience with Azure Databricks, Azure Data Factory, and Azure Storage.
• Strong Python and SQL programming skills.

Responsibilities

• Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
• Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
• Monitor, troubleshoot, and resolve data and system issues.

Skills

Data engineering

Azure Databricks

Azure Data Factory

Python

SQL

Bloomberg data feeds

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking a Data Engineer – Databricks in New York, NY for a 17-month project. Responsibilities include managing data pipelines in Azure Databricks and integrating Bloomberg market data feeds.

The ideal candidate will have over 10 years of experience in data engineering, strong skills in Python and SQL, and hands-on experience with Azure services. This role offers a dynamic work environment with opportunities for skill enhancement.