Data Engineer - Databricks

Robotics Technologies LLC; New York (NY); On-site; Full time

Job summary

A leading technology firm in New York is seeking an experienced Data Engineer to manage batch processes and support data pipelines in Azure Databricks and Azure Data Factory. The ideal candidate will have over 10 years of experience in data engineering within financial services, strong Python and SQL programming skills, and hands-on experience with Bloomberg data feeds. This role offers competitive salary and benefits.

Qualifications

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Strong experience with data integration and optimization techniques.
• Hands-on experience with Azure technologies.

Responsibilities

• Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
• Integrate Bloomberg market data feeds into trading platforms.
• Develop and optimize ETL pipelines using Python, Spark, and SQL.

Skills

Azure Databricks

Azure Data Factory

Python

SQL

Tools

Bloomberg data feeds (BPIPE, TSIP, SFTP)

Job description

Responsibilities

• Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory.
• Integrate and process Bloomberg market data feeds and files into trading or analytics platforms.
• Monitor, troubleshoot, and resolve data and system issues related to trading applications and market data ingestion.
• Develop, automate, and optimize ETL pipelines using Python, Spark, and SQL.
• Manage FTP/SFTP file transfers between internal systems and external vendors.
• Ensure data quality, completeness, and timeliness for downstream trading and reporting systems.
• Collaborate with operations, application support, and infrastructure teams to resolve incidents and enhance data workflows.

Qualifications

• 10+ years of experience in data engineering or production support within financial services or trading environments.
• Hands‑on experience with Azure Databricks, Azure Data Factory, Azure Storage, Logic Apps, Fabric.
• Strong Python and SQL programming skills.
• Experience with Bloomberg data feeds (BPIPE, TSIP, SFTP).

ROBOTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ROBOTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ROBOTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract