Data Engineer: AI & Quant Data Platform

Cantor Fitzgerald; Greater London; On-site; GBP 65,000 - 90,000; Full time

Job summary

Cantor Fitzgerald is seeking a Data Engineer in London to build and maintain data pipelines for AI and quant models. You will design scalable data architectures, ensure data quality, and create metadata systems to support model-ready datasets.

Collaborate with data scientists, manage time-series data, and implement data lineage and access controls, while staying current with best practices in modern cloud data stacks.

Qualifications

• Strong Python and SQL experience with production ETL/ELT pipelines.
• Proficient in cloud data stack technologies (Azure, Databricks, Delta Lake, Snowflake).
• Experience with time-series data and data quality monitoring.
• Bachelor's degree in CS/engineering or related field preferred; 2+ years of data engineering experience.

Responsibilities

• Build and maintain market, economic, research, news, and internal data pipelines, including Fenics/BGC data integration.
• Design and implement a scalable bronze/silver/gold data architecture to support AI and quant models.
• Establish and monitor data quality gates to ensure data integrity and accuracy.
• Develop and manage instrument, ticker, country, client, source, and theme metadata for effective data categorization and retrieval.
• Create APIs and tables for seamless integration with agent tools, dashboards, and quant models.
• Implement data lineage tracking, user entitlements, and permissions management systems.
• Monitor and optimize data pipelines for performance and efficiency, ensuring smooth data flow.
• Collaborate with data scientists and analysts to understand their data needs and provide model-ready datasets.
• Stay updated with trends in time-series and complex-data analysis, incorporating best practices into our data platform.
• Ensure data security and privacy compliance, adhering to industry standards and regulations.

Skills

Python

SQL

Time-series data

Cloud data stack

Data quality monitoring

kdb+ familiarity

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Azure

Databricks

Delta Lake

Snowflake

kdb+

Job description

Cantor Fitzgerald is seeking a Data Engineer in London to build and maintain data pipelines for AI and quant models. You will design scalable data architectures, ensure data quality, and create metadata systems to support model-ready datasets.

Collaborate with data scientists, manage time-series data, and implement data lineage and access controls, while staying current with best practices in modern cloud data stacks.