Senior Data Engineer - Greenfield Databricks & AWS

twentyAI; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

twentyAI is seeking a Senior Data Engineer to join its Enterprise Data Team in the US. You will help build a modern data platform, scaling pipelines and lakehouse architecture across multi-market trading businesses.

You will own data quality, observability and CI/CD practices, collaborating with Data, AI and Analytics to deliver tangible business impact. The role offers a greenfield opportunity to shape technical direction from day one, leveraging Databricks, Spark, Python and AWS in a

Qualifications

• Strong hands-on experience with Databricks and Spark in production environments.
• Excellent Python and SQL skills.
• Experience building scalable data pipelines and lakehouse architectures.
• Knowledge of CI/CD, automated testing, data quality and observability.
• AWS experience preferred.
• Financial services experience is a plus, particularly within capital markets or trading environments.

Responsibilities

• Build and scale enterprise data pipelines and lakehouse architectures.
• Own engineering standards, data quality, observability and platform performance.
• Collaborate with Data, AI and Analytics teams on cross-functional projects.
• Influence architectural direction and establish best practices from day one.

Skills

Databricks

Spark

Python

SQL

CI/CD

AWS

Data pipelines

Lakehouse

Observability

Job description

twentyAI is seeking a Senior Data Engineer to join its Enterprise Data Team in the US. You will help build a modern data platform, scaling pipelines and lakehouse architecture across multi-market trading businesses.

You will own data quality, observability and CI/CD practices, collaborating with Data, AI and Analytics to deliver tangible business impact. The role offers a greenfield opportunity to shape technical direction from day one, leveraging Databricks, Spark, Python and AWS in a