Data Engineer: Cloud Lakehouse & Scalable Pipelines

Harnham; New York (NY); On-site; USD 110,000 - 160,000; Full time

Job summary

Harnham in New York is seeking a Data Engineer to design and build scalable data pipelines and contribute to a modern cloud-based lakehouse platform.

The role emphasizes best practices in data modelling, quality, governance, and security, with collaboration across analytics, data science, and engineering teams to deliver high-value data products.

Candidates should have strong Python/SQL/Spark skills and experience with lakehouse tech; join a technology-driven org investing in data capabilities.

Qualifications

• Strong experience building and supporting cloud-based data platforms.
• Advanced Python, SQL, and Apache Spark expertise.
• Experience with lakehouse technologies such as Apache Iceberg, Delta Lake, or Apache Hudi.
• Strong understanding of data modelling, warehousing, and CDC patterns.
• Experience building scalable, event-driven data solutions.
• Knowledge of CI/CD, infrastructure as code, and data governance best practices.

Responsibilities

• Designing and building scalable data pipelines and ETL solutions.
• Helping to develop and evolve a modern cloud-based lakehouse platform.
• Implementing best practices across data modelling, quality, governance, and security.
• Optimizing data processing workloads using Python, SQL, and Spark.
• Collaborating with analytics, data science, and engineering teams to deliver high-value data products.
• Contributing to technical decisions and platform architecture.

Skills

Cloud data platforms

Python

SQL

Apache Spark

Lakehouse tech

Data modelling

CDC patterns

Event-driven data

CI/CD / IaC

Data governance

Job description

Harnham in New York is seeking a Data Engineer to design and build scalable data pipelines and contribute to a modern cloud-based lakehouse platform.

The role emphasizes best practices in data modelling, quality, governance, and security, with collaboration across analytics, data science, and engineering teams to deliver high-value data products.

Candidates should have strong Python/SQL/Spark skills and experience with lakehouse tech; join a technology-driven org investing in data capabilities.