Data Engineer

Harnham; New York (NY); On-site; USD 110,000 - 160,000; Full time

Job summary

Harnham in New York is seeking a Data Engineer to design and build scalable data pipelines and contribute to a modern cloud-based lakehouse platform.

The role emphasizes best practices in data modelling, quality, governance, and security, with collaboration across analytics, data science, and engineering teams to deliver high-value data products.

Candidates should have strong Python/SQL/Spark skills and experience with lakehouse tech; join a technology-driven org investing in data capabilities.

Qualifications

• Strong experience building and supporting cloud-based data platforms.
• Advanced Python, SQL, and Apache Spark expertise.
• Experience with lakehouse technologies such as Apache Iceberg, Delta Lake, or Apache Hudi.
• Strong understanding of data modelling, warehousing, and CDC patterns.
• Experience building scalable, event-driven data solutions.
• Knowledge of CI/CD, infrastructure as code, and data governance best practices.

Responsibilities

• Designing and building scalable data pipelines and ETL solutions.
• Helping to develop and evolve a modern cloud-based lakehouse platform.
• Implementing best practices across data modelling, quality, governance, and security.
• Optimizing data processing workloads using Python, SQL, and Spark.
• Collaborating with analytics, data science, and engineering teams to deliver high-value data products.
• Contributing to technical decisions and platform architecture.

Skills

Cloud data platforms

Python

SQL

Apache Spark

Lakehouse tech

Data modelling

CDC patterns

Event-driven data

CI/CD / IaC

Data governance

Job description

*no third party agencies for this role please*

The Company

They are a technology-driven organization investing heavily in their data capabilities to support business growth and innovation. Their teams work with modern cloud technologies, large-scale data processing frameworks, and advanced data architecture patterns to deliver high-quality, reliable data products. They offer a collaborative environment where technical leadership and engineering excellence are highly valued.

The Role

As a Data Engineer, you will be:

• Designing and building scalable data pipelines and ETL solutions.


• Helping to develop and evolve a modern cloud-based lakehouse platform.


• Implementing best practices across data modelling, quality, governance, and security.


• Optimizing data processing workloads using Python, SQL, and Spark.


• Collaborating with analytics, data science, and engineering teams to deliver high-value data products.


• Contributing to technical decisions and platform architecture.

Your Skills & Experience

A successful Data Engineer will have the following skills and experience:

• Strong experience building and supporting cloud-based data platforms.


• Advanced Python, SQL, and Apache Spark expertise.


• Experience with modern lakehouse technologies such as Apache Iceberg, Delta Lake, or Apache Hudi.


• Strong understanding of data modelling, warehousing, and CDC patterns.


• Experience building scalable, event-driven data solutions.


• Knowledge of CI/CD, infrastructure as code, and data governance best practices.