Senior Data Engineer - Lakehouse & Pipeline Architect

Dynata; Westport (CT); On-site; USD 130,000 - 150,000; Full time

Benefits offered by this job

Medical benefits

Discretionary incentive program

Job summary

Dynata is seeking a Senior Data Engineer to design, build, and operate scalable data pipelines and data models powering the enterprise lakehouse. This role is a technical anchor on the data engineering team, delivering robust ELT/ETL solutions and mentoring junior engineers.

You will work with Spark, Kafka, Delta Lake/Iceberg, and cloud services across AWS, Azure, and GCP, implementing data quality checks and IaC with Terraform and Helm.

Qualifications

• 6+ years of data engineering experience with enterprise-scale delivery.
• Expert proficiency in Python and SQL; PySpark experience required.
• Hands-on with Spark, Delta Lake or Iceberg, and orchestration tools.
• Cloud data services expertise and containerization capabilities.

Responsibilities

• Design and build scalable batch and streaming data pipelines.
• Maintain lakehouse architectures and data models.
• Develop SQL and PySpark transformations for large datasets.
• Implement data quality checks and monitoring.
• Write IaC for pipeline environments and participate in code reviews.
• Mentor junior engineers and contribute to knowledge sharing.

Skills

Python

SQL

PySpark

Apache Spark

Kafka

Flink

Airflow

Prefect

Dagster

Delta Lake

Iceberg

dbt

Terraform

Helm

Git

Docker

Kubernetes

Education

Bachelor's degree in Computer Science, Engineering, or related technical field

Tools

Apache Spark

Delta Lake

Iceberg

Airflow

Prefect

Dagster

dbt

Terraform

Helm

Job description

Dynata is seeking a Senior Data Engineer to design, build, and operate scalable data pipelines and data models powering the enterprise lakehouse. This role is a technical anchor on the data engineering team, delivering robust ELT/ETL solutions and mentoring junior engineers.

You will work with Spark, Kafka, Delta Lake/Iceberg, and cloud services across AWS, Azure, and GCP, implementing data quality checks and IaC with Terraform and Helm.