Senior Data Engineer

Survey Sampling International Hyderabad Private Ltd. (India); Westport (CT); On-site; USD 130,000 - 150,000; Full time

Benefits offered by this job

Medical benefits

Discretionary incentive program

Job summary

Dynata is seeking a Senior Data Engineer to design, build, and maintain data pipelines powering the enterprise lakehouse. You will anchor the data engineering team, delivering robust ELT/ETL solutions and mentoring junior engineers.

You will design scalable batch and streaming pipelines using Spark, Kafka, and Flink, implement lakehouse architecture with Delta Lake or Iceberg, and optimize complex PySpark transformations on large datasets.

Qualifications

• 6+ years of data engineering experience with enterprise-scale delivery.
• Expert proficiency in Python and SQL; PySpark experience required.
• Hands-on experience with Spark, Delta Lake, or Iceberg.
• Experience with orchestration tools: Airflow, Prefect, or Dagster.
• Strong knowledge of cloud data services: AWS Glue, Azure Data Factory, GCP Dataflow.
• Proficiency with Git, CI/CD pipelines, and containerization (Docker/Kubernetes).
• Experience with dbt for transformation layer management.
• Bachelor's degree in Computer Science, Engineering, or related field.

Responsibilities

• Design, build, and maintain scalable data pipelines and data models.
• Implement Bronze/Silver/Gold medallion lakehouse architecture.
• Develop and optimize SQL and PySpark transformations for large datasets.
• Integrate structured, semi-structured, and unstructured data sources.
• Mentor junior engineers and participate in code reviews.
• Write Infrastructure-as-Code for pipelines (Terraform, Helm).
• Ensure data quality through tests and monitoring.

Skills

Python

SQL

Mentoring

Data engineering

Education

Bachelor's degree in CS/Engineering or related field

Tools

Apache Spark

Delta Lake

Apache Iceberg

Airflow

Prefect

Dagster

Git

CI/CD

Docker

Kubernetes

dbt

Job description

The Senior Data Engineer is responsible for designing, building, and maintaining the data pipelines, transformation layers, and data models that power the enterprise lakehouse. This role is a technical anchor on the data engineering team, delivering robust ELT/ETL solutions and serving as a mentor to junior engineers.

KEY RESPONSIBILITIES

• Design and implement scalable batch and streaming data pipelines using Apache Spark, Kafka, and Flink
• Build and maintain the Bronze/Silver/Gold medallion architecture within the lakehouse (Delta Lake / Iceberg)
• Develop and optimize complex SQL and PySpark transformations for large-scale datasets
• Integrate structured, semi-structured, and unstructured data sources into the lakehouse
• Collaborate with data architects to evolve the physical and logical data models
• Implement data quality checks and monitoring using Great Expectations or dbt tests
• Write Infrastructure-as-Code for pipeline environments (Terraform, Helm)
• Participate in code reviews and enforce engineering standards and best practices
• Troubleshoot pipeline failures, performance bottlenecks, and data incidents
• Mentor junior and mid-level data engineers and contribute to internal knowledge sharing

REQUIRED QUALIFICATIONS

• 6+ years of data engineering experience with a track record of enterprise-scale delivery
• Expert proficiency in Python and SQL; PySpark experience required
• Hands-on experience with Apache Spark, Delta Lake, or Apache Iceberg
• Experience with orchestration tools: Apache Airflow, Prefect, or Dagster
• Strong knowledge of cloud data services: AWS Glue, Azure Data Factory, GCP Dataflow
• Proficiency with version control (Git), CI/CD pipelines, and containerization (Docker/Kubernetes)
• Experience with dbt (data build tool) for transformation layer management
• Bachelor's degree in Computer Science, Engineering, or related technical field

PREFERRED QUALIFICATIONS

• Experience with Databricks, Snowflake, or Apache Hudi
• Knowledge of streaming architectures and Apache Kafka
• Certifications: Databricks Certified Data Engineer, AWS Data Analytics Specialty

At Dynata, we deliver the highest quality first-party data to help businesses around the world gain precise insights, activate the right audiences, and confidently measure impact. With industry-leading respondent accuracy, reliability, and a commitment to continuous improvement, Dynata is the trusted foundation for smarter decision-making.

At Dynata, we are committed to creating an inclusive and accessible environment where every employee and customer feels valued, respected, and supported. We strive to build a workforce that reflects the diversity of the communities we serve. Dynata welcomes and encourages applications from individuals with disabilities and is dedicated to fostering a work culture that supports everyone. Accommodations are available upon request for all aspects of the selection process. Dynata is an Equal Opportunity Employer. We consider all qualified applicants and employees without regard to race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, marital status, age, disability, genetic information, veteran status, or any other legally protected status under applicable laws.

The base salary range for this position in is $130K-$150K/yr; however, base pay offered may vary depending on location, job-related knowledge, skills, and experience. A discretionary incentive program may be provided as part of the compensation package, in addition to a full range of medical and other benefits, dependent on full-time employment status.

Who we are At Dynata, we deliver the highest quality first-party data to help businesses around the world gain precise insights, activate the right audiences, and confidently measure impact. With industry-leading respondent accuracy, reliability, and a commitment to continuous improvement, Dynata is the trusted foundation for smarter decision-making. At Dynata, your work directly influences how the world's leading organizations understand people, markets, and behavior.

About our culture Our culture is rooted in inspiration, collaboration, and a drive for excellence. At Dynata, a career is more than just a job it's a place where your work matters, your voice is heard, and your growth is supported every step of the way. Whether you're passionate about innovation, driven to make a difference, or excited to join a collaborative team that puts integrity and impact at the center of everything we do, you'll find your next chapter here. We provide A collaborative, inclusive culture that values expertise, curiosity, and ownership. The chance to make a measurable impact on how insights are created and trusted. Competitive compensation, benefits, and opportunities for growth.

We recently won the 2026 Association for Talent Development BEST award

We are honored to be recipients of the 2026 Association for Talent Development (ATD) BEST Award, one of the industry's most prestigious recognitions for excellence in talent development. Receiving this distinction validates our intentional investment in fostering a supportive and empowering environment for our team members.

At Dynata, we don't just talk about development—we put it into action. Every April, our global Power Your Career conference brings together employees from around the world to connect, learn, and grow. Our experiential High-Potential Program provides rising leaders with immersive, hands-on opportunities for professional development, ensuring our next generation of talent is ready to make a difference. Additionally, our Leadership Challenges equip managers and future leaders with the skills and insights necessary to drive quality and excellence throughout the organization.