Senior Data Engineer: Python Pipelines & Airflow

Hyundai Autoever America; Irvine (CA); On-site; USD 97,000 - 138,000; Full time

Benefits offered by this job

Medical/dental coverage

Generous PTO

Education assistance

Annual merit increase eligibility

Job summary

Hyundai AutoEver America (HAEA) seeks a Senior Data Engineer in Irvine, CA to design and build scalable Python-based data pipelines and Airflow workflows. You will implement Medallion Architecture and robust ETL/ELT solutions, ingesting data from diverse sources to support analytics and ML use cases.

You will collaborate with data scientists, analysts, and stakeholders to ensure data quality, governance, and scalable data platforms across cloud environments.

Qualifications

• 7+ years of experience in data warehouse or MDM applications.
• Bachelor's degree in computer science, Information Technology, or related field.
• Extensive knowledge of SQL and experience with relational databases.
• Strong programming and scripting skills, including Python and PL/SQL.
• Hands-on experience developing ETL/ELT data pipelines and supporting production data workloads.

Responsibilities

• Design, develop, and maintain scalable Python-based data pipelines for ingesting, processing, and transforming large volumes of data.
• Build and manage data workflows using Apache Airflow, including scheduling, monitoring, alerting, and troubleshooting production jobs.
• Implement and support Medallion Architecture (Bronze, Silver, Gold) data layers for efficient processing and analytics.
• Develop robust ETL/ELT solutions to ingest data from databases, APIs, flat files, streaming sources, and third-party systems into enterprise data platforms.
• Create reusable Python frameworks and libraries to standardize data ingestion, transformation, validation, and monitoring processes.
• Apply data quality checks, validation rules, and reconciliation processes to ensure data reliability.

Skills

Python

Apache Airflow

SQL

PL/SQL

ETL/ELT

Data pipelines

Lakehouse architecture

Medallion Architecture

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Lake

AWS

GCP

Spark/PySpark

Git

CI/CD

Job description

Hyundai AutoEver America (HAEA) seeks a Senior Data Engineer in Irvine, CA to design and build scalable Python-based data pipelines and Airflow workflows. You will implement Medallion Architecture and robust ETL/ELT solutions, ingesting data from diverse sources to support analytics and ML use cases.

You will collaborate with data scientists, analysts, and stakeholders to ensure data quality, governance, and scalable data platforms across cloud environments.