Lead Data Engineer

TechDigital Group; United States; On-site; USD 100,000 - 120,000; Full time

Job summary

A leading tech organization is seeking a Data Engineer with 3–5 years of experience. The ideal candidate will have strong expertise in ETL pipelines and distributed data processing, especially within the AWS ecosystem. Proficiency in Python and SQL is required, along with experience in optimizing Amazon Redshift. This role focuses on enhancing data workflows and performance optimization.

Qualifications

• 3–5 years of experience in data engineering.
• Hands-on expertise with data modeling, ETL pipelines, and performance optimization.
• Experience with Redshift performance tuning and schema design.

Skills

Data engineering experience

Distributed data processing

ETL pipelines

Python

SQL

Data Warehousing concepts

Cloud experience

Tools

AWS Glue

Spark

Amazon Redshift

Airflow

Job description

Qualifications

• 3–5 years of experience in data engineering.
• Strong experience with distributed data processing (Spark, AWS Glue, EMR, or equivalent).
• Hands-on expertise with data modeling, ETL pipelines, and performance optimization.
• Strong hands-on expertise in building and optimizing ETL pipelines into Amazon Redshift
• Proficiency in Python, PySpark and SQL; familiarity with Iceberg tables preferred.
• Solid background in Data Analysis and Data Warehousing concepts (star/snowflake schema design, dimensional modeling, and reporting enablement).
• Orchestration experience with Airflow, Step Functions, and Lambda
• Experience with Redshift performance tuning, schema design, and workload management.
• Cloud experience (AWS ecosystem preferred).