AWS Data Engineer

TechDigital Group; Charlotte (NC); Vor Ort; USD 100.000 - 140.000; Vollzeit

Zusammenfassung

A technology consulting company is seeking an AWS Data Engineer with over 10 years of experience in data engineering, particularly in data warehouse implementations. The candidate must have substantial experience with AWS technology, including PySpark and Glue, and a solid understanding of data governance and data quality frameworks. This position focuses on building and optimizing ETL pipelines and ensuring data integrity.

Qualifikationen

• 10+ years of specialization in data engineering.
• 4 years of relevant experience in AWS technologies.
• Hands-on expertise in data modelling and ETL pipelines.

Kenntnisse

Data engineering in data warehouse

AWS tech stack (PySpark, Glue, EMR, SQL)

Kafka and Kinesis data streams

Data governance and validation frameworks

Jobbeschreibung

AWS Data Engineer

• Skill Matrix: Overall 10+ years of specialization in data engineering in data warehouse and data mesh implementations
• Must have 4 years of relevant experience in AWS tech stack - Writing PySpark, AWS Glue scripting (ETL & Crawler), EMR, Datasync, DMS, SQL, Redshift
• Possesses experience in technologies such change data capture(CDC), data quality, Kafka and Kinesis data streams, Airflow, Step Functions, and Lambda
• Knowledge on table formats such as Iceberg and Delta tables
• Has experience in metadata management building data catalog in alignment with business glossary
• Has knowledge of data governance aspects such as data lineage, data quality.Should have built data validation frameworks to reconcile source and target data
• Hands‑on expertise with data modelling, ETL pipelines, and performance optimization.
• Solid background in Data Warehousing concepts (star/snowflake schema design, dimensional modelling, and reporting enablement)