A technology consulting company is seeking an AWS Data Engineer with over 10 years of experience in data engineering, particularly in data warehouse implementations. The candidate must have substantial experience with AWS technology, including PySpark and Glue, and a solid understanding of data governance and data quality frameworks. This position focuses on building and optimizing ETL pipelines and ensuring data integrity.
Qualifications
10+ years of specialization in data engineering.
4 years of relevant experience in AWS technologies.
Hands-on expertise in data modelling and ETL pipelines.
Skills
Data engineering in data warehouse
AWS tech stack (PySpark, Glue, EMR, SQL)
Kafka and Kinesis data streams
Data governance and validation frameworks
Job description
AWS Data Engineer
Skill Matrix: Overall 10+ years of specialization in data engineering in data warehouse and data mesh implementations
Must have 4 years of relevant experience in AWS tech stack - Writing PySpark, AWS Glue scripting (ETL & Crawler), EMR, Datasync, DMS, SQL, Redshift
Possesses experience in technologies such change data capture(CDC), data quality, Kafka and Kinesis data streams, Airflow, Step Functions, and Lambda
Knowledge on table formats such as Iceberg and Delta tables
Has experience in metadata management building data catalog in alignment with business glossary
Has knowledge of data governance aspects such as data lineage, data quality.Should have built data validation frameworks to reconcile source and target data
Hands‑on expertise with data modelling, ETL pipelines, and performance optimization.
Solid background in Data Warehousing concepts (star/snowflake schema design, dimensional modelling, and reporting enablement)