AWS Data Engineer

Qode

United States

On-site

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Qode is seeking an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines on AWS. You will collaborate with analysts, stakeholders, and data scientists to ensure data quality and cost-efficient storage.

Expertise with Databricks and AWS-native technologies is essential for robust data transformations and processing. The role focuses on modernizing data platforms, migrating workflows to the cloud, and implementing security controls.

Qualifications

  • 10+ years of experience in data engineering on AWS platforms.
  • Proficiency building robust data pipelines using AWS native services.
  • Strong experience with Snowflake for data transformations and scalable processing.
  • Experience with streaming and batch data pipelines architectures.
  • Familiarity with DataOps, CI/CD pipelines on AWS, and source control.
  • Hands-on Databricks experience and willingness to grow capabilities.
  • Experience with data storage solutions (S3, Redshift, Glue, EMR).
  • Knowledge of secure data handling (KMS, Macie).
  • Knowledge of BI integrations (Power BI/Tableau/QuickSight).
  • Graduate/Post-Graduate degree in CS or related field.

Responsibilities

  • Lead and support modernization of data platform projects on AWS.
  • Design and develop scalable data pipelines using AWS native services.
  • Optimize ETL processes for performance and cost-efficiency.
  • Migrate workflows from on-premise to AWS cloud with data quality in mind.
  • Create automations to resolve data inconsistencies and automate workflows.
  • Perform system testing and validation for data integrations.
  • Implement security and compliance controls in cloud environments.
  • Collaborate with architects to document data movement and automation strategies.

Skills

AWS
Python
Snowflake
S3/Redshift
Databricks
DataOps
CI/CD
Dataiku
FHIR
Multi-account AWS

Education

Graduate degree in Computer Science

Tools

AWS Glue
EMR
Lambda
KMS
Macie
Power BI
Tableau
QuickSight

Job description

Job BriefAs an AWS Data Engineer, your role will be to design, develop, and maintain scalable data pipelines on AWS. You will work closely with technical analysts, client stakeholders, data scientists, and other team members to ensure data quality and integrity while optimizing data storage solutions for performance and cost-efficiency. This role requires leveraging AWS native technologies and Databricks for data transformations and scalable data processing.

Responsibilities
  • Lead and support the delivery of data platform modernization projects.
  • Design and develop robust and scalable data pipelines leveraging AWS native services.
  • Optimize ETL processes, ensuring efficient data transformation.
  • Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency.
  • Design automations and integrations to resolve data inconsistencies and quality issues
  • Perform system testing and validation to ensure successful integration and functionality.
  • Implement security and compliance controls in the cloud environment.
  • Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets.
  • Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.
Skills and Requirements
  • 10+ years’ experience with a core data engineering skillset leveraging AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).
  • Experience in the design and development of robust and scalable data pipelines leveraging AWS native services.
  • Proficiency in leveraging Snowflake for data transformations, optimization of ETL pipelines, and scalable data processing.
  • Experience with streaming and batch data pipeline/engineering architectures.
  • Familiarity with DataOps concepts and tooling for source control and setting up CI/CD pipelines on AWS.
  • Hands-on experience with Databricks and a willingness to grow capabilities.
  • Experience with data engineering and storage solutions (AWS Glue, EMR, Lambda, Redshift, S3).
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is needed
  • Graduate/Post-Graduate degree in Computer Science or a related field.
  • AWS S3 (data storage, export, recall)
  • Athena (querying data lakes)
  • Data pipelines (batch & near-real-time)
  • Integration with external systems (FHIR)
  • Secure data handling (KMS, Macie)
  • Cloud-native analytics
  • Multi-account, multi-region data architecture
  • BI integrations: Power BI, Tableau, QuickSight
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

The Value Maximizer • South Carolina

On-site
USD 90,000 - 120,000
Data Engineer
Data Engineer

Advanced Tech Placement • Atlanta (GA)

On-site
USD 120,000 - 150,000
AWS Data Engineer
AWS Data Engineer

TechDigital Group • Edison (NJ)

On-site
USD 90,000 - 120,000
AWS Data Engineer
AWS Data Engineer

TechDigital Group • Charlotte (NC)

On-site
USD 100,000 - 140,000
AWS
AWS

Trantor • United States

Remote
USD 120,000 - 150,000
Data Engineer
Data Engineer

Applied Resource Group • Atlanta (GA)

On-site
USD 110,000 - 130,000
AWS Data Engineer
AWS Data Engineer

TechDigital Group • Raleigh (NC)

On-site
USD 100,000 - 130,000
Data Engineer
Data Engineer

Compunnel Inc. • Boston (MA)

On-site
USD 110,000 - 140,000
AWS Data Engineer
AWS Data Engineer

Compunnel Inc. • Pennsylvania

On-site
USD 120,000 - 150,000
AWS Big Data Lead Software Engineer
AWS Big Data Lead Software Engineer

Testing Site - JPMC • Columbus (OH)

On-site
USD 90,000 - 130,000