Remote Data Engineer: AWS Pipelines & Quality

Edvwerke; Indiana (PA); Remote; USD 80,000 - 120,000; Full time

Benefits offered by this job

Competitive salary with bonuses

Opportunities for professional development

Dynamic collaborative work environment

Job summary

Edvwerke is looking for a Data Engineer to develop and maintain AWS-based data pipelines. The role involves optimizing data models, enhancing features, and ensuring data quality through automated checks.

The ideal candidate has strong Python development skills, solid SQL abilities, and hands-on experience with AWS services. They will need to communicate effectively with stakeholders and maintain versioned code in Git.

This position offers a competitive salary, performance-based bonuses, and opportunities for professional development.

Qualifications

• Strong coding experience in Python or similar languages using Test-Driven Development practices.
• Solid SQL skills for designing efficient schemas and managing structured datasets.
• Hands-on experience with AWS services like Athena, Lambda, Aurora.
• Experience designing and maintaining scalable data pipelines.
• Experience implementing automated data validation and quality checks.

Responsibilities

• Develop and maintain AWS-based data pipelines including Lambda processing jobs.
• Modify existing Lambda functions to support new data processing features.
• Refactor pipelines to reliably ingest and process external data sources.
• Implement automated validation checks ensuring data accuracy and completeness.
• Design optimized data models using Iceberg format.

Skills

Python Development Expertise

SQL & Data Modeling Skills

AWS Data Platform Experience

Data Pipeline Engineering

Data Quality & Validation Knowledge

Communication Skills

Ownership Mindset

Analytical & Problem-Solving Skills

Job description

Edvwerke is looking for a Data Engineer to develop and maintain AWS-based data pipelines. The role involves optimizing data models, enhancing features, and ensuring data quality through automated checks.

The ideal candidate has strong Python development skills, solid SQL abilities, and hands-on experience with AWS services. They will need to communicate effectively with stakeholders and maintain versioned code in Git.

This position offers a competitive salary, performance-based bonuses, and opportunities for professional development.