Senior Cloud Data Engineer - ETL, Spark & AWS (Hybrid)

Genesis10; Eagan (MN); Hybrid; USD 109,000 - 123,000; Full time

Benefits offered by this job

Health Insurance

Dental

Vision

401K

Sick Pay

Commuter Benefits

Job summary

Genesis10 is seeking a Data Engineer for a Regional Health Insurance Provider in Eagan, MN. The role focuses on designing and maintaining scalable cloud-based data pipelines using Python, SQL, Spark, and AWS.

Hybrid work arrangement: 2 days onsite and 3 days remote. W2 compensation ranges from $79.10 to $89.10 per hour, commensurate with experience. The candidate will collaborate with analysts and engineers to deliver enterprise data solutions.

Qualifications

• 5+ years of professional data engineering experience.
• Strong Python and SQL skills with scalable ETL/ELT experience.
• Experience with Spark, PySpark or Spark SQL.
• Experience building cloud-based data pipelines on AWS.
• Data modeling, integration, and quality best practices.
• Experience designing enterprise data pipelines.
• Ability to work independently while collaborating with teams.
• Strong analytical and communication skills.
• Experience in Agile software development.

Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines and integration solutions.
• Build ETL/ELT processes that support analytics and reporting.
• Process and transform large datasets with distributed processing technologies.
• Develop reusable data engineering components for scalability.
• Partner with analysts, product owners, and engineering teams to deliver solutions.
• Participate in solution design, architecture discussions, and reviews.
• Troubleshoot production issues and implement long-term improvements.
• Support testing, deployment, and ongoing maintenance of data solutions.
• Contribute to engineering best practices and continuous improvement.
• Participate in Agile ceremonies and cross-functional collaboration.

Skills

5+ years of data engineering

Python

SQL

Spark/PySpark

AWS

Data modeling

Data integration

Data quality

Agile

Tools

Spark

PySpark

Spark SQL

AWS

Git

Job description

Genesis10 is seeking a Data Engineer for a Regional Health Insurance Provider in Eagan, MN. The role focuses on designing and maintaining scalable cloud-based data pipelines using Python, SQL, Spark, and AWS.

Hybrid work arrangement: 2 days onsite and 3 days remote. W2 compensation ranges from $79.10 to $89.10 per hour, commensurate with experience. The candidate will collaborate with analysts and engineers to deliver enterprise data solutions.