Data Engineer - Hybrid - Can be Full Time or Contract-to-Hire

Genesis10; Eagan (MN); Hybrid; USD 109,000 - 123,000; Full time

Benefits offered by this job

Health Insurance

Dental

Vision

401K

Sick Pay

Commuter Benefits

Job summary

Genesis10 is seeking a Data Engineer for a Regional Health Insurance Provider in Eagan, MN. The role focuses on designing and maintaining scalable cloud-based data pipelines using Python, SQL, Spark, and AWS.

Hybrid work arrangement: 2 days onsite and 3 days remote. W2 compensation ranges from $79.10 to $89.10 per hour, commensurate with experience. The candidate will collaborate with analysts and engineers to deliver enterprise data solutions.

Qualifications

• 5+ years of professional data engineering experience.
• Strong Python and SQL skills with scalable ETL/ELT experience.
• Experience with Spark, PySpark or Spark SQL.
• Experience building cloud-based data pipelines on AWS.
• Data modeling, integration, and quality best practices.
• Experience designing enterprise data pipelines.
• Ability to work independently while collaborating with teams.
• Strong analytical and communication skills.
• Experience in Agile software development.

Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines and integration solutions.
• Build ETL/ELT processes that support analytics and reporting.
• Process and transform large datasets with distributed processing technologies.
• Develop reusable data engineering components for scalability.
• Partner with analysts, product owners, and engineering teams to deliver solutions.
• Participate in solution design, architecture discussions, and reviews.
• Troubleshoot production issues and implement long-term improvements.
• Support testing, deployment, and ongoing maintenance of data solutions.
• Contribute to engineering best practices and continuous improvement.
• Participate in Agile ceremonies and cross-functional collaboration.

Skills

5+ years of data engineering

Python

SQL

Spark/PySpark

AWS

Data modeling

Data integration

Data quality

Agile

Tools

Spark

PySpark

Spark SQL

AWS

Git

Job description

Genesis10 is currently seeking a Data Engineer position with a Regional Health Insurance Provider located in Eagan, MN. This position can either be a direct hire opportunity or it can be a 6+ month contract-to-hire opportunity. This is a hybrid position - 2 days onsite, 3 days remote.

Compensation: $79.10 - $89.10 per hour, W2, based on qualifications

Position Overview

This role involves designing, developing, and maintaining scalable cloud-based data pipelines and integration solutions within the healthcare industry. The ideal candidate will build ETL/ELT processes to support enterprise analytics, working with large datasets using Python, SQL, and distributed computing technologies like Spark on the AWS platform.

Key Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines and integration solutions
• Build ETL/ELT processes that support enterprise analytics and operational reporting
• Process and transform large datasets using distributed computing technologies
• Develop reusable data engineering components that improve scalability and maintainability
• Partner with business analysts, product owners, and engineering teams to understand requirements and deliver technical solutions
• Participate in solution design, architecture discussions, and technical reviews
• Troubleshoot production issues and implement long-term improvements
• Support testing, deployment, and ongoing maintenance of enterprise data solutions
• Contribute to engineering best practices and continuous improvement initiatives
• Participate in Agile ceremonies and collaborate with cross-functional teams throughout the software development lifecycle

Primary Requirements

• 5+ years of professional data engineering experience
• Strong Python and SQL skills with experience developing scalable ETL/ELT pipelines
• Experience processing large datasets using Spark, PySpark, Spark SQL, or similar distributed processing technologies
• Experience building cloud-based data engineering solutions using AWS or equivalent cloud platforms
• Strong understanding of data modeling, data integration, and data quality best practices
• Experience designing and implementing enterprise data pipelines
• Ability to work independently while collaborating across technical teams
• Strong analytical, troubleshooting, and problem-solving skills
• Excellent verbal and written communication skills
• Experience working within Agile software development environments

Desired Skills

• Healthcare or health insurance industry experience
• Hands-on Databricks experience including notebooks, workflows, and cluster management
• Experience with AWS services including S3, Lambda, Glue, EC2, and related cloud technologies
• Experience scheduling and automating data pipelines
• Experience using Git in collaborative development environments
• Experience working with Jira, epics, and Agile workflows
• Working knowledge of UNIX/Linux scripting
• AWS certification

Only candidates available and ready to work directly as Genesis10 employees will be considered for this position.

Benefits of Working with Genesis10

• Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years
• The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years
• Access to an experienced, caring recruiting team (more than 7 years of experience, on average)
• Behavioral Health Platform
• Medical, Dental, Vision
• Health Savings Account
• Voluntary Hospital Indemnity (Critical Illness & Accident)
• Voluntary Term Life Insurance
• 401K
• Sick Pay (for applicable states/municipalities)
• Commuter Benefits (Dallas, NYC, SF, and Illinois)

Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

#DIG10-MN