Data Engineer – Hybrid (Can be Full Time or Contract-to-Hire)

Genesis10; Eagan (MN); Hybrid; USD 109,000 - 123,000; Full time

Benefits offered by this job

Medical, Dental, Vision

Health Savings Account

401K

Sick Pay

Job summary

Genesis10 is seeking a Data Engineer for a regional health insurance provider located in Eagan, Minnesota. The role is hybrid (2 days onsite, 3 days remote) with W2 compensation between $79.10 and $89.10 per hour, depending on qualifications.

Direct hire or 6-month contract-to-hire options are available. You will design and maintain cloud-based data pipelines on AWS, work with Python, SQL, Spark, and large datasets to enable enterprise analytics.

Qualifications

• 5 years of professional data engineering experience.
• Strong Python and SQL skills with scalable ETL/ELT pipelines.
• Experience processing large datasets using Spark/PySpark/Spark SQL.
• Experience building cloud-based data pipelines on AWS.
• Strong understanding of data modeling, data integration, and data quality best practices.

Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines and integration solutions.
• Build ETL/ELT processes that support enterprise analytics and operational reporting.
• Process and transform large datasets using distributed computing technologies.
• Develop reusable data engineering components that improve scalability and maintainability.
• Collaborate with analysts, product owners, and engineers to understand requirements and deliver technical solutions.
• Participate in solution design, architecture discussions, and technical reviews.

Skills

Python

SQL

Spark / PySpark

AWS

ETL/ELT pipelines

Data modeling

Analytics

Communication

Agile

Independent work

Tools

Databricks

Git

Jira

Unix/Linux

AWS services (S3, Lambda, Glue, EC2)

Job description

Genesis10 is currently seeking a Data Engineer position with a Regional Health Insurance Provider located in Eagan, MN. This position can either be a direct hire opportunity or it can be a 6 month contract-to-hire opportunity. This is a hybrid position – 2 days onsite, 3 days remote.
Compensation: $79.10 – $89.10 per hour, W2, based on qualifications

Position Overview

This role involves designing, developing, and maintaining scalable cloud-based data pipelines and integration solutions within the healthcare industry. The ideal candidate will build ETL/ELT processes to support enterprise analytics, working with large datasets using Python, SQL, and distributed computing technologies like Spark on the AWS platform.

Key Responsibilities

• Design, develop, and maintain scalable cloud-based data pipelines and integration solutions
• Build ETL/ELT processes that support enterprise analytics and operational reporting
• Process and transform large datasets using distributed computing technologies
• Develop reusable data engineering components that improve scalability and maintainability
• Partner with business analysts, product owners, and engineering teams to understand requirements and deliver technical solutions
• Participate in solution design, architecture discussions, and technical reviews
• Troubleshoot production issues and implement long-term improvements
• Support testing, deployment, and ongoing maintenance of enterprise data solutions
• Contribute to engineering best practices and continuous improvement initiatives
• Participate in Agile ceremonies and collaborate with cross-functional teams throughout the software development lifecycle

Primary Requirements

• 5 years of professional data engineering experience
• Strong Python and SQL skills with experience developing scalable ETL/ELT pipelines
• Experience processing large datasets using Spark, PySpark, Spark SQL, or similar distributed processing technologies
• Experience building cloud-based data engineering solutions using AWS or equivalent cloud platforms
• Strong understanding of data modeling, data integration, and data quality best practices
• Experience designing and implementing enterprise data pipelines
• Ability to work independently while collaborating across technical teams
• Strong analytical, troubleshooting, and problem-solving skills
• Excellent verbal and written communication skillsExperience working within Agile software development environments

Desired Skills

• Healthcare or health insurance industry experience
• Hands-on Databricks experience including notebooks, workflows, and cluster management
• Experience with AWS services including S3, Lambda, Glue, EC2, and related cloud technologies
• Experience scheduling and automating data pipelines
• Experience using Git in collaborative development environments
• Experience working with Jira, epics, and Agile workflows
• Working knowledge of UNIX/Linux scripting
• AWS certification

Only candidates available and ready to work directly as Genesis10 employees will be considered for this position.

Benefits of Working with Genesis10

• Access to hundreds of clients, most who have been working with Genesis10 for 5-20 years
• The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years
• Access to an experienced, caring recruiting team (more than 7 years of experience, on average)
• Behavioral Health Platform
• Medical, Dental, Vision
• Health Savings Account
• Voluntary Hospital Indemnity (Critical Illness & Accident)
• Voluntary Term Life Insurance
• 401K
• Sick Pay (for applicable states/municipalities)
• Commuter Benefits (Dallas, NYC, SF, and Illinois)

Genesis10 is an Equal Opportunity Employer. Candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

DIG10-MN