Lead Big Data Engineer – Remote (Spark/Databricks)

UnitedHealth Group; Eden Prairie (MN); Remote; USD 112,700 - 193,200; Full time

Benefits offered by this job

Comprehensive benefits package

Equity stock purchase plan

401k contribution

Job summary

UnitedHealth Group is seeking a highly experienced software professional to design and deliver scalable big data solutions. You will contribute across Spark, Databricks, Hadoop, and Snowflake ecosystems, building APIs and partnering with cross-functional teams.

The role emphasizes mentoring, agile practices, and proactive learning to stay ahead in a dynamic healthcare technology environment. Remote work from anywhere in the U.S. is supported with in-office requirements in select areas.

Qualifications

• Undergraduate degree or equivalent experience.
• 10+ years of hands-on software development experience.
• 5+ years of experience in distributed systems technologies like Spark, Databricks, Hadoop, Snowflake.
• 5+ years of experience in relational databases (SQL).
• 5+ years of experience in API development with Python or Java.
• 3+ years of experience in infrastructure services on at least one major cloud platform (Azure preferred).
• 1+ years of experience in scaling tools, such as ADF/Airflow.
• Demonstrated experience mentoring and helping others grow.
• Experience with Agile/SCRUM methodology.

Responsibilities

• Design, code, test, document, and maintain high-quality and scalable big data solutions.
• Help drive agile processes and mentor junior level members of the team.
• Research, evaluate, and deploy new tools, frameworks and patterns to help build a sustainable big data platform.
• Identify gaps and opportunities for improvement of existing solutions.
• Define and develop APIs for integration with various data sources in the enterprise.
• Translate customer requirements into solution design.
• Make accurate development effort estimates to assist management in project and resource planning.
• Collaborate with management, quality assurance, architecture, and other development teams.
• Write technical documentation and participate in production support.
• Participate with prototypes as well as design and code reviews.
• Keep skills up to date through ongoing self-directed training.
• The ideal candidate will be a self-starter who can learn quickly and be actively engaged.

Skills

Scala

Python

JSON

Web Services

Spark

Databricks

Hadoop

Snowflake

SQL

API development

Azure

Airflow

Mentoring

Agile/SCRUM

Education

Bachelor's degree or equivalent experience

Tools

Docker

Kubernetes

Kafka

NoSQL databases

Job description

UnitedHealth Group is seeking a highly experienced software professional to design and deliver scalable big data solutions. You will contribute across Spark, Databricks, Hadoop, and Snowflake ecosystems, building APIs and partnering with cross-functional teams.

The role emphasizes mentoring, agile practices, and proactive learning to stay ahead in a dynamic healthcare technology environment. Remote work from anywhere in the U.S. is supported with in-office requirements in select areas.