Senior Data Engineer - Spark/Databricks, BI (Remote)

Milliman, Inc; Indianapolis (IN); On-site; USD 98,000 - 198,000; Full time

Benefits offered by this job

Medical, dental and vision coverage

401(k) plan with matching

PTO 15 days/year

Holidays and life insurance

Flexible spending accounts

Job summary

MedInsight, a Milliman subsidiary, seeks a seasoned Senior Data Engineer skilled in Spark and SQL to lead the design and enhancement of our data infrastructure. Python, healthcare data, and Power BI semantic models are advantageous.

The candidate should demonstrate passion for data-driven solutions and high standards. Collaborate with analytics and business teams to craft efficient data models for BI tools, ensure data quality and regulatory compliance, and drive data reporting improvements.

Qualifications

• Bachelor's degree preferred; substantial relevant experience will be considered.
• Minimum of 5 years of proven experience as a Data Engineer with strong command of Databricks/Spark.
• Proficiency in SQL and data modeling, warehousing, and ETL pipelines.

Responsibilities

• Develop and uphold scalable data architectures using Databricks and Spark.
• Execute advanced data manipulation and querying tasks with SQL.
• Optimize data pipelines and architectures for high-volume processing using Spark.
• Collaborate with analytics and business teams to craft efficient data models for BI tools.
• Uphold data quality, security, and regulatory compliance.
• Leverage Python, healthcare data experience, and Power BI semantic models to enhance data solutions.
• Stay informed on trends in data engineering and BI.

Skills

Databricks/Spark

SQL

Power BI Semantic Models

Python

Healthcare data

Data modeling

ETL pipelines

Cloud services

Analytical thinking

Communication

Education

Bachelor's degree in Computer Science/Engineering/Mathematics or related field

Tools

Databricks

Spark

Power BI

Job description

MedInsight, a Milliman subsidiary, seeks a seasoned Senior Data Engineer skilled in Spark and SQL to lead the design and enhancement of our data infrastructure. Python, healthcare data, and Power BI semantic models are advantageous.

The candidate should demonstrate passion for data-driven solutions and high standards. Collaborate with analytics and business teams to craft efficient data models for BI tools, ensure data quality and regulatory compliance, and drive data reporting improvements.