Remote Data Engineer – Databricks & Medallion Analytics

GovCIO; Madison (WI); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

EAP

Corporate discounts

Learning platform

Certification assistance

Referral bonuses

Internal mobility

Pet insurance

Flexible work environment

Job summary

GovCIO is hiring a Data Engineer to design and build enriched datasets using the medallion architecture in Databricks, sourcing data from the VA CDW and other systems. The datasets feed Power BI semantic models used by stakeholders across the organization.

You will work with clients to gather requirements, track work in JIRA, and deliver high-quality pipelines, with full remote work from the United States. Strong SQL, PySpark, and Power BI experience are essential.

Qualifications

• Bachelor's degree and 12+ years of experience.
• Hands-on Databricks (PySpark and/or SQL) experience.
• Strong SQL skills with complex joins, aggregations, and performance tuning.
• Experience with Power BI semantic models.
• GitHub version control experience.
• JIRA or similar project tracking experience.
• Strong client communication skills.
• Understanding of medallion data architecture principles.

Responsibilities

• Design, build, and maintain datasets in Databricks following medallion architecture (bronze, silver, gold).
• Develop, orchestrate, and monitor Databricks jobs and pipelines.
• Write efficient SQL to transform and model healthcare data.
• Prepare and optimize gold-layer datasets for Power BI semantic models.
• Manage code and version control through GitHub with team review practices.
• Log, track, and update work items in JIRA.
• Collaborate with clients to understand requirements and data definitions.
• Troubleshoot data quality issues and ensure accuracy across pipelines.
• Write ad hoc queries to support client requests and analyses.
• Perform data validation and quality checks on pipelines.
• Document data lineage, transformation logic, and business rules.
• Collaborate with Power BI developers and data scientists.

Skills

Databricks PySpark

SQL skills

Power BI

GitHub

JIRA

Clear communication

Medallion architecture

Data modeling

Education

Bachelors degree + 12+ yrs

Tools

Databricks

Python

GitHub

JIRA

Job description

GovCIO is hiring a Data Engineer to design and build enriched datasets using the medallion architecture in Databricks, sourcing data from the VA CDW and other systems. The datasets feed Power BI semantic models used by stakeholders across the organization.

You will work with clients to gather requirements, track work in JIRA, and deliver high-quality pipelines, with full remote work from the United States. Strong SQL, PySpark, and Power BI experience are essential.