Remote Data Engineer: Databricks Medallion Pipelines

GovCIO; Concord (NH); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

Employee Assistance Program (EAP)

Corporate Discounts

Learning & Development platform

Training, Education and Certification

Referral Bonus Program

Internal Mobility Program

Pet Insurance

Flexible Work Environment

Job summary

GovCIO is seeking a Data Engineer to design and build enriched datasets using the medallion architecture in Databricks, sourcing from the VA CDW and internal/external systems. You will feed analytics-ready data into Power BI models and work closely with stakeholders to gather requirements and deliver quality pipelines remotely.

The role requires 12+ years of experience with Databricks (PySpark/SQL), strong SQL, Power BI data prep, and GitHub/JIRA proficiency, along with excellent client

Qualifications

• Bachelor's degree and 12+ years of experience (or commensurate experience).
• Hands-on experience building data pipelines and transformations in Databricks (PySpark and/or SQL).
• Strong SQL skills, including complex joins, aggregations, and performance tuning.
• Experience working with Power BI, including preparing data for semantic models.
• Familiarity with GitHub for version control and collaborative development.
• Experience using JIRA to track and manage work.
• Strong communication skills and comfort working directly with clients/stakeholders.
• Understanding of medallion (bronze/silver/gold) data architecture principles.

Responsibilities

• Design, build, and maintain enriched datasets following medallion architecture in Databricks.
• Develop, orchestrate, and monitor Databricks jobs and pipelines.
• Write efficient, well-structured SQL to transform and model healthcare data.
• Prepare and optimize gold-layer datasets for Power BI semantic models.
• Manage code and version control through GitHub, following team practices.
• Log, track, and update work items in JIRA.
• Collaborate with clients and stakeholders to understand requirements and validate outputs.
• Troubleshoot data quality issues and ensure dataset accuracy.

Skills

SQL

Power BI

Data pipelines

Data quality

Stakeholder communication

Medallion architecture

GitHub

JIRA

Communication

Education

Bachelor's degree in a relevant field

Tools

Databricks

PySpark

Job description

GovCIO is seeking a Data Engineer to design and build enriched datasets using the medallion architecture in Databricks, sourcing from the VA CDW and internal/external systems. You will feed analytics-ready data into Power BI models and work closely with stakeholders to gather requirements and deliver quality pipelines remotely.

The role requires 12+ years of experience with Databricks (PySpark/SQL), strong SQL, Power BI data prep, and GitHub/JIRA proficiency, along with excellent client