Data Engineer: Medallion Databricks, Fully Remote

GovCIO; Olympia (WA); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

Employee Assistance Program (EAP)

Corporate Discounts

Learning & Development platform

Certification Assistance

Referral Bonus Program

Internal Mobility Program

Pet Insurance

Flexible Work Environment

Job summary

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture in Databricks, sourced from the VA CDW and other systems. You will create analytics-ready data for Power BI models, collaborate with clients, and manage pipelines with JIRA and GitHub in a fully remote role.

You will work with healthcare data across the Veterans Affairs ecosystem, ensuring data quality and providing outputs for stakeholders. Prior VA or VHA familiarity is a strong plus.

Qualifications

• Bachelors degree and 12+ years of experience (or commensurate experience).
• Hands-on experience building data pipelines and transformations in Databricks (PySpark and/or SQL).
• Strong SQL skills, including complex joins, aggregations, and performance tuning.
• Experience working with Power BI, including preparing data for semantic models.
• Familiarity with GitHub for version control and collaborative development.
• Experience using JIRA or similar tools to track and manage work.
• Strong communication skills and comfort working directly with clients/stakeholders.
• Understanding of medallion (bronze/silver/gold) data architecture principles.

Responsibilities

• Design, build, and maintain enriched datasets following medallion architecture (bronze, silver, gold layers) in Databricks.
• Develop, orchestrate, and monitor Databricks jobs and pipelines.
• Write efficient, well-structured SQL to transform and model healthcare data.
• Prepare and optimize gold-layer datasets for consumption by Power BI semantic models.
• Manage code and version control through GitHub, following team branching and review practices.
• Log, track, and update work items in JIRA.
• Partner directly with clients and stakeholders to understand requirements, clarify data definitions, and validate outputs.
• Troubleshoot data quality issues and ensure accuracy and consistency across pipelines.
• Write ad hoc queries to support client requests, investigations, and one-off analyses.
• Perform data validation and quality assurance checks on pipelines and enriched datasets to ensure accuracy, completeness, and consistency.
• Document data lineage, transformation logic, and business rules for enriched datasets.
• Collaborate with Power BI developers and data scientists on the broader team to ensure datasets meet downstream reporting and analytical needs.

Skills

Databricks

PySpark/SQL

SQL

Power BI

JIRA

GitHub

Communication

Medallion architecture

Education

Bachelor's degree

12+ years experience

Tools

Databricks

JIRA

GitHub

Job description

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture in Databricks, sourced from the VA CDW and other systems. You will create analytics-ready data for Power BI models, collaborate with clients, and manage pipelines with JIRA and GitHub in a fully remote role.

You will work with healthcare data across the Veterans Affairs ecosystem, ensuring data quality and providing outputs for stakeholders. Prior VA or VHA familiarity is a strong plus.