Remote Data Engineer - Databricks Medallion Architect

GovCIO; Augusta (ME); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

EAP

Corporate Discounts

Learning & Development

Certification Assistance

Referral Bonus Program

Internal Mobility Program

Pet Insurance

Flexible Work Environment

Job summary

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture (bronze/silver/gold) in Databricks, sourcing data from the VA Corporate Data Warehouse and other internal systems. The datasets feed Power BI semantic models used across the organization, with collaboration in JIRA and GitHub workflows.

This is a fully remote position. You will work directly with clients to gather requirements, validate outputs, and ensure data quality across pipelines,

Qualifications

• Bachelor's degree and 12+ years of relevant experience.
• Hands-on Databricks data pipelines with PySpark and/or SQL.
• Strong SQL with complex joins, aggregations, and performance tuning.
• Experience preparing data for Power BI semantic models.
• GitHub for version control and collaborative development; JIRA for tracking work.
• Strong communication skills and ability to work with clients/stakeholders.
• Understanding of medallion (bronze/silver/gold) data architecture principles.

Responsibilities

• Design, build, and maintain enriched datasets following medallion architecture (bronze, silver, gold) in Databricks.
• Develop, orchestrate, and monitor Databricks jobs and pipelines.
• Write efficient, well-structured SQL to transform and model healthcare data.
• Prepare and optimize gold-layer datasets for Power BI semantic models.
• Manage code and version control through GitHub, following team branching and review practices.
• Log, track, and update work items in JIRA.
• Partner directly with clients and stakeholders to understand requirements, clarify data definitions, and validate outputs.
• Troubleshoot data quality issues and ensure accuracy and consistency across pipelines.
• Write ad hoc queries to support client requests and analyses.
• Document data lineage, transformation logic, and business rules for enriched datasets.
• Collaborate with Power BI developers and data scientists on the broader team.

Skills

Databricks

PySpark

SQL

Power BI

GitHub

JIRA

Medallion architecture

Client communication

Education

Bachelor's degree

Tools

Databricks

Power BI

GitHub

JIRA

Job description

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture (bronze/silver/gold) in Databricks, sourcing data from the VA Corporate Data Warehouse and other internal systems. The datasets feed Power BI semantic models used across the organization, with collaboration in JIRA and GitHub workflows.

This is a fully remote position. You will work directly with clients to gather requirements, validate outputs, and ensure data quality across pipelines,