Remote Data Engineer: Databricks Medallion Architect

GovCIO; Hartford (CT); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

Employee Assistance Program (EAP)

Corporate Discounts

Learning & Development platform

Certification Assistance

Referral Bonus Program

Internal Mobility Program

Pet Insurance

Flexible Work Environment

Job summary

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture (bronze/silver/gold) in Databricks, sourcing from the VA Corporate Data Warehouse and other systems. Datasets feed Power BI models used by stakeholders across the organization.

This fully remote role requires strong SQL and PySpark skills, experience with data pipelines, GitHub version control, and Jira for tracking.

Qualifications

• Bachelor's degree required with 12+ years of experience or equivalent
• Hands-on data pipeline experience in Databricks (PySpark and/or SQL)
• Strong SQL skills including complex joins, aggregations and performance tuning
• Experience with Power BI data preparation for semantic models
• Familiarity with GitHub for version control and collaborative development
• Experience using JIRA or similar tools to track work
• Strong communication skills and ability to work with clients/stakeholders
• Understanding of medallion (bronze/silver/gold) data architecture principles

Responsibilities

• Design, build, and maintain enriched datasets following medallion architecture (bronze, silver, gold) in Databricks
• Develop, orchestrate, and monitor Databricks jobs and pipelines
• Write efficient, well-structured SQL to transform and model healthcare data
• Prepare and optimize gold-layer datasets for Power BI semantic models
• Manage code and version control through GitHub with team review practices
• Log, track, and update work items in JIRA
• Partner with clients to gather requirements, clarify data definitions, and validate outputs
• Troubleshoot data quality issues and ensure accuracy across pipelines
• Write ad hoc queries to support client requests and analyses
• Document data lineage, transformation logic, and business rules for datasets
• Collaborate with Power BI developers and data scientists to meet downstream needs

Skills

Databricks

PySpark/SQL

Power BI

GitHub

JIRA

Medallion arch

Stakeholder comms

Education

Bachelor's degree

Tools

Databricks

GitHub

JIRA

Job description

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture (bronze/silver/gold) in Databricks, sourcing from the VA Corporate Data Warehouse and other systems. Datasets feed Power BI models used by stakeholders across the organization.

This fully remote role requires strong SQL and PySpark skills, experience with data pipelines, GitHub version control, and Jira for tracking.