Remote Databricks Data Engineer | Medallion Architecture

GovCIO; Jackson (MS); Remote; USD 130,000 - 160,000; Full time

Benefits offered by this job

Remote work

Training, Certification Support

Employee Assistance Program

Referral Bonus

Flexible Work Environment

Job summary

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture in Databricks, sourcing data from the VA CDW and other systems. You will deliver analytics-ready data to Power BI models and collaborate with clients, stakeholders, and the VA health program across a fully remote environment.

The role requires 12+ years’ experience or equivalent, strong SQL and PySpark/Databricks skills, and proficiency with GitHub and JIRA for CI/CD and project tracking.

Qualifications

• Bachelors degree and 12+ years of experience (or commensurate experience).
• Hands-on experience building data pipelines and transformations in Databricks (PySpark and/or SQL).
• Strong SQL skills including complex joins, aggregations, and performance tuning.
• Experience with Power BI including preparing data for semantic models.
• Familiarity with GitHub for version control and collaborative development.
• Experience using JIRA to track and manage work.
• Strong communication skills and client/stakeholder engagement.
• Understanding of medallion data architecture (bronze/silver/gold).

Responsibilities

• Design, build, and maintain enriched datasets following medallion architecture in Databricks.
• Develop, orchestrate, and monitor Databricks jobs and pipelines.
• Write efficient SQL to transform and model healthcare data.
• Prepare gold-layer datasets for Power BI semantic models.
• Manage code and version control via GitHub and team reviews.
• Log and track work in JIRA; collaborate with clients and stakeholders.
• Troubleshoot data quality issues and ensure dataset accuracy and consistency.
• Document data lineage, transformation logic, and business rules.
• Collaborate with Power BI developers and data scientists to meet needs.

Skills

Databricks

PySpark

SQL

Power BI

Medallion architecture

GitHub

JIRA

Data pipelines

stakeholder communication

Education

Bachelor's degree

Tools

Databricks

GitHub

Power BI

JIRA

Job description

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture in Databricks, sourcing data from the VA CDW and other systems. You will deliver analytics-ready data to Power BI models and collaborate with clients, stakeholders, and the VA health program across a fully remote environment.

The role requires 12+ years’ experience or equivalent, strong SQL and PySpark/Databricks skills, and proficiency with GitHub and JIRA for CI/CD and project tracking.