Data Engineer - Medallion Data Pipelines (Remote)

GovCIO; Topeka (KS); Remote; USD 130.000 - 160.000; Vollzeit

Benefits dieser Stelle

Employee Assistance Program (EAP)

Corporate Discounts

Learning & Development platform

Training, Education and Certification

Referral Bonus Program

Internal Mobility Program

Pet Insurance

Flexible Work Environment

Zusammenfassung

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture (bronze/silver/gold) in Databricks, sourcing from VA CDW and other systems. The datasets feed Power BI semantic models and support stakeholders across the organization. This is a fully remote role.

The role collaborates with clients to gather requirements, track work in JIRA, and deliver high‑quality, well‑documented data pipelines, while leveraging GitHub for version control and best practices.

Qualifikationen

• Bachelor's degree and 12+ years of experience or commensurate experience.
• Hands-on experience building data pipelines and transformations in Databricks (PySpark and/or SQL).
• Strong SQL skills with complex joins, aggregations, and performance tuning.
• Experience working with Power BI, including preparing data for semantic models.
• Familiarity with GitHub for version control and collaborative development.
• Experience using JIRA or similar tools to track and manage work.
• Strong communication skills and comfort working directly with clients/stakeholders.
• Understanding of medallion (bronze/silver/gold) data architecture principles.

Aufgaben

• Design, build, and maintain enriched datasets following medallion architecture (bronze, silver, gold layers) in Databricks.
• Develop, orchestrate, and monitor Databricks jobs and pipelines.
• Write efficient, well-structured SQL to transform and model healthcare data.
• Prepare and optimize gold-layer datasets for consumption by Power BI semantic models.
• Manage code and version control through GitHub, following team branching and review practices.
• Log, track, and update work items in JIRA.
• Partner directly with clients and stakeholders to understand requirements, clarify data definitions, and validate outputs.
• Troubleshoot data quality issues and ensure accuracy and consistency across pipelines.
• Write ad hoc queries to support client requests, investigations, and one-off analyses.
• Perform data validation and quality assurance checks on pipelines and enriched datasets to ensure accuracy, completeness, and consistency.
• Document data lineage, transformation logic, and business rules for enriched datasets.
• Collaborate with Power BI developers and data scientists on the broader team to ensure datasets meet downstream reporting and analytical needs.

Kenntnisse

Databricks (PySpark/SQL)

SQL proficiency

Power BI

GitHub

JIRA

Client communication

Medallion data architecture

Ausbildung

Bachelor's degree

Tools

Databricks

Power BI

GitHub

JIRA

Jobbeschreibung

GovCIO is seeking a Data Engineer to design and build enriched datasets using medallion architecture (bronze/silver/gold) in Databricks, sourcing from VA CDW and other systems. The datasets feed Power BI semantic models and support stakeholders across the organization. This is a fully remote role.

The role collaborates with clients to gather requirements, track work in JIRA, and deliver high‑quality, well‑documented data pipelines, while leveraging GitHub for version control and best practices.