Data Platform Engineer — Medallion Architecture & Lakehouse

Compunnel Inc.; Nashville (TN); On-site; USD 110,000 - 160,000; Full time

Job summary

Compunnel, Inc. is seeking a data engineer to design and implement scalable data platforms using Medallion Architecture within a lakehouse environment. The role emphasizes building robust pipelines and a service/API layer for analytics-ready data.

You will work with PySpark, Spark SQL, and Microsoft Fabric to govern data access, ensure quality, and mentor teammates through documentation and coaching throughout projects.

Qualifications

• Proven experience with Medallion Architecture.
• Strong Microsoft Fabric data engineering pipelines, notebooks, and dataflows in lakehouse.
• Proficiency in PySpark and Spark SQL.
• Knowledge of data governance and access control for sensitive data.

Responsibilities

• Designs and structures data platforms to refine raw data into analytics-ready assets.
• Establishes Bronze (raw), Silver (cleansed), and Gold (business-ready) layers with governance and quality controls.
• Experience building a service layer and API layer for data delivery.
• Proven data integration experience across enterprise source systems.
• Excellent documentation and coaching skills to hand off projects.

Skills

Medallion Architecture

PySpark

Spark SQL

Data governance

Tools

Microsoft Fabric

Job description

JOB SUMMARY
Key Responsibilities
- Designs and structures data platforms to progressively refine raw data into analytics-ready assets.
- Establishes standard frameworks for the Bronze (raw), Silver (cleansed), and Gold (business-ready) layers, ensuring data quality, system scalability, and governance.
- Experience building a service layer and API layer for data delivery.
- Proven data integration experience across enterprise source systems.
- Excellent documentation and coaching skills to hand off project.

Required Qualifications
- Proven experiences w/Medallion Architecture.
- Strong Microsoft Fabric Experiences- Data Engineering Pipelines, notebooks, and dataflows in a lakehouse environment.
- Proficiency in PySpark, Spark SQL.
- Knowledge of data governance and access control for sensitive data.

Preferred Qualifications