Data Platform Engineer — Medallion Architecture & Lakehouse

Compunnel, Inc.; Nashville (TN); On-site; USD 110,000 - 160,000; Full time

Job summary

Compunnel, Inc. is seeking a data engineer to design and implement scalable data platforms using Medallion Architecture within a lakehouse environment. The role emphasizes building robust pipelines and a service/API layer for analytics-ready data.

You will work with PySpark, Spark SQL, and Microsoft Fabric to govern data access, ensure quality, and mentor teammates through documentation and coaching throughout projects.

Qualifications

• Proven experience with Medallion Architecture.
• Strong Microsoft Fabric data engineering pipelines, notebooks, and dataflows in lakehouse.
• Proficiency in PySpark and Spark SQL.
• Knowledge of data governance and access control for sensitive data.

Responsibilities

• Designs and structures data platforms to refine raw data into analytics-ready assets.
• Establishes Bronze (raw), Silver (cleansed), and Gold (business-ready) layers with governance and quality controls.
• Experience building a service layer and API layer for data delivery.
• Proven data integration experience across enterprise source systems.
• Excellent documentation and coaching skills to hand off projects.

Skills

Medallion Architecture

PySpark

Spark SQL

Data governance

Tools

Microsoft Fabric

Job description

Compunnel, Inc. is seeking a data engineer to design and implement scalable data platforms using Medallion Architecture within a lakehouse environment. The role emphasizes building robust pipelines and a service/API layer for analytics-ready data.

You will work with PySpark, Spark SQL, and Microsoft Fabric to govern data access, ensure quality, and mentor teammates through documentation and coaching throughout projects.