Databricks Platform Engineer – Medallion Data & AI

CMT Services, Inc.; Adelphi (MD); On-site; USD 100,000 - 130,000; Full time

Job summary

CMT Services, Inc. is seeking a Databricks Engineer to design, build, and operate a Data & AI platform rooted in the Medallion Architecture. This role involves developing end-to-end data pipelines using Databricks and Apache Spark, integrating enterprise data systems, and ensuring data quality and governance. Candidates should have hands-on experience with Databricks, strong SQL and programming skills, and a comprehensive understanding of data engineering principles. The position is based in Adelphi, Maryland.

Qualifications

• Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering.
• Deep understanding of ELT pipeline development and orchestration.
• Strong proficiency in SQL, Python, or Scala for data transformations.

Responsibilities

• Design, implement, and optimize end-to-end data pipelines on Databricks.
• Develop data quality checks and validation rules to ensure data integrity.
• Maintain technical documentation for all pipelines and components.

Skills

Databricks

Apache Spark

SQL

Python

Delta Lake

Tools

MLflow

Azure Data Lake Storage

Amazon S3

Job description

CMT Services, Inc. is seeking a Databricks Engineer to design, build, and operate a Data & AI platform rooted in the Medallion Architecture. This role involves developing end-to-end data pipelines using Databricks and Apache Spark, integrating enterprise data systems, and ensuring data quality and governance. Candidates should have hands-on experience with Databricks, strong SQL and programming skills, and a comprehensive understanding of data engineering principles. The position is based in Adelphi, Maryland.