Databricks Data Engineer — Remote | Public Trust Clearance

Cogent People Inc.; Columbia (MD); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health, Dental, and Vision Insurance:

401(k) Plan: Matching contributions

Life Insurance & Disability Coverage

Paid Time Off: 3 weeks PTO + 10 days

Job summary

Cogent People Inc. is seeking a skilled Data Engineer with Databricks experience to join our team. You will build and maintain data pipelines for a mission-critical, data-centric system supporting a large-scale Federal Government IT program in the healthcare domain.

In this role, you will translate business requirements into scalable pipelines, design Delta Lake tables, and ensure security boundaries. You will collaborate with developers, project managers, business analysts and testers in an

Qualifications

• Bachelor’s degree or equivalent experience in CS/engineering or related field.
• 5+ years of hands-on data engineering, with at least 2 years on Databricks.
• Strong Python, PySpark and SQL skills for data pipelines.
• Experience with Delta Lake, Unity Catalog, and Databricks workflows.

Responsibilities

• Understand requirements and translate them into data pipelines within security boundaries.
• Build, test, and maintain pipelines on Databricks using Python, PySpark, Spark SQL.
• Design Delta Lake tables and ingestion patterns for batch and reports.
• Migrate Oracle SQL/PL/SQL logic to Databricks and verify results.
• Automate recurring Databricks reports and monitor jobs.
• Manage Databricks Workflows, tuning for performance and cost.
• Administer Databricks workspace: clusters, permissions, and secrets.
• Apply data governance using Unity Catalog in federal security boundaries.
• Follow DevSecOps: Git, CI/CD, and environment promotion.
• Collaborate in an Agile team and document builds.

Skills

Python

PySpark

SQL

Delta Lake

Databricks

AWS

DevSecOps

Agile

Education

Bachelor’s degree in computer science, software engineering, data engineering or a related field

Tools

Databricks

Unity Catalog

Delta Lake

Spark SQL

Python notebooks/repos

Job description

Cogent People Inc. is seeking a skilled Data Engineer with Databricks experience to join our team. You will build and maintain data pipelines for a mission-critical, data-centric system supporting a large-scale Federal Government IT program in the healthcare domain.

In this role, you will translate business requirements into scalable pipelines, design Delta Lake tables, and ensure security boundaries. You will collaborate with developers, project managers, business analysts and testers in an