Databricks Data Engineer — Remote/Hybrid (Govt Healthcare)

Cogent People Inc; Columbia (MD); Híbrido; USD 120.000 - 180.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health insurance

401(k) Plan

Life Insurance & Disability Coverage

Paid Time Off

Descripción de la vacante

Cogent People Inc. is seeking a Data Engineer with Databricks experience to build and maintain data pipelines for a large federal healthcare IT program. You’ll work on Delta Lake designs, convert Oracle logic to Databricks, and automate reports within a secure, agile environment.

You will join an Agile team, collaborate with developers, PMs, and testers, and participate in DevSecOps practices, including Git and CI/CD, within federal security boundaries.

Formación

• Bachelor's degree in computer science, software engineering, data engineering or related field, or equivalent experience.
• 5+ years hands-on data engineering with at least 2 years on Databricks.
• Experience with Delta Lake, Databricks workflows, and Spark SQL.
• Experience in Agile environments and DevSecOps practices.

Responsabilidades

• Translate business needs into scalable Databricks pipelines.
• Build, test, and maintain data pipelines using Python, PySpark, Spark SQL.
• Design Delta Lake tables and ingestion patterns for batch and reports.
• Migrate Oracle SQL/PLSQL logic to Databricks and verify results.
• Automate recurring Databricks reports.
• Schedule and monitor Databricks Workflows for performance and cost.
• Manage Databricks workspace: clusters, policies, users, permissions, secrets.
• Apply data governance with Unity Catalog within security boundaries.
• Follow DevSecOps: Git, CI/CD, environments.
• Collaborate with cross-functional teams in Agile and document work.

Conocimientos

Python

PySpark

SQL

Delta Lake

Databricks

AWS

Agile/Scrum

DevSecOps

Data governance

Educación

Bachelor’s degree in CS/SE

Herramientas

Git

Unity Catalog

CI/CD

Descripción del empleo

Cogent People Inc. is seeking a Data Engineer with Databricks experience to build and maintain data pipelines for a large federal healthcare IT program. You’ll work on Delta Lake designs, convert Oracle logic to Databricks, and automate reports within a secure, agile environment.

You will join an Agile team, collaborate with developers, PMs, and testers, and participate in DevSecOps practices, including Git and CI/CD, within federal security boundaries.