Remote Databricks Data Engineer - US Citizens / Clearance

The Judge Group; Arlington (VA); Teletrabalho; USD 100 000 - 160 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Healthcare

401k

Medical insurance

Dental insurance

Vision insurance

Resumo da oferta

Supporting the Federal Gov. is sourcing Databricks professionals to build and test pipelines within a large federal data modernization program.

You will implement ingestion, transformation, and migration ETL/ELT solutions, ensuring data quality and successful integration with governance standards. Collaboration with architects and engineers is essential to deliver scalable data products.

Qualificações

• Bachelor's degree in CS, data engineering, information systems, or related field.
• Minimum 4 years of experience in data engineering, software development, ETL/ELT, or cloud analytics.
• Hands-on experience with Databricks, Spark, PySpark, Python, SQL, Delta Lake, and orchestration.
• Experience building, testing, and maintaining batch data pipelines and data layers.
• Experience with enterprise data migration, source-to-target mapping, reconciliation, validation, and data-quality controls.
• Familiarity with Git, CI/CD, automated testing, deployment, monitoring, logging, and troubleshooting.
• Strong analytical, problem-solving, documentation, collaboration, and communication skills.
• Ability to obtain and maintain a Federal Public Trust.

Responsabilidades

• Build and maintain Databricks ingestion, transformation, orchestration, migration, and data-processing pipelines.
• Develop scalable ETL/ELT solutions using Databricks, Spark, PySpark, Python, SQL, and Delta Lake.
• Implement source-to-target mappings, transformation rules, business logic, data contracts, metadata, lineage, and data-quality requirements.
• Develop migrated data feeds, APIs, curated datasets, reporting layers, and reusable data products.
• Create reconciliation routines and support source-to-target validation, exception analysis, and defect resolution.
• Build unit, integration, regression, performance, and data-quality tests and document results.
• Support Git-based development, CI/CD, release management, deployment, monitoring, troubleshooting, and stabilization.
• Analyze and resolve job failures, cluster-performance issues, and data-quality problems.
• Collaborate with data architects, engineering leads, integration engineers, profiling analysts, testers, security specialists, governance leads, and source-system teams.
• Document reusable code, runbooks, troubleshooting procedures, and lessons learned for modernization waves.
• Participate in Agile ceremonies, backlog refinement, sprint planning, demonstrations, and technical reviews.

Conhecimentos

Databricks

Apache Spark

PySpark

Python

SQL

Delta Lake

Workflow orchestration

Formação académica

Bachelor's degree in computer science or related field

Ferramentas

Git

CI/CD

Descrição da oferta de emprego

Supporting the Federal Gov. is sourcing Databricks professionals to build and test pipelines within a large federal data modernization program.

You will implement ingestion, transformation, and migration ETL/ELT solutions, ensuring data quality and successful integration with governance standards. Collaboration with architects and engineers is essential to deliver scalable data products.