Databricks Data Engineer

Elevate Government Solutions

Washington (District of Columbia)

Remote

USD 130,000 - 170,000

Full time

11 hours ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Health Insurance

Unlimited Vacation

Training

Mentoring/Coaching

Job summary

Elevate Government Solutions seeks a Databricks Platform Engineer/Admin to support a Federal client in a remote capacity for US citizens with an ACTIVE SECRET clearance. You will design, build, and maintain data pipelines, governance, and scalable Databricks workflows.

Required: 5+ years data engineering, 2+ years on Databricks, PySpark/SQL, batch and streaming processing, data modeling, Python with Git CI/CD. Unity Catalog knowledge and DL/T workflows are a plus.

Qualifications

5+ years data engineering experience
2+ years on Databricks
Strong PySpark and SQL for production-grade transformations
Experience with batch and streaming data processing
Solid grounding in data modeling and data architecture principles
Python proficiency and Git-based CI/CD workflow experience
Familiarity with Unity Catalog from a consumer perspective
Experience with DLT or Workflows orchestration a plus

Responsibilities

Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLT
Implement Medallion architecture for data curation and quality
Build ingestion frameworks for structured/semi-structured/unstructured data from files, databases, APIs, and streaming sources
Design data models supporting downstream analytics
Build and consume APIs for data integration with downstream systems
Optimize Spark jobs for performance and cost
Implement data quality checks and pipeline monitoring
Document data flows and lineage for maintainability

Skills

PySpark

SQL

Databricks

Batch processing

Streaming data

Data modeling

APIs

Spark optimization

Data quality checks

Documentation

Education

Bachelor's degree in CS/Eng

Tools

Unity Catalog

Git CI/CD

DLT/Workflows

Job description

This position requires an ACTIVE SECRET security clearance. Your application will not be reviewed if you do not have an ACTIVE security clearance at SECRET or above.

Elevate Government Solutions is a high growth Technology Services company focused on driving technological change in the government space. Our teams engage with various government agencies to develop and deploy emerging technology solutions using a tailored Agile methodology.

We are seeking a highly motivated and intellectually curious Databricks Platform Engineer/Admin to join our team working with a Federal client. The position will be a remote role open to US citizens residing in the United States with a Secret security clearance.

Responsibilities and Duties

Design, build, and maintain batch and streaming pipelines using PySpark, SQL, Databricks Workflows/DLT
Implement Medallion architecture (bronze/silver/gold) for data curation and quality
Build ingestion frameworks for structured/semi-structured/ unstructured data from files, databases, APIs, and streaming sources (Kafka, Kinesis, Auto Loader)
Design data models (dimensional or domain-specific) supporting downstream analytics
Build and consume APIs for data integration with downstream systems
Optimize Spark jobs for performance and cost (partitioning, caching, cluster sizing)
Implement data quality checks and pipeline monitoring
Document data flows and lineage for maintainability

Required Experience, Skills and Qualifications

5+ years data engineering experience, 2+ years on Databricks
Strong PySpark and SQL for production-grade transformations
Experience with both batch and streaming data processing
Solid grounding in data modeling and data architecture principles
Python proficiency and Git-based CI/CD workflow experience
Familiarity with Unity Catalog (catalogs, schemas, grants) from a consumer perspective
Experience with DLT or Workflows orchestration a plus

Education Requirement