Databricks Data Engineer & Scientist: Lakehouse AI & ETL

Parra Consulting Group, Inc. .; Gaithersburg (MD); On-site; USD 150,000 - 210,000; Full time

Job summary

Parra Consulting Group, Inc. is seeking a Databricks Data Engineer and Scientist to support a federal client’s enterprise Lakehouse. You will design, build, and maintain data pipelines with AI-assisted tools and apply analytics to turn raw data into actionable insights across the business.

The role requires 8+ years of ETL and data pipeline experience, Databricks and PySpark coding, and AWS services knowledge. U.S. citizenship is required for the federal contract.

Qualifications

• Bachelor’s degree in a relevant technical field.
• 8+ years of ETL and data pipeline experience.
• U.S. citizenship and ability to obtain Public Trust.
• Experience with Databricks and Python/PySpark.
• Experience with AWS services (Glue, S3, RDS).

Responsibilities

• Design, build, and maintain robust end-to-end data pipelines for a Lakehouse on Databricks and AWS.
• Develop and manage ETL processes with logging and error handling.
• Design data models within Bronze, Silver, Gold medallion architecture.
• Analyze and decompose complex legacy SQL and rebuild pipelines.
• Optimize pipeline performance using partitioning, bucketing, and caching.
• Collaborate with cross-functional teams to deliver analytics-ready data.

Skills

ETL pipelines

Python

PySpark

Data modeling

SQL

AWS

Education

Bachelor’s degree in Computer Science/Engineering/Math/Physics/IST

Tools

Databricks

Delta Lake

Unity Catalog

Claude Code

Cursor

AWS Glue

S3

RDS

Job description

Parra Consulting Group, Inc. is seeking a Databricks Data Engineer and Scientist to support a federal client’s enterprise Lakehouse. You will design, build, and maintain data pipelines with AI-assisted tools and apply analytics to turn raw data into actionable insights across the business.

The role requires 8+ years of ETL and data pipeline experience, Databricks and PySpark coding, and AWS services knowledge. U.S. citizenship is required for the federal contract.