Senior Data Engineer - Databricks Lakehouse Architect

UNAVAILABLE; McLean (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

Unknown Company seeks a seasoned Senior Data Engineer to join the team and help build enterprise-grade data platforms, data lakes, and lakehouses using Databricks. You will collaborate with clients, design scalable pipelines, and support cloud deployments across AWS, Azure, or GCP.

The role requires strong communication skills, hands-on Databricks and PySpark expertise, and experience in an Agile environment. Security clearance may be required.

Qualifications

• Ability to obtain and maintain a U.S. government security clearance
• 5–7 years of industry experience developing production software and solving complex technical problems
• 5–7 years of direct experience in Data Engineering with Databricks, Spark, and Delta Lake
• Experience with cloud data platforms (AWS, Azure, GCP) and data pipelines

Responsibilities

• Lead and support the design, development, and migration of data lake and lakehouse environments using Databricks, focusing on performance, reliability, and scalability.
• Assess and understand existing ETL jobs, workflows, data marts, BI tools, reports, and data dependencies.
• Design, develop, and optimize scalable data pipelines and data processing solutions using Databricks.
• Address technical inquiries concerning customization, integration, enterprise architecture, and data product features.
• Develop and support databases, data warehouses, data marts, data lakes, and lakehouses in cloud environments (AWS/Azure/GCP).
• Apply hands-on Databricks, SQL, PySpark, and cloud technologies to support data engineering solutions.
• Support an Agile software development lifecycle.
• Contribute to the continued growth of our AI & Data Exploitation Practice.

Skills

Excellent communication

Customer service

Agile development experience

Education

Bachelor's degree in computer science, information systems, engineering, or related technical discipline

Tools

Databricks

Apache Spark

Delta Lake

SQL (T-SQL / PostgreSQL / MySQL)

Airflow

AWS

Azure

Python / PySpark

Java

Scala

Iceberg

Job description

Unknown Company seeks a seasoned Senior Data Engineer to join the team and help build enterprise-grade data platforms, data lakes, and lakehouses using Databricks. You will collaborate with clients, design scalable pipelines, and support cloud deployments across AWS, Azure, or GCP.

The role requires strong communication skills, hands-on Databricks and PySpark expertise, and experience in an Agile environment. Security clearance may be required.