Databricks Engineer II — ETL Pipelines & PySpark

OpenTalent; Washington; On-site; USD 120,000 - 170,000; Full time

Job summary

OpenTalent is seeking a data engineer to design and maintain robust data pipelines in Databricks. You will build and optimize bronze, silver, and gold tables from diverse sources and collaborate with a tech-led team to deliver high-quality data products.

The role requires 2+ years of data engineering experience, strong SQL, Python, PySpark, and Databricks skills, plus the ability to obtain and maintain an active Top Secret clearance and work in the United States.

Qualifications

• 2+ years of experience in data engineering, data integration, or data management.
• 2+ years of experience with SQL.
• 2+ years of experience building or supporting ETL/ELT pipelines.
• 1+ years of experience with Databricks and cloud-based data platforms.
• Active Top Secret clearance required or ability to obtain/maintain.

Responsibilities

• Build ETL pipelines and maintain tables in Databricks with multiple source data.
• Develop and maintain bronze, silver, and gold tables in Databricks.
• Lead projects or workstreams and manage multiple tasks in a fast-paced environment.
• Communicate clearly and build professional relationships with team and clients.

Skills

SQL

Python

PySpark

Databricks

ETL/ELT

Data Integration

Communication

Team Collaboration

Project Leadership

Attention to Detail

Education

Bachelor's degree

Tools

Databricks

Job description

OpenTalent is seeking a data engineer to design and maintain robust data pipelines in Databricks. You will build and optimize bronze, silver, and gold tables from diverse sources and collaborate with a tech-led team to deliver high-quality data products.

The role requires 2+ years of data engineering experience, strong SQL, Python, PySpark, and Databricks skills, plus the ability to obtain and maintain an active Top Secret clearance and work in the United States.