Databricks Engineer Data Engineer II - Top Secret Clearance - Deloitte

OpenTalent; Washington; On-site; USD 120,000 - 170,000; Full time

Job summary

OpenTalent is seeking a data engineer to design and maintain robust data pipelines in Databricks. You will build and optimize bronze, silver, and gold tables from diverse sources and collaborate with a tech-led team to deliver high-quality data products.

The role requires 2+ years of data engineering experience, strong SQL, Python, PySpark, and Databricks skills, plus the ability to obtain and maintain an active Top Secret clearance and work in the United States.

Qualifications

• 2+ years of experience in data engineering, data integration, or data management.
• 2+ years of experience with SQL.
• 2+ years of experience building or supporting ETL/ELT pipelines.
• 1+ years of experience with Databricks and cloud-based data platforms.
• Active Top Secret clearance required or ability to obtain/maintain.

Responsibilities

• Build ETL pipelines and maintain tables in Databricks with multiple source data.
• Develop and maintain bronze, silver, and gold tables in Databricks.
• Lead projects or workstreams and manage multiple tasks in a fast-paced environment.
• Communicate clearly and build professional relationships with team and clients.

Skills

SQL

Python

PySpark

Databricks

ETL/ELT

Data Integration

Communication

Team Collaboration

Project Leadership

Attention to Detail

Education

Bachelor's degree

Tools

Databricks

Job description

• Building ETL pipelines and creation and maintenance of tables in Databricks, with the support of tech lead
• Develop and maintain bronze, silver, & gold tables in Databricks with data from a multitude of sources
• Ability to work independently and collaborate as part of a team
• Effective written and verbal communication skills
• Meticulous attention to detail and quality of work product
• Ability to build and sustain professional relationships
• Ability to lead projects or workstreams
• Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
• Strong interpersonal skills and professional demeanor
• Ability to meet deadlines
• Ability to provide clear guidance to others
• Bachelor's degree
• Active Top Secret clearance
• Must be able to obtain and maintain the required clearance for this role
• 2+ years of experience in data engineering, data integration, or data management, including 2+ years of experience with Structured Query Language (SQL)
• 2+ years of experience building or supporting extract, transform, and load (ETL) or extract, load, and transform (ELT) pipelines
• 2+ years of experience with Python and PySpark
• 1+ years of experience with Databricks and cloud-based data platforms, including data pipeline development and data transformation
• Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future.
• Ability to travel 10-15%, on average, based on the work you do and the clients and industries/sectors you serve
• Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future