Senior ETL & Data Engineering Lead - Azure Databricks

Quantum Technologies. LLC

City of Albany (NY)

On-site

USD 84,000 - 120,000

Full time

5 days ago

Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies LLC seeks a seasoned Java Full Stack Developer to lead a high-performance data engineering team in the US. The role focuses on end-to-end project delivery, scalable data processing with Azure Databricks, and translating business requirements into technical specifications.

You will oversee the development lifecycle, conduct code reviews, and collaborate with stakeholders to mitigate risks while leveraging Azure data services and CI/CD practices.

Qualifications

Minimum 8 years of end-to-end project delivery with technical leadership.
Strong programming skills in Python, Scala, or SQL.
Experience with SQL, Informatica and cloud technologies.

Responsibilities

Lead and mentor technical professionals and teams.
Design and implement scalable data processing solutions using Azure Databricks.
Translate business requirements into technical specs.
Oversee full development lifecycle from planning to maintenance.
Perform code reviews and enforce coding standards.
Coordinate with stakeholders across business and technical teams.
Identify and mitigate project delivery and team performance risks.
Stay current with Azure Databricks and data engineering tech.

Skills

8+ years of experience

Python

Scala

SQL

leadership

data processing

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Azure Data Lake Storage

Azure SQL Database

Informatica

Azure DevOps / CI/CD

Job description

You will oversee the development lifecycle, conduct code reviews, and collaborate with stakeholders to mitigate risks while leveraging Azure data services and CI/CD practices.

Get your free, confidential resume review.

or drag and drop your file here.