Lead Azure Data Engineer

Cloud Hybrid Technologies, LLC; Alpharetta (GA); On-site; USD 85,000 - 115,000; Full time

Job summary

A leading technology firm in Alpharetta seeks a skilled data engineer to architect and implement scalable data platforms on Azure and Databricks. Responsibilities include optimizing ETL/ELT pipelines, collaborating with cross-functional teams, and driving data governance practices. The ideal candidate should have robust data engineering skills and experience with tools like PostgreSQL and Delta Lake. This position offers an opportunity to mentor junior engineers and contribute to engineering standards.

Qualifications

• Experience with Azure and Databricks for data platform implementation.
• Strong knowledge in building ETL/ELT pipelines.
• Familiarity with data governance and security practices.

Responsibilities

• Architect and implement scalable data platforms.
• Optimize data ingestion and transformation workflows.
• Collaborate with teams to translate requirements into solutions.

Skills

Data engineering

Azure

Databricks

Spark (Python)

ETL/ELT pipelines

Data governance

Tools

PostgreSQL

Delta Lake

ADLS

Job description

Architect, design, and implement scalable data platforms and pipelines on Azure and Databricks.
• Build and optimize data ingestion, transformation, and processing workflows across batch and real-time data streams.
• Work extensively with ADLS, Delta Lake, and Spark (Python) for large-scale data engineering.
• Lead the development of complex ETL/ELT pipelines, ensuring high quality, reliability, and performance.
• Design and implement data models, including conceptual, logical, and physical models for analytics and operational workloads.
• Work with relational and lakehouse systems including PostgreSQL and Delta Lake.
• Define and enforce best practices in data governance, data quality, security, and architecture.
• Collaborate with architects, data scientists, analysts, and business teams to translate requirements into technical solutions.
• Troubleshoot production issues, optimize performance, and support continuous improvement of the data platform.
• Mentor junior engineers and contribute to building engineering standards and reusable components.

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract