Azure Databricks ETL Lead - Data Engineering Leader

Valiant Technologies LLC; City of Albany (NY); On-site; USD 87,000 - 117,000; Full time

Job summary

Valiant Technologies LLC in the United States is seeking a Java Full Stack Developer for an eight-month engagement with extension potential. You will lead and mentor technical professionals, design scalable data processing solutions, and coordinate with stakeholders to translate requirements into technical specs.

The role requires 8+ years of end-to-end delivery, strong Python/Scala/SQL skills, and hands-on experience with Azure Databricks, Azure Data Lake, and Azure SQL.

Qualifications

• Bachelor’s degree in Computer Science, IT, or a related field.
• 8+ years of experience in data engineering and software development with leadership.

Responsibilities

• Lead and mentor technical professionals, fostering a collaborative and high-performance team.
• Design and implement scalable data processing solutions using Azure Databricks.
• Gather business requirements and translate them into technical specifications.
• Oversee the complete development lifecycle, including planning, design, deployment, and maintenance.
• Conduct code reviews and ensure adherence to coding standards and best practices.
• Coordinate with technical and non-technical stakeholders.
• Identify and mitigate project delivery and team performance risks.
• Stay current with Azure Databricks and data engineering technologies.

Skills

Team leadership

Python

Scala

SQL

Informatica

Azure Databricks

Azure Data Lake

Azure SQL

ETL

Data warehousing

Data modeling

Cloud technologies

Full stack development

Education

Bachelor’s degree in Computer Science

Tools

Azure DevOps

Job description

Valiant Technologies LLC in the United States is seeking a Java Full Stack Developer for an eight-month engagement with extension potential. You will lead and mentor technical professionals, design scalable data processing solutions, and coordinate with stakeholders to translate requirements into technical specs.

The role requires 8+ years of end-to-end delivery, strong Python/Scala/SQL skills, and hands-on experience with Azure Databricks, Azure Data Lake, and Azure SQL.