Lead Data Engineer - Azure Databricks & ETL

Artifintech; City of Albany (NY); Sur place; USD 84 000 - 120 000; Plein temps

Résumé du poste

Artifintech seeks a senior data engineering leader to design and implement scalable data solutions using Azure Databricks. You will guide the full delivery lifecycle, translate business needs into technical specs, and mentor engineers to uphold coding standards across multiple concurrent projects.

You will work with Azure Data Lake Storage and Azure SQL Database, lead data modeling and ETL design, and collaborate with stakeholders to ensure robust, compliant data warehousing solutions.

Qualifications

• Bachelor's degree in Computer Science, IT, or related field.
• 8+ years of end-to-end project delivery with technical leadership.
• Strong programming skills in Python, Scala, or SQL.
• Hands-on experience with Azure Databricks.
• Experience with Azure Data Lake Storage and Azure SQL Database.
• Strong understanding of data modeling, ETL processes, and data warehousing.
• Ability to lead teams and manage multiple projects simultaneously.

Responsabilités

• Lead and mentor technical professionals, fostering a collaborative and high-performance team.
• Design and implement scalable data processing solutions using Azure Databricks.
• Gather business requirements and translate them into technical specifications.
• Oversee the complete development lifecycle, including planning, design, deployment, and maintenance.
• Conduct code reviews and ensure adherence to coding standards and best practices.
• Coordinate with technical and non-technical stakeholders.
• Identify and mitigate project delivery and team performance risks.
• Stay current with Azure Databricks and data engineering technologies.

Connaissances

End-to-end project delivery

Technical team leadership

Python/Scala/SQL

SQL experience

Cloud technologies

Data modeling/ETL/warehousing

Multi-project leadership

Formation

Bachelor's degree in CS/IT or related

Outils

Azure Databricks

Azure Data Lake Storage

Azure SQL Database

Informatica

SQL

Cloud technologies

Description du poste

Artifintech seeks a senior data engineering leader to design and implement scalable data solutions using Azure Databricks. You will guide the full delivery lifecycle, translate business needs into technical specs, and mentor engineers to uphold coding standards across multiple concurrent projects.

You will work with Azure Data Lake Storage and Azure SQL Database, lead data modeling and ETL design, and collaborate with stakeholders to ensure robust, compliant data warehousing solutions.