Senior Data Platform Lead (Azure, Spark, AI) – Lisbon

Advancing Analytics; USA; Hybrid; USD 61.000 - 83.000; Vollzeit

Zusammenfassung

Advancing Analytics in Lisbon is seeking a data engineering leader who can design and deliver dependable data platforms to support analytics and AI. The role blends hands-on data engineering with end-to-end solution thinking, consulting, and agile project leadership in a flexible, Lisbon-based setting.

You will gather requirements, build cloud data pipelines with Spark, Python, and SQL, and work with data lakes and governance. Travel to customers or team locations may be required.

Qualifikationen

• Experience with Microsoft Azure and core cloud computing concepts.
• Practical experience with Apache Spark, such as Databricks, Microsoft Fabric, or a comparable engine.
• Strong Python and SQL skills, including writing efficient queries and understanding execution behavior.
• Familiarity with cloud orchestration, Azure Data Lake, and Delta Lake.
• Experience with data governance tooling and infrastructure as code, such as Unity Catalog or Purview, and Terraform or Azure DevOps.
• Client consulting, requirements gathering, agile delivery, and object-oriented development practices.

Aufgaben

• Gather requirements with clients and shape practical data engineering solutions.
• Build and maintain cloud data pipelines using Spark, Python, SQL, and orchestration tools.
• Work with data lakes, lakehouse formats, and governance controls to support reliable, well-managed data.
• Lead project delivery while balancing technical quality with scope and client needs.
• Share knowledge with colleagues and the wider data community.

Kenntnisse

Azure

Spark Databricks

Python

SQL

Orchestration

Azure Data Lake

Terraform

Azure DevOps

Unity Catalog

Purview

Tools

Databricks

Microsoft Fabric

Power BI

Tableau

Unity Catalog

Purview

Terraform

Azure DevOps

Jobbeschreibung

Advancing Analytics in Lisbon is seeking a data engineering leader who can design and deliver dependable data platforms to support analytics and AI. The role blends hands-on data engineering with end-to-end solution thinking, consulting, and agile project leadership in a flexible, Lisbon-based setting.

You will gather requirements, build cloud data pipelines with Spark, Python, and SQL, and work with data lakes and governance. Travel to customers or team locations may be required.