Technical Lead – Platform and Data

Jobtailor; Deutschland; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Jobtailor is seeking an experienced Data Architect to design and implement scalable Modern Data Platforms on Azure, incorporating infrastructure-as-code, CICD, and DevOps practices. You will collaborate with BI developers to deploy pipelines and with data scientists to deploy ML-enabled services.

The role includes supporting real-time architectures and streaming pipelines using Spark Structured Streaming or Azure Functions, ensuring seamless integration with data applications across the stack.

Qualifikationen

• Bachelor’s or Master’s degree with several years of data-architecture experience.
• Strong expertise in Azure Data Factory, Synapse, SQL, Data Lake, and App Service.
• Proven experience with Azure cloud services, DevOps/CI/CD.
• Hands-on with Azure Databricks and Data Factory (3+ years).
• Experience designing data pipelines, data transformations, and ML integrations.

Aufgaben

• Designing & building data architectures including scalable Modern Data Platforms with IaC, CI/CD, and DevOps.
• Collaborating with BI developers to deploy data pipelines and transformations (Azure).
• Working with Data Scientists to deploy ML into scalable services aligned with the data architecture.
• Assisting the project team in deploying data applications including streaming pipelines (Spark Structured Streaming or Azure Functions).

Kenntnisse

data architecture

infrastructure-as-code

CICD

DevOps

data pipelines

data transformations

machine learning

streaming pipelines

Azure Databricks

Microsoft SQL Server Integration Servi

Ausbildung

Bachelor’s degree + 10 years’ experience OR Master’s degree + 7 years’ experience

Tools

Azure Data Factory

Azure Synapse

Azure SQL

Azure Data Lake

Azure App Service

Azure Functions

Spark Structured Streaming

SSIS

Jobbeschreibung

Responsibilities include:

• Designing & building data architectures including the design & set-up of scalable Modern Data Platforms incl. infrastructure-as-code, proper CICD, solid DevOps and the best-fit technologies for the use case.
• Working together with the BI developers deploying data pipelines & data transformations which turn the raw data into relevant datasets and insights (Azure).
• Working with Data Scientist deploying machine learning into scalable services in a perfect fit with the data architecture.
• Assisting the project team in deploying data applications including, if needed, close-to real-time architectures such as streaming pipelines (Spark Structured Streaming or Azure Functions).

Requirements

• Bachelor’s degree plus 10 years’ experience OR master’s degree plus 7 years’ experience; preferred degree in Computer Science or related area.
• Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is required.
• Expertise in Azure cloud services, and DevOps/CI/CD frameworks.
• 3+ years of Azure Databricks and Azure Data-factory.
• 3+ years of current experience with development and implementation of Microsoft SQL Server Integration Services (SSIS).

Hard Skills

• data architecture
• infrastructure-as-code
• CICD
• DevOps
• data pipelines
• data transformations
• machine learning
• streaming pipelines
• Azure Databricks
• Microsoft SQL Server Integration Services

Industry Keywords

• Modern Data Platforms
• data applications
• real-time architectures
• cloud services
• data insights

Tools & Technologies

• Azure Data Factory
• Azure Synapse
• Azure SQL
• Azure Data Lake
• Azure App Service
• Azure Functions
• Spark Structured Streaming