Azure Databricks Engineer (Data & AI)

AtlantisJobs; Wrocław; Remote; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Home office

International collaboration

Learning platforms

Certification programs

Job summary

Atos Poland Global Services Sp. z o.o. in Wrocław is seeking a Data & AI Engineer to build modern cloud-based data platforms on Azure and Databricks.

You will design scalable pipelines, data models and AI-powered solutions while collaborating with engineers across multiple countries on international projects. The role involves working with Azure Databricks, Python, PySpark, SQL, Delta Lake and CI/CD to deliver production-ready data & AI platforms.

Qualifications

• 3–6 years of experience in cloud, data or platform engineering.
• Hands-on experience with Azure, Azure Databricks and cloud-native services.
• Strong knowledge of Python, PySpark and SQL.
• Experience with ETL/ELT, Spark, Delta Lake and Lakehouse architectures.
• Understanding of Infrastructure as Code, CI/CD and cloud security principles.
• Interest in AI and Generative AI technologies.
• Fluent English.

Responsibilities

• Build and optimize data pipelines and Lakehouse solutions in Azure Databricks.
• Develop data models, integrations and analytics capabilities.
• Create AI-powered applications and Generative AI solutions.
• Automate cloud environments using Terraform and CI/CD pipelines.
• Apply security, governance and data quality best practices.
• Optimize solutions for performance, scalability and cost efficiency.
• Collaborate with business and technical stakeholders to deliver reliable, production-ready solutions.

Skills

Cloud experience

Data engineering

Platform engineering

Azure

Azure Databricks

Python

PySpark

SQL

ETL/ELT

Spark

Delta Lake

Lakehouse

Terraform

Azure DevOps

CI/CD

Cloud security

Generative AI

English

Tools

Terraform

MLflow

Databricks Genie

AKS

Job description

Nasze wymagania:

• 3-6 years of experience in cloud, data engineering or platform engineering.
• Hands-on experience with Azure, Azure Databricks and cloud-native services.
• Strong knowledge of Python, PySpark and SQL.
• Experience with ETL/ELT, Spark, Delta Lake and Lakehouse architectures.
• Understanding of Infrastructure as Code, CI/CD and cloud security principles.
• Interest in AI and Generative AI technologies.
• Fluent English.

Mile widziane:

• Experience with Terraform, MLflow or Databricks Genie.
• Knowledge of Azure Kubernetes Service (AKS).
• Exposure to MLOps practices.
• Azure, Databricks or HashiCorp certifications.

O projekcie:

Build modern Data & AI solutions on Azure and Databricks. Join Atos and work on an international project supporting a global leader in the semiconductor industry. You'll design and develop scalable cloud-based data platforms and explore the latest Generative AI and AI Agent solutions using Microsoft Azure and Databricks, collaborating with experienced engineers across multiple countries.

Technology Stack

Azure Databricks | Python | PySpark | SQL | Delta Lake | Terraform | Azure DevOps | CI/CD | Generative AI

Zakres obowiązków:

• Build and optimize data pipelines and Lakehouse solutions in Azure Databricks.
• Develop data models, integrations and analytics capabilities.
• Create AI-powered applications and Generative AI solutions.
• Automate cloud environments using Terraform and CI/CD pipelines.
• Apply security, governance and data quality best practices.
• Optimize solutions for performance, scalability and cost efficiency.
• Collaborate with business and technical stakeholders to deliver reliable, production-ready solutions.

Oferujemy:

• Work on enterprise-scale Data & AI platforms used by a global technology leader.
• Access to the latest Azure, Databricks and Generative AI technologies.
• Learning platforms, technical communities and certification programs.
• Flexible working model, home office and international collaboration.
• Clear opportunities to grow your technical expertise and career within global Data & AI projects.