Azure Senior Data Lead

HCL Technologies Limited; Sweden; On-site; SEK 900,000 - 1,500,000; Full time

Job summary

HCL Technologies Limited is seeking a Databricks expert to design and implement Databricks architecture on Azure and/or GCP, delivering AI/ML solutions and GenAI capabilities. You will drive platform governance, security, and cost optimization while collaborating with engineering and business teams to realize end-to-end AI use cases.

The ideal candidate has hands-on Databricks AI stack experience (MLflow, Feature Store, Model Serving) and strong PySpark/Delta Lake expertise, with a focus on

Qualifications

• Strong experience in Databricks setup and architecture.

Responsibilities

• Design and implement Databricks architecture on Azure and/or GCP (workspace, clusters, networking, security).
• Lead platform setup, governance, and optimization (Unity Catalog, cost control, access management).
• Build and deploy AI/ML solutions using Databricks (MLflow, Feature Store, Model Serving).
• Develop GenAI / LLM solutions (RAG pipelines, embeddings, vector search).
• Integrate LLMs (Azure OpenAI / Vertex AI / other APIs) within Databricks.
• Deliver scalable Lakehouse architecture solutions.
• Collaborate with engineering and business teams for end-to-end AI use cases.
• Ensure performance tuning, reliability, and security of workloads.

Skills

Databricks setup

Databricks architecture

PySpark

Spark optimization

Delta Lake

Unity Catalog

LLMs integration

GenAI solutions

Cloud platforms (Azure/GCP)

Tools

MLflow

Feature Store

Model Serving

LangChain

Vector databases

Job description

We are looking for a Databricks expert with strong experience in platform setup, architecture, and AI/ML capabilitiesacross Azure and/or GCP. The ideal candidate should bring hands-on expertise in building Databricks-based AI solutions, not just traditional data pipelines.

Key Responsibilities

• Design and implement Databricks architectureon Azure and/or GCP (workspace, clusters, networking, security).
• Lead platform setup, governance, and optimization(Unity Catalog, cost control, access management).
• Build and deploy AI/ML solutions using Databricks(MLflow, Feature Store, Model Serving).
• Develop GenAI / LLM solutions(RAG pipelines, embeddings, vector search).
• Integrate LLMs (Azure OpenAI / Vertex AI / other APIs)within Databricks.
• Deliver scalable Lakehouse architecture solutions.
• Collaborate with engineering and business teams for end-to-end AI use cases.
• Ensure performance tuning, reliability, and security of workloads.

Skill Requirements

• Strong experience in Databricks setup & architecture (must-have).
• Hands-on with Databricks AI stack:
• MLflow, AutoML
• Feature Store
• Model Serving
• Experience with PySpark, Spark optimization, Delta Lake.
• Strong exposure to cloud platforms:
• Experience integrating LLMs / GenAI solutions.
• Knowledge of Unity Catalog, governance, and security.

Other Requirements

Preferred Skills

• Experience in GenAI applications on Databricks
• Familiarity with LangChain / vector databases
• Exposure to real-time/streaming pipelines
• CI/CD and DevOps practices

Ideal Candidate

• Strong in Databricks platform + AI (not just data engineering)
• Hands-on in cloud setup (Azure/GCP)and AI delivery

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026totaled $14.8billion.