Databricks AI Architect – Azure/GCP GenAI Platform Lead

HCL Technologies Limited; Sweden; On-site; SEK 900,000 - 1,500,000; Full time

Job summary

HCL Technologies Limited is seeking a Databricks expert to design and implement Databricks architecture on Azure and/or GCP, delivering AI/ML solutions and GenAI capabilities. You will drive platform governance, security, and cost optimization while collaborating with engineering and business teams to realize end-to-end AI use cases.

The ideal candidate has hands-on Databricks AI stack experience (MLflow, Feature Store, Model Serving) and strong PySpark/Delta Lake expertise, with a focus on

Qualifications

• Strong experience in Databricks setup and architecture.

Responsibilities

• Design and implement Databricks architecture on Azure and/or GCP (workspace, clusters, networking, security).
• Lead platform setup, governance, and optimization (Unity Catalog, cost control, access management).
• Build and deploy AI/ML solutions using Databricks (MLflow, Feature Store, Model Serving).
• Develop GenAI / LLM solutions (RAG pipelines, embeddings, vector search).
• Integrate LLMs (Azure OpenAI / Vertex AI / other APIs) within Databricks.
• Deliver scalable Lakehouse architecture solutions.
• Collaborate with engineering and business teams for end-to-end AI use cases.
• Ensure performance tuning, reliability, and security of workloads.

Skills

Databricks setup

Databricks architecture

PySpark

Spark optimization

Delta Lake

Unity Catalog

LLMs integration

GenAI solutions

Cloud platforms (Azure/GCP)

Tools

MLflow

Feature Store

Model Serving

LangChain

Vector databases

Job description

HCL Technologies Limited is seeking a Databricks expert to design and implement Databricks architecture on Azure and/or GCP, delivering AI/ML solutions and GenAI capabilities. You will drive platform governance, security, and cost optimization while collaborating with engineering and business teams to realize end-to-end AI use cases.

The ideal candidate has hands-on Databricks AI stack experience (MLflow, Feature Store, Model Serving) and strong PySpark/Delta Lake expertise, with a focus on