Databricks / Azure Data Platform Architect

EPAM Systems; Paris; Hybrid; EUR 110,000 - 150,000; Full time

Benefits offered by this job

25 days paid leave + RTT

Meal vouchers

Private medical insurance

Pension fund

ESPP

Navigo transit allowance

Remote work approval

Job summary

EPAM Systems, Inc. in Paris is seeking an experienced Databricks/Azure Data Platform Architect to lead end-to-end design and development of a modern enterprise data platform on Azure and Databricks.

You will shape the technical roadmap and guide engineering teams through greenfield implementation with a hybrid work model and occasional client-site visits. The role requires strong leadership, expert hands-on experience with Azure Databricks, Delta Lake and Unity Catalog, and collaboration with

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field or equivalent experience
• Fluent French and English required
• Strong hands-on expertise in Azure Databricks, Apache Spark, Delta Lake and Unity Catalog
• Proven track record of building greenfield enterprise data platforms
• Advanced knowledge of Azure networking, identity management, enterprise security and private connectivity
• Databricks and Microsoft Azure certifications are advantageous

Responsibilities

• Define and govern target enterprise architecture, technical roadmap and platform standards
• Design scalable lakehouse solutions using Azure Databricks, Delta Lake, Unity Catalog and ADLS Gen2
• Establish robust patterns for data ingestion, transformation, orchestration, governance, security and observability
• Architect and oversee batch, streaming and near real-time data pipelines
• Implement CI/CD pipelines and Infrastructure as Code using Azure DevOps or GitHub Actions with Terraform/Bicep
• Define and enforce standards for data quality, data lineage, access control, disaster recovery and cost management
• Guide and mentor engineering teams through implementation and architectural decisions
• Collaborate closely with business, analytics, security and infrastructure stakeholders

Skills

Azure Databricks

Apache Spark

Delta Lake

Unity Catalog

Python

SQL

Terraform

CI/CD

IaC

Education

Bachelor's or Master's in CS

Tools

Azure DevOps

GitHub Actions

Terraform

Bicep

Job description

We're looking for a Databricks / Azure Data Platform Architect to join our Data Analytics Consulting team in Paris.Working on a new product development project, you will lead the end-to-end design and development of a modern enterprise-scale data platform on Microsoft Azure and Databricks. This role offers the opportunity to shape the core data architecture, define the technical roadmap and guide engineering teams through greenfield implementation.The role involves working in a hybrid working mode with around one visit per month to the client site in Paris.ResponsibilitiesDefine and govern target enterprise architecture, technical roadmap and platform standardsDesign scalable lakehouse solutions using Azure Databricks, Delta Lake, Unity Catalog and ADLS Gen2Establish robust patterns for data ingestion, transformation, orchestration, governance, security and observabilitySelect, configure and integrate Azure services including Data Factory, Event Hubs, Key Vault, Entra ID and Power BIArchitect and oversee batch, streaming and near real-time data pipelinesImplement CI/CD pipelines and Infrastructure as Code (IaC) using Azure DevOps or GitHub Actions with Terraform/BicepDefine and enforce standards for data quality, data lineage, access control, disaster recovery and cost managementGuide and mentor engineering teams through implementation and architectural decisionsCollaborate closely with business, analytics, security and infrastructure stakeholdersRequirementsBachelor’s or Master’s degree in Computer Science or related field, or equivalent experienceFluent French and English requiredDemonstrated ability to lead data engineering teams at EPAM and with the clientExcellent client-facing consulting approach with the ability to advise senior stakeholders effectivelyStrong hands-on expertise in Azure Databricks, Apache Spark, Delta Lake and Unity CatalogProven track record of building greenfield enterprise data platforms from the ground upAdvanced knowledge of Azure networking, identity management, enterprise security and private connectivityExtensive experience with medallion/lakehouse architectures, dimensional modelling and data product designHigh proficiency in Python, SQL, Terraform and automated deployment practicesExperience in Fast-Moving Consumer Goods (FMCG) domains is nice to haveRelevant Databricks and Microsoft Azure certifications are advantageousWe offer25 days of paid leave per year + reduction of the working time (RTT days, number depending on the year)Meal vouchers Card (11 euros per day, 51% covered by EPAM)Life & Private medical insurance (50% of monthly cost covered by EPAM, including dental and vision insurance)Pension fundEmployee Stock Purchase Plan (ESPP) (subject to eligibility requirements)Navigo (Ground transportation allowance, 50% of the monthly cost covered by EPAM)Monthly Afterwork organized by the HR TeamEPAM Referral ProgramRemote Work (under Business & Management approval)IT Equipment (Laptop (HP or MacBook, according to eligibility criteria), headphones, mouse, professional phone with monthly subscription fees covered by EPAM)Learning and development opportunities including in-house training and coaching, professional certifications, and courses*All benefits and perks are subject to certain eligibility requirements