Senior Data Platform Architect - Remote (Databricks)

Capgemini; Atlanta (GA); Remote; USD 73,000 - 174,000; Full time

Benefits offered by this job

Paid time off

Medical, dental, and vision coverage

Retirement savings plans

Job summary

Capgemini, a global leader in engineering and technology services, seeks a Resident Solution Architect to lead data engineering and analytics initiatives on Databricks. You will collaborate with client stakeholders and delivery teams to design scalable data platforms and guide production deployments.

The role requires hands-on Databricks development, strong Spark optimization skills, and extensive cloud experience across AWS, Azure, or GCP, with a focus on architecture standards and roadmaps.

Qualifications

• 7+ years of experience in data engineering, data platforms, and analytics.
• Completed Databricks Data Engineering Professional certification and required training curriculum.
• Proven experience delivering 6-8+ successful projects with significant hands-on Databricks development expertise.
• Strong experience with distributed computing using Apache Spark, including understanding of Spark runtime internals and performance optimization techniques.
• Experience designing and deploying solutions across cloud platforms, with deep expertise in AWS, Azure, or GCP and working knowledge of at least one additional cloud ecosystem.
• Familiarity with CI/CD pipelines, production deployment practices, and cloud-native development methodologies.
• Working knowledge of MLOps frameworks, machine learning lifecycle management, and model deployment processes.
• Current knowledge of Databricks products, platform capabilities, and best practices for scalability, reliability, and governance.

Responsibilities

• Lead the design and implementation of scalable data engineering and analytics solutions on Databricks.
• Partner with client and delivery teams to define architecture standards, best practices, and technical roadmaps.
• Provide hands-on guidance for data platform development, optimization, and production deployments.
• Drive performance tuning, scalability improvements, and cost optimization across cloud and Databricks environments.
• Collaborate with engineering teams to establish CI/CD, DevOps, and MLOps best practices.
• Mentor technical teams on distributed computing, Spark architecture, and modern data platform design.
• Evaluate emerging Databricks and cloud capabilities and recommend adoption strategies that align with business goals.

Skills

Databricks

Data engineering

Spark

Cloud platforms

CI/CD

MLOps

Databricks certification

Architectural leadership

Tools

AWS

Azure

GCP

Job description

Capgemini, a global leader in engineering and technology services, seeks a Resident Solution Architect to lead data engineering and analytics initiatives on Databricks. You will collaborate with client stakeholders and delivery teams to design scalable data platforms and guide production deployments.

The role requires hands-on Databricks development, strong Spark optimization skills, and extensive cloud experience across AWS, Azure, or GCP, with a focus on architecture standards and roadmaps.