Lead Databricks Platform Engineer / Solutions Architect

NTT DATA North America; Plano (TX); On-site; USD 134,625 - 224,375; Full time

Benefits offered by this job

Medical, dental & vision

401(k) with match

Paid time off

Employee assistance

Life and AD&D insurance

Job summary

NTT DATA is seeking a senior Databricks Platform & Data Engineer to join our Databricks Center of Excellence (CoE). This role blends platform engineering, architecture, and hands-on data engineering, with a focus on building and scaling enterprise-grade Databricks environments for large, regulated clients.

The ideal candidate will lead platform setup, governance, and adoption, while partnering directly with clients to design and deliver high‑impact use cases leveraging the latest Databricks

Qualifications

• 12+ years of experience in data engineering, platform engineering, or data architecture.
• 5+ years hands-on experience with Databricks in large enterprise environments.
• Deep expertise in Apache Spark, Delta Lake, and Lakehouse architectures.
• Strong experience with cloud platforms (AWS, Azure, or GCP).
• Experience implementing data governance, security, and compliance controls.
• Proven ability to design and deliver scalable, production-grade data platforms.
• Strong client-facing and communication skills.
• Preferred: experience in financial services or regulated industries.
• Familiarity with data governance frameworks, regulatory reporting.
• Databricks certifications (Data Engineer, Solutions Architect).
• Experience with real-time streaming (Kafka, Structured Streaming), MLOps, AI workflows.

Responsibilities

• Design and deploy enterprise-scale Databricks Lakehouse platforms across AWS/Azure.
• Establish secure, governed environments using Unity Catalog, RBAC, and data lineage.
• Define platform standards, reusable patterns, and guardrails for scalable adoption.
• Optimize platform performance, cost, and reliability for production workloads.
• Implement CI/CD, environment promotion, and DevOps automation for Databricks.
• Lead end-to-end use case delivery from requirements to production deployment.
• Drive data quality, observability, and pipeline reliability.
• Act as a trusted advisor to client stakeholders and translate requirements into architecture.

Skills

Databricks

Apache Spark

Delta Lake

Lakehouse architecture

Cloud platforms (AWS/Azure/GCP)

Data governance & security

Client-facing communication

CI/CD / DevOps

Job description

Job Overview

NTT DATA is seeking a senior Databricks Platform & Data Engineer to join our Databricks Center of Excellence (CoE). This role blends platform engineering, architecture, and hands‑on data engineering, with a focus on building and scaling enterprise‑grade Databricks environments for large, regulated clients. The ideal candidate will lead platform setup, governance, and adoption, while partnering directly with clients to design and deliver high‑impact use cases leveraging the latest Databricks capabilities. This is a client‑facing consulting role requiring strong technical depth, communication skills, and the ability to translate business requirements into scalable data platform solutions.

Key Responsibilities

Platform Engineering & Architecture

• Design and deploy enterprise‑scale Databricks Lakehouse platforms across AWS/Azure
• Establish secure, governed environments using Unity Catalog, role‑based access controls, and data lineage
• Define platform standards, reusable patterns, and guardrails for scalable adoption
• Optimize platform performance, cost, and reliability for production workloads
• Implement CI/CD, environment promotion, and DevOps automation for Databricks

Databricks Feature Enablement

• Unity Catalog – centralized governance, access control, lineage
• Dataflow / declarative pipelines – build scalable ingestion and transformation frameworks
• Genie / AI‑assisted development – accelerate developer productivity and data accessibility
• Enable AI/BI dashboards, model serving, and advanced analytics use cases

Data Engineering & Use Case Delivery

• Build and optimize batch and streaming data pipelines using Spark and Delta Lake
• Develop data products and domain‑oriented pipelines aligned to enterprise data strategies
• Lead end‑to‑end use case delivery, from requirements to production deployment
• Drive data quality, observability, and pipeline reliability

Client Engagement & Advisory

• Act as a trusted advisor to client stakeholders (architecture, data, risk, and business teams)
• Translate business requirements into technical architecture and delivery roadmaps
• Lead workshops, solution design sessions, and platform adoption strategies
• Support proposals, solutioning, and client innovations within regulated industries

CoE Contribution

• Build and contribute to accelerators, frameworks, and reusable assets
• Define best practices, reference architectures, and playbooks for enterprise Databricks adoption
• Mentor junior engineers and support capability building across the CoE

Required Qualifications

• 12+ years of experience in data engineering, platform engineering, or data architecture
• 5+ years hands‑on experience with Databricks in large enterprise environments
• Deep expertise in Apache Spark (Scala/Python), Delta Lake and Lakehouse architectures, Databricks workspace setup, cluster policies, and job orchestration
• Strong experience with cloud platforms (AWS, Azure, or GCP)
• Experience implementing data governance, security, and compliance controls
• Proven ability to design and deliver scalable, production‑grade data platforms
• Strong client‑facing and communication skills

Preferred Qualifications

• Experience in financial services or other regulated industries
• Familiarity with data governance frameworks, regulatory reporting, and risk data environments
• Databricks certifications (e.g., Data Engineer, Solutions Architect)
• Experience with real‑time streaming (Kafka, Structured Streaming), MLOps / Model Serving, Data marketplace / data product architectures, and AI‑assisted development workflows and agent‑based tooling

Location & Compensation

Locations: Plano, TX | Minneapolis, MN | Chicago, IL | Atlanta, GA.

Candidates must be within reasonable commuting distance of or able to relocate to one of these locations.

Salary ranges: Plano, TX and Atlanta, GA – $134,625–$224,375; Chicago, IL and Minneapolis, MN – $148,088–$246,812.

Benefits

This position is eligible for company benefits including medical, dental, and vision insurance with employer contribution; flexible spending or health savings account; life and AD&D insurance; short and long term disability coverage; paid time off; employee assistance; participation in a 401(k) program with company match; and additional voluntary or legally‑required benefits. This position may also be eligible for incentive compensation based on individual and/or company performance.

EEO Statement

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. NTT DATA is an equal opportunity employer.