Lead Databricks Platform Engineer

UNAVAILABLE; Irving (TX); On-site; USD 98,000 - 182,000; Full time

Benefits offered by this job

Flexible time off

Paid holidays

Paid sick time

Parental leave

Childcare assistance

Elder care assistance

Comprehensive health coverage

401(k)

Tuition assistance

Commuter benefits

Professional development

Employee recognition

Charitable donation matching

Health coaching

Counseling

Job summary

Epsilon, a Publicis Groupe subsidiary, is seeking a Lead Databricks Administrator to own and evolve our Databricks platform across AWS, Azure, and GCP. This role emphasizes governance, reliability, and scale within enterprise data systems.

You will drive standards, strengthen identity and access management, and collaborate with Engineering, Security, Cloud, and Operations to deliver secure, auditable platform architecture and cost-effective operations.

Qualifications

• BS in Computer Science or related field.
• 7+ years in data platform, database administration, or cloud infrastructure roles.
• 3+ years administering Databricks (workspaces, clusters, jobs, SQL Warehouses, platform services).
• Strong expertise in Databricks workspace and account management, governance, access controls, and administration best practices.
• Hands-on experience with infrastructure provisioning and automation (Terraform, APIs, scripting, CI/CD pipelines).
• Strong understanding of identity and access management (SSO, SCIM provisioning, RBAC).
• Working knowledge of Unity Catalog, data governance frameworks, and secure data access patterns.
• Experience building and maintaining platform standards and documentation.

Responsibilities

• Lead and scale Databricks platform administration across enterprise workspaces and multi-cloud environments (AWS, Azure, GCP).
• Establish and enforce standards for workspace provisioning, access controls, compute configuration, and governance.
• Drive operational excellence through automation and best practices across Databricks environments.
• Strengthen platform reliability, performance, and cost efficiency via monitoring and optimization.
• Mentor team members and promote best practices to elevate platform maturity.
• Build and maintain documentation, runbooks, and platform standards for audit readiness.

Skills

SQL

Unix/Linux

Python/Scala

Communication

Cross-functional collaboration

Education

BS in Computer Science or related field

Tools

Databricks

Terraform

CI/CD pipelines

Unity Catalog

APIs

Job description

Job Description

How You’ll Make an Impact

A subsidiary of Publicis Groupe, Epsilon powers data-driven marketing at massive scale for some of the world’s leading brands.

We’re hiring a Lead Databricks Administrator to own and evolve our Databricks platform across cloud environments. This is a high-impact role focused on driving platform standards, strengthening governance, and improving reliability across enterprise data systems. You’ll support large-scale Data Lake environments across AWS, Azure, and GCP, helping enable critical data operations for key clients.

Responsibilities

• Lead and scale Databricks platform administration across enterprise workspaces and multi-cloud environments (AWS, Azure, GCP)
• Establish and enforce standards for workspace provisioning, access controls, compute configuration, and governance to improve platform consistency and stability
• Drive operational excellence by implementing repeatable processes, automation, and best practices across Databricks environments
• Strengthen platform reliability, performance, and cost efficiency through proactive monitoring, optimization, and issue resolution
• Partner cross-functionally with Engineering, Security, Cloud, and Operations teams to ensure secure, compliant, and scalable platform architecture
• Own and improve identity and access management practices (least privilege, group management, service principals, admin controls)
• Lead troubleshooting and resolution of complex issues across Databricks, cloud infrastructure, networking, and data workloads
• Evaluate and adopt new Databricks capabilities to enhance governance, scalability, and operational efficiency
• Build and maintain documentation, runbooks, and platform standards to support long-term maintainability and audit readiness
• Mentor team members and promote best practices to elevate overall platform maturity
• Support production operations, incident response, and ongoing platform health in a high-impact, enterprise environment

Qualifications

• BS in Computer Science or related technical discipline, or equivalent practical experience
• 7+ years of experience in data platform, database administration, or cloud infrastructure roles
• 3+ years of hands‑on experience administering Databricks (workspaces, clusters, jobs, SQL Warehouses, platform services)
• Strong expertise in:
  • Databricks workspace and account management
  • Platform governance, access controls, and administration best practices
  • Compute configuration, cluster policies, and workload optimization
  • Experience supporting Databricks across AWS, Azure, or GCP environments
• Hands‑on experience with infrastructure provisioning and automation (Terraform, APIs, scripting, CI/CD pipelines)
• Strong understanding of identity and access management:
  • SSO, SCIM provisioning, RBAC
  • Service principals, group management, least privilege models
• Working knowledge of Unity Catalog, data governance frameworks, and secure data access patterns
• Experience implementing and maintaining platform standards (naming conventions, provisioning workflows, configuration baselines, access controls)
• Proven ability to monitor, troubleshoot, and optimize platform performance, reliability, and cost efficiency
• Experience diagnosing issues across Databricks, cloud infrastructure, networking, identity, and data pipelines
• Strong SQL, Unix/Linux, and scripting skills; Python or Scala is a plus
• Experience building and maintaining documentation, runbooks, and operational processes to support audit readiness and platform scalability
• Familiarity with incident response, change management, and production support in enterprise environments
• Ability to operate independently, manage multiple priorities, and contribute to a high-ownership, cross-functional environment
• Strong communication skills with the ability to work effectively across engineering, security, and platform teams

Benefits

We offer a comprehensive benefits package including:

• Time to Recharge: Flexible time off (FTO), 15 paid holidays
• Time to Recover: Paid sick time
• Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance
• Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Equal Opportunity Employer

Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information, or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants needing accommodations to complete the application process. Please reach out to [e-mail] to request an accommodation.

For San Francisco Bay and Los Angeles Areas: Epsilon will consider for employment qualified applicants with criminal histories in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply.

#LI-TG1

Compensation Range: USD $98,000.00 - USD $182,000.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time.