Databricks Solution Architect (Data & AI)

EPAM Systems; Chicago (IL); Remote; USD 180,000 - 210,000; Full time

Job summary

EPAM Systems is seeking a Databricks Solution Architect to design end-to-end Lakehouse architectures on Databricks across cloud platforms. You will lead discovery workshops, shape solutions for pursuits, and partner with sales for proposals and POCs while guiding delivery teams through build and go-live.

The role requires 8+ years in data engineering or architecture, 3+ years on Databricks, and strong Python/SQL skills with Fluent English.

Qualifications

• 8+ years in data engineering, data architecture or software development, incl. 3+ years on Databricks
• Hands-on Python and SQL; Scala a plus
• Deep knowledge of Spark, Delta Lake, Lakeflow, Unity Catalog
• Experience with Azure, AWS or GCP data services and security models
• Proven experience leading large client projects incl. pre-sales & proposals
• Strong communication in English (B2+)

Responsibilities

• Design end-to-end Lakehouse architectures on Databricks (Azure, AWS or GCP)
• Lead discovery workshops with client executives and engineering teams
• Partner with sales to shape solutions, answer RFPs, build proposals and run POCs
• Define target architectures and migration paths to Databricks
• Architect governance with Unity Catalog including access control and data sharing
• Design AI solutions (RAG, agentic workflows, MLOps)
• Guide delivery teams through build, go-live and optimization
• Run performance tuning and FinOps reviews for Spark and Databricks SQL workload

Skills

Databricks

Python

SQL

Apache Spark

Unity Catalog

Cloud platforms

MLflow

Pre-sales

Data governance

FinOps

Docker/Kubernetes

Tools

Terraform

Databricks Asset Bundles

Kafka

Event Hubs / Kinesis / Flink

Job description

We are seeking a Databricks Solution Architect to join EPAM's Data & AI practice in North America. You will design and deliver governed data, analytics, and AI platforms on Databricks for enterprise clients, and you will join pre-sales pursuits to shape solutions, estimates, and proposals.

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture, and you will collaborate with multinational teams on innovative projects while continuing to learn and grow.

Req.#1112994925

Responsibilities

• Design end to end Lakehouse architectures on Databricks (Azure, AWS, or GCP), covering ingestion, medallion modeling, serving, governance, and cost control

• Lead discovery and architecture workshops with client executives and engineering teams, and present proposed solutions and roadmaps clearly

• Partner with sales and the Databricks field team on pursuits: shape solutions, answer RFPs, build proposals, estimate effort, and run POCs

• Define target architectures and migration paths from other solutions to Databricks

• Architect governance with Unity Catalog, including access control, lineage, data sharing, and compliance with client security requirements

• Design AI solutions, including RAG, agentic workflows, Model Serving, Vector Search, and MLflow based LLMOps and MLOps

• Guide delivery teams through build and go live, and review, audit, and improve existing designs and system architectures

• Run performance tuning, optimization, and FinOps reviews for Spark and Databricks SQL workloads

Requirements

• 8+ years of experience in data engineering, data architecture, or software development, including 3+ years designing solutions on Databricks

• Hands‑on proficiency in Python and SQL; Scala is a plus

• Deep knowledge of Apache Spark, Delta Lake, Lakeflow (Spark Declarative Pipelines and Jobs), Databricks SQL, and Unity Catalog

• Experience with at least one major cloud (Azure, AWS, or GCP) and its data services, networking, and security model

• Proven experience leading large, client driven implementation projects, including pre‑sales and proposal work

• Experience with streaming and messaging tools such as Kafka, Event Hubs, Kinesis, or Flink

• Knowledge of design patterns, CI/CD, infrastructure as code (Terraform), and Databricks Asset Bundles

• Working knowledge of AI on Databricks (Mosaic AI, Agent Bricks, MLflow)

• Strong communication and consulting skills, with fluent English (B2+ or higher)

• Authorization to work in the US or Canada

Nice to have

• Databricks Solution Architect Champion certification (a big plus), plus certifications such as Data Engineer Professional, Generative AI Engineer Associate, or Machine Learning Professional

We offer

• Medical, Dental and Vision Insurance (Subsidized)

• Health Savings Account

• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)

• Short‑Term and Long‑Term Disability (Company Provided)

• Life and AD&D Insurance (Company Provided)

• Employee Assistance Program

• Unlimited access to LinkedIn learning solutions

• Matched 401(k) Retirement Savings Plan

• Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)

• Paid Holidays - nine (9) total per year

• Legal Plan and Identity Theft Protection

• Accident Insurance

• Employee Discounts

• Pet Insurance

• Employee Stock Purchase Program

• If otherwise eligible, participation in the discretionary annual bonus program

• If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

This Remote Position Cannot be Performed in New York City.

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $180,000 - $210,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

In accordance with the LA County Fair Chance Ordinance, you may find a copy of the Notice containing a summary of the Ordinance’s key provisions here: Concept FCO Posting 8 27 24 (lacounty.gov)

EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.

At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.