Databricks Integration Lead for Enterprise Pipelines (Hybrid)

Altria Client Services LLC; Richmond (VA); Hybrid; USD 120,000 - 150,000; Full time

Benefits offered by this job

Relocation benefits

Job summary

Altria Client Services LLC is seeking a Lead Databricks Integration Analyst in Richmond, VA, with a hybrid work schedule. You will design, build, and operate the data integration layer connecting enterprise sales apps to the Databricks Lakehouse, partnering with architects, engineers, and business partners to deliver reliable pipelines.

You will lead technical initiatives, review designs, and mentor engineers while translating business requirements into scalable solutions and communicating

Qualifications

• Bachelor's degree and 6+ years of production data integration experience.
• 3+ years hands-on Databricks experience designing and operating data pipelines.
• Experience with Lakeflow Connect and Lakeflow Jobs.
• Strong SQL and Python development and Spark tuning.

Responsibilities

• Design/implement bi-directional integrations between enterprise apps and Databricks Lakehouse.
• Build and optimize ingestion pipelines for databases, SaaS, files, and streaming data.
• Develop and maintain transformation pipelines using Spark Declarative Pipelines and Lakeflow tooling.
• Establish data quality, monitoring, and incident resolution for production pipelines.
• Partner with owners, vendors, and platform teams to define connectivity and data contracts.
• Provide technical direction, design/code reviews, and mentoring across the team.
• Translate business requirements into scalable technical solutions; communicate priorities and risks.

Skills

SQL

Python

Data integration

Mentoring

Leadership

Communication

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field

Tools

Databricks

Lakeflow Connect

Lakeflow Jobs

Spark Declarative Pipelines

Unity Catalog

Azure

CI/CD

Infrastructure as Code

Job description

Altria Client Services LLC is seeking a Lead Databricks Integration Analyst in Richmond, VA, with a hybrid work schedule. You will design, build, and operate the data integration layer connecting enterprise sales apps to the Databricks Lakehouse, partnering with architects, engineers, and business partners to deliver reliable pipelines.

You will lead technical initiatives, review designs, and mentor engineers while translating business requirements into scalable solutions and communicating