Senior Databricks Architect

Lumenalta; Tulsa (OK); Remote; USD 144,000 - 192,000; Full time

Job summary

An established industry player is seeking a Senior Databricks Architect to join their innovative team. In this pivotal role, you will architect end-to-end data pipelines, leveraging cutting-edge technologies like PySpark, SQL, and Databricks. Your expertise will drive the design of scalable lakehouse solutions while ensuring governance and security. Collaborate with cross-functional teams to translate complex business needs into effective data architecture. This full-time position offers a competitive salary and a flexible, remote working environment, making it an exciting opportunity for those passionate about shaping the future of technology.

Benefits

Flexible working hours

Health insurance (medical and dental)

401K Contribution

Professional development fund

15 days of paid time off

Access to soft-skill development courses

Qualifications

• 6+ years of experience in data engineering/architecture.
• Deep understanding of Databricks features and architecture.

Responsibilities

• Architect end-to-end pipelines using Databricks technologies.
• Mentor and uplift team members in data engineering best practices.

Skills

PySpark

SQL

Databricks

Terraform

CI/CD

AWS

Python

Education

Bachelor's Degree in Computer Science

Databricks Certifications

Tools

GitHub Actions

Jenkins

Azure DevOps

Job description

Join to apply for the Senior Databricks Architect role at Lumenalta

5 days ago Be among the first 25 applicants

Join to apply for the Senior Databricks Architect role at Lumenalta

At Lumenalta, we create impactful software solutions that drive innovation and transform businesses. Since 2000, we’ve partnered with visionary leaders to build cutting-edge tech, solve complex challenges, and deliver results faster through our elite teams and tech-driven approach. Join us in shaping the future of technology.

What you’ll do

• Architect end-to-end pipelines using PySpark, SQL, DLT, and dbt for batch and streaming use cases.
• Design governed lakehouse solutions using Unity Catalog, Delta Lake, and scalable architecture best practices.
• Leverage cutting-edge Databricks features including:
• Unity Catalog for access control and lineage
• Liquid Clustering for performance tuning
• System Tables for monitoring and cost insights
• Serverless Compute for elastic scalability
• Query Federation and Delta Sharing for unified access
• Automate everything: Use Terraform, Databricks CLI, and REST APIs to provision and manage infrastructure.
• Streamline CI/CD: Build pipelines for notebooks, workflows, DLT, and ML models using GitHub Actions, Jenkins, or Azure DevOps.
• Collaborate cross-functionally: Translate complex business needs into simple, scalable data architecture.
• Champion governance and security: Enforce fine-grained access, logging, and compliance using Unity Catalog and platform controls.
• Stay ahead of the curve: Explore and guide adoption of new Databricks features like Lakehouse Federation, GenAI integrations, and Model Serving.
• Mentor and uplift: Share knowledge, contribute to internal standards, and help raise the bar for data engineering across the team.

What you bring

• 6+ years of experience in data engineering/architecture, including 3+ years hands-on with Databricks in production.
• Deep understanding of Databricks features and architecture, especially: Unity Catalog, Delta Live Tables, Liquid Clustering, Serverless Compute, Photon Engine, System Tables, Query Federation and Delta Sharing
• Strong cloud knowledge—AWS is your home base (S3, IAM, Glue, Redshift, Lambda, Athena, ECS/EKS).
• Infrastructure automation experience with Terraform, CLI tools, and REST APIs.
• CI/CD pro with GitHub Actions, Jenkins, Azure DevOps, or similar.
• Fluency in PySpark, SQL, and Python; experience with dbt, MLflow, Spark internals a plus.
• Practical knowledge of data governance, lineage, access controls, and compliance in cloud-native environments.
• Clear communicator with strong architectural instincts and attention to detail.

Nice to have

• Databricks certifications (Data Engineer Pro, Machine Learning Pro, Lakehouse Architect)
• Experience with Model Serving, Feature Store, Vector Search, or GenAI use cases
• Comfort integrating with BI tools like Tableau, Power BI, and Databricks SQL
• Past work on migrations from Hadoop, Teradata, Informatica, or similar
• Exposure to Databricks on Azure or GCP
• Familiarity with data observability tools
• You’ll work on high-impact projects that power real-time analytics, AI, and innovation at scale.
• You’ll be surrounded by smart, supportive people who care about doing great work and helping each other grow.
• You’ll stay on the forefront of Databricks capabilities and cloud-native design patterns.
• We offer competitive compensation, flexibility, and the chance to shape meaningful solutions for forward-thinking clients.

What's it like to work at Lumenalta?

Salary range: $144,000 - $192,000 annually, with final compensation determined by your qualifications, expertise, experience, and the role's scope.

In addition to competitive pay, we offer a variety of benefits to support your professional and personal growth, including:

• Flexible working hours in a remote environment.
• Health insurance (medical and dental) for W2 Employees
• 401K Contribution
• A professional development fund to enhance your skills and knowledge.
• 15 days of paid time off annually.
• Access to soft-skill development courses to further your career.

This is a full-time position requiring a minimum of 40 hours per week, Monday through Friday.

At Lumenalta, we are committed to creating an environment that prioritizes growth, work-life balance, and the diverse needs of our team members.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering, Information Technology, and Consulting

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lumenalta by 2x

Sign in to set job alerts for “Architect” roles.

DevOps Cloud Architect, Digital Engineering Solutions (Remote)

Software Architect - Containers / Virtualisation

Software Engineer - Cross-platform C++ - Multipass

Senior Site Reliability / Gitops Engineer

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.