Senior Databricks Architect - Remote PySpark Pipelines

Virtasant

Oregon

Hybrid

USD 96,000 - 165,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Virtasant seeks a Senior Databricks Engineer/Architect to design and optimize scalable data pipelines using PySpark and Databricks. You will architect and lead migrations to Databricks, building robust ETL/ELT workflows that ensure data quality, performance, and reliability across enterprise platforms.

The role requires translating complex requirements into actionable data solutions, collaborating with cross-functional teams, and presenting architectures and roadmaps to leadership and business

Qualifications

  • Senior data engineer with Databricks and PySpark experience.
  • Experience designing scalable data pipelines.
  • Experience leading migrations to Databricks.
  • Strong communication with stakeholders and leadership.

Responsibilities

  • Design, develop, and maintain scalable, high-performance data pipelines.
  • Architect and lead data migration strategies to the Databricks platform.
  • Develop and optimize complex data transformations using PySpark.
  • Build and enhance ETL/ELT processes to support enterprise data initiatives.
  • Ensure data quality, integrity, scalability, and performance across data platforms.
  • Present technical solutions, migration roadmaps, and project progress to stakeholders.
  • Bridge the gap between technical teams and business stakeholders to align data solutions with organizational objectives.

Skills

Data pipeline design
Cross-functional collaboration
Presentation to leadership

Tools

Databricks
PySpark
ETL/ELT tooling

Job description

Virtasant seeks a Senior Databricks Engineer/Architect to design and optimize scalable data pipelines using PySpark and Databricks. You will architect and lead migrations to Databricks, building robust ETL/ELT workflows that ensure data quality, performance, and reliability across enterprise platforms.

The role requires translating complex requirements into actionable data solutions, collaborating with cross-functional teams, and presenting architectures and roadmaps to leadership and business

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Databricks Architect | PySpark Pipelines
Remote Senior Databricks Architect | PySpark Pipelines

Virtasant • Austin (TX)

Remote
USD 140,000 - 180,000
Senior Databricks Engineer/Architect
Senior Databricks Engineer/Architect

Virtasant • Austin (TX)

Remote
USD 140,000 - 180,000
Senior Databricks Engineer/Architect
Senior Databricks Engineer/Architect

Virtasant • United States

Remote
USD 96,000 - 165,000
1099 contract
Remote work within US
Senior Databricks Engineer/Architect
Senior Databricks Engineer/Architect

Virtasant • Oregon

Hybrid
USD 96,000 - 165,000
Databricks Solutions Architect (Remote, 1099)
Databricks Solutions Architect (Remote, 1099)

Virtasant • United States

Remote
USD 96,000 - 165,000
1099 contract
Remote work within US
Senior Databricks Engineer – Remote Data Pipelines
Senior Databricks Engineer – Remote Data Pipelines

Princeton IT Services, Inc • United States

Remote
USD 130,000 - 180,000
Senior Data Engineer - Databricks/PySpark/SQL | Remote
Senior Data Engineer - Databricks/PySpark/SQL | Remote

HumanIT Digital Consulting • United States

Remote
USD 28,000 - 37,000
15th month salary
Health insurance for family
Birthday off
+3
Senior Databricks Data Engineer | PySpark & Cloud Pipelines
Senior Databricks Data Engineer | PySpark & Cloud Pipelines

Valiant Technologies LLC • Madison (WI)

On-site
USD 120,000 - 150,000
Senior Databricks Data Engineer: Spark, ETL & AWS
Senior Databricks Data Engineer: Spark, ETL & AWS

Valiant Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 190,000
Senior Databricks Data Engineer - Spark, PySpark & AWS
Senior Databricks Data Engineer - Spark, PySpark & AWS

Ethereum Technologies • Dallas (TX)

On-site
USD 120,000 - 170,000