Remote Senior Databricks Architect | PySpark Pipelines

Virtasant

Austin (TX)

Remote

USD 140,000 - 180,000

Part time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Virtasant is seeking a Senior Databricks Engineer/Architect to design, build, and optimize scalable data pipelines using PySpark and Databricks. This remote US contract role focuses on data migrations, modernizing data platforms, and robust ETL/ELT workflows to ensure data quality and performance.

You will translate complex requirements into data solutions, collaborate with cross-functional teams, and present architecture designs and progress to leadership and stakeholders.

Qualifications

  • Experienced Senior Data Engineer or Data Architect specializing in designing, developing, and optimizing scalable data pipelines using PySpark and Databricks.
  • Architecting and executing data migrations to Databricks, modernizing data platforms, and building robust ETL/ELT workflows that ensure data quality, performance, and reliability.
  • Adept at translating complex technical requirements into effective data solutions, collaborating with cross-functional teams, and presenting technical strategies, architecture designs, and project outcomes to business stakeholders and leadership.

Responsibilities

  • Design, develop, and maintain scalable, high-performance data pipelines.
  • Architect and lead data migration strategies to the Databricks platform.
  • Develop and optimize complex data transformations using PySpark.
  • Build and enhance ETL/ELT processes to support enterprise data initiatives.
  • Ensure data quality, integrity, scalability, and performance across data platforms.
  • Present technical solutions, migration roadmaps, and project progress to stakeholders.
  • Bridge the gap between technical teams and business stakeholders to align data solutions with organizational objectives.

Skills

PySpark
Databricks
ETL/ELT
Data migrations
Data quality
Stakeholder communication

Tools

SQL
Apache Airflow

Job description

Virtasant is seeking a Senior Databricks Engineer/Architect to design, build, and optimize scalable data pipelines using PySpark and Databricks. This remote US contract role focuses on data migrations, modernizing data platforms, and robust ETL/ELT workflows to ensure data quality and performance.

You will translate complex requirements into data solutions, collaborate with cross-functional teams, and present architecture designs and progress to leadership and stakeholders.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Solutions Architect (Remote, 1099)
Databricks Solutions Architect (Remote, 1099)

Virtasant • United States

Remote
USD 96,000 - 165,000
1099 contract
Remote work within US
Senior Databricks Engineer/Architect
Senior Databricks Engineer/Architect

Virtasant • Austin (TX)

Remote
USD 140,000 - 180,000
Senior Databricks Engineer/Architect
Senior Databricks Engineer/Architect

Virtasant • United States

Remote
USD 96,000 - 165,000
1099 contract
Remote work within US
Senior Data Engineer - Databricks/PySpark/SQL | Remote
Senior Data Engineer - Databricks/PySpark/SQL | Remote

HumanIT Digital Consulting • United States

Remote
USD 28,000 - 37,000
15th month salary
Health insurance for family
Birthday off
+3
Remote Senior Data Engineer - PySpark & Databricks ETL
Remote Senior Data Engineer - PySpark & Databricks ETL

Truelogic • United States

Remote
USD 120,000 - 170,000
Remote work
Competitive USD pay
Paid time off
+2
Senior Databricks Engineer – Remote Data Pipelines
Senior Databricks Engineer – Remote Data Pipelines

Princeton IT Services, Inc • United States

Remote
USD 130,000 - 180,000
Remote Senior Data Engineer - Databricks, dbt, SQL, PySpark
Remote Senior Data Engineer - Databricks, dbt, SQL, PySpark

Qualis1 • United States

Remote
USD 120,000 - 180,000
Visa sponsorship
Remote Databricks Engineer — Spark & Delta Lake Expert
Remote Databricks Engineer — Spark & Delta Lake Expert

Arting Digital Private Limited • United States

Remote
USD 120,000 - 170,000
Senior Data Engineer (Databricks/PySpark) - Remote
Senior Data Engineer (Databricks/PySpark) - Remote

Pinnacle Alliances • United States

Remote
USD 83,000 - 90,000
Databricks Solutions Architect – Remote Data Pipelines
Databricks Solutions Architect – Remote Data Pipelines

Confidential • United States

Remote
USD 240,000 - 260,000
Competitive hourly rate
Flexible contract or full-time work
Work with leading enterprise customers