Senior Databricks Engineer/Architect

Virtasant

United States

Remote

USD 96,000 - 165,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

1099 contract
Remote work within US

Job summary

Virtasant seeks a senior data engineer/architect to lead the design and delivery of data solutions centered on Databricks. You will build scalable pipelines, implement PySpark transformations, and guide platform migrations while focusing on data quality and performance.

You will present architecture and migration plans to stakeholders, collaborate with business leaders, and drive enterprise data initiatives on a remote, US-based contract.

Qualifications

  • Senior-level data engineering or architecture experience with Databricks and PySpark.
  • Proven ability to build and optimize scalable data pipelines and robust ETL/ELT workflows.
  • Experience architecting and executing data migrations to Databricks or modernizing data platforms.
  • Ability to translate complex technical needs into effective, reliable data solutions.
  • Strong collaboration and presentation skills for communicating architecture and project outcomes to business stakeholders and leadership.

Responsibilities

  • Design, develop, and maintain scalable, high-performance data pipelines.
  • Plan and lead data migrations to Databricks as part of platform modernization.
  • Build and optimize complex data transformations with PySpark.
  • Develop and improve ETL/ELT workflows for enterprise data initiatives.
  • Protect data quality and integrity while improving platform scalability and performance.
  • Present architecture, migration plans, and progress to stakeholders; connect technical teams with business decision-makers.

Skills

Data pipelines design
ETL/ELT workflows
Architecture leadership
Data modeling
Technical leadership

Tools

Databricks
PySpark

Job description

Role overview

Lead the design and delivery of data engineering solutions centered on Databricks. The work covers scalable pipelines, PySpark transformations, and platform migration, while keeping data quality and performance in view and aligning technical plans with business needs.

Responsibilities
  • Design, develop, and maintain scalable, high-performance data pipelines.
  • Plan and lead data migrations to Databricks as part of platform modernization.
  • Build and optimize complex data transformations with PySpark.
  • Develop and improve ETL/ELT workflows for enterprise data initiatives.
  • Protect data quality and integrity while improving platform scalability and performance.
  • Present architecture, migration plans, and progress to stakeholders; connect technical teams with business decision-makers.
Requirements
  • Senior-level data engineering or architecture experience with Databricks and PySpark.
  • Demonstrated ability to build and optimize scalable data pipelines and robust ETL/ELT workflows.
  • Experience architecting and executing data migrations to Databricks or modernizing data platforms.
  • Ability to translate complex technical needs into effective, reliable data solutions.
  • Strong collaboration and presentation skills for communicating architecture and project outcomes to business stakeholders and leadership.
Benefits and work setup
  • Long-term, ongoing 1099 contract.
  • Remote within the United States.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys LLC • United States

On-site
USD 120,000 - 190,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Alephys • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Databricks Engineer/Architect
Senior Databricks Engineer/Architect

Virtasant • Austin (TX)

Remote
USD 140,000 - 180,000
Remote Senior Databricks Architect | PySpark Pipelines
Remote Senior Databricks Architect | PySpark Pipelines

Virtasant • Austin (TX)

Remote
USD 140,000 - 180,000
Senior Consultant (Databricks)
Senior Consultant (Databricks)

Unison Group • San Francisco (CA)

On-site
USD 180,000 - 250,000
Senior Data Architect
Senior Data Architect

Sowelo Consulting sp. z o.o. sp. k. • United States

Remote
USD 45,000 - 87,000
Solution Architect, Delivery (Databricks)
Solution Architect, Delivery (Databricks)

Jobgether • United States

Remote
USD 140,000 - 210,000
Remote work within the United States
Competitive compensation
Professional development
+1
Senior Resident Solution Architect
Senior Resident Solution Architect

Unison Group • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 160,000
Databricks Data Engineer
Databricks Data Engineer

Quantum Technologies LLC • Dallas (TX)

On-site
USD 150,000 - 190,000