Remote Databricks Architect: Spark & Delta Lake Lead

Vidha It Solutions Llc; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

Vidha IT Solutions LLC is seeking a Databricks Architect to design, develop, and maintain scalable data pipelines using Databricks and Apache Spark. This remote role offers Visa: Any visa and W2 only, with collaboration across data scientists, analysts, and business stakeholders to deliver data-driven solutions.

You will manage and monitor Databricks clusters, notebooks, and job scheduling, implement Delta Lake architecture, and integrate Databricks with cloud platforms (AWS, Azure, or GCP) to

Qualifications

• Hands-on Databricks platform expertise.
• Strong proficiency in Spark and SQL.
• Experience with Delta Lake and Lakehouse architecture.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
• Build and optimize ETL/ELT workflows to support data ingestion, transformation, and delivery.
• Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
• Manage and monitor Databricks clusters, notebooks, and job scheduling for performance and cost efficiency.
• Implement Delta Lake architecture and best practices for data reliability and governance.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP) and enterprise data sources.

Skills

Databricks

Apache Spark

PySpark

SQL

Problem solving

Tools

Delta Lake

Python

Scala

Cloud platforms

Job description

Vidha IT Solutions LLC is seeking a Databricks Architect to design, develop, and maintain scalable data pipelines using Databricks and Apache Spark. This remote role offers Visa: Any visa and W2 only, with collaboration across data scientists, analysts, and business stakeholders to deliver data-driven solutions.

You will manage and monitor Databricks clusters, notebooks, and job scheduling, implement Delta Lake architecture, and integrate Databricks with cloud platforms (AWS, Azure, or GCP) to