Remote Data Architect & Databricks Solutions Lead

TekValue IT Solutions; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

TekValue IT Solutions is seeking a Data Architect / Solution Architect to design and implement scalable data platforms in a remote United States setting. You will lead end-to-end data solutions, optimize Spark and Databricks workloads, and collaborate with stakeholders to ensure delivery and value.

The candidate should have 5-10+ years in data engineering/analytics, strong Databricks and Spark skills, Delta Lake, and cloud experience across AWS, Azure, or GCP.

Qualifications

• 5-10+ years of experience in Data Engineering, Analytics, or Data Solutions Consulting.
• 3+ years of hands-on experience with Databricks including workload optimization, debugging, and governance.
• Strong expertise in Apache Spark, Spark Internals, Py Spark, and Databricks SQL (DBSQL).
• Experience architecting and optimizing large-scale data processing workloads.
• Strong knowledge of Delta Lake, Lakehouse Architecture, and Structured Streaming.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Ability to lead customer engagements from discovery through delivery with minimal oversight.
• Experience conducting technical workshops, solution design sessions, and Proof of Concepts (PoCs).
• Strong customer-facing communication and stakeholder management skills.
• Experience mentoring engineers and promoting best practices in data engineering.

Responsibilities

• Lead customer engagements with full ownership and accountability.
• Architect, implement, and optimize Spark and Databricks solutions for performance and cost efficiency.
• Troubleshoot and tune distributed data workloads and SQL performance issues.
• Design and deliver workshops and Proof of Concepts (PoCs).
• Act as a trusted technical advisor to customers and business stakeholders.
• Collaborate with product and engineering teams to improve customer outcomes.
• Mentor team members and drive adoption of data engineering best practices.

Skills

Data engineering

Analytics

Data solutions consulting

Databricks

Spark

Spark internals

Py Spark

Databricks SQL

large-scale data processing

Delta Lake

Lakehouse architecture

Structured Streaming

Cloud platforms

AWS

Azure

GCP

lead customer engagements

workshops

PoCs

customer-facing communication

Tools

Databricks

Spark

Delta Live Tables

Unity Catalog

AWS

Azure

GCP

Job description

TekValue IT Solutions is seeking a Data Architect / Solution Architect to design and implement scalable data platforms in a remote United States setting. You will lead end-to-end data solutions, optimize Spark and Databricks workloads, and collaborate with stakeholders to ensure delivery and value.

The candidate should have 5-10+ years in data engineering/analytics, strong Databricks and Spark skills, Delta Lake, and cloud experience across AWS, Azure, or GCP.