Senior Forward-Deployed Data Engineer (Databricks & Spark)

Menlo Ventures; Austin (TX); On-site; USD 182,000 - 250,208; Full time

Job summary

Databricks is seeking a Senior Big Data Solutions Architect (Resident Solutions Architect) to lead client engagements on Databricks-based big data and AI projects. You will design, build and deploy end-to-end architectures, provide data engineering and data science guidance, and work closely with clients to maximize value from their data.

You will scope work with engagement managers, guide strategic customers through complex migrations, and offer expert architectural support while traveling up

Qualifications

• 6+ years experience in data engineering, data platforms & analytics.
• Proficient in Python or Scala.
• Experience with one or more cloud ecosystems (AWS, Azure, GCP).
• Deep experience with Apache Spark and Spark runtime internals.
• Familiar with CI/CD for production deployments.
• Experience with MLOps.
• Design and deployment of end-to-end data architectures.
• Experience with technical project delivery and managing scope/timelines.
• Strong documentation and whiteboarding skills.
• Experience working with clients and managing conflicts.
• Willingness to travel 20%.
• Databricks Certification.

Responsibilities

• Design and build reference architectures and productionize customer use cases.
• Scope professional services with engagement managers and customer input.
• Guide customers in implementing big data projects end-to-end.
• Consult on architecture; bootstrap or implement customer projects.
• Provide escalated support for operational issues.
• Collaborate with Databricks team to deliver engagements.
• Feedback product and support issues to engineering and support teams.
• Travel to customers up to 20%.

Skills

Data engineering

Data platforms

Analytics

Python

Scala

Cloud platforms

Apache Spark

CI/CD

MLOps

Documentation

Client communication

Project delivery

Travel 20%

Tools

Databricks Platform

Job description

Databricks is seeking a Senior Big Data Solutions Architect (Resident Solutions Architect) to lead client engagements on Databricks-based big data and AI projects. You will design, build and deploy end-to-end architectures, provide data engineering and data science guidance, and work closely with clients to maximize value from their data.

You will scope work with engagement managers, guide strategic customers through complex migrations, and offer expert architectural support while traveling up