Senior Spark Solutions Engineer for Strategic Clients

Neon; San Francisco (CA); On-site; USD 142,000 - 251,000; Full time

Job summary

Databricks in the San Francisco Bay Area is seeking a Sr. Staff Technical Solutions Engineer to partner with Field and Engineering teams, delivering high-touch support and tailored technical solutions for the largest DNB customers.

You will use Spark, SQL, Delta, and runtime features to triage complex issues and unblock critical challenges. You will build POCs, develop playbooks, and train customers on performance tuning.

Qualifications

• 8012 years building distributed data apps with Spark/ML/AI.
• 4+ years delivering production Spark/ML/AI solutions in Python/Java/Scala.
• Hands-on with data lakes, SQL databases, and cloud data warehousing.
• Deep knowledge of Spark internals, Delta/Iceberg, JVM tuning.
• Experience with AWS/Azure/GCP and CI/CD pipelines.
• 30to5 years in customer-facing roles such as Solutions Architect.
• Strong collaboration and leadership across teams.
• Proactive risk mitigation for production systems.

Responsibilities

• Perform advanced troubleshooting and root cause analysis for Spark/SQL/Delta issues.
• Collaborate with R&D and NOC to optimize customer environments.
• Build rapid POCs and monitor deployments showcasing Spark/ML/AI capabilities.
• Develop playbooks and a knowledge base for Spark, ML, AI workflows.
• Train customer teams on performance tuning and best practices.
• Travel up to 20% for on-site engagements.

Skills

Spark/ML/AI production pipelines

Data Lakes

SQL databases

Cloud Data Warehousing (Snowflake/Red

AWS/Azure/GCP

CI/CD, Monitoring & Alerting

Customer-facing experience

Proactive problem solving

Cross-functional leadership

Job description

Databricks in the San Francisco Bay Area is seeking a Sr. Staff Technical Solutions Engineer to partner with Field and Engineering teams, delivering high-touch support and tailored technical solutions for the largest DNB customers.

You will use Spark, SQL, Delta, and runtime features to triage complex issues and unblock critical challenges. You will build POCs, develop playbooks, and train customers on performance tuning.