Sr. Designated Support Engineer, Apache Spark

Databricks; São Paulo; Presencial; BRL 180 000 - 300 000; Tempo integral

Resumo da oferta

Databricks is seeking a Sr. Designated Support Engineer/Premier Support Engineer with a deep background in Apache Spark and data engineering. You will manage strategic accounts, troubleshoot complex Spark issues, and guide customers on best practices across ETL/ELT, data modeling, and lakehouse architectures.

The role emphasizes proactive engagement with cross-functional teams and senior stakeholders. You will coordinate with Engineering, Product, and Accounts teams to drive tickets to

Qualificações

• Minimum 3 years of dedicated experience in Data Engineering, building, deploying, and maintaining large-scale data pipelines.
• Minimum 3 years’ experience designing, developing, testing, and sustaining Python/Java/Scala-based applications.
• Deep architectural knowledge of Apache Spark internals (Drivers, Executors, memory, DAGs, Catalyst, Tungsten).

Responsabilidades

• Manage large strategic accounts to provide a high-touch support experience.
• Deep-dive into complex Spark and Data Engineering issues, analyzing Spark UI, thread dumps, and logs to resolve bottlenecks.
• Advise customers on data engineering best practices, ETL/ELT optimization, data modeling, and lakehouse architecture.
• Project manage open support cases to expedite ticket closure.
• Coordinate with Engineering, Product, SMEs, and Accounts teams to advance tickets toward resolution.
• Engage with Senior Leadership to remove roadblocks and mitigate issues.
• Drive customer self-sufficiency by teaching how to engage with Databricks Support tools.

Conhecimentos

Data Engineering

Spark

Python/Java/Scala

Project Management

Troubleshooting

Customer Engagement

Executive Communication

Descrição da oferta de emprego

P-1448

About the Role

Databricks is seeking an experienced Sr. Designated Support Engineer/Premier Support Engineer with a strong technical foundation in Apache Spark and a passion for customer engagement. This self-motivated professional will demonstrate high commitment to both customers and internal teams, with excellent communication, project management, and problem-solving skills. In this role, the Sr. Designated Support Engineer/Premier Support Engineer will build and maintain close relationships with strategic customers, manage and prioritize critical issues, and ensure a high-touch, proactive support experience.

The Impact You Will Have

• Manage large strategic accounts to provide a high-touch support experience.

• Deep-dive into complex Apache Spark and Data Engineering issues, analyzing Spark UI, thread dumps, and driver/executor logs to resolve critical performance bottlenecks.

• Advise strategic customers on Data Engineering best practices, including optimizing ETL/ELT pipelines, data modeling, and leveraging the Databricks Lakehouse architecture (Delta Lake/Iceberg).

• Project manage all open support cases to expedite support ticket closure.

• Facilitate customer correspondence with Engineering, Product Team, SMEs, and Accounts Teams to advance tickets toward resolution.

• Directly engage on business-impacting situations and ensure recovery of functionality for the customer.

• Successfully engage with Senior Leadership, Technical and Functional staff to remove roadblocks, address delays, and mitigate issues.

• Effectively use sound business judgment, risk avoidance, and SME resources to coordinate team efforts to solve problems.

• Carry out regular reviews of customer cases to identify trends and proactive optimization opportunities.

• Champion and advocate for customers and chair roundtables to ensure close communication and relationship building with key stakeholders.

• Drive customer self-sufficiency by ensuring customers understand how to engage with the Databricks Support organization and tools.

What We Look For

• Minimum 3 years of dedicated experience in Data Engineering, building, deploying, and maintaining large-scale data pipelines.

• Minimum 3 years’ experience designing, developing, testing, and sustaining Python/Java/Scala-based applications required.

• Deep, architectural knowledge of Apache Spark internals (including Drivers, Executors, Core Memory Management, DAGs, Catalyst Optimizer, and Tungsten execution engine).

• Proven track record of troubleshooting complex Spark and big data issues, such as data skew, out-of-memory (OOM) errors, serialization issues, and slow-running broadcast joins.

• Highly effective with project managing multiple tasks and work streams, driving them to conclusion.

• Demonstrated analytical and problem-solving skills, particularly those that apply to a “Distributed Big Data Computing” environment.

• Excellent executive presence. You are an excellent communicator (written and verbal skills), with demonstrable customer communication and coordination efforts, and the ability to take complex technical ideas and translate them to non-technical stakeholders

• Preference for customer-facing experience as a Support Engineer, Technical Account Manager, DSE, or in related production support areas

About Databricks

Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn, X, YouTube, and Instagram.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here.

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.