Sr. Designated Support Engineer, Apache SparkTM

Databricks Inc.; São Paulo; Híbrido; BRL 200 000 - 400 000; Tempo integral

Resumo da oferta

Databricks is seeking a Sr. Designated Support Engineer/Premier Support Engineer based in São Paulo, Brazil, to provide high-touch support for strategic customers and manage critical issues related to Apache Spark and data engineering.

You will dive into Spark internals, guide customers on best practices for ETL/ELT pipelines, and collaborate with cross-functional teams to drive ticket resolution and customer success in a hybrid office model requiring 3 days per week in the São Paulo office.

Qualificações

• Minimum 3 years of experience in Data Engineering building large-scale data pipelines.
• 3+ years designing developing testing and sustaining Python/Java/Scala applications.
• Deep knowledge of Apache Spark internals and troubleshooting complex Spark issues.

Responsabilidades

• Manage large strategic accounts to provide high-touch support.
• Deep-dive into Spark and Data Engineering issues to resolve bottlenecks.
• Advise customers on ETL/ELT, data modeling, and Delta Lake/Iceberg usage.
• Project manage open support cases to expedite resolutions.
• Coordinate with Engineering, Product, SMEs, and Accounts teams on tickets.

Conhecimentos

Apache Spark

Data Engineering

Python/Java/Scala

Customer engagement

Project management

Ferramentas

Spark UI

Logging analysis

Descrição da oferta de emprego

Sr. Designated Support Engineer, Apache Spark™

P-1448

This role is hybrid and requires at least 3x a week in our office, based in São Paulo/SP.

About the Role

Databricks is seeking an experienced Sr. Designated Support Engineer/Premier Support Engineer with astrong technical foundation in Apache Spark and a passion for customer engagement. This self-motivated professional will demonstrate high commitment to both customers and internal teams, with excellent communication, project management, and problem-solving skills. In this role, the Sr. Designated Support Engineer/Premier Support Engineer will build and maintain close relationships with strategic customers, manage and prioritize critical issues, and ensure a high-touch, proactive support experience.

The Impact You Will Have

Manage large strategic accounts to provide a high-touch support experience.

Deep-dive into complex Apache Spark and Data Engineering issues, analyzing Spark UI, thread dumps, and driver/executor logs to resolve critical performance bottlenecks.

Advise strategic customers on Data Engineering best practices, including optimizing ETL/ELT pipelines, data modeling, and leveraging the Databricks Lakehouse architecture (Delta Lake/Iceberg).

Project manage all open support cases to expedite support ticket closure.

Facilitate customer correspondence with Engineering, Product Team, SMEs, and Accounts Teams to advance tickets toward resolution.

Directly engage on business-impacting situations and ensure recovery of functionality for the customer.

Successfully engage with Senior Leadership, Technical and Functional staff to remove roadblocks, address delays, and mitigate issues.

Effectively use sound business judgment, risk avoidance, and SME resources to coordinate team efforts to solve problems.

Carry out regular reviews of customer cases to identify trends and proactive optimization opportunities.

Champion and advocate for customers and chair roundtables to ensure close communication and relationship building with key stakeholders.

Drive customer self-sufficiency by ensuring customers understand how to engage with the Databricks Support organization and tools.

What We Look For

Minimum 3 years of dedicated experience in Data Engineering, building, deploying, and maintaining large-scale data pipelines.

Minimum 3 years’ experience designing, developing, testing, and sustaining Python/Java/Scala-based applications required.

Deep, architectural knowledge of Apache Spark internals (including Drivers, Executors, Core Memory Management, DAGs, Catalyst Optimizer, and Tungsten execution engine).

Proven track record of troubleshooting complex Spark and big data issues, such as data skew, out-of-memory (OOM) errors, serialization issues, and slow-running broadcast joins.

Highly effective with project managing multiple tasks and work streams, driving them to conclusion.

Demonstrated analytical and problem-solving skills, particularly those that apply to a "Distributed Big Data Computing" environment.

Excellent executive presence. You are an excellent communicator (written and verbal skills), with demonstrable customer communication and coordination efforts, and the ability to take complex technical ideas and translate them to non-technical stakeholders

Preference for customer-facing experience as a Support Engineer, Technical Account Manager, DSE, or in related production support areas

Mandatory Bilingual Proficiency (English & Portuguese): Full professional fluency in English is required for daily collaboration with US-based internal teams, alongside full professional fluency in Portuguese to directly support our Brazilian customer base.

About Databricks

Databricks is the Data and AI company. More than 20,000 organizations worldwide - including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 - rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn , X , YouTube , and Instagram .
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region click here .

Our Commitment to Diversity and Inclusion

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

Compliance

If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Databricks’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.