Staff Scala Engineer (Apache Spark)

BairesDev; Bengaluru Urban; Remote; INR 11,483,000 - 17,225,000; Full time

Benefits offered by this job

Excellent compensation

Paid parental leave

Vacation and national holidays

Innovative work environment

Mentorship and skill development

Growth opportunities

Multicultural environment

Job summary

A leading IT services company is seeking a Staff Scala Engineer (Apache Spark) to lead the architecture and optimization of large-scale distributed data systems. The ideal candidate will have over 10 years of software development experience, expertise in Scala and Spark internals, and a proven record of contributing to open-source projects. This full-time role offers competitive compensation and a supportive environment for professional growth.

Qualifications

• 10+ years of experience in software development.
• Expertise in Scala functional programming and JVM performance tuning.
• Deep understanding of Spark internals (Catalyst, Tungsten, memory management).
• Proven experience in designing, scaling, and optimizing large distributed Spark workloads.
• Core contributions to Apache Spark or other related projects.
• Advanced level of English.

Responsibilities

• Contribute actively to Apache Spark and related open source projects as a core contributor.
• Architect and optimize distributed Spark applications with Scala.
• Lead performance optimization initiatives in Spark’s Catalyst optimizer and Tungsten engine.
• Guide cross‑team projects on large‑scale Spark integrations and deployments.
• Provide technical leadership and best practice guidance for Scala and Spark development.

Skills

Scala functional programming

JVM performance tuning

Apache Spark internals

Distributed system optimization

English (Advanced)

Open source

English

Job description

Join to apply for the Staff Scala Engineer (Apache Spark) role at BairesDev.

At BairesDev® we have been leading technology projects for over 15 years, delivering cutting‑edge solutions to giants like Google and the most innovative startups.

We are seeking a Staff Scala (Apache Spark) Engineer to lead the architecture and optimization of distributed data systems. You'll drive large‑scale Spark applications, improve Spark’s performance, and guide technical direction across teams.

What You'll Do

• Contribute actively to Apache Spark and related open source projects as a core contributor.
• Architect and optimize distributed Spark applications with Scala.
• Lead performance optimization initiatives in Spark’s Catalyst optimizer and Tungsten engine.
• Guide cross‑team projects on large‑scale Spark integrations and deployments.
• Provide technical leadership and best practice guidance for Scala and Spark development.

What we are looking for

• 10+ years of experience in software development.
• Expertise in Scala functional programming and JVM performance tuning.
• Deep understanding of Spark internals (Catalyst, Tungsten, memory management).
• Proven experience in designing, scaling, and optimizing large distributed Spark workloads.
• Core contributions to Apache Spark or other related projects.
• Advanced level of English.

How we make your work (and your life) easier

• Excellent compensation in USD or your local currency if preferred.
• Paid parental leave, vacation, and national holidays.
• Innovative and multicultural work environment.
• Collaborate and learn from the global Top 1% of talent in each area.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

Information Technology

Industries

IT Services and IT Consulting