Staff Software Engineer, Storage

Cloudera; Remote; INR 15,00,000 - 25,00,000; Full time

Job summary

A global technology firm is seeking a Staff Software Engineer focused on distributed systems and Apache Ozone. You will design and implement core features, collaborate with teams, and contribute to open-source software. Candidates should have a strong backend engineering skill set with expertise in Java or C++, along with experience in handling large-scale distributed systems. This role involves leading engineering efforts and mentoring junior engineers, making it a pivotal part of the data engineering landscape.

Benefits

Generous PTO Policy

Flexible WFH Policy

Mental & Physical Wellness programs

Continued Career Development

Comprehensive Benefits and Competitive Packages

Paid Volunteer Time

Employee Resource Groups

Qualifications

• 6+ years of relevant industry experience required.
• Expertise in backend engineering, particularly in Java or C++.
• Experience with large-scale distributed systems design and development.
• Hands-on programming with strong data structures and algorithms skills.

Responsibilities

• Design and implement core features of Apache Ozone.
• Contribute code and design docs to the Apache open-source community.
• Collaborate with cross-functional teams to facilitate design and implementation.
• Lead and mentor junior engineers in the Storage Engineering team.

Skills

Java

C++

Distributed systems design

Clean coding habits

Data structures and algorithms

Strong communication skills

Education

Bachelor's +6 or Master's degree

Tools

Apache Ozone

Apache Ratis

Hive

Pig

MapReduce

HBase

Job description

Business Area

Engineering

Seniority Level

Mid-Senior level

Job Description

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we’re the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance.

Cloudera is looking for an exceptional and passionate software engineer with a strong distributed systems background to join the Storage Engineering team focused on building Apache Ozone. The Storage team is responsible for primary storage and storage access layers, which are core to the platform. They created and wrote most of the HDFS code and made a huge impact on the big data and cloud computing industry. Apache Ozone provides a massively scalable distributed object store with a distributed file system interface. Ozone is designed to scale to tens of billions of files and blocks, and overcome the limitations of Hadoop Distributed File System (HDFS), namely, millions of small files and managing a huge number of datanodes.

Ozone is one of the fastest-growing products inside CDP in terms of customer adoption and expansion revenue.

As a Staff Software Engineer, you will…

• You will be directly involved in the design and implementation of the core feature set of Apache Ozone and Apache Ratis (open-source RAFT implementation)
• You will regularly contribute code and design docs to the Apache open-source community.
• As part of storage engineering, you will support enterprise customers running 100s of petabytes-scale big data analytics and ML/AI pipelines.
• You will partner with product managers and cross-functional teams as a part of the Cloudera Data Platform ecosystem in understanding requirements and turning them into a solid design and implementation, and facilitating integration and adoption.
• You will be responsible for leading and collaborating with a talented group of engineers working on a feature and mentoring junior engineers.

We are excited if you have…

• Bachelor's +6, Master's 4-6 years of relevant industry experience required
• Strong backend engineering skill set with expertise in Java, or strong C++ skills, with intermediate Java expertise
• Passionate about programming. Clean coding habits, attention to detail, and focus on quality
• Experience with large-scale, distributed systems design and development with a strong understanding of scaling, replication, consistency, and high availability
• Solid experience with system software design and development with a strong understanding of computer architecture, storage, network, and IO subsystems, and distributed systems
• Hands-on programmer with strong data structures and algorithms skillset
• Strong oral and written communication skills

You may also have.

• Strong background in a distributed storage system, including file systems, database storage internals, NoSQL storage, or distributed hash tables
• Strong background in performance tuning, identifying performance bottlenecks, and implementing performance optimizations
• Strong understanding of the Apache Big Data ecosystem and over 3+ years of experience in systems software, including file systems
• Recognized contributions to open source projects
• Experience using projects such as Hive, Pig, MapReduce, HBase, etc., is a big plus
• Good Understanding of storage development, RAFT replication framework, or equivalent distributed consensus frameworks

Why this role matters:

You will tackle complex distributed systems challenges, crafting the foundational software for the control and data planes that powers CDP and keeps it running at massive scale. Working at the forefront of hybrid and multi-cloud technology, you will empower data scientists, engineers, and analysts with the tools and infrastructure they need for advanced analytics and modeling.

Collaboration is key, you will work alongside brilliant minds across product, data science, and engineering to drive innovation, standardize best practices, and shape the future of enterprise AI and data platforms. This is your chance to build the future of data and see your work make a global impact.

What you can expect from us:

• Generous PTO Policy
• Support work life balance with Unplugged Days
• Flexible WFH Policy
• Mental & Physical Wellness programs
• Phone and Internet Reimbursement program
• Access to Continued Career Development
• Comprehensive Benefits and Competitive Packages
• Paid Volunteer Time
• Employee Resource Groups

EEO/VEVRAA