System Software Engineer Engineering Hyderabad, IN / Remote

DataPelago, Inc.; Hyderabad; Hybrid; INR 1,800,000 - 2,400,000; Full time

Job summary

DataPelago, Inc. in Hyderabad (India) is hiring a System Software Engineer to advance OS-level services for its accelerated data processing engine. You will architect and implement core components, optimize concurrency, and collaborate with the execution engine team.

This role values strong C/C++ and Rust expertise, Linux proficiency, and proven ability to design scalable systems on CPU/GPU platforms. You will contribute to CI/CD, testing, and performance tuning in a fast-moving, world-class

Qualifications

• Experience developing OS-level services such as task scheduling, memory management, interprocess communication, and asynchronous event processing.
• Strong knowledge of OS internals and computer architecture.
• Extensive development experience in Linux environments.
• Exceptional programming skills in C, C++, and Rust.

Responsibilities

• Architect: influence architecture for compute/memory/storage/resource management.
• Design: enhance OS-level capabilities for high-concurrency data processing.
• Core Development: implement, test, optimize, and maintain engine components.
• Innovation: evaluate Rust/CUDA runtime and other platform advances to improve the engine.
• Collaboration: work with the execution engine team to enhance system software.
• Continuous Improvement: promote best practices, CI/CD, testing, and code quality.

Skills

Task scheduling

Memory management

Interprocess communication

Asynchronous event processing

Rust

C++

C

Linux

Education

Bachelor's in Computer Science or related

Master's in Computer Science or related

Tools

C

C++

Rust

Linux

Job description

System Software Engineer

Hyderabad, IN / Remote

About DataPelago:

DataPelago is at the forefront of revolutionizing data processing for traditional analytics and cutting-edge GenAI preprocessing. We are building an innovative data processing engine that is transforming how Apache Spark, Apache Flink, Ray and others operate on diverse, large-scale data. Our team of engineers drive and adopt advances in hardware-accelerated computing, parallel processing of large-scale data, query optimization, distributed systems, compilers, machine learning, and cloud-native computing. We are looking for specialists to join our engineering team and shape the future of accelerated data processing.

The Opportunity:

As a System Software Engineer, you will be a key individual contributor in advancing operating system level capabilities underlying DataPelago’s data processing engine. You will enhance functional breadth, performance, scale, and reliability of these OS-level services on diverse accelerated hardware platforms. This is a unique opportunity to make a significant impact on a category-defining product and work with a talented team of engineers.

What You'll Do:

• Architect: Influence the architecture of how our data processing engine harnesses and manages the use of compute, memory, storage, and network resources.


• Design: Lead design of functional and performance enhancements to OS-level capabilities underlying our data processing engine such as concurrent event processing, memory management, and inter-process communication.


• Core Development: Individually design, implement, test, optimize, and maintain components of the data processing engine.


• Innovation and Differentiation: Analyze advances in system services provided by platforms and programming models for high-concurrency data processing on CPUs and GPUs (e.g., Rust, CUDA runtime) and identify opportunities for our engine to enhance technology and product leadership.


• Collaboration: Partner effectively with the execution engine engineering team in enhancing system software capabilities.


• Continuous Improvement: Foster best practices in design and code reviews, testing, CI/CD, and issue resolution to maintain highest product quality, security, efficiency, & productivity.

What You'll Bring:

• Bachelor's degree in Computer Science or a related field with 5+ years of relevant experience OR a Master's degree in Computer Science or a related field with 3+ years of relevant experience.


• 3+ years of deep technical experience in developing and delivering OS-level services such as task scheduling, memory management, interprocess communication, asynchronous event processing for production software or hardware platforms.


• Demonstrated experience in troubleshooting and resolving functional and performance anomalies in both pre- and post-production scenarios.


• Strong knowledge of operating system internals and computer architecture.


• Exceptional programming skills in C, C++, and Rust.


• Extensive development experience in Linux environments.


• Strong analytical and problem-solving skills with a passion for performance optimization.

Location Considerations:

We value face-to-face collaboration, but recognize that talent can be found anywhere. Our engineering team works at our headquarters in Mountain View, CA, at our India office in Hyderabad, and at remote locations. This position will be primarily based in India, in Hyderabad (preferred) or remote.

Why Join DataPelago?

• Technology Leadership: Shape the architecture and development of core operating system level capabilities that our data processing engine depends on.


• Cutting-Edge Innovation: Work on challenging problems at the forefront of accelerated computing and data processing.


• Significant Impact: Your contributions will directly impact the performance and scalability of our mission-critical platform.


• Growth: Expand your technical expertise and scope of responsibilities working with other talented engineers and with a growing product.


• Competitive compensation, stock options, comprehensive benefits package, leadership development opportunities.