Senior Software Engineer - Streaming Platform Client

The Consulting Solutions; New York (NY); On-site; USD 192,000 - 240,000; Full time

Benefits offered by this job

New hire stock equity (RSUs)

Continuous professional development

Inclusive company culture

Free global mental health benefits

Job summary

The Consulting Solutions is seeking a Senior Software Engineer to enhance the Streaming Platform Client. This pivotal role involves collaborating across teams in the US and Europe to build robust technologies for critical data pipelines.

You will work on optimizing high-throughput streaming libraries, leading technical initiatives, and mentoring junior developers. Candidates should have a strong proficiency in Rust and a commitment to user experience, along with an interest in AI for software development.

Benefits include stock equity, professional development opportunities, and a supportive company culture.

Qualifications

• Strong proficiency in low-level languages, especially Rust.
• Experience with high-throughput, low-level streaming libraries.

Responsibilities

• Work within a distributed team to build technologies for data pipelines.
• Optimize high-throughput streaming library for performance.
• Mentor junior engineers and interns.

Skills

Low-level languages proficiency

Rust programming

Performance optimization

AI integration

Tools

Kafka

Job description

Senior Software Engineer - Streaming Platform Client

Data streams are mission‑critical at Datadog, powering near real‑time communication across the vast majority of our services. Our Streaming Platform group builds the core infrastructure and abstractions that ensure Datadog remains a trusted partner for engineers worldwide.

The Streaming Platform Client team sits at the heart of this ecosystem. We own the Rust client library (producers and consumers) with language bindings for Java, Go, and Python. We focus on building intuitive APIs and abstractions that make a powerful distributed system easy to adopt and operate for the hundreds of internal users of our library. Our library runs on critical data paths that handle hundreds of millions of messages per second, making performance, observability, and reliability paramount. We also develop and operate the service that bridges the client fleet with the platform’s control plane, handling complex balancing, scaling, and stability challenges.

What You’ll Do:

• Work within a distributed, high‑impact team spanning Europe and the US, building critical technologies that power data pipelines for dozens of internal teams and hundreds of services.
• Architect and implement resilient interactions between our client libraries and the control plane.
• Optimize our high‑throughput, low‑level streaming library to push the boundaries of performance and efficiency.
• Champion the developer experience by providing exceptional support, technical documentation, and proactive troubleshooting for our wide user base.
• Lead high‑stakes technical projects, maintaining end‑to‑end accountability for their delivery and quality.
• Collaborate with partner teams on delivering projects wider than your team’s scope.
• Mentor junior engineers and interns, fostering a culture of technical excellence and shared knowledge.

Who You Are:

• Self‑starter who experiments methodically, iterates rapidly, and views failure as a learning opportunity.
• Finisher who takes projects through the finish line and does not stop at shipping code.
• Collaborative, blameless culture champion who actively fosters growth of teammates.
• Communicates complex ideas effectively, with experience gathering requirements from stakeholders and leading high‑impact technical initiatives.
• Deeply committed to user experience, ensuring the tools you build empower developers.
• Strong proficiency in low‑level languages, ideally Rust.
• Passionate about deep‑dive investigations, especially in performance optimization and debugging complex systems.
• Curious about AI and actively leverages it to enhance development workflow.
• Bonus: Direct experience operating or using large‑scale streaming systems like Kafka.
• Bonus: Familiarity with language bindings and FFI.

Benefits and Growth:

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
• Continuous professional development, product training, and career pathing.
• In‑departmental mentor and buddy program for in‑house networking.
• Inclusive company culture with access to employee resource groups.
• Free, global mental health benefits for employees and dependents age 6+.
• Competitive global benefits.

Salary: $192,000 – $240,000 USD

Equal Opportunity at Datadog:

Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.