Job #1119 - Senior Software Engineer - distributed systems, low-latency, high throughput

Bivium Group; United States; Remote; USD 180,000 - 260,000; Full time

Job summary

An innovative company is urgently seeking a Senior Software Engineer specializing in distributed systems. This remote position offers the chance to work on enhancing a crucial syncing engine that serves a diverse global clientele. You'll tackle challenges in performance optimization and troubleshooting, while having the autonomy to manage projects from start to finish. The role emphasizes collaboration with customers and the opportunity to influence company priorities. If you thrive in a fast-paced startup environment and are passionate about delivering significant customer value, this position is perfect for you.

Qualifications

• Experience with distributed systems and high-scale applications is essential.
• Strong interest in solving complex technical problems for customer value.

Responsibilities

• Optimize syncing processes to enhance data synchronization speeds.
• Transition from batch syncing to real-time syncing for platforms.
• Develop a low-latency caching layer for real-time personalization.

Skills

Distributed Systems

Performance Optimization

Troubleshooting

Real-time Data Processing

Data Synchronization

Job description

Job #1119 - Senior Software Engineer - distributed systems, low-latency, high throughput

Salary range:
$180,000 - $260,000

Location:
Remote

Description:
This company is well-funded and boasts an impressive list of industry-leading customers. They are U.S. based and operate on a remote-first model.

This is a high priority role that they are urgently looking to fill. They are seeking a Distributed Systems Engineer to enhance the systems that drive their syncing engine, which is essential for customers and engineering teams. This role involves tackling challenges in distributed systems, performance optimization, and troubleshooting to improve the capacity for handling large volumes of customer data. The position offers the opportunity to work on a multi-cloud and multi-region infrastructure that serves a global clientele.

The organization emphasizes high levels of ownership and autonomy, allowing engineers to manage projects from inception to completion, collaborate directly with customers on scaling issues, and influence team and company priorities.

Responsibilities:

1. Analyze and optimize the syncing process to enhance data synchronization speeds for platforms like Facebook and Snapchat.
2. Transition from batch syncing to real-time syncing, supporting streaming sources such as webhooks and queues.
3. Identify and address potential bottlenecks in scaling and reliability as the company grows.
4. Develop a low-latency caching layer for real-time personalization use cases, achieving <30ms p90 response times with high query per second (QPS) capability.
5. Expand the backend infrastructure to new regions to meet global data residency requirements.

The ideal candidate is a motivated engineer with a strong interest in solving complex technical problems that provide significant customer value. They should thrive in a fast-paced startup environment and possess experience with distributed systems and high-scale applications.

Relevant experience may include:

1. Building syncing engines capable of processing and moving terabytes of data daily.
2. Developing event collection or data streaming services that are vital for critical company operations.
3. Managing systems that have scaled significantly and implementing necessary growth strategies.