Distributed Systems Engineer - Data Platform (Delivery, Database, Retrieval)
Cloudflare
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
Cloudflare is seeking experienced engineers to join its DATA Org, building high-performance data systems for real-time visibility across global properties.
You will work on a suite of scalable services, including data delivery, analytical platforms, and customer-facing APIs, with emphasis on performance, reliability, and scalable architectures.
Qualifications
- 3+ years of experience working with distributed systems and databases.
- Strong Go programming skills and best practices.
- Hands-on with observability stacks (Prometheus, Grafana).
- Deep knowledge of SQL, database internals, design, and tuning.
- Solid CS foundation: algorithms, data structures, concurrency.
- Strong analytical and problem-solving abilities; capable of debugging large-scale systems.
- Excellent collaboration and communication across teams.
- Experience with ClickHouse is a plus.
Responsibilities
- Design, develop, and maintain scalable distributed systems across the data lifecycle.
- Build and optimise components of the high-throughput data delivery platform.
- Contribute to the Cloudflare Analytical Platform for performance improvements.
- Scale and monitor large-scale database clusters for growing data volumes.
- Enhance customer-facing GraphQL APIs, log delivery, and alerting solutions.
- Identify bottlenecks in data pipelines and optimize ingestion and queries.
- Collaborate with other teams and contribute to upstream ClickHouse.
- Stay at the frontier of data platform technologies and approaches.
Skills
Tools
Job description
At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company.
At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in.
We are looking for experienced and highly motivated engineers to join our DATA Org and help build the future of data at Cloudflare. Our organisation is responsible for the entire data lifecycle - from ingestion and processing to storage and retrieval - powering the critical logs and analytics that provide our customers with real-time visibility into the health and performance of their online properties.
Our mission is to empower customers to leverage their data to drive better outcomes for their business. We build and maintain a suite of high-performance, scalable systems that handle more than a billion events in a second. As an engineer in our organisation, you will have the opportunity to work on complex distributed systems challenges across different parts of our data stack.
Our Data Org is composed of several key teams, and you could contribute to any of the following areas:
- Data Delivery: You will build and operate our distributed data delivery pipeline, a high-throughput, low-latency system (primarily written in Go) responsible for ingesting, processing, and routing massive volumes of data from across Cloudflare's global network to multi-core destination.
- Analytical Database Platform: Contribute to our core analytical platform powered by ClickHouse. This team builds and maintains a high-performance, scalable database platform optimised for the immense analytical workloads generated by our products and services.
- Data Retrieval: Be responsible for building the customer-facing products that make data accessible and actionable. This includes developing our public GraphQL API, building robust log delivery solutions and integrations with customer destinations, and contributing to our alerting products, which empower users to configure and receive near real-time alerts based on the logs and metrics observed by our data platform.
- Design, develop, and maintain scalable and reliable distributed systems across the entire data lifecycle.
- Build and optimise key components of our high-throughput data delivery platform to ensure data integrity and low-latency delivery.
- Develop new and improve existing components for the Cloudflare Analytical Platform to extend functionality and performance.
- Scale, monitor, and maintain the performance of our large-scale database clusters to accommodate the growing volume of data.
- Develop and enhance our customer-facing GraphQL APIs, log delivery, and alerting solutions, focusing on performance, reliability, and user experience.
- Work to identify and remove bottlenecks across our data platforms, from streamlining data ingestion processes to optimizing query performance.
- Collaborate with other teams across Cloudflare to understand their data needs and build solutions that empower them to make data-driven decisions.
- Collaborate with the ClickHouse open-source community to add new features and contribute to the upstream codebase.
- Participate in the development of the next generation of our data platforms, including researching and evaluating new technologies and approaches.
- 3+ years of experience working in software development covering distributed systems and databases.
- Strong programming skills (Golang is preferable), as well as a deep understanding of software development best practices and principles.
- Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
- Strong knowledge of SQL and database internals, including experience with database design, optimisation, and performance tuning.
- A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
- Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale.
- Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.
- Experience with ClickHouse
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
