Distributed Systems Engineer - Data Platform (Delivery, Database, Retrieval)

Cloudflare; Lisboa; Presencial; EUR 70 000 - 110 000; Tempo integral

Resumo da oferta

Cloudflare Lisbon is seeking experienced engineers to join our DATA Org and help build the future of data at Cloudflare. You will work on end-to-end data lifecycle systems, from ingestion to analytics, in a high-scale environment.

As part of the Data Org, you will contribute across data delivery, analytical platform, and data retrieval areas, collaborating with global teams to deliver reliable, low-latency solutions that power real-time visibility for customers.

Qualificações

• 3+ years in software development with distributed systems & databases.
• Proficient in Go and modern software practices.
• Experience with Prometheus, Grafana, and high-cardinality metrics.
• Strong SQL knowledge and understanding of database internals.

Responsabilidades

• Design, develop, and maintain scalable distributed systems across the data lifecycle.
• Build and optimise components of the data delivery platform for low latency.
• Develop and enhance Cloudflare Analytical Platform features for performance.
• Scale and monitor large-scale database clusters to handle growing data volumes.
• Develop and improve GraphQL APIs, log delivery, and alerting solutions.
• Identify bottlenecks and optimize data ingestion and query performance.
• Collaborate with other teams across Cloudflare to meet data needs.
• Contribute to the ClickHouse community and upstream codebase.
• Explore new technologies to advance the next generation of data platforms.

Conhecimentos

Golang

Distributed systems

SQL

Observability

Problem solving

Collaboration

Formação académica

Bachelor's degree in CS or related field

Ferramentas

Prometheus

Grafana

ClickHouse

Descrição da oferta de emprego

About Us

At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company.

About Us

At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in.

Locations Available: Atlanta, US, Austin, US, Denver, US, Seattle, US, Washington DC, US, Lisbon, Portugal

About Role

We are looking for experienced and highly motivated engineers to join our DATA Org and help build the future of data at Cloudflare. Our organisation is responsible for the entire data lifecycle - from ingestion and processing to storage and retrieval - powering the critical logs and analytics that provide our customers with real-time visibility into the health and performance of their online properties.

Our mission is to empower customers to leverage their data to drive better outcomes for their business. We build and maintain a suite of high-performance, scalable systems that handle more than a billion events in a second. As an engineer in our organisation, you will have the opportunity to work on complex distributed systems challenges across different parts of our data stack.

Our Data Org is composed of several key teams, and you could contribute to any of the following areas:

• Data Delivery: You will build and operate our distributed data delivery pipeline, a high-throughput, low-latency system (primarily written in Go) responsible for ingesting, processing, and routing massive volumes of data from across Cloudflare's global network to multi-core destination.
• Analytical Database Platform: Contribute to our core analytical platform powered by ClickHouse. This team builds and maintains a high-performance, scalable database platform optimised for the immense analytical workloads generated by our products and services.
• Data Retrieval: Be responsible for building the customer-facing products that make data accessible and actionable. This includes developing our public GraphQL API, building robust log delivery solutions and integrations with customer destinations, and contributing to our alerting products, which empower users to configure and receive near real-time alerts based on the logs and metrics observed by our data platform.

Responsibilities

• Design, develop, and maintain scalable and reliable distributed systems across the entire data lifecycle.
• Build and optimise key components of our high-throughput data delivery platform to ensure data integrity and low-latency delivery.
• Develop new and improve existing components for the Cloudflare Analytical Platform to extend functionality and performance.
• Scale, monitor, and maintain the performance of our large-scale database clusters to accommodate the growing volume of data.
• Develop and enhance our customer-facing GraphQL APIs, log delivery, and alerting solutions, focusing on performance, reliability, and user experience.
• Work to identify and remove bottlenecks across our data platforms, from streamlining data ingestion processes to optimizing query performance.
• Collaborate with other teams across Cloudflare to understand their data needs and build solutions that empower them to make data-driven decisions.
• Collaborate with the ClickHouse open-source community to add new features and contribute to the upstream codebase.
• Participate in the development of the next generation of our data platforms, including researching and evaluating new technologies and approaches.

Key Qualifications

• 3+ years of experience working in software development covering distributed systems and databases.
• Strong programming skills (Golang is preferable), as well as a deep understanding of software development best practices and principles.
• Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
• Strong knowledge of SQL and database internals, including experience with database design, optimisation, and performance tuning.
• A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
• Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale.
• Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.
• Experience with ClickHouse