Senior Backend Engineer—Data Platform, Remote, Stock

People Data Labs; United States; Teletrabalho; USD 160 000 - 200 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Stock

Competitive salaries

Unlimited paid time off

Medical, dental, & vision insurance

Health, fitness, and office stipends

Resumo da oferta

People Data Labs is seeking a senior data engineer to design and optimize data ingestion pipelines, build scalable crawling systems, and deliver high-quality datasets to customers. You will work on distributed architectures, improve observability, and collaborate with product teams to create new data products.

The role offers remote-first collaboration with a data-driven culture and a strong emphasis on ownership, learning, and innovation.

Qualificações

• 7+ years of professional experience building or operating backend or infrastructure systems at scale.
• Solid programming experience in Python, Go, Rust, or similar, including experience with async / await, coroutines, or concurrency frameworks.
• Strong grasp of software architecture and backend fundamentals; you can reason clearly about concurrency, scalability, and fault tolerance.
• Familiarity with network architecture and debugging (HTTP, DNS, proxies, packet capture and analysis).
• Experience designing or maintaining resilient data ingestion, API integration, or ETL systems.

Responsabilidades

• Contribute to the architecture and improvement of our data acquisition and processing platform, increasing reliability, throughput, and observability
• Use and develop web crawling technologies to capture and catalog data on the internet
• Build, operate, and evolve large-scale distributed systems that collect, process, and deliver data from across the web
• Design and develop backend services that manage distributed job orchestration, data pipelines, and large-scale asynchronous workloads
• Structure and model captured data, ensuring high quality and consistency across datasets
• Continuously improve the speed, scalability, and fault-tolerance of our ingestion systems
• Partner with data product and engineering teams to design and implement new data products powered by the data you help collect, and enhance and improve upon existing products
• Learn and apply domain-specific knowledge in web crawling and data acquisition, with mentorship from experienced teammates and access to existing systems

Conhecimentos

Python

Go

Rust

Async programming

Distributed systems

Data ingestion

Web crawling

Formação académica

Degree in quantitative field

Ferramentas

Kafka

SQS

Airflow

Spark

Databricks

SQL

Snowflake

Redshift

BigQuery

Descrição da oferta de emprego

People Data Labs is seeking a senior data engineer to design and optimize data ingestion pipelines, build scalable crawling systems, and deliver high-quality datasets to customers. You will work on distributed architectures, improve observability, and collaborate with product teams to create new data products.

The role offers remote-first collaboration with a data-driven culture and a strong emphasis on ownership, learning, and innovation.