Senior Data Ingestion Engineer: Pipelines & Streaming

Remote; San Francisco (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Logoslabs in San Francisco seeks a Staff Software Engineer, Data Ingestion to design and build scalable data pipelines. You will develop production-grade ingestion systems, integrate multiple data sources, and ensure data quality and availability for analytics and products.

Responsibilities include optimizing data models with DB engineers, monitoring pipelines, and participating in on-call rotations. Strong Python, distributed systems, and cloud experience are essential.

Qualifications

• 6+ years experience in software development from a computer science background.
• Extensive Python experience in production-grade applications.
• Experience collecting data from diverse sources (APIs, Kafka, S3, OAuth, GraphQL, etc.).
• Strong knowledge of distributed systems, scale, performance, and fault tolerance.
• Familiarity with cloud data services (AWS or GCP) and data modeling basics.

Responsibilities

• Design, develop, and maintain high-performance, fault-tolerant data ingestion pipelines.
• Integrate with diverse data sources and perform data transformation during ingestion.
• Monitor, troubleshoot, and resolve ingestion issues; ensure data quality and freshness.
• Collaborate with database engineers to optimize data models for fast consumption.
• Propose new technologies to improve ingestion efficiency and reliability; participate in on-call rotation.
• Define and uphold SLAs/SLOs for data freshness, completeness, and availability.

Skills

Python expertise

Data ingestion

Distributed systems

Cloud platforms

SQL / OLAP

Monitoring & alerting

Git

On-call experience

Education

B.S. in Computer Science

Tools

Docker

Kubernetes

Kafka

Spark Streaming

AWS / GCP services

Job description

Logoslabs in San Francisco seeks a Staff Software Engineer, Data Ingestion to design and build scalable data pipelines. You will develop production-grade ingestion systems, integrate multiple data sources, and ensure data quality and availability for analytics and products.

Responsibilities include optimizing data models with DB engineers, monitoring pipelines, and participating in on-call rotations. Strong Python, distributed systems, and cloud experience are essential.