Remote Data Engineer - Real‑Time AI & Distributed Pipelines

Zignal Labs; San Francisco (CA); Remote; USD 120,000 - 180,000; Full time

Job summary

Zignal Labs is seeking a Data Engineer to build and operate pipelines that ingest, enrich, and structure massive volumes of unstructured data into real‑time intelligence. You’ll own components end‑to‑end and work with engineers across teams to scale streaming, AI, and search services.

You’ll collaborate on production‑grade systems, write robust code, and contribute to CI/CD and infrastructure‑as‑code practices while operating in a fully remote environment across U.S. time zones.

Qualifications

• 3+ years building and operating data pipelines in production.
• Strong programming skills in a JVM language — Scala, Java, or Kotlin.
• Python proficiency for data and scripting work.
• Hands‑on with Spark and Kafka in a distributed environment.
• Experience with AWS, Docker, and Kubernetes in production.
• Proficient SQL plus at least one NoSQL or caching store.

Responsibilities

• Build and maintain batch and streaming pipelines ingesting high‑volume unstructured data.
• Develop data pathways feeding NLP, LLM, and retrieval services.
• Collaborate with search and storage layers for semantic search and real‑time retrieval.
• Design and implement scalable data services and APIs.
• Operate and monitor pipelines; write reliable, tested code and review others' work.
• Collaborate with Data Science, ML, Product, and Security teams to move ideas to production.

Skills

Scala

Java

Kotlin

Python

Apache Spark

Kafka

SQL

NoSQL

Redis

AWS

Docker

Kubernetes

Airflow

Dagster

Education

Bachelor’s degree in Computer Science, Engineering, or a related field

Tools

Databricks

Delta Lake

Flink

Airflow

Prefect

Dagster

Job description

Zignal Labs is seeking a Data Engineer to build and operate pipelines that ingest, enrich, and structure massive volumes of unstructured data into real‑time intelligence. You’ll own components end‑to‑end and work with engineers across teams to scale streaming, AI, and search services.

You’ll collaborate on production‑grade systems, write robust code, and contribute to CI/CD and infrastructure‑as‑code practices while operating in a fully remote environment across U.S. time zones.