Remote Data Engineer, AI & Distributed Systems

Zignal Labs, Inc.; United States; On-site; USD 120,000 - 160,000; Full time

Job summary

Zignal Labs, Inc. is seeking a Data Engineer for AI & Distributed Systems to build and operate data pipelines processing massive volumes of unstructured data in a fully remote setting. You will work with cross-functional teams to enable real-time data processing and AI-enabled retrieval.

Responsibilities include crafting batch and streaming pipelines, supporting NLP/LLM data pathways, and integrating search/storage to boost semantic search capabilities across systems and data stores.

Qualifications

• 3+ years of experience building and operating data pipelines in production.
• Strong programming skills in a JVM language such as Scala, Java, or Kotlin.
• Working proficiency in Python for data and scripting tasks.
• Hands-on experience with distributed processing frameworks, particularly Apache Spark.
• Practical experience with AWS and familiarity with Docker and Kubernetes.

Responsibilities

• Build and maintain batch and streaming data pipelines, owning components from implementation to production monitoring.
• Support AI systems by developing data pathways for NLP, LLM, and retrieval services.
• Integrate with search and storage layers to enhance semantic search and real-time data retrieval.

Skills

Data pipelines

Scala/Java/Kotlin

Python

Apache Spark

AWS

Docker

Kubernetes

Tools

Docker

Kubernetes

Job description

Zignal Labs, Inc. is seeking a Data Engineer for AI & Distributed Systems to build and operate data pipelines processing massive volumes of unstructured data in a fully remote setting. You will work with cross-functional teams to enable real-time data processing and AI-enabled retrieval.

Responsibilities include crafting batch and streaming pipelines, supporting NLP/LLM data pathways, and integrating search/storage to boost semantic search capabilities across systems and data stores.