Senior Data Platform Engineer - Real-Time Analytics

MetTel; New York (NY); On-site; USD 145,000 - 165,000; Full time

Job summary

MetTel seeks a Senior Software Engineer - Data Platform in NYC to build and operate a scalable, real-time data processing platform behind proactive network monitoring. You will own data pipelines, event processing, and the data lakehouse, collaborating across product and ops to deliver reliable, observable systems for enterprise and government clients.

The role emphasizes production-grade Java/Python, distributed systems, and modern stack components (Flink/Kafka/Spark) with Kubernetes, CI/CD,

Qualifications

• 5+ years of professional software engineering with production data pipelines.
• Strong Java or Python, preferably both for streaming and orchestration.
• Experience with distributed systems and real-time processing.
• Hands-on with Kafka, Flink, or Spark streaming stacks.
• Familiarity with ETL/workflow tools and CI/CD practices.

Responsibilities

• Design, build, and operate reliable, scalable data pipelines for high-volume telemetry.
• Develop real-time event processing and detection logic at scale.
• Enhance detection/workflow engine for client-specific paths and versioning.
• Collaborate to expose event/incident flow in product UX and APIs.
• Instrument observability and data lineage; support data lakehouse storage.
• Contribute to tech stack evolution and cloud/DevOps practices.
• Write design docs, perform code reviews, and share on-call responsibilities.
• Leverage AI-assisted tooling within the engineering workflow.

Skills

Java

Python

Distributed systems

Real-time processing

Data pipelines

SQL

Cloud/Kubernetes

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Flink

Kafka Streams

Spark Structured Streaming

Beam

Dagster

Airflow

Prefect

Kubernetes

Snowflake

BigQuery

Trino

Presto

ClickHouse

Job description

MetTel seeks a Senior Software Engineer - Data Platform in NYC to build and operate a scalable, real-time data processing platform behind proactive network monitoring. You will own data pipelines, event processing, and the data lakehouse, collaborating across product and ops to deliver reliable, observable systems for enterprise and government clients.

The role emphasizes production-grade Java/Python, distributed systems, and modern stack components (Flink/Kafka/Spark) with Kubernetes, CI/CD,