Flink Manager

Weekday AI (YC W21); United States; On-site; USD 10,000,000 - 40,000,000; Full time

Job summary

A premier tech company is seeking a Flink Manager to drive real-time streaming initiatives and manage high-performing engineering teams. You will design and deploy scalable data solutions that support mission-critical applications. The ideal candidate will have 8-12 years in data engineering, with strong expertise in Apache Flink, Java, and Kafka. This role offers competitive compensation and opportunities for professional growth in a dynamic environment.

Qualifications

• 8-12 years of experience in data engineering or backend engineering.
• Strong hands-on expertise in Apache Flink, minimum 3-5 years preferred.
• Deep understanding of stream processing concepts.

Responsibilities

• Lead design and deployment of real-time data processing pipelines.
• Architect scalable streaming systems leveraging Flink.
• Optimize Flink job performance for high-throughput environments.

Skills

Apache Flink

Java

Scala

Kafka

Data engineering

Troubleshooting

Tools

Kubernetes

YARN

Job description

This role is for one of the Weekday's clients.

Salary range: Rs 10000000 - Rs 40000000 (ie INR 100 - 400 LPA)

Min Experience: 8 years

Location: United States

JobType: full‑time

As a Flink Manager, you will be responsible for driving real‑time streaming initiatives, managing high‑performing engineering teams, and architecting scalable data solutions that power mission‑critical business applications. You will collaborate closely with product, analytics, infrastructure, and leadership teams to translate business requirements into resilient streaming architectures.

Key Responsibilities

• Lead the design, development, and deployment of real‑time data processing pipelines using Apache Flink.
• Architect scalable, fault‑tolerant, and low‑latency streaming systems leveraging Flink's DataStream and Table APIs.
• Manage end‑to‑end lifecycle of Flink applications including development, testing, optimization, monitoring, and production support.
• Drive best practices for state management, checkpointing, windowing, event‑time processing, and fault tolerance in Flink.
• Optimize Flink job performance, resource allocation, and cluster tuning for high‑throughput environments.
• Oversee integration of Flink with distributed systems such as Kafka, data lakes, warehouses, and microservices.
• Lead and mentor a team of data engineers, conducting code reviews and enforcing engineering excellence standards.
• Collaborate with DevOps teams to manage Flink deployments on cloud and on‑prem environments.
• Establish monitoring, logging, and alerting mechanisms for streaming pipelines to ensure high availability and reliability.
• Contribute to roadmap planning for streaming and real‑time analytics platforms.

Required Qualifications

• 8-12 years of overall experience in data engineering, distributed systems, or backend engineering.
• Strong hands‑on expertise in Apache Flink (minimum 3-5 years preferred).
• Deep understanding of stream processing concepts including event‑time semantics, watermarking, state backends, and exactly‑once guarantees.
• Proven experience designing and managing high‑throughput, low‑latency Flink pipelines.
• Strong programming skills in Java or Scala for Flink development.
• Experience with distributed messaging systems (e.g., Kafka) and data storage systems.
• Familiarity with cluster resource management frameworks (YARN, Kubernetes, or similar).
• Strong debugging, troubleshooting, and performance tuning skills specific to Flink workloads.
• Experience leading engineering teams and managing cross‑functional stakeholders.

Preferred Qualifications

• Experience deploying Flink in cloud environments (AWS, Azure, or GCP).
• Knowledge of batch and stream unification architectures.
• Exposure to big data ecosystems including Hadoop or Spark.
• Understanding of CI/CD practices for streaming applications.
• Experience implementing real‑time analytics, fraud detection, personalization, or IoT streaming use cases.

Leadership Expectations

The ideal candidate is a strategic thinker and technical leader who can balance hands‑on involvement with managerial responsibilities. You will champion best practices in Flink architecture, ensure production stability, and drive continuous improvement across streaming platforms.