AWS Managed Apache Flink Streaming Developer

Hitachi Digital Services; Hyderabad, Pune District, Bengaluru; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Hitachi Digital Services is seeking a Flink-focused engineer to develop real-time streaming applications on AWS. The role emphasizes Java and Python (PyFlink) work on managed Flink with emphasis on event-time processing, state management, and performance tuning.

The ideal candidate will have hands-on experience with DataStream/Table API, Flink SQL, and lakehouse formats like Iceberg or Glue Data Catalog, enabling robust data pipelines and scalable deployments.

Qualifications

• Experience developing Flink applications in Java (DataStream/Table API) and Python (PyFlink) for managed Flink on AWS.
• Experience deploying and operating real-time streaming apps on Amazon Managed Service for Apache Flink.
• Experience with PyFlink and Python packaging for Managed Flink.
• Familiarity with Iceberg, Glue Data Catalog, or other lakehouse formats.

Responsibilities

• Develop Flink applications in Java (DataStream and Table API) and Python (PyFlink) for managed Flink on AWS.
• Build, deploy, and operate real-time streaming applications on Amazon Managed Service for Apache Flink.
• Implement event-time processing, watermarks, windowing, and late-event handling.
• Configure and manage checkpointing, snapshots, state backends, and recovery on Managed Flink.
• Tune performance and cost: parallelism, KPUs, backpressure, and state size.
• Stateful stream processing, checkpointing, and event-time semantics.

Skills

Flink DataStream API

Flink Table API

Flink SQL

PyFlink

AWS Managed Flink

Tools

Iceberg

Glue Data Catalog

Job description

Role & responsibilities

• Develop Flink applications in Java (DataStream and Table API) and Python (PyFlink) for managed Flink on AWS.
• Build, deploy, and operate real-time streaming applications on Amazon Managed Service for Apache Flink.
• Implement event-time processing, watermarks, windowing, and late-event handling.
• Configure and manage checkpointing, snapshots, state backends, and recovery on Managed Flink.
• Tune performance and cost parallelism, KPUs (Kinesis Processing Units), backpressure, and state size.
• Stateful stream processing, checkpointing, and event-time semantics.

Preferred candidate profile

• Apache Flink: DataStream API, Table API, or Flink SQL.
• Amazon Managed Service for Apache Flink: application deployment, configuration, and operations.
• Experience with PyFlink and Python packaging for Managed Flink.
• Familiarity with Apache Iceberg, Glue Data Catalog, or other lakehouse formats.