Real-Time Integration Engineer: Java + Kafka & Streaming

Tata Consultancy Services; Irvine (CA); On-site; USD 110,000 - 140,000; Full time

Job summary

Tata Consultancy Services is seeking an Integration Engineer in Irvine to design, develop, and support scalable integration solutions using Java, Apache Kafka, and real-time streaming technologies. You will build event-driven architectures, APIs, and microservices while ensuring reliability, performance, and security.

Responsibilities include managing Kafka topics, data pipelines, and CI/CD automation, with containerized deployments on cloud platforms.

Qualifications

• Experience with Java, Spring Boot, Apache Kafka and streaming technologies.
• Strong knowledge of event-driven architectures and API integrations.
• Experience designing and supporting scalable, secure integrations.
• Familiarity with CI/CD pipelines, containers, and cloud platforms.

Responsibilities

• Design, develop, and maintain scalable integration solutions using Java, Spring Boot, Apache Kafka, and streaming technologies.
• Build and support real-time event-driven architectures for seamless data exchange.
• Develop high-performance Kafka producers, consumers, and stream processing apps.
• Design and implement integration APIs, microservices, and messaging solutions.
• Create and manage Kafka topics, partitions, consumer groups, schemas, retention.
• Develop real-time data pipelines for ingestion, transformation, distribution.
• Ensure performance, scalability, reliability, and security of integrations.
• Integrate enterprise systems with cloud services via APIs and messaging frameworks.
• Develop RESTful services and event-based integration patterns.
• Implement data transformation, validation and routing logic.
• Support batch and streaming data processing needs.
• Design streaming solutions with Kafka Streams, Spark Streaming, or similar.
• Monitor and optimize Kafka clusters for throughput and fault tolerance.
• Troubleshoot messaging latency and performance issues.
• Define topic strategies, partitioning, and event schemas.
• Develop and support CI/CD pipelines for integration apps.
• Build containerized apps with Docker and deploy on Kubernetes/OpenShift.
• Automate deployment, monitoring, and operational processes.
• Participate in infra and environment provisioning.

Skills

Event-Driven Architecture

Microservices Architecture

API integrations

Distributed systems

Cloud services design

Tools

Java

Spring Boot

Apache Kafka

Kafka Streams

Kafka Connect

Spring Cloud

Docker

Kubernetes

Spark Streaming

REST APIs

JSON

XML

Git

Jenkins

CI/CD

AWS

Azure

Monitoring tools

Splunk

Grafana

ELK

Prometheus

SQL/NoSQL

Job description

Tata Consultancy Services is seeking an Integration Engineer in Irvine to design, develop, and support scalable integration solutions using Java, Apache Kafka, and real-time streaming technologies. You will build event-driven architectures, APIs, and microservices while ensuring reliability, performance, and security.

Responsibilities include managing Kafka topics, data pipelines, and CI/CD automation, with containerized deployments on cloud platforms.