Integration Engineer

Tata Consultancy Services; Irvine (CA); On-site; USD 110,000 - 140,000; Full time

Job summary

Tata Consultancy Services is seeking an Integration Engineer in Irvine to design, develop, and support scalable integration solutions using Java, Apache Kafka, and real-time streaming technologies. You will build event-driven architectures, APIs, and microservices while ensuring reliability, performance, and security.

Responsibilities include managing Kafka topics, data pipelines, and CI/CD automation, with containerized deployments on cloud platforms.

Qualifications

• Experience with Java, Spring Boot, Apache Kafka and streaming technologies.
• Strong knowledge of event-driven architectures and API integrations.
• Experience designing and supporting scalable, secure integrations.
• Familiarity with CI/CD pipelines, containers, and cloud platforms.

Responsibilities

• Design, develop, and maintain scalable integration solutions using Java, Spring Boot, Apache Kafka, and streaming technologies.
• Build and support real-time event-driven architectures for seamless data exchange.
• Develop high-performance Kafka producers, consumers, and stream processing apps.
• Design and implement integration APIs, microservices, and messaging solutions.
• Create and manage Kafka topics, partitions, consumer groups, schemas, retention.
• Develop real-time data pipelines for ingestion, transformation, distribution.
• Ensure performance, scalability, reliability, and security of integrations.
• Integrate enterprise systems with cloud services via APIs and messaging frameworks.
• Develop RESTful services and event-based integration patterns.
• Implement data transformation, validation and routing logic.
• Support batch and streaming data processing needs.
• Design streaming solutions with Kafka Streams, Spark Streaming, or similar.
• Monitor and optimize Kafka clusters for throughput and fault tolerance.
• Troubleshoot messaging latency and performance issues.
• Define topic strategies, partitioning, and event schemas.
• Develop and support CI/CD pipelines for integration apps.
• Build containerized apps with Docker and deploy on Kubernetes/OpenShift.
• Automate deployment, monitoring, and operational processes.
• Participate in infra and environment provisioning.

Skills

Event-Driven Architecture

Microservices Architecture

API integrations

Distributed systems

Cloud services design

Tools

Java

Spring Boot

Apache Kafka

Kafka Streams

Kafka Connect

Spring Cloud

Docker

Kubernetes

Spark Streaming

REST APIs

JSON

XML

Git

Jenkins

CI/CD

AWS

Azure

Monitoring tools

Splunk

Grafana

ELK

Prometheus

SQL/NoSQL

Job description

Job Description

Integration Engineer

Must Have Technical/Functional Skills

Java, Kafka & Streaming

Roles & Responsibilities

We are seeking a highly skilled Integration Engineer with strong experience in Java, Apache Kafka, and real-time streaming technologies to design, develop, and support scalable integration solutions. The ideal candidate should have expertise in event-driven architectures, API integrations, distributed systems, and enterprise data streaming platforms. The role involves building high-performance integrations between various applications, data platforms, and cloud services while ensuring reliability, scalability, and security.

• Design, develop, and maintain scalable integration solutions using Java, Spring Boot, Apache Kafka, and streaming technologies.


• Build and support real-time event-driven architectures to enable seamless data exchange across enterprise applications.


• Develop high-performance Kafka producers, consumers, and stream processing applications.


• Design and implement integration APIs, microservices, and messaging solutions to support business processes.


• Create and manage Kafka topics, partitions, consumer groups, schema registries, and retention policies.


• Develop and maintain real-time data pipelines for data ingestion, transformation, and distribution.


• Ensure integrations meet performance, scalability, reliability, and security requirements.


• Integrate enterprise systems, cloud platforms, databases, and third-party applications using APIs and messaging frameworks.


• Develop RESTful services and event-based integration patterns to support application interoperability.


• Implement data transformation, validation, and routing logic across integration flows.


• Support batch and streaming data processing requirements.


• Design and implement streaming solutions using Kafka Streams, Spark Streaming, or similar technologies.


• Monitor and optimize Kafka clusters for throughput, availability, and fault tolerance.


• Troubleshoot messaging, latency, and performance issues within streaming environments.


• Implement dead-letter queues (DLQs), retry mechanisms, and fault-tolerant processing patterns.


• Define topic strategies, partitioning schemes, and event schemas to support business requirements.


• Develop and support CI/CD pipelines for integration and streaming applications.


• Build containerized applications using Docker and deploy on Kubernetes/OpenShift platforms.


• Automate deployment, monitoring, and operational processes.


• Participate in infrastructure and environment provisioning activities.


• Java, Spring Boot, Spring Cloud


• Apache Kafka, Kafka Streams, Kafka Connect


• Event-Driven Architecture (EDA)


• REST APIs, JSON, XML


• Microservices Architecture


• Git, Jenkins, CI/CD


• Docker, Kubernetes


• SQL/NoSQL Databases


• AWS/Azure Cloud Services


• Monitoring tools such as Splunk, Grafana, ELK, and Prometheus

Salary Range- $110,000-$140,000 a year