Big Data Engineer

Synechron; Chennai District; On-site; INR 1,400,000 - 2,000,000; Full time

Job summary

Synechron in Chennai is seeking a Big Data Engineer to design, develop, and deploy scalable data processing solutions on AWS using Java and Spark. You will implement end-to-end pipelines and ensure reliable performance in a cloud-native environment.

Key responsibilities include building data pipelines on AWS EMR, deploying serverless components with AWS Lambda, orchestrating containers with EKS, and implementing workflow orchestration with Apache Airflow.

Qualifications

• Experience in designing, development, and deployment of scalable data processing solutions on AWS using Java and Spark.
• Implement big data processing pipelines using Apache Spark on AWS EMR.
• Develop and deploy Serverless applications using AWS Lambda, integrating with other AWS services.
• Utilize Amazon EKS for container orchestration and microservices management.
• Design and implement workflow orchestration using Apache Airflow for complex data pipelines.
• Strong hands-on experience in Java development.
• Proficiency in Apache Spark for distributed data processing.
• Experience with AWS services including EMR, Lambda, EKS, and Airflow.

Responsibilities

• Experience in designing, development, and deployment of scalable and reliable data processing solutions on AWS using Java and Spark.
• implement big data processing pipelines using Apache Spark on AWS EMR.
• Develop and deploy Serverless applications using AWS Lambda, integrating with other AWS services.
• Utilize Amazon EKS for container orchestration and microservices management.
• Design and implement workflow orchestration using Apache Airflow for complex data pipelines.
• Strong hands-on experience in Java development.
• Proficiency in Apache Spark for distributed data processing.
• Experience with AWS services including EMR, Lambda, EKS, and Airflow.

Skills

Java

Apache Spark

AWS

Lambda

EKS

Airflow

Tools

AWS EMR

AWS Lambda

AWS EKS

Apache Airflow

Job description

Job Description

Big Data Engineer - Java, Spark & AWS

Hiring Location Chennai

• Experience in designing, development, and deployment of scalable and reliable data processing solutions on AWS using Java and Spark.
• implement big data processing pipelines using Apache Spark on AWS EMR.
• Develop and deploy Serverless applications using AWS Lambda, integrating with other AWS services.
• Utilize Amazon EKS for container orchestration and microservices management.
• Design and implement workflow orchestration using Apache Airflow for complex data pipelines.
• Strong hands-on experience in Java development.
• Proficiency in Apache Spark for distributed data processing.
• Experience with AWS services including EMR, Lambda, EKS, and Airflow.