Aws Data Engineer

Hexaware Technologies; Chennai; On-site; INR 1,800,000 - 2,400,000; Full time

Job description

Job Summary:

We are seeking a skilled Data Engineer with strong expertise in AWS Glue and Apache Kafka to design, develop, and maintain scalable data pipelines and real-time data processing solutions. The ideal candidate should have experience building cloud-native data platforms on AWS and working with large-scale data integration and streaming architectures.

Key Responsibilities:

• Design, develop, and support ETL/ELT pipelines using AWS Glue.
• Build and maintain real-time data streaming solutions using Apache Kafka/MSK.
• Develop scalable data processing frameworks using Python, PySpark, and Spark.
• Integrate data from multiple sources into AWS-based data lakes and warehouses.
• Optimize data ingestion, transformation, and processing workflows.
• Collaborate with business and engineering teams to understand data requirements.
• Ensure data quality, reliability, and performance across data platforms.
• Monitor and troubleshoot production data pipelines.

Mandatory Skills:

• AWS Glue
• Apache Kafka / Amazon MSK
• Python
• PySpark / Apache Spark
• AWS Cloud Services (S3, IAM, CloudWatch)
• ETL/Data Engineering Concepts
• SQL

Preferred Skills:

• AWS Lambda
• Amazon Redshift
• Airflow
• Snowflake
• Glue Data Catalog
• CI/CD Pipelines
• Docker/Kubernetes

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 9+ years of experience in Data Engineering.
• Hands-on experience with AWS cloud services and big data technologies.
• Strong understanding of data warehousing and data lake concepts.

Note : We are looking for the candidates who can come for F2F Interview on Thursday