Aws Data Engineer

Talworx Solutions; Kolkata District, Pune District, Delhi; Hybrid; INR 1,800,000 - 3,000,000; Full time

Job summary

Talworx Solutions is seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines on AWS. You will develop ETL/ELT workflows using AWS services like Glue, Lambda, EMR, and Step Functions, and work with data ingestion tools such as Kinesis, Kafka, or SQS.

The role requires building data lakes with S3 and Lake Formation, and collaborating with analytics teams to deliver high-quality datasets.

Qualifications

• Experience designing and operating scalable data pipelines on AWS.
• Hands-on with AWS Glue, S3, Lambda, IAM, and Step Functions.
• Strong Python (PySpark) and SQL for data transformation.

Responsibilities

• Design, build, and maintain scalable data pipelines on AWS.
• Develop ETL/ELT workflows using AWS services (Glue, Lambda, EMR, Step Functions).
• Work with data ingestion frameworks using Kinesis, Kafka, or SQS.
• Build and optimize data lakes using S3, Glue Catalog, and Lake Formation.
• Collaborate with analytics teams to deliver high-quality datasets.

Skills

AWS data pipelines

ETL/ELT on AWS

Kinesis

Kafka

SQS

Redshift

Snowflake

Data quality checks

CI/CD deployments

Python (PySpark)

SQL

Data modeling

Spark (EMR/Glue)

Terraform/CloudFormation (IaC)

S3/Lake Formation

Glue Catalog

Education

BE/B.Tech

Tools

Terraform

CloudFormation

Job description

Location: Bangalore, Delhi, Kolkata, Coimbatore, Hyderabad, Bhubaneshwar

The Aws Data engineer is responsible for managing client relationships and overseeing the successful delivery of programs or accounts. This role serves as the primary point of contact between the organization and its clients, ensuring alignment of goals, timelines, budgets, and expected outcomes while driving client satisfaction and business growth.

Key Skills & Competencies

• Design, build, and maintain scalable data pipelines on AWS.
• Develop ETL/ELT workflows using AWS services (Glue, Lambda, EMR, Step Functions).
• Work with data ingestion frameworks using Kinesis, Kafka, or SQS.
• Build and optimize data lakes using S3, Glue Catalog, and Lake Formation.
• Work with Redshift/Snowflake for data warehousing solutions.
• Implement data quality checks, monitoring, logging, and CI/CD deployments.
• Collaborate with analytics and business teams to deliver high-quality datasets.
• Strong hands-on experience with AWS Glue, S3, Lambda, IAM, and Step Functions.
• Proficiency in Python (PySpark), SQL, and data transformation logic.
• Experience with Redshift, Athena, and Glue Data Catalog.
• Knowledge of Spark (EMR/Glue) and distributed data processing.
• Familiarity with Terraform/CloudFormation for IaC is a plus.
• Good understanding of data modeling, data lake principles, and best practices.
• Design, develop and deploy solutions using different tools, design principles and conventions.
• Configure robotics processes and objects using core workflow principles in an efficient way; ensure they are easily maintainable and easy to understand.
• Understand existing processes and facilitate changing requirements as part of a structured change control process.
• Solve day-to-day issues arising while running robotics processes and provide timely resolutions.
• Maintain proper documentation for the solutions, test procedures and scenarios during UAT and Production phase.
• Coordinate with process owners and business to understand the as-is process and design the automation process flow.

Preferred Qualifications

• Education - B. tech or BE

Success Metrics

• 6 + years of strong hands-on experience with AWS Glue, S3, Lambda, IAM, and Step Functions.
• Proficiency in Python (PySpark), SQL, and data transformation logic.
• Managing change - Responding to changing environment with resilience.
• Managing Quality & Risk - Delivering high quality results and mitigating risks with utmost integrity and precision.
• Strategic Thinking & Problem Solving - Applying strategic mindset to solve business issues and complex problems.
• Tech Savvy - Leveraging ethical technology practices to deliver high impact for clients and for Deloitte.
• Empathetic leadership and inclusivity - creating a safe and thriving environment where everyone's values who they are, use empathy to understand others to adapt our behaviors and attitudes to become more inclusive.