AWS Data Engineer - Hyderabad

Coforge; Hyderabad; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Coforge is seeking a seasoned Data Engineer to design, build, and optimize scalable data pipelines using Python and Apache Airflow in an AWS-centric environment. You will work on real-time and batch processing, integrating data across sources via APIs and Fivetran, while ensuring robust data warehousing and modelling practices.

Ideal candidates have 4–8 years of experience, strong problem-solving and communication skills, and a hands-on track record with Kafka, SQS, and EventBridge for

Qualifications

• Proficient in Python, Airflow and AWS data services.
• Experience with data integration, ETL/ELT pipelines and cloud data platforms.
• Solid understanding of data warehousing concepts and data modelling.
• Experience with Kafka, SQS and EventBridge for large-scale processing.
• Strong problem-solving and communication skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and Airflow.
• Build and optimize data solutions on AWS using S3, Glue, EMR, and Redshift.
• Develop real-time and batch data processing frameworks.
• Integrate data from multiple sources using APIs, Fivetran, and other integration tools.
• Implement data warehousing and data modelling best practices.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Collaborate with architects, analysts, and business teams to deliver high-quality data solutions.
• Ensure data security, governance, and compliance standards are maintained.

Skills

Python

Apache Airflow

AWS Services

Data Warehousing

Data Modelling

Fivetran & API Integrations

Kafka

SQS

EventBridge

ETL/ELT Pipelines

Cloud Data Engineering

Job description

Required Skills

• Python
• Apache Airflow
• AWS Services (S3, Glue, EMR, Redshift)
• Data Warehousing & Data Modelling
• Fivetran & API Integrations
• Kafka, SQS, EventBridge
• ETL/ELT Pipelines
• Cloud Data Engineering

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and Airflow.
• Build and optimize data solutions on AWS using S3, Glue, EMR, and Redshift.
• Develop real-time and batch data processing frameworks.
• Integrate data from multiple sources using APIs, Fivetran, and other integration tools.
• Implement data warehousing and data modelling best practices.
• Monitor, troubleshoot, and optimize data pipelines for performance and scalability.
• Collaborate with architects, analysts, and business teams to deliver high-quality data solutions.
• Ensure data security, governance, and compliance standards are maintained.

What We're Looking For

• 4 to 8 years of experience in Data Engineering.
• Strong hands-on expertise in Python, Airflow, and AWS data services.
• Experience with data integration, ETL/ELT pipelines, and cloud data platforms.
• Good understanding of data warehousing concepts and data modelling.
• Experience with Kafka, SQS, EventBridge, and large-scale data processing is preferred.
• Strong problem-solving and communication skills.