Data Engineer AWS

Kryon Knowledge Works Group; India; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Kryon Knowledge Works Group is seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines using AWS data services. You will work with Python, PySpark, and SQL to ingest, model, and quality-check data for analytics.

The role requires hands-on experience with AWS S3, Glue, Athena, Lake Formation, Step Functions, and Lambda, plus a focus on reliability and performance. Cloud-based data engineering is central to this role.

Qualifications

• AWS Platform Certification is mandatory.
• Proficient in SQL and Python for large-scale data processing.
• Hands-on PySpark experience.
• Experience with AWS data services for ingestion and data modelling.
• Knowledge of data quality frameworks and data lineage.
• Strong focus on scalable and reliable data pipelines.
• Familiarity with batch and API-based data ingestion.
• Experience with data governance and metadata management.
• Experience designing cloud-based data engineering pipelines.

Responsibilities

• Design, develop, and maintain scalable data pipelines using AWS data services.
• Build and optimize data processing solutions using Python, PySpark, and SQL.
• Implement batch-based and API-based data ingestion processes.
• Work with AWS services, including Amazon S3, AWS Glue, Amazon Athena, AWS Lake Formation, AWS Step Functions, and AWS Lambda.
• Develop and maintain data models to support analytics and downstream data consumption.
• Implement data quality frameworks to ensure data accuracy and reliability.
• Apply data partitioning strategies to improve processing performance.
• Manage metadata and data lineage to support governance and traceability.
• Optimize data pipelines for scalability, performance, and reliability.
• Troubleshoot data processing issues and ensure smooth execution of workflows.

Skills

AWS

SQL

Python

PySpark

Data modelling

Data quality

Data governance

API data ingestion

Tools

AWS S3

AWS Glue

AWS Athena

AWS Lake Formation

AWS Step Functions

AWS Lambda

Job description

Job Summary

We are looking for an experienced Data Engineer with strong expertise in AWS data services, Python, PySpark, and SQL to design, develop, and maintain scalable data processing solutions. The ideal candidate should have hands‑on experience with data ingestion, data modelling, data quality, and cloud‑based data engineering, along with a strong focus on building reliable, scalable, and efficient data pipelines.

AWS Platform Certification is mandatory for this position.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using AWS data services.
• Build and optimize data processing solutions using Python, PySpark, and SQL.
• Implement batch‑based and API‑based data ingestion processes.
• Work with AWS services, including Amazon S3, AWS Glue, Amazon Athena, AWS Lake Formation, AWS Step Functions, and AWS Lambda.
• Develop and maintain data models to support analytics and downstream data consumption.
• Implement data quality frameworks to ensure the accuracy, consistency, reliability, and usability of data.
• Apply effective data partitioning strategies to improve data processing performance.
• Manage metadata and data lineage to support data governance and traceability.
• Optimize data pipelines for scalability, performance, and reliability.
• Troubleshoot data processing issues and ensure the smooth execution of data engineering workflows.

Mandatory Skills

• AWS Platform Certification Mandatory.
• Strong proficiency in SQL.
• Hands‑on experience with Python and PySpark for large‑scale data processing.
• Practical experience with AWS S3, Glue, Athena, Lake Formation, Step Functions, and Lambda.
• Experience implementing API‑based and batch data ingestion patterns.
• Strong understanding of data modelling and data quality frameworks.
• Knowledge of data partitioning strategies, metadata management, and data lineage.
• Strong focus on data quality, scalability, reliability, and usability.

Preferred Qualifications

• Experience designing and maintaining cloud‑based data engineering pipelines.
• Ability to troubleshoot and optimize large‑scale data processing workflows.
• Strong analytical, problem‑solving, and communication skills.