Aws Data Engineer

Kairos Technologies; India; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Kairos Technologies in India seeks an experienced data engineer to design and implement scalable data pipelines using AWS services such as Glue, Redshift, S3, Athena and Lambda. You will work with Databricks for analytics, and contribute to ETL/ELT patterns and distributed systems.

Strong Python and SQL skills are essential, along with CI/CD practices to maintain reliable data workflows.

Qualifications

• Experience with ETL/ELT data integration patterns.
• Design and build data pipelines for large-scale datasets.
• Development in Python is preferred.
• Advanced SQL knowledge required.
• Experience designing and implementing large-scale distributed systems.

Skills

Python

SQL

ETL/ELT design

Distributed systems design

CI/CD pipelines

Tools

AWS Glue

AWS Redshift

S3

API Gateway

Athena

Step Functions

Lambda

Databricks

Job description

Description:

• AWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions
• Solid knowledge on Databricks
• Experience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern.
• Experience in designing and building data pipelines.
• Development experience in one or more object-oriented programming languages, preferably Python
• Advanced SQL knowledge/Strong SQL
• Experience designing and implementing large-scale distributed systems
• Maintains and improves CI / CD pipeline