Data Engineer

Appsierra Group

Pune District

On-site

INR 900,000 - 1,500,000

Full time

2 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Appsierra Group is seeking a Data Engineer to design and maintain data pipelines in a data-driven environment. You will collaborate with stakeholders and drive ETL initiatives using AWS services.

Responsibilities include building scalable pipelines with AWS Glue/Lambda/DBT, transforming data with PySpark and SQL, and managing Airflow workflows and EMR clusters. REST and SOAP API integration is also required.

Qualifications

3 to 5 years of experience in data engineering.
Proficient in AWS S3, Glue, Lambda, DBT, PySpark, SQL, API Gateway, EMR, Airflow.
Hands-on experience with REST and SOAP APIs.
Strong client communication and basic project lifecycle management.

Responsibilities

Design and develop scalable data pipelines using AWS services.
Implement ETL processes with AWS Glue, Lambda, and DBT.
Work with PySpark and SQL to transform and cleanse data.
Configure and manage Airflow workflows and Amazon EMR clusters.
Integrate data services with API Gateway and REST/Soap APIs.

Skills

AWS

PySpark

SQL

ETL

Airflow

REST APIs

SOAP APIs

Data modelling

Tools

DBT

EMR

API Gateway

Job description

We are seeking a Data Engineer to join our team. The role will involve building and maintaining data pipelines and collaborating closely with stakeholders.

Key responsibilities

Design and develop scalable data pipelines using AWS services.
Implement ETL processes with AWS Glue, Lambda, and DBT.
Work with PySpark and SQL to transform and cleanse data.
Configure and manage Airflow workflows and Amazon EMR clusters.
Integrate data services with API Gateway and REST/Soap APIs.

Required qualifications

3 to 5 years of experience in data engineering.
Proficient in AWS S3, Glue, Lambda, DBT, PySpark, SQL, API Gateway, EMR, Airflow.
Hands-on experience with REST and SOAP APIs.
Strong client communication and basic project lifecycle management.

Nice to have