Data Engineer

AppSierra; Dadri; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

AppSierra in India is seeking a skilled Data Engineer to join our team. The role focuses on building robust data pipelines using AWS services and PySpark, optimizing SQL queries, and maintaining streamlined data workflows with Apache Airflow.

You will collaborate with data scientists and analysts to translate data requirements into scalable solutions, ensure data quality and integrity across platforms, and document data architecture and engineering processes.

Qualifications

• 3-5 years of experience in data engineering or related field.
• Proficient in AWS services such as S3, Redshift, and Glue.
• Strong experience with PySpark for big data processing.
• Solid SQL skills for data manipulation and analysis.
• Experience with workflow orchestration using Apache Airflow.

Responsibilities

• Design and implement data pipelines using AWS services and PySpark.
• Develop and optimize SQL queries for data extraction and transformation.
• Monitor and maintain data workflows in Apache Airflow.
• Collaborate with data scientists and analysts to understand data requirements.
• Ensure data quality and integrity across all platforms.
• Document data architecture and engineering processes.
• Stay updated with emerging technologies and best practices in data engineering.

Skills

Data engineering

SQL

PySpark

Tools

AWS

Airflow

Job description

About The Role

We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a solid background in data engineering, with expertise in AWS technologies and data processing frameworks.

About The Role

We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a solid background in data engineering, with expertise in AWS technologies and data processing frameworks.

Key Responsibilities

• Design and implement data pipelines using AWS services and PySpark.
• Develop and optimize SQL queries for data extraction and transformation.
• Monitor and maintain data workflows in Apache Airflow.
• Collaborate with data scientists and analysts to understand data requirements.
• Ensure data quality and integrity across all platforms.
• Document data architecture and engineering processes.
• Stay updated with emerging technologies and best practices in data engineering.

Required Qualifications

• 3-5 years of experience in data engineering or related field.
• Proficient in AWS services such as S3, Redshift, and Glue.
• Strong experience with PySpark for big data processing.
• Solid SQL skills for data manipulation and analysis.
• Experience with workflow orchestration using Apache Airflow.

Nice to have

• Familiarity with data warehousing concepts and architecture.
• Experience with ETL processes and tools.
• Knowledge of Python or Java programming for data processing.
• Understanding of data visualization tools and techniques.