Data Engineer

Appsierra Group; Karnataka; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Appsierra Group in India is seeking a Data Engineer to join our team. With expertise in big data solutions, cloud technologies, and data pipelines, you will help design and deploy scalable data architectures for our clients.

You will collaborate with stakeholders to gather requirements, design data models and ingestion pipelines on AWS, and migrate on‑prem projects to cloud platforms using Airflow, Docker, and Kubernetes.

Qualifications

• Bachelor's degree in Computer Science (B.Tech) is required.
• Over 8.5 years of professional data engineering experience.
• Proficiency in Python, Spark, and AWS services (S3, Glue, Lambda, EMR).
• Strong background in Big Data ecosystems (Hadoop, Hive, Kafka, Spark SQL).
• Experience with data modeling, ETL, and data lake architecture.

Responsibilities

• Provide out-of-the-box custom data solutions, pipelines, repairs, and reprocessing for analytics workloads.
• Design and implement data models, ingestion pipelines, and data warehouses on AWS.
• Collaborate with stakeholders to gather requirements and create architecture diagrams.
• Develop and maintain large-scale modules using Python, Spark, and SQL.
• Lead the migration of on‑premises projects to cloud platforms.
• Utilize Airflow, Docker, and Kubernetes for workflow orchestration and deployment.
• Ensure data quality and security across all pipelines.
• Document processes and maintain version control with Git.

Skills

Python

Apache Spark

Big Data

ETL

Data modeling

Education

Bachelor's degree in Computer Science (B.Tech)

Tools

Python

Apache Spark

AWS (S3, Glue, Lambda, EMR)

Hadoop

Hive

Kafka

Spark SQL

Airflow

Docker

Kubernetes

Job description

We are seeking a Data Engineer to join our team. With expertise in big data solutions, cloud technologies, and data pipelines, you will help design and deploy scalable data architectures. Your experience will enable us to deliver high-quality, cloud-native data services for our clients.

Key responsibilities

• Provide out-of-the-box custom data solutions, pipelines, repairs, and reprocessing for analytics workloads.
• Design and implement data models, ingestion pipelines, and data warehouses on AWS.
• Collaborate with stakeholders to gather requirements and create architecture diagrams.
• Develop and maintain large-scale modules using Python, Spark, and SQL.
• Lead the migration of on‑premises projects to cloud platforms.
• Utilize Airflow, Docker, and Kubernetes for workflow orchestration and deployment.
• Ensure data quality and security across all pipelines.
• Document processes and maintain version control with Git.

Required qualifications

• Bachelor's degree in Computer Science (B.Tech)
• Over 8.5 years of professional data engineering experience.
• Proficient in Python, Spark, and AWS services (S3, Glue, Lambda, EMR).
• Strong background in Big Data ecosystems (Hadoop, Hive, Kafka, Spark SQL).
• Experience with data modeling, ETL, and data lake architecture.

Nice to have

• Airflow certification or experience.
• Knowledge of Docker, Kubernetes, and CI/CD pipelines.
• Java programming and RESTful API development.