Opportunity For Data Engineer professionals

Atos; Chennai District, Bengaluru, Mumbai; On-site; INR 2,000,000 - 3,600,000; Full time

Job summary

Atos in India is seeking an experienced Data Engineer to join our data platform team in India. The role focuses on building robust data pipelines using Python, PySpark and SQL, with Snowflake data warehousing and data lake development.

You will optimize Spark/PySpark and Hive workloads, implement medallion architecture, and oversee orchestration with Apache Airflow. Preference for exposure to Trino or AWS Athena and S3 data stores.

Qualifications

• Must have Python programming experience.
• Must have Snowflake Data Warehouse experience.
• Experience with Apache PySpark.
• Airflow orchestration experience is required.
• Spark/PySpark and Hive optimization experience is MUST.
• Data Lake development experience with medallion architecture is required.
• Trino or AWS Athena is a plus.
• Data quality experience is a plus.
• S3 storage experience is a plus.

Skills

Python

Snowflake Data Warehouse

PySpark

Airflow

Spark optimization

Hive optimization

Medallion Architecture

Trino

AWS Athena

S3

Tools

SQL

Data Lake

Job description

Dear Candidate,

This is with reference for Opportunity for Data Engineer professionals

PFB the Job Description

• Experience in Python Programming (Must )
• Experience in Snowflakes Database (Must)
• Knowledge of Pyspark and SQL (SQL, Joins, Window Functions , Subqueries , Partitions , Indexes )
• Data Lake Development experience. (medallion architecture is must)
• Orchestration (Apache Airflow is Must).
• Spark and Hive: Optimization of Spark/PySpark and Hive apps is MUST
• Trino/(AWS Athena) (Good to have)
• Data Quality (good to have)
• Experience In File Storage (S3 is good to have)

Total Experience -6-10years

Skill - Python, Snowflake Data Warehouse, Apache PySpark

Location Chennai ,Bangalore ,Mumbai