Data Engineer

Alike Thoughts; Bengaluru; On-site; INR 1,200,000 - 1,900,000; Full time

Job summary

Alike Thoughts is seeking a Data Engineer to design and optimize scalable data pipelines using Python, PySpark, AWS Glue and Snowflake. The role involves building cloud-based data solutions and ensuring data quality across systems.

You will collaborate with analytics and product teams to transform raw data into governed datasets, implement ETL/ELT processes, and tune performance across Snowflake and AWS services. Exposure to AI/ML is a plus.

Qualifications

• Proficient in Python, PySpark and SQL for data pipelines.
• Experience designing scalable ETL/ELT processes.
• Knowledge of Snowflake data warehousing and data modeling.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and AWS Glue.
• Develop data transformation and processing solutions using Python and SQL.
• Build and optimize data models and workflows in Snowflake.
• Integrate data from multiple sources using AWS services.
• Perform performance tuning and troubleshoot data pipeline issues.
• Ensure data quality, reliability, and scalability.
• Collaborate with data, application, and business teams to deliver data solutions.

Skills

Python

PySpark

SQL

Data Pipelines

ETL/ELT

Data Processing

Data Integration

Performance Tuning

AI/ML

GenAI

Education

Bachelors or higher in CS/IS/Data/Engineering

Tools

Snowflake

AWS Glue

AWS S3

AWS Lambda

CloudWatch

Oracle Fusion Cloud

Job description

Role & responsibilities

Data Engineer Python / PySpark

Job Description

We are looking for an experienced Data Engineer with strong hands-on expertise in Python, PySpark, AWS Glue, and Snowflake. The candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions.

Key Skills

• Python, PySpark & SQL
• Snowflake – Data Warehousing & Data Modeling
• AWS Glue
• AWS services: S3, Lambda, CloudWatch
• Strong experience in ETL/ELT & Data Pipeline Development
• Data integration, transformation, and processing
• Performance Tuning & Optimization
• Experience with cloud-based data platforms
• Good understanding of data quality and governance
• Exposure to AI/ML or GenAI is a plus
• Knowledge of Oracle Fusion Cloud Applications is a plus

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and AWS Glue.
• Develop data transformation and processing solutions using Python and SQL.
• Build and optimize data models and workflows in Snowflake.
• Integrate data from multiple sources using AWS services.
• Perform performance tuning and troubleshoot data pipeline issues.
• Ensure data quality, reliability, and scalability.
• Collaborate with data, application, and business teams to deliver data solutions.