Data Engineer

IntraEdge

India

Remote

INR 1,000,000 - 1,500,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A growing technology company is seeking a skilled Data Engineer to join their remote data team. You will build scalable, reliable data pipelines using Python, PySpark, and AWS Glue. The ideal candidate has at least 5 years of experience and a deep understanding of data modeling and ETL frameworks. This role focuses on delivering high-quality data solutions to drive business insights and operational efficiency.

Qualifications

5+ years of experience as a Data Engineer or similar role.
Proficiency in Python for data manipulation and scripting.
Experience with PySpark for large-scale data processing.
Strong expertise in Snowflake – data modeling, performance tuning, and SnowSQL.
Experience with AWS Glue, including Glue Jobs, Crawlers, and Data Catalog integration.
Experience with other AWS services like S3, Lambda, Athena, CloudWatch, etc.
Familiarity with CI/CD pipelines and version control tools (e.g., Git).
Understanding of data warehousing concepts, dimensional modeling, and ETL best practices.
Problem-solving skills and attention to detail.

Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines using PySpark and AWS Glue.
Build and optimize data models in Snowflake to support reporting, analytics, and machine learning workloads.
Automate data ingestion from various sources including APIs, databases, and third-party platforms.
Ensure high data quality and implement data validation and monitoring processes.
Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high-quality solutions.
Work with large datasets in structured and semi-structured formats (JSON, Parquet, Avro, etc.).
Participate in code reviews, performance tuning, and debugging of data workflows.
Implement security and compliance measures across data pipelines and storage.

Skills

Python

PySpark

AWS

AWS Glue

Lambda

Snowflake

Redshift

SQL

DBT

Job description

We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reliable data pipelines that drive business insights and operational efficiency. This role requires a deep understanding of data modeling, ETL frameworks, and cloud-based data platforms.

Job Title: Data Engineer

Location: Remote

Full-Time

Responsibilities:

Design, develop, and maintain scalable ETL/ELT pipelines using PySpark and AWS Glue.
Build and optimize data models in Snowflake to support reporting, analytics, and machine learning workloads.
Automate data ingestion from various sources including APIs, databases, and third‑party platforms.
Ensure high data quality and implement data validation and monitoring processes.
Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high‑quality solutions.
Work with large datasets in structured and semi‑structured formats (JSON, Parquet, Avro, etc.).
Participate in code reviews, performance tuning, and debugging of data workflows.
Implement security and compliance measures across data pipelines and storage.

Required Skills:

5+ years of experience as a Data Engineer or similar role.
Proficiency in Python for data manipulation and scripting.
Experience with PySpark for large‑scale data processing.
Strong expertise in Snowflake – data modeling, performance tuning, and SnowSQL.
Experience with AWS Glue, including Glue Jobs, Crawlers, and Data Catalog integration.
Experience with other AWS services like S3, Lambda, Athena, CloudWatch, etc.
Familiarity with CI/CD pipelines and version control tools (e.g., Git).
Understanding of data warehousing concepts, dimensional modeling, and ETL best practices.
Problem‑solving skills and attention to detail.

Must have skills: