Data Engineer

Synergy Computer Solutions; Hyderabad; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Synergy Computer Solutions is seeking a Data Engineer in Hyderabad. The role focuses on designing, building, and maintaining scalable data pipelines with Python, PySpark, Snowflake, and AWS.

You will develop ETL/ELT workflows, implement Airflow orchestration, and optimize data processing at scale, collaborating with analysts and engineers to meet data needs. The ideal candidate brings 5-8 years of experience, strong SQL skills, and a solid foundation in data warehousing and big data

Qualifications

• 5-8 years of experience in designing, developing, and maintaining scalable data solutions.
• Strong hands-on experience with Python, PySpark, Snowflake, ETL/ELT, AWS (EMR, S3), and Apache Airflow.
• Experience building scalable data pipelines and cloud-based data processing solutions.
• Strong proficiency in SQL with query optimization and performance tuning.
• Experience with Apache Spark and large-scale data processing environments.
• Knowledge of data warehousing concepts, data modeling, and best practices.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows.
• Build and optimize data ingestion, transformation, and processing using Python, PySpark, and SQL.
• Develop and manage data workflows using Apache Airflow for orchestration and scheduling.
• Implement and optimize Snowflake data modeling, performance, and queries.
• Work with AWS services, especially S3 and EMR, to build cloud-native data platforms.
• Process and analyze large datasets using Spark and big data technologies.
• Collaborate with business stakeholders, data analysts, and engineering teams to understand data requirements and deliver solutions.
• Ensure data quality, reliability, security, and governance across data platforms.
• Troubleshoot and resolve performance bottlenecks in data pipelines and databases.

Skills

Python

PySpark

Snowflake

SQL

ETL/ELT

AWS (S3, EMR)

Apache Airflow

Apache Spark

Job description

Role

Data Engineer

• 5-8 years of experience in designing, developing, and maintaining scalable data solutions.
• The ideal candidate should possess strong expertise in Python, PySpark, Snowflake, AWS (EMR, S3), Apache Airflow, and ETL/ELT processes.
• The role involves building robust data pipelines, enabling large-scale data processing, and supporting cloud-based analytics platforms.

Key Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines and ETL/ELT workflows.
• Build and optimize data ingestion, transformation, and processing solutions using Python, PySpark, and SQL.
• Develop and manage data workflows using Apache Airflow for orchestration and scheduling.
• Implement and optimize data solutions on Snowflake, including data modeling, performance tuning, and query optimization.
• Work with AWS services, particularly S3 and EMR, to build cloud-native data platforms.
• Process and analyze large datasets using Spark and other big data technologies.
• Collaborate with business stakeholders, data analysts, and engineering teams to understand data requirements and deliver solutions.
• Ensure data quality, reliability, security, and governance across data platforms.
• Troubleshoot and resolve performance bottlenecks in data pipelines and databases.

Desired Candidate Profile

• 5-8 years of experience in Data Engineering.
• Strong hands-on experience with Python, PySpark, Snowflake, ETL/ELT, AWS (EMR, S3), and Apache Airflow.
• Proven experience in building scalable data pipelines and cloud-based data processing solutions.
• Strong proficiency in SQL with experience in query optimization and performance tuning.
• Experience working with Apache Spark and large-scale data processing environments.
• Good understanding of data warehousing concepts, data modeling, and best practices.
• Experience with workflow orchestration tools and modern data engineering frameworks.
• Strong analytical, problem-solving, and debugging skills.
• Excellent communication and collaboration skills.

Mandatory Skills

• Python
• PySpark
• Snowflake
• SQL
• ETL/ELT
• AWS (S3, EMR)
• Apache Airflow
• Apache Spark

Good to Have

• AWS Glue
• Scala
• Hadoop
• Data Modeling & Data Warehousing

Experience: 5-8 Years
Location: Hyderabad
Employment Type: Full-Time
Notice Period: Immediate to 30 Days Preferred (Optional)