PySpark Developer – ETL & SQL

DATAECONOMY Inc; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Health insurance for you and family

Group Personal Accident Insurance

Gratuity as per regulations

Hybrid work arrangements

21 days annual leave plus holidays

Break-out area with refreshments

Job summary

DATAECONOMY Inc. is seeking a PySpark Developer to design and operate large-scale data pipelines. You will leverage PySpark, ETL processes, and SQL to transform datasets into actionable insights and support analytics across the organization.

The role involves optimizing data workflows, collaborating with cross-functional teams, and delivering robust data solutions in a hybrid work environment. Ideal candidates bring 4–8 years of data engineering experience and strong problem-solving abilities.

Qualifications

• 4-8 years of experience in Data Engineering or related roles.
• Hands-on experience with PySpark and large-scale data processing.
• Design and develop ETL pipelines.
• Advanced SQL skills including optimization and performance tuning.
• Understanding of data warehousing and data modeling concepts.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.

Responsibilities

• Develop and maintain robust data pipelines using PySpark.
• Design and build scalable ETL processes to support business and analytics needs.
• Write optimized SQL queries for data extraction, transformation, validation, and reporting.
• Work with large volumes of structured and unstructured data.
• Ensure data quality, accuracy, and consistency across data sources.
• Identify and resolve performance bottlenecks in data workflows.
• Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
• Participate in code reviews and contribute to data engineering best practices.

Skills

PySpark

ETL development

SQL

Data processing

Tools

AWS

Airflow

Hadoop ecosystem

Job description

We're looking for aPySpark Developerwho enjoys working with data at scale and has a strong foundation inPySpark, ETL development, and SQL. If you're passionate about building efficient data pipelines, transforming large datasets into meaningful insights, and solving complex data challenges, we'd love to connect with you.

Requirements

What You'll Do

• Develop and maintain robust data pipelines usingPySpark.
  
• Design and build scalableETL processesto support business and analytics needs.
  
• Write optimizedSQL queriesfor data extraction, transformation, validation, and reporting.
  
• Work with large volumes of structured and unstructured data.
  
• Ensure data quality, accuracy, and consistency across various data sources.
  
• Identify and resolve performance bottlenecks in existing data workflows.
  
• Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
  
• Participate in code reviews and contribute to data engineering best practices.
  

What We're Looking For

• 4-8 years of experience in Data Engineering or related roles.
  
• Strong hands-on experience withPySparkand large-scale data processing.
  
• Solid expertise in designing and developingETL pipelines.
  
• Advanced SQL skills, including query optimization and performance tuning.
  
• Good understanding of data warehousing and data modeling concepts.
  
• Strong problem-solving skills and attention to detail.
  
• Excellent communication and collaboration skills.
  

Nice to Have

• Experience with AWS.
  
• Exposure to Airflow or other workflow orchestration tools.
  
• Familiarity with Hadoop ecosystem technologies.
  
• Experience working with modern data lake or cloud data platforms.
  

Health insurance of INR 5.0 Lakhs for you and your family (up to 6 members), ensuring complete peace of mind.

Robust Protection Plans:

Group Personal Accident Insurance and Gro up Term Life Insurance to safeguard you and your loved ones.

PF and Gratuity provided as per standard government regulations.

Flexible Work Options:

Enjoy hybrid work arrangements & flexible working hours

Generous Leave Policy:

21 days of annual leave, in addition to 10 company-declared holidays.

Access to a dedicated break-out area with round-the-clock refreshments for relaxation and rejuvenation