Data Engineer -Data Engineer Data Platform

Unison Group; Hyderabad; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Unison Group in Hyderabad is seeking a data engineer with 4-6 years of experience in data engineering or software development. The role focuses on building robust data pipelines using Apache Spark and PySpark, and on cleaning, transforming, and validating large datasets.

The ideal candidate writes clean Python code for data manipulation, handles errors gracefully, and has strong SQL/data modeling skills for structured and semi-structured data. Familiarity with Git, CI/CD, and Agile is preferred.

Qualifications

• 4–6 years of experience in data engineering or software development.
• Strong hands-on experience with Apache Spark / PySpark.
• Proficient in Python for data manipulation and packaging.
• Solid understanding of distributed computing concepts (RDDs, DataFrames).
• Proficient in SQL and data modeling for structured and semi-structured data.
• Experience with Git, CI/CD, and Agile methodologies.

Skills

Data engineering

Python programming

Distributed computing

SQL & data modeling

Git & CI/CD

Agile

Tools

Apache Spark

PySpark

Git

CI/CD

Job description

Experience: 4-6 years of experience in data engineering or software development.

Technical Expertise

• Strong hands-on experience with Apache Spark / PySpark.
• Proficiency in Python programming (data manipulation, error handling, packaging).
• Solid understanding of distributed computing concepts (RDDs, DataFrames, partitions, shuffles).
• Proficient in SQL and data modeling for both structured and semi-structured data.
• Understanding of version control (Git), CI/CD, and Agile methodologies.
• Strong debugging, performance tuning, and analytical skills.