Data Engineer (Migration)

Verdantas; Pune District; On-site; INR 2,000,000 - 3,200,000; Full time

Job summary

Verdantas is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and systems across the organization. You will collaborate with stakeholders to support analytics, reporting, and data-driven decision-making while ensuring data integrity, performance, and governance.

The role requires 5–9 years of hands-on data engineering experience in cloud environments and a strong background in SQL, Python, and Spark.

Qualifications

• Bachelor's or master's degree in computer science, information systems, data engineering, or related field.
• Typically 5-9 years of hands-on data engineering experience in data integration and cloud environments.

Responsibilities

• Demonstrate strong proficiency in SQL and Python for data engineering, transformation, and optimization activities.
• Develop and support large-scale data processing solutions using distributed frameworks like Apache Spark.
• Work within Azure-based cloud data ecosystems to build and maintain scalable data solutions.
• Design, develop, and maintain ETL/ELT pipelines using orchestration and workflow tools.
• Support and execute data migration initiatives with data accuracy and minimal disruption.
• Apply best practices in data modeling, metadata management, and data governance.
• Collaborate with cross-functional teams to improve data quality, performance, and accessibility.

Skills

SQL

Python

Apache Spark

Azure

ETL Pipelines

Data Governance

Data Migration

Education

BSc/MSc in CS or related field

Tools

Spark

Azure Data Factory/ETL tools

Job description

At Verdantas, we are looking for a talented and experienced Senior Data Engineer to join our growing team. This role is responsible for designing, building, and maintaining scalable data pipelines and data systems that ensure reliable, high-quality data availability across the organization. The Senior Data Engineer will work closely with stakeholders to support analytics, reporting, and data-driven decision-making while ensuring data integrity, performance, and governance standards are maintained. The ideal candidate will be passionate about solving complex data challenges, supporting enterprise data initiatives, and contributing to the continuous improvement of scalable and reliable data solutions

Responsibilities:

Technical Expertise

• Demonstrate strong proficiency in SQL and Python for data engineering, transformation, and optimization activities.
• Develop and support large-scale data processing solutions using distributed processing frameworks such as Apache Spark or similar technologies.
• Work within Azure-based cloud data ecosystems to build and maintain scalable data solutions.
• Design, develop, and maintain ETL/ELT pipelines using orchestration and workflow management tools.
• Support and execute data migration initiatives, ensuring data accuracy, consistency, and minimal disruption to business operations.
• Apply best practices in data modeling, metadata management, and data governance to create reliable and reusable data assets.
• Collaborate with cross-functional teams to improve data quality, performance, and accessibility for business users and analytics teams.

Education & Experience

• Bachelor's or master's degree in computer science, Information Systems, Data Engineering, or a related discipline.
• Typically, 5-9 years of hands-on experience in data engineering, data integration, and cloud-based data environments.

Preferred Certifications

• Google Professional Data Engineer
• AWS Certified Data Analytics - Specialty