Senior Big Data Engineer | Hadoop | Spark | Python | PL/SQL | ETL

V2 Solutions; Chennai District; Hybrid; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Hybrid work environment

Growth opportunities

Cross-functional teams

High-impact projects

Job summary

V2 Solutions in Chennai is seeking a Senior Associate Projects (Big Data Engineer) with 6–10 years of experience to design, develop, and optimize large-scale data processing solutions using Hadoop, Spark, Python, PL/SQL, and ETL tools. The role focuses on building scalable data pipelines, ensuring data quality, and enabling data-driven decision-making across the organization, with a hybrid work setup.

Candidates should have hands-on experience across data integration, data transformation, and

Qualifications

• 6–10 years of experience in Data Engineering or Big Data Development.
• Strong hands-on experience with Hadoop ecosystem components.
• Expertise in Apache Spark for large-scale data processing.
• Experience with ETL tools and data integration projects.
• Strong proficiency in Python programming.
• Advanced knowledge of PL/SQL and database optimization techniques.
• Experience working with structured and unstructured data.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Hadoop and Spark.
• Build and optimize ETL workflows to extract, transform, and load data from multiple sources.
• Perform data gap analysis and implement solutions to improve data quality and consistency.
• Develop complex PL/SQL procedures, functions, packages, and performance-tuned queries.
• Use Python to automate data processing, workflow orchestration, and reporting activities.
• Monitor, troubleshoot, and optimize big data applications and ETL jobs.
• Collaborate with business stakeholders and technical teams to gather requirements and deliver data solutions.
• Ensure data integrity, security, and compliance with organizational standards.
• Participate in code reviews and implement best practices for scalable data engineering solutions.
• Improve system performance through tuning, optimization, and process enhancements.
• Document technical designs, data flows, and operational procedures.

Skills

Hadoop

Apache Spark

Python

PL/SQL

ETL Tools

Data Gap Analysis

Data Integration

SQL

Job description

Job Description Position Senior Associate Projects (Big Data Engineer) Experience 6 – 10 Years Location Chennai (Hybrid) Shift Day Shift

Job Summary We are seeking a highly skilled Big Data Engineer with expertise in Hadoop, Spark, Python, PL/SQL, and ETL Tools to design, develop, and optimize large-scale data processing solutions. The ideal candidate will be responsible for building scalable data pipelines, ensuring data quality, and enabling data-driven decision-making across the organization. The role requires hands-on experience in big data technologies, data integration, data transformation, and performance optimization within enterprise environments.

Mandatory Skills

• Hadoop
• Apache Spark
• Python
• PL/SQL
• ETL Tools
• Data Gap Analysis
• Data Integration
• SQL

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Hadoop and Spark.
• Build and optimize ETL workflows to extract, transform, and load data from multiple sources.
• Perform data gap analysis and implement solutions to improve data quality and consistency.
• Develop complex PL/SQL procedures, functions, packages, and performance-tuned queries.
• Use Python to automate data processing, workflow orchestration, and reporting activities.
• Monitor, troubleshoot, and optimize big data applications and ETL jobs.
• Collaborate with business stakeholders and technical teams to gather requirements and deliver data solutions.
• Ensure data integrity, security, and compliance with organizational standards.
• Participate in code reviews and implement best practices for scalable data engineering solutions.
• Improve system performance through tuning, optimization, and process enhancements.
• Document technical designs, data flows, and operational procedures.

Required Qualifications

• 6–10 years of experience in Data Engineering or Big Data Development.
• Strong hands-on experience with Hadoop ecosystem components.
• Expertise in Apache Spark for large-scale data processing.
• Experience with ETL tools and data integration projects.
• Strong proficiency in Python programming.
• Advanced knowledge of PL/SQL and database optimization techniques.
• Experience working with structured and unstructured data.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management skills.

Preferred Certifications

• Certified Hadoop Developer
• Apache Spark Certification
• Python Programming Certification

Why Join Us?

• Work on enterprise-scale Big Data platforms.
• Exposure to cutting-edge data engineering technologies.
• Opportunity to collaborate with cross-functional teams on high-impact projects.
• Hybrid work environment with excellent growth opportunities.