Principal Data Engineer

Mahindra And Mahindra Limited; Chennai District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Mahindra and Mahindra Limited is seeking a Principal Engineer - PIH to design a scalable, unified data platform for real-time automotive data ingestion, processing, and storage, aligned with strategic goals. You will drive end-to-end data integration from vehicle telemetry, IoT sensors, and service records into a centralized repository.

The role requires 10+ years in data engineering with at least 5 years in leadership, deep expertise in big data and cloud platforms (AWS/Azure/GCP), and strong

Qualifications

• Bachelor's or Master's Engineering in Computer Science, Information Technology, Data Science, or related technical discipline.
• Proven expertise in big data technologies, cloud platforms (AWS, Azure, GCP), and real-time data processing frameworks.
• Experience in leading large-scale data platforms (10+ years) with at least 5 years in leadership.

Responsibilities

• Define and implement a scalable, unified data platform architecture for real-time automotive data ingestion, processing, and storage aligned with organizational goals.
• Oversee end-to-end data integration from vehicle telemetry, IoT sensors, customer feedback, and service records into a centralized repository.
• Ensure high data quality through rigorous validation, cleansing, versioning, and governance processes to maintain a single source of truth.
• Establish and enforce data security and privacy compliance, managing controlled access and audit trails.
• Standardize data engineering tools, coding practices, and automation to enhance platform efficiency and maintainability.
• Lead and develop a high-performing data engineering team, fostering technical expertise in big data, cloud architecture, and IoT data management.
• Collaborate cross-functionally with analytics, system intelligence, and insight delivery teams to translate business requirements into robust data infrastructure solutions.

Skills

Big data

Cloud platforms

Real-time processing

Data governance

Security

Education

Bachelor's or Master's in CS/IT/Data Science

Tools

Apache Spark

Kafka

Cloud services (AWS/Azure/GCP)

Containerization

Automation tools

Version control systems

Job description

Principal Engineer - PIH

Responsibilities & Key Deliverables

Key Tasks and Deliverables:

Define and implement a scalable, unified data platform architecture for real-time automotive data ingestion, processing, and storage aligned with organizational goals.

Oversee end-to-end data integration from vehicle telemetry, IoT sensors, customer feedback, and service records into a centralized repository.

Ensure high data quality through rigorous validation, cleansing, versioning, and governance processes to maintain a single source of truth.

Establish and enforce data security and privacy compliance, managing controlled access and audit trails.

Standardize data engineering tools, coding practices, and automation to enhance platform efficiency and maintainability.

Lead and develop a high-performing data engineering team, fostering technical expertise in big data, cloud architecture, and IoT data management.

Collaborate cross-functionally with analytics, system intelligence, and insight delivery teams to translate business requirements into robust data infrastructure solutions.

Critical Must-Have Deliverables

• A fully operational, scalable data platform capable of handling high-volume, real-time automotive and customer data.
• Robust, automated data pipelines ensuring seamless, resilient data ingestion and integration.
• Comprehensive data governance framework ensuring data quality, security, and compliance.
• A skilled and motivated data engineering team aligned with evolving technology trends and organizational objectives.
• Documented and standardized data engineering practices and tooling across the platform.

Experience Minimum 10 years of progressive experience in data engineering or related fields, with at least 5 years in a leadership role managing large-scale data platforms.

Industry Preferred Automotive, IoT, Technology, or Data-Driven Product Development industries.

Qualifications

Bachelor's or Master's Engineering in Computer Science, Information Technology, Data Science, or related technical discipline.

Proven expertise in big data technologies, cloud platforms (e.g., AWS, Azure, GCP), and real-time data processing frameworks.

General Requirements Good-to-Have Deliverables

• Implementation of advanced analytics enablement features such as real-time streaming analytics and predictive data models.
• Continuous innovation initiatives introducing emerging technologies and methodologies in data engineering.
• Cross-functional training programs to enhance data literacy and collaboration across business units.
• Contributions to industry forums or publications showcasing the organization’s data engineering capabilities.

Competencies and Skills

Functional Competencies

• Expertise in data platform architecture, data lake/warehouse design, and pipeline development.
• Strong knowledge of data integration techniques, ETL/ELT processes, and real-time streaming data.
• Proficiency in data governance, quality assurance, and security best practices.

Tools and Techniques Used

• Advanced proficiency with big data tools (e.g., Apache Spark, Kafka), cloud services (AWS/Azure/GCP), and data orchestration frameworks.
• Experience with containerization, automation tools, and version control systems.

Behavioral Competencies

• Strategic thinking with a results-driven mindset.
• Strong leadership and team development capabilities.
• Excellent communication and stakeholder management skills.
• Adaptability and continuous learning orientation.

Our commitment to Diversity, Equity, and Inclusion

At Mahindra and Mahindra Limited, we believe that diversity drives innovation, and inclusion is at the heart of everything we do. We are committed to cultivating a workplace where every individual feels valued, respected, and empowered to thrive. We are proud to be an Equal Opportunity Employer. All qualified applicants will be considered for employment without regard to age, caste, race, religion, color, ethnic origin, gender identity, nationality, physical or mental disability, medical condition, sexual orientation, educational background, marital or domestic partnership status, pregnancy or childbirth, veteran status, citizenship status, ancestry, financial status, or any other personal characteristic protected by applicable law. We actively encourage candidates from all backgrounds to apply and bring their unique perspectives to our teams. We are committed to ensuring an accessible and inclusive experience for all applicants. Together, we rise by embracing differences and building a future that reflects the communities we serve.

Experience Level

Senior Level