Senior Apache Spark Technical Lead - Scala, Python

HCL Technologies Limited; Chennai District; On-site; INR 3,000,000 - 4,500,000; Full time

Job summary

HCL Technologies Limited in Chennai seeks a Senior Apache Spark Technical Lead to guide teams on designing, developing, and deploying scalable Spark-based solutions using Scala and Python. The role focuses on leadership, code reviews, performance optimization, and delivering high-quality results.

The ideal candidate will mentor engineers, collaborate with stakeholders to define project scope, and ensure adherence to SDLC and best practices in deployment and testing.

Qualifications

• Strong proficiency in Apache Spark, Scala, and Python.
• Experience in leading technical teams and projects.
• Excellent problem-solving and critical thinking.
• Solid understanding of software development life cycle.
• Good communication and interpersonal skills.
• Ability to work effectively in a collaborative team environment.
• Strong organizational and leadership abilities.
• Experience in performance tuning and optimization techniques.
• Knowledge of big data concepts is a plus.

Responsibilities

• Lead technical teams in designing and implementing Spark-based solutions with Spark, Scala, and Python.
• Provide technical guidance to resolve complex issues.
• Collaborate with stakeholders to gather requirements and define project scope.
• Ensure adherence to coding, testing, and deployment best practices.
• Conduct code reviews and optimize performance.
• Troubleshoot and debug to ensure on-time delivery.
• Stay updated with Spark, Scala, and Python trends and advancements.
• Mentor team members and share knowledge within the team.

Skills

Apache Spark

Scala

Python

Leadership

Team management

SDLC

Communication

Collaboration

Performance tuning

Big data concepts

Job description

Senior Apache Spark Technical Lead - Scala, Python Senior Apache Spark Technical Lead - Scala, Python India Job Description Senior Apache Spark Technical Lead - Scala, Python Chennai, Tamil Nadu

Job Summary

The Senior Technical Lead at HCL will be responsible for leading technical teams and projects related to apache spark, scala, and python. The role involves overseeing the design, development, and implementation of scalable and efficient solutions using these technologies.

Key Responsibilities

• 1. Lead technical teams in the design and implementation of solutions using apache spark, scala, and python
• 2. Provide technical expertise and guidance to team members in resolving complex technical issues
• 3. Collaborate with stakeholders to gather requirements and define project scope
• 4. Ensure adherence to best practices in coding, testing, and deployment processes
• 5. Conduct code reviews and performance optimization activities
• 6. Troubleshoot and debug technical issues to ensure seamless project delivery
• 7. Stay updated with the latest trends and advancements in apache spark, scala, and python technologies
• 8. Mentor team members and facilitate knowledge sharing within the team

Skill Requirements

• 1. Strong proficiency in apache spark, scala, and python
• 2. Experience in leading technical teams and projects
• 3. Excellent problem-solving skills and ability to think critically
• 4. Solid understanding of software development life cycle
• 5. Good communication and interpersonal skills
• 6. Ability to work effectively in a collaborative team environment
• 7. Strong organizational and leadership abilities
• 8. Experience in performance tuning and optimization techniques
• 9. Knowledge of big data concepts and tools is a plus

Other Requirements

• 1.Relevant certifications in apache spark, scala, or python are a plus Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026totaled $14.8billion.