Technical Lead

Sigmoid; Bengaluru; On-site; INR 2,000,000 - 2,500,000; Full time

Job summary

Sigmoid is looking for a Technical Lead in Bengaluru, Karnataka to build a scalable big data platform. The role involves working closely with Fortune 500 clients, designing fault-tolerant components, and leading a team of developers.

Ideal candidates must have 8+ years of experience in software development, proficiency with big data technologies like Hadoop and Spark, and the ability to effectively communicate with diverse teams. This is a fast-paced start-up environment where innovation thrives.

Qualifications

• 8+ years of experience in a related field.
• Strong expertise in enterprise-scale applications.
• Proven track record of delivering large-scale engineering products.

Responsibilities

• Interface with Fortune 500 clients to align technology solutions with their needs.
• Design and implement scalable, fault-tolerant components using big-data technologies.
• Guide developers and manage technical talent within the organization.

Skills

Big data technologies

Hadoop

Spark

Python

Scala

Cloud infrastructure (GCP/AWS)

Agile methodology

Data communication skills

Education

Bachelor's in Computer Science or related field

Tools

HDFS

MapReduce

Hive

Spark

Job description

Technical Lead – Data Engineering

This position reports to Engineering Manager.

As a Technical Lead, you will be responsible for building a highly scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

Responsibilities

• Align the organization with key client initiatives: interface daily with customers across leading Fortune 500 companies, connect with VP and Director level clients, travel to client locations, and translate business requirements into technology solutions.
• Design, develop, and evolve highly scalable and fault‑tolerant distributed components using Big‑data technologies; design and implement APIs, abstractions, and integration patterns; define technical requirements, data extraction, transformation, automate jobs, productionise jobs, and explore new big‑data technologies within a parallel‑processing environment.
• Provide technical leadership and manage day‑to‑day activities: guide developers in design and coding tasks and play a key role in hiring technical talent.
• Stay up‑to‑date on emerging technologies to ensure the greatest ROI for customers and the organization.
• Culture: be a strategic thinker, analytical, data‑driven, with raw intellect, entrepreneurial spirit, and an agile mindset; balance leadership with hands‑on execution.

Qualifications

• 8+ years of relevant work experience and a Computer Science or related technical discipline.
• Strong background in architecture and delivery of enterprise‑scale applications; capable of developing frameworks and design patterns; able to propose comprehensive solutions and guide junior staff.
• Proven track record of building and shipping large‑scale engineering products; preferred experience with cloud infrastructure such as GCP or AWS.
• Experience working with large, complex data sets from a variety of sources.
• Proficiency with Hadoop, Spark, or similar stack.
• Proficiency with functional and object‑oriented programming, Python or Scala.
• Effective written and verbal communication skills.
• Ability to collaborate with diverse engineers, data scientists, and product managers.
• Technical knowledge of Spark, Hadoop, and GCS Stack.
• Comfortable working in a fast‑paced start‑up environment.

Preferred Qualifications

• Experience with agile methodology.
• Development and support experience in the Big Data domain.
• Architecting, developing, implementing, and maintaining Big Data solutions.
• Experience with database modeling and development, data mining, and warehousing.
• Experience with the Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc).