Big Data Lead

Talentica; Bengaluru; On-site; INR 12,00,000 - 18,00,000; Full time

Job summary

A leading tech company in Bangalore is seeking a Data Engineer Lead to drive data science research and software development related to enterprise Wi-Fi technology. Ideal candidates will have 7-12 years of experience in software development along with strong skills in Python or Java and hands-on experience with big data frameworks like Spark or Hadoop. You'll collaborate with product teams to enhance innovative technology solutions in a supportive work environment.

Benefits

Flexible schedules

Remote work options

Recognition rewards

Learning opportunities

Innovative culture

Qualifications

• 7-12 years of software development experience with big data technologies.
• Strong programming skills in Python or Java.
• Hands-on experience with big data frameworks: Spark/Hadoop, Apache Storm, Apache Flink.

Responsibilities

• Design and implement machine learning solutions to process terabytes of streaming data.
• Utilize analytical and programming skills, such as Hadoop, Java, and Python.
• Work with cloud-based CI/CD tools to enhance data processing pipelines.

Skills

Python

Java

Apache Spark

Hadoop

Apache Storm

Apache Flink

Cassandra

Elasticsearch

Redis

Docker

Education

Bachelor’s degree in Engineering/Technology (B.E/B.Tech)

Tools

Hadoop

Docker

Job description

Overview

We are seeking a Data Engineer Lead who will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology, delivering unprecedented visibility into the user experience. In this role, you’ll collaborate with other engineers and product managers to enhance Wi-Fi AIOps models.

This position requires experience in dealing with huge amounts of data generated by communication protocols. You’ll apply your knowledge of wireless communication networks, machine learning and software engineering to develop and implement scalable algorithms to process a large amount of streaming data to classify AIOps Insights.

If solving complex big data challenges excites you, we’d love to connect.

Responsibilities

• Design and implement machine learning solutions to process terabytes of streaming data, enabling AIOps for Wi-Fi networks to detect issues and classify insights.


• Require knowledge and experience of various big data streaming processing platforms, such as Apache Storm and Apache Flink, and NoSQL database storage, Cassandra, Elasticsearch, Redis.


• Utilize analytical and programming skills, such as Hadoop, Java and Python.


• Require good knowledge and experience to work with cloud based CI/CD tools and cloud DevOps teams to collect stats and create monitors for our data processing pipelines.


• Good understanding Python web service and be able to develop good quality code.


• Experience with containerizing applications, e.g., with Docker.

To be successful in this role, you should have

• Qualification: Bachelor’s degree in Engineering/Technology (B.E/B.Tech) from a top-tier institution in India.


• Experience: 7-12 years of software development experience with big data technologies.

Skills

• Strong programming skills in Python or Java.


• Hands-on experience with big data frameworks: Spark/Hadoop, Apache Storm, Apache Flink (at least two).


• Proficiency with NoSQL databases (Cassandra, Elasticsearch, or Redis).


• Solid understanding of cloud-based CI/CD and DevOps practices.


• Experience with containerization tools (Docker).

Good-to-have skills

• Python, CICD, Docker, cloud, AWS, GCP, networking domain

What you’ll find here

• A culture of innovation: We only take up projects that challenge us to innovate. Our customers come to us for our technology expertise.


• Endless learning opportunities: Continuous learning is baked into our DNA. You’ll always have the chance to learn new things and stay on top of the latest trends.


• Talented peers: Lead and work alongside engineers from IITs, NITs, BITS, and other premier institutions.


• Work-life balance: We value work-life balance and offer flexible schedules, including remote work options, so you can thrive both professionally and personally.


• A great culture: Our employees love working here! 82% recommend Talentica to their friends, according to Glassdoor. Join us, and you’ll see why!


• Recognition rewards: We don’t just work hard, we celebrate success. Your contributions won’t go unnoticed. We’ll make sure you’re recognized for the amazing work you do.

Ready to Make an Impact

Fill out the lead form below, and we’ll get in touch!

Apply Now

Personal Information

Educational Details

Professional Details