Big Data Lead

Persistent; Bengaluru; Hybrid; INR 1,500,000 - 2,000,000; Full time

Benefits offered by this job

Competitive salary and benefits package

Quarterly promotion cycles and sponsored higher education

Flexible working hours

Annual health check-ups

Insurance coverage for family

Job summary

Persistent in Bengaluru, Karnataka is looking for a Big Data Lead who will manage large datasets beyond traditional database capabilities.

This role involves creating, designing, and implementing data processing jobs, ensuring data security, and complying with industry standards. The ideal candidate has 6 years of experience with the Big Data Hadoop Ecosystem and is skilled in data modeling and software implementation.

Qualifications

• 6 years' experience in designing & developing enterprise application solutions for distributed systems.
• Understanding of Big Data Hadoop Ecosystem components, including Sqoop, Hive, Pig, Flume.
• Experience with Hadoop, HDFS, cluster management, Hive, Pig, MapReduce, and Hadoop ecosystem framework.

Responsibilities

• Manage customer's priorities of projects and requests.
• Assess customer needs utilizing a structured requirements process.
• Design and implement software products including data models and visualizations.

Skills

Big Data Hadoop Ecosystem

Java

NoSQL databases

Apache Spark

Tools

Hadoop

HDFS

Hive

Pig

Talend

Job description

About Persistent

We are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world including 12 of the 30 most innovative US companies, 80% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem.

Our growth trajectory continues, as we reported $1,231M annual revenue (16% Y-o-Y). Along with our growth, we’ve onboarded over 4900 new employees in the past year, bringing our total employee count to over 23,500+ people located in 19 countries across the globe.

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

About the Position

We are looking for a Big Data Lead who will be responsible for the management of data sets that are too big for traditional database systems to handle. You will create, design, and implement data processing jobs in order to transform the data into a more usable format. You will also ensure that the data is secure and complies with industry standards to protect the company’s information.

What You?ll Do

• Manage customer's priorities of projects and requests


• Assess customer needs utilizing a structured requirements process (gathering, analyzing, documenting, and managing changes) to prioritize immediate business needs and advising on options, risks and cost


• Design and implement software products (Big Data related) including data models and visualizations


• Demonstrate participation with the teams you work in


• Deliver good solutions against tight timescales


• Be pro-active, suggest new approaches and develop your capabilities


• Share what you are good at while learning from others to improve the team overall


• Show that you have a certain level of understanding for a number of technical skills, attitudes and behaviors


• Deliver great solutions


• Be focused on driving value back into the business

Expertise You?ll Bring

• 6 years' experience in designing & developing enterprise application solution for distributed systems


• Understanding of Big Data Hadoop Ecosystem components (Sqoop, Hive, Pig, Flume)


• Additional experience working with


• Hadoop, HDFS, cluster management


• Hive, Pig and MapReduce, and Hadoop ecosystem framework


• HBase, Talend, NoSQL databases


• Apache Spark or other streaming Big Data processing, preferred


• Java or Big Data technologies, will be a plus

Benefits

• Competitive salary and benefits package


• Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications


• Opportunity to work with cutting-edge technologies


• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards


• Annual health check-ups


• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Inclusive Environment

We offer hybrid work options and flexible working hours to accommodate various needs and preferences.

Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.

Let's unleash your full potential. See Beyond, Rise Above