Big Data Engineer

TECHNIX TECHNOLOGY; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading company is seeking a talented Big Data Engineer to join their team in Bengaluru. The ideal candidate will possess strong skills in SQL, Hive, Spark and ETL processes, along with a proven ability to manage large data sets. This full-time position offers an opportunity to work on high-performance big data solutions in a collaborative environment.

Qualifications

• Must have 4+ years of relevant experience in big data engineering.
• Strong proficiency in SQL, Hive, Spark, and basic Unix shell scripting.
• Familiarity with ETL processes and large data sets.

Responsibilities

• Develop and maintain scalable and high-performance big data solutions.
• Design, develop, and implement ETL processes.
• Collaborate with cross-functional teams to identify and solve complex business problems.

Skills

Big Data

SQL

Java

ETL

NiFi

PySpark

Unix shell

Hive

Spark

Ansible

shell scripts

Pig

Go

Education

BSc in Computer Science

Engineering or Relevant field

MCA

BCA

Job description

Join to apply for the Big Data Engineer role at TECHNIX TECHNOLOGY

Join to apply for the Big Data Engineer role at TECHNIX TECHNOLOGY

Get AI-powered advice on this job and more exclusive features.

Bangalore

Opening: 21-Feb-2023

Skills Required: Big Data, SQL, Java, ETL, NiFi, PySpark, Unix shell, Hive, Spark, Ansible, shell scripts, Pig, Go

Experience Required: Must have 3 Years + Experience in relevant field

Educational Qualification: BSc in Computer Science, Engineering or Relevant field ,MCA or BCA

Employment Type: Full Time

Workplace Options: Onsite

Opening Summary

We are seeking a talented and experienced Big Data Engineer with a passion for data management and analytics to join our team. The ideal candidate will have 4+ years of relevant experience with SQL, Hive, Spark and basic Unix shell scripting skills. The candidate must be familiar with ETL (Extract, Transform, Load) processes and be able to work with large data sets.

Requirements

• 4+ years of relevant experience in big data engineering
• Strong proficiency in SQL, Hive, Spark and basic Unix shell scripting
• Solid understanding of ETL processes
• Experience working with large data sets
• Familiarity with data modeling and data warehousing concepts
• Excellent problem-solving skills and attention to detail
• Strong communication skills and ability to work in a team environment
  
  

Responsibilities

• Develop and maintain scalable and high-performance big data solutions
• Design, develop and implement ETL processes
• Perform data analysis and data profiling to ensure data quality and integrity
• Collaborate with cross-functional teams including data scientists, business analysts, and product
• Managers to identify and solve complex business problems
• Develop and maintain documentation, including technical specifications and user guides
• Conduct code reviews and mentor junior team members
  
  

Preferred Qualification

Experience with Pig, Java, Go, NiFi and PySpark Worked on AMEX projects or experience in FSS domain Knowledge of distributed computing, Hadoop ecosystem, and NoSQL databases

Notes

• If you are passionate about big data and are looking for a challenging and rewarding opportunity, we encourage you to apply for this position.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at TECHNIX TECHNOLOGY by 2x

Sign in to set job alerts for “Big Data Developer” roles.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.