Big Data Engineer

Tekskills; Bulandshahr; On-site; INR 600,000 - 1,200,000; Full time

Job summary

Tekskills is seeking a skilled Big Data developer to work with Hadoop, Hive SQL, Spark and cloud-based data tools. You will contribute to building scalable data pipelines and collaborate with teams across a complex organization to deliver robust data solutions.

The ideal candidate has hands-on experience with DevOps, Agile development, and performance tuning of queries, plus familiarity with cloud services (AWS or Azure) and modern streaming frameworks.

Qualifications

• Working experience of Hadoop, Hive SQL, Spark, Bigdata Eco System Tools.
• Ability to tweak queries and improve performance.
• Deliver code, set up environment, connectivity, deploy in production after testing.
• Strong DevOps and Agile Development Framework knowledge.
• Cloud computing knowledge (AWS or Azure).
• Strong problem solving and quick learning in complex organizations.
• Experience in teams with multiple reporting lines.
• Solid understanding of OO programming and HDFS concepts

Responsibilities

• Deliver code and set up development environment.
• Deploy code to production after testing.
• Tweak queries and optimize performance.
• Collaborate with teams in a complex organization with multiple reporting lines.
• Apply DevOps and Agile practices in project delivery.

Skills

Hadoop

Hive SQL

Spark

Bigdata ecosystem tools

Cloud computing

AWS

Azure cloud services

DevOps

Agile development

Scala

Storm

Spark Streaming

Flink

HDFS concepts

Job description

Job Description

Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing ?
Work on Hadoop, Hive SQL?s, Spark, Bigdata Eco System Tools.?
Experience in working with teams in a complex organization involving multiple reporting lines.?
The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. ?
The candidate should have strong DevOps and Agile Development Framework knowledge.?
Create Scala/Spark jobs for data transformation and aggregation?
Experience with stream-processing systems like Storm, Spark-Streaming, Flink"

Essential Skills

"? Working experience of Hadoop, Hive SQL?
s, Spark, Bigdata Eco System Tools.?
Should be able to tweak queries and work on performance enhancement. ?
The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing. ?
The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects.
The candidate should have strong DevOps and Agile Development Framework knowledge
Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.?
Strong conceptual and creative problem-solving skills, ability to work with considerable ambiguity, ability to learn new and complex concepts quickly.?
Experience in working with teams in a complex organization involving multiple reporting lines?
Solid understanding of object-oriented programming and HDFS concepts