Big Data Engineer

Tekskills; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tekskills in Hyderabad, India is seeking a Big Data Developer to work on Hadoop, Spark and data warehousing tools within cloud environments.

You will implement Scala/Spark jobs, optimize queries, and collaborate with banking-domain teams while adhering to DevOps and Agile practices.

Experience with Storm, Spark-Streaming or Flink is a plus; familiarity with HDFS and OO principles will help you deliver robust solutions.

Qualifications

• Experience with Hadoop, Hive SQL, Spark and Bigdata eco tools.
• Ability to tweak queries and enhance performance.
• Deliver code, set up environment, and deploy in production after testing.
• Strong DevOps and Agile knowledge; banking terminologies helpful.

Responsibilities

• Deliver code and manage deployment in production after testing.
• Set up development and production environments and ensure connectivity.
• Collaborate with teams across a complex org with multiple reporting lines.
• Apply DevOps and Agile practices throughout project cycles.

Skills

Hadoop

Hive SQL

Spark

Bigdata eco tools

DevOps

Agile

Cloud AWS

Azure

Scala

Storm

Spark Streaming

Flink

OOP/HDFS

Tools

Hadoop tools

SQL optimization

Production deployment

Job description

Job Description

Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing ?
Work on Hadoop, Hive SQL?s, Spark, Bigdata Eco System Tools.?
Experience in working with teams in a complex organization involving multiple reporting lines.?
The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. ?
The candidate should have strong DevOps and Agile Development Framework knowledge.?
Create Scala/Spark jobs for data transformation and aggregation?
Experience with stream-processing systems like Storm, Spark-Streaming, Flink"

Essential Skills

"? Working experience of Hadoop, Hive SQL?
s, Spark, Bigdata Eco System Tools.?
Should be able to tweak queries and work on performance enhancement. ?
The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing. ?
The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects.
The candidate should have strong DevOps and Agile Development Framework knowledge
Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.?
Strong conceptual and creative problem-solving skills, ability to work with considerable ambiguity, ability to learn new and complex concepts quickly.?
Experience in working with teams in a complex organization involving multiple reporting lines?
Solid understanding of object-oriented programming and HDFS concepts