Azure Big Data Engineer

PradeepIT Consulting Services Pvt Ltd; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A leading IT consulting firm in Bengaluru seeks an experienced IT professional with 4-6 years in Hadoop project execution and strong skills in MS-Azure and related technologies. The candidate should possess excellent analytical and communication abilities, along with sound interpersonal skills.

Qualifications

• Overall 4-6 years of relevant IT experience.
• Experience executing end-to-end Hadoop projects.
• Excellent communication and teamwork skills.

Responsibilities

• Implement Hadoop projects as per specifications.
• Conduct ad-hoc analyses and present results clearly.
• Anticipate issues and devise solutions.

Skills

Hadoop implementation

MS-Azure

SparkCore

PySpark

Scala

Hive

HBase

SparkSQL

PostgreSQL

Azure Data Factory

NoSQL databases

Education

BE, MCA, M.Tech or MS

Job description

Responsibilities:

• Overall 4 6 years of relevant IT experience

Primary Skills

• Experience in implementing at least 2 end to end Hadoop projects
• Min 4-year experience on MS-Azure with HDInsights / Databricks
• Min 4 years of experience on SparkCore, PySpark, Scala, Hive, HBase, SparkSQL

Secondary Skills

• Min 2+ years of experience with PostgreSQL
• Experience with Azure Data Factory (ADF), Blob, ADLS.
• Experience with NoSQL databases such as HBase, CosmosDB

Qualifications

BE, MCA, M.Tech or MS

Additional information

• BE/MCA with 4+ years of total experience with end-to-end Hadoop Project execution and Excellent communication
• Doing ad-hoc analysis and presenting results in a clear manner
• Good ability to anticipate issues and formulate remedial actions.
• Sound interpersonal and teamwork skills.
• Sound Knowledge of unit testing methodologies and frameworks