Senior Big Data Engineer — Hadoop/Spark on Azure

360 IT Professionals Inc.

Santa Clara (CA)

On-site

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Relocation expenses
Benefits

Job summary

A leading ICT organization in the US is seeking an accomplished IT Security Leader to work on big data projects. The role involves collaborating with Technical Architects and developers, documenting processes, and recommending efficient solutions to complex challenges. Candidates should have over 5 years of IT experience, with strong skills in big data technologies, Java, and architectural collaboration. This is a full-time position with relocation expenses covered.

Qualifications

  • 5+ years of experience in IT, with a focus on big data.
  • Experienced in Java, J2EE, and SQL databases.
  • Proficient in Hadoop ecosystem technologies including HDFS, Map Reduce, and Hive.

Responsibilities

  • Work on tasks assigned by Technical Architects related to big data proof-of-concept.
  • Collaborate with architects to solve complex problems.
  • Document techniques and process flow diagrams as required.

Skills

Big data
Java
J2EE
Hadoop ecosystem
SQL
ETL tools
Unix shell scripting
Cassandra
Apache Kafka

Tools

Hadoop
Azure Data Factory
Apache Kafka

Job description

We are focused on imparting effective business staffing services through high-level cost effective solutions. We have a strong foundation built on the legacy and emerging technologies, including an excellent track record of on-time delivery. We are leaders in providing additional custom IT Services with a proficient approach towards development of emerging mobile-based applications and web based application development. We are emerging as one of the largest private talent sourcing and management firms in the US.

Our client- one of the leading ICT for development - ICT4D - organization, providing low-cost solutions using ICT to tackle poverty and to overcome disadvantage, working closely with local communities seeks an accomplishedIT Security Leader.

Job Description

Job Location: Deerfield, IL 60015

Project Duration: Long-term and Fulltime

Salary: Base Salary + Relocation expenses + Benefits

Description:

Primary Responsibilities:

  • Work on tasks assigned by Technical Architects related to a proof-of-concept in the area of big data.
  • Many activities will involve implementation of a series of use cases for a given technology stack which includes: HDInsight, Azure Event Hub (or Kafka), Azure Data Factory (or Talend), HBASE, Hive, Pig, Sqoop and Flume.
  • Recommend, design and code efficient and effective solutions for challenging problems for large work efforts of medium to high complexity.
  • Collaborate with architects and developers and present alternative approaches to complex problems.
  • Document techniques/approaches, process flow diagrams and data models as required.

Required Skills:

  • Overall 5+ years of experience with at least 2+ years with big data.
  • 3+ years with Java, J2EE & databases like Oracle and/or SQL Server
  • 2+ years of experience in developing systems/applications with: Hadoop ecosystem including Hadoop (Hortonworks or Cloudera), Map Reduce Pig, Hive, Sqoop and Flume.
  • 1+ years of experience with Spark, Spark Streaming or Storm and Kafka.
  • Experience with any ETL tool.
  • Experience with troubleshooting performance issues, SQL tuning etc.
  • Experience with shell scripting using Unix, PERL or Python
  • Experience with NoSQL database technologies such as Cassandra or HBASE

Candidates preferred with experience in following platforms and technologies:

  • Azure Data Factory or Talend
  • Azure Event Hub or Apache Kafka
Additional Information

All your information will be kept confidential according to EEO guidelines.

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data Developer
Senior Big Data Developer

360 IT Professionals • Santa Clara (CA)

On-site
USD 120,000 - 180,000
Relocation expenses
Benefits
Senior Big Data Engineer: Spark, AWS & ML Deployments
Senior Big Data Engineer: Spark, AWS & ML Deployments

Disys - Oak Brook • Tampa (FL)

On-site
USD 90,000 - 120,000
BigData Engineer / Architect
BigData Engineer / Architect

Nitor Infotech • Portland (OR)

On-site
USD 120,000 - 180,000
Lead Big Data Engineer - Data Lake & Real-Time Ingest
Lead Big Data Engineer - Data Lake & Real-Time Ingest

360 IT Professionals Inc. • Atlanta (GA)

On-site
USD 130,000 - 160,000
Senior Big Data Architect – Spark, Hadoop & Cloud
Senior Big Data Architect – Spark, Hadoop & Cloud

Avance Consulting Services • Memphis (TN)

On-site
USD 120,000 - 150,000
Big data with Azure architect
Big data with Azure architect

Avtech solution • Schaumburg (IL)

On-site
USD 120,000 - 190,000
Senior Big Data & Hadoop Architect
Senior Big Data & Hadoop Architect

Avance Consulting Services • New Jersey

On-site
USD 100,000 - 130,000
Lead Big Data Engineer: Spark, Hadoop & Azure
Lead Big Data Engineer: Spark, Hadoop & Azure

Avance Consulting Services • San Jose (CA)

On-site
USD 100,000 - 130,000
Senior Hadoop Developer - Lead Big Data, Spark & ML
Senior Hadoop Developer - Lead Big Data, Spark & ML

360 IT Professionals Inc. • Bloomington (IL)

On-site
USD 100,000 - 130,000
Sr. Hadoop Data Engineer
Sr. Hadoop Data Engineer

Sonoma Consulting Inc. • St. Louis (MO)

On-site
USD 100,000 - 130,000