Hadoop Developer

Incedo; Wilson (NC); On-site; USD 100,000 - 130,000; Full time

Job summary

Incedo is looking for a skilled Hadoop Consultant based in Raleigh, NC. Candidates should have 8-10 years of experience in data architecture, with a strong focus on big data technologies such as Hadoop and Spark. Lead data engineering efforts, build data pipelines, and leverage cloud services.

The ideal candidate will possess a Bachelor's or Master's degree in IT or Computer Science and has proven hands-on expertise in programming languages like Java and Python. Benefits include a contract position with exciting projects in data analytics.

Qualifications

• 8-10 years of industry experience in data analysis and architecture design.
• 5+ years of experience as a data engineer/solution architect.
• Strong programming experience using Java, Python, or Scala.

Responsibilities

• Design and deliver large scale distributed software systems.
• Build data pipelines for various data processing needs.
• Lead a technical team of business intelligence and big data developers.

Skills

Hadoop/MapReduce

Spark/SparkR

Java

Python

Scala

SQL

NoSQL

Data Pipeline Construction

Data Warehousing Best Practices

Education

Bachelor's Degree in IT/Computer Science

Master's Degree in IT/Computer Science

Tools

Hadoop

Kafka

ElasticSearch

Cassandra

Jupyter

SOLR

Job description

Incedo (http://www.incedoinc.com/) (formerly a part of $4Bn Group) is a technology solutions and services organization headquartered in the Bay Area, USA with workforce across North America, South Africa and India (Gurgaon, Bangalore). We specialize in Data & Analytics and Product Engineering Services, with deep expertise in Financial Services, Life Science and Communication Engineering. Our key focus is on Emerging Technologies and Innovation. Our end-to-end capabilities span across Application Services, Infrastructure and Operations.

Job Description

Position: Hadoop Consultant
Location: Raleigh, NC
Duration: Contract/Full Time

• Bachelors (IT/Computer Science Preferred); Master's Degree preferred (IT/Computer Science Preferred) or equivalent experience
• 8-10 years of industry experience in analysing source system data and data flows, working with structured and unstructured data, and delivering data and solution architecture designs.
• Experience with clustered/distributed computing systems, such as Hadoop/MapReduce, Spark/SparkR, Lucene/ElasticSearch, Storm, Cassandra, Graph Databases, Analytics Notebooks like Jupyter, Zeppelin etc
• Experience building data pipelines for structured/unstructured, real-time/batch, events/synchronous/asynchronous using MQ, Kafka, Steam processing.
• 5+ years of experience as a data engineer/solution architect designing and delivering large scale distributed software systems, preferably in large scale global business- preferably using open source tools and big data technologies such as Cassandra, Hadoop, Hive, Prestodb, Impala, HBase, Spark, Storm, Redis, Drill etc
• Strong hands-on experience of programming with Java, Python, Scala etc.
• Experience with SQL, NoSQL, relational database design, and methods for efficiently retrieving data for Time Series Analytics.
• Knowledge of Data Warehousing best practices; modelling techniques and processes and complex data integration pipelines
• Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
• Excellent technical skills – able to effectively lead a technical team of business intelligence and big data developers as well as data analysts.

Optional Skills

• Experience in Machine Learning, Deep Learning, Data Science
• Experience with Cloud architecture & service like AWS, Azure
• Experience with Graph, Sematic Web, RDF Technologies
• Experience with Text Analytics using SOLR or ElasticSearch

Additional Information

All your information will be kept confidential according to EEO guidelines.