Senior Big Data Engineer: Hadoop, Spark & Data Pipelines

Incedo; Wilson (NC); On-site; USD 100,000 - 130,000; Full time

Job summary

Incedo is looking for a skilled Hadoop Consultant based in Raleigh, NC. Candidates should have 8-10 years of experience in data architecture, with a strong focus on big data technologies such as Hadoop and Spark. Lead data engineering efforts, build data pipelines, and leverage cloud services.

The ideal candidate will possess a Bachelor's or Master's degree in IT or Computer Science and has proven hands-on expertise in programming languages like Java and Python. Benefits include a contract position with exciting projects in data analytics.

Qualifications

• 8-10 years of industry experience in data analysis and architecture design.
• 5+ years of experience as a data engineer/solution architect.
• Strong programming experience using Java, Python, or Scala.

Responsibilities

• Design and deliver large scale distributed software systems.
• Build data pipelines for various data processing needs.
• Lead a technical team of business intelligence and big data developers.

Skills

Hadoop/MapReduce

Spark/SparkR

Java

Python

Scala

SQL

NoSQL

Data Pipeline Construction

Data Warehousing Best Practices

Education

Bachelor's Degree in IT/Computer Science

Master's Degree in IT/Computer Science

Tools

Hadoop

Kafka

ElasticSearch

Cassandra

Jupyter

SOLR

Job description

Incedo is looking for a skilled Hadoop Consultant based in Raleigh, NC. Candidates should have 8-10 years of experience in data architecture, with a strong focus on big data technologies such as Hadoop and Spark. Lead data engineering efforts, build data pipelines, and leverage cloud services.

The ideal candidate will possess a Bachelor's or Master's degree in IT or Computer Science and has proven hands-on expertise in programming languages like Java and Python. Benefits include a contract position with exciting projects in data analytics.