Senior Hadoop Data Engineer — Scalable Data Pipelines

Sonoma Consulting Inc.; St. Louis (MO); On-site; USD 100,000 - 130,000; Full time

Job summary

A reputable IT consulting firm in St. Louis is seeking a Full-Time Data Engineer with extensive experience in Big Data and Hadoop solutions. The ideal candidate should possess a Bachelor's degree and 8+ years of relevant experience or a Master’s degree with 6+ years. Key responsibilities include designing scalable data pipelines and implementing ETL processes. Candidates must be US Citizens or Green Card Holders. This opportunity offers a chance to work on innovative projects within a collaborative team environment.

Qualifications

• 8+ years relevant experience with a Bachelor's degree or 6+ years with a Master's.
• 4+ years implementing big data solutions on Hadoop.
• Experience building stream-processing systems.

Responsibilities

• Implement data ingestion and ETL processes on Hadoop.
• Design and build scalable data processing pipelines.
• Participate in Agile development with daily scrums.

Skills

Big Data tools

Hadoop

Data ingestion and ETL processes

Scala

Java

Python

NoSQL databases

Kafka

Education

Bachelor's degree

Master’s degree

Tools

Hadoop v2

MapReduce

Spark

HDFS

Hive

Kafka

Job description

A reputable IT consulting firm in St. Louis is seeking a Full-Time Data Engineer with extensive experience in Big Data and Hadoop solutions. The ideal candidate should possess a Bachelor's degree and 8+ years of relevant experience or a Master’s degree with 6+ years. Key responsibilities include designing scalable data pipelines and implementing ETL processes. Candidates must be US Citizens or Green Card Holders. This opportunity offers a chance to work on innovative projects within a collaborative team environment.