Senior Big Data Architect - Real-Time Analytics & Spark

Ventures Unlimited Inc; Louisville (KY); On-site; USD 100,000 - 130,000; Full time

Job summary

A technology consulting firm based in Louisville, KY is seeking a Senior Data Engineer with extensive experience in Data and Information Management, including Big Data solutions. The ideal candidate will design and deploy complex analytics and collaborate closely with product teams. Proficiency in technologies such as Cloudera, Spark, and AWS is required. This position demands a strong background in both analytical and architecting roles to drive innovative solutions.

Qualifications

• 10-15 years of total experience in Data and Information Management including 5 years in Big Data.
• Hands-on experience in utilizing the emerging technologies like Spark, Machine Learning, Python, Scala, Kafka, Ambari.
• Experience implementing NoSQL databases and Natural Language Processing methodologies.

Responsibilities

• Design, develop, test, and deploy Big Data solutions using Cloudera and/or IBM Big Insights.
• Collaborate with product/project managers and data scientists to formulate requirements.
• Drive overall architect responsibilities including roadmaps and IT governance.

Skills

Data and Information Management

Big Data

Cloudera

Hadoop

Spark

Machine Learning

Python

Scala

Kafka

Natural Language Processing

NoSQL DB

AWS

Job description

A technology consulting firm based in Louisville, KY is seeking a Senior Data Engineer with extensive experience in Data and Information Management, including Big Data solutions. The ideal candidate will design and deploy complex analytics and collaborate closely with product teams. Proficiency in technologies such as Cloudera, Spark, and AWS is required. This position demands a strong background in both analytical and architecting roles to drive innovative solutions.