Kafka/Redis/Hadoop Developer

Centraprise, Corp.; Plano (TX); On-site; USD 120,000 - 170,000; Full time

Job summary

Centraprise, Corp. is seeking a Senior Big Data Engineer in Plano, Texas to design, implement, and optimize real-time data pipelines using Kafka, Redis, Hadoop, and PySpark.

The role requires hands-on work with streaming engines and NoSQL databases while collaborating across teams to deliver scalable solutions. The ideal candidate has 9+ years of experience, strong problem-solving skills, and demonstrates expertise in distributed architectures, data security, and cloud platforms such as AWS,

Qualifications

• Minimum 9 years of experience in data engineering or related field.
• 5+ years of industry experience with hands-on Big Data and real-time data processing.
• Strong knowledge of real-time streaming with Kafka (KStreams, KTable).
• Proficient in NoSQL databases like Redis, MongoDB, or HBase.
• Proficient in Python, Scala, Java, and Bash/Shell scripting.

Skills

Kafka

Redis

Hadoop

PySpark

Education

Bachelor's or Master's in Science or Engineering

Tools

KStreams

KTable

Flink

Storm

Job description

Primary Skill: Kafka, Redis, Hadoop, PySpark

Secondary: Python

Experience: Minimum 9 years

• Bachelor's or Master's degree in Science or Engineering, or a related field.
• Minimum of 5 years of industry experience, with at least 3 years focused on hands-on work in Big Data and real-time data processing technologies.
• Proficiency in real-time streaming technologies like Kafka (KStreams, KTable)
• Strong knowledge of NoSQL databases like Redis, MongoDB, or HBase.
• Proficiency in programming languages such as Python, Scala, Java, and Bash/Shell Scripting.
• Excellent problem-solving abilities and the capability to deliver effective solutions for business-critical applications.
• Strong understanding of distributed systems, data partitioning, and fault-tolerant architectures.
• Experience with additional real-time streaming technologies like Flink or Storm.
• Familiarity with Cloud Technologies such as Azure, AWS, or GCP.
• knowledge of machine learning algorithms, statistical analysis, and programming languages (Python or R) to conduct data analysis and develop predictive models.
• Proficiency in Data Integration and Data Security within real-time and Big Data ecosystems, including knowledge of Kerberos.
• Strong command of Visual Analytics Tools, with a focus on Tableau.