Senior Big Data Engineer: Real-Time Pipelines & ML Infra

Redolent Infotech Pvt. Ltd.; Sunnyvale (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

Redolent Infotech Pvt. Ltd. in Sunnyvale, CA seeks a Sr. Big Data Engineer to design, build and operate petabyte-scale data systems, with a strong focus on real-time pipelines and ML infrastructure.

You will collaborate with engineers, product managers, BI developers and architects to deliver scalable, low-latency data solutions using Java and Python. 6–8 years of experience, Hadoop/Spark/Kafka and cloud tech (GCP/Azure) are required.

Qualifications

• Min 6-8 years of Big data development experience.
• Expertise in Data Engineering and complex data pipeline development.
• Proficiency in Java and Python for data processing.
• Experience with Hadoop, Hive, Kafka, Presto, Spark; strong SQL.

Responsibilities

• Design, develop, implement and tune large-scale distributed systems and pipelines for high data volumes with scalability, low latency and fault tolerance.
• Create and optimize real-time data pipelines and streaming analytics.
• Collaborate with engineers, product managers, BI developers and architects to deliver robust data solutions.

Skills

Big data development

Java

Python

SQL

Data pipelines

MapReduce

Hadoop

Hive

Kafka

Presto

Spark

Cloud: GCP

Cloud: Azure

NoSQL/Cassandra

Druid

RESTful APIs

Clickstream data

Data governance

Retail experience

Job description

Redolent Infotech Pvt. Ltd. in Sunnyvale, CA seeks a Sr. Big Data Engineer to design, build and operate petabyte-scale data systems, with a strong focus on real-time pipelines and ML infrastructure.

You will collaborate with engineers, product managers, BI developers and architects to deliver scalable, low-latency data solutions using Java and Python. 6–8 years of experience, Hadoop/Spark/Kafka and cloud tech (GCP/Azure) are required.