Sr. Data Engineer ( SQL / Big data / Hadoop )

Redolent Infotech Pvt. Ltd.; Sunnyvale (CA); On-site; USD 140,000 - 180,000; Part time

Job summary

Redolent Infotech Pvt. Ltd. is seeking a Sr. Data Engineer in Sunnyvale, CA to design and implement data pipelines using SQL and Hadoop ecosystems.

The role focuses on large data sets, distributed computing, and real-time ingestion with Kafka, with development in Java, Scala, or Python. Familiarity with Cassandra and Hadoop tools is a plus, offering a market-rate contract of 6+ months. Ideal candidates will have Teradata SQL experience, Unix shell scripting skills, ETL expertise, and comfort

Qualifications

• Advanced SQL expertise, preferably Teradata.
• Experience with large data sets and distributed computing in Hadoop ecosystem.
• Strong Hadoop scripting to process petabytes of data.
• Unix/Linux shell scripting capability.
• ETL processes experience.
• Real-time data ingestion with Kafka is a plus.
• Development experience with Java, Scala, or Python.
• Familiarity with Cassandra and Automic scheduler.
• R and SAS experience is a plus.

Skills

Advanced SQL

Unix scripting

ETL processes

Java

Python

Scala

R

SAS

Tools

Teradata

Hadoop

MapReduce

Hive

Pig

Apache Spark

Flume

Kafka

Cassandra

Automic Scheduler

Job description

Sr. Data Engineer ( SQL / Big data / Hadoop )

We have following urgent role with our DIRECT client

Title: Sr. Data Engineer ( SQL / Big data / Hadoop )

Location: Sunnyvale, CA

Duration: 6+ Months

Rate: Market

Technical Requirements

• Advanced SQL (preferably Teradata)


• Experience working with large data sets, experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spar\"k\", etc.).


• Strong Hadoop scripting skills to process petabytes of data


• Experience in Unix/Linux shell scripting or similar programming/scripting knowledge


• Experience in ETL/ processes


• Real time data ingestion (Kafka) Nice to Have


• Development experience with Java, Scala, Flume, Python


• Cassandra


• Automic scheduler


• R/R studio, SAS experience a plus