Senior Level Software Engineers

iTechStack; New Jersey; On-site; USD 90,000 - 120,000; Full time

Job summary

iTechStack is looking for a skilled developer to design and implement data processing systems using technologies like Apache Spark and Java. The role involves developing hive scripts and redshift scripts, requiring strong knowledge of Spark, Pyspark, and related frameworks.

The ideal candidate must be willing to travel to setup systems for various clients across the United States, performing feasibility studies and evaluating user requirements. Join us to leverage your expertise in a dynamic environment.

Qualifications

• Strong knowledge of Java programming language.
• Experience with Apache Spark and related technologies.
• Willingness to travel for client setup and feasibility studies.

Responsibilities

• Develop hive scripts and redshift scripts.
• Design and implement data processing systems using Spark.
• Integrate Spark Streaming with various technologies.

Skills

Java

Apache Spark

Pyspark

Scala

SparkSQL

Kafka

Flume

Amazon Kinesis

Cassandra

Job description

Job Description

Developed multiple hive scripts and redshift scripts for several workflows. Designed and implemented Customization of Keys, Values, Partitioners, Combiners, InputFormats and Record Readers in JAVA. Modify existing software to processing data using Spark (Pyspark, Scala, SparkSQL) and Spark Streaming, Integrated Spark Streaming with Kafka, Flume, Amazon Kinesis and Cassandra. Must be willing to travel to set up systems to various clients across the nation, perform feasibility studies, and evaluate user requirements.