Real-Time Data Engineer (Spark/PySpark, Kafka, Cassandra)

Ethereum Technologies; Dallas (TX); On-site; USD 87,000 - 117,000; Full time

Job summary

Ethereum Technologies in Dallas, TX is seeking a Data Engineer for a 10-month engagement. The role involves translating application stories into functional apps and building near real-time data pipelines using Apache Spark, PySpark, Python, Kafka, and Cassandra.

The candidate will design Java-based services, exemplify best practices in test automation with JUnit/Mockito and Log4j 2, and contribute to a scalable microservices ecosystem.

Qualifications

• Translate application storyboards and use cases into functional applications.
• Build near real time data pipelines using Spark, PySpark and Python to extract data from NoSQL DBs and load into Cassandra.
• Design and maintain Java code with emphasis on reliability and performance.
• Develop web apps and APIs using Java, HTML5, CSS3, JavaScript, AngularJS, Spring Boot.
• Write unit and integration tests with JUnit/Mockito and log with Log4j 2.

Responsibilities

• Translate storyboards and use cases into functional applications.
• Build near real-time data pipelines using Spark, PySpark and Python to extract data and load into Cassandra.
• Create real-time data pipelines with Flink where applicable and ensure data integrity.
• Develop Java-based services and APIs using a microservices approach.
• Ensure performance, quality, and responsiveness of applications.
• Help maintain code quality, organization, and automation.

Skills

Apache Spark

Python

Java

JavaScript

Angular

Spring Boot

Kafka

NoSQL

Cassandra

Git

JUnit/Mockito

Log4j 2

Tools

Git

SVN

JUnit

Mockito

Log4j 2

Job description

Ethereum Technologies in Dallas, TX is seeking a Data Engineer for a 10-month engagement. The role involves translating application stories into functional apps and building near real-time data pipelines using Apache Spark, PySpark, Python, Kafka, and Cassandra.

The candidate will design Java-based services, exemplify best practices in test automation with JUnit/Mockito and Log4j 2, and contribute to a scalable microservices ecosystem.