Real-Time Data Engineer (Spark, Kafka, Java) — 10mo

Quantum Technologies. LLC; Dallas (TX); On-site; USD 84,000 - 120,000; Full time

Job summary

Quantum Technologies. LLC seeks a Data Engineer to design and implement near real-time data pipelines using Spark/PySpark, Python, Kafka, Flink, and Cassandra. The role requires Java-based microservices and web app/API development with HTML5/JS frameworks. Collaboration in an Agile environment is essential.

Location is Dallas, TX with a duration of 10 months. The position accommodates W-2, 1099, or C2C engagement models and a hourly rate of $74.

Qualifications

• Experience with big data and streaming architectures is required.
• Strong debugging and problem-solving skills in real-time data pipelines.
• Experience with Agile/Scrum methodologies.

Responsibilities

• Translate application storyboards and use cases into functional applications.
• Build near real-time data pipelines with Spark/PySpark and Python to extract data from NoSQL DBs and load into Cassandra.
• Build real-time data pipelines with Apache Flink and Kafka; load into Cassandra graph databases.
• Design, build, and maintain efficient, reusable, and reliable Java code.
• Ensure performance, quality, and responsiveness of applications.
• Write unit and integration tests with JUnit and Mockito; use Log4j 2 for logging.
• Collaborate in an Agile development environment to deliver microservices-based web apps and APIs.
• Develop web front-ends and APIs using HTML5, CSS3, JavaScript, jQuery, AngularJS, Spring Boot.

Job description

Quantum Technologies. LLC seeks a Data Engineer to design and implement near real-time data pipelines using Spark/PySpark, Python, Kafka, Flink, and Cassandra. The role requires Java-based microservices and web app/API development with HTML5/JS frameworks. Collaboration in an Agile environment is essential.

Location is Dallas, TX with a duration of 10 months. The position accommodates W-2, 1099, or C2C engagement models and a hourly rate of $74.