Data enginner

Valiant Technologies LLC; Dallas (TX); Presencial; USD 84.000 - 120.000; Tempo integral

Resumo da vaga

Valiant Technologies LLC in Dallas, TX seeks an experienced Data Engineer to design and implement real-time data pipelines. You will work with Spark, PySpark, Python, Kafka and Cassandra to extract data from multiple sources and load into our data platforms. Strong Java + web tech skills (HTML5/CSS3/JS) required for APIs and microservices.

You will contribute to Agile/Scrum processes, ensure code quality, and help automate testing and deployment in a fast-paced environment.

Qualificações

• Ability to translate application stories and use cases into functional applications.
• Experience building near real-time data pipelines with Spark/PySpark and Python.
• Experience extracting data from NoSQL/Relational DBs and loading into Cassandra.
• Strong Java development with web technologies (HTML5/CSS3/JS).

Responsabilidades

• Translate stories and use cases into scalable data solutions.
• Build near real-time data pipelines with Apache Spark, PySpark, and Python.
• Design, build, and maintain Java code for data processing and APIs.
• Ensure performance, quality and responsiveness of applications.
• Maintain code quality, organization and automation; write unit/integration tests.

Conhecimentos

Apache Spark

PySpark

Python

NoSQL

Cassandra

Apache Kafka

Java

HTML5

CSS3

JavaScript

jQuery

AngularJS

Spring Boot

Git

SVN

JUnit

Mockito

Log4j 2

Agile/Scrum

Ferramentas

Apache Spark

PySpark

Apache Flink

Apache Kafka

Java

HTML5

CSS3

JavaScript

jQuery

AngularJS

Spring Boot

Git

SVN

JUnit

Mockito

Log4j 2

Descrição da vaga

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: Data enginner
Location: Dallas,TX
Duration: 10 months
Bill Rate: $74/hour (C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description

• Ability to translate application storyboards and use cases into functional applications
• Build near real time data pipeline with Apache Spark| Pyspark & Python to extract data from NoSQL DBs and Load it into Cassandra Data Enterprise Graph Build real time data pipeline with Apache Flink|
• Apache Kafka and Python to extract data from Relational and NoSQL DBs and Load it into Cassandra Data Enterprise Graph Design| build| and maintain efficient| reusable| and reliable Java code
• Ensure the best possible performance| quality| and responsiveness of the applications
• Help maintain code quality| organization| and automatization
• Strong debugging| problem solving and investigative skills.
• Ability to assimilate disparate information (log files| error messages etc.) and pursue leads to find root cause of problems
• Experience in Agile/Scrum methodology
• Proven ability to create innovative solutions.
• Strong agile/scrum development experience Expertise developing web applications and APIs using Micro Services| with demonstrable production-scale experience.
• Web applications development using Java| HTML5| CSS3| JavaScript| jQuery| Angular JS| Spring Boot.
• Skilled n Version control tools e.g.,| GIT| SVN| etc. to maintain common source code the entire process of workflow.Writing unit / Integration tests using JUnit / Mockito for code coverage as per the standards and Log4j 2 for logging.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.