Hadoop & Spark Engineer - Cloud Data Platform

Valiant Technologies LLC; Bentonville (AR); On-site; USD 110,000 - 150,000; Full time

Job summary

Valiant Technologies LLC seeks a capable Big Data Engineer to design, develop, and optimize data pipelines and analytics workflows. You will work with Hadoop, Spark, and streaming technologies, leveraging cloud platforms like GCP and Azure to deliver scalable data solutions.

You should have hands-on coding in Scala or Python, strong data modeling and migration skills, and familiarity with BI tools and data warehousing. Collaboration with cross-functional teams is essential.

Qualifications

• Hands-on coding experience in at least one language (Scala or Python).
• Experience with cloud platforms (GCP, Azure).
• Strong data modeling and data migration skills.
• Exposure to Hadoop ecosystems, Spark, streaming technologies, and Kafka.

Responsibilities

• Demonstrates and promotes an extremely high standard of code quality, system reliability, and performance.
• Proven track record of hands-on coding experience in Scala or Python.
• Experience with at least one cloud platform (GCP or Azure).
• Experience with data warehousing, BI tools, and integration/orchestration tools such as Automic and Apache Airflow.

Skills

Hadoop

Spark

Cloud technologies

Python

Scala

Java

Streaming tech

Kafka

Backend dev

J2EE

Data modeling

Data migration

Tools

Automic

Apache Airflow

Job description

Valiant Technologies LLC seeks a capable Big Data Engineer to design, develop, and optimize data pipelines and analytics workflows. You will work with Hadoop, Spark, and streaming technologies, leveraging cloud platforms like GCP and Azure to deliver scalable data solutions.

You should have hands-on coding in Scala or Python, strong data modeling and migration skills, and familiarity with BI tools and data warehousing. Collaboration with cross-functional teams is essential.