Data Engineer: Spark, Hadoop & Big Data ETL

Valiant Technologies LLC; Alpharetta (GA); Vor Ort; USD 110.000 - 170.000; Vollzeit

Zusammenfassung

Valiant Technologies LLC is seeking a skilled data engineer with strong Core Java and Java 8+ experience. The role requires deep expertise in Apache Spark, Spark SQL, and DataFrames, with solid SQL and database knowledge.

Candidates should be familiar with Hadoop, HDFS, and Hive, and able to design and optimize large-scale ETL pipelines. We value distributed computing and data engineering principles, and expect hands-on capability to implement reliable data processing at scale in a fast-paced

Qualifikationen

• Strong hands-on experience in Core Java and Java 8+.
• Extensive experience with Apache Spark, Spark SQL, and DataFrames.
• Strong knowledge of SQL and database concepts.
• Experience with Big Data technologies such as Hadoop, HDFS, and Hive.
• Understanding of distributed computing and data engineering concepts.
• Experience in building and optimizing large-scale ETL pipelines.

Kenntnisse

Core Java

Spark SQL

SQL

Big Data

ETL pipelines

Tools

Apache Spark

Hadoop

Hive

DataFrames

SQL

Jobbeschreibung

Valiant Technologies LLC is seeking a skilled data engineer with strong Core Java and Java 8+ experience. The role requires deep expertise in Apache Spark, Spark SQL, and DataFrames, with solid SQL and database knowledge.

Candidates should be familiar with Hadoop, HDFS, and Hive, and able to design and optimize large-scale ETL pipelines. We value distributed computing and data engineering principles, and expect hands-on capability to implement reliable data processing at scale in a fast-paced