Data Engineer: Spark, Hadoop & ETL Pipelines

Quantum Technologies. LLC; Alpharetta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Quantum Technologies. LLC in Alpharetta, GA is seeking a seasoned Big Data Engineer with hands-on experience in Java and Spark to design and optimize large-scale data pipelines.

You will work with Spark SQL, DataFrames, Hadoop and Hive to build reliable ETL processes, improve data quality, and support analytics across the organization. Strong SQL skills and distributed computing understanding are essential.

Qualifications

• Strong hands-on experience in Core Java and Java 8+.
• Extensive experience with Apache Spark, Spark SQL, and DataFrames.
• Strong knowledge of SQL and database concepts.
• Experience with Big Data technologies such as Hadoop, HDFS, and Hive.
• Understanding of distributed computing and data engineering concepts.
• Experience in building and optimizing large-scale ETL pipelines.

Skills

Core Java

Spark

Spark SQL

DataFrames

SQL

Hadoop

Hive

Distributed computing

ETL pipelines

Data engineering concepts

Job description

Quantum Technologies. LLC in Alpharetta, GA is seeking a seasoned Big Data Engineer with hands-on experience in Java and Spark to design and optimize large-scale data pipelines.

You will work with Spark SQL, DataFrames, Hadoop and Hive to build reliable ETL processes, improve data quality, and support analytics across the organization. Strong SQL skills and distributed computing understanding are essential.