Senior Backend Data Engineer - Spark/Scala/Python (AWS/GCP)

Quantum Technologies. LLC; Elk Grove (CA); On-site; USD 103,000 - 165,000; Full time

Job summary

QUANTUM TECHNOLOGIES LLC is seeking a skilled Back-End Engineer with a data engineering focus to design, develop, and maintain scalable data pipelines and backend systems. You will work with large datasets, leverage cloud technologies, and partner with data scientists to deliver data-driven solutions.

Candidates should have 5+ years in backend development, strong Spark, Python, Scala, Java, and SQL skills, plus AWS or GCP and Kafka experience.

Qualifications

• Bachelor’s degree in computer science or related field, or equivalent experience.
• 5+ years of backend development with a data engineering focus.
• Strong problem solving and collaboration skills.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient SQL for ETL processes and data extraction.
• Build real-time streaming pipelines with MSK/Kafka and use S3 for storage.
• Ensure data quality, security, and collaborate with data scientists.

Skills

Spark

Python

Scala

Java

SQL

DataFrames

Cloud AWS

GCP

Kafka

S3

Iceberg

Data Warehousing

Communication

Education

Bachelor’s degree in computer science or related field

Tools

AWS

GCP

MSK/Kafka

S3

Iceberg

Data Lake

Job description

QUANTUM TECHNOLOGIES LLC is seeking a skilled Back-End Engineer with a data engineering focus to design, develop, and maintain scalable data pipelines and backend systems. You will work with large datasets, leverage cloud technologies, and partner with data scientists to deliver data-driven solutions.

Candidates should have 5+ years in backend development, strong Spark, Python, Scala, Java, and SQL skills, plus AWS or GCP and Kafka experience.