Senior Backend Data Engineer: Spark, Scala, Python, AWS/GCP

Cloud Analytics Technologies, LLC; Elk Grove (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

A technology consulting firm is seeking a skilled Back-End Engineer to design and maintain data pipelines and back-end systems. Candidates should have strong experience in Spark, Python, and SQL, with a focus on cloud technologies like AWS and GCP. This position requires collaboration with data scientists for impactful solutions. The role is available in Elk Grove, CA, and may offer hourly rates depending on experience.

Qualifications

• 5+ years of experience in back-end development with a focus on data engineering.
• Strong proficiency in Spark, Python, Scala, and Java.
• Expertise in SQL and working with relational databases.

Responsibilities

• Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
• Implement data storage and processing solutions using cloud technologies.

Skills

Spark

Python

Scala

Java

SQL

DataFrames

AWS

GCP

MSK/Kafka

S3

Iceberg

Education

Bachelor's degree in computer science or related field

Job description

A technology consulting firm is seeking a skilled Back-End Engineer to design and maintain data pipelines and back-end systems. Candidates should have strong experience in Spark, Python, and SQL, with a focus on cloud technologies like AWS and GCP. This position requires collaboration with data scientists for impactful solutions. The role is available in Elk Grove, CA, and may offer hourly rates depending on experience.