Data Engineer

The AES Group; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

The AES Group is seeking a Data Engineer to join our Bay Area team on a long-term project focused on building scalable data pipelines for large-scale web and advertising traffic.

You'll design and optimize ETL/ELT processes, work with Spark/Hadoop ecosystems, and collaborate with data scientists and product teams to deliver reliable, query-friendly data stores on AWS or GCP.

Qualifications

• Strong programming skills in Python or Java/Scala with advanced SQL.
• Hands-on experience with Spark, Hadoop, Hive, or Kafka.
• Proficiency in public cloud platforms like AWS or GCP and data modeling.

Responsibilities

• Design, scale, and maintain reliable ETL/ELT data pipelines.
• Process real-time and batch streaming datasets.
• Optimize warehouse storage, partitioning, and query performance.
• Collaborate with Data Scientists and Product teams to deliver clean data environments.

Skills

Python/Java/Scala

Advanced SQL

Tools

Apache Spark

Hadoop

Hive

Kafka

AWS

GCP

Job description

• Work with a leading technology organization in the digital and data-driven industry.
• Gain hands-on experience building and optimizing modern data solutions.
• Collaborate with experienced engineers, analysts, and cross-functional teams.
• Work on high-impact data engineering initiatives in a fast-paced environment.
• Opportunity to strengthen your skills across data pipelines, cloud technologies, and analytics.

Role: Data Engineer

Location: Bay Area, CA

Why Join Us?

• Work with a leading technology organization in the digital and data-driven industry.
• Gain hands-on experience building and optimizing modern data solutions.
• Collaborate with experienced engineers, analysts, and cross-functional teams.
• Work on high-impact data engineering initiatives in a fast-paced environment.
• Opportunity to strengthen your skills across data pipelines, cloud technologies, and analytics.

About The Role

The AES Group INC looking for a skilled Data Engineer to join our team for a high-impact, long-term project spanning over a year. In this role, you will build, optimize, and maintain robust data pipelines that process massive volumes of web and advertising traffic. If you love handling large-scale data systems and building infrastructure that scales, we want to talk to you!

Key Responsibilities

• Data Pipelines: Design, scale, and maintain reliable ETL/ELT data pipelines.
• Stream & Batch Processing: Process large-scale real-time and batch streaming datasets.
• Storage Architecture: Optimize data warehouse storage, partitioning, and query performance.
• Collaboration: Partner with Data Scientists and Product teams to deliver clean, structured data environments.

What We Are Looking For

• Core Tech: Strong programming skills in Python or Java/Scala, alongside advanced SQL expertise.
• Big Data Infrastructure: Deep, hands-on experience with tools like Apache Spark, Hadoop, Hive, or Kafka.
• Cloud Architecture: Proficiency with public cloud platforms (such as AWS or GCP).
• Data Modeling: Solid understanding of data warehousing concepts, schema designs, and data lakes.