Data Engineer

The AES Group; San Francisco (CA); On-site; USD 130,000 - 170,000; Full time

Job summary

The AES Group in the Bay Area, CA is seeking a Data Engineer to join our team on a high-impact, long-term project. You will build, optimize, and maintain robust data pipelines that process massive volumes of web and advertising traffic, ensuring scalable infrastructure.

Collaborate with data scientists and product teams to deliver clean, structured data environments, leveraging Python/Java, SQL, and modern big data tools in AWS or GCP.

Qualifications

• Proficiency in Python or Java/Scala and SQL.
• Hands-on experience with Spark, Hadoop, Hive, or Kafka.
• Experience with public cloud platforms (AWS or GCP).
• Strong understanding of data warehousing concepts and data modeling.

Responsibilities

• Data Pipelines: Design, scale, and maintain reliable ETL/ELT data pipelines.
• Stream & Batch Processing: Process large-scale real-time and batch datasets.
• Storage Architecture: Optimize data warehouse storage, partitioning, and query performance.
• Collaboration: Work with Data Scientists and Product teams to deliver clean data environments.

Skills

Python

Java/Scala

SQL

Apache Spark

Hadoop

Hive

Kafka

AWS

GCP

Data warehousing

Job description

Role: Data Engineer
Location: Bay Area, CA

Why Join Us?

• Work with a leading technology organization in the digital and data-driven industry.
• Gain hands-on experience building and optimizing modern data solutions.
• Collaborate with experienced engineers, analysts, and cross-functional teams.
• Work on high-impact data engineering initiatives in a fast-paced environment.
• Opportunity to strengthen your skills across data pipelines, cloud technologies, and analytics.

About the Role

The AES Group INC looking for a skilled Data Engineer to join our team for a high-impact, long-term project spanning over a year. In this role, you will build, optimize, and maintain robust data pipelines that process massive volumes of web and advertising traffic. If you love handling large-scale data systems and building infrastructure that scales, we want to talk to you!

Key Responsibilities

• Data Pipelines: Design, scale, and maintain reliable ETL/ELT data pipelines.
• Stream & Batch Processing: Process large-scale real-time and batch streaming datasets.
• Storage Architecture: Optimize data warehouse storage, partitioning, and query performance.
• Collaboration: Partner with Data Scientists and Product teams to deliver clean, structured data environments.

What We Are Looking For

• Core Tech: Strong programming skills in Python or Java/Scala, alongside advanced SQL expertise.
• Big Data Infrastructure: Deep, hands-on experience with tools like Apache Spark, Hadoop, Hive, or Kafka.
• Cloud Architecture: Proficiency with public cloud platforms (such as AWS or GCP).
• Data Modeling: Solid understanding of data warehousing concepts, schema designs, and data lakes.