Senior PySpark Data Engineer - GCP & Data Pipelines

Apex Systems; Mexico; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

Apex Systems is seeking a data/software engineer with 0.5+ years of experience in data engineering or software engineering. The role requires strong experience with Python, Apache Spark (PySpark, Spark SQL, Spark Streaming), relational and NoSQL databases, and GCP tools like BigQuery and Dataproc.

Familiarity with RESTful APIs in data pipelines and CI/CD (GitLab CI) is valued. A Bachelor’s degree is required.

Skills

Python

PySpark

Spark SQL

Spark Streaming

RESTful APIs

CI/CD

GitLab CI

Data modeling

Distributed systems

Data pipelines

Relational databases

NoSQL databases

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience

Tools

BigQuery

Dataproc

Job description

Apex Systems is seeking a data/software engineer with 0.5+ years of experience in data engineering or software engineering. The role requires strong experience with Python, Apache Spark (PySpark, Spark SQL, Spark Streaming), relational and NoSQL databases, and GCP tools like BigQuery and Dataproc.

Familiarity with RESTful APIs in data pipelines and CI/CD (GitLab CI) is valued. A Bachelor’s degree is required.