Senior Data Engineer (PySpark / GCP / Kafka)

Apex Systems; Mexico; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

Apex Systems is seeking a data/software engineer with 0.5+ years of experience in data engineering or software engineering. The role requires strong experience with Python, Apache Spark (PySpark, Spark SQL, Spark Streaming), relational and NoSQL databases, and GCP tools like BigQuery and Dataproc.

Familiarity with RESTful APIs in data pipelines and CI/CD (GitLab CI) is valued. A Bachelor’s degree is required.

Skills

Python

PySpark

Spark SQL

Spark Streaming

RESTful APIs

CI/CD

GitLab CI

Data modeling

Distributed systems

Data pipelines

Relational databases

NoSQL databases

Education

Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience

Tools

BigQuery

Dataproc

Job description

• 
  Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience
• .5+ years of experience in data engineering or software engineering
• .Strong experience with
• :Pytho
• nApache Spark (PySpark, Spark SQL, Spark Streaming
• aRelational and NoSQL database
• sExperience with GCP (BigQuery, Dataproc)
• sExperience with RESTful APIs in data pipelines
• Hands-on experience with.
  CI/CD (GitLab CI)
• .Strong understanding of data modeling, distributed systems, and data pipelines