Remote Data Engineer (Mexico): Lakehouse Pipelines

Pyramid Consulting, Inc; Mexico; On-site; PHP 3,317,000 - 4,792,000; Full time

Job summary

Pyramid Consulting, Inc. is seeking a Data Engineer to design, build, and maintain scalable cloud-native data pipelines and infrastructure.

You will work with analytics, BI, and data science teams to deliver reliable data solutions using modern cloud, big data, and API-driven technologies. The role requires strong SQL, Python and Spark skills, and hands-on experience with Azure Databricks, Delta Lake, and API development.

Qualifications

• Strong SQL proficiency with relational databases.
• Proficient in Python, PySpark, Java or Scala.
• Experience with Azure cloud services and Databricks Lakehouse.
• Knowledge of real-time data ingestion and streaming tech such as Kafka or Event Hubs.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines for batch and real-time processing.
• Develop and optimize data models, Delta Tables, and Lakehouse architectures.
• Create RESTful APIs and data services for seamless data exchange.
• Implement real-time ingestion frameworks and streaming architectures.
• Ensure data quality, governance, security, and compliance across platforms.

Skills

Analytical thinking

Python programming

APIs & microservices

Education

Bachelor's degree in Computer Science or similar

Tools

Azure Cloud

Databricks

Delta Lake

Delta Tables

Spark

OpenShift

Kubernetes

Docker

Airflow

Azure Data Factory

Event Hubs

Synapse Analytics

Job description

Pyramid Consulting, Inc. is seeking a Data Engineer to design, build, and maintain scalable cloud-native data pipelines and infrastructure.

You will work with analytics, BI, and data science teams to deliver reliable data solutions using modern cloud, big data, and API-driven technologies. The role requires strong SQL, Python and Spark skills, and hands-on experience with Azure Databricks, Delta Lake, and API development.