AI-Native Data Engineer — Hybrid & Cloud Data Pipelines

Palo IT; Palo Amarillo; Hybrid; MXN 700,000 - 1,000,000; Full time

Job summary

PALO IT is seeking a Data Engineer in CDMX to design and implement scalable data solutions for a leading insurance company. You will build resilient data pipelines in cloud environments and enable underwriting, risk management, fraud prevention, and customer experience.

Join a global AI-native consultancy with a collaborative culture, growth opportunities through PALO IT Academy, and projects across multiple industries.

Qualifications

• Experience with modern data processing frameworks: Spark, Databricks, dbt, Kafka, Apache Beam.
• Strong command of Python and SQL.
• Hands-on experience with Azure cloud platforms (Data Factory, Synapse).
• Knowledge of modern Data Lake / Data Warehouse design (Snowflake, Redshift, BigQuery).
• Familiarity with DataOps, testing, and CI/CD practices in data pipelines.
• Experience with workflow orchestration systems such as Airflow or Dagster.
• Understanding of data quality and governance frameworks: Great Expectations, Deequ, DataHub, OpenLineage.
• Knowledge of streaming technologies: Kafka, Pub/Sub, Kinesis.
• Upper-intermediate English level (B2 or higher) for global collaboration.

Responsibilities

• Designing, building, and maintaining scalable data pipelines in cloud environments.
• Integrating large volumes of structured and unstructured data from source systems.
• Automating data ingestion, transformation, and quality processes.
• Building and maintaining data lakes and warehouses (Snowflake, Redshift, BigQuery).
• Implementing data quality, lineage, and governance validations.
• Ensuring compliance with data regulations and internal security policies.
• Designing datasets to enable machine learning models and dashboards.
• Collaborating with data scientists, architects, and business stakeholders to democratize data access.
• Documenting data architectures, pipelines, transformation standards, and lineage.

Skills

Python

SQL

English (B2+)

Tools

Spark

Databricks

dbt

Kafka

Apache Beam

Airflow

Dagster

Azure Data Factory

Synapse

Snowflake

BigQuery

Redshift

Power BI

Looker

Tableau

Job description

PALO IT is seeking a Data Engineer in CDMX to design and implement scalable data solutions for a leading insurance company. You will build resilient data pipelines in cloud environments and enable underwriting, risk management, fraud prevention, and customer experience.

Join a global AI-native consultancy with a collaborative culture, growth opportunities through PALO IT Academy, and projects across multiple industries.