Senior Data Engineer

Pyramid Consulting, Inc; México; Presencial; MXN 900.000 - 1.500.000; Jornada completa

Descripción de la vacante

Pyramid Consulting, Inc. is seeking a Software Development Specialist Advisor to lead and oversee a remote team in Mexico, focused on data integration and analytics platforms using Informatica IDMC and AWS services.

The role requires technical leadership across CDI, CMI, CAI, and CDQ, with experience in data governance and operating in regulated environments. The position emphasizes mentorship, delivery governance, and end-to-end data product delivery.

Formación

• Extensive experience leading data integration and analytics platforms.
• Strong background in Informatica IDMC and cloud data integration:** CDI, CMI, CAI, CDQ**.
• Hands-on experience with AWS data services, Redshift, and data governance.

Responsabilidades

• Lead a team of 9 engineers delivering analytics data integrations.
• Oversee ingestion, transformation, and delivery into Redshift and Denodo marketplaces.
• Act as delivery lead applying Informatica best practices, SLAs, staffing and governance.
• Develop data products end-to-end from source discovery to published governed views.
• Maintain and support the integration platform, with incident resolution and change management.
• Define technical standards, patterns, and best practices for the team.
• Guide data pipelines using AWS services (Glue, S3, Step Functions, Athena, Secret Manager).
• Define ETL migration methodologies for modernization projects.

Conocimientos

Technical leadership

Mentoring data engineers

Project estimation

Delivery governance

AWS data services knowledge

Herramientas

Informatica IDMC

AWS Glue

S3

Redshift

Step Functions

Athena

Lake Formation

SageMaker

Denodo

Terraform

CloudFormation

Power BI

Descripción del empleo

Job Title: Software Development Specialist Advisor

Employment Type: Full-Time

Location: Remote in Mexico

ROLE SUMMARY

Technical leadership profile covering the full spectrum of a modern data platform: data engineering with Informatica IDMC and the enablement of analytical and agentic capabilities. Acts as the team’s technical reference, ensures alignment between engineering and governance. Proven experience in financial or highly regulated environments.

REQUIRED TECHNICAL SKILLS

Informatica IDMC · Full Stack

Cloud Data Integration (CDI): mapping and mapping-task design, taskflow orchestration, pushdown optimization, parameterization and reusable assets, hierarchical and complex-file processing, performance tuning, and promotion across Dev/QA/Prod orgs.

Cloud Mass Ingestion (CMI): database, file, application, and streaming ingestion; initial load plus incremental CDC over Oracle, Redshift and SQL; schema-drift handling; and delivery to Amazon S3.

Cloud Application Integration (CAI): process and service-connector design, REST/SOAP API exposure, and event-driven orchestration for near-real-time integration.

Cloud Data Quality (CDQ): profiling, rule specifications, scorecards, and remediation embedded in the ingestion and delivery pipelines.

IDMC administration: Secure Agent sizing and runtime environment groups, connection and asset management, RBAC, license/IPU consumption monitoring, Operational Insights, and upgrade planning.

AI-accelerated development (desirable): use of AI coding assistants to speed up discovery, profiling, and mapping/SQL and pipeline generation, with AI-generated assets reviewed against naming, reusability, and performance standards under code-review and CI/CD guardrails.

Lakehouse and Serving Layer.

Experience in developing Medallion architecture: design and development of Bronze / Silver / Gold layers raw landing, conformed and deduplicated Silver models with data-quality expectations, and Gold Data Products.

Semantic layer for BI consumption: governed semantic models over the Gold layer— star-schema and conformed-dimension modelling, business metric and KPI definitions, and publication of certified datasets to Power BI.

AWS: Glue, S3, Redshift, Step Functions, Athena, Lake Formation, SageMaker, Bedrock.

IaC: Terraform + CloudFormation.

Advanced Data Engineering

Orchestration: AWS Step Functions

Technical Leadership

Definition of reference architectures for enterprise data platforms.

Mentoring of data engineering teams (5+ people).

Technical estimation, proposal review, and management of technical stakeholders.

KEY RESPONSIBILITIES

Lead and organize a team of 9 engineers (data integration developers and IDMC administrators) delivering analytics data integrations with Informatica Cloud Data Integration and Cloud Mass Ingestion, extracting data from heterogeneous source systems and technologies.

Provides seamless ingestion, transformation, and delivery of data from diverse source systems into the Enterprise Data Warehouse in Amazon Redshift and the Data Marketplace in Denodo.

Act as delivery lead covering best practices in Informatica for the data integration scope: service levels, staffing and capacity, delivery governance, reporting, and escalation with the client.

Lead the development and availability of data products end to end — source discovery, ingestion, curated models in Redshift, and publication as governed views and marketplace assets in Denodo for consumer teams.

Own maintenance and support of the integration platform: incident resolution within agreed SLAs (L2/L3), root-cause analysis, problem and change management, monitoring and alerting, and a continuous improvement backlog.

Define technical standards, development patterns, and best practices for the team.

Guide the Development of data pipelines using the following AWS cloud services: AWS Glue, S3, Step Functions, Athena, and Secret Manager, to extract data from different source systems and technologies.

Define and apply methodologies and best practices for ETL migration (workload assessment, lift-and-shift vs. re-engineering strategy, mapping inventory and prioritization, conversion, validation and parallel run, cutover and rollback) in modernization projects.

CERTIFICATIONS

(Desirable) Informatica Cloud Data Governance and Catalog, Professional Certification (ICP).