Senior Data Engineer — AI-Powered Pipelines & Spark Expert

Apex Systems; México; Presencial; MXN 800.000 - 1.100.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Vacation bonus

Christmas bonus

Private medical insurance

Life insurance

Pantry Vouchers

Home office bonus

Transportation bonus

More than 12 vacation days per year

Descripción de la vacante

Everforth Apex Systems Mexico is seeking experienced Senior Data Engineers to join a high-impact data platform team responsible for building and maintaining enterprise-scale data infrastructure.

The role focuses on batch and real-time data pipelines, with collaboration across Product Managers, Architects, source data teams, and business stakeholders to deliver reliable data solutions. AI-assisted development is a key aspect of the work environment.

Formación

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, or equivalent professional experience.
• 5+ years of experience in Data Engineering or related roles.
• Strong experience with Scala or Java development.
• Strong hands-on experience with Apache Spark.
• Experience designing and maintaining batch and real-time/streaming data pipelines.
• Experience working with Hive and/or Apache Iceberg data storage technologies.
• Experience using AI-assisted development tools such as Claude, GitHub Copilot, Cursor, or similar platforms.
• Strong prompt engineering experience for software development use cases.
• Experience debugging, reviewing, and validating generated code.
• Familiarity with Agile delivery methodologies and Jira.
• Excellent verbal and written communication skills.
• Proven ability to work cross-functionally with technical and non-technical stakeholders.
• English proficiency level C1 or higher is a requirement.

Responsabilidades

• Design, build, and maintain scalable batch and streaming data pipelines.
• Develop and optimize data processing solutions using Scala or Java and Apache Spark.
• Implement data transformations, validations, and integrations across multiple data sources.
• Support data ingestion, enrichment, and delivery into enterprise data stores.
• Utilize AI-powered coding tools to accelerate development and testing activities.
• Create effective prompts to generate pipeline code and supporting components.
• Review, validate, debug, and improve AI-generated code.
• Collaborate on AI-assisted unit testing and deployment processes.
• Work with Hive and/or Iceberg-based data storage solutions.
• Participate in discussions regarding data modeling, table design, and data architecture decisions.
• Partner with Product Managers to refine requirements and understand business needs.
• Collaborate with source data teams, architects, and downstream data consumers.
• Communicate technical solutions, dependencies, and project status effectively.
• Participate in roadmap initiatives and cross-functional planning activities.
• Investigate and resolve data pipeline failures and operational issues.
• Support in-hours production incidents and data refresh requests.
• Coordinate with impacted stakeholders and communicate resolution plans and timelines.

Conocimientos

Cross-functional collaboration

English proficiency

Communication skills

Educación

Bachelor's degree in Computer Science/Software Engineering/Information Systems

Herramientas

Scala

Java

Apache Spark

Hive

Apache Iceberg

Claude

GitHub Copilot

Cursor

Descripción del empleo

Everforth Apex Systems Mexico is seeking experienced Senior Data Engineers to join a high-impact data platform team responsible for building and maintaining enterprise-scale data infrastructure.

The role focuses on batch and real-time data pipelines, with collaboration across Product Managers, Architects, source data teams, and business stakeholders to deliver reliable data solutions. AI-assisted development is a key aspect of the work environment.