Software Engineer- Apache spark

Hitachi, Ltd.; Región Centro; Presencial; MXN 1.004.000 - 1.562.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Exciting Projects

Collaborative Environment

Work-Life Balance

Professional Development

Excellent Benefits

Descripción de la vacante

GlobalLogic is seeking a skilled Data Engineer to join our team in Mexico. You will develop and maintain tools to upgrade Apache Spark versions, build robust data validation pipelines, and write clean, scalable code for data processing utilities.

You will explore AI models to aid migrations, work with large-scale data systems, and collaborate with a global team to ensure data parity, performance, and quality across projects.

Formación

• Experience: 4–8 years in professional software development.
• Strong proficiency in Java and/or Python.
• Hands-on experience with Apache Spark and Hadoop ecosystem.
• Exposure to AI tools, methodologies, and LLMs, esp. Gemini models/APIs.
• Proven experience in testing, debugging, and maintaining batch or streaming data pipelines.
• Nice to have: Cloud environments like Google Cloud Platform / Dataproc.
• Familiarity with unit testing frameworks and CI/CD pipelines for data engineering.
• Experience with automated data diffing or validation tools.

Responsabilidades

• Develop and maintain automated tools and scripts to facilitate and accelerate Spark version upgrades.
• Design and execute data validation pipelines and data quality checks post-upgrade to ensure parity, integrity, and performance.
• Write clean, scalable, maintainable code for data processing or toolchain utilities.
• Explore and integrate AI models and methodologies to assist in code assessment, error detection, or translation tasks during migrations.

Conocimientos

Java

Python

Apache Spark

Hadoop ecosystem

Google Gemini

Data pipelines testing

GCP / Dataproc

Unit testing frameworks

CI/CD pipelines

Automated data validation

Herramientas

CI/CD tools

Descripción del empleo

Job Description

N/A

Requirements

• Experience: 4–8 years of professional software development experience
• Core Languages: Strong proficiency in Java and/or Python.
• Big Data Frameworks: Hands‑on experience or solid familiarity with Apache Spark and the Hadoop ecosystem.
• Artificial Intelligence: Practical exposure to AI tools, methodologies, and Large Language Models (LLMs), with specific familiarity or exposure to
• Google's Gemini models/APIs.
• Proven experience in testing, debugging, and maintaining batch or streaming data pipelines.
• Preferred Skills (Nice to Have)- Experience working on Cloud environments (e.g., Google Cloud Platform, Dataproc).
• Familiarity with unit testing frameworks and CI/CD pipelines for data engineering.- Experience with automated data diffing or validation tools.

Job Responsibilities

• Develop and maintain automated tools and scripts to facilitate and accelerate Apache Spark version upgrades.
• Design and execute comprehensive data validation pipelines and data quality checks post-upgrade to ensure data parity, integrity, and performance.
• Write clean, scalable, and maintainable code for data processing or toolchain utilities.
• Explore and integrate AI models and methodologies to assist in code assessment, error detection, or translation tasks during migrations.

What we offer

Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to work on market-defining products using the latest technologies.

Collaborative Environment:Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!

Work-Life Balance:GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules.We offer you the best quality of work life so that you exceed the expectations of our clients, while achieving your professional and personal ambitions.

Professional Development:Our dedicated Learning & Development team regularly organizes English classes, professional certifications, and technical and soft skill trainings. We also offer the chance to travel internationally

Excellent Benefits:We provide our employees with competitive salaries, family medical insurance, extended paternity leave, annual performance bonuses, and referral bonuses.

About GlobalLogic

GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next‑generation products and digital experiences. We expertly integrate design, complex engineering, and agile delivery capabilities to deliver superior business outcomes for global brands in telecom, automotive, healthcare, technology, media and entertainment, manufacturing, and semiconductor industries.

Headquartered in Silicon Valley, GlobalLogic employs over 25,000 designers and engineers across the globe. Analysts like NASSCOM and Zinnov have recognized us for being a top company in our field, and we are consistently nominated as a preferred employer by both global HR consultative firms and local job boards. By creating a work environment that is exciting and flexible, and by fostering growth through ongoing learning and development programs, we empower our employees to achieve both their professional and personal goals.

At GlobalLogic, we make amazing products — and careers.