Data Engineer

Tata Consultancy Services; Ciudad de México; Hybrid; MXN 900,000 - 1,300,000; Full time

Benefits offered by this job

Direct contract

Legal benefits above standard

Job summary

Tata Consultancy Services in Mexico City is seeking a seasoned Data Engineer to design, develop, and maintain scalable data pipelines for Enterprise Credit Risk initiatives. You will work with Databricks, Spark, PySpark, Hadoop, SQL and Python, building batch and real-time solutions and mentoring juniors.

Hybrid role requiring presence at the Mexico City office (Av. Reforma) two days per week, with collaboration across Risk, Product, Data Science, and Engineering teams to deliver robust data

Qualifications

• Hands-on experience with Databricks, Spark, PySpark, Hadoop, SQL and Python.
• Experience building and maintaining enterprise-scale data engineering solutions.
• Cloud-based data platforms and storage technologies experience.
• Knowledge of CI/CD pipelines and Git workflows.

Responsibilities

• Design, develop, test, and maintain scalable data pipelines and data products supporting Enterprise Credit Risk initiatives.
• Build and optimize batch and real-time data processing solutions using modern cloud and lakehouse technologies.
• Partner with Risk, Product, Data Science, and Engineering teams to translate requirements into technical solutions.
• Develop reusable frameworks, components, and engineering patterns to improve efficiency and consistency.
• Implement data quality controls, monitoring, and observability for data reliability and trustworthiness.
• Support migration of assets into Databricks and cloud-native platforms.
• Build and maintain curated datasets for lending decisioning and risk analytics.
• Participate in architecture discussions and provide technical recommendations for platform enhancements.
• Troubleshoot production issues and drive root cause analysis to improve reliability and performance.
• Follow engineering best practices for code quality, testing, deployment automation, security, and operations.
• Mentor junior engineers through code reviews and knowledge sharing.
• Continuously evaluate scalability, performance, cost efficiency, and maintainability of data platforms.

Skills

Databricks

Apache Spark

PySpark

Hadoop

SQL

Python

Data modeling

CI/CD

Airflow

Java

Tools

Airflow

Databricks

Job description

(Candidate must be available to work from Mexico City office [Av. Reforma] office 2 day per week)

Main responsibilities and activities:

• Design, develop, test, and maintain scalable data pipelines and data products supporting Enterprise Credit Risk initiatives.
• Build and optimize batch and real-time data processing solutions using modern cloud and lakehouse technologies.
• Partner with Risk, Product, Data Science, and Engineering teams to understand business requirements and translate them into technical solutions.
• Develop reusable frameworks, components, and engineering patterns that improve development efficiency and platform consistency.
• Implement data quality controls, monitoring, alerting, and observability capabilities to ensure data reliability and trustworthiness.
• Support the migration and modernization of existing data assets and workloads into Databricks and cloud-native platforms.
• Build and maintain curated datasets that support lending decisioning, portfolio risk management, and advanced analytics use cases.
• Participate in architecture discussions and contribute technical recommendations for platform enhancements.
• Troubleshoot production issues and drive root cause analysis to improve platform reliability and performance.
• Follow engineering best practices for code quality, testing, deployment automation, security, and operational excellence.
• Mentor junior engineers through code reviews, technical guidance, and knowledge sharing.
• Continuously evaluate opportunities to improve scalability, performance, cost efficiency, and maintainability of data platforms.
• Advanced English communication
• Strong experience developing and maintaining enterprise-scale data engineering solutions.
• Hands-on experience with Databricks, Apache Spark, PySpark, Hadoop, SQL, and Python.
• Experience building ETL/ELT pipelines and large-scale data processing applications.
• Experience working with cloud-based data platforms and storage technologies.
• Strong understanding of data modeling concepts and analytical data structures.
• Experience implementing automated testing, monitoring, and data quality practices.
• Experience with Data formats ( Parquet, Avro, ORC )
• Knowledge of CI/CD pipelines, Git-based development workflows, and DevOps principles.
• Experience with Workflow orchestration Tools like Airflow
• Strong analytical and problem-solving skills with the ability to work independently on complex technical challenges.
• Knowledge of Java Based application development is a huge Plus.

We are offering:

• Direct contract
• Benefits of law and above

Tata Consultancy Services is an equal opportunity employer, our commitment to diversity & inclusion drives our efforts to provide equal opportunity to all candidates who meet our required knowledge & competency needs, irrespective of any socio-economic background, race, color, national origin, religion, sex, gender identity/expression, age, marital status, disability, sexual orientation or any others. We encourage anyone interested to build a career in TCS to participate in our recruitment & selection process.