Shell Scripting/Python Developer

Infosys Limited; Toluca; Híbrido; MXN 1,117,000 - 1,491,000; Jornada completa

Descripción de la vacante

A global technology firm in Toluca is seeking a Shell Scripting/Python Developer Technology Lead to design and develop ETL processes, build data pipelines on Google Cloud Platform, and automate workflows. The ideal candidate will have extensive experience in data manipulation, SQL, and task automation in Linux/Unix environments. A passion for problem-solving and attention to detail are essential. This position offers a hybrid work model with three days in the office each week.

Formación

• Knowledge of Google Cloud Platform (GCP), especially with data services like BigQuery and Dataflow.
• Proficiency in Python for data manipulation and script development.
• Strong skills in Shell Scripting for task automation in Linux/Unix environments.
• Extensive experience working with SQL and NoSQL databases.
• Solid understanding of data modeling and data warehousing principles.

Responsabilidades

• Design and develop robust and scalable ETL processes.
• Build and maintain data pipelines on Google Cloud Platform (GCP).
• Automate workflows using Shell Scripting and Python.
• Write and optimize complex SQL queries.
• Monitor, debug, and troubleshoot data pipelines.

Conocimientos

Google Cloud Platform (GCP)

Python

Shell Scripting

SQL

Data modeling

Problem-solving

Educación

Relevant degree or certification

Herramientas

PostgreSQL

MySQL

Apache Airflow

Docker

Kubernetes

Descripción del empleo

Shell Scripting/Python Developer Technology Lead

Technology|ETL & Data Quality|ETL - Others, Technology|Open System|Shell scripting, Technology|OpenSystem|Python - OpenSystem

Domain

Delivery

Interest Group

Infy Mexico

Company

Requisition ID

137151BR

Job Description: ETL, python and shell scripting

Key Responsibilities:

Design and develop robust and scalable ETL processes to move and transform large volumes of data from various sources.

Build and maintain data pipelines on Google Cloud Platform (GCP) using services such as Dataflow, Cloud Functions, BigQuery, and Cloud Storage.

Automate workflows and processes using Shell Scripting and Python.

Write and optimize complex SQL queries for data manipulation and analysis in relational (e.g., PostgreSQL, MySQL) and NoSQL databases.

Monitor, debug, and troubleshoot data pipelines to ensure their proper functioning and performance.

Document implemented processes, architectures, and data flows.

Skills and Qualifications

Required:

Knowledge of Google Cloud Platform (GCP), especially with data services like BigQuery and Dataflow.

Proficiency in Python for data manipulation and script development (knowledge of libraries like Pandas, Apache Beam is a plus).

Strong skills in Shell Scripting for task automation in Linux/Unix environments.

Extensive experience working with SQL (e.g., PostgreSQL, SQL Server, MySQL) and NoSQL databases. Ability to write complex and optimized queries.

Solid understanding of data modeling and data warehousing principles.

Excellent problem-solving skills and attention to detail.

Preferred:

Google Cloud certification (e.g., Professional Data Engineer).

Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.

Knowledge of Agile methodologies (Scrum/Kanban).

Familiarity with container technologies like Docker and Kubernetes.

Ability to communicate effectively in English (oral and written).

Job description

Job Description: ETL, python and shell scripting

Key Responsibilities:

• Design and develop robust and scalable ETL processes to move and transform large volumes of data from various sources.

• Build and maintain data pipelines on Google Cloud Platform (GCP) using services such as Dataflow, Cloud Functions, BigQuery, and Cloud Storage.

• Automate workflows and processes using Shell Scripting and Python.

• Write and optimize complex SQL queries for data manipulation and analysis in relational (e.g., PostgreSQL, MySQL) and NoSQL databases.

• Monitor, debug, and troubleshoot data pipelines to ensure their proper functioning and performance.

• Document implemented processes, architectures, and data flows.

Skills and Qualifications

Required:

• Proven experience in ETL development and/or data engineering.

• Knowledge of Google Cloud Platform (GCP), especially with data services like BigQuery and Dataflow.

• Proficiency in Python for data manipulation and script development (knowledge of libraries like Pandas, Apache Beam is a plus).

• Strong skills in Shell Scripting for task automation in Linux/Unix environments.

• Extensive experience working with SQL (e.g., PostgreSQL, SQL Server, MySQL) and NoSQL databases. Ability to write complex and optimized queries.

• Solid understanding of data modeling and data warehousing principles.

• Excellent problem-solving skills and attention to detail.

Preferred:

• Google Cloud certification (e.g., Professional Data Engineer).

• Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.

• Knowledge of Agile methodologies (Scrum/Kanban).

• Familiarity with container technologies like Docker and Kubernetes.

• Ability to communicate effectively in English (oral and written).

Location: Toluca
hybrid scheme 3 days per week
Green credit bureau report

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability. Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.