Data Engineer — Cloud Data Pipelines

InTalent Asia; United States; Presencial; USD 4500 - 7200; Jornada completa

Descripción de la vacante

InTalent Asia is seeking an Engineer – Data Engineering to design, develop, and maintain scalable data solutions in a cloud-based environment. The role focuses on building data pipelines, integrating source systems, and processing large data volumes within an Agile/DevOps framework.

The ideal candidate has a Bachelor's degree in CS/IT and 1–2 years of hands-on experience with Python, SQL, and Shell scripting, plus practical exposure to Google Cloud Platform services such as BigQuery, Dataflow,

Formación

• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or equivalent.
• 1–2 years of experience building enterprise-grade data-processing applications.
• Strong programming in Python, Shell scripting, and SQL.
• Hands-on experience processing large data volumes.
• Experience designing and developing ETL/ELT pipelines.
• Experience with relational and NoSQL databases and distributed storage engines.
• Hands-on experience with Google Cloud Platform (GCP).
• Experience with BigQuery, Dataflow, Dataproc, Datastream, Pub/Sub, Cloud Functions, Cloud Run, Cloud Composer.

Responsabilidades

• Design and develop scalable data-processing solutions.
• Build data applications supporting large-scale business requirements.
• Develop ETL/ELT pipelines connecting multiple source systems.
• Process, transform, and validate large data volumes.
• Develop data solutions on Google Cloud Platform.
• Build data pipelines using Airflow/Cloud Composer.
• Work with BigQuery, Dataflow, Dataproc, Datastream, Pub/Sub, Cloud Functions, Cloud Run.
• Collaborate with cross-functional teams in Agile/DevOps environments.
• Participate in code reviews and CI/CD practices.
• Maintain technical documentation and data mappings.

Conocimientos

Python

SQL

Shell scripting

Analytical skills

Communication skills

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Airflow

Cloud Composer

BigQuery

Dataflow

Dataproc

Pub/Sub

Cloud Functions

Cloud Run

GitHub

GitLab

Jenkins

Datadog

Kafka

Descripción del empleo

InTalent Asia is seeking an Engineer – Data Engineering to design, develop, and maintain scalable data solutions in a cloud-based environment. The role focuses on building data pipelines, integrating source systems, and processing large data volumes within an Agile/DevOps framework.

The ideal candidate has a Bachelor's degree in CS/IT and 1–2 years of hands-on experience with Python, SQL, and Shell scripting, plus practical exposure to Google Cloud Platform services such as BigQuery, Dataflow,