ETL Developer

Merkleinnovation

Asia

On-site

PEN 60,000 - 90,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Merkleinnovation is seeking a skilled ETL Development Engineer with hands-on experience building high-throughput data pipelines using PySpark. You will design, develop, and optimize scalable data warehouse models and Spark-based ETL workflows, collaborating with cross-functional teams to ensure data availability and reliable delivery.

The role emphasizes performance tuning of Spark jobs, DAG orchestration with Airflow, and adherence to coding standards, documentation, and testing.

Qualifications

  • 3+ years PySpark offline ETL development experience.
  • Strong Spark Core/SQL tuning and Airflow orchestration.
  • Data warehouse modeling with dimensional modeling experience.
  • Familiarity with cloud environment workflows and Telco data processing.
  • Independent delivery with strong coding standards.
  • Experience migrating from legacy ETL systems (Ab Initio) to PySpark.
  • Data mapping and large-scale migrations in Telco/Banking sectors.

Responsibilities

  • ETL Pipeline Development: design, build, and maintain high-throughput offline batch ETL pipelines using Spark.
  • Performance Tuning: optimize Spark jobs, memory, and query execution for performance and cost efficiency.
  • Data Warehouse Modeling: architect scalable dimensional models for analytical workflows.
  • Pipeline Orchestration: manage DAG workflows using Airflow with monitoring and alerts.
  • Code Quality & Best Practices: ensure clean code, documentation, reviews, and unit testing.
  • Migration & Modernization: participate in or lead ETL re-engineering and platform migrations.
  • Cross-functional Collaboration: read docs and communicate with international teams in English.

Skills

PySpark
ETL development
Performance tuning
Data warehouse modeling
Pipeline orchestration
Code quality
Migration & modernization
Cross-functional collaboration
English communication

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Spark
Airflow

Job description

We are looking for a skilled and self-motivated ETL Development Engineer with strong hands-on experience in high-throughput data pipelines and offline batch processing. In this role, you will design, develop, and optimize scalable data warehouse models and Spark-based ETL workflows. You will work closely with cross-functional teams to ensure high data availability, seamless task orchestration, and reliable data architecture delivery.

Responsibilities
  • ETL Pipeline Development: Design, build, and maintain high-throughput offline batch ETL pipelines utilizing Apache Spark (Core/SQL).
  • Performance Tuning: Troubleshoot, benchmark, and optimize Spark jobs, memory allocation, and query execution for high performance and cost efficiency.
  • Data Warehouse Modeling: Architect and implement scalable data warehouse dimensional models (Kimball/Inmon methodologies, ODS/DWH/ADS layering) supporting analytical workflows.
  • Data Warehouse Modeling: Architect and implement scalable data warehouse dimensional models (Kimball/Inmon methodologies, ODS/DWH/ADS layering) supporting analytical workflows.
  • Pipeline Orchestration: Manage DAG workflows, incremental processing, failure retry logic, and real-time monitoring/alerting using orchestration platforms such as Apache Airflow.
  • Code Quality & Best Practices: Maintain high software engineering standards through clean code writing, robust documentation, code reviews, and automated unit testing.
  • Migration & Modernization: Assist in or lead large-scale ETL re-engineering, platform migrations, and optimization initiatives across legacy and modern data stacks.
  • Cross-functional Collaboration: Read technical documentation, communicate seamlessly with international tech teams in English, and deliver features independently from requirements to production.
Requirements
  • Bachelor's degree or above in a computer-related major
  • Experience: 3+ years in PySpark offline ETL development
  • Technical Skills: Spark Core/SQL tuning, Airflow orchestration, and data warehouse modeling.
  • Domain & Infra: Experience or familiarity with cloud environment workflows and telco data processing challenges.
  • Delivery: Strong coding standards and proven independent delivery capability.
  • Language: Working proficiency in English (technical documentation, written, and spoken).
  • Preferred: Prior experience in large-scale ETL migration or reengineering in telco/cloud environments.
  • Proven hands-on experience in executing end-to-end data and logic-level migrations from legacy ETL systems (specifically Ab Initio) to modern frameworks using PySpark
  • Strong background in complex data mapping, table design, and script rewriting, preferably within large-scale Data Migration projects in the Telecommunications or Banking sectors
Let's Build Something Meaningful Together

Helping businesses transform ideas into impactful digital solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Developer (Legacy ETL Expert)
ETL Developer (Legacy ETL Expert)

Merkleinnovation • Asia

On-site
PEN 204,000 - 306,000
Remote Data Engineer: Azure Synapse ETL Mastery
Remote Data Engineer: Azure Synapse ETL Mastery

Bluelight Consulting LLC • Lima Metropolitana

Remote
PEN 120,731 - 206,968
Competitive salary and performance bonuses
Generous paid-time-off policy
Flexible working hours
+2
Remote Data Engineer: Azure Synapse ETL Mastery
Remote Data Engineer: Azure Synapse ETL Mastery

Bluelight Consulting LLC • Piura

Remote
PEN 103,484 - 206,968
Competitive salary and bonuses
Generous paid-time-off policy
Flexible working hours
+1
Remote Data Engineer - Azure Synapse & ETL
Remote Data Engineer - Azure Synapse & ETL

Bluelight Consulting LLC • Chimbote

Remote
PEN 103,519 - 241,546
Competitive salary and bonuses
Generous paid time off
Flexible working hours
+2
Remote Azure Data Engineer: ETL & Synapse Expert
Remote Azure Data Engineer: ETL & Synapse Expert

Bluelight Consulting LLC • Chiclayo

Remote
PEN 102,915 - 171,526
Collaborative work environment
Career growth opportunities
Remote Data Engineer - Azure Synapse & ETL
Remote Data Engineer - Azure Synapse & ETL

Bluelight Consulting LLC • Tacna

Hybrid
PEN 103,519 - 172,533
Competitive salary and bonuses
Generous paid-time-off policy
Flexible working hours
+2
Azure Data Engineer - Remote, Latin America
Azure Data Engineer - Remote, Latin America

Bluelight Consulting LLC • Iquitos

Hybrid
PEN 204,918 - 273,224
Competitive salary and bonuses
Generous paid-time-off policy
Flexible working hours
+2
Data Engineer, Azure - Remote, Latin America
Data Engineer, Azure - Remote, Latin America

Bluelight LLC • Piura

Remote
PEN 103,484 - 206,968
Competitive salary and bonuses
Generous paid-time-off policy
Flexible working hours
+1
Data Engineer, Azure - Remote, Latin America
Data Engineer, Azure - Remote, Latin America

Bluelight LLC • Lima Metropolitana

Remote
PEN 120,731 - 206,968
Competitive salary and performance bonuses
Generous paid-time-off policy
Flexible working hours
+2
Azure Data Engineer - Remote, Latin America
Azure Data Engineer - Remote, Latin America

Bluelight Consulting LLC • Huancayo

Hybrid
PEN 204,918 - 273,224
Competitive salary
Generous paid-time-off policy
Flexible working hours
+2