Saas Bi Support & Analytics Engineer

Payo Argentina; Ciudad de Mendoza; Sur place; ARS 1 800 000 - 3 000 000; Plein temps

Résumé du poste

Payo Argentina is seeking a data engineer to design and optimize end-to-end data pipelines in Python, leveraging Medallion architecture to transform raw data into analytics-ready assets. The role focuses on robust ETL, standardized storage with Parquet, Iceberg, and Delta Lake, and embedded analytics with DuckDB.

Responsibilities include building scalable pipelines, managing PostgreSQL schemas, and enabling distributed processing with Databricks/PySpark across multi-cloud environments.

Qualifications

• Advanced SQL proficiency with deep PostgreSQL expertise and working knowledge of SQLite.
• Hands-on experience building robust analytical pipelines using Python and DuckDB.
• Mastery of open table and storage formats (Parquet, Apache Iceberg, Delta Lake).
• Proven track record designing data lakes using the Medallion data processing architecture.
• Familiarity with the Databricks / PySpark ecosystem for distributed processing.

Responsabilités

• Pipeline Design: Construct resilient data processing pipelines in Python using Medallion architecture principles (Bronze/Silver/Gold).
• Open Storage Management: Standardize data storage using open formats for cross-cloud compatibility.
• Embedded Analytics: Leverage DuckDB integrated with Python for fast localized data processing within ETL workflows.
• Database Operations: Architect and optimize production PostgreSQL schemas and SQLite for embedded storage needs.
• Distributed Compute: Scale heavy ETL and analytics workloads using Databricks or Apache Spark.

Connaissances

Advanced SQL

PostgreSQL expertise

Python

DuckDB

Outils

Databricks

PySpark

Apache Spark

Delta Lake

Parquet

Iceberg

Description du poste

The Role:

Builds performant data processing pipelines, manages relational databases, and constructs cloud-portable data lake environments using modern open storage formats and embedded analytical engines.

Responsibilities:

• Pipeline Design: Construct resilient data processing pipelines in Python using Medallion architecture principles (Bronze/Silver/Gold) to transform raw data into analytics-ready assets.
• Open Storage Management: Standardize data storage using open formats including Parquet, Apache Iceberg, and Delta Lake to ensure cross-cloud compatibility.
• Embedded Analytics: Leverage DuckDB integrated with Python for fast, lightweight, and performant localized data processing within ETL workflows.
• Database Operations: Architect and optimize production PostgreSQL schemas while utilizing SQLite for embedded or lightweight localized storage needs.
• Distributed Compute: Scale heavy ETL, data transformation, and analytics workloads using Databricks or Apache Spark.

Requirements:

• Advanced SQL proficiency with deep PostgreSQL expertise and working knowledge of SQLite.
• Hands-on experience building robust analytical pipelines using Python and DuckDB.
• Mastery of open table and storage formats (Parquet, Apache Iceberg, Delta Lake).
• Proven track record designing data lakes using the Medallion data processing architecture.
• Familiarity with the Databricks / PySpark ecosystem for distributed processing.