Senior Data Engineer | Remote LATAM Only

Agentic Dream Inc.; Colombia; Remote; COP 120,000,000 - 190,000,000; Full time

Job summary

Agentic Dream Inc. in Colombia is seeking a Senior Data Engineer to design scalable data architectures across ERP ecosystems and enable AI/BI solutions.

You will build end-to-end pipelines, implement bronze–silver–gold layers, and collaborate with data architecture leadership to ensure enterprise-grade data platforms. You will work with SQL, Python, Spark/Databricks, and cloud tools (ADF, Data Lake, Synapse) to ingest, clean, and model data for dashboards and AI/ML use cases.

Qualifications

• 7+ years of experience in enterprise-scale data engineering.
• Strong SQL and Python for data processing.
• Experience with Spark/Databricks and cloud data platforms.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines from ERP sources to Data Lakes/warehouses.
• Develop connectors for structured and semi-structured data using APIs and middleware.
• Implement bronze/silver/gold layers for ingestion, cleaning, and curated datasets.
• Organize data structures for BI and AI systems.
• Align units of measure across products and regions.
• Execute deduplication, enrichment, and harmonization across systems.
• Collaborate with Data Architecture leadership on schemas and partitioning.
• Set up sandbox/staging environments for testing.
• Provide clean datasets to support BI dashboards and AI/ML use cases.
• Document pipeline architectures and data transformation logic.
• Ensure data governance and support metadata management.

Skills

SQL (Advanced)

Python for data processing

Spark or Databricks

Azure Data Lake / Synapse

ETL orchestration (ADF/Airflow/dbt)

API integrations

ERP data ingestion

Master data / data modeling

Data governance

Fluent English

Tools

dbt

Airflow

Azure Data Factory

Databricks

Job description

We are looking for highly experienced Senior Data Engineers to help deliver a robust and scalable data architecture across global ERP systems. This role is ideal for someone passionate about building end-to-end pipelines, enabling AI/BI solutions, and thriving in fast-paced, high-stakes environments. You will contribute to the acceleration of global data transformation initiatives, ensuring modern, enterprise-ready data ecosystems.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines from diverse ERP sources into centralized Data Lakes and Warehouses.
• Develop connectors for structured and semi-structured data using Python, SQL, APIs, or middleware solutions.
• Implement bronze, silver, and gold layers for ingestion, cleaning, and curated datasets.
• Organize data structures for optimized use in BI and AI systems.
• Align global units of measure (lbs, kg, packaging, linear feet) across products and regions.
• Execute data deduplication, enrichment, and harmonization from disparate systems.
• Collaborate closely with Data Architecture leadership on schema definitions, partitioning strategies, and infrastructure design.
• Set up and maintain sandbox/staging environments for safe testing.
• Provide ready-to-use, clean datasets to support BI dashboards and AI/ML use cases.
• Document pipeline architectures, data transformation logic, and integration points.
• Ensure adherence to data governance policies and support metadata management.

Requirements

Technical Requirements

• 7+ years of experience in enterprise-scale data engineering.
• Strong proficiency in:
  • SQL (Advanced) and Python for data processing
  • Spark or Databricks for distributed data workflows
  • Cloud platforms such as Azure Data Lake/Blob, Synapse, or equivalents
  • ETL orchestration tools like Azure Data Factory (ADF), Airflow, or dbt
  • API integrations and data ingestion from ERP systems (NetSuite, QuickBooks, Salesforce, RF Smart, etc.)
• Demonstrated experience with:
  • Master data frameworks, unit conversion, and ERP-to-warehouse mapping
  • Handling structured and unstructured data
  • Data modeling best practices (star schema, snowflake schema)

Soft Skills & Work Commitment

• Fluent English (C1 level) – required for daily client calls and clear technical documentation.
• Strong interpersonal and collaboration skills to work with cross-functional teams (BI, QA, DevOps, Business Analysts).

Nice to Have

• Experience standardizing data across global manufacturing or supply chain environments.
• Familiarity with Power BI datasets, alert triggers, and integration with messaging/email tools.
• Exposure to AI/ML pipelines, including data preparation for machine learning or anomaly detection.

Originally posted on Himalayas