Senior Data Engineer: Global ERP & AI/BI Pipelines

Agentic Dream Inc.; Colombia; Remote; COP 120.000.000 - 190.000.000; Vollzeit

Zusammenfassung

Agentic Dream Inc. in Colombia is seeking a Senior Data Engineer to design scalable data architectures across ERP ecosystems and enable AI/BI solutions.

You will build end-to-end pipelines, implement bronze–silver–gold layers, and collaborate with data architecture leadership to ensure enterprise-grade data platforms. You will work with SQL, Python, Spark/Databricks, and cloud tools (ADF, Data Lake, Synapse) to ingest, clean, and model data for dashboards and AI/ML use cases.

Qualifikationen

• 7+ years of experience in enterprise-scale data engineering.
• Strong SQL and Python for data processing.
• Experience with Spark/Databricks and cloud data platforms.

Aufgaben

• Design, build, and maintain scalable ETL/ELT pipelines from ERP sources to Data Lakes/warehouses.
• Develop connectors for structured and semi-structured data using APIs and middleware.
• Implement bronze/silver/gold layers for ingestion, cleaning, and curated datasets.
• Organize data structures for BI and AI systems.
• Align units of measure across products and regions.
• Execute deduplication, enrichment, and harmonization across systems.
• Collaborate with Data Architecture leadership on schemas and partitioning.
• Set up sandbox/staging environments for testing.
• Provide clean datasets to support BI dashboards and AI/ML use cases.
• Document pipeline architectures and data transformation logic.
• Ensure data governance and support metadata management.

Kenntnisse

SQL (Advanced)

Python for data processing

Spark or Databricks

Azure Data Lake / Synapse

ETL orchestration (ADF/Airflow/dbt)

API integrations

ERP data ingestion

Master data / data modeling

Data governance

Fluent English

Tools

dbt

Airflow

Azure Data Factory

Databricks

Jobbeschreibung

Agentic Dream Inc. in Colombia is seeking a Senior Data Engineer to design scalable data architectures across ERP ecosystems and enable AI/BI solutions.

You will build end-to-end pipelines, implement bronze–silver–gold layers, and collaborate with data architecture leadership to ensure enterprise-grade data platforms. You will work with SQL, Python, Spark/Databricks, and cloud tools (ADF, Data Lake, Synapse) to ingest, clean, and model data for dashboards and AI/ML use cases.