Senior Data Engineer - Remote, AI-Driven BI & Pipelines Lead

Idt; Bogotá ciudad; Remoto; COP 373.680.000 - 560.521.000; Tempo pieno

Vantaggi offerti da questo lavoro

Remote work opportunity

Company-supported English classes

Long-term growth potential

Learning and conference support

Descrizione del lavoro

IDT Corporation is seeking a Senior Data Engineer from LATAM to join our BI team and take an active role in designing, building, and maintaining the end-to-end data pipeline, architecture and design that powers our warehouse, LLM-driven applications, and AI-based BI. IDT Corporation is a global communications company with a strong history in innovation.

This role offers a remote work opportunity and exposure to cutting-edge data engineering, MLOps, and LLM operations across multiple data

Competenze

• Design scalable data pipelines for ingestion, transformation and delivery.
• Experience with SQL/PLSQL and data warehousing concepts.
• Familiarity with Python for data engineering tasks.
• Knowledge of big data tech such as Spark, Kafka, Hadoop.

Mansioni

• Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services.
• Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns.
• Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights.
• Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces.
• Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
• Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions.
• Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines.
• Should be willing to stay informed and learn emerging methodologies in data engineering, MLOps and LLM operations.

Descrizione del lavoro

IDT Corporation is seeking a Senior Data Engineer from LATAM to join our BI team and take an active role in designing, building, and maintaining the end-to-end data pipeline, architecture and design that powers our warehouse, LLM-driven applications, and AI-based BI. IDT Corporation is a global communications company with a strong history in innovation.

This role offers a remote work opportunity and exposure to cutting-edge data engineering, MLOps, and LLM operations across multiple data