Medallion Data Platform Engineer - AI-Ready Analytics

MindSource; Plano (TX); Presencial; USD 63.000 - 89.000; Jornada completa

Descripción de la vacante

MindSource is seeking a mid-level Data Platform Engineer in Plano, TX to build a new greenfield data platform integrating several internal systems using Medallion Architecture. You will own the end-to-end data pipeline—from ingestion through Bronze/Silver/Gold transformations—while migrating Alteryx workflows to dbt and Python implementations.

The role includes developing an MCP server for AI-driven data access and leveraging OpenMetadata for data lineage, with a 12-month contract and pay rate

Formación

• 3+ years of hands-on data engineering in production.
• Advanced SQL skills with window functions, CTEs, and tuning.
• Hands-on dbt experience: models, increments, macros, tests.
• Python for data processing, including pandas.
• Experience with Trino/Presto, Spark, or DuckDB.
• Experience with Iceberg, Delta Lake, or Hudi.
• Knowledge of Medallion Architecture and star schema.
• CDC or batch data ingestion from SQL Server and Oracle.

Responsabilidades

• Ingest data from sources like SQL Server and Oracle into Bronze with CDC-based ingestion.
• Develop dbt models for Silver: cleanse, standardize, deduplicate, test data quality.
• Create Gold layer data marts and migrate Alteryx logic to SQL/dbt.
• Configure Iceberg tables and REST Catalog with schema evolution and time travel.
• Develop and operate Airflow DAGs, manage dependencies and scheduling.
• Develop MCP server to support AI agents for querying Gold data marts.
• Manage metadata and data lineage using OpenMetadata.
• Automate Excel reporting using Python and openpyxl.

Conocimientos

SQL

dbt

Python

Trino/Presto or Apache Spark or DuckDB

Iceberg or Delta Lake or Hudi

Microsoft SQL Server

Oracle

MinIO (S3-compatible storage)

Descripción del empleo

MindSource is seeking a mid-level Data Platform Engineer in Plano, TX to build a new greenfield data platform integrating several internal systems using Medallion Architecture. You will own the end-to-end data pipeline—from ingestion through Bronze/Silver/Gold transformations—while migrating Alteryx workflows to dbt and Python implementations.

The role includes developing an MCP server for AI-driven data access and leveraging OpenMetadata for data lineage, with a 12-month contract and pay rate