Data Platform Engineer: Medallion Data & AI Pipelines

SBT Global, Inc.; Plano (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

SBT Global, Inc. in Plano, TX is seeking a mid-level Data Platform Engineer to build a new greenfield data platform using a Medallion Architecture.

You will own end-to-end data pipelines from ingestion to Bronze/Silver/Gold layers and migrate Alteryx workflows to code-based dbt and Python. The role includes developing an MCP server to support AI-driven analytics, configuring Iceberg tables, Airflow DAGs, and OpenMetadata for governance, delivering a scalable, governed data foundation for faster

Qualifications

• 3+ years of hands-on data engineering experience in production environments.
• Advanced SQL skills, including window functions, CTEs, and query tuning.
• Hands-on dbt experience, including model design, incremental strategies, macros, and tests.
• Python proficiency for data processing and automation, including libraries such as pandas.
• Experience with at least one analytical engine: Trino/Presto, Apache Spark, or DuckDB.
• Experience with at least one lakehouse table format: Iceberg, Delta Lake, or Hudi.
• Experience with Medallion Architecture and star schema/dimensional modeling.
• Experience integrating relational sources (SQL Server, Oracle) using CDC or batch processing.

Responsibilities

• Ingest data from sources such as SQL Server (BOSS) and Oracle into the Bronze layer with CDC-based ingestion.
• Develop dbt models for the Silver layer including cleansing, standardization, deduplication, and data quality tests.
• Develop Gold layer data marts and migrate Alteryx transformation logic to SQL/dbt.
• Configure Iceberg tables and a REST Catalog, including schema evolution and time travel support.
• Develop and operate Airflow DAGs, managing dependencies, scheduling, and failure notifications.
• Develop an MCP server enabling AI agents to query Gold-layer data marts and access catalog/metadata.
• Manage metadata and data lineage using OpenMetadata.

Skills

SQL

Python

dbt

Airflow

OpenMetadata

Tools

Trino/Presto

Apache Spark

DuckDB

Apache Iceberg

Delta Lake

Apache Hudi

LangChain

LangGraph

OpenMetadata

DataHub

Airbyte

Fivetran

Iceberg REST Catalog

Job description

SBT Global, Inc. in Plano, TX is seeking a mid-level Data Platform Engineer to build a new greenfield data platform using a Medallion Architecture.

You will own end-to-end data pipelines from ingestion to Bronze/Silver/Gold layers and migrate Alteryx workflows to code-based dbt and Python. The role includes developing an MCP server to support AI-driven analytics, configuring Iceberg tables, Airflow DAGs, and OpenMetadata for governance, delivering a scalable, governed data foundation for faster