Jr. Data Architect/Engineer

SBT Global, Inc.; Plano (TX); Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

SBT Global, Inc. in Plano, TX is seeking a mid-level Data Platform Engineer to build a new greenfield data platform using a Medallion Architecture.

You will own end-to-end data pipelines from ingestion to Bronze/Silver/Gold layers and migrate Alteryx workflows to code-based dbt and Python. The role includes developing an MCP server to support AI-driven analytics, configuring Iceberg tables, Airflow DAGs, and OpenMetadata for governance, delivering a scalable, governed data foundation for faster

Formación

• 3+ years of hands-on data engineering experience in production environments.
• Advanced SQL skills, including window functions, CTEs, and query tuning.
• Hands-on dbt experience, including model design, incremental strategies, macros, and tests.
• Python proficiency for data processing and automation, including libraries such as pandas.
• Experience with at least one analytical engine: Trino/Presto, Apache Spark, or DuckDB.
• Experience with at least one lakehouse table format: Iceberg, Delta Lake, or Hudi.
• Experience with Medallion Architecture and star schema/dimensional modeling.
• Experience integrating relational sources (SQL Server, Oracle) using CDC or batch processing.

Responsabilidades

• Ingest data from sources such as SQL Server (BOSS) and Oracle into the Bronze layer with CDC-based ingestion.
• Develop dbt models for the Silver layer including cleansing, standardization, deduplication, and data quality tests.
• Develop Gold layer data marts and migrate Alteryx transformation logic to SQL/dbt.
• Configure Iceberg tables and a REST Catalog, including schema evolution and time travel support.
• Develop and operate Airflow DAGs, managing dependencies, scheduling, and failure notifications.
• Develop an MCP server enabling AI agents to query Gold-layer data marts and access catalog/metadata.
• Manage metadata and data lineage using OpenMetadata.

Conocimientos

SQL

Python

dbt

Airflow

OpenMetadata

Herramientas

Trino/Presto

Apache Spark

DuckDB

Apache Iceberg

Delta Lake

Apache Hudi

LangChain

LangGraph

OpenMetadata

DataHub

Airbyte

Fivetran

Iceberg REST Catalog

Descripción del empleo

We are seeking a mid-level Data Platform Engineer to build a new greenfield data platform integrating internal systems (GSCM, SEASI, SMART, and BOSS) using a Medallion Architecture.

This role owns the end-to-end data pipeline—from ingestion through Bronze/Silver/Gold transformation—while migrating existing Alteryx workflows to code-based dbt and Python implementations.

The engineer will also develop an MCP server enabling AI agents to query business-specific data marts, directly supporting the organization's AI-driven analytics initiatives.

Success in this role will deliver a scalable, governed data foundation that accelerates business insights and AI adoption.

Job Description

Ingest data from sources such as Microsoft SQL Server (BOSS) and Oracle into the Bronze layer, implementing CDC-based incremental ingestion

Develop dbt models for the Silver layer including cleansing, standardization, deduplication, and data quality testing

Develop Gold layer business-specific data marts and migrate existing Alteryx transformation logic

Configure Apache Iceberg tables and a REST Catalog, including schema evolution and time travel support

Develop and operate Apache Airflow DAGs, managing dependencies, scheduling, and failure notifications

Develop an MCP server enabling AI agents to query Gold-layer data marts, including catalog/metadata access, ontology integration, and query execution

Manage metadata and data lineage using OpenMetadata

Automate Excel reporting using Python and openpyxl

Qualifications

3+ years of hands-on data engineering experience in production environments

Advanced SQL skills, including window functions, CTEs, and query tuning

Hands-on dbt experience, including model design, incremental strategies, macros, and tests

Python proficiency for data processing and automation, including libraries such as pandas

Experience with at least one analytical engine: Trino/Presto, Apache Spark, or DuckDB

Experience with at least one lakehouse table format: Apache Iceberg, Delta Lake, or Apache Hudi

Experience with Medallion Architecture and star schema/dimensional modeling

Experience integrating relational database sources, such as Microsoft SQL Server and Oracle, using CDC or batch processing

Required Technical Skills

SQL

dbt

Python

Trino/Presto or Apache Spark or DuckDB

Apache Iceberg or Delta Lake or Apache Hudi

Microsoft SQL Server

Oracle

MinIO (S3-compatible storage)

Preferred Qualifications

Experience with EL tools such as Airbyte or Fivetran, and Iceberg REST Catalog implementations such as Apache Polaris

Experience with governance tools such as OpenMetadata or DataHub, and semantic layers such as Cube.dev

Ability to interpret Alteryx workflows (.yxmd) and migrate their logic to SQL/dbt

Experience developing MCP servers or building LLM, RAG, or AI agent pipelines

Experience developing applications, APIs, or backend services using Java and/or Python

Experience building Generative AI (GenAI) applications, including LLM integration, retrieval-augmented generation (RAG), and AI agent workflows

Hands-on experience with LangChain and/or LangGraph for developing tool-enabled AI agents and orchestrating multi-step workflows

Understanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analytics

Understanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analytics

Preferred Technical Skills

Java or Python

Generative AI (GenAI) and LLM integration

LangChain

LangGraph

RAG and AI agent pipelines

Airbyte

Fivetran

OpenMetadata

DataHub

Cube.dev

Alteryx

Additional Information

All your information will be kept confidential according to EEO guidelines.