Junior Data Platform Engineer for AI-Driven Data Lake

Ledgent Technology; Plano (TX); On-site; USD 74,000 - 81,000; Full time

Job summary

Roth Staffing is seeking a mid-level Data Platform Engineer to design a greenfield data platform in Plano, TX. You will own end-to-end data pipelines—from ingestion to Bronze/Silver/Gold layers—using dbt, Python, and Apache Airflow.

The role includes building an MCP server and OpenMetadata data lineage integration to support AI-driven analytics initiatives. You will migrate Alteryx workflows to code-based dbt and Python implementations while ensuring scalable, governed data foundations for

Qualifications

• 3+ years of hands-on data engineering in production
• Advanced SQL with window functions, CTEs, and tuning
• Hands-on dbt experience including models, incremental strategies, macros, tests
• Python proficiency for data processing with pandas
• Experience developing Apache Airflow DAGs
• Experience with Trino/Presto, Apache Spark, or DuckDB
• Experience with lakehouse formats: Iceberg, Delta Lake, or Hudi
• Experience with Medallion Architecture and star schemas
• Experience integrating Microsoft SQL Server and Oracle using CDC or batch processing

Responsibilities

• Ingest data from SQL Server and Oracle into Bronze with CDC-based ingestion
• Develop dbt models for Silver with cleansing and quality tests
• Create Gold layer data marts and migrate Alteryx logic
• Configure Iceberg tables and REST Catalog with schema evolution and time travel
• Develop and operate Airflow DAGs for dependencies and scheduling
• Build MCP server for AI agents to query Gold-layer marts
• Manage metadata and data lineage using OpenMetadata
• Automate Excel reporting using Python and openpyxl

Skills

Advanced SQL

Python programming

dbt

Pandas

Airflow

Data modeling

Tools

Trino/Presto

Apache Spark

DuckDB

Apache Iceberg

Delta Lake

Apache Hudi

Kubernetes

MinIO

Microsoft SQL Server

Oracle

Job description

Roth Staffing is seeking a mid-level Data Platform Engineer to design a greenfield data platform in Plano, TX. You will own end-to-end data pipelines—from ingestion to Bronze/Silver/Gold layers—using dbt, Python, and Apache Airflow.

The role includes building an MCP server and OpenMetadata data lineage integration to support AI-driven analytics initiatives. You will migrate Alteryx workflows to code-based dbt and Python implementations while ensuring scalable, governed data foundations for