Data Engineer: Python, Airflow & S3 Pipelines

Matlen Silver; Plano (TX); On-site; USD 110,000 - 160,000; Full time

Job summary

Matlen Silver is seeking a Data Engineer to design, build, and maintain an enterprise data platform built with Python, Apache Airflow, Iceberg, and S3-compatible storage. You will develop data ingestion pipelines, onboard new sources, and ensure data quality for analytics and reporting.

The role involves collaborating with platform engineering, application owners, and business stakeholders in an Agile environment, functioning as both an individual contributor and a member of a distributed team

Qualifications

• 3-5 years of hands-on experience developing data engineering solutions using Python.
• 2+ years of experience developing and supporting Apache Airflow DAGs in production environments.
• Experience designing, developing, and supporting data pipelines and automated workflow solutions.
• Experience working with S3-compatible object storage platforms or cloud object storage technologies.
• Experience creating, managing, and troubleshooting Apache Iceberg tables or similar modern table formats.
• Experience connecting to and integrating data from Oracle, SQL Server, Hive, Teradata, PostgreSQL, or similar enterprise platforms.
• Proficiency working in Linux/Unix environments, including shell scripting.
• Experience with source control systems such as Git and collaborative software development practices.
• Understanding of data lakehouse and modern data platform concepts.
• Working knowledge of SQL and database design concepts.
• Understanding of Agile software development methodology.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent written and verbal communication skills.

Responsibilities

• Design, develop, and maintain data ingestion and transformation pipelines.
• Build Airflow DAGs and onboard new data sources.
• Establish and maintain data connectivity and Iceberg tables for analytics.
• Promote data quality, reliability, and operational efficiency through automated workflows.
• Collaborate with platform engineering, application owners, and business stakeholders in an Agile environment.
• Contribute as an individual contributor and as part of a globally distributed team.

Skills

Python

Apache Airflow

SQL

Linux shell

Git

Agile

Data governance

Communication

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, Information Systems, or related STEM

Tools

Apache Iceberg

S3-compatible storage

Starburst/Trino/Presto

Git

Linux

Job description

Matlen Silver is seeking a Data Engineer to design, build, and maintain an enterprise data platform built with Python, Apache Airflow, Iceberg, and S3-compatible storage. You will develop data ingestion pipelines, onboard new sources, and ensure data quality for analytics and reporting.

The role involves collaborating with platform engineering, application owners, and business stakeholders in an Agile environment, functioning as both an individual contributor and a member of a distributed team