Python/S3 Storage Developer (Plano, JC, CLT)

The Matlen Silver Group, Inc.

Plano (TX)

On-site

USD 90,000 - 140,000

Full time

31 hours ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

The Matlen Silver Group, Inc. is seeking a Data Engineer in Plano, TX to design, develop, and maintain data ingestion and transformation pipelines using Python, Airflow, and Iceberg. You will build scalable data products and collaborate with distributed teams to enable enterprise analytics and reporting.

Ideal candidates have solid experience with S3-compatible storage, SQL, and data lakehouse concepts, plus strong problem-solving and communication skills in an Agile setting.

Qualifications

  • 3-5 years of hands-on experience developing data engineering solutions using Python.
  • 2+ years of experience developing and supporting Apache Airflow DAGs in production environments.
  • Experience designing, developing, and supporting data pipelines and automated workflow solutions.
  • Experience working with S3-compatible object storage platforms or cloud object storage technologies.
  • Experience creating, managing, and troubleshooting Apache Iceberg tables or similar modern table formats.
  • Experience connecting to and integrating data from Oracle, SQL Server, Hive, Teradata, PostgreSQL, or similar enterprise platforms.
  • Proficiency working in Linux/Unix environments, including shell scripting.
  • Experience with source control systems such as Git and collaborative software development practices.
  • Understanding of data lakehouse and modern data platform concepts.
  • Working knowledge of SQL and database design concepts.
  • Understanding of Agile software development methodology.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent written and verbal communication skills.

Responsibilities

  • Design, develop, and maintain data ingestion and transformation pipelines to create governed, scalable data products.
  • Build Airflow DAGs, onboard new data sources, and manage Iceberg tables for enterprise analytics.
  • Collaborate with platform engineering teams, application owners, and business stakeholders in an Agile environment.

Skills

Python
Airflow
S3 storage
Iceberg
SQL
Git
Linux/Unix
Agile
Communication

Education

Bachelor's degree in STEM

Tools

Starburst/Trino/Presto
Jenkins
GitHub Actions
Bitbucket Pipelines
Ansible
Kubernetes

Job description

Location Plano, United States Sector Banking

While resources should know how to leverage AI for efficiency, they should not need AI to demonstrate technical knowledge and skills during interview. Please screen accordingly prior to submission.

Role Overview

Enterprise Finance Technology's AI, Data & Platform Services Technology (ADAPT) Team is seeking a motivated Data Engineer to help develop and support a modern enterprise data platform built on Python, Apache Airflow, S3-compatible object storage, Apache Iceberg, and Starburst.

In this role, the candidate will design, develop, and maintain data ingestion and transformation pipelines that create governed, scalable, and reusable data products. The engineer will build Airflow DAGs, onboard new data sources, establish and maintain data connectivity, and create and manage Iceberg tables that make curated datasets available for enterprise analytics and reporting.

The successful candidate will contribute to strategic modernization initiatives by replacing manual processes with automated data workflows while promoting data quality, reliability, and operational efficiency. The role requires close collaboration with platform engineering teams, application owners, and business stakeholders in an Agile environment.

The candidate will function as both an individual contributor and an active member of a globally distributed team.

Requirements
  • 3-5 years of hands-on experience developing data engineering solutions using Python.
  • 2+ years of experience developing and supporting Apache Airflow DAGs in production environments.
  • Experience designing, developing, and supporting data pipelines and automated workflow solutions.
  • Experience working with S3-compatible object storage platforms or cloud object storage technologies.
  • Experience creating, managing, and troubleshooting Apache Iceberg tables or similar modern table formats.
  • Experience connecting to and integrating data from Oracle, SQL Server, Hive, Teradata, PostgreSQL, or similar enterprise platforms.
  • Proficiency working in Linux/Unix environments, including shell scripting.
  • Experience with source control systems such as Git and collaborative software development practices.
  • Understanding of data lakehouse and modern data platform concepts.
  • Working knowledge of SQL and database design concepts.
  • Understanding of Agile software development methodology.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Excellent written and verbal communication skills.
  • Bachelor's degree in Computer Science, Engineering, Mathematics, Information Systems, or related STEM discipline.
Preferred Skills and Experience
  • Experience with Starburst, Trino, or Presto.
  • Familiarity with Hadoop ecosystem technologies including Hive and HDFS.
  • Experience with CI/CD pipelines and automation tools such as Jenkins, GitHub Actions, Bitbucket Pipelines, or Ansible.
  • Experience implementing data quality, monitoring, and observability solutions.
  • Knowledge of data governance, metadata management, and data lineage concepts.
  • Experience supporting large-scale analytical data platforms.
  • Exposure to container-based platforms such as Kubernetes or OpenShift.
  • Understanding of enterprise security controls, authentication mechanisms, encryption standards, and access management practices.
  • Exposure to reporting, analytics, AI, or machine learning data platforms.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Python Engineer
Python Engineer

Matlen Silver • Jersey City (NJ)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Compunnel, Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Data Engineer - Python, SQL, AWS
Data Engineer - Python, SQL, AWS

Compunnel, Inc. • Durham (NC)

On-site
USD 95,000 - 120,000
Data & Software Engineer
Data & Software Engineer

Avalore • Chantilly (VA)

On-site
USD 120,000 - 180,000
Health insurance
401k
Life Insurance
+3
Sr Data Engineer
Sr Data Engineer

TechTriad • New York (NY)

On-site
USD 110,000 - 140,000
Data & Software Engineer
Data & Software Engineer

Avalore.ai • Chantilly (VA)

On-site
USD 130,000 - 180,000
Health care benefits
Retirement plan (401k)
Life Insurance
+4
Senior Data Engineer
Senior Data Engineer

SDL Search Partners • Boston (MA)

On-site
USD 130,000 - 185,000
Competitive compensation
Senior Data Engineer
Senior Data Engineer

The Phoenix Group • New York (NY)

On-site
USD 120,000 - 170,000
Senior Data Engineer
Senior Data Engineer

ConsultNet Technology Services and Solutions • United States

On-site
USD 120,000 - 180,000
Java Data Engineer with AI
Java Data Engineer with AI

Surge Technology Solutions Inc • Chicago (IL)

On-site
USD 120,000 - 160,000