Python Data Engineer - AI-Driven Data Platform

Matlen Silver; Jersey City (NJ); On-site; USD 120,000 - 160,000; Full time

Job summary

Matlen Silver is seeking a Data Engineer to join the Enterprise Finance Technology (ADAPT) team. You will help build and support a modern data platform using Python, Apache Airflow, S3-compatible storage, Apache Iceberg, and Starburst.

You will design, develop, and maintain data ingestion and transformation pipelines, onboard new data sources, establish data connectivity, and create curated datasets for analytics.

Qualifications

• 3–5 years of hands-on Python data engineering experience.
• 2+ years of Airflow DAGs in production.
• Experience designing, developing, and supporting data pipelines and automated workflows.
• Experience with S3-compatible object storage platforms.
• Experience creating, managing, and troubleshooting Apache Iceberg tables.
• Experience integrating data from Oracle, SQL Server, and Hive.
• Proficiency with Linux/Unix and shell scripting.
• Experience with Git and collaborative software development practices.
• Understanding of data lakehouse concepts, SQL, and database design.
• Understanding of Agile software development methodologies.
• Excellent written and verbal communication skills.
• Bachelor's degree in a STEM field.

Responsibilities

• Design, develop, and maintain data ingestion and transformation pipelines.
• Build and maintain Apache Airflow DAGs.
• Onboard new data sources and establish data connectivity.
• Create and manage Apache Iceberg tables and curated datasets.
• Develop automated data workflows to replace manual processes.
• Promote data quality, reliability, and operational efficiency.

Skills

Python development

Airflow

Linux/Unix shell

Git/source control

SQL and DB design

Agile methodologies

Analytical problem-solving

Communication skills

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, Information Systems, or related STEM

Tools

Starburst

Trino

Presto

Jenkins

GitHub Actions

Ansible

Hadoop/HDFS

Job description

Matlen Silver is seeking a Data Engineer to join the Enterprise Finance Technology (ADAPT) team. You will help build and support a modern data platform using Python, Apache Airflow, S3-compatible storage, Apache Iceberg, and Starburst.

You will design, develop, and maintain data ingestion and transformation pipelines, onboard new data sources, establish data connectivity, and create curated datasets for analytics.