Remote Data Engineer Specialist - Cloud Data Platforms

Metropolitan Transportation Authority (MTA); New York (NY); Hybrid; USD 114,000 - 135,000; Full time

Job summary

The Metropolitan Transportation Authority is seeking a Specialist Data Engineer to design, deploy, and maintain data solutions across on‑prem and cloud environments. You will collaborate with data analysts, data scientists and business users to build pipelines that meet organizational needs and drive data intelligence capabilities.

Responsibilities include developing scalable ELT/ETL processes, building data catalogs, and implementing security and data quality controls, with opportunities for

Qualifications

• Bachelor’s Degree in Arts/Sciences (BA/BS) or equivalent experience.
• Minimum 3 years of relevant experience.
• Microsoft Certified: Azure Data Engineer Associate preferred.
• Microsoft Certified: Azure Data Fundamentals preferred.

Responsibilities

• Design, develop, and implement data solutions to meet business requirements and data ingestion needs.
• ELT/ETL data from various sources including on-premises and cloud systems.
• Write secure, well designed code adhering to standards.
• Monitor and troubleshoot data pipelines to minimize disruptions.
• Implement data quality checks and validation processes.
• Write complex queries and scripts to manipulate and transform data.
• Create and maintain data catalog and lineage, plus CI/CD processes for data platforms.
• Stay updated with Azure cloud trends to improve data capabilities.
• Mentor less experienced staff.

Skills

Big Data architectures

Lakehouse architecture

Azure Databricks

Azure Synapse

Power BI

Data Factory

Terraform

Ansible

Python

PySpark

SQL

Airflow

CI/CD

DevOps

Jira

Confluence

Data Modeling

ETL/ELT

Education

Bachelor’s Degree (BA/BS)

Tools

Terraform

Ansible

Jira

Confluence

Azure Databricks

Azure Synapse Analytics

Power BI

Job description

The Metropolitan Transportation Authority is seeking a Specialist Data Engineer to design, deploy, and maintain data solutions across on‑prem and cloud environments. You will collaborate with data analysts, data scientists and business users to build pipelines that meet organizational needs and drive data intelligence capabilities.

Responsibilities include developing scalable ELT/ETL processes, building data catalogs, and implementing security and data quality controls, with opportunities for