Senior Data Platform Engineer - Snowflake & Spark

Apptad Inc; Georgia; Presencial; USD 120 000 - 180 000; Tempo integral

Resumo da oferta

Apptad Inc is seeking a Data Engineer for Data & Intelligence focusing on T-Mobile Finance RDMP. The role centers on building enterprise-scale ELT/ETL pipelines for billing, revenue, GL, and opex, leveraging Snowflake and Databricks to process large finance data assets.

You will define ingestion patterns (CDC, watermarking), orchestrate pipelines with Airflow/Azure Data Factory, and drive scalable cloud infrastructure (Azure/AWS) with IaC practices.

Qualificações

• Experience architecting enterprise-scale ELT/ETL pipelines for finance and revenue data.
• Define and enforce standards for batch, incremental, and streaming ingestion patterns.
• Provide technical leadership for multi-source, high-volume data integration pipelines.
• Strong knowledge of Snowflake and Databricks platforms for large-scale data processing.

Responsabilidades

• Lead architecture for Snowflake and Databricks platforms, and establish DAG standards in Airflow/Azure Data Factory.
• Define best practices for Snowpipe, streams, tasks, and PySpark optimization.
• Oversee data quality, observability, and governance across pipelines.
• Architect real-time and near real-time data processing using Kafka/Event Hub and Spark Structured Streaming.
• Drive cost optimization for cloud data platforms and ensure secure, production-ready deployments.

Conhecimentos

ELT/ETL development

SQL

Python

PySpark

Data modeling

Ferramentas

Snowflake

Databricks

dbt

Airflow

Azure Data Factory

Terraform

Bicep

Descrição da oferta de emprego

Apptad Inc is seeking a Data Engineer for Data & Intelligence focusing on T-Mobile Finance RDMP. The role centers on building enterprise-scale ELT/ETL pipelines for billing, revenue, GL, and opex, leveraging Snowflake and Databricks to process large finance data assets.

You will define ingestion patterns (CDC, watermarking), orchestrate pipelines with Airflow/Azure Data Factory, and drive scalable cloud infrastructure (Azure/AWS) with IaC practices.