Senior Data Engineer: Lakehouse & Data Platform Lead

datafuelX Inc.; New York (NY); In loco; USD 120.000 - 160.000; Tempo pieno

Descrizione del lavoro

Valid8 Financial, Inc. is seeking a Senior Data Engineer to innovate and enhance our data platform, primarily focusing on scalable data architectures to drive media monetization. The role involves designing data pipelines, collaborating with various teams, and ensuring data quality in a fast-paced environment.

Ideal candidates will possess over 5 years of data engineering experience, along with strong skills in SQL, Python, and modern cloud platforms such as GCP and AWS. A background in the media industry is preferred.

Competenze

• 5+ years of experience in building scalable data engineering platforms.
• Strong experience in modern data pipelines and architectures.
• Advanced skills in SQL, Python, and PySpark.

Mansioni

• Design and maintain scalable data pipelines for media monetization.
• Ingest and transform high-volume media data from multiple sources.
• Collaborate with teams to support ML and enable self-service insights.

Conoscenze

Data engineering

SQL

Python

PySpark

Cloud platforms (GCP & AWS)

ETL/ELT processes

Data quality assurance

Agile methodologies

Formazione

Bachelor's degree in Computer Science or related field

Strumenti

Airflow

Dagster

Data Lake

Data Warehouse

Tableau

Metabase

Descrizione del lavoro

Valid8 Financial, Inc. is seeking a Senior Data Engineer to innovate and enhance our data platform, primarily focusing on scalable data architectures to drive media monetization. The role involves designing data pipelines, collaborating with various teams, and ensuring data quality in a fast-paced environment.

Ideal candidates will possess over 5 years of data engineering experience, along with strong skills in SQL, Python, and modern cloud platforms such as GCP and AWS. A background in the media industry is preferred.