Senior Data Platform Architect: Spark Pipelines

Experian Group; United States; À distance; USD 180 000 - 240 000; Plein temps

Résumé du poste

Experian is seeking a Principal Solutions Architect to lead the design of large-scale data platforms. You will partner with engineering, product, security, and business teams to set technical direction and deliver automated pipelines using Spark or Trino.

You will mentor architects, drive governance and observability practices, and influence senior leadership on architecture strategy. This role reports to the Head of Technology and is based in or near collaboration hubs across the U.S.

Qualifications

• Bachelor's in CS, data engineering, or a related field; Master’s preferred.
• 8+ years in software/data engineering or technology architecture.
• 5+ years hands-on with Big Data and large-scale distributed processing.
• Experience designing automated data pipelines using Spark, Trino, or similar frameworks.
• Experience architecting enterprise-scale data platforms and cloud environments.

Responsabilités

• Define end-to-end architecture for large-scale data platforms and distributed systems.
• Develop automated data pipelines using Spark, Trino, or similar technologies.
• Establish best practices for data ingestion, transformation, storage and usage.
• Improve performance, scalability, resiliency and cost efficiency across platforms.
• Partner with Product, Engineering, Security, Cloud and Architecture teams to modernize workflows.
• Lead architecture reviews and define data governance, security, and observability practices.
• Mentor architects and engineers and communicate strategy to senior leadership.

Connaissances

Big Data

Distributed systems

Python

Java/Scala/SQL

Cloud architectures

Data pipelines

Leadership

Formation

Bachelor's degree in Computer Science or related field

Master's degree preferred

Outils

Apache Spark

Trino

Big Data frameworks

Description du poste

Experian is seeking a Principal Solutions Architect to lead the design of large-scale data platforms. You will partner with engineering, product, security, and business teams to set technical direction and deliver automated pipelines using Spark or Trino.

You will mentor architects, drive governance and observability practices, and influence senior leadership on architecture strategy. This role reports to the Head of Technology and is based in or near collaboration hubs across the U.S.