Lead Data Platform Architect — Big Data & Cloud

Experian Group; Northern (KY); Hybrid; USD 140,000 - 200,000; Full time

Job summary

Experian seeks an experienced Data Architect to define end-to-end architecture for large-scale data platforms and distributed systems. You will develop automated data pipelines using Spark and Trino, and collaborate with Product, Engineering, Security, Cloud, and Architecture teams to modernize workflows.

You will mentor architects and engineers, lead architecture reviews, and establish governance, security, and observability practices while communicating strategy and risk to senior leadership.

Qualifications

• Bachelor's in Computer Science, Data Engineering, or related field, or equivalent experience (Master's preferred).
• 8+ years of experience in software engineering, data engineering, or technology architecture.
• 5+ years of hands-on experience with Big Data technologies and large-scale distributed data processing.
• Experience designing and building automated, custom data pipelines using Apache Spark, Trino, or similar frameworks.
• Experience architecting enterprise-scale data platforms and distributed systems.
• Experience designing solutions in cloud environments and with expertise in Python, Java, Scala, or SQL.
• Experience with data lakes, data warehouses, object storage, and distributed query engines.
• Reside in, or near the designated Collaboration Hub(s) for this role.

Responsibilities

• Define end-to-end architecture for large-scale data platforms and distributed systems
• Develop automated, custom data pipelines using Apache Spark, Trino, or similar Big Data technologies
• Establish architecture best practices for data ingestion, transformation, storage, and usage
• Improve performance, scalability, resiliency, and cost efficiency across data platforms
• Partner with Product, Engineering, Security, Cloud, and Architecture teams to modernize legacy workflows and translate our needs into technical solutions
• Lead architecture reviews, resolve cross-team technical decisions, and define practices for data governance, security, and observability
• Mentor architects and engineers, and communicate technical strategy and risk to senior leadership

Skills

Big Data technologies

Apache Spark

Trino

Python

Java

Scala

SQL

Distributed data processing

Education

Bachelor's in Computer Science, Data Engineering, or related field

Tools

Apache Spark

Trino

SQL

Job description

Experian seeks an experienced Data Architect to define end-to-end architecture for large-scale data platforms and distributed systems. You will develop automated data pipelines using Spark and Trino, and collaborate with Product, Engineering, Security, Cloud, and Architecture teams to modernize workflows.

You will mentor architects and engineers, lead architecture reviews, and establish governance, security, and observability practices while communicating strategy and risk to senior leadership.