Databrick Architect

EXL; Radnor (Delaware County); On-site; USD 102,800 - 168,900; Full time

Job summary

EXL is seeking a Risk Data Engineer and Architect to lead cloud-native data solutions using AWS and Databricks. This role requires strong experience in data engineering with a focus on building scalable data pipelines and implementing data governance frameworks.

The ideal candidate has 5+ years in data engineering, proficiency in SQL, Python, and AWS services, and experience managing relational databases. The position offers a salary range of $102.8k to $168.9k dependent on skills and experience.

Qualifications

• 5+ years of experience in data engineering or similar role.
• Production experience with relational databases including complex queries and data integrity.
• Strong experience with end-to-end data architecture and AWS services.

Responsibilities

• Architect cloud-native data solutions using AWS and Databricks.
• Build and optimize data pipelines using Python, PySpark, and SQL.
• Implement data governance frameworks and monitor production systems.

Skills

Data engineering

Cloud data solutions

Python

SQL

AWS services

Databricks

Education

Bachelor’s degree in Computer Science or related field

Tools

MySQL

Aurora PostgreSQL

Redshift

Job description

As a Risk Data Engineer and Architect, you will architect and lead the design and implementation of new technology solutions for the Risk Investments and Technology team within the Chief Risk Office (CRO). You will own technical roadmaps, champion SDLC best practices, and build production grade systems that power analytics, machine learning, and cross-functional risk management.

Working on a centralized cloud data platform (AWS, Databricks or Dataiku), you'll design scalable data pipelines, implement data governance frameworks using modern cataloging tools, and develop advanced solutions. This role is critical to modernizing how we manage market risk, credit risk, and operational risk data on the enterprise scale. Significant Databricks experience is required.

You’ll partner closely with risk analysts, quantitative researchers, and technology leaders to migrate business-owned processes into robust, production-controlled platforms while maintaining operational excellence.

What you’ll be doing

• Architect cloud-native data solutions using AWS services (S3, Redshift, Glue, EMR, Lambda, Athena) and Databricks (Unity Catalog, Workflows, MLflow) or similar technology to support risk analytics at scale.
• Build and optimize data pipelines using Python, PySpark, and SQL to integrate structured and unstructured data from internal and external sources.
• Drive modernization initiatives by migrating legacy on-premises systems to cloud platforms while ensuring zero disruption to critical business services.
• Implement data governance frameworks including cataloging, lineage tracking, quality monitoring, and access controls aligned with internal controls and regulatory requirements.
• Collaborate cross-functionally with data scientists, risk managers, and business stakeholders to translate requirements into scalable technical solutions, drive change management and process improvements.
• Develop production-grade code following DevOps practices including CI/CD, automated testing, code reviews, and infrastructure-as-code.
• Manage and optimize relational databases (MySQL, Aurora PostgreSQL, Redshift) for performance, cost efficiency, and data integrity.
• Integrate structured and unstructured data from various internal and external sources.
• Mentor and influence technical standards and architectural decisions across the Risk, Investments Technology organization.
• Monitor and troubleshoot production systems, implementing observability practices and proactive performance tuning.

What we’re looking for

• Bachelor’s degree in Computer Science, Information Systems, Engineering or related field.
• 5+ years of experience in data engineering or similar role implementing with a variety of on-premises and cloud data management, integration, and analytical technologies.
• Production experience with relational databases such as MySQL, and SQL Server, including designing schemas, writing complex queries, optimizing performance, and ensuring data integrity for a variety of business applications.
• Strong experience with end-to-end data architecture implementing systems that use AWS services related to data storage and management, must have advanced proficiency in SQL, Python, YAML and Bash.
• Thorough understanding of the Software Development Life Cycle (SDLC), including DevOps practices, CI/CD processes, application resiliency, and security measures.
• Excellent communication skills with ability to translate technical concepts for business audiences.
• Data governance experience: catalog tools, data quality frameworks, lineage tracking, and compliance controls is a plus.
• AWS certifications such as SAA, Associate Developer, Data Analytics Specialty, or Databricks certification is a plus.

Salary – $102.8k to 168.9k

The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits