Data Engineering and Development VP

STATE STREET CORPORATION; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

State Street seeks a Data Engineering Lead to drive design, development and deployment of data solutions across use cases such as document processing, intelligent agents, and automation frameworks.

You will collaborate with cross-functional teams to translate business needs into data-driven workflows, promote security and governance, and build reusable frameworks to scale capabilities enterprise-wide.

Qualifications

• Bachelor’s or advanced degree in Computer Science, Engineering, Mathematics, or a related field.
• Overall 12+ years in IT delivery including 3+ years of hands-on experience in AI/ML and data engineering.
• Strong hands-on expertise in Python, Apache Spark, PySpark, and Databricks for large-scale data processing and AI model development.
• Proven ability to design, deploy, and evaluate machine learning and generative AI models using platforms such as OpenAI, Hugging Face, Azure OpenAI.

Responsibilities

• Lead the design, development, and deployment of solutions across use cases such as document processing, intelligent agents, and automation frameworks.
• Collaborate with cross-functional teams to translate business needs into data-driven workflows using modern orchestration tools.
• Promote responsible practices including security, compliance, and explainability, while ensuring robust deployment.
• Establish reusable frameworks, evaluation pipelines, and scalable components to accelerate adoption and maintain consistency.
• Prioritize initiatives, manage delivery timelines, and align efforts with enterprise goals.

Skills

Data engineering

Oracle database

PL/SQL

Snowflake

Azure cloud

Python

Git/CI-CD

Unix/Linux

AI/ML

OpenAI / LangChain

Education

Bachelor’s degree in Computer Science or related field

Tools

Oracle SQL

AWR/ASH

Azure Data Factory

Databricks

Job description

Who we are looking for

We’re looking for a dynamic and forward-thinking leader who’s passionate about shaping the future of technology at scale. If you thrive at the intersection of innovation and execution, and enjoy turning cutting-edge trends into practical enterprise solutions, this role is for you. As a hands‑on strategist, you’ll guide the development and evaluation of advanced capabilities across diverse business domains, while mentoring teams and influencing stakeholders. The ideal candidate brings a strong blend of technical depth and strategic vision, with a drive to build reusable frameworks, foster responsible practices, and cultivate a culture of experimentation and continuous learning.

Why this role is important to us

Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We’re driving the company’s digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

What you will be responsible for

As Data Engineering Lead you will:

• Lead the design, development, and deployment of solutions across use cases such as document processing, intelligent agents, and automation frameworks
• Collaborate with cross-functional teams to translate business needs into data-driven workflows using modern orchestration tools
• Promote responsible practices including security, compliance, and explainability, while ensuring robust deployment
• Establish reusable frameworks, evaluation pipelines, and scalable components to accelerate adoption and maintain consistency
• Prioritize initiatives, manage delivery timelines, and align efforts with enterprise goals

What we value

• Solid understanding of modern data engineering concepts and emerging technologies
• Strong experience with Oracle Database, including schema design, data modeling, and performance optimization
• Advanced proficiency in PL/SQL development, including stored procedures, packages, triggers, and functions
• Expertise in SQL query tuning and performance optimization, including execution plan analysis and indexing strategies
• Hands‑on experience with Oracle performance diagnostics tools (e.g., AWR, ASH, explain plans)
• Solid understanding of database architecture, data integrity, and transaction management
• Experience with data migration, integration, and ETL processes involving Oracle systems
• Hands‑on experience with Snowflake, including data warehousing, query performance tuning, and data pipeline integration
• Proficiency in Azure cloud services, such as Azure SQL, Azure Data Factory, Azure Storage, or Azure Virtual Machines
• Experience designing and supporting cloud‑based data solutions and hybrid (on‑prem + cloud) architectures
• Familiarity with data security, access control, and governance in cloud environments
• Strong scripting skills (e.g., Shell, Python) for automation and data processing
• Experience with version control systems (Git/Bitbucket) and CI/CD pipelines
• Understanding of batch processing, job scheduling, and file‑based integrations
• Familiarity with Unix/Linux environments for database and application support
• Familiarity with distributed systems, orchestration tools, and API integration
• Strong foundation in software engineering principles including OOPS, design patterns, data structures, and algorithms
• Ability to manage and support multiple workflows or agents in parallel
• Awareness of responsible technology principles and practices, including fairness, transparency, and safety
• Experience building reusable components, libraries, and frameworks to accelerate development
• A proactive mindset with the ability to work independently and guide teams under general supervision

Education & Preferred Qualifications

• Bachelor’s or advanced degree in Computer Science, Engineering, Mathematics, or a related field,
• Overall 12 + years in IT delivery including 3+ years of hands‑on experience in AI/ML and data engineering, with a strong foundation in enterprise‑scale solution development
• Strong hands‑on expertise in Python, Apache Spark, PySpark, and Databricks for large‑scale data processing and AI model development
• Proven ability to design, deploy, and evaluate machine learning and generative AI models using platforms such as OpenAI, Hugging Face, Azure OpenAI, and orchestration tools like LangChain
• Solid understanding of AI evaluation frameworks, responsible AI practices, and experience building reusable libraries and scalable pipelines
• Effective communicator and collaborator with experience influencing cross‑functional teams and stakeholders in complex, regulated environments

Additional requirements

Work Requirement

• John Adams Building, North Quincy, MA 9 to 5 PM EST

About State Street Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work‑life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers Read our CEO Statement Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work‑life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers Read our CEO Statement