Data Engineering and Development VP

State Street; Greater London; On-site; GBP 136,000 - 182,000; Full time

Benefits offered by this job

Flexible work-life support

Paid volunteer days

Employee networks

Job summary

State Street is seeking a Data Engineering Lead to guide the design, development, and deployment of large-scale data solutions. You will mentor teams, influence stakeholders, and build reusable frameworks across diverse domains.

You will apply expertise in Oracle, SQL, Python, and cloud data services to drive secure, compliant, and scalable data architectures for enterprise clients.

Qualifications

• 12+ years in IT delivery including 3+ years in AI/ML and data engineering.
• Strong hands-on Python, Spark, PySpark and Databricks experience.
• Experience designing enterprise-scale data solutions and reusable libraries.

Responsibilities

• Lead design, development, and deployment of data solutions across use cases such as document processing and automation.
• Translate business needs into data-driven workflows with modern orchestration tools.
• Promote security, compliance, and explainability while ensuring robust deployment.
• Establish reusable frameworks and scalable components to accelerate adoption.
• Prioritize initiatives and align with enterprise goals.

Skills

Data engineering concepts

Oracle Database

PL/SQL development

SQL performance tuning

Security/compliance

Team leadership

Cross-functional collaboration

Orchestration tools

Responsible AI practices

AI model evaluation

OpenAI / HuggingFace

Cloud architectures

Python

Git/CI-CD

Unix/Linux

Education

Bachelor’s degree in CS

12+ years IT delivery

AI/ML hands-on experience

Tools

Oracle

Snowflake

Azure Data Factory

Azure SQL

Azure Storage

Azure VMs

Python

Apache Spark

Databricks

Git/Bitbucket

CI/CD

LangChain

Job description

Who we are looking for

We’re looking for a dynamic and forward-thinking leader who’s passionate about shaping the future of technology at scale. If you thrive at the intersection of innovation and execution, and enjoy turning cutting‑edge trends into practical enterprise solutions, this role is for you. As a hands‑on strategist, you’ll guide the development and evaluation of advanced capabilities across diverse business domains, while mentoring teams and influencing stakeholders. The ideal candidate brings a strong blend of technical depth and strategic vision, with a drive to build reusable frameworks, foster responsible practices, and cultivate a culture of experimentation and continuous learning.

Why this role is important to us

Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We’re driving the company’s digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

What you will be responsible for

As Data Engineering Lead you will:

• Lead the design, development, and deployment of solutions across use cases such as document processing, intelligent agents, and automation frameworks
• Collaborate with cross-functional teams to translate business needs into data-driven workflows using modern orchestration tools
• Promote responsible practices including security, compliance, and explainability, while ensuring robust deployment
• Establish reusable frameworks, evaluation pipelines, and scalable components to accelerate adoption and maintain consistency
• Prioritize initiatives, manage delivery timelines, and align efforts with enterprise goals

What we value

These skills will help you succeed in this role

• Solid understanding of modern data engineering concepts and emerging technologies
• Strong experience with Oracle Database, including schema design, data modeling, and performance optimization
• Advanced proficiency in PL/SQL development, including stored procedures, packages, triggers, and functions
• Expertise in SQL query tuning and performance optimization, including execution plan analysis and indexing strategies
• Hands‑on experience with Oracle performance diagnostics tools (e.g., AWR, ASH, explain plans)
• Solid understanding of database architecture, data integrity, and transaction management
• Experience with data migration, integration, and ETL processes involving Oracle systems
• Hands‑on experience with Snowflake, including data warehousing, query performance tuning, and data pipeline integration
• Proficiency in Azure cloud services, such as Azure SQL, Azure Data Factory, Azure Storage, or Azure Virtual Machines
• Experience designing and supporting cloud-based data solutions and hybrid (on-prem + cloud) architectures
• Familiarity with data security, access control, and governance in cloud environments
• Strong scripting skills (e.g., Shell, Python) for automation and data processing
• Experience with version control systems (Git/Bitbucket) and CI/CD pipelines
• Understanding of batch processing, job scheduling, and file-based integrations
• Familiarity with Unix/Linux environments for database and application support
• Familiarity with distributed systems, orchestration tools, and API integration
• Strong foundation in software engineering principles including OOPS, design patterns, data structures, and algorithms
• Ability to manage and support multiple workflows or agents in parallel
• Awareness of responsible technology principles and practices, including fairness, transparency, and safety
• Experience building reusable components, libraries, and frameworks to accelerate development
• A proactive mindset with the ability to work independently and guide teams under general supervision

Education & Preferred Qualifications

• Bachelor’s or advanced degree in Computer Science, Engineering, Mathematics, or a related field,
• Overall 12 + years in IT delivery including 3+ years of hands‑on experience in AI/ML and data engineering, with a strong foundation in enterprise-scale solution development
• Strong hands‑on expertise in Python, Apache Spark, PySpark, and Databricks for large-scale data processing and AI model development
• Proven ability to design, deploy, and evaluate machine learning and generative AI models using platforms such as OpenAI, Hugging Face, Azure OpenAI, and orchestration tools like LangChain
• Solid understanding of AI evaluation frameworks, responsible AI practices, and experience building reusable libraries and scalable pipelines
• Effective communicator and collaborator with experience influencing cross‑functional teams and stakeholders in complex, regulated environments

Additional requirements

Work Requirement

• John Adams Building, North Quincy, MA
• 9 to 5 PM EST

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work‑life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement