Data Engineering and Development VP

STATE STREET CORPORATION; Quincy (MA); On-site; USD 150,000 - 210,000; Full time

Job summary

STATE STREET CORPORATION in Quincy, MA seeks a Data Engineering Lead who can shape data architecture and scalable automation. You will lead design, development and deployment of data solutions across use cases such as document processing and intelligent agents, guiding teams and aligning with enterprise goals.

You’ll apply Python, Spark, Databricks, Snowflake and Azure to build reusable components, ensure security and compliance, and promote responsible AI practices.

Qualifications

• Bachelor’s or advanced degree in Computer Science, Engineering, Mathematics, or a related field.
• 12+ years in IT delivery including 3+ years in AI/ML and data engineering.
• Strong hands-on in Python, Spark, PySpark, and Databricks.
• Experience deploying ML models using OpenAI, Azure OpenAI, and orchestration tools.
• Ability to design reusable libraries and scalable pipelines.
• Excellent communication and collaboration in regulated environments.

Responsibilities

• Lead the design, development, and deployment of data solutions across use cases like document processing and automation.
• Collaborate with cross-functional teams to translate business needs into data-driven workflows.
• Promote responsible practices including security, compliance, and explainability.
• Establish reusable frameworks, evaluation pipelines, and scalable components.
• Prioritize initiatives and align efforts with enterprise goals.

Skills

Data engineering concepts

Python

SQL performance tuning

Snowflake

Azure Cloud

ETL pipelines

CI/CD

APIs

Git/Bitbucket

OOP/Design patterns

Education

Bachelor’s or advanced degree in Computer Science, Engineering, Mathematics, or related field

Tools

Oracle Database

Snowflake

Azure SQL

Azure Data Factory

Azure Storage

Azure Virtual Machines

OpenAI

Hugging Face

LangChain

Databricks

Git/Bitbucket

Job description

Who we are looking forWe’re looking for a dynamic and forward-thinking leader who’s passionate about shaping the future of technology at scale. If you thrive at the intersection of innovation and execution, and enjoy turning cutting-edge trends into practical enterprise solutions, this role is for you. As a hands-on strategist, you’ll guide the development and evaluation of advanced capabilities across diverse business domains, while mentoring teams and influencing stakeholders. The ideal candidate brings a strong blend of technical depth and strategic vision, with a drive to build reusable frameworks, foster responsible practices, and cultivate a culture of experimentation and continuous learning.Why this role is important to usOur technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We’re driving the company’s digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.What you will be responsible forAs Data Engineering Lead you will:· Lead the design, development, and deployment of solutions across use cases such as document processing, intelligent agents, and automation frameworks· Collaborate with cross-functional teams to translate business needs into data-driven workflows using modern orchestration tools· Promote responsible practices including security, compliance, and explainability, while ensuring robust deployment· Establish reusable frameworks, evaluation pipelines, and scalable components to accelerate adoption and maintain consistency· Prioritize initiatives, manage delivery timelines, and align efforts with enterprise goalsWhat we valueThese skills will help you succeed in this role· Solid understanding of modern data engineering concepts and emerging technologies· Strong experience with Oracle Database, including schema design, data modeling, and performance optimization· Advanced proficiency in PL/SQL development, including stored procedures, packages, triggers, and functions· Expertise in SQL query tuning and performance optimization, including execution plan analysis and indexing strategies· Hands-on experience with Oracle performance diagnostics tools (e.g., AWR, ASH, explain plans)· Solid understanding of database architecture, data integrity, and transaction management· Experience with data migration, integration, and ETL processes involving Oracle systems· Hands-on experience with Snowflake, including data warehousing, query performance tuning, and data pipeline integration· Proficiency in Azure cloud services, such as Azure SQL, Azure Data Factory, Azure Storage, or Azure Virtual Machines· Experience designing and supporting cloud-based data solutions and hybrid (on-prem + cloud) architectures· Familiarity with data security, access control, and governance in cloud environments· Strong scripting skills (e.g., Shell, Python) for automation and data processing· Experience with version control systems (Git/Bitbucket) and CI/CD pipelines· Understanding of batch processing, job scheduling, and file-based integrations· Familiarity with Unix/Linux environments for database and application support· Familiarity with distributed systems, orchestration tools, and API integration· Strong foundation in software engineering principles including OOPS, design patterns, data structures, and algorithms· Ability to manage and support multiple workflows or agents in parallel· Awareness of responsible technology principles and practices, including fairness, transparency, and safety· Experience building reusable components, libraries, and frameworks to accelerate development· A proactive mindset with the ability to work independently and guide teams under general supervisionEducation & Preferred Qualifications· Bachelor’s or advanced degree in Computer Science, Engineering, Mathematics, or a related field,· Overall 12 + years in IT delivery including 3+ years of hands-on experience in AI/ML and data engineering, with a strong foundation in enterprise-scale solution development· Strong hands-on expertise in Python, Apache Spark, PySpark, and Databricks for large-scale data processing and AI model development· Proven ability to design, deploy, and evaluate machine learning and generative AI models using platforms such as OpenAI, Hugging Face, Azure OpenAI, and orchestration tools like LangChain· Solid understanding of AI evaluation frameworks, responsible AI practices, and experience building reusable libraries and scalable pipelines· Effective communicator and collaborator with experience influencing cross-functional teams and stakeholders in complex, regulated environmentsAdditional requirementsWork RequirementJohn Adams Building, North Quincy, MA9 to 5 PM ESTAbout State StreetAcross the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.Discover more information on jobs at StateStreet.com/careersRead our CEO Statement