Data Engineering Snowflake Lead Engineer _ Vice President _Data Engineering

Morgan Stanley; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Morgan Stanley is seeking a Lead Data Engineer to architect and modernize data infrastructure for Data AI platforms in Bengaluru. You will lead data pipelines, governance, and modeling efforts across teams, leveraging Snowflake Cortex, Spark, Python, and SQL/NoSQL to deliver scalable solutions.

The role requires 8+ years in data engineering, strong Python, and hands-on Snowflake/Databricks experience, with cloud familiarity (AWS/Azure).

Qualifications

• 8+ years in data engineering or related field.
• Proficiency in Python.
• Experience with Spark or Hadoop.
• Strong SQL and NoSQL skills.
• Hands-on with Snowflake and Databricks.
• Snowflake Cortex experience is required.
• Familiarity with AWS/Azure cloud data services.
• understanding data modeling/architecture.
• Knowledge of data warehousing concepts.
• Experience with Kafka, Git, Jupyter.
• Excellent communication and collaboration skills.
• Ability to work independently and in distributed teams.
• Nice to have Tableau/Power BI familiarity.
• Knowledge of data governance, security, CI/CD, and Collibra.

Responsibilities

• Develop and maintain data pipelines and ETL processes.
• Handle structured and unstructured data for accessibility.
• Optimize data systems for performance and scale.
• Enforce data quality and governance standards.
• Translate stakeholder data needs into technical solutions.
• Documentation and knowledge sharing within the team.
• Participate in code reviews and improve development processes.
• Contribute to broader data architecture discussions and communities.

Skills

Python

Data engineering

Data modeling

Data architecture

SQL/NoSQL

Cloud platforms

Apache Spark

Hadoop

Snowflake

Databricks

Snowflake Cortex

Kafka

Git

Jupyter

Tableau

Power BI

Collibra

CI/CD

DevOps

Tools

Git

Jupyter notebooks

Snowflake Cortex

Snowflake

Databricks

Apache Spark

Hadoop

Kafka

Collibra

CI/CD pipelines

Job description

We’re seeking someone to join our ETS (Enterprise Tech & Services) (Architecture & Modernization) team as a Data Engineering Snowflake Lead to manage, develop and design the data infrastructure for our Data AI platforms with good exposure on Data Engineering, Data Modeling, Snowflake, Python and SQL/PLSQL. Experience in Snowflake Cortex will be added advantage.

In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is a Lead Data Engineer position at Vice President Level, which is part of the job family responsible for developing and maintains software solutions that support business needs.

Since 1935, Morgan Stanley is known as a global leader in financial services, always evolving and innovating to better serve our clients and our communities in more than 40 countries around the world.

What You’ll Do In The Role

• Develop and maintain data pipelines and ETL (Extract, Transform, Load) processes.
• Work with structured and unstructured data to ensure it is accessible and usable.
• Optimize data systems for performance and scalability.
• Implement data quality and data governance standards.
• Collaborate with stakeholders across technology and business units to understand their data needs and translate them into technical solutions and provide data-driven insights.
• Contribute to the documentation and knowledge sharing within the team, creating, and maintaining technical documentation and training materials.
• Participate in code reviews and contribute to the improvement of development processes.
• Contribute to the broader data architecture community through knowledge sharing, presentations.

What You’ll Bring To The Role

• 8 years+ of being a practitioner in data engineering or a related field.
• Proficiency in programming skills in Python.
• Experience with data processing frameworks like Apache Spark or Hadoop.
• Strong experience of database systems (SQL and NoSQL).
• Experience working on Snowflake and Databricks.
• Experience on Snowflake Cortex is must.
• Familiarity with cloud platforms (AWS, Azure) and their data services.
• Understanding of data modeling and data architecture principles.
• Experience with data warehousing concepts and technologies.
• Experience with message queues and streaming platforms (e.g., Kafka).
• Experience with version control systems (e.g., Git).
• Experience using Jupyter notebooks for data exploration, analysis, and visualization.
• Excellent communication and collaboration skills.
• Ability to work independently and as part of a geographically distributed team.
• At least 6 years' relevant experience would generally be expected to find the skills required for this role.
• Nice to have
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Familiarity with data governance and security best practices (e.g., data access control, data masking).
• Experience with Agile methodologies. Familiarity with data catalog and metadata management tools (e.g., Collibra). Familiarity with CI/CD pipelines and DevOps practices.

What You Can Expect From Morgan Stanley

At Morgan Stanley, we raise, manage and allocate capital for our clients – helping them reach their goals. We do it in a way that’s differentiated – and we’ve done that for 90 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren’t just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you’ll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There’s also ample opportunity to move about the business for those who show passion and grit in their work.

To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices into your browser.

Morgan Stanley is an equal opportunity employer committed to building and maintaining a workforce that is diverse in experience and background. Our recruiting efforts reflect our strong commitment to a culture of inclusion, where individuals are hired, developed, and advanced based on their skills and talents.

Our workforce reflects a broad cross-section of the global communities in which we operate, bringing a variety of backgrounds, talents, perspectives, and experiences.

For more information, please visit: https://www.morganstanley.com/people-opportunities/eeo.