Lead, Data Engineer

185 Northern Operating Sols Pvt Ltd; Pune District; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Northern Trust in Pune, India, seeks a Lead Data Engineer to design and deliver enterprise-scale data platforms. You will architect Snowflake-based data warehouses, develop robust pipelines, and drive data modernization across analytics and reporting workloads.

You will lead technically, influence platform standards, and partner with stakeholders to provide trusted, analytics-ready data assets in a cloud-native environment.

Qualifications

• 7+ years in Data Engineering, Data Platform Engineering, or Data Warehousing.
• 5+ years hands-on Snowflake experience.
• Strong Python and SQL development skills.
• Experience designing enterprise-scale data warehouses and analytics platforms.
• Experience with Airflow or Astronomer for orchestration.
• Cloud-native solutions on Microsoft Azure.

Responsibilities

• Design, build, and optimize scalable enterprise data platforms using Snowflake and Azure.
• Develop robust data pipelines including batch, micro-batch, and real-time processing.
• Architect modern data warehouse and data lake solutions.
• Design scalable ELT/ETL frameworks and data transformation pipelines.
• Leverage Snowflake features like Streams & Tasks, Snowpark, and Materialized Views.
• Ensure platform reliability, observability, and governance.
• Build cloud-native solutions with Azure AKS, Blob Storage, and Data Lake Storage.
• Collaborate with analytics and business teams to deliver analytics-ready data assets.

Skills

Snowflake

Python

SQL

Airflow

Astronomer

Azure Cloud Services

Data Warehousing

Data Modeling

Data Lake Architectures

ELT/ETL Development

Git

CI/CD

Education

Bachelor's or Master's in computer science, Engineering, Information Systems, or related field

Tools

Astronomer

Azure DevOps

CI/CD Tools

Job description

About Northern Trust

As a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families, corporations and institutions. Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide. With more than 135 years of financial experience and over 24,000 partners, we serve the world’s most sophisticated clients using leading technology and exceptional service.

We are seeking a highly skilled and hands‑on Lead Data Engineer to design, build, and modernize enterprise-scale data platforms supporting analytics, reporting, and data-driven decision making. This role will lead the technical implementation of cloud-native data solutions using Snowflake, Azure, Python, and Astronomer/Airflow, while partnering with architects, product owners, analytics teams, and business stakeholders to deliver scalable, secure, and high‑performing data products. This is a senior individual contributor role with significant influence on platform architecture, engineering standards, cloud modernization efforts, and data platform strategy.

Key Responsibilities

• Design, build, and optimize scalable enterprise data platforms using Snowflake and Microsoft Azure.
• Develop robust batch, micro-batch, and near real‑time data pipelines using Python and Astronomer/Airflow.
• Architect and implement modern cloud data warehouse and data lake solutions.
• Design scalable ELT/ETL frameworks, reusable data ingestion patterns, and data transformation pipelines.
• Leverage advanced Snowflake capabilities including Streams & Tasks, Dynamic Tables, Snowpark, Iceberg Tables, Secure Data Sharing, and Materialized Views.
• Drive data platform reliability, operational excellence, monitoring, observability, and governance.
• Optimize Snowflake workloads for performance, scalability, and cost efficiency.
• Build and deploy cloud-native solutions using Azure AKS, Azure Blob Storage, Azure Data Lake Storage, Azure DevOps CI/CD.
• Design and support real‑time and event‑driven data processing architectures.
• Partner with analytics, reporting, and business teams to provide trusted, analytics‑ready data assets.
• Establish engineering best practices, coding standards, and architectural patterns.
• Participate in solution design, technical reviews, and architecture governance activities.

Required Qualifications

• Bachelor's or master's degree in computer science, Engineering, Information Systems, or related field.
• 7+ years of experience in Data Engineering, Data Platform Engineering, or Data Warehousing.
• 5+ years of hands‑on experience with Snowflake.
• Strong expertise in Python and advanced SQL development.
• Proven experience designing and implementing enterprise‑scale data warehouses and analytical platforms.
• Strong experience with Airflow and/or Astronomer for orchestration and workflow management.
• Experience building cloud-native solutions on Microsoft Azure.
• Strong understanding of Data Modeling, Data Warehousing Concepts, ELT/ETL Frameworks, Distributed Systems, Data Governance, CI/CD and DevOps Practices.
• Excellent analytical, problem‑solving, and communication skills.

Technical Skills Required

• Snowflake
• Python
• SQL
• Airflow / Astronomer
• Azure Cloud Services
• Data Warehousing
• Data Modeling
• Data Lake Architectures
• ELT / ETL Development
• Git
• CI/CD Pipelines

Desired

• Snowpark Streams & Tasks, Dynamic Tables, Iceberg Tables, Data Sharing, CDC Frameworks, Real-Time Data Processing, Event-Driven Architectures
• Azure AKS, Azure Blob Storage, Azure Data Lake Storage, Azure DevOps
• REST APIs and Data Integrations

Domain Expertise (Preferred)

• Experience working with Financial Services, Wealth Management, Asset Management, or Investment Analytics platforms.
• Familiarity with Portfolio Management Data Holdings & Positions Transactions & Tax Lots Client Reporting Performance Reporting Financial Analytics Investment Operations Data

Nice to Have

• Experience with modern BI and Analytics platforms such as ThoughtSpot, Power BI, Cognos, Tableau, or similar technologies.
• Familiarity with semantic modeling, dashboard development, self-service analytics, and reporting solutions.
• Experience designing analytics-ready data models to support enterprise reporting and business intelligence workloads.
• Understanding of search-driven analytics, AI-assisted analytics, and embedded analytics capabilities.
• Experience supporting the migration and modernization of legacy BI platforms to cloud-native analytics ecosystems.
• Exposure to data governance, lineage, metadata management, and data catalog solutions.

Preferred Certifications

• Snowflake SnowPro Core Certification
• SnowPro Advanced Data Engineer
• SnowPro Advanced Architect
• Microsoft Azure Microsoft Certified: Azure Data Engineer Associate (DP-203)
• Microsoft Certified: Azure Solutions Architect Expert (AZ-305)
• Microsoft Certified: Azure Fundamentals (AZ-900)

What You’ll Bring

• Passion for building modern, scalable cloud data platforms.
• Strong ownership mindset and ability to drive technical initiatives independently.
• Deep technical expertise combined with practical problem‑solving skills.
• Ability to influence architecture and engineering decisions across teams.
• Strong collaboration skills with engineers, architects, analysts, and business stakeholders.
• Commitment to engineering excellence, reliability, and continuous improvement.

Working with Us

As a Northern Trust partner, you will be part of a flexible and collaborative work culture, which has a strong history of financial strength and stability. Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to an inclusive workplace and assisting the communities we serve. Philanthropy is deeply rooted in Northern Trust’s history and is an essential element of our culture. Employees around the world give their time and talent to work for the greater good of their communities.

Reasonable Accommodation

Northern Trust is committed to working with and providing adjustments to individuals with health conditions and disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at [e-mail], or alternatively you can discuss your individual requirements with the recruiter you are working with.

About Our Pune Office

The Northern Trust Pune office, established in 2016, is now home to over 3,000 employees. The office handles various functions, including Operations for Asset Servicing and Wealth Management, as well as delivering critical technology solutions that support business operations across the globe. Our Pune team takes our commitment to service to heart. In 2024, they volunteered more than 10,000+ hours into the communities where they live and work. Learn more.

Terms and Conditions

Candidate Privacy Notice California Applicant Privacy Notice Pay Transparency Nondiscrimination Provision (U.S) Transparency in Coverage Disclosure – North America Northern Trust is committed to working with and providing reasonable accommodations to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the employment process, please email our HR Service Center or call 1-800-807-0302 (North America), [phone] (Asia Pacific), 1800-425-0333 (India), [phone] (Europe, Middle East and Africa) and let us know the nature of your request and your contact information.

APAC/INDIA EEO STATEMENT

It is the policy and practice of Northern Trust to provide equal employment opportunities to all employees and applicants. Northern Trust does not discriminate on the basis of race, colour, religion or belief, nationality, ethnic or national origin, sex, marital status, sexual orientation, disability or age. All employment decisions will be made in a non-discriminatory manner in accordance with our obligations under the law and codes of practice. This includes human resources’ decisions relating to recruitment, terms and conditions of employment, transfers, promotions and access to learning and development.

Canada EEO STATEMENT

Northern Trust is an Equal Opportunity Employer. Hiring and other employment decisions at Northern Trust are made without regard to race, colour, religion, sex, ancestry, national origin, ethnic origin, age, disability, citizenship, veteran status, sexual orientation, record of offences, marital status, family status, or any other characteristic protected under federal, provincial, or local law, regulation, or ordinance.

EMEA EEO STATEMENT

It is the policy and practice of Northern Trust to provide equal employment opportunities to all employees and applicants. Northern Trust does not discriminate on the basis of race, colour, religion or belief, nationality, ethnic or national origin, sex, marital status, sexual orientation, disability or age. All employment decisions will be made in a non-discriminatory manner in accordance with our obligations under the law and codes of practice. This includes human resources’ decisions relating to recruitment, terms and conditions of employment, transfers, promotions and access to learning and development.

USA EEO STATEMENT

It is the policy of The Northern Trust Company to afford equal opportunity in all phases of employment without regard to an individual's age, race, color, religion, creed, gender, national origin, citizenship status, marital status, pregnancy, sexual orientation, gender identity, gender expression, genetic tests and information, physical or mental disability, protected veteran status or any other legally protected status.