Sr Lead - Cloud Data Engg

The Northern Trust Company

Pune

Sur place

INR 4 000 000 - 7 000 000

Plein temps

14 jours+

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

The Northern Trust Company in Pune, India, seeks a Sr. Lead - Cloud Data Platform Engineer to design, build, and maintain scalable, secure data platforms on cloud.

You will optimize performance, implement governance, and collaborate with data scientists, engineers, and business stakeholders. Expect deep cloud expertise (AWS/Azure), proficiency in data pipelines, and experience with Snowflake, Databricks, Airflow, and Terraform.

Qualifications

  • Bachelor's degree in Computer Science, Data Engineering, or related field.
  • 8+ years in data engineering, cloud/platform engineering with 13+ years total tech experience.
  • Hands-on with at least one major cloud provider (AWS or Azure).
  • Strong experience with big data and data processing frameworks (e.g., Spark, Databricks, Flink).
  • Proven expertise in building data pipelines with tools like Apache Airflow, dbt, Kafka, or similar.

Responsabilités

  • Design, build, and maintain cloud-native data platform infrastructure.
  • Develop and optimize data pipelines for ingestion, transformation, and processing of data.
  • Implement data quality, lineage, and cataloging solutions; enforce governance and security.
  • Establish CI/CD pipelines for data services and platform components.
  • Mentor junior engineers and collaborate with data scientists and business stakeholders.

Connaissances

Cloud platforms
Data engineering
Big data processing
Data governance
CI/CD pipelines

Formation

Bachelor's degree in CS or related field
Master's preferred

Outils

AWS
Azure
Snowflake
Databricks
Apache Airflow
dbt
Kafka
Terraform
Kubernetes
Python

Description du poste

About Northern TrustAs a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world's most successful individuals, families, corporations and institutions.Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide.With more than 135 years of financial experience and over 24,000 partners, we serve the world's most sophisticated clients using leading technology and exceptional service.

Position Overview

The Sr. Lead - Cloud Data Platform Engineer is responsible for designing, building, and maintaining scalable, secure, and high-performance cloud-based data platforms that support analytics, machine learning, and enterprise data needs. This role ensures that data solutions are optimized for performance, cost, and reliability, while meeting governance, compliance, and business requirements. The engineer collaborates closely with data scientists, analysts, architects, and business stakeholders to deliver modern data capabilities on cloud platforms. Should have deep technical expertise, strong design judgment, and the ability to influence without authority.

Key Responsibilities
Platform Engineering & Development
  • Design, implement, and maintain cloud-native data platform infrastructure resources (e.g., AWS, Azure).
  • Design and build GitHub terraform Pipeline for managing cloud data infrastructure resources and object management pipelines into the databases and SaaS product.
  • Develop and optimize data pipelines patterns for ingestion, transformation, and processing of structured, semi-structured, and unstructured data.
  • Build reusable frameworks and automation for data workflows, monitoring, and scaling.
  • Ensure data storage and compute solutions are optimized for performance, security, and cost efficiency.
  • Integrate cloud data services with enterprise applications, APIs, and third-party tools.
Data Management & Governance
  • Implement data quality, lineage, and cataloging solutions across the data platform.
  • Enforce governance, security, and compliance standards (e.g., GDPR, HIPAA, SOC2).
  • Work with architects and security teams to implement role-based access, encryption, and audit controls.
  • Support metadata management, data discoverability, and enterprise-wide data democratization.
Operations & Reliability
  • Manage the operational health of the cloud data platform, including monitoring, alerting, and troubleshooting.
  • Establish CI/CD pipelines for data services and platform components.
  • Implement disaster recovery, backup, and failover strategies.
  • Continuously optimize platform performance, cost, and scalability.
Collaboration & Innovation
  • Partner with data scientists, BI teams, and application developers to enable advanced analytics and AI/ML workloads.
  • Evaluate emerging cloud data services and recommend adoption based on enterprise needs.
  • Provide technical expertise in designing cloud-based data architectures and solutions.
  • Mentor junior engineers and contribute to best practices in cloud engineering and data development.
Qualifications
Education & Experience:
  • Bachelor's degree in Computer Science, Data Engineering, or related field (Master's preferred).
  • 8+ years of experience in data engineering, cloud engineering, or platform engineering with 13+ years of total work experience in technology infrastructure.
  • Hands‑on experience with at least one major cloud provider (AWS or Azure).
  • Strong experience with big data and data processing frameworks (e.g., Spark, Databricks, Flink).
  • Proven expertise in building data pipelines with tools like Apache Airflow, dbt, Kafka, or similar.
Skills & Competencies:
  • In-depth knowledge and experience with Snowflake, Databricks, or similar cloud data platforms.
  • Extensive knowledge and real hands‑on experience on Github terraform pipelines and objects deployment management.
  • Extensive knowledge and real hands‑on experience of AI/ML data pipelines and feature engineering.
  • Exposure to regulated environments (financial services, healthcare, etc.).
  • Proficiency in terraform, SQL and one or more programming languages (Python, Java, or Scala).
  • Deep understanding of cloud-native data services (e.g., AWS Redshift, Glue, S3, Athena; Azure Synapse, Data Factory; GCP BigQuery, Dataflow).
  • Familiarity with containerization and orchestration (Docker, Kubernetes).
  • Experience with infrastructure‑as‑code (Terraform, CloudFormation, Pulumi).
  • Knowledge of FinOps principles for cost‑efficient data platform design.
  • Strong problem‑solving, communication, and cross‑functional collaboration skills.
  • Excellent communication, mentorship, and ability to influence cross‑functional teams.
Key Success Metrics

Uptime, performance, and reliability of the clou

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Sr Lead - Cloud Data Platform Engg
Sr Lead - Cloud Data Platform Engg

Ntrs • Pune District

Sur place
INR 1 800 000 - 2 800 000
Principal Solutions Architect
Principal Solutions Architect

The Northern Trust Company • Bengaluru

Sur place
INR 3 000 000 - 6 000 000
Sr Lead - Cloud Data Platform Engg
Sr Lead - Cloud Data Platform Engg

185 Northern Operating Sols Pvt Ltd • Pune District

Sur place
INR 4 000 000 - 7 000 000
Data Architect – Snowflake/Databricks
Data Architect – Snowflake/Databricks

Systango Group • Indore District

Sur place
INR 4 500 000 - 8 500 000
Senior Software Engineer
Senior Software Engineer

Carelon Global Solutions • Gurugram District, Bengaluru

Sur place
INR 1 500 000 - 2 700 000
Senior Data Platform Engineer
Senior Data Platform Engineer

Relevance Lab • Bengaluru

Sur place
INR 400 000 - 700 000
Cloud Data Transformation Practice Lead
Cloud Data Transformation Practice Lead

Amdocs • Pune District

Sur place
INR 3 000 000 - 5 000 000
Data Engineer
Data Engineer

Alp Consulting Ltd. • Hyderabad

Sur place
INR 2 000 000 - 3 000 000
Director- Cloud Data Platform Operations
Director- Cloud Data Platform Operations

Northern Trust Corp • Pune

Sur place
INR 3 500 000 - 5 500 000
Lead Data Engineer
Lead Data Engineer

Edgematics Group • Gurugram District

Sur place
INR 3 500 000 - 5 500 000