Senior Data Engineer

Metropolis; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Metropolis is hiring a Senior Data Engineer to shape data products for customers and internal teams. You will design end-to-end data pipelines, own data architecture for large-scale projects, and build data models and dashboards that power multiple products.

You will collaborate with engineers, PMs, and data scientists to ensure data quality, security, and governance while optimizing performance and reliability. The role requires ongoing mentoring and occasional evening support in Bengaluru.

Qualifications

• Bachelor's degree in computer science, computer engineering, or a related technical field; a master's degree preferred.
• 5+ years of experience in data engineering, database engineering, BI, data warehousing, and ETL tools, with large cloud datasets.
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive Snowflake and dbt experience.
• 5+ years of Python experience and building scalable big data solutions and ETL ecosystems.
• Hands-on with MySQL, MS SQL Server, and Postgres.
• Familiarity with Airflow and Automic, plus CI/CD knowledge.
• Strong code quality, reliability, and performance mindset.
• Experience with Spark/PySpark for large-scale data processing.
• Terraform proficiency is a must-have.

Responsibilities

• Collaborate with engineers, product managers, and data scientists to understand data needs and develop end-to-end data pipelines and foundational data sets.
• Design and own data architecture for large-scale projects, balancing design and operational trade-offs.
• Build, launch, and optimize data pipelines, data models, and visualizations across products or domains.
• Define and manage SLAs for data sets within areas of ownership.
• Implement data security models, ensure privacy compliance, address data quality issues, and evolve governance.
• Solve complex data integration challenges using ETL/ELT patterns and SQL concepts for structured and unstructured data.
• Maintain and enhance production processes by optimizing code with advanced algorithms.
• Optimize pipelines, dashboards, frameworks, and systems for efficient data artifact development.
• Mentor team members and foster growth and collaboration.
• Ensure availability during evening hours.

Skills

SQL proficiency

ETL/ELT

Data modeling

Snowflake

dbt

Python

Spark/PySpark

Airflow

CI/CD

Terraform

Education

Bachelor's degree in CS/CE or related field

Master's degree preferred

Tools

Snowflake

dbt

Python

Spark

PySpark

Airflow

Automic

CI/CD pipelines

RDBMS (MySQL, MSSQL, Postgres)

Terraform

AWS

Job description

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact thousands of internal users and millions of members. Join a world-class data engineering team dedicated to advancing your skills and career in data engineering and beyond.

What you'll do

• Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets
• Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs
• Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains
• Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership
• Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes
• Solve complex data integration challenges using optimal ETL/ELT patterns, frameworks, and query techniques for both structured and unstructured data sources
• Maintain and enhance existing production processes by optimizing complex code using advanced algorithmic concepts
• Optimize pipelines, dashboards, frameworks, and systems to streamline data artifact development
• Mentor team members, providing and receiving actionable feedback to foster skill growth and collaboration
• Ensure flexibility with availability during evening hours

What we're looking for

• Bachelor's degree in computer science, Computer Engineering, or a relevant technical field; a master's degree is preferred
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt
• 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems
• Hands-on experience with RDBMS such as MySQL, MS SQL Server, and Postgres
• Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines
• Ability to deliver high standards of code quality, system reliability, and performance
• Experience with Spark and PySpark to handle large-scale data processing and enhance data pipeline efficiency
• Strong proficiency in Terraform is a must-have.

Our Stack

• Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited)
• Cloud: AWS
• Version control: Git & GitHub
• AI Tooling: Copilot on GitHub

When you join Metropolis, you’ll join a team of world-class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

Metropolis may utilize an automated employment decision tool (AEDT) to assess or evaluate your candidacy for employment or promotion. AEDTs are used to assist in assessing a candidate’s application relative to the required job qualifications and responsibilities listed in the job posting.

As part of this process, Metropolis retains data relevant to your candidacy, including personal information, for a period that is reasonably necessary for the use of the tool. If you are hired for the position, your data may become part of your employee records.

Metropolis Technologies is an equal opportunity employer. We make all hiring decisions based on merit, qualifications, and business needs — without regard to race, color, religion, sex (including gender identity, sexual orientation, and pregnancy), national origin, disability, veteran status, or any other protected characteristic under federal, state, or local law. We are committed to providing a welcoming, accessible hiring experience. If you need a reasonable accommodation for any part of the application or interview process, please reach out to us at [e-mail] .