Senior Data Engineer

Metropolis Technologies; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Metropolis Technologies in the United States seeks a Senior Data Engineer to design and build scalable data pipelines, data models, and analytics foundations powering multiple products in parking, mobility and real estate.

You will collaborate with engineers, product managers, and data scientists to translate data needs into end-to-end solutions, own data architecture for large-scale projects, mentor teammates, and uphold data quality, security, and governance in a fast-paced, inclusive

Qualifications

• Bachelor's degree in computer science, computer engineering, or a related technical field.
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, with large datasets in the cloud.
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive Snowflake and dbt experience.
• 5+ years of experience with Python, and building scalable Big Data solutions and ETL ecosystems.
• Hands-on experience with RDBMS such as MySQL, MS SQL Server, and PostgreSQL.
• Familiarity with integration tools like Airflow and Automic, and CI/CD pipelines.
• Ability to deliver high standards of code quality, reliability, and performance.
• Experience with Spark and PySpark for large-scale data processing.
• Strong proficiency in Terraform is required.

Responsibilities

• Collaborate with engineers, product managers, and data scientists to understand data needs and develop end-to-end data pipelines, solutions, and foundational data sets.
• Design and own the data architecture for large-scale projects, making informed design and operational trade-offs.
• Build, launch, and optimize sophisticated data pipelines, data models, and visualizations supporting multiple products/domains.
• Define and manage SLAs for all data sets within ownership areas.
• Implement data security models, ensure privacy safeguards, and evolve data governance processes.
• Solve complex data integration challenges using ETL/ELT patterns and techniques for structured/unstructured data.
• Maintain and enhance production processes by optimizing code with advanced algorithms.
• Optimize pipelines, dashboards, frameworks, and systems for data artifact development.
• Mentor team members and foster skill growth and collaboration.
• Ensure availability during evening hours.

Skills

SQL expertise

Python programming

Data modeling

ETL/ELT patterns

Mentoring

Team collaboration

Evening hours availability

Education

Bachelor's degree in CS or related field

Tools

Snowflake

dbt

Airflow

Terraform

Spark

PySpark

MySQL

PostgreSQL

MS SQL Server

AWS

CI/CD

Job description

Who we are

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout-free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout-free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable - giving us back our most valuable asset, time.

Who you are

As a Senior Data Engineer at Metropolis, you will play a key role in shaping both customer-facing and business-facing data products that align with our mission. Your technical expertise and analytical acumen will contribute to designing and building extensive data sets that impact thousands of internal users and millions of members. Join a world-class data engineering team dedicated to advancing your skills and career in data engineering and beyond.

What you'll do

• Collaborate with engineers, product managers, and data scientists to understand data needs, and develop end-to-end data pipelines, solutions, and foundational data sets
• Design and own the data architecture for large-scale projects, making informed decisions about design and operational trade-offs
• Build, launch, and optimize sophisticated data pipelines, data models, and visualizations that support diverse use cases across multiple products or domains
• Define and manage Service Level Agreements (SLAs) for all data sets within areas of ownership
• Implement data security models based on privacy requirements, ensure compliance with safeguards, address data quality issues, and evolve data governance processes
• Solve complex data integration challenges using optimal ETL/ELT patterns, frameworks, and query techniques for both structured and unstructured data sources
• Maintain and enhance existing production processes by optimizing complex code using advanced algorithmic concepts
• Optimize pipelines, dashboards, frameworks, and systems to streamline data artifact development
• Mentor team members, providing and receiving actionable feedback to foster skill growth and collaboration
• Ensure flexibility with availability during evening hours

What we're looking for

• Bachelor's degree in computer science, Computer Engineering, or a relevant technical field; a master's degree is preferred
• 5+ years of experience in data engineering, database engineering, business intelligence, data warehousing, and ETL tools, working with large data sets in the cloud
• Proficiency in SQL, ETL/ELT, and data modeling, with extensive experience in Snowflake and dbt
• 5+ years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems
• Hands‑on experience with RDBMS such as MySQL, MS SQL Server, and Postgres
• Familiarity with integration tools like Airflow and Automic, along with a working knowledge of CI/CD pipelines
• Ability to deliver high standards of code quality, system reliability, and performance
• Experience with Spark and PySpark to handle large-scale data processing and enhance data pipeline efficiency
• Strong proficiency in Terraform is a must‑have.

Our Stack

• Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited)
• Datastores: MySQL, PostgreSQL, Snowflake
• Cloud: AWS
• Version control: Git & GitHub
• AI Tooling: Copilot on GitHub
• Observability: Datadog

When you join Metropolis, you’ll join a team of world‑class product leaders and engineers, building an ecosystem of technologies at the intersection of parking, mobility, and real estate. Our goal is to build an inclusive culture where everyone has a voice and the best idea wins. You will play a key role in building and maintaining this culture as our organization grows. #LI-SR1 #LI-Onsite

Metropolis may utilize an automated employment decision tool (AEDT) to assess or evaluate your candidacy for employment or promotion. AEDTs are used to assist in assessing a candidate’s application relative to the required job qualifications and responsibilities listed in the job posting.

As part of this process, Metropolis retains data relevant to your candidacy, including personal information, for a period that is reasonably necessary for the use of the tool. If you are hired for the position, your data may become part of your employee records.

Metropolis Technologies is an equal opportunity employer. We make all hiring decisions based on merit, qualifications, and business needs, without regard to race, color, religion, sex (including gender identity, sexual orientation, or pregnancy), national origin, disability, veteran status, or any other protected characteristic under federal, state, or local law.