Data Platform Engineer

Upstart; United States; Remote; USD 80,000 - 130,000; Full time

Job summary

Join a forward-thinking company as a Data Platform Engineer, where you'll build user-friendly tools and scalable data infrastructure. This role offers the chance to collaborate with diverse teams, enhance data platform performance, and drive impactful data solutions. You'll be at the forefront of innovation, working with cutting-edge technologies in a supportive environment that values your contributions. If you're passionate about data and eager to make a difference, this opportunity is perfect for you!

Benefits

Competitive Compensation

Comprehensive medical coverage

401(k) with company match

Employee Stock Purchase Plan

Life and disability insurance

Generous leave policies

Wellness reimbursement programs

Catered lunches and snacks

Social activities and team events

Qualifications

• 3+ years of experience in data platform development and engineering.
• Strong foundation in algorithms and data structures.

Responsibilities

• Build and maintain scalable tools for data transformations.
• Manage and maintain the data catalog for efficient data discovery.

Skills

Data Engineering

Problem Solving

Collaboration

Analytical Skills

Education

Bachelor's degree in Computer Science

Bachelor's degree in Data Science

Bachelor's degree in Engineering

Tools

Databricks

PostgreSQL

Python

Spark

Kafka

SQL

AWS

Airflow

DBT

Docker

Kubernetes

Job description

The Data Platform Engineering team (Part of Upstart's core platform vertical) provides developer tools, frameworks, and scalable data infrastructure as shared services across Upstart. The team's primary objective is to provide Data Analysts, Software Engineers, and ML scientists access to high-quality data and developer tools to create business metrics for respective product verticals.

You will join the subdivision focusing on Data Curation.

As the Data Platform Engineer joining this team, you will get the opportunity to contribute to the following areas:

1. Build and maintain user-friendly, scalable tools that enable data teams and other stakeholders to perform data transformations without needing deep technical expertise.
2. Expand the self-serve ETL and orchestration framework that developers use to build pipelines.
3. Manage, organize, and maintain the data catalog to ensure efficient data discovery, governance, access control, and metadata management across the organization.

We would love to hear from you if you are passionate about building data products!

How you’ll make an impact:

• Build and improve the tools owned by the Data Curation team.
• Participate in planning and prioritization by collaborating with stakeholders across the various product verticals and functions (ML, Analytics, Finance, Software engineering) to ensure our tools/frameworks help deliver overall business objectives.
• Collaborate with stakeholders such as Software Engineering, Machine Learning, Machine Learning Platform, and Analytics teams to onboard them to the Lakehouse and adopt the developer tools.
• Participate in code reviews and architecture discussions to exchange actionable feedback with peers.
• Help break down complex projects and requirements into stories for sprints.
• Continuously monitor and improve data platform performance, reliability, and security.
• Stay up-to-date with emerging technologies and industry best practices in data engineering.
• Develop and maintain technical documentation for the data platform, including design, architecture, and operational procedures. Promote best practices for data engineering within the organization.

What we’re looking for:

• Minimum requirements:
  • A bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
  • 3+ years of experience in data platform development, data engineering, or related fields.
  • Proficiency in data engineering tech stack; Databricks / PostgreSQL / Python / Spark / Kafka / SQL / AWS / Airflow / DBT / containers and orchestration (Docker, Kubernetes) and others.
  • Ability to approach problems with first principles thinking, embrace ambiguity, and enjoy collaborative work on complex solutions.
• Preferred qualifications:
  • Strong foundation in algorithms and data structures and their real-world use cases.
  • Strong analytical and troubleshooting skills, with the ability to analyze complex technical challenges and deliver effective solutions.
  • Experience and understanding of distributed systems, data architecture design, and big data technologies (e.g., Spark, Kafka, Lakehouse, Databricks).
  • Experience with AWS technologies (e.g., AWS Lambda, Redshift, RDS, S3, etc.).
  • Good knowledge of DevOps engineering using Continuous Integration/Delivery tools like Kubernetes, Jenkins, Terraform, etc., thinking about automation, alerting, monitoring, security, and other declarative infrastructure.
  • Ability to explain complex concepts in easy-to-understand ways and navigate environments where problems are not well-defined (and evolve quickly).

Position Location - This role is available in the following locations: Remote, San Mateo, Columbus.

Travel Requirements - This team has periodic on-site collaboration sessions twice or thrice a year. Upstart will cover all travel-related expenses if you need to travel to make these meetups.

What you'll love:

• Competitive Compensation (base + bonus & equity).
• Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart.
• 401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings.
• Employee Stock Purchase Plan (ESPP).
• Life and disability insurance.
• Generous holiday, vacation, sick and safety leave.
• Supportive parental, family care, and military leave programs.
• Annual wellness, technology & ergonomic reimbursement programs.
• Social activities including team events and onsites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering.
• Catered lunches + snacks & drinks when working in offices.

#LI-REMOTE

#LI-Associate