Senior Data Engineer

7Seventy

United States

Remote

USD 156,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Cash bonus potential
Equity
Medical, dental, and vision benefits
401(k)
Unlimited PTO
Remote-first

Job summary

7Seventy is seeking a Senior Data Engineer to own a large-scale daily data ingestion engine for a revenue management platform. This is a full-time, remote position based in the United States and involves managing multi-terabyte datasets that support dynamic pricing algorithms.

You will work with Ruby on Rails and AWS services (RDS, Aurora, Athena), optimize ingestion workflows, and ensure reliable data delivery to the core application.

Qualifications

  • 5+ years of experience in Data Engineering or Backend Engineering handling multi-terabyte data.
  • 10+ years of overall engineering experience in technology companies.
  • Advanced knowledge of relational databases, especially PostgreSQL and Amazon Aurora.
  • Strong programming skills in Ruby and Ruby on Rails, or Python with Ruby willingness.
  • Experience with AWS cloud services and infra-as-code tools (Terraform, CloudFormation).
  • Experience implementing CI/CD pipelines and data pipelines at scale.

Responsibilities

  • Architect, optimize, and oversee daily ingestion pipelines for 14M+ listings.
  • Tune AWS RDS PostgreSQL and Amazon Aurora for high-throughput operations.
  • Improve background job orchestration and ETL processes.
  • Collaborate with engineers to make data accessible to core applications.
  • Apply DevOps practices to AWS infra, CI/CD, and IaC workflows.
  • Build monitoring, alerting, and observability to preempt issues.

Skills

Data engineering
Backend engineering
Ruby/Python
Distributed systems
AWS
DevOps
SQL optimization

Tools

PostgreSQL
Amazon Aurora
Resque/Sidekiq
Terraform/CloudFormation
CI/CD

Job description

Annual base salary: $156,000 - $180,000 per year, depending on experience.

Additional compensation: Cash bonus potential and equity.

Employment type: Full-Time

About the Role

This opportunity is for a Senior Data Engineer to take ownership of a large-scale daily data ingestion engine supporting a revenue management platform for the flexible rental market. This is a full-time, remote position based in the United States.

The platform tracks calendar, availability, and pricing information for more than 14 million listings worldwide, ingesting updated future-calendar data for every listing each day. This creates a highly dynamic, multi-terabyte dataset that directly supports the pricing algorithms used by the core product.

The role works within a Ruby on Rails and Resque environment supported by AWS RDS for PostgreSQL, Amazon Aurora, and Athena. The Senior Data Engineer will oversee and improve existing ingestion workflows, integrate new data sources, optimize database and processing performance, and ensure that data is delivered reliably to the core application.

This position requires full ownership of the reliability, speed, scalability, observability, and cost efficiency of business-critical data infrastructure. The daily synchronization process is essential to the product, making dependable pipeline performance and rapid issue resolution central to this role.

What You’ll Do
  • Architect, optimize, and oversee daily ingestion pipelines that process calendar data for more than 14 million listings.
  • Tune and scale AWS RDS PostgreSQL and Amazon Aurora databases to support high-throughput read and write operations and multi-terabyte storage requirements.
  • Improve background job orchestration to ensure data is processed efficiently and delivered on schedule.
  • Design and build reliable ETL processes that integrate new and complex data sources into the existing data ecosystem.
  • Collaborate with application engineers to make multiple versions and aggregations of data easily accessible to the core application.
  • Apply DevOps best practices to maintain and improve AWS infrastructure, CI/CD pipelines, and infrastructure-as-code workflows.
  • Build comprehensive monitoring, alerting, dashboards, and observability tools that identify anomalies and bottlenecks before they affect customers or business operations.
  • Proactively identify opportunities to improve the performance, scalability, reliability, and cost efficiency of data infrastructure.
  • Troubleshoot complex issues involving distributed systems, large datasets, databases, background processing, and cloud infrastructure.
  • Design safeguards and repeatable processes that detect difficult-to-find data issues before they affect downstream systems.
  • Evaluate technical tradeoffs and determine when to implement a long-term architectural solution or a practical short-term fix.
  • Communicate data engineering constraints, system behavior, and architectural decisions clearly to engineering and product stakeholders.
Qualifications
  • 5+ years of experience in Data Engineering or Backend Engineering involving high-velocity, multi-terabyte datasets.
  • 10+ years of overall engineering experience within technology companies.
  • Advanced knowledge of relational databases, particularly PostgreSQL and Amazon Aurora.
  • Experience tuning databases, optimizing complex queries, and managing large-scale indexing strategies.
  • Strong programming skills in Ruby and Ruby on Rails, or expert-level experience in a similar language such as Python with a strong willingness to learn Ruby.
  • Experience operating background processing frameworks at scale, such as Resque, Sidekiq, Celery, or similar technologies.
  • Hands-on experience with AWS cloud services.
  • Experience provisioning infrastructure with Terraform, CloudFormation, or similar infrastructure-as-code tools.
  • Experience building, maintaining, or improving CI/CD pipelines.
  • Strong data modeling skills, including the ability to balance fast ingestion with efficient application queries.
  • Demonstrated ability to identify performance bottlenecks in complex distributed systems and implement effective solutions.
  • Experience working independently, communicating asynchronously, and managing priorities effectively in a remote environment.
  • Strong systems thinking and an understanding of how background processing, PostgreSQL, and AWS infrastructure interact.
  • Ability to remain calm and methodical while resolving critical pipeline and data infrastructure issues.
  • Strong written and verbal communication skills, including the ability to explain complex technical concepts in clear language.
  • A practical approach to engineering decisions, with the ability to balance technical quality, delivery speed, and business needs.
  • Strong attention to detail and a process-driven approach to data quality, monitoring, and issue prevention.
Benefits and Opportunities
  • Opportunity to own large-scale data pipelines within a growing SaaS environment.
  • Direct impact on product reliability, data availability, and customer experience.
  • Autonomy to shape projects and influence the direction of future technical development.
  • Collaborative small-team environment with highly visible individual contributions.
  • Cash bonus potential and equity.
  • Full medical, dental, and vision benefits for U.S. employees.
  • Fidelity 401(k) plan for U.S. employees.
  • Unlimited paid time off.
  • Remote-first working environment focused on sustainable performance and work-life balance.

Recruitment notice: all communication only happens from authorized email addresses ending in@7seventy.net. We never ask for payments or sensitive documents. Suspect a scam? Email report@7seventy.net

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Remote, Large-Scale Data Pipelines
Senior Data Engineer - Remote, Large-Scale Data Pipelines

7Seventy • United States

Hybrid
USD 156,000 - 180,000
Cash bonus potential
Equity
Medical, dental, and vision benefits
+3
Senior Backend Data Engineer
Senior Backend Data Engineer

7Seventy • United States

Hybrid
USD 150,000 - 240,000
Equity participation
Medical, dental, and vision coverage
401(k) plan
+1
Senior Data Engineer
Senior Data Engineer

7Seventy • New York (NY)

Hybrid
USD 160,000 - 180,000
Employer 401(k) match
Wellness stipend
Remote-friendly, optional NYC office
+1
Senior Data Engineer / $160k–$200k + Equity / 100% Remote
Senior Data Engineer / $160k–$200k + Equity / 100% Remote

Halian | Managed Services, Recruitment Agency & Contract Staffing • United States

Remote
USD 160,000 - 200,000
Equity
Remote work
Senior Software Engineer - Data Engineering
Senior Software Engineer - Data Engineering

Oxbow Talent • United States

Remote
USD 140,000 - 190,000
Fully remote
Travel to Boston 2–3x per year
Staff Data Engineer - Remote, Real-Time Pipelines
Staff Data Engineer - Remote, Real-Time Pipelines

Renew Home, LLC • United States

Remote
USD 170,000 - 220,000
Remote work
Home office setup allowance
Flexible PTO
+2
Senior Data Engineer
Senior Data Engineer

Aitomic Jobs • United States

Remote
USD 120,000 - 160,000
Data Engineer
Data Engineer

Atlantic Talent Recruitment • Boston (MA)

Hybrid
USD 90,000 - 120,000
Competitive salary with performance-based incentives
Comprehensive health, dental, and vision insurance
401(k) retirement plan with company match
+3
Senior Data Engineer
Senior Data Engineer

Throttle Up Technologies, LLC • United States

Remote
USD 100,000 - 160,000
Dental insurance
Health insurance
Life insurance
+2
Senior Data Engineer (Python)
Senior Data Engineer (Python)

Proxify AB • United States

Remote
USD 120,000 - 180,000
Predictable monthly payments
Flexible withdrawal options
Remote-first culture
+1