Senior Data Engineer

7Seventy; Northern (KY); On-site; USD 156,000 - 180,000; Full time

Benefits offered by this job

Cash bonus potential

Equity

Medical, dental, and vision benefits

401(k)

Unlimited PTO

Remote-first

Job summary

7Seventy is seeking a Senior Data Engineer to own a large-scale daily data ingestion engine for a revenue management platform. This is a full-time, remote position based in the United States and involves managing multi-terabyte datasets that support dynamic pricing algorithms.

You will work with Ruby on Rails and AWS services (RDS, Aurora, Athena), optimize ingestion workflows, and ensure reliable data delivery to the core application.

Qualifications

• 5+ years of experience in Data Engineering or Backend Engineering handling multi-terabyte data.
• 10+ years of overall engineering experience in technology companies.
• Advanced knowledge of relational databases, especially PostgreSQL and Amazon Aurora.
• Strong programming skills in Ruby and Ruby on Rails, or Python with Ruby willingness.
• Experience with AWS cloud services and infra-as-code tools (Terraform, CloudFormation).
• Experience implementing CI/CD pipelines and data pipelines at scale.

Responsibilities

• Architect, optimize, and oversee daily ingestion pipelines for 14M+ listings.
• Tune AWS RDS PostgreSQL and Amazon Aurora for high-throughput operations.
• Improve background job orchestration and ETL processes.
• Collaborate with engineers to make data accessible to core applications.
• Apply DevOps practices to AWS infra, CI/CD, and IaC workflows.
• Build monitoring, alerting, and observability to preempt issues.

Skills

Data engineering

Backend engineering

Ruby/Python

Distributed systems

AWS

DevOps

SQL optimization

Tools

PostgreSQL

Amazon Aurora

Resque/Sidekiq

Terraform/CloudFormation

CI/CD

Job description

Annual base salary: $156,000 - $180,000 per year, depending on experience.

Additional compensation: Cash bonus potential and equity.

Employment type: Full-Time

About the Role

This opportunity is for a Senior Data Engineer to take ownership of a large-scale daily data ingestion engine supporting a revenue management platform for the flexible rental market. This is a full-time, remote position based in the United States.

The platform tracks calendar, availability, and pricing information for more than 14 million listings worldwide, ingesting updated future-calendar data for every listing each day. This creates a highly dynamic, multi-terabyte dataset that directly supports the pricing algorithms used by the core product.

The role works within a Ruby on Rails and Resque environment supported by AWS RDS for PostgreSQL, Amazon Aurora, and Athena. The Senior Data Engineer will oversee and improve existing ingestion workflows, integrate new data sources, optimize database and processing performance, and ensure that data is delivered reliably to the core application.

This position requires full ownership of the reliability, speed, scalability, observability, and cost efficiency of business-critical data infrastructure. The daily synchronization process is essential to the product, making dependable pipeline performance and rapid issue resolution central to this role.

What You’ll Do

• Architect, optimize, and oversee daily ingestion pipelines that process calendar data for more than 14 million listings.
• Tune and scale AWS RDS PostgreSQL and Amazon Aurora databases to support high-throughput read and write operations and multi-terabyte storage requirements.
• Improve background job orchestration to ensure data is processed efficiently and delivered on schedule.
• Design and build reliable ETL processes that integrate new and complex data sources into the existing data ecosystem.
• Collaborate with application engineers to make multiple versions and aggregations of data easily accessible to the core application.
• Apply DevOps best practices to maintain and improve AWS infrastructure, CI/CD pipelines, and infrastructure-as-code workflows.
• Build comprehensive monitoring, alerting, dashboards, and observability tools that identify anomalies and bottlenecks before they affect customers or business operations.
• Proactively identify opportunities to improve the performance, scalability, reliability, and cost efficiency of data infrastructure.
• Troubleshoot complex issues involving distributed systems, large datasets, databases, background processing, and cloud infrastructure.
• Design safeguards and repeatable processes that detect difficult-to-find data issues before they affect downstream systems.
• Evaluate technical tradeoffs and determine when to implement a long-term architectural solution or a practical short-term fix.
• Communicate data engineering constraints, system behavior, and architectural decisions clearly to engineering and product stakeholders.

Qualifications

• 5+ years of experience in Data Engineering or Backend Engineering involving high-velocity, multi-terabyte datasets.
• 10+ years of overall engineering experience within technology companies.
• Advanced knowledge of relational databases, particularly PostgreSQL and Amazon Aurora.
• Experience tuning databases, optimizing complex queries, and managing large-scale indexing strategies.
• Strong programming skills in Ruby and Ruby on Rails, or expert-level experience in a similar language such as Python with a strong willingness to learn Ruby.
• Experience operating background processing frameworks at scale, such as Resque, Sidekiq, Celery, or similar technologies.
• Hands-on experience with AWS cloud services.
• Experience provisioning infrastructure with Terraform, CloudFormation, or similar infrastructure-as-code tools.
• Experience building, maintaining, or improving CI/CD pipelines.
• Strong data modeling skills, including the ability to balance fast ingestion with efficient application queries.
• Demonstrated ability to identify performance bottlenecks in complex distributed systems and implement effective solutions.
• Experience working independently, communicating asynchronously, and managing priorities effectively in a remote environment.
• Strong systems thinking and an understanding of how background processing, PostgreSQL, and AWS infrastructure interact.
• Ability to remain calm and methodical while resolving critical pipeline and data infrastructure issues.
• Strong written and verbal communication skills, including the ability to explain complex technical concepts in clear language.
• A practical approach to engineering decisions, with the ability to balance technical quality, delivery speed, and business needs.
• Strong attention to detail and a process-driven approach to data quality, monitoring, and issue prevention.

Benefits and Opportunities

• Opportunity to own large-scale data pipelines within a growing SaaS environment.
• Direct impact on product reliability, data availability, and customer experience.
• Autonomy to shape projects and influence the direction of future technical development.
• Collaborative small-team environment with highly visible individual contributions.
• Cash bonus potential and equity.
• Full medical, dental, and vision benefits for U.S. employees.
• Fidelity 401(k) plan for U.S. employees.
• Unlimited paid time off.
• Remote-first working environment focused on sustainable performance and work-life balance.

Recruitment notice: all communication only happens from authorized email addresses ending [e-mail]. We never ask for payments or sensitive documents. Suspect a scam? Email [e-mail]