Senior Software Engineer

Pagos Consultants; India; Hybrid; INR 1,500,000 - 2,500,000; Full time

Benefits offered by this job

Competitive compensation

Equity

Remote flexibility

In-person team offsites

Job summary

Pagos Consultants is seeking a Backend Engineer focused on Data & Orchestration to own a rapidly evolved data platform. You will build dependable, well-documented, scalable systems spanning data pipelines, production services, and infrastructure.

This is not limited to ETL; you will work across pipelines, external data sources, and integrations, while mentoring junior engineers and shaping the data strategy for a fast-growing company.

Qualifications

• 3-10 years hands-on engineering experience in startups or high-growth companies.
• Advanced Python skills, including asynchronous code and long-running data jobs.
• Experience operating unreliable external data sources, including scrapers and platform APIs with proxies and rate limits.
• Experience designing fault-tolerant, event-driven pipelines using Airflow, Dagster, or similar tooling.
• Familiarity with databases and warehouses like Postgres, ClickHouse, MongoDB, or Redshift, with performance considerations.
• Strong monitoring practices using Datadog or equivalent tools and meaningful quality checks.
• Comfort with Docker, Terraform, CI/CD, cloud infra, RBAC, and secrets management.
• Ability to simplify and document a messy data environment and mentor junior engineers.
• Strong engineering fundamentals and use of modern AI coding tools.

Responsibilities

• Own end-to-end data pipelines from orchestration to storage and analytics.
• Maintain and operate scrapers and external data sources despite rate limits and anti-bot measures.
• Build monitoring, data quality checks, and alerting for data freshness and accuracy.
• Manage CI/CD, IaC, cloud infra, access control, and secrets for data platforms.
• Consolidate fragmented systems into a simpler, well-documented architecture.
• Communicate data capabilities and trade-offs to non-technical colleagues and mentor juniors.

Skills

Python

Async Python

Airflow

Dagster

Data pipelines

CI/CD

Terraform

Docker

Datadog

Postgres

Education

Bachelor's degree in CS or related field

Tools

Airflow

Dagster

Postgres

ClickHouse

Redshift

Terraform

Docker

Datadog

Job description

We are a fast-growing, venture-backed technology company operating at the intersection of media, entertainment, and consumer growth. We use technology and data to create, distribute, and scale content for global audiences, with products that have already reached significant engagement at scale.

The team combines an entrepreneurial operating model with deep expertise across consumer technology, growth, data, and creative production. We are building quickly in a large and evolving market, with a high bar for ownership, experimentation, and measurable outcomes.

What you will do

The company’s products and decisions depend on reliable data systems. As a Backend Engineer focused on Data & Orchestration, you will take ownership of a rapidly evolved data platform and turn it into a dependable, documented, and scalable system.

This is not solely an ETL or warehouse role. You will work across data pipelines, production backend services, infrastructure, and the integrations that support them.

Typical responsibilities include:

• Keeping scrapers and third-party platform integrations operational despite unreliable sources, rate limits, anti-bot measures, and changing APIs.
• Owning event-driven data pipelines end to end, from orchestration tools such as Airflow or Dagster to databases and warehouses.
• Building monitoring, alerting, and data-quality checks for freshness, volume, schema, and values.
• Managing CI/CD, infrastructure as code, cloud systems, access controls, and secrets for data infrastructure.
• Consolidating fragmented systems into a simpler, documented, maintainable architecture.
• Communicating data capabilities and limitations to non-technical colleagues and mentoring junior engineers as the team grows.

Who you are

You are an engineer who takes ownership of production systems from design through day-to-day operation. You have worked in a small or fast-moving environment where you were trusted to build and run critical infrastructure.

Your background will typically include:

• 3-10 years of hands-on engineering experience, primarily in startups or high-growth companies.
• Advanced Python skills, including asynchronous code and long-running data jobs.
• Experience operating unreliable external data sources, including scrapers, platform APIs, or unofficial endpoints, with knowledge of proxies, rate limits, and anti-bot measures.
• Experience designing fault-tolerant, event-driven pipelines processing high data volumes, using Airflow, Dagster, task queues, or similar tooling.
• Familiarity with databases and warehouses such as Postgres, ClickHouse, MongoDB, or Redshift, including performance and cost considerations.
• Strong monitoring and data-reliability practices, using Datadog or comparable tools and implementing meaningful quality checks.
• Comfort with Docker, Terraform, CI/CD, cloud infrastructure, role-based access control, and secrets management.
• A record of simplifying and documenting a messy data environment, communicating trade-offs clearly, and supporting more junior engineers.
• Strong engineering fundamentals, sound judgment, and effective use of modern AI coding tools.
• Comfort operating in a fast-paced, performance-oriented environment.

What makes this exciting

You will own data systems that underpin the company’s core operations and have substantial influence over how they evolve. This is an autonomous role with the opportunity to improve reliability, reduce complexity, and establish the foundations for future scale.

The company offers competitive compensation, equity, remote flexibility, and periodic in-person team offsites.

• competitive compensation
• equity
• remote flexibility
• periodic in-person team offsites

The process moves quickly and typically includes: