Senior Data Engineer — AI-Ready Data Pipelines (Remote)

RecruiterForge; United States; Remote; USD 134,000 - 175,000; Full time

Benefits offered by this job

Unlimited PTO

Parental leave

401(k) matching

Wellness stipend

Employer-sponsored insurance (employee

Union Square office optional

Job summary

RecruiterForge is seeking a Senior Data Engineer to design, build, and operate cloud data pipelines and reusable data products for analytics and risk across the enterprise. You will combine SQL, Python, dimensional modeling, and production ownership to improve platform reliability and govern data for AI-powered products.

You will design scalable batch, streaming, and event-driven pipelines, develop reusable data models, and build ETL/ELT workflows using modern frameworks.

Qualifications

• Five+ years designing, building, and operating scalable data pipelines in production.
• Advanced SQL and strong Python for maintainable, production-grade code.
• Hands-on experience with cloud data platforms (Azure preferred; AWS/GCP transferable).
• Strong modeling fundamentals: fact/dimension tables, SCDs, reusable analytical models.
• Experience with ETL/ELT frameworks (dbt) and orchestration (Airflow/Dagster).
• Experience with streaming/CDC/event-driven architectures (Kafka, Event Hubs, Spark).
• Understanding of warehouses, lakes, lakehouses, governance, metadata, lineage, observability.
• Hands-on experience with a major cloud provider (Azure/AWS/GCP).
• Strong software engineering practices: Git, code reviews, CI/CD, IaC, production troubleshooting.
• Ability to make architectural decisions and improve scalability, performance, and cost.
• Experience translating requirements across Engineering, Analytics, Product, Risk, Finance, Data Science.

Responsibilities

• Design and operate scalable batch, streaming, and event-driven pipelines across enterprise sources.
• Develop reusable data products and dimensional/semantic models for analytics and decision-making.
• Build and optimize ETL/ELT workflows with modern transformation/orchestration frameworks.
• Strengthen data quality and observability with automated validation and alerts.
• Create near-real-time capabilities for monitoring, risk signals, and operational intelligence.
• Improve performance and cost efficiency by establishing scalable architecture patterns.
• Build shared frameworks and automated workflows to accelerate delivery.
• Apply CI/CD, infrastructure as code, and production ownership practices.
• Partner with Data Science teams on reliable AI-ready datasets and pipelines.
• Lead complex initiatives, mentor engineers, and raise engineering standards.

Skills

SQL

Python

Data modeling

ETL/ELT

CI/CD

Mentoring

Data quality

Observability

Cloud platforms

Azure

AWS

GCP

Airflow

dbt

Kafka

Tools

Snowflake

Databricks

BigQuery

Azure

AWS

GCP

Dagster

Airflow

Job description

RecruiterForge is seeking a Senior Data Engineer to design, build, and operate cloud data pipelines and reusable data products for analytics and risk across the enterprise. You will combine SQL, Python, dimensional modeling, and production ownership to improve platform reliability and govern data for AI-powered products.

You will design scalable batch, streaming, and event-driven pipelines, develop reusable data models, and build ETL/ELT workflows using modern frameworks.