Senior Data Ingest Engineer - Cloud Integrations (Remote)
Beaconai
A complete application in a minute
Tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
AgileEngine is seeking a Mid-level Data Engineer to build and maintain dbt pipelines and Snowflake data marts powering customer reporting, spend analytics, and AI features.
The role requires solid dbt experience, data ingestion/orchestration tools like Airbyte or Prefect, 3+ years in data or analytics engineering on production pipelines, strong SQL and Python, dimensional modeling, Snowflake or similar cloud warehouse, and an upper-intermediate English level.
Qualifications
- 3+ years in analytics engineering, data engineering, or related role with production pipelines.
- Solid dbt experience: modeling, tests, macros, and incremental models.
- Strong SQL and Python.
- Data modelling fundamentals: dimensional modelling, data marts, grain and conformance.
- Experience with a modern cloud warehouse (Snowflake preferred).
- Experience with ingestion tooling and orchestration (Airbyte, Prefect, or equivalents).
- Familiarity with guardrails around output of agentic tools.
- Upper-intermediate English level.
Responsibilities
- Build and maintain dbt pipelines, data marts, and warehouse models for in-app reporting and analytics.
- Translate complex procurement logic into maintainable pipelines and validate models.
- Develop models within data mart architecture following grain and conformance conventions.
- Contribute to semantic layer for metrics and dimensions across systems.
- Maintain boundary between PII and reporting-safe data.
- Build and maintain FastAPI services exposing reporting marts to customers.
- Ingest data via Airbyte, OneSchema, and S3 into the warehouse; support Forward Deployed Engineering.
- Implement data quality checks and alerting; ensure data accuracy for customers.
Skills
Tools
Job description
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Mid-level Data Engineer to build and maintain dbt pipelines and Snowflake data marts behind customer-facing reporting, spend analytics, and AI features.
The mandatory requirements are solid dbt experience (modeling, tests, macros, and incremental models), ingestion and orchestration tools such as Airbyte or Prefect, 3+ years in data or analytics engineering on production pipelines, strong SQL and Python, dimensional modeling, Snowflake or a similar cloud warehouse, and an upper-intermediate English level.
WHAT YOU WILL DO
- Build and maintain the dbt pipelines, data marts, and warehouse models that serve in-app reporting, spend analytics, AI features, and internal analytics, treating them as production systems.
- Translate complicated procurement business logic into maintainable, well-tested pipeline code, and notice when a model is valid-looking but wrong.
- Build models within our data mart architecture, following the chapter's conventions for grain, conformed dimensions, and incremental patterns, and propose improvements when you find them.
- Contribute to and help buildout the semantic layer that our internal MCP servers and AI agents query, so that metrics and dimensions are defined once and answered consistently.
- Maintain the boundary between PII and agent/reporting-safe data.
- Build and maintain the FastAPI services that expose reporting marts to customers.
- Build and maintain ingestion pipelines (Airbyte, OneSchema, S3) into the warehouse, and support our Forward Deployed Engineering function in bringing customer data into our systems.
- Implement data quality checks: freshness, schema and reconciliation tests, and alerting, so problems surface before customers find them.
- Implement metric definitions faithfully, and flag conflicting or ambiguous definitions to the chapter rather than guessing.
- Keep documentation and lineage current so that humans and AI agents can both find and trust what's in the warehouse.
- Tune Snowflake performance and cost within the models you build.
- Use agentic coding tools in your daily work, within the guardrails (tests, conventions, review patterns) the team maintains, and understand why those guardrails exist.
- Share what you learn through code review and team discussion.
- Communicate clearly with engineering, product, and customer-facing teams about what the data means and what it can and can't do.
MUST HAVES
- 3+ years in analytics engineering, data engineering, or a closely related role, including hands-on work on production data pipelines that other systems or customers depended on.
- Solid dbt experience: modeling, tests, macros, and incremental models.
- Strong SQL and working Python.
- Data modeling fundamentals: dimensional modeling, data marts, grain and conformance.
- Experience with a modern cloud warehouse (Snowflake preferred).
- Experience with ingestion tooling and orchestration (Airbyte, Prefect, or equivalents).
- Familiarity with agentic coding tools and an understanding of why guardrails around their output matter.
- Deep curiosity about the business: you want to understand what the data means and how customers use it, not just how it flows.
- Software engineering discipline for analytics code: Git, code review, CI/CD.
- Can take a multi-sprint piece of work from spec to production with normal oversight, and can explain tradeoffs to technical and non-technical stakeholders.
NICE TO HAVES
- Experience building or maintaining API services on top of warehouse data (FastAPI or similar).
- Experience with a semantic layer or governed metric definitions that multiple consumers rely on, including for LLM-driven or agent-driven querying.
- Experience exposing warehouse data to customers through embedded analytics or customer-facing APIs.
- Experience with data observability tooling.
- Experience supporting customer data onboarding or implementation teams.
- Experience deploying data pipelines across multiple regions and managing PII or sensitive data.
- Knowledge of procurement and/or supply chain data models.
- Prior experience in enterprise software and startups.
PERKS AND BENEFITS
- Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
- Exciting projects : Modern solutions with Fortune 500 and top product companies.
- Flextime : Flexible schedule with remote and office options.
Job Description
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
ABOUT THE ROLE
We are looking for a Mid-level Data Engineer to build and maintain dbt pipelines and Snowflake data marts behind customer-facing reporting, spend analytics, and AI features.
The mandatory requirements are solid dbt experience (modeling, tests, macros, and incremental models), ingestion and orchestration tools such as Airbyte or Prefect, 3+ years in data or analytics engineering on production pipelines, strong SQL and Python, dimensional modeling, Snowflake or a similar cloud warehouse, and an upper-intermediate English level.
WHAT YOU WILL DO
- Build and maintain the dbt pipelines, data marts, and warehouse models that serve in-app reporting, spend analytics, AI features, and internal analytics, treating them as production systems.
- Translate complicated procurement business logic into maintainable, well-tested pipeline code, and notice when a model is valid-looking but wrong.
- Build models within our data mart architecture, following the chapter's conventions for grain, conformed dimensions, and incremental patterns, and propose improvements when you find them.
- Contribute to and help buildout the semantic layer that our internal MCP servers and AI agents query, so that metrics and dimensions are defined once and answered consistently.
- Maintain the boundary between PII and agent/reporting-safe data.
- Build and maintain the FastAPI services that expose reporting marts to customers.
- Build and maintain ingestion pipelines (Airbyte, OneSchema, S3) into the warehouse, and support our Forward Deployed Engineering function in bringing customer data into our systems.
- Implement data quality checks: freshness, schema and reconciliation tests, and alerting, so problems surface before customers find them.
- Implement metric definitions faithfully, and flag conflicting or ambiguous definitions to the chapter rather than guessing.
- Keep documentation and lineage current so that humans and AI agents can both find and trust what's in the warehouse.
- Tune Snowflake performance and cost within the models you build.
- Use agentic coding tools in your daily work, within the guardrails (tests, conventions, review patterns) the team maintains, and understand why those guardrails exist.
- Share what you learn through code review and team discussion.
- Communicate clearly with engineering, product, and customer-facing teams about what the data means and what it can and can't do.
MUST HAVES
- 3+ years in analytics engineering, data engineering, or a closely related role, including hands-on work on production data pipelines that other systems or customers depended on.
- Solid dbt experience: modeling, tests, macros, and incremental models.
- Strong SQL and working Python.
- Data modeling fundamentals: dimensional modeling, data marts, grain and conformance.
- Experience with a modern cloud warehouse (Snowflake preferred).
- Experience with ingestion tooling and orchestration (Airbyte, Prefect, or equivalents).
- Familiarity with agentic coding tools and an understanding of why guardrails around their output matter.
- Deep curiosity about the business: you want to understand what the data means and how customers use it, not just how it flows.
- Software engineering discipline for analytics code: Git, code review, CI/CD.
- Can take a multi-sprint piece of work from spec to production with normal oversight, and can explain tradeoffs to technical and non-technical stakeholders.
- Upper-intermediate English level.
NICE TO HAVES
- Experience building or maintaining API services on top of warehouse data (FastAPI or similar).
- Experience with a semantic layer or governed metric definitions that multiple consumers rely on, including for LLM-driven or agent-driven querying.
- Experience exposing warehouse data to customers through embedded analytics or customer-facing APIs.
- Experience with data observability tooling.
- Experience supporting customer data onboarding or implementation teams.
- Experience deploying data pipelines across multiple regions and managing PII or sensitive data.
- Knowledge of procurement and/or supply chain data models.
- Prior experience in enterprise software and startups.
PERKS AND BENEFITS
- Professional growth : Mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation : USD-based pay with education, fitness, and team activity budgets.
- Exciting projects : Modern solutions with Fortune 500 and top product companies.
- Flextime : Flexible schedule with remote and office options.
Requirements
Must Haves: 5+ years of experience as a Product Manager working on technology-powered products. Proven experience managing mobile applications (iOS and/or Android), ideally consumer apps used at scale. Strong understanding of UI/UX principles and experience working closely with designers to deliver user-friendly products. Hands-on experience with AI tools, with the ability to build at least a simple technical solution yourself (for example, a prototype, an automation, or an AI-powered feature built with no-code tools or LLM APIs). Led product development on complex features from the first iteration through many later ones. A deep understanding of modern product discovery and product delivery methods. Strong analytical skills and experience with product analytics tools and A/B testing. Proven ability to work constructively with engineers, designers, and company leaders. Bachelor’s degree or equivalent practical experience.
The Role: Builds performant data processing pipelines, manages relational databases, and constructs cloud-portable data lake environments using modern open storage formats and embedded analytical engines.
Responsibilities: Pipeline Design: Construct resilient data processing pipelines in Python using Medallion architecture principles (Bronze/Silver/Gold) to transform raw data into analytics-ready assets.
Open Storage Management: Standardize data storage using open formats including Parquet, Apache Iceberg, and Delta Lake to ensure cross-cloud compatibility.
Embedded Analytics: Leverage DuckDB integrated with Python for fast, lightweight, and performant localized data processing within ETL workflows.
Database Operations: Architect and optimize production PostgreSQL schemas while utilizing SQLite for embedded or lightweight localized storage needs.
Distributed Compute: Scale heavy ETL, data transformation, and analytics workloads using Databricks or Apache Spark
Requirements: Advanced SQL proficiency with deep PostgreSQL expertise and working knowledge of SQLite.
Hands-on experience building robust analytical pipelines using Python and DuckDB.
Mastery of open table and storage formats (Parquet, Apache Iceberg, Delta Lake).
Proven track record designing data lakes using the Medallion data processing architecture.
Familiarity with the Databricks / PySpark ecosystem for distributed processing.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
