Automation Engineer — Data Pipelines & Integrations

Astreya; Fremont (CA); On-site; USD 130,000 - 180,000; Full time

Job summary

Astreya is seeking an Automation/Data Engineer to design and implement automated workflows, data pipelines, and runbooks for managing partner data and operations. You will build self-service tools, automated alerts, and ETL pipelines to synchronize information across systems.

Responsibilities include data quality governance, reconciliation scripting, incident-driven automation, and dashboards to monitor platform adoption and ROI.

Qualifications

• 5+ years of experience in automation or data engineering.
• Strong Python proficiency.
• Experience building and consuming APIs (REST/GraphQL).
• Familiarity with SQL and ETL concepts.
• Experience with scheduling/orchestration tools (Airflow, cron).
• Understanding of data quality principles (validation, deduplication, reconciliation).
• Ability to work with large datasets across multiple sources.
• Strong problem-solving skills and independence.

Responsibilities

• Design and implement automated workflows for partner onboarding, contact updates, service renewals, and data lifecycle management.
• Create self-service tools for bulk data operations without engineering support.
• Build automated alerting for stale data, missing information, or expiring service agreements.
• Build ETL pipelines that synchronize partner data across internal systems.
• Migrate legacy data from spreadsheets, wikis, and siloed databases into the centralized platform.
• Develop reconciliation scripts to detect discrepancies between systems and maintain data consistency.
• Build tools that auto-retrieve relevant partner contacts during network incidents.
• Create automated escalation and outreach workflows triggered by network events.
• Develop runbook automation to standardize and speed up repetitive operational tasks.
• Build dashboards tracking data quality, freshness, and platform adoption.
• Implement automated health checks and audit scripts to detect duplicates or incomplete entries.
• Create scheduled reports for leadership on automation ROI and data integrity metrics.

Skills

Python

APIs REST/GraphQL

SQL & ETL

Airflow / Scheduling

Data quality & reconciliation

Large datasets

Problem solving

Job description

Astreya is seeking an Automation/Data Engineer to design and implement automated workflows, data pipelines, and runbooks for managing partner data and operations. You will build self-service tools, automated alerts, and ETL pipelines to synchronize information across systems.

Responsibilities include data quality governance, reconciliation scripting, incident-driven automation, and dashboards to monitor platform adoption and ROI.