Data Engineer (Senior) ID43916

AgileEngine; Rio de Janeiro; Hybrid; BRL 624,000 - 780,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

A leading software company in Brazil is seeking a Senior Data Engineer to transform telemetry into actionable insights and ensure device reliability. The ideal candidate will have 5–8+ years of experience in data engineering, proficiency in Spark and Python, and the ability to support live device rollouts. This full-time role offers competitive USD-based compensation and opportunities for professional growth.

Qualifications

• 5–8+ years of experience in data engineering.
• Experience with Spark or similar tools in production.
• Comfortable supporting live device rollouts.
• Experience building alerting, monitoring, or observability systems.
• Experience turning manual checks into automated guardrails.
• Comfortable supporting live device rollouts and post-launch monitoring.
• Upper-intermediate English level.

Responsibilities

• Turn raw device telemetry into actionable alerts.
• Work with cross-functional teams on device observability.
• Develop automated anomaly detection for logging anomalies.
• Collaborate with QA for testing and automations.
• Develop automated anomaly detection for logging anomalies in device telemetry.
• Build dashboards to track device health and ensure all data artifacts have proper quality, integrity, and reliability.
• Participate in remote or on-site go-lives to monitor device health and triage issues in real time using dashboards.
• Collaborate with QA to ensure access to proper data and pipelines for testing and build automations as needed.
• Develop tooling to simulate various on-device scenarios for launch-readiness.
• Support on-site testing and live device launches remotely by monitoring device health based on metrics and dashboards.
• Triage issues in real time by analyzing logs and identifying failure sources to enable rapid resolution and successful launches.

Skills

Spark (Structured Streaming)

Python

SQL/pandas

Observability systems

Automated guardrails

Streaming fundamentals

Upper-intermediate English

Job description

Join to apply for the Data Engineer (Senior) ID43916 role at AgileEngine.

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people‑first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

As a Data Engineer, you’ll play a key role in ensuring smooth and successful device launches through observability, test automation, and real‑time launch support. You’ll transform raw telemetry into actionable insights, build dashboards and anomaly detection systems, and automate data validation workflows. This role offers the opportunity to work on cutting‑edge devices, collaborate cross‑functionally, and directly impact product reliability and customer experience.

WHAT YOU WILL DO

• Turn raw device telemetry into actionable alerts with strong observability, data quality, and launch support baked in.
• Work with cross‑functional teams to establish device observability and health monitoring.
• Define logging, metrics, and traces for device and pipeline health, and ship dashboards for latency, uptime, error rates, and crash signals.
• Add anomaly detection over telemetry and logs and track health KPIs during launches.
• Develop automated anomaly detection for logging anomalies in device telemetry.
• Build dashboards to track device health and ensure all data artifacts have proper quality, integrity, and reliability.
• Participate in remote or on‑site go‑lives to monitor device health and triage issues in real time using dashboards.
• Collaborate with QA to ensure access to proper data and pipelines for testing and build automations as needed.
• Develop tooling to simulate various on‑device scenarios for launch‑readiness.
• Support on‑site testing and live device launches remotely by monitoring device health based on metrics and dashboards.
• Triage issues in real time by analyzing logs and identifying failure sources to enable rapid resolution and successful launches.

MUST HAVES

• 5–8+ years of experience in data engineering with Spark (Structured Streaming) or similar tools in production.
• Proficiency in Python and strong SQL/pandas skills.
• Solid understanding of streaming fundamentals.
• Experience building alerting, monitoring, or observability systems.
• Experience turning manual checks into automated guardrails.
• Comfortable supporting live device rollouts and post‑launch monitoring.
• Upper‑intermediate English level.

PERKS AND BENEFITS

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever‑growing skills, talent, and contributions with competitive USD‑based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top‑tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work‑life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Referrals increase your chances of interviewing at AgileEngine by 2x.

Seniority level

Mid‑Senior level

Employment type

Full‑time

Job function

IT Services and IT Consulting