Sr Data Engineer

Dynatrace; Bengaluru; Hybrid; INR 2,800,000 - 4,200,000; Full time

Benefits offered by this job

Hybrid work model

Wellness days

AI-driven workflows

Volunteering day

Regular team events

Job summary

Dynatrace in Bengaluru is seeking an experienced Data Engineer to design, build, and optimize scalable data ingestion pipelines for product telemetry and enterprise applications data. This role emphasizes rapid prototyping of pipelines to enable data exploration, analytics, and downstream consumption in a fast-paced environment.

You will work with Python, Fivetran, Kafka, Spark, and Snowflake to deliver reliable, observable data flows, enabling analytics and rapid experimentation while

Qualifications

• 6+ years of hands-on data engineering and ingestion automation experience.
• Proven work ingesting business data (CRM, ERP, financial, usage data).
• Strong Python and Fivetran experience for pipelines, automation, and validation.

Responsibilities

• Design and implement data ingestion pipelines for product telemetry and business data.
• Build end-to-end pipelines from sources to Snowflake with reliability and observability.
• Optimize performance, handle rate limits, and enable CDC with micro-batching.

Skills

Data ingestion

Python

Fivetran

Kafka

Spark

SQL

CDC / incremental loads

DevOps / CI-CD

API rate limits

Tools

Fivetran

Kafka

Spark

Snowflake

S3 lakehouse

CI/CD tooling

Job description

# Sr Data Engineer## **Your role at Dynatrace**We are seeking an experienced **Data Engineer** to design, build, and optimize **scalable data ingestion pipelines** for **product telemetry and enterprise business applications data**. This role operates in a fast‐paced environment, rapidly prototyping data pipelines to enable **data exploration, analytics, and downstream consumption**.**Responsibilities*** Design and implement modern **data ingestion pipelines** for business systems data using **Fivetran**, **Python and Bulk APIs**, **S3-based lakehouse architectures**, and **streaming ingestion** (Kafka, Spark)* Build end-to-end automated pipelines from source systems to **Snowflake**, ensuring reliability, scalability, and observability* Apply **advanced SQL** in Snowflake for transformation, standardization, and preparation of analytics-ready datasets* Optimize ingestion performance for **large-scale, high-volume datasets** using API rate-limit handling, micro-batching, and **incremental loading / CDC*** Implement **DevOps and CI/CD practices** for data pipelines, including version control and deployment automation* Partner with analysts, SMEs, and platform teams to **rapidly prototype pipelines** supporting exploration and evolving requirements* Monitor, troubleshoot, and optimize ingestion jobs to ensure **data freshness, accuracy, and performance**## **What will help you succeed*** **6+ years** of hands-on experience in **data engineering and ingestion automation** in cloud or hybrid environments* Proven experience ingesting **business application data** (CRM, ERP, financial, consumption, renewals systems)* Advanced proficiency with **Python** and **Fivetran** (or similar ETL/ELT tool) for pipelines, automation, orchestration, and validation* Expertise with **Kafka, Spark**, and **S3 / lakehouse-style** storage architectures* Strong proficiency with **Snowflake,** ingestion, transformation, and performance optimization* Deep understanding of **ingestion optimization,** rate limits, micro-batching, incremental loads, and **CDC*** Experience applying **DevOps / CI/CD** practices to data pipelines* Ability to work independently and **deliver solutions rapidly** in a fast-paced, iterative environmentDesirable:* Experience with additional **open-source ingestion frameworks and connectors*** Exposure to **event-driven or telemetry-heavy architectures** at scale## **Why you will love being a Dynatracer*** Dynatrace is a leader in unified observability and security.* We provide a culture of excellence with competitive compensation packages designed to recognize and reward performance.* Our employees work with the largest cloud providers, including AWS, Microsoft, and Google Cloud, and other leading partners worldwide to create strategic alliances.* You'll get to work at the forefront of innovation with Dynatrace Intelligence, the industry's first agentic operations system. Bringing together deterministic and agentic AI, it helps teams understand what's happening, why it matters, and what to do next, automatically.* Over 50% of the Fortune 100 companies are current customers of DynatraceApply now**Note to Recruiters and Agencies**: Thank you for your interest in Dynatrace. Please note that **we do not accept unsolicited agency resumes**—do not forward them via our website or directly to Dynatrace employees. Dynatrace will not pay fees for unsolicited resumes, and any resumes received this way will be considered the property of Dynatrace.## Benefits and work-life perksWe offer best-in-class core rewards, including paid time off, financial security benefits, retirement savings plans, and health insurance. Beyond that, you’ll get other benefits and work-life perks designed to make your ride with us even more rewarding.#### Mental health supportOur Employee Assistance Program, powered by Telus Health, offers support for you and your family members.#### Wellness DaysFour company-designated extra paid days off for you to recharge batteries.#### FlexibilityOur hybrid working model and flexible working hours offer you the flexibility you need.#### AI-driven workflowsUse AI as your daily teammate to automate tasks and focus on what matters.#### Learn & developCompany-wide learning perks, designated team's learning days, and more.#### Volunteering dayA day of paid volunteer time to support a community or cause you care about.#### Regular team eventsWe host Global Culture Parties, Family & Friends at Work Day, Global Breakfasts, Green Weeks, Pride Month, and beyond!#### International vibeMost of our offices and teams are proudly multicultural. English is our shared language, but we embrace and learn from each other's cultures.Rewards vary depending on your employment type. Some benefits and perks also differ by location — explore your city to see what’s available there.