Software Engineer II, Data Engineering

Jobtailor; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Jobtailor in Bengaluru, India is seeking a Data Engineer to own production data pipelines, improve reliability, and reduce technical debt. You will translate business needs into robust, low-latency data APIs.

You will work with Python, SQL, Databricks, Delta Lake, and Airflow, implement CDC patterns, and contribute to observability, testing, and incident response.

Qualifications

• 3+ years as a Data Engineer, including ownership of production pipelines.
• Strong Python programming skills.
• Proficient SQL with ability to write correct queries.
• Experience with Databricks, Delta Lake, and Airflow in production.
• Experience with CDC patterns for real-time data synchronization.
• Test-driven development discipline.
• Able to operate independently under ambiguity.

Responsibilities

• Own reliability and performance of production pipelines across our product catalog infrastructure.
• Identify and reduce technical debt.
• Build and maintain low latency data APIs.
• Implement CDC patterns to keep catalog data synchronized.
• Build monitoring, observability, and automated testing.
• Translate business requirements from non-technical stakeholders into durable pipeline logic.
• Own code versioning, deployment, and incident response.

Skills

Data Engineer

Python

SQL

Independent operation

Stakeholder communication

Test-driven development

Tools

Databricks

Delta Lake

Airflow

Job description

• Own reliability and performance of operational pipelines across our product catalog infrastructure
• Identify and reduce technical debt
• Build and maintain low latency data APIs
• Implement CDC patterns to keep catalog data synchronized
• Build monitoring, observability, and automated testing
• Translate business requirements from non-technical stakeholders into durable pipeline logic
• Own code versioning, deployment, and incident response

Requirements

• 3+ years as a Data Engineer, including solo or primary ownership of production pipelines
• Strong Python
• Strong SQL with ability to write correct queries
• Databricks, Delta Lake, Airflow for production orchestration
• Experience with CDC patterns for real-time or near‑real‑time data synchronization
• Test‑driven development discipline
• Operates independently under ambiguity

Core Competencies

Demonstrates expertise in building and maintaining operational data pipelines, with a strong focus on performance, reliability, and real‑time data synchronization. Proficient in translating business requirements into technical solutions while employing test‑driven development practices.

Highest‑signal resume keywords

• Data Engineering
• Python
• SQL
• Databricks
• CDC Patterns

Hard Skills

• Data Pipeline Ownership
• Low Latency Data APIs
• Technical Debt Reduction
• Automated Testing
• Query Writing

Soft Skills

• Independent Operation
• Stakeholder Communication

Industry Keywords

• Production Orchestration
• Test‑Driven Development
• Observability

Tools & Technologies

• Delta Lake
• Airflow
• Monitoring Tools