Practo - Data Platform Engineer

Practo

Bengaluru

On-site

INR 4,000,000 - 7,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Practo in Bengaluru is seeking a highly hands-on Data Platform Engineer to join our AI Labs team. This role will be responsible for architecting, building, and scaling our end-to-end data platform, bridging traditional data engineering with modern AI infrastructure.

You will own the design and implementation of data pipelines, lakehouse architecture, multi-region data systems, and AI/ML-powered data processing workflows.

Qualifications

  • Strong experience in data engineering, data platform development, and large-scale distributed data systems.
  • Proficiency in SQL and Python for data engineering and pipeline development.
  • Hands-on experience building CDC-based ingestion and ETL/ELT pipelines.
  • Experience with workflow orchestration frameworks such as Temporal.
  • Working knowledge of dbt for data transformation and modeling.
  • Experience with AWS cloud infrastructure and Infrastructure as Code tools such as Terraform or AWS CDK.
  • Exposure to ML/LLM inference pipelines, embedding generation, and AI-powered data processing.

Responsibilities

  • End-to-End Data Architecture & Engineering: Design, build, and maintain end-to-end data pipelines, covering CDC ingestion from production databases to production-grade lakehouse storage.
  • Develop and scale workflow orchestration using Temporal and data transformation pipelines using dbt.
  • Build standardized dimensional data models and optimized relational/materialized views to support analytics and business intelligence.
  • Modernize legacy data workflows by replacing traditional DAG runners and cron-based batch jobs with scalable orchestration frameworks.
  • Multi-Region Architecture & Data Residency: Design and implement multi-region data architectures across cloud environments, ensuring compliance with data residency and sovereignty requirements.
  • Establish secure data isolation mechanisms to ensure sensitive patient and transaction data remains within permitted geographical boundaries.
  • Build compliant cross-region replication, synchronization, failover, and data-routing mechanisms.
  • AI/ML Integration & Multimodal Data Processing: Integrate machine learning models into data pipelines to identify and redact sensitive PII/PHI across text, images, audio, and video.
  • Build and operationalize embedding generation, LLM inference, and semantic search pipelines.
  • Develop scalable workflows for AI-powered data processing and multimodal content analysis.
  • Lakehouse Infrastructure & Platform Enablement: Design and optimize open lakehouse architectures using Apache Iceberg.
  • Implement efficient partitioning, ACID transactions, and time-travel capabilities for large-scale datasets.
  • Provision and manage secure, scalable Jupyter Notebook environments for data science and exploratory analytics.
  • Cloud Infrastructure, DevOps & FinOps: Design, deploy, and manage AWS infrastructure using Infrastructure as Code (Terraform or AWS CDK).
  • Establish cost-monitoring frameworks to track cost-per-outcome across data and AI pipelines.
  • Own production reliability through monitoring, alerting, data quality checks, and pipeline freshness tracking.

Skills

Data engineering
SQL
Python
CDC ingestion
dbt
Temporal
Iceberg
AWS CDK
ML pipelines

Tools

Apache Iceberg

Job description

About The Role

We are looking for a highly hands-on Data Platform Engineer to join our AI Labs team in Bengaluru. This role will be responsible for architecting, building, and scaling our end-to-end data platform, bridging traditional data engineering with modern AI infrastructure.

You will own the design and implementation of data pipelines, lakehouse architecture, multi-region data systems, and AI/ML-powered data processing workflows. From Change Data Capture (CDC) and ETL/ELT pipelines to LLM inference and multimodal data redaction, you will build reliable, scalable, and cost-efficient data infrastructure.

Roles & Responsibilities
  • End-to-End Data Architecture & Engineering :
  • Design, build, and maintain end-to-end data pipelines, covering CDC ingestion from production databases to production-grade lakehouse storage.
  • Develop and scale workflow orchestration using Temporal and data transformation pipelines using dbt.
  • Build standardized dimensional data models and optimized relational/materialized views to support analytics and business intelligence.
  • Modernize legacy data workflows by replacing traditional DAG runners and cron-based batch jobs with scalable orchestration frameworks.
  • Multi-Region Architecture & Data Residency :
  • Design and implement multi-region data architectures across cloud environments, ensuring compliance with data residency and sovereignty requirements.
  • Establish secure data isolation mechanisms to ensure sensitive patient and transaction data remains within permitted geographical boundaries.
  • Build compliant cross-region replication, synchronization, failover, and data-routing mechanisms.
  • AI/ML Integration & Multimodal Data Processing :
  • Integrate machine learning models into data pipelines to identify and redact sensitive PII/PHI across text, images, audio, and video.
  • Build and operationalize embedding generation, LLM inference, and semantic search pipelines.
  • Develop scalable workflows for AI-powered data processing and multimodal content analysis.
  • Lakehouse Infrastructure & Platform Enablement :
  • Design and optimize open lakehouse architectures using Apache Iceberg.
  • Implement efficient partitioning, ACID transactions, and time-travel capabilities for large-scale datasets.
  • Provision and manage secure, scalable Jupyter Notebook environments for data science and exploratory analytics.
  • Cloud Infrastructure, DevOps & FinOps :
  • Design, deploy, and manage AWS infrastructure using Infrastructure as Code (Terraform or AWS CDK).
  • Establish cost-monitoring frameworks to track cost-per-outcome across data and AI pipelines.
  • Own production reliability through monitoring, alerting, data quality checks, and pipeline freshness tracking.
Required Skills & Technical Expertise
  • Strong experience in data engineering, data platform development, and large-scale distributed data systems.
  • Proficiency in SQL and Python for data engineering and pipeline development.
  • Hands-on experience building CDC-based ingestion and ETL/ELT pipelines.
  • Experience with workflow orchestration frameworks such as Temporal.
  • Working knowledge of dbt for data transformation and modeling.
  • Experience with Apache Iceberg or other modern lakehouse technologies.
  • Experience with AWS cloud infrastructure and Infrastructure as Code tools such as Terraform or AWS CDK.
  • Exposure to ML/LLM inference pipelines, embedding generation, and AI-powered data processing.
Hiring Note

We are hiring for two complementary SE II positions from the same candidate pool. Both positions are individual contributor roles focused on deep technical architecture and execution, with no formal people-management or team-mentoring responsibilities.

(ref:hirist.tech)

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer | AI | Visualization
Data Engineer | AI | Visualization

Pashtek • Salesforce Partner | Data & AI • Chennai District

Hybrid
INR 400,000 - 800,000
Data Platform Engineer (IC Role - SDE 2 to Staff)
Data Platform Engineer (IC Role - SDE 2 to Staff)

Weekday • Hyderabad

On-site
INR 1,500,000 - 2,500,000
High ownership
Impactful work in AI
Data Engineer
Data Engineer

Tensor Solution Tech Private Limited • Bengaluru

On-site
INR 1,200,000 - 2,800,000
Technical Lead - Data Engineer (Data&AI)
Technical Lead - Data Engineer (Data&AI)

Srijan: Now Material • Gurugram District

On-site
INR 4,000,000 - 7,500,000
Lead AWS Data Engineer
Lead AWS Data Engineer

Weekday • Bengaluru

On-site
INR 1,000,000 - 1,500,000
Lead Product AI Data Engineer & Architect
Lead Product AI Data Engineer & Architect

DR Decisions Resources LLC • Bengaluru

Hybrid
INR 3,500,000 - 5,500,000
Hybrid work arrangement
Opportunity to lead AI initiatives
Data Engineer
Data Engineer

Primesoft Solutions • Mumbai, Hyderabad, Bengaluru

On-site
INR 1,800,000 - 2,400,000
Data Lake Engineer
Data Lake Engineer

Care Health insurance • Gurugram District

On-site
INR 1,200,000 - 2,000,000
Lead Data / ML Engineer
Lead Data / ML Engineer

Web Spiders • Kolkata

Hybrid
INR 4,000,000 - 8,000,000
Principal Architect
Principal Architect

Waisl Ltd • Bengaluru

On-site
INR 3,500,000 - 5,200,000