AI Data Engineer

DataE2E Technologies

India

Presencial

INR 1.200.000 - 1.800.000

Jornada completa

hace 32 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

DataE2E Technologies is seeking a seasoned Data Engineer to design and implement scalable data pipelines using Databricks, Spark and SQL in a cloud-native environment. You will build medallion-architecture data products (bronze, silver, gold) and develop robust ELT/ETL frameworks for batch and streaming workloads.

Ideal candidates have 8+ years in data engineering or analytics engineering, hands-on experience with agentic AI solutions, and a strong track record of delivering enterprise-grade

Formación

  • 8+ years in Data Engineering, Analytics Engineering or Data Platform development
  • Hands-on experience building agentic AI solutions
  • Experience implementing enterprise-scale data pipelines and data products
  • Familiar with software engineering best practices and DevOps methodologies
  • Experience with Git, pull-request review, automated testing and CI/CD pipelines for analytics or data assets
  • Familiarity with natural-language analytics, MCP or spec-driven development; knowledge of responsible AI frameworks and AI cost controls

Responsabilidades

  • Design and develop scalable data pipelines using Databricks, Spark, SQL and cloud-native technologies
  • Build and maintain bronze, silver and gold data products following medallion architecture principles
  • Develop robust ELT/ETL frameworks supporting batch and streaming workloads
  • Implement data modeling standards, optimization strategies and performance tuning practices
  • Ensure engineering solutions meet enterprise standards for scalability, reliability and maintainability
  • Build AI-assisted solutions for: Spark and SQL code generation, Data pipeline generation
  • Data quality rule generation, Unit test generation, Code review and optimization, CI/CD and deployment automation
  • Develop multi-agent workflows that orchestrate end-to-end engineering tasks
  • Script against REST APIs and SDKs (Power BI/Fabric, Databricks, Jira or Azure DevOps) and use Tabular Editor for bulk model changes
  • Build evaluation harnesses for AI agents and orchestrate workloads with tools such as Databricks Jobs or Airflow

Conocimientos

Data engineering
AI/agentic systems
ETL/ELT frameworks
Data pipelines
Cloud-native architectures
Performance tuning
Git & CI/CD
Enterprise standards

Herramientas

Databricks
Spark
SQL

Descripción del empleo

  • Design and develop scalable data pipelines using Databricks, Spark, SQL and cloud-native
    technologies
  • Build and maintain bronze, silver and gold data products following medallion architecture principles
  • Develop robust ELT/ETL frameworks supporting batch and streaming workloads
  • Implement data modeling standards, optimization strategies and performance tuning practices
  • Ensure engineering solutions meet enterprise standards for scalability, reliability and maintainability
Agentic AI engineering
  • Use Speckit and enterprise knowledge repositories to give AI agents contextual grounding, so
  • generated code, documentation, tests and engineering artifacts align with organizational standards and
  • best practices
  • Design knowledge-driven agent workflows that draw on documented business rules, data models, architecture patterns and engineering guidelines
  • Build AI-assisted solutions for: Spark and SQL code generation, Data pipeline generation
  • Data quality rule generation, Unit test generation, Code review and optimization, CI/CD and deployment automation
  • Develop multi-agent workflows that orchestrate end-to-end engineering tasks
  • Script against REST APIs and SDKs (Power BI/Fabric, Databricks, Jira or Azure DevOps), and use
  • Tabular Editor for bulk model changes
  • Build evaluation harnesses for AI agents and orchestrate workloads with tools such as Databricks Jobs or Airflow
  • Create reusable prompt frameworks, agent instructions, templates and engineering accelerators
  • Define guardrails and quality controls for AI-generated code and artifacts
  • Implement human-in-the-loop review and governance mechanisms
Experience
  • 8+ years in Data Engineering, Analytics Engineering or Data Platform development
  • Hands-on experience building agentic AI solutions
  • Experience implementing enterprise-scale data pipelines and data products
  • Demonstrated experience with software engineering best practices and DevOps methodologies
  • Experience with Git, pull-request review, automated testing and CI/CD pipelines for analytics or data assets
  • Experience with natural-language analytics, MCP or spec-driven development; familiarity with responsible AI frameworks and AI cost controls
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior AI Engineer
Senior AI Engineer

TheMathCompany Inc. • Bengaluru

Presencial
INR 2.400.000 - 4.200.000
Sr AI Data Engineer
Sr AI Data Engineer

Techblocks • Hyderabad

Presencial
INR 4.000.000 - 7.000.000
AI Data Engineers
AI Data Engineers

Mployee.me • Dadri

A distancia
INR 600.000 - 900.000
Associate Data Engineering - Databricks
Associate Data Engineering - Databricks

Optum • Bengaluru

Presencial
INR 1.500.000 - 2.500.000
AI Data Engineers
AI Data Engineers

Infosys • Dadri

Presencial
INR 1.500.000 - 2.100.000
AI Data Engineer
AI Data Engineer

Infosys • Bengaluru

Presencial
INR 900.000 - 1.300.000
Lead Engineer - Data & AI
Lead Engineer - Data & AI

Quest Global • Bengaluru

Presencial
INR 1.000.000 - 1.500.000
Senior AI Data Engineer (Gurgaon OR Noida)
Senior AI Data Engineer (Gurgaon OR Noida)

Amplify Health • Dadri

Presencial
INR 4.500.000 - 6.500.000
Data Engineer - A/SA with AI
Data Engineer - A/SA with AI

PwC • Hyderabad, Chennai, Bengaluru

Presencial
INR 1.500.000 - 2.800.000
Data Engineering Lead
Data Engineering Lead

Optum • Bengaluru

Presencial
INR 1.400.000 - 2.400.000
Health insurance