Lead Data Engineer

Neurealm

Chennai

On-site

INR 1,200,000 - 2,400,000

Full time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Neurealm is seeking a highly skilled Senior Data Engineer/Data Architect to design, develop, and support enterprise-scale data integration and AI-ready data platforms in an offshore India context (Pune, Bangalore, Chennai).

The role focuses on Informatica, SQL Server, vector databases, REST APIs, and modern data integration patterns, collaborating with business and technology stakeholders to enable AI/LLM solutions and enterprise modernization.

Qualifications

  • 8+ years of Data Engineering experience.
  • 5+ years of Informatica development experience.
  • Experience building enterprise data integration solutions.
  • Experience working with cloud-based data platforms.
  • Experience supporting AI/GenAI initiatives is highly desirable.

Responsibilities

  • Design, develop, and maintain enterprise data pipelines using Informatica.
  • Build and optimize ETL/ELT workflows for large-volume data processing.
  • Integrate data from multiple enterprise applications, databases, APIs, and third-party platforms.
  • Develop data ingestion frameworks for structured, semi-structured, and unstructured data.
  • Implement data quality, validation, reconciliation, and monitoring mechanisms.

Skills

Data Integration
ETL/ELT
Data Warehousing
SQL Server
API Integration
REST APIs
Python
Git
Agile/Scrum
DevOps CI/CD
Vector Databases
AI/GenAI
Embeddings
Semantic Search
Development

Tools

Databricks
Snowflake
Kafka/Event Hub
LangChain

Job description

Location : Offshore (India) Pune, Bangalore , Chennai

Experience : 8-12+ Years

Employment Type : Full-Time

About the Role

We are seeking a highly skilled Senior Data Engineer/Data Architect to design, develop, and support enterprise-scale data integration and AI-ready data platforms. The ideal candidate will possess deep expertise in Informatica, SQL Server, Vector Databases, REST APIs, and modern data integration patterns. This role will work closely with business and technology stakeholders to build scalable data pipelines, enable AI/LLM solutions, and support enterprise application modernization initiatives.

Key Responsibilities
  • Design, develop, and maintain enterprise data pipelines using Informatica.
  • Build and optimize ETL/ELT workflows for large-volume data processing.
  • Integrate data from multiple enterprise applications, databases, APIs, and third-party platforms.
  • Develop data ingestion frameworks for structured, semi-structured, and unstructured data.
  • Implement data quality, validation, reconciliation, and monitoring mechanisms.
Database & Data Modeling
  • Design and manage SQL Server databases.
  • Develop complex SQL queries, stored procedures, views, and performance tuning solutions.
  • Design logical and physical data models supporting operational and analytical workloads.
  • Optimize database performance, scalability, and reliability.
AI & Vector Database Enablement
  • Build and manage vector-based data stores for GenAI and semantic search use cases.
  • Work with embeddings, vector indexes, and Retrieval Augmented Generation (RAG) architectures.
  • Integrate enterprise data sources with AI/LLM platforms.
  • Support document intelligence, knowledge management, and AI search solutions.
API Development & Integration
  • Develop and consume REST APIs for enterprise integrations.
  • Implement API security using OAuth, JWT, and token-based authentication.
  • Integrate cloud and on-premise applications through API-based architectures.
  • Support event-driven and microservices-based integration patterns.
  • Define data architecture standards and integration best practices.
  • Ensure data security, governance, and compliance requirements are met.
  • Collaborate with business analysts, architects, data scientists, and application teams.
  • Drive technical design reviews and solution recommendations.
Mandatory Skills
  • Data Integration
  • ETL/ELT Development
  • Data Warehousing Concepts
  • Data Migration and Data Synchronization
  • Database
  • Microsoft SQL Server
  • Query Optimization
  • Stored Procedures
  • Performance Tuning
  • Data Modeling
  • API & Integration
  • REST APIs
  • JSON/XML
  • API Integration Frameworks
  • AI/Data Modernization
  • Embedding Concepts
  • Semantic Search
  • Development
  • Python preferred
  • Git
  • Agile/Scrum
  • DevOps CI/CD Practices
Preferred Skills
  • Databricks
  • Snowflake
  • Kafka/Event Hub
  • LangChain
  • Document AI platforms
  • Knowledge Graphs
  • Data Lake Architecture
Required Experience
  • 8+ years of Data Engineering experience.
  • 5+ years of Informatica development experience.
  • Experience building enterprise data integration solutions.
  • Experience working with cloud-based data platforms.
  • Experience supporting AI/GenAI initiatives is highly desirable.
Nice-to-Have Experience
  • Document Processing Solutions
  • LLM Integration Projects
  • AI-powered Knowledge Management Platforms
  • Healthcare, Manufacturing, Distribution, or Enterprise IT domains
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Neurealm Company • Chennai, Tiruchirappalli, Coimbatore District, Bengaluru, Hyderabad

Remote
INR 3,000,000 - 5,000,000
Lead Data Engineer
Lead Data Engineer

Indxx • Gurugram District

On-site
INR 3,600,000 - 5,200,000
Lead Data Engineer (Lead Software Engineer)
Lead Data Engineer (Lead Software Engineer)

DigitalXNode • Ahmedabad District

On-site
INR 1,800,000 - 2,600,000
Senior Data Engineer
Senior Data Engineer

Straive • Hyderabad, Gurugram District, Chennai

Hybrid
INR 1,800,000 - 2,600,000
Technical Lead - Data Engineer (Data&AI)
Technical Lead - Data Engineer (Data&AI)

Srijan: Now Material • Gurugram District

On-site
INR 4,000,000 - 7,500,000
Lead Data Architect/Lead Data Engineer
Lead Data Architect/Lead Data Engineer

Tech Mahindra Limited • Hyderabad, Chennai, Bengaluru

Hybrid
INR 2,500,000 - 4,500,000
Data Engineer
Data Engineer

Thalus Technologies Pvt Ltd • Margao

On-site
INR 1,200,000 - 2,500,000
Data Engineer
Data Engineer

Talent et au-dela • Hyderabad

On-site
INR 900,000 - 1,800,000
Data Engineer | AI | Visualization
Data Engineer | AI | Visualization

Pashtek • Salesforce Partner | Data & AI • Chennai District

Hybrid
INR 400,000 - 800,000
Data Architect (Cloud, ETL, Python) || 7-12 yrs
Data Architect (Cloud, ETL, Python) || 7-12 yrs

Iklavya • Dadri

On-site
INR 2,000,000 - 2,500,000