(Offshore) Principal AI Engineer

iSolved HCM; Hyderabad; Hybrid; INR 13,146,000 - 17,840,000; Full time

Job summary

isolved is seeking a Principal AI Data Engineer to lead the design of a scalable, cloud-native data platform focused on analytics, RAG, and feature engineering. You will architect data models, manage dbt pipelines, and optimize vector stores for ML-driven search and recommendations.

You will drive best practices in CI/CD, governance, and observability while mentoring engineers across the data stack. The role emphasizes Azure-centric solutions and high-impact data products.

Qualifications

• 8+ years in data engineering or similar technical roles.
• Deep hands-on experience with dbt, SQL, and data warehouse modeling (Kimball, Data Vault, etc.).
• Experience with Apache Iceberg and/or Delta Lake in production-grade systems.
• Expertise in Python and Spark for scalable data processing.
• Experience building and operating KNN/vector databases and embedding stores (e.g., FAISS, Pinecone, Azure AI Search, Weaviate).
• Familiarity with Retrieval-Augmented Generation (RAG) architecture and best practices.
• Solid understanding of feature engineering workflows and ML/data products.
• Cloud platform experience, with a strong preference for Azure.
• Experience with IaC (Terraform, etc).
• Understanding data governance, privacy, and compliance (GDPR, HIPAA, SOC 2).

Responsibilities

• Design scalable data models using dimensional modeling for modern data warehousing.
• Develop and scale dbt transformation pipelines with testing and docs.
• Architect Delta Lake/Iceberg tables for high-performance analytics.
• Build production-grade Python processes integrating diverse data sources.
• Manage KNN embedding storage (e.g., FAISS, Pinecone, Weaviate, or Azure AI Search).
• Support feature engineering, dataset versioning, and model-ready pipelines.
• Enable RAG by building reliable retrieval layers and embedding pipelines.
• Define data product architecture and lifecycle for internal and customer-facing apps.
• Champion Azure cloud-native development across storage, compute, and orchestration.
• Establish CI/CD, observability, testing, governance, and docs across the stack.
• Provide technical mentorship across engineering and analytics teams.

Skills

dbt

SQL

Python

Spark

Azure

Data warehouse modeling

RAG

KNN/vector stores

Terraform

GDPR/Privacy

Education

Bachelor's degree

Master's degree

PhD in CS or Electronics

Tools

Delta Lake

Apache Iceberg

Weaviate/FAISS

Azure Data Factory

Airflow

dbt Cloud

Job description

Job Description

Principal AI Data Engineer

Summary/objective

The Principal AI Data Engineer will lead the development of our modern, intelligent data platform. This role blends deep expertise in data engineering, machine learning infrastructure, and data product development. Will architect and build scalable, cloud-native solutions that enable everything from classic analytics to Retrieval-Augmented Generation (RAG) and advanced feature engineering. The Principal AI Data Engineer should be equally adept at modeling a data warehouse using dbt as optimizing storage for vector embeddings.

Core Job Duties

• Design and implement scalable data models using dimensional modeling and best practices for modern data warehousing.
• Develop and scale dbt transformation pipelines, including testing, documentation, and modularization.
• Architect and optimize Delta Lake / Apache Iceberg tables for high-performance analytics and large-scale ingestion.
• Build production-grade processes in Python, integrating with various data sources & APIs.
• Implement and manage KNN embedding storage (e.g., FAISS, Pinecone, Weaviate, or Azure AI Search) for use in RAG pipelines and ML-powered search or recommendations.
• Establish foundation to support feature engineering, dataset versioning, and model-ready pipelines.
• Enable Retrieval-Augmented Generation (RAG) use cases by building reliable retrieval layers and embedding pipelines to support LLM-based systems.
• Define architecture, development and lifecycle of data products that serve internal users, operational processes, and customer-facing applications.
• Champion cloud-native development practices, primarily on Azure (preferred) including storage, compute, and orchestration tools.
• Establish best practices in CI/CD, observability, testing, governance, and documentation across the data stack.
• Provide technical mentorship and thought leadership across engineering and analytics teams.

Job Complexity

As an expert in the field, uses professional concepts in developing resolution to critical issues and broad design matters. Anticipates broad changes pertaining to their area of expertise and ensure isolved is always ahead of the curve. Significant barriers to entry (e.g., top management review, approval) exist at this level.

Interaction

Works on issues that impact design/selling success or address future concepts, products, or technologies. Creates formal networks with key decision makers and serves as external spokesperson for the organization.

Supervision

Exercises wide latitude in determining objectives and approaches to critical assignments.

Experience

Typically requires a minimum of 15 years of related experience with a Bachelor's degree; or 12 years and a Master's degree; or a PhD in computer science or electronics engineering with 8 years of related experience; or equivalent experience.

Minimum Qualifications

• 8+ years in data engineering or similar technical roles.
• Deep hands-on experience with dbt, SQL, and data warehouse modeling (Kimball, Data Vault, etc.).
• Experience with Apache Iceberg and/or Delta Lake in production-grade systems.
• Expertise in Python and Spark for scalable data processing.
• Experience building and operating KNN/vector databases and embedding stores (e.g., FAISS, Pinecone, Azure AI Search, Weaviate, etc.).
• Familiarity with Retrieval-Augmented Generation (RAG) architecture and implementation best practices.
• Solid understanding of feature engineering workflows and their role in ML and data products.
• Proven ability to build & scale data products that drive insights, decisions, and customer experiences.
• Cloud platform experience, with a strong preference for Azure
• Experience with IaC [Terraform, etc]
• Understanding data governance, privacy, and compliance frameworks (e.g., GDPR, HIPAA, SOC 2).

Nice to Have:

• Familiarity with ML model pipelines (e.g., feature stores, model registries).
• Experience with orchestration tools like Airflow, dbt Cloud, or Azure Data Factory.
• Understanding of modern LLM infrastructure and vector-enhanced applications.
• Desire or experience in Agentic AI
• Experience working in agile product teams or a startup environment.

Physical Demands

Prolonged periods of sitting at a desk and working on a computer. Must be able to lift up to 15 pounds.

Travel Required

Yes, up to 15% domestic travel may be required.

Work Authorization

Employee must be legally authorized to work in the United States.

FLSA Classification

Exempt

Location

Office/Hybrid/Remote

Internal Job Title

Principal AI Data Engineer

About isolved

isolved is an employee experience leader, providing intuitive, people-first HCM (Human Capital Management) technology. Our solutions are delivered directly or through our partner network to more than five million employees and 145,000 employers - who use them every day to boost performance, increase productivity, and accelerate results while reducing risk. Our HCM platform, isolved People Cloud, seamlessly connects and manages the employee journey across talent management, HR & payroll, workforce management and engagement management functions. No matter the industry, we help high-growth organizations employ, enable and empower their workforce by transforming employee experience for a better today and a better tomorrow. For more information, visit www.isolvedhcm.com.

isolved is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. isolved is a progressive and open-minded meritocracy. If you are smart and good at what you do, come as you are. Visit www.isolvedhcm.com/careers for more information regarding our incredible culture and focus on our employee experience. Visit www.isolvedeebenefits.com for a comprehensive list of our employee total rewards offerings.