AI Data Engineering

ADP Private Limited; Hyderabad; Hybrid; INR 1.800.000 - 2.400.000; Vollzeit

Zusammenfassung

ADP Private Limited in Hyderabad seeks an experienced AI Data Engineer to design and optimize scalable data and AI/ML solutions on AWS Cloud. The role focuses on modern data engineering, cloud-native architecture, and GenAI workloads, collaborating with data scientists and business stakeholders to deliver impactful analytics.

The candidate will implement GenAI apps, RAG architectures, and data pipelines, ensuring governance and cost efficiency while enabling reliable AI deployments.

Qualifikationen

• Experience with AWS data services (S3, Glue, Redshift) and modern data pipelines.
• Proficiency in Python, PySpark, and SQL for data engineering and ML workloads.
• Hands-on with SageMaker and/or Bedrock for GenAI solutions and LLMs.
• Experience designing and deploying RAG architectures and vector stores.
• Experience integrating AI workloads with enterprise systems and APIs.

Aufgaben

• Design, build, and optimize scalable data/AI platforms on AWS.
• Develop Generative AI apps using SageMaker/Bedrock and RAG solutions.
• Create robust data pipelines enabling AI/ML workloads across teams.
• Collaborate with data scientists, ML engineers, and business stakeholders.
• Implement guardrails, governance, and cost-aware GenAI practices.

Kenntnisse

AWS Services

Python

PySpark

SQL

SageMaker

Bedrock

Generative AI

RAG architecture

OpenSearch

LLM orchestration

REST APIs

CI/CD

Docker

Vector Databases

Tools

Docker

Git

Terraform/CloudFormation

OpenSearch

SageMaker

Bedrock

pgvector/Pinecone/Chroma

Jobbeschreibung

Job Summary:

Seeking an experienced AI Data Engineer to design, build, and optimize scalable data and AI/ML solutions on AWS Cloud. The ideal candidate should possess strong expertise in modern data engineering, cloud-native architecture, machine learning data pipelines, and Generative AI solutions. The role involves developing robust data platforms, enabling AI workloads, and collaborating with data scientists, ML engineers, and business stakeholders to deliver impactful analytics and AI-driven solutions.

Key Responsibilities:

• Design, develop data ingestion solutions from APIs, databases, and maintain scalable ETL/ELT pipelines on AWS.
• Design, develop, and deploy Generative AI applications using Amazon Bedrock, SageMaker, and foundation models.
• Build and implement Retrieval-Augmented Generation (RAG) solutions leveraging vector databases and enterprise knowledge repositories.
• Enable AI/ML and Generative AI workloads through robust data pipelines.
• Integrate Large Language Models (LLMs) with enterprise systems, APIs, and business workflows.
• Design and optimize prompts, evaluate model performance, and improve response quality through prompt engineering techniques.
• Implement AI guardrails, content filtering, and responsible AI practices to ensure safe and compliant GenAI deployments.
• Monitor GenAI application performance, model usage, latency, and costs while ensuring scalability and reliability.
• Implement and ensure data quality, governance, security, scalability, and cost-effective AWS data platforms.
• Collaborate with Data Scientists, ML Engineers, and business stakeholders.
• Develop conversational AI solutions, enterprise copilots, intelligent search, and knowledge-management applications.
• Document technical solutions and support Agile delivery practices.

Required Skills

• Strong experience with AWS Services: S3, Glue, Lambda, Redshift, DynamoDB, IAM, Step Functions, API Gateway, EC2, ECS/EKS.
• Proficiency in Python, PySpark and SQL.
• Hands-on experience with Amazon SageMaker and/or Amazon Bedrock, OpenSearch, Generative AI, RAG, Vector Databases, Prompt Engineering and LLM orchestration platforms.
• Experience implementing enterprise scale RAG architecture, embeddings, and vector databases (OpenSearch, pgvector, Pinecone, Chroma, etc.).
• Experience building and deploying scalable, secure, and production-grade GenAI and Agentic AI applications on AWS.
• Strong understanding of Large Language Models (LLMs), Prompt Engineering, Retrieval-Augmented Generation (RAG), AI Agents, Multi-Agent Systems, and Conversational AI solutions.
• Experience building enterprise AI copilots, chatbots, document intelligence, or knowledge assistant solutions.
• Strong understanding of REST APIs, Microservices, CI/CD pipelines, Git, Docker, and cloud-native development practices.
• Ability to work closely with business stakeholders and cross-functional teams to identify use cases and deliver AI-driven solutions.
• Excellent analytical, problem-solving, and communication skills with a passion for innovation and emerging AI technologies.

Preferred Skills:

• At least 3 years of experience in AI Engineering or related field
• Experience with Data Lakes, ETL/ELT, Data Warehousing, and Data Modeling.
• Working experience with Terraform/CloudFormation, Git, CI/CD, and Docker.
• Exposure to LLM Ops, model evaluation, prompt optimization, monitoring, governance, and Responsible AI practices.
• AWS Certifications (Developer Associate, Solutions Architect, Data Engineer, AI Practitioner) are a plus.

Location:

Hyderabad