GenAI Engineer

Jobtailor; India; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Jobtailor is seeking an experienced NLP and Python developer to design and implement scalable Generative AI solutions. You will work on end-to-end ML projects, from data processing to production-grade models, in a fast-paced environment.

Responsibilities include building RAG pipelines with embeddings, indexing, and prompts, collaborating with cross-functional teams, and optimizing GPU usage on cloud platforms to maximize performance and reliability.

Qualifications

• 5+ years of data science and ML model development experience.
• Deep knowledge of NLP evolution and Large Language Models (LLMs).
• Experience building RAG pipelines with embeddings, indexing, chunking, reranking, prompts and evaluation.
• Strong Python coding with NumPy, Pandas, Scikit-learn, and Jupyter.
• Experience with cloud platforms (Azure, AWS, Databricks).

Responsibilities

• Develop Python-based applications in Generative AI.
• Implement and optimize Generative AI models (GPT, LLAMA, Mistral, FLAN T5).
• Build advanced RAG pipelines with embeddings, indexing, chunking, reranking, prompts and evaluation.
• Collaborate with cross-functional teams to integrate AI into broader systems.
• Utilize cloud GPU resources (AWS/Azure/Databricks) to maximize performance.
• Stay updated on Generative AI and cloud services to enhance capabilities.
• Assist delivery leads in delivering AI solutions to clients in a timely manner.

Skills

NLP development

Python programming

Data science

Algorithms & data structures

Model evaluation

Education

Bachelor's or Master's degree in CS/ML/Statistics

Tools

NumPy

Pandas

Scikit-learn

Jupyter

GitHub

Jira

SQL Server

Spark

Databricks

Job description

Job Responsibilities

• 5+ years of experience as a NLP and Python developer.
• Experience with Pandas, NumPy, Scikit, NLP a must have.
• Key fundamentals in object-oriented design, data structures and systems.
• Ability to integrate multiple data sources into a single system.
• Familiarity with testing tools.
• Ability to collaborate on projects and work independently when required.
• Working knowledge of GitHub and Jira.
• Ability to document requirements and specifications.
• Develop and maintain advanced Python-based applications in the Generative AI domain, ensuring high performance, reliability, and scalability.
• Implement and optimize Generative AI models, including GPT, LLAMA, Mistral, FLAN T5 and other cutting-edge AI technologies, to create innovative solutions and knowledge graph.
• Development of advanced RAG pipelines with proper embeddings, indexing, chunking, reranking, prompts and evaluation.
• Collaborate with cross-functional teams to integrate AI functionalities into broader systems and applications.
• Utilize AWS/Azure/Databricks GPU machines to manage GPU memory effectively, maximizing performance and efficiency.
• Stay updated on the latest advancements in Generative AI, Python development practices, and cloud services to continually enhance our AI capabilities.
• Assist delivery leads in delivering Generative AI solutions to clients in a timely manner, ensuring client satisfaction and project success.

Requirements

• Bachelor's or Master's degree in a quantitative field (CS, machine learning, mathematics, statistics) or equivalent experience.
• 5+ years of experience in data science, building hands-on ML models.
• Candidate must be aware of entire evolution history of NLP (Traditional Language Models to Modern Large Language Models), training data creation, training set-up and finetuning.
• Knowledge of advanced RAG pipelines with proper embeddings, indexing, chunking, reranking, prompts and evaluation.
• Excellent programming skills in Python. Strong working knowledge of Python's numerical, data analysis, or AI frameworks such as NumPy, Pandas, Scikit-learn, Jupyter, etc.
• SQL skills with SQL Server and Spark experience is preferred but not necessary.
• Knowledge of predictive/prescriptive analytics including Machine Learning algorithms (Supervised and Unsupervised) and deep learning algorithms and Artificial Neural Networks.
• Experience with Natural Language Processing (NLTK) and text analytics for information extraction, parsing and topic modeling.
• Excellent verbal and written communication. Strong troubleshooting and problem-solving skills. Thrive in a fast-paced, innovative environment.
• Experience with cloud platforms such as Azure, AWS, Databricks is preferred.