Data Scientist

CoreOps.AI; Dadri; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

CoreOps.AI is seeking a data scientist to lead a Gen‑AI engineering team, guiding data extraction, cleaning, model training and production deployment.

You will work with Langchain, vector databases and cross‑functional teams to prototype scalable AI solutions, ensuring robust systems and practical deployments. The ideal candidate has 5–10 years of Gen‑AI experience, strong Python skills and experience with TF/PyTorch/Keras on Ubuntu/Linux.

Qualifications

• Bachelor’s or Master’s degree in computer science, data science, mathematics or related field.
• 5–10 years of experience building Gen-AI applications.

Responsibilities

• Utilize Langchain for developing scalable AI solutions.
• Integrate vector databases like Azure Cognitive Search, Weaviate, or Pinecone.
• Collaborate with cross-functional teams to define problems and prototype AI solutions.
• Ensure robustness, scalability, and reliability of AI systems by applying ML and software best practices.
• Explore and visualize data to understand distributions and predict performance in production.
• Supervise data‑centred projects and data acquisition when needed.
• Identify and source datasets for training from online resources.
• Define validation strategies, feature engineering, and data augmentation pipelines.
• Train models and tune hyperparameters; analyze errors and refine approaches.
• Deploy models to production.

Skills

Python

Statistical techniques

Langchain

Vector databases

Deep learning (NLP)

TensorFlow/PyTorch/Keras

Big data platforms

Ubuntu/Linux

Communication skills

Education

Bachelor’s/Master’s degree in computer science, data science, mathematics or related field

Tools

TensorFlow

PyTorch

Keras

Langchain

Azure Cognitive Search

Weaviate

Pinecone

Hadoop

Spark

Kafka

Hive

Ubuntu/Linux

Job description

Overview

We are seeking a highly motivated and experienced data scientist to help us in leading the team of Gen‑Ai Engineers involved. You are required to lead manage all the processes from data extraction, cleaning, and pre-processing, to training models and deploying them to production. The ideal candidate will be passionate about artificial intelligence and stay up-to-date with the latest developments in the field.

Key Responsibilities

• Utilize frameworks like Langchain for developing scalable and efficient AI solutions.
• Integrate vector databases such as Azure Cognitive Search, Weaviate, or Pinecone to support AI model functionalities.
• Work closely with cross‑functional teams to define problem statements and prototype solutions leveraging generative AI.
• Ensure robustness, scalability, and reliability of AI systems by implementing best practices in machine learning and software development.
• Explore and visualize data to gain an understanding of it, then identify differences in data distribution that could affect performance when deploying the model in the real world.
• Devising and overseeing data‑centred projects.
• Verify data quality, and/or ensure it via data cleaning.
• Supervise the data acquisition process if more data is needed.
• Find available datasets online that could be used for training.
• Define validation strategies, feature engineering, data augmentation pipelines on a given dataset.
• Train models and tune their hyperparameters.
• Analyze the errors of the model and design strategies to overcome them.
• Deploy models to production.

Qualifications and Education Requirements

• Bachelor’s/Master’s degree in computer science, data science, mathematics or a related field.
• At least 5-10 years of experience in building Gen‑Ai applications.

Preferred Skills

• Proficiency in statistical techniques such as hypothesis testing, regression analysis, clustering, classification, and time series analysis to extract insights and make predictions from data.
• Proficiency with a deep learning framework such as TensorFlow, PyTorch, and Keras.
• Specialized in Deep Learning (NLP) and statistical machine learning.
• Strong Python skills.
• Experience with developing production‑grade applications.
• Familiarity with Langchain framework and vector databases like Azure Cognitive Search, Weaviate, or Pinecone.
• Understanding and experience with retrieval algorithms.
• Worked on Big data platforms and technologies such as Apache Hadoop, Spark, Kafka, or Hive for processing and analyzing large volumes of data efficiently and at scale.
• Familiarity in working and deploying applications on Ubuntu/Linux system.
• Excellent communication, negotiation, and interpersonal skills.