Data Engineering Intern

primenumbers.in; Bengaluru; On-site; INR 167,000 - 234,000; Part time

Job summary

PrimeNumbers is seeking a data engineering intern to build and enhance Palladium, a data and AI platform. You will ingest, clean, and transform data, collaborate with founders and the engineering team, and develop end-to-end data pipelines for AI/ML workloads.

You'll gain hands-on experience with Python, pandas, PostgreSQL, and web scraping, while contributing to large-scale data acquisition and validation projects over a 6-month in-office internship in Bengaluru.

Qualifications

• Currently pursuing a B.Tech in Computer Science or a closely related discipline, or recent graduate from such a program.
• Strong Python programming with clean, maintainable code.
• Hands-on experience cleaning, reshaping, and analysing datasets using pandas, SQL, or similar tools.
• Working knowledge of PostgreSQL or other relational database systems.
• Prior work or projects involving web scraping, REST APIs, or data processing frameworks.
• Familiarity with Linux command-line environments.
• Genuine passion for data engineering, building pipelines, and the role of data in AI and ML systems.

Responsibilities

• Ingest, validate, and refine large-scale datasets from multiple sources.
• Implement web scraping and reverse-engineer APIs to extract data programmatically.
• Design and maintain Python-based data pipelines for continuous data processing.
• Query and work with PostgreSQL databases to structure and retrieve data efficiently.
• Transform and prepare datasets to meet the requirements of AI and ML models.
• Troubleshoot data quality issues and implement automated checks and validations.

Skills

Python

Pandas

SQL

Education

B.Tech in Computer Science

Tools

PostgreSQL

REST APIs

Web scraping

Linux CLI

Data processing frameworks

Job description

About the role

• Build and enhance Palladium, a data and AI platform serving hundreds of mid-to-large enterprises across India
• Collaborate closely with founders and the engineering team on datasets that feed intelligent search systems and data-driven decision-making
• Develop end-to-end solutions for data acquisition, validation, and transformation at scale

What you'll work on

• Ingest, validate, and refine large-scale datasets from multiple sources
• Implement web scraping and reverse-engineer APIs to extract data programmatically
• Design and maintain Python-based data pipelines for continuous data processing
• Query and work with PostgreSQL databases to structure and retrieve data efficiently
• Transform and prepare datasets to meet the requirements of AI and ML models
• Troubleshoot data quality issues and implement automated checks and validations

What we're looking for

• Currently pursuing a B.Tech in Computer Science or a closely related discipline, or recent graduate from such a program
• Solid grasp of Python programming with demonstrated ability to write clean, maintainable code
• Hands-on experience cleaning, reshaping, and analysing datasets using pandas, SQL, or similar tools
• Working knowledge of PostgreSQL or other relational database systems
• Prior work or projects involving web scraping, REST APIs, or data processing frameworks
• Familiarity with Linux command-line environments
• Genuine passion for data engineering, building pipelines, and the role of data in AI and ML systems
• Strong logical thinking, debugging skills, and commitment to precision in data work

How it works

• 6-month internship on an in-office basis
• Work directly alongside the founding team and engineers