Data Engineer - Web Scrapping & Enrichment

Gala Intelligence; Ahmedabad; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A tech-driven startup in Ahmedabad is seeking a passionate Data Engineer to shape their technology platform. You'll build web scrapers, manage data pipelines, and ensure data quality. Ideal candidates have experience in web scraping, strong Python skills, and a curiosity for discovery. Join a dynamic team dedicated to combatting fraud through innovative technology.

Qualifications

• 2+ years of experience in web scraping, crawling, or data collection.
• Strong proficiency in Python (BeautifulSoup, Scrapy, Selenium).
• Familiarity with NoSQL databases and data serialization formats.
• Experience in handling large-scale scraping with proxy management.
• Basic knowledge of ETL processes and integration.
• Exposure to graph databases is a plus.

Responsibilities

• Build and maintain automated scrapers to extract data.
• Develop multi-threaded, distributed crawlers.
• Normalize scraped data and ensure consistency.
• Implement anti-bot techniques for scraping.
• Deliver clean datasets into NoSQL stores and ETL pipelines.
• Ensure data accuracy and maintain a trust scoring system.
• Document scraping logic for reproducibility.

Skills

Web scraping

Python

NoSQL databases

Large-scale scraping

ETL processes

Graph databases

Job description

We're looking for an entrepreneurial, passionate, and driven Data Engineer to join Startup Gala Intelligence backed by Navneet Tech Venture. As we're building our technology platform from scratch, you'll have the unique opportunity to shape our technology vision, architecture, and engineering culture right from the ground up. You’ll directly contribute to foundational development and establish best practices, while eventually building and contributing to our engineering team.

This role is ideal for someone eager to own the entire tech stack, who thrives on early-stage challenges, and loves building innovative, scalable solutions from day zero.

What You’ll Do

• Web Scraping & Crawling: Build and maintain automated scrapers to extract structured and unstructured data from websites, APIs, and public datasets.
• Scalable Scraping Systems: Develop multi-threaded, distributed crawlers capable of handling high-volume data collection without interruptions.
• Data Parsing & Cleaning: Normalize scraped data, remove noise, and ensure consistency before passing to data pipelines.
• Anti-bot & Evasion Tactics: Implement proxy rotation, captcha solving, and request throttling techniques to handle scraping restrictions.
• Integration with Pipelines: Deliver clean, structured datasets into NoSQL stores and ETL pipelines for further enrichment and graph-based storage.
• Data Quality & Validation: Ensure data accuracy, deduplicate records, and maintain a trust scoring system for data confidence.
• Documentation & Maintenance: Keep scrapers updated when websites change, and document scraping logic for reproducibility.

Who You Are

Technical Skills:

• 2+ years of experience in web scraping, crawling, or data collection.
• Strong proficiency in Python (libraries like BeautifulSoup, Scrapy, Selenium, Playwright, Requests).
• Familiarity with NoSQL databases (MongoDB, DynamoDB) and data serialization formats (JSON, CSV, Parquet).
• Experience in handling large-scale scraping with proxy management and rate-limiting.
• Basic knowledge of ETL processes and integration with data pipelines.
• Exposure to graph databases (Neo4j) is a plus.

Soft Skills:

• Detail-oriented, ensuring accuracy and reliability of collected data.
• Strong problem-solving skills, particularly in adapting scrapers to evolving web structures.
• Curious mindset with a drive to discover new data sources.
• Comfortable working in a fast-paced, early-stage startup environment.

Who We Are & Our Culture

Gala Intelligence, backed by Navneet Tech Ventures, is a tech-driven startup dedicated to solving one of the most pressing business challenges - fraud detection and prevention. We're building cutting-edge, real-time products designed to empower consumers and businesses to stay ahead of fraudsters, leveraging innovative technology and deep domain expertise.

Our culture and values:

We’re united by a single, critical mission - stopping fraud before it impacts businesses. Curiosity, innovation, and proactive action define our approach. We value transparency, collaboration, and individual ownership, creating an environment where talented people can do their best work.

• Problem-Driven Innovation: We're deeply committed to solving real challenges that genuinely matter for our customers.
• Rapid Action & Ownership: We encourage autonomy and accountability—own your projects, move quickly, and shape the future of Gala Intelligence.
• Collaborative Excellence: Cross-team collaboration ensures alignment, sparks innovation, and drives us forward together.
• Continuous Learning: Fraud evolves rapidly, and so do we. Continuous improvement, experimentation, and learning are core to our success.

If you're excited by the opportunity to leverage technology in the fight against fraud, and you're ready to build something impactful from day one, we want to hear from you!