Senior Data Engineer

Nextyn; Mumbai; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Competitive salary

Challenging projects

High growth potential

Job summary

A tech-driven company in Mumbai is seeking a Senior Data Engineer to design and implement scalable data scraping systems. This role emphasizes the development of innovative data architectures, integrating advanced AI techniques for efficient data processing. The ideal candidate has over 5 years of experience in data engineering, with a solid proven track record in building end-to-end systems and expertise in web scraping tools. Join us to advance your career with competitive compensation and exciting projects.

Qualifications

• 5+ years of experience in data engineering and data scraping.
• Proven track record of building end-to-end data systems.
• Deep knowledge of web scraping tools and strategies.

Responsibilities

• Design and implement scalable web scraping systems.
• Develop semantic scraping solutions using advanced AI methods.
• Architect data pipelines integrating structured and unstructured data.

Skills

Data engineering

Data scraping

AI and NLP methods

Web scraping tools (Scrapy, Selenium, BeautifulSoup)

Cloud infrastructure (AWS/GCP/Azure)

Job description

We’re seeking a Senior Data Engineer with deep expertise in large-scale data scraping and end-to-end data architecture design. This role focuses on building the backbone of our AI‑driven systems—from developing responsive, semantic scraping frameworks to architecting robust, scalable data pipelines from the ground up. You’ll play a key role in ensuring that our data infrastructure is intelligent, efficient, and future‑ready.

Key Responsibilities

• Design and implement scalable web scraping systems capable of handling high‑volume, high‑velocity data sources.
• Develop responsive and semantic scraping solutions using advanced AI and NLP methods to extract meaningful, context‑rich information.
• Architect and build data pipelines from scratch, integrating structured and unstructured data across multiple platforms.
• Establish reliable, fault‑tolerant data architectures for long‑term scalability and maintainability.
• Integrate scraped data into RAG (Retrieval‑Augmented Generation) and other intelligent workflows.
• Continuously enhance scraping performance, pipeline efficiency, and data quality through automation and innovation.

Required Skills and Qualifications

• 5+ years of experience in data engineering, data scraping, and pipeline development.
• Proven track record of building end‑to‑end data systems from the ground up.
• Deep knowledge of web scraping tools (Scrapy, Selenium, BeautifulSoup) and anti‑blocking, concurrent scraping strategies.
• Strong understanding of AI‑driven data extraction, NLP, and semantic enrichment.
• Experience implementing RAG pipelines and integrating LLMs with retrieval systems.
• Familiarity with cloud infrastructure (AWS/GCP/Azure) and CI/CD best practices.

Why Join Us

• Build cutting‑edge, AI‑powered data scraping ecosystems at production scale.
• Shape the data architecture roadmap for next‑generation intelligent systems.
• Collaborate with a highly skilled, forward‑thinking engineering team.
• Competitive salary, challenging projects, and high growth potential.

If you’re passionate about turning large‑scale web data into meaningful, AI‑ready insights, we want you on our team.