Backend Engineer with Python, PHP along with web scraping

Mployee.me

Pune

On-site

INR 900,000 - 1,300,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible working environment
Volunteer time off
LinkedIn Learning
Employee-Assistance-Program (EAP)

Job summary

NIQ is seeking a mid-level Software Engineer in Pune/Chennai to own scalable backend architectures, data extraction pipelines, and web applications using Python, PHP, and PostgreSQL. You will develop web crawlers, automate browsers, and build RESTful APIs while ensuring performance and reliability across platforms.

You will collaborate with Product, QA, DevOps, and engineering teams, applying Agile/Scrum practices and modern tooling to deliver robust data solutions.

Qualifications

  • Minimum 3+ years of professional software engineering experience.
  • Strong web scraping with Python libraries like Scrapy/BeautifulSoup/LXML/Requests.
  • Browser automation with Selenium/Playwright/Pyppeteer.
  • PHP development with CodeIgniter framework.
  • PostgreSQL schema design and performance tuning.
  • Microservices architecture and RESTful APIs.
  • Proactive, independent ownership and collaboration in teams.
  • Familiarity with Agile/Scrum and JIRA.

Responsibilities

  • Build scalable web crawlers to harvest structured and unstructured data.
  • Manage dynamic content extraction using browser automation for JS-heavy sites.
  • Optimize crawling performance with concurrency, asynchronous programming, and multi-threading.
  • Design, develop, and maintain scalable backend microservices using Python and PHP.
  • Build web applications and internal tools with CodeIgniter.
  • Design Python-based RESTful APIs for cross-functional data integration.
  • Write efficient SQL queries and manage PostgreSQL schema design.
  • Troubleshoot production issues to maintain system stability.

Skills

3+ years exp
Python
RESTful APIs
Agile/Scrum
Ownership
Team collaboration

Tools

Selenium
Playwright
Pyppeteer
Docker
Kubernetes
CodeIgniter
Git
JIRA
PostgreSQL
Scrapy

Job description

Job Description
Software Engineer, Pune

We are seeking an experienced and highly motivated Mid Software Engineer based in Pune/Chennai. In this role, you will take end-to-end ownership of scalable backend architectures, web scraping pipelines, and core web applications. You will balance data extraction engineering with robust backend development using Python, PHP and PostgreSQL. If you thrive in a fast-paced environment and love solving complex data challenges, this role is for you.

Responsibilities
Data Extraction & Web Scraping
  • Build scalable web crawlers to harvest structured and unstructured web data using custom and enterprise frameworks.
  • Manage dynamic content extraction using advanced browser automation tools for JavaScript-heavy, AJAX, and infinite-scroll sites.
  • Optimize crawling performance through concurrent execution, asynchronous programming, and container multi-threading.
Backend & Application Engineering
  • Design, develop, and maintain scalable backend microservices using Python and PHP.
  • Build web applications and custom internal tools using the PHP CodeIgniter framework.
  • Design Python based RESTful APIs to ensure seamless data integration across cross-functional platforms.
Database Management & Operations
  • Write efficient, optimized SQL queries and manage schema design within PostgreSQL.
  • Troubleshoot, debug, and resolve complex production issues to maintain system stability.

Collaborate closely with cross-functional teams including Product, QA, DevOps, and other engineering units.

Qualifications
  • Must Have Experience: 3+ years of professional software engineering experience.
  • Web Scraping: Deep proficiency with Python parsing packages (Scrapy, BeautifulSoup, LXML, Requests).
  • Browser Automation: Hands-on experience handling browser execution via Selenium, Playwright, or Pyppeteer.
  • PHP: Strong development experience in PHP and the CodeIgniter framework.
  • Database: Solid understanding of PostgreSQL database schema design, query optimization, and performance tuning.
  • Architecture: Strong foundation in designing Microservices and building robust RESTful APIs.
  • Soft Skills: Ownership: Ability to take a project from concept to delivery independently.
  • Collaboration: Strong communication skills to align with remote and local cross-functional teams.
  • Agility: A proactive mindset that thrives in fast-paced, continuous-improvement environments.
  • Nice to Have Cloud & DevOps: Experience with cloud platforms (AWS, Azure, or GCP) and CI/CD pipelines.
  • Containerization: Familiarity with Docker and Kubernetes orchestration.
  • Tooling: Experience with Git version control and logging, monitoring, and observability tools.
  • Methodology: Familiarity working within Agile/Scrum frameworks using JIRA
Additional Information
Our Benefits
  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)

NIQ may utilize artificial intelligence (AI) tools at various stages of the recruitment process, including résumé screening, candidate assessments, interview scheduling, job matching, communication support, and certain administrative tasks that help streamline workflows. These tools are intended to improve efficiency and support fair and consistent evaluation based on job-related criteria. All use of AI is governed by NIQ’s principles of fairness, transparency, human oversight, and inclusion. Final hiring decisions are made exclusively by humans. NIQ regularly reviews its AI tools to help mitigate bias and ensure compliance with applicable laws and regulations. If you have questions, require accommodations, or wish to request human review were permitted by law, please contact your local HR representative. For more information, please visit NIQ’s AI Safety Policies and Guiding Principles: https://nielseniq.com/global/en/info/niqs-ai-safety-policies/

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on: LinkedIn | Instagram | Twitter | Facebook

Our commitment to Diversity, Equity, and Inclusion

At NIQ, we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence. All employment decisions at NIQ are made without regard to race, color, religion, sex (including pregnancy, sexual orientation, or gender identity), national origin, age, disability, genetic information, marital status, veteran status, or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion, please visit the https://nielseniq.com/global/en/news-center/diversity-inclusion

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Backend Engineer with Python, PHP along with web scraping
Backend Engineer with Python, PHP along with web scraping

NielsenIQ • Pune District

On-site
INR 1,200,000 - 2,100,000
Flexible working environment
Volunteer time off
Senior Software Engineer-ETL
Senior Software Engineer-ETL

NielsenIQ • Chennai

On-site
INR 900,000 - 1,300,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Software Engineer (Java, Springboot, RestAPI)
Software Engineer (Java, Springboot, RestAPI)

NielsenIQ • Chennai

On-site
INR 900,000 - 1,300,000
Wellness plans for you and family
Career development opportunities
Flexible working environment
+1
Data Engineer (Python, Java, SQL, PL/SQL)
Data Engineer (Python, Java, SQL, PL/SQL)

NielsenIQ • Chennai

On-site
INR 1,200,000 - 2,100,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Software Engineer (Core Java, spring boot, restAPI, microservices development, design patterns)
Software Engineer (Core Java, spring boot, restAPI, microservices development, design patterns)

NielsenIQ • Chennai

On-site
INR 1,500,000 - 2,600,000
Flexible working environment
Wellness plans for you and your family
Career development opportunities
+2
Software Engineer
Software Engineer

NielsenIQ • Chennai

On-site
INR 1,600,000 - 2,600,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Senior Engineer, cloud security and Infrastructure Security
Senior Engineer, cloud security and Infrastructure Security

NielsenIQ • Maharashtra

On-site
INR 2,500,000 - 4,500,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Specialist, Application Support - GCP Site Reliability Engineering
Specialist, Application Support - GCP Site Reliability Engineering

NielsenIQ • Chennai District

On-site
INR 900,000 - 1,800,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Software Engineer - Backend and Data Systems
Software Engineer - Backend and Data Systems

NielsenIQ • Chennai

On-site
INR 1,500,000 - 2,100,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1
Support Engineer (PL/SQL, Python)
Support Engineer (PL/SQL, Python)

NielsenIQ • Chennai District

On-site
INR 1,200,000 - 1,800,000
Flexible working environment
Volunteer time off
LinkedIn Learning
+1