InfoBeans Technologies - Senior Python Developer - Databricks

InfoBeans; Indore; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

InfoBeans is seeking an experienced Python Developer to design scalable backend services and secure APIs. You will build data pipelines using Azure Databricks and PySpark, working with Delta Lake and Lakehouse architectures for large-scale analytics.

The role requires strong Django skills and hands-on Azure experience, with collaboration across product, data engineers, and frontend teams to deliver end-to-end cloud-based solutions.

Qualifications

• 9–14 years of Python backend experience.
• Strong Django expertise.
• Experience designing RESTful APIs and microservices.
• Hands-on Azure cloud services experience with data processing in Databricks.
• Proficiency with PySpark, Delta Lake, and Lakehouse concepts.
• Strong SQL and NoSQL knowledge.
• Collaborative work with cross-functional teams; mentoring.

Responsibilities

• Design, develop, and maintain scalable backend applications using Python and Django.
• Develop secure, high-performance RESTful APIs and microservices.
• Build and manage data processing pipelines with Azure Databricks and PySpark.
• Work with Delta Lake and Lakehouse architectures for large-scale analytics.
• Leverage Azure services for deployment, monitoring, and integration.
• Optimize performance of backends, pipelines, and queries; ensure reliability.
• Collaborate with frontend, product, data engineers, and architects; support React integration as needed.
• Lead code reviews, drive architectural discussions, and mentor junior engineers.

Skills

Python & Django

Backend systems

REST APIs

Azure cloud

Azure Databricks

Delta Lake

SQL/NoSQL

Git & Agile

Performance optimization

Code reviews & mentoring

Tools

PySpark

Job description

Role Overview

We are looking for an experienced Python Developer with strong expertise in backend development, Django, Azure cloud services, and big data processing. The role involves designing scalable backend services, developing secure APIs, building data processing pipelines using Azure Databricks and PySpark, and delivering reliable cloud-based applications.

Key Responsibilities

• Design, develop, and maintain scalable backend applications and microservices using Python and Django.
• Design, implement, and maintain secure, high-performance RESTful APIs and web services.
• Build and manage data processing pipelines using Azure Databricks, PySpark, and Delta Lake.
• Work with Delta Tables and Lakehouse concepts to support large-scale data processing and analytics.
• Leverage Azure cloud services for application deployment, integration, monitoring, and management.
• Optimize backend services, data pipelines, database queries, and storage solutions for performance, scalability, and reliability.
• Work with SQL and NoSQL databases to support application and data processing requirements.
• Collaborate with frontend developers, product managers, data engineers, architects, and other stakeholders to deliver end-to-end solutions.
• Support frontend integration using React, where required.
• Participate in solution architecture, technical design discussions, and technology decisions.
• Conduct code reviews and ensure adherence to coding standards, security practices, testing, and maintainability guidelines.
• Mentor junior developers and provide technical guidance to the engineering team.
• Troubleshoot complex application, API, cloud, and data pipeline issues and drive root-cause resolution.
• Contribute to CI/CD, version control, testing, deployment, and release activities.
• Participate in Agile ceremonies, estimation, sprint planning, and continuous improvement initiatives.
• Maintain technical documentation covering application architecture, APIs, data pipelines, and operational procedures.

Required Skills & Experience

• 9 - 14 years of experience in Python development, backend engineering, or software application development.
• Strong hands‑on proficiency in Python and Django.
• Experience designing and developing RESTful APIs, backend services, and microservices.
• Hands‑on experience with Microsoft Azure cloud services.
• Strong experience with Azure Databricks and PySpark for large-scale data processing.
• Good understanding of Delta Lake, Delta Tables, and Lakehouse architecture.
• Strong SQL skills and experience with relational databases; familiarity with NoSQL databases is also expected.
• Understanding of data processing pipelines, data transformation, and distributed data processing concepts.
• Experience with application performance optimization, debugging, testing, and production troubleshooting.
• Familiarity with React and frontend integration.
• Experience using Git and working with Agile development methodologies.
• Strong understanding of secure coding, application scalability, reliability, and software engineering best practices.
• Experience conducting code reviews, leading technical discussions, and mentoring developers.
• Excellent analytical, problem-solving, communication… ...