Python - ADB

Capgemini; Hyderabad, Pune District, Bengaluru; Hybrid; INR 900,000 - 1,800,000; Full time

Job summary

Capgemini is looking for a Python Developer proficient in Databricks (PySpark) to develop and maintain scalable data pipelines. You will manage cloud environments on Azure and ensure smooth API integration and testing.

The role requires strong Python skills, Databricks experience, and familiarity with Azure DevOps and DevOps practices within an Agile/Scrum framework. API testing with Postman is also valued.

Qualifications

• Proficient in Python with data processing libraries (Pandas, NumPy).
• Hands-on Databricks (PySpark) experience for data processing and analysis.
• Experience using Azure Portal to manage cloud environments and services.
• Expertise in working with APIs and data ingestion in JSON format.
• Familiarity with DevOps practices and Agile/Scrum environments.
• Proficiency with Postman for API testing and automation.

Responsibilities

• Develop and maintain scalable data pipelines using Python and Databricks (PySpark).
• Process and manipulate large datasets with Python.
• Handle API ingestion and JSON data for automation of data workflows.
• Manage cloud environments and services via Azure Portal.
• Work with Databricks and PySpark for distributed data processing.
• Implement CI/CD pipelines following DevOps practices in an Agile/Scrum setting.
• Test and automate APIs using Postman.
• Collaborate with cross-functional teams to align solutions with business goals.

Skills

Python

Databricks

PySpark

Azure

Postman

Tools

Azure Portal

Postman

Job description

Python with ADB :-

Job Summary:

As a Python Developer with Databricks, you will be responsible for developing and maintaining scalable data pipelines, managing cloud environments on Azure, and ensuring smooth integration with APIs. The ideal candidate will be proficient in Python, Databricks (PySpark), and Azure DevOps, with a strong understanding of cloud services, DevOps practices, and API testing.

Key Responsibilities:

• Develop and Maintain Data Pipelines: Design, develop, and maintain scalable data pipelines using Python and Databricks (PySpark).
• Data Processing: Apply strong proficiency in Python and advanced Python concepts to process and manipulate large datasets effectively.
• API Ingestion: Experience in API ingestion, working with data in JSON format to integrate and automate data workflows.
• Cloud Management: Use Azure Portal for managing cloud environments and services.
• Databricks PySpark: Work with Databricks and PySpark to build distributed data processing applications.
• DevOps & Agile Methodology: Implement DevOps best practices and work within a Scrum framework to ensure continuous integration and continuous delivery (CI/CD) pipelines.
• API Testing & Automation: Use Postman to test and automate APIs for robust integration and data workflows.
• Collaboration: Work closely with cross-functional teams to implement solutions aligned with business objectives and technical requirements.

Required Qualifications:

• Programming Skills: Strong proficiency in Python with experience in data processing libraries (e.g., Pandas, NumPy).
• Databricks Experience: Hands-on experience with Databricks (PySpark) for data processing and analysis.
• Cloud Platform: Experience using Azure Portal to manage cloud environments and services.
• API Handling: Expertise in working with APIs, specifically with data ingestion and integration in JSON format.
• DevOps Methodology: Familiarity with DevOps practices and experience working in Agile/Scrum environments.
• API Testing Tools: Proficiency with Postman for API testing and automation.