Job Description – Python Developer (Data Engineering & Backend)
- Job Title: Python Developer
- Experience: 3–4 Years
- Employment Type: Full-time
Job Overview
We are looking for a skilled Python Developer with 3–4 years of experience in developing Python applications, building data processing pipelines, and developing backend services.
The ideal candidate should have strong Python programming skills, experience working with large datasets, knowledge of ETL processes, database integration, and exposure to AWS data services. The candidate will work on data-intensive applications, healthcare data processing systems, reporting solutions, and automated alert-generation platforms.
Key Responsibilities1. Python Application Development
- Develop, maintain, and optimize Python-based applications.
- Write clean, reusable, modular, and efficient Python code.
- Apply object-oriented programming principles and software development best practices.
- Develop data transformation, validation, and processing modules.
- Debug applications and troubleshoot complex technical issues.
- Optimize application performance and memory utilization.
2. Data Engineering & ETL Development
- Design and develop ETL pipelines for processing large datasets.
- Process large CSV, ZIP, and other structured data files.
- Work with Pandas, Polars, PyArrow, and DuckDB for data manipulation and transformation.
- Develop memory-efficient solutions using chunk-based and streaming data processing.
- Convert large datasets into optimized Parquet formats.
- Implement data partitioning and optimize data retrieval.
- Perform data cleansing, normalization, deduplication, and validation.
3. AWS Cloud Services
- Develop Python applications that interact with AWS services using Boto3.
- Work with Amazon S3 for data storage, retrieval, and file processing.
- Use AWS Athena for querying and analyzing large datasets.
- Integrate Python applications with AWS RDS and other cloud-based data sources.
- Understand AWS IAM roles and permissions required for application access.
- Build cloud-based data processing workflows.
4. Database & SQL Development
- Work with MySQL and relational databases.
- Write, optimize, and troubleshoot SQL queries.
- Design efficient database interactions and data retrieval mechanisms.
- Integrate Python applications with databases.
- Work with large datasets and improve query performance.
5. Backend & API Development
- Develop REST APIs using FastAPI.
- Build backend services for reporting and data-processing applications.
- Implement request validation, response handling, and exception management.
- Integrate APIs with databases, cloud storage, and internal applications.
- Develop scalable and maintainable backend components.
- Application Monitoring & Optimization
- Implement application logging and error handling.
- Troubleshoot application issues and analyze logs.
- Optimize processing time and memory consumption.
- Handle inconsistent data formats and unexpected input conditions.
- Ensure application reliability and data accuracy.
Required Technical Skills
Category Required Skills
- Programming: Python, OOP, Data Structures
- Python Libraries: Pandas, Polars, PyArrow, Boto3
- Data Processing: ETL, CSV, ZIP, Parquet, Chunk Processing
- Database: MySQL, SQL
- Query Engine: AWS Athena
- Cloud Services: AWS S3, RDS, IAM
- Backend Development: FastAPI, REST APIs
- Operating System: Linux, Ubuntu
- Version Control: Git, Bitbucket
Good to Have
- Experience in healthcare data processing or healthcare data integration.
- Knowledge of large-scale data processing and memory-efficient programming.
- Experience with AWS Glue or similar data integration services.
- Familiarity with distributed data processing concepts.
- Experience working with reporting and analytics applications.
- Understanding of application performance profiling and optimization.
Candidate Profile