Job Summary Role: Python Lead Developer / Data Engineer Experience: 8 to 12 Years Key Technologies: Python , Big Data , Cloudera , AWS , Azure , Hive , Shell scripting , Django , Flask , FastAPI , RESTful APIs , Docker , Kubernetes , Git , CI/CD pipelines , SQL , NoSQL
Job Description Looking for The role is for a Data Engineer who would be responsible to work independently on end-to-end data acquisition , transformation and Governance including Infra set ups in Big Data . The resource should have around 8-10 years of experience in the IT Industry with hands on development experience in Cloudera / AWS / Azure with expertise in Python , Hive , Shell scripting .
Key Responsibilities
- Work independently on end-to-end data acquisition , transformation and Governance including Infra set ups in Big Data .
- Write clean, well-crafted, and maintainable Python code for server-side logic and backend features .
- Work with cross-functional teams , including UX/UI designers , AbInitio & Spark Scala developers , to integrate / migrate different application components and deliver features .
- Create and maintain technical documentation and specifications for software applications.
Requirements
- Proven, extensive experience ( 8 to 12 Years ) as a Python Lead Developer , with a portfolio of successful projects.
- In-depth knowledge and hands-on experience with Python frameworks like Django , Flask , FastAPI , or others depending on the specialization.
- Around 8-10 years of experience in the IT Industry with hands on development experience in Cloudera / AWS / Azure with expertise in Python , Hive , Shell scripting .
- Experience with RESTful APIs , web services , and containerization technologies like Docker and Kubernetes .
- Experience with version control systems (e.g., Git ) and familiarity with CI/CD pipelines and agile methodologies .
- Strong proficiency with databases , including both SQL (e.g., Oracle ) and NoSQL databases (e.g., MongoDB ), along with an understanding of schema design .
- Excellent analytical and problem-solving skills to troubleshoot complex software issues and propose innovative solutions.