Competitive salaries and comprehensive health benefits
Flexible work environment
Opportunities for creativity and innovation
Job summary
A leading data solutions firm in India is seeking experienced data engineers to design and implement robust data pipelines. The ideal candidate has over 5 years of software engineering experience and is proficient in Python, containerized microservices, and cloud native technologies. This role offers competitive salaries, health benefits, and a dynamic work environment focused on innovation and client experience.
Qualifications
5+ years of progressively responsible experience in software engineering.
3+ years of data engineering or equivalent experience.
Strong problem-solving, analytical and team collaboration skills.
Responsibilities
Design, implement and optimize end-to-end data pipelines.
Develop data pipelines using cloud native technologies.
Implement data validation and quality checks.
Monitor system performance and troubleshoot issues.
Collaborate with stakeholders to understand data requirements.
Document technical designs and workflows.
Provide technical guidance to team members.
Skills
Web & Enterprise applications in Python
Containerized microservices
Bash/Shell scripting
Integration technologies (Kafka, REST APIs)
Troubleshooting integration issues
Kubernetes, Docker, Helm
Oracle/MySQL/graph databases
Elastic/Open Search applications
CI/CD Pipeline functionality
Redis and monitoring tools
Education
Bachelor's degree in Computer Science or related field
Tools
Kubernetes
Docker
Grafana
Nagios
AppDynamics
Job description
Overview
Responsibilities
Design, implement and optimize end-to-end data pipelines for ingesting, processing and transforming large volumes of structured and unstructured data.
Develop data pipelines to extract and transform data in near real time using cloud native technologies.
Implement data validation and quality checks to ensure accuracy and consistency.
Monitor system performance, troubleshoot issues and implement optimizations to enhance reliability and efficiency.
Collaborate with business users, analysts and other stakeholders to understand data requirements and deliver tailored solutions.
Document technical designs, workflows and best practices to facilitate knowledge sharing and maintain system documentation.
Provide technical guidance and support to team members and stakeholders as needed.
Identify problems and recommend appropriate solutions for WSI in a wide variety of circumstances.
Take an active role in developing effective, scalable and maintainable code in a timely fashion and participate in design and code reviews.
Benefits
Maintains a manner of leadership and flexibility that diffuses pressure and promotes a positive environment.
We're a successful, fast-growing company with an entrepreneurial vibe
A technologically and data-driven business
Competitive salaries and comprehensive health benefits
We're at the forefront of tech and retail, redefining technology for the next generation
We're passionate about our internal and external clients and live/breathe the client experience
We get to be creative on a daily basis
A smart, experienced the leadership team that wants to do it right and is open to new ideas
We believe in autonomy and reward taking the initiative • We have fun!
Qualifications
We’re excited about you because you have…
Experience in development of Web & Enterprise applications in Python language
Experience in building containerized microservices using Python frameworks, Django, Flask etc.
Experience in Bash/Shell scripting and Hands-On in Linux Environment
Experience in integration technologies like Kafka (Distributed Messaging Systems), REST APIs and Webservices.
Expertise in troubleshooting integration issues involving SSL, firewalls, proxies, load balancers and LDAP
Experience in managing applications in Kubernetes, Docker and Helm
Proficiency in working with Oracle/MySQL/graph databases.
Good to have understanding of Elastic/Open Search applications. Should be comfortable in analysing data, scripting and the desire to learn the rest of our stack.
Good to have understanding of CI/CD Pipeline functionality.
Good to have exposure in Redis and monitoring tools such as AppDynamics, Nagios and Grafana.
Familiarity with Unix/AIX environments and monitoring tools.
Experience in planning and managing product upgrades and migrations.
Strong problem-solving, analytical and team collaboration skills.
Bachelor’s degree or foreign equivalent in Computer Science, Engineering or related field
5+ years of progressively responsible experience in software engineering
3+ years of data engineering or equivalent experience.