We are looking for an experienced Data Engineer to join theData Infrastructure teamand contribute to the development and operation of a scalable, robust, and self-service analytics platform.
Educational Qualification: Bachelor’s or Master’s degree Software Engineering, or a related field .
Key Responsibilities:
- Maintain, enhance, and optimize data ingestion pipelines responsible for reliably processing billions of events per day within defined SLAs.
- Design, build, and operate scalable and reliable data pipelines and infrastructure.
- Support engineering teams in developing and optimizing complex data pipelines.
- Work closely with cross-functional teams to identify platform pain points, technical challenges, and opportunities for improvement.
- Develop reusable tools, frameworks, and best practices to enhance the overall data platform.
- Contribute to large-scale initiatives, including ML platforms and real-time/streaming use cases.
- Establish and promote best practices for software engineering and data development.
- Improve platform reliability, observability, performance, scalability, and self-service capabilities.
- Troubleshoot production issues and take ownership of problems through to resolution.
- Contribute to CI/CD, testing, automation, and continuous improvement of the data engineering environment.
Required Qualifications:
- 3+ years of professional experience in Data Engineeringor a closely related field .
- Experience with data orchestration tools such as Apache Airflow .
- Proven experience working with large-scale datasets .
- Strong experience designing and developing complex ETL/ELT pipelines .
- Hands-on experience with at least one major cloud platform: GCP, AWS, or Azure .
- Strong programming skills in Apache Spark using Scala and Python
- Experience with CI/CD practices and tools , such as Jenkins and Git.
- Strong understanding of software engineering principles, development practices, testing, and version control .
Soft Skills:
- Excellent problem-solving, analytical, and communication skills.
- Ability to work independently, take ownership, and proactively identify and resolve technical challenges.
Job Features
Job Category Data Engineerig