Next Mobility Labs // Circunomics // Airive | Senior Data Engineer -- (all genders)

Job Description

Your mission:

1. End-to-End Development: Design, develop, and deploy scalable, maintainable, efficient, and reliable applications using Python 3, FastAPI or Flask, with optional use of Angular. Ensure seamless integration of back-end components.
2. Big Data Management: Handle (near) real-time big data environments, managing and processing datasets starting from terabytes with precision and efficiency.
3. ETL Processes: Design, implement, and manage ETL (Extract, Transform, Load) processes to ensure efficient data handling through its entire lifecycle.
4. Performance Optimization: Implement caching services like Redis to improve application performance.
5. Data Pipelines: Develop and manage data pipelines using Airflow.
6. Mentorship: Provide guidance and mentorship to junior developers, fostering a culture of continuous learning and improvement within the team.
7. Architecture & Design: Collaborate with architects and other developers to design robust, high-performance, secure application architectures.
8. Collaboration: Work closely with product managers, designers, and other stakeholders to understand requirements, provide technical insights, and ensure the successful delivery of features.
9. Code Quality & Best Practices: Write clean, efficient, and well-documented code while setting and maintaining high standards for code quality through code reviews, testing, and automated tooling.
10. Containerization: Containerize applications using Docker and manage container orchestration with Kubernetes.
11. Infrastructure Management: Create and manage infrastructure using Helm Charts and Terraform.
12. Cloud Deployment: Deploy and manage applications on AWS cloud platforms, including S3, ECR, EKS, RDS, and EFS.
13. Data Visualization: Create data visualizations using Plotly.
14. CI/CD Implementation: Implement CI/CD pipelines using GitHub.
15. Troubleshooting & Optimization: Troubleshoot and resolve application issues while optimizing performance.

Your profile:

1. Experience: You have a minimum of 5 to 7 years of professional experience as a Data Engineer, particularly with Python 3, FastAPI, or Flask, and optional familiarity with Angular. You have a strong track record of designing and deploying scalable applications across backend components and, optionally, front-end components.
2. Big Data Management: You possess deep knowledge in managing (near) real-time big data environments, dealing with datasets starting from terabytes.
3. You have implemented processes to efficiently handle, analyze, and process large volumes of data within strict deadlines.
4. ETL Processes: You are proficient in implementing ETL (Extract, Transform, Load) processes, ensuring effective and efficient data handling throughout its lifecycle.
5. Deep Understanding: You have in-depth knowledge of software development methodologies, RESTful APIs, microservices architecture, and CI/CD pipelines.
6. Problem-solving: You have strong analytical and problem-solving skills and can tackle complex technical challenges.
7. Communication: You have excellent communication and interpersonal skills and can convey complex technical concepts to non-technical stakeholders.
8. Adaptability: You thrive in a fast-paced, dynamic environment and can manage multiple priorities and projects simultaneously.
9. Skills: You have a good command of the English language.
10. Nice to Have: Experience with Dash Framework for data visualization, Familiarity with other cloud platforms and technologies.

Why us?

• Flexible hours.
• Work-from-home options.
• Low hierarchies and open feedback culture.
• Open & international environment.
• Modern offices are in the city center of Frankfurt.
• English is the company language and is used in international working environments.
• Attractive development perspectives with creative freedom for growth.
• Shape the future circular battery space and the green energy transition.

About Us:

Circunomics challenges the automotive industry, OEMs, 2nd-life applications, and recyclers to embrace a more circular approach.