Jobs in Quebec, Canada

Core responsibilities:
– Architect and document a high-throughput data ingestion pipeline capable of processing billions of events daily
– Create detailed technical specifications and solution blueprints
– Develop and implement efficient ETL processes for ingestion, storage and retrieval
– Design and implement processes for detecting and offloading stale data from active systems to long-term storage databases.
– Ensure efficient integration of APIs with Redis and caching, optimizing data retrieval and reducing database load.
– Develop and deploy monitoring solutions for tracking API (FastAPI) usage patterns, response times and error rates.
– Collaborate with DevOps team to deploy and scale APIs within OpenShift/Kubernetes environments. Ensure application scalability, high availability, and resilience within a containerized ecosystem
– Conduct design and code reviews to ensure alignment with best practices.
– Define integration patterns and data flows between system components
– Establish technical standards, guidelines, and best practices
– Guide and mentor development team in implementing architectural decisions

Required skills:
– 8+ years of software development experience with focus on high-throughput RESTful API design with at least 2 years in architecture roles
– Proven experience in database interactions with PostgreSQL and Snowflake including query optimization and schema design
– Advanced Python programming with frameworks like Fast API and SQL Achemy
– Strong experience with caching strategies in API design
– Proven track record in designing large-scale, data intensive systems
– Strong experience in distributed systems architecture
– Deep understanding of data modeling and database design
– Experience with microservices architecture and event-driven systems
– Strong analytical skills for analyzing performance metrics and optimizing complex systems
– Excellent documentation and communication skills
– Proactive approach to identifying and solving technical challenges

Nice to have:
– Knowledge of monitoring tools like Prometheus and Open Telemtry