Role Overview
Senior Software Engineer – develop, maintain, and enhance systems and infrastructure for the Data Platform team.
Key Responsibilities
- Develop, maintain, and enhance systems and infrastructure through IaaC for the Data Platform, especially for the team responsible for metadata management.
- Collaborate with multiple teams to solve complex technical problems, particularly around Python, AWS, and CI/CD pipelines.
- Build web-based applications, support microservices, and deploy them in cloud environments with a focus on data platform infrastructure.
- Contribute to engineering initiatives and guide technical adoption across teams using the Data Platform.
- Implement modern software engineering practices including test automation, architectural principles, and best practices for data platform development.
- Ensure solutions are scalable, resilient, and secure.
- Work closely with technical leadership to drive the technical evolution of the Data Platform.
- Enable other teams to adopt new platform capabilities through collaboration and knowledge sharing.
About You
- Experience in Python and AWS, including CI/CD and Infrastructure as a Code (IaaC).
- Solid experience in web-based application development, microservices architecture, and cloud deployment.
- Excellent communication and collaboration skills, with the ability to work across teams.
- Deep understanding of modern software engineering principles and practices applied to data platforms.
- Experience developing scalable, resilient, and secure systems.
- Recognize the importance of people in software development and work effectively with cross-functional teams.
Technical Skillsets
- Experience designing and operating scalable AWS-based data and backend platforms: ECS, Terraform, MSK/Kafka, SQS FIFO queues, Lambda, Docker/ECR, Python.
- Preferred: OpenSearch/Elasticsearch, AWS Glue, S3, Secrets Manager/SSM Parameter Store, Redshift.
- Proficiency in CloudFormation, Jenkins CI/CD pipelines, TypeScript/Node.js, DataHub or modern metadata/data catalog platforms considered a strong plus.
Equal Opportunities
We are an equal opportunities employer. This means we are committed to recruiting the best people regardless of their race, colour, religion, age, sex, national origin, disability or protected veteran status. You can find out more about your rights under the law at www.eeoc.gov.