The role leads the development and architecture of data pipelines, models, and automation across data sources. It works in agile teams and collaborates across business and technology partners to deliver resilient, reliable, and governed data infrastructure.
Job Duties:
- Pipeline Development: Design and develop scalable ELT/ETL pipelines using cloud-native tools.
- Data Modeling: Implement dimensional models and integrate data sources for BI/reporting.
- Security & Quality: Apply data security best practices and quality checks across the pipeline.
- Performance Optimization: Tune queries and jobs for speed and reliability.
- Tooling and Automation: Build CI/CD pipelines, reusable modules, and automation scripts.
- Cross-Functional Collaboration: Work with analysts, architects, and other developers to deliver cohesive data solutions.
- Documentation and Metadata: Maintain documentation and contribute to enterprise metadata/catalog tools.
- Agile Execution: Lead user story delivery and actively participate in sprint planning and retrospectives.
- Support and Monitoring: Provide Tier 2 support and monitor pipeline health proactively.
- Innovation and Improvement: Identify and implement enhancements to improve system scalability and user satisfaction.
Qualifications:
- 6-8+ years experience in Data Development, with strong proficiency in SQL, Python, Spark, and Azure Services.
- Experience designing and developing scalable ETL pipelines on Azure using cloud-native tools.
- Successful completion of a four-year university education in Computer Science, Software Engineering, or another related discipline.
Sr. Data Developer
Duration: 36 Months
Hours of Work: 35
Location: Oshawa, 3 days/week onsite
Job Overview:
The role leads the development and architecture of data pipelines, models, and automation across data sources. It works in agile teams and collaborates across business and technology partners to deliver resilient, reliable, and governed data infrastructure.
Job Duties:
- Pipeline Development: Design and develop scalable ELT/ETL pipelines using cloud-native tools.
- Data Modeling: Implement dimensional models and integrate data sources for BI/reporting.
- Security & Quality: Apply data security best practices and quality checks across the pipeline.
- Performance Optimization: Tune queries and jobs for speed and reliability.
- Tooling and Automation: Build CI/CD pipelines, reusable modules, and automation scripts.
- Cross-Functional Collaboration: Work with analysts, architects, and other developers to deliver cohesive data solutions.
- Documentation and Metadata: Maintain documentation and contribute to enterprise metadata/catalog tools.
- Agile Execution: Lead user story delivery and actively participate in sprint planning and retrospectives.
- Support and Monitoring: Provide Tier 2 support and monitor pipeline health proactively.
- Innovation and Improvement: Identify and implement enhancements to improve system scalability and user satisfaction.
Qualifications:
- 6-8+ years experience in Data Development, with strong proficiency in SQL, Python, Spark, and Azure Services.
- Experience designing and developing scalable ETL pipelines on Azure using cloud-native tools.
- Successful completion of a four-year university education in Computer Science, Software Engineering, or another related discipline.
Disclaimer:
AI may be used in evaluating candidates.
This posting is for an existing vacancy.