Data Pipeline Developer

Arcurve Inc; Calgary; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

A leading technology company in Calgary seeks a Data Pipeline Developer to enhance their advanced analytics team. In this role, you will design and implement efficient data pipelines, collaborate with experts, and ensure data quality for client projects in various industries. Ideal candidates will possess a strong background in Python and data pipeline technologies, thriving in a team-focused environment with opportunities for exceptional professional growth.

Benefits

Competitive salary with flexible health & wellness benefits

Hybrid work environment with flexible scheduling options

Fun team atmosphere prioritizing equity, diversity, and inclusion

Prime location in downtown Calgary

Qualifications

• 3-5 years professional experience as a Data Pipeline Developer or similar role.
• Strong proficiency in Python and developing complex data pipelines.
• Knowledge of APIs and large-scale data systems.

Responsibilities

• Design and develop robust data pipelines from multiple sources.
• Collaborate with analysts and scientists to align data solutions.
• Ensure optimized data systems for performance.

Skills

Python

Data Pipelines

Data Modeling

ETL Processes

Collaboration

Communication

Education

Degree in Computer Science, IT, or a similar field

Tools

Databricks

Synapse

Spark

Snowflake

Job description

Posted Tuesday, January 7, 2025 at 9 : 00 AM | Expired Saturday, February 8, 2025 at 8 : 59 AM

Arcurve is one of North America’s leading full-service technology, advisory and software development companies. In 2006, we began with a belief that there was a better way to deliver professional services in the technology industry. Since then, we have completed more than 800 projects for clients ranging from start-ups to Fortune 500 companies. From our office in Calgary and hubs in Halifax, Houston, and Vancouver we deliver exceptional results for our clients in a diverse range of industries including telecommunications, oil and gas, transportation, private equity, gaming, infrastructure, software, finance, and hospitality.

At Arcurve, we believe that work should be an enjoyable experience and that the best “aha” moments come through team learning and continuous motivation. We know the key to success is collaboration, and that you can’t put a value on accountable, transparent, and authentic interactions. We strive to deliver exceptional service while creating lasting relationships with our employees, our students, our clients, and our community.

We’re looking for an authentic, collaborative and accountable Data Pipeline Developer to join Arcurve’s advanced analytics team.

YOU ARE

• An authentic and creative human
• Driven to succeed
• A believer in the importance of teamwork
• Community-minded
• Someone who thrives on challenge
• Motivated by exceptional results

THE GOAL

As a Data Pipeline Developer, you'll play a key role in retrieving, transforming, and storing raw data into structured leading-edge analytics platforms. By building efficient and scalable data pipelines from various data sources, you'll ensure that our data projects run smoothly, are performant, and meet the needs of our clients.

In this role, you’ll strive for efficiency by aligning data systems with business goals while collaborating with business intelligence analysts, data scientists, and stakeholders. Strong experience in Python programming and working with data pipelines and technologies is required. Additionally, you will have the opportunity to expand your professional network through collaboration with external community partners such as YYC Data Society, DAMA, and the University of Calgary. If you are detail-oriented with excellent communication and organizational skills, we’d like to hear from you!

THE RESPONSIBILITIES

• Design and develop robust data pipelines that integrate data from multiple sources
• Ensure data systems are optimized for performance and can scale to meet future business needs
• Leverage your strong Python programming skills to write clean, efficient, and maintainable code
• Collaborate with business intelligence analysts, data scientists, and other stakeholders to align data solutions with business objectives
• Proactively explore and implement ways to enhance data quality, consistency, and reliability
• Contribute to cross-functional projects, working with diverse team members on multiple client projects

THE REQUIREMENTS

• 3-5 years of professional experience as a Data Engineer, Data Pipeline Developer, or in a similar Software Developer (Data Pipelines) role
• Strong proficiency in Python and experience developing complex data pipelines
• Extensive experience with Databricks, Synapse, Spark, and Snowflake
• In-depth knowledge of data modeling and ETL processes
• Solid knowledge of SDLC and code quality best practices
• Familiarity with API integration tools and working with large-scale data systems
• Knowledge of SCADA systems and data historians is an asset
• A detail-oriented mindset with the ability to prioritize and manage multiple tasks
• Excellent communication, organizational, and collaboration skills
• Degree in Computer Science, IT, or a similar field
• Ability to obtain Reliability Status security clearance

THE PERKS

• A fun team atmosphere that prioritizes equity, diversity, and inclusion
• Competitive salary with flexible health & wellness benefits
• Hybrid work environment with flexible scheduling options
• Prime, central location in downtown Calgary