Senior Data Engineer

Bitstrapped; Ontario; On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading consulting firm is seeking a Senior Data Engineer to join their Data Services Practice. This full-time role involves designing and implementing data systems primarily on Google Cloud, collaborating with cloud architects, and ensuring data system robustness. The ideal candidate will have extensive experience in data engineering, programming, and cloud technologies, with a strong commitment to continuous learning and improvement.

Benefits

Health benefits

Subsidy for certifications

Subsidies for home-office equipment

Assistance for fitness plans

Qualifications

• 5+ years experience as a data engineer or software engineer.
• Experience with data ingestion, processing, ETL/ELT.

Responsibilities

• Design, implement, and maintain enterprise data systems.
• Write reusable and scalable code prioritizing test-driven approach.

Skills

Cloud Certifications

Data Engineering

Programming

Data Governance

Education

GCP Data Engineer certification

Tools

Apache Beam

BigQuery

Postgres

Terraform

Job description

We are seeking a hands-on Senior Data Engineer in a full-time salaried position. The Sr. Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams.

The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a hands-on consultant to our customers. The Data Engineer will work mostly on Google Cloud, interacting with other platforms such as AWS or Microsoft Azure in hybrid environments.

Responsibilities

• Design, implement, automate, and maintain enterprise data systems for our customers
• Implement data engineering technologies, primarily stream and batch processing systems with Apache Beam / Dataflow, Data Warehouses including BigQuery, queuing and message systems with Pub / Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL and Postgres, Redis, and Composer DAG-based workflow automation
• Show an ability to implement data system robustness including caches, clustering, partitioning, event windows, performant and cost efficient data warehouse queries, audit tables, data governance and security including RBAC and CBAC
• Capable of balancing 1-2 client projects with differing project priorities
• Write reusable and scalable code, prioritizing a test driven approach where possible
• Experience working with project plans and milestone based sprints, under the supervision of technical project management and principal architects
• Hands-on experience with relational and non-relational databases, as well as file types that include Parquet, Avro, csv
• Possess a desire to continuously learn and adopt new technologies
• Possess a desire to work in a fast paced environment
• Be capable of working independently, staying on task, and remaining productive with little supervision
• 5+ years experience as a data engineer or software engineer in a professional environment
• 5+ years of experience with data engineering duties including data ingestion, data processing, ETL / ELT, parallel computing, integration of sinks / taps, workflow orchestration
• Strong knowledge of databases and data storage
• Ability to architect, develop, and test code at an enterprise level, adhering to software engineering best practices
• Ability to Design data models with a strong understanding of modeling design patterns.
• Proficiency in at least one programming language.
• Has knowledge and experience working on distributed systems (monitoring, alerting, message contracts)
• Cloud Certifications - GCP Data Engineer certification preferred

Bonus

• Experience in Data Science and Data Science Engineering
• Experience with the deployment of workloads to the cloud
• Experience interacting with other cloud infrastructure services including Cloud Functions, Kubernetes, or VertexAI is a nice to have
• Experience with DevOps CI / CD workflows using technologies such as Github, Gitlab, Jenkins, CircleCI, Bitbucket, and otherDevOps Technologies.
• Experience writing infrastructure as code using Terraform

About Bitstrapped

Bitstrapped is a fast-growing consulting firm with Data and AI services practices. Our passion lies in our ability to help companies invest in forward-thinking data-to-AI infrastructure. Investments in these areas enable our customers to distinguish their brands from their competition, stay competitive, and produce better business outcomes.

We help our customers architect solutions for the cloud, advanced data engineering, MLOps, and AI infrastructure. This includes engineering systems for data ingestion, data transformation, data warehousing, data migrations, and the application of machine learning. We are a Google Cloud partner. However, we work with other major cloud platforms.

Health benefits, including medical, dental, and vision coverage.

Subsidy for certifications.

Subsidies for home-office equipment.

Assistance for fitness plans.

We encourage applications from people who look, feel, and think differently than members of our current team. We value candidates with non-linear career paths, and people who find themselves underrepresented or underestimated, especially in technical spaces. We encourage applications from people with caregiving responsibilities.

Create a job alert for this search