Senior Big Data Engineer - Remote

Bitstrapped; Ontario; Remote; CAD 100,000 - 140,000; Full time

Job summary

A fast-growing consulting firm in Canada is seeking a Senior Data Engineer to join their Data Services Practice. The role involves designing and implementing data platforms in a hybrid cloud environment, working with technologies like Google Cloud, AWS, and Azure. Candidates should have extensive experience in data engineering, cloud solutions, and a strong understanding of databases. The company values diverse backgrounds and offers health benefits and home-office subsidies.

Benefits

Health benefits

Home-office subsidies

Qualifications

• 5+ years as a data or software engineer.
• Strong knowledge of databases and data storage solutions.
• Experience with cloud certifications, preferably GCP Data Engineer.

Responsibilities

• Design, implement, and maintain enterprise data systems.
• Implement data engineering technologies, including ETL/ELT.
• Write reusable, scalable, and test-driven code.

Skills

Data engineering

Software engineering

Database management

Cloud computing

Distributed systems

DevOps CI/CD

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Beam

BigQuery

Terraform

GitHub

Jenkins

Job description

We are seeking a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and collaborate with our talented cloud architects to play a key role in our delivery teams. The role involves designing, programming, and implementing data platform components, serving as a hands-on consultant to our customers. The primary platform is Google Cloud, with interactions across AWS and Microsoft Azure in hybrid environments.

Responsibilities

1. Design, implement, automate, and maintain enterprise data systems for our customers.
2. Implement data engineering technologies, including stream and batch processing systems with Apache Beam / Dataflow, Data Warehouses like BigQuery, queuing and messaging systems such as Pub/Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL, Postgres, Redis, and workflow automation with Composer DAGs.
3. Ensure data system robustness with features like caches, clustering, partitioning, event windows, cost-efficient queries, audit tables, data governance, and security (RBAC and CBAC).
4. Manage multiple client projects with differing priorities.
5. Write reusable, scalable, and test-driven code.
6. Work with project plans and milestones under the supervision of technical project management and architects.
7. Handle relational and non-relational databases and file types including Parquet, Avro, CSV.

Qualifications

1. 5+ years as a data or software engineer in a professional environment.
2. 5+ years in data engineering tasks such as ingestion, processing, ETL/ELT, parallel computing, and workflow orchestration.
3. Strong knowledge of databases and data storage solutions.
4. Ability to architect, develop, and test enterprise-level code following best practices.
5. Experience designing data models with strong understanding of modeling patterns.
6. Proficiency in at least one programming language.
7. Knowledge of distributed systems, monitoring, and alerting.
8. Cloud certifications, preferably GCP Data Engineer.
9. Experience in Data Science, Data Science Engineering, and deploying workloads to the cloud.
10. Experience with DevOps CI/CD workflows using tools like Github, Gitlab, Jenkins, etc.
11. Experience with infrastructure as code using Terraform.

About the Company

Bitstrapped is a fast-growing consulting firm specializing in Data and AI services. We help companies build data-to-AI infrastructure, architect cloud solutions, and develop systems for data ingestion, transformation, warehousing, migrations, and machine learning. We offer health benefits, home-office subsidies, and value diverse backgrounds and non-linear career paths.