Remote Senior Big Data Engineer

Bitstrapped; Ontario; Remote; CAD 90,000 - 130,000; Full time

Job summary

A growing consulting firm in Ontario seeks a Senior Data Engineer to join their Data Services Practice. The role involves designing and implementing data platforms primarily on Google Cloud, with responsibilities including data governance, project management, and developing scalable data solutions. Benefits include health coverage and support for diverse career paths.

Benefits

Health coverage (medical, dental, vision)

Subsidies for home-office equipment

Encouragement for underrepresented groups to apply

Qualifications

• Minimum 5+ years of experience as a data engineer or software engineer.
• Strong knowledge of databases and data storage solutions.
• Proficiency in at least one programming language.

Responsibilities

• Design, implement, automate, and maintain enterprise data systems.
• Implement data engineering technologies focusing on stream and batch processing.
• Manage multiple client projects with differing priorities.

Skills

Data ingestion

Data processing

ETL/ELT

Parallel computing

Workflow orchestration

Data governance

Cloud technologies

Programming

Infrastructure as code

DevOps CI/CD

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Beam

BigQuery

Pub/Sub

Terraform

Job description

We are seeking a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and collaborate with cloud architects to play a key role in our delivery teams. Responsibilities include designing, programming, and implementing data platform components, and serving as a hands-on consultant to our customers.

The role primarily involves working on Google Cloud, with interactions across other platforms such as AWS or Microsoft Azure in hybrid environments.

1. Design, implement, automate, and maintain enterprise data systems for our clients.
2. Implement data engineering technologies, focusing on stream and batch processing systems with Apache Beam / Dataflow, Data Warehouses including BigQuery, messaging systems like Pub/Sub, Data Lakes with BigLake and Cloud Storage, application databases including SQL, Postgres, Redis, and workflow automation with Composer DAGs.
3. Ensure data system robustness through caching, clustering, partitioning, event windows, and cost-efficient queries.
4. Implement data governance and security measures, including RBAC and CBAC.
5. Manage multiple client projects with differing priorities.
6. Write reusable, scalable, and test-driven code.
7. Work with project plans and milestones under the supervision of project managers and architects.
8. Hands-on experience with relational and non-relational databases, and file types like Parquet, Avro, CSV.
9. Minimum 5+ years of experience as a data engineer or software engineer, with specific experience in data ingestion, processing, ETL/ELT, parallel computing, and workflow orchestration.
10. Strong knowledge of databases and data storage solutions.
11. Ability to architect, develop, and test enterprise-level code following best practices.
12. Design data models with strong understanding of modeling patterns.
13. Proficiency in at least one programming language.
14. Experience with distributed systems, monitoring, alerting, and message contracts.
15. Cloud certifications, such as GCP Data Engineer, are preferred.
16. Experience in Data Science, Data Science Engineering, and deploying workloads to the cloud.
17. Familiarity with DevOps CI/CD workflows using tools like Github, Gitlab, Jenkins, CircleCI, Bitbucket.
18. Experience with infrastructure as code, particularly Terraform.

Our company, Bitstrapped, is a growing consulting firm specializing in Data and AI services. We focus on helping companies develop advanced data-to-AI infrastructure to improve their market position and business outcomes. Our services include designing cloud solutions, data engineering, MLOps, and AI infrastructure, covering data ingestion, transformation, warehousing, migrations, and machine learning applications.

Benefits include health coverage (medical, dental, vision), subsidies for home-office equipment, and we value diverse and non-traditional career paths, especially encouraging underrepresented groups to apply.