Data Platform Engineer - Python, SQL

Everforth CyberCoders

California

Hybrid

USD 112,000 - 136,000

Full time

3 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Base Salary: CAD 160k-195k
Remote (1x in office per month)
Healthcare package
Profit Sharing Bonus
Company Discounts

Job summary

CyberCoders, Inc. is seeking a Data Platform Engineer to design, build and operate scalable data infrastructure supporting analytics, ML, and operational workloads. You will lead modern data architectures including data lakes, lakehouses and warehouses across cloud and on‑prem environments.

The role requires hands-on experience with Spark, Hadoop, SQL and streaming platforms, plus IaC tooling for reliable deployments. A strong focus on data governance and security is essential.

Qualifications

  • 5+ years building large-scale data platforms.
  • Experience with cloud and hybrid environments.
  • Strong SQL and data modeling skills.

Responsibilities

  • Design, build and operate scalable data platforms for analytics, BI and ML.
  • Develop and optimize ETL/ELT and CDC pipelines across cloud/on‑prem.
  • Ensure data governance, security and performance in multi-cloud setups.

Skills

Data platform design
ETL/ELT pipelines
Spark & Hadoop
Cloud data platforms
SQL & data modeling
CI/CD & IaC

Education

Bachelor's or Master's in CS/Engineering

Tools

Airflow
Kafka
Terraform
Kubernetes
Databricks

Job description

Backed by industry leaders in the fitness world, our company has created a platform that enables anyone in the world to track their athletic performance and sign up for athletic events all over! We are actively growing the team and have an urgent need to bring on a Data Platform Engineer (Canadian Residents). If you are passionate about fitness and love working with a dynamic team, then come join us!


Position Overview

We are seeking an experienced Data Platform Engineer to design, build, and operate scalable data infrastructure that supports analytics, machine learning, and operational data workloads. The ideal candidate will lead the development of modern data architectures data lakes, lakehouses and data warehouses implement robust ETL/ELT and CDC pipelines, and ensure data governance, security and performance across cloud and on-prem environments. This role requires strong hands-on experience with distributed processing frameworks, cloud data services, streaming platforms and infrastructure-as-code to deliver reliable, performant and cost-effective data solutions.


Key Responsibilities


  • Design, build and maintain scalable data platforms including data lakes, lakehouses and data warehouses to support analytics, BI and ML use cases.

  • Develop, optimize and operate ETL/ELT pipelines and Change Data Capture (CDC) flows using tools such as Spark, Kafka, Debezium, Flink, Airflow, Prefect and NiFi.

  • Implement and tune batch and streaming processing with Apache Spark (Scala, Java, PySpark), SparkSQL, Presto/Trino, Hive, Flink and SQL engines for high-throughput, low-latency workloads.

  • Build and manage cloud-native data services across AWS, Azure and GCP including S3, GCS, HDFS, Databricks, Delta Lake, Snowflake, Amazon Redshift, Google BigQuery and Azure Synapse.

  • Design and implement data modeling, schema evolution, columnar storage (Parquet, ORC), Avro serialization, Delta Lake and lakehouse patterns to support OLAP and OLTP workloads.

  • Implement data integration, orchestration and CI/CD using tools such as Airflow, Prefect, Terraform, Kubernetes, Docker and Git; automate deployments and testing of data pipelines.

  • Ensure data governance, security and compliance through IAM, RBAC, encryption, auditing and data lineage practices; collaborate with security and product teams to enforce policies.

  • Monitor and troubleshoot platform health, performance tuning and capacity planning using Grafana, Prometheus, Datadog and other observability tools; optimize query and storage performance for systems like Redshift, ClickHouse and Redis.

  • Collaborate with data engineers, analysts, scientists and product teams to translate business requirements into scalable data solutions and provide operational runbooks and knowledge transfer.

  • Drive best practices for data quality, change management, documentation, and cost optimization across cloud and on-prem data environments.


Qualifications


  • Bachelors or Masters degree in Computer Science, Engineering or related field, or equivalent work experience.

  • 5+ years of hands-on experience building and operating large-scale data platforms, data warehouses and data lakes in cloud and hybrid environments.

  • Proven expertise with distributed data processing frameworks and languages including Apache Spark (Scala/Java/PySpark), SparkSQL, Presto/Trino, Hadoop and Hive.

  • Strong SQL skills including T-SQL and PL/SQL; experience with data modeling, OLAP/OLTP design and columnar storage formats (Parquet, ORC) and serialization (Avro).

  • Experience designing and implementing ETL/ELT and CDC pipelines using tools like Debezium, Kafka, Flink, Kinesis, Pulsar, Airflow, NiFi and dbt.

  • Hands-on experience with cloud data platforms and services: AWS (S3, Redshift, Kinesis), Azure (Synapse), GCP (BigQuery), Databricks, Snowflake and Delta Lake.

  • Familiarity with streaming technologies and message systems: Apache Kafka, Kinesis, Apache Pulsar and stream processing frameworks (Flink, Spark Streaming).

  • Experience with infrastructure-as-code and container orchestration: Terraform, Kubernetes, Docker and CI/CD best practices; proficiency with Git.

  • Understanding of data governance, IAM, RBAC, encryption, and privacy/compliance requirements; experience implementing lineage and auditing.

  • Strong troubleshooting and performance tuning skills for databases and query engines (Redshift, ClickHouse, MongoDB) and observability tools (Grafana, Prometheus, Datadog).

  • Excellent communication and collaboration skills, with experience mentoring engineers and working across product, analytics and security teams.


Benefits


  • Base Salary: $160,000 - $195,000 (CAD DOLLARS)

  • REMOTE (1x in office per month ideally)

  • Healthcare package

  • Profit Sharing Bonus!

  • Company Discounts

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Data Platform
Software Engineer, Data Platform

movableink • United States

Remote
USD 91,000 - 116,000
Elixir
Airflow
Kafka
+2
Senior Data Engineer
Senior Data Engineer

83zero Ltd • Baltimore (MD)

On-site
USD 120,000 - 150,000
Data Platform Engineer
Data Platform Engineer

Quix • United States

Remote
USD 84,000 - 119,000
Remote work
Senior Data Engineer
Senior Data Engineer

Zoominfo • United States

Remote
USD 110,000 - 170,000
Remote work
Principal Data Engineer
Principal Data Engineer

Zoominfo • United States

Remote
USD 172,000 - 270,000
Wellbeing programs
Senior Data Engineer
Senior Data Engineer

7Seventy • New York (NY)

Hybrid
USD 160,000 - 180,000
Employer 401(k) match
Wellness stipend
Remote-friendly, optional NYC office
+1
Senior Software Engineer, Data Platform
Senior Software Engineer, Data Platform

block • United States

Remote
USD 153,000 - 270,000
Medical insurance
Remote work across countries
Retirement savings plans
+1
Senior Data Engineer
Senior Data Engineer

Peyton Resource Group • Houston (TX)

On-site
USD 120,000 - 150,000
Data Platform Engineer
Data Platform Engineer

BrightAI • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Data Platform Engineer
Data Platform Engineer

Beecruit Pte Ltd • United States

Remote
USD 120,000 - 170,000