Principal Data Engineer - Real-Time Pipelines & Warehousing

myBridge Corporation; San Jose, Northern (CA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

myBridge Corporation seeks a skilled Data Engineer to build, maintain, and scale real-time and batch data ingestion pipelines for multi-terabyte enterprise datasets in San Jose. You will collaborate with Data Science and BI teams to design optimized data warehouses and perform ETL/ELT transformations.

The role emphasizes data freshness, governance, and query performance, using Spark, Snowflake, Databricks, Python, SQL, Airflow, Kafka, and AWS Glue.

Qualifications

• Bachelor’s degree required in CS, Applied Mathematics, Data Analytics, or Information Systems.
• Snowflake SnowPro Advanced certification preferred.

Responsibilities

• Builds, maintains, and scales real-time and batch data ingestion pipelines for multi-terabyte datasets.
• Collaborates with Data Science and BI teams to design optimized data warehouses and perform ETL/ELT transformations.
• Guarantees data freshness, governance, and query performance.

Skills

Apache Spark

Snowflake

Databricks

Python

SQL

Apache Airflow

Kafka

Data Modeling

AWS Glue

Education

Bachelor’s degree in Computer Science, Applied Mathematics, Data Analytics, or Information Systems

Snowflake SnowPro Advanced certification

Job description

myBridge Corporation seeks a skilled Data Engineer to build, maintain, and scale real-time and batch data ingestion pipelines for multi-terabyte enterprise datasets in San Jose. You will collaborate with Data Science and BI teams to design optimized data warehouses and perform ETL/ELT transformations.

The role emphasizes data freshness, governance, and query performance, using Spark, Snowflake, Databricks, Python, SQL, Airflow, Kafka, and AWS Glue.