Principal Data Engineer

myBridge Corporation; San Jose, Northern (CA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

myBridge Corporation seeks a skilled Data Engineer to build, maintain, and scale real-time and batch data ingestion pipelines for multi-terabyte enterprise datasets in San Jose. You will collaborate with Data Science and BI teams to design optimized data warehouses and perform ETL/ELT transformations.

The role emphasizes data freshness, governance, and query performance, using Spark, Snowflake, Databricks, Python, SQL, Airflow, Kafka, and AWS Glue.

Qualifications

• Bachelor’s degree required in CS, Applied Mathematics, Data Analytics, or Information Systems.
• Snowflake SnowPro Advanced certification preferred.

Responsibilities

• Builds, maintains, and scales real-time and batch data ingestion pipelines for multi-terabyte datasets.
• Collaborates with Data Science and BI teams to design optimized data warehouses and perform ETL/ELT transformations.
• Guarantees data freshness, governance, and query performance.

Skills

Apache Spark

Snowflake

Databricks

Python

SQL

Apache Airflow

Kafka

Data Modeling

AWS Glue

Education

Bachelor’s degree in Computer Science, Applied Mathematics, Data Analytics, or Information Systems

Snowflake SnowPro Advanced certification

Job description

• Job Description: Builds, maintains, and scales real-time and batch data ingestion pipelines to process multi-terabyte enterprise datasets. Collaborates with Data Science and BI teams to design optimized data warehouses, perform ETL/ELT transformations, and guarantee data freshness, governance, and query performance.
• Required Skills: Apache Spark, Snowflake, Databricks, Python, SQL, Apache Airflow, Kafka, Data Modeling, AWS Glue.
• Education & Certifications: Bachelor’s degree in Computer Science, Applied Mathematics, Data Analytics, or Information Systems. Snowflake SnowPro Advanced certification preferred.