Senior Data Engineer (GCP) — Data Pipelines & ML Ops

Robotics Prcocess Automation, LLC; Mountain View (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing and build scalable data pipelines on Google Cloud Platform. The ideal candidate should have extensive experience in GCP services and strong problem-solving skills. You will contribute to improving data management processes and ensuring the reliability of data infrastructure. A bachelor’s or master’s degree in a relevant field is required along with proficiency in various data science tools.

Qualifications

• Proficient in Python with experience in writing, maintaining, and optimizing data processing frameworks and libraries.
• Extensive experience with GCP services including BigQuery and Cloud Dataflow.
• Strong understanding of software engineering best practices including version control and CI/CD.

Responsibilities

• Develop and enhance Python frameworks and libraries for data processing and machine learning.
• Build and maintain scalable data pipelines on Google Cloud Platform.
• Implement monitoring, logging, and alerting systems for data infrastructure.

Skills

Python Expertise

Code Management

GCP Proficiency

Software Engineering

Data Management

Problem-Solving

Communication

Data Science Stack

Frameworks/Tools

Education

Bachelor’s or master’s degree in computer science, Engineering, Computer Information Systems, Mathematics, Physics, or a related field

Tools

Git

GitHub

BigQuery

Cloud Dataflow

Pub/Sub

Cloud Storage

TensorFlow

Apache Spark

scikit-learn

Jupyter Notebook

pandas

NumPy

Job description

A leading technology firm based in Mountain View, California is seeking a Data Engineer to develop and enhance Python frameworks for data processing and build scalable data pipelines on Google Cloud Platform. The ideal candidate should have extensive experience in GCP services and strong problem-solving skills. You will contribute to improving data management processes and ensuring the reliability of data infrastructure. A bachelor’s or master’s degree in a relevant field is required along with proficiency in various data science tools.