Senior Software Engineer, PILOT: Data Pipelines & Insights

Credo; San Jose (CA); On-site; USD 150,000 - 175,000; Full time

Job summary

Credo in San Jose, CA is seeking a Senior Software Engineer to join the PILOT team. You will build tools to ingest data from Credo products deployed in customer data centers and translate it into actionable insights to improve data center reliability.

You will collaborate with optical engineers, firmware engineers, and data center operators to define reliable metrics, develop dashboards, and integrate data pipelines across local and cloud environments.

Qualifications

• Bachelor's degree in computer science required.
• 6+ years of Python and data science stack experience.
• Strong OLAP database knowledge (DuckDB, ClickHouse, Snowflake, or Redshift).
• Experience collaborating in a group and using Git.
• Experience with cloud data pipelines and data lakes.
• Experience working with hardware products.
• Ability to work with cross-functional teams.
• Strong data science background to formalize insights.

Responsibilities

• Develop PILOT software to capture data from hardware.
• Integrate data into local and cloud data pipelines.
• Generate formalized and rigorous insights on ingested data.
• Develop documentation explaining our tools and insights.
• Work with cross-functional teams to define reliable insights and feedback.
• Develop visualizations to show data center performance.
• Analyze real world data to provide insights to improve products and customer operations.

Skills

Python

Data pipelines

Cross-functional work

Git

Hardware experience

Data science

Education

Bachelor's degree in computer science

Tools

DuckDB

ClickHouse

Snowflake

Amazon Redshift

Git

Job description

Credo in San Jose, CA is seeking a Senior Software Engineer to join the PILOT team. You will build tools to ingest data from Credo products deployed in customer data centers and translate it into actionable insights to improve data center reliability.

You will collaborate with optical engineers, firmware engineers, and data center operators to define reliable metrics, develop dashboards, and integrate data pipelines across local and cloud environments.