Senior AI Platform Engineer: Data & ML Systems

Fdetimes; Redwood City (CA); Vor Ort; USD 145.000 - 187.000; Vollzeit

Zusammenfassung

C3 AI is seeking a Senior Software Engineer to join the Data organization within Platform Engineering. You will design and build scalable infrastructure for data pipelines and ML workflows, working across Cassandra, PostgreSQL, Snowflake, and cloud storage like AWS S3/Azure/BLOBs.

Collaborative, fast-paced environment at petabyte-scale with cross-team impact. Responsibilities include API development, distributed systems components, and integration with Spark, Ray, and Pandas/Koalas for data

Qualifikationen

• Bachelor of Science in Computer Science, Computer Engineering, or related fields.
• Minimum 5 years of work experience in a fast-paced software company.
• Strong understanding of CS fundamentals.
• Proficient in compiled languages (Java, C++, C#) and Python.
• Strong OO programming, data structures, algorithms, and design patterns.
• Experience with Git.
• Experience with large-scale distributed systems.
• Experience with AWS, Azure, or GCP.
• Familiarity with Hadoop, Spark, Kafka; cloud-managed versions OK.
• Familiarity with Pandas and Koalas.

Aufgaben

• Design and develop infrastructure and services for data pipelines at petabyte scale.
• Create abstractions over datastores like Cassandra, PostgreSQL, Snowflake.
• Build file system abstractions over S3, Azure Blobs, HDFS.
• Develop connectors to external data stores.
• Build distributed system components for streaming, batching, analytics.
• Develop high-performance APIs for AI/ML applications.
• Support distributed computations over large-scale data for ML workflows.
• Create ML-specific data-systems like feature stores and recommendation engines.
• Integrate with Spark, Ray for data exploration and ML orchestration.
• Integrate with Pandas, Koalas for data analysis.
• Develop and productionize AI/ML models for failure prediction and schema inference.
• Work with architects, product managers, and engineers in a collaborative environment.
• Contribute to test-driven development and agile delivery.

Kenntnisse

Java

C++

C#

Python

Distributed systems

Data pipelines

Object-oriented programming

Algorithms

Git

Cloud platforms

REST

GraphQL

Spark

Kafka

Pandas

Koalas

Ausbildung

Bachelor of Science in Computer Science, Computer Engineering, or related fields

Tools

Git

Hadoop

Spark

Kafka

Pandas

Koalas

Jobbeschreibung

C3 AI is seeking a Senior Software Engineer to join the Data organization within Platform Engineering. You will design and build scalable infrastructure for data pipelines and ML workflows, working across Cassandra, PostgreSQL, Snowflake, and cloud storage like AWS S3/Azure/BLOBs.

Collaborative, fast-paced environment at petabyte-scale with cross-team impact. Responsibilities include API development, distributed systems components, and integration with Spark, Ray, and Pandas/Koalas for data