Senior Software Engineer, Platform - Data + AI (Back-End)

FDE Times

Redwood City (CA)

In loco

USD 145.000 - 187.000

Tempo pieno

14 giorni+

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Descrizione del lavoro

C3 AI is seeking a Senior Software Engineer to join the Data organization within Platform Engineering. You will design and build scalable infrastructure for data pipelines and ML workflows, working across Cassandra, PostgreSQL, Snowflake, and cloud storage like AWS S3/Azure/BLOBs.

Collaborative, fast-paced environment at petabyte-scale with cross-team impact. Responsibilities include API development, distributed systems components, and integration with Spark, Ray, and Pandas/Koalas for data

Competenze

Bachelor of Science in Computer Science, Computer Engineering, or related fields.
Minimum 5 years of work experience in a fast-paced software company.
Strong understanding of CS fundamentals.
Proficient in compiled languages (Java, C++, C#) and Python.
Strong OO programming, data structures, algorithms, and design patterns.
Experience with Git.
Experience with large-scale distributed systems.
Experience with AWS, Azure, or GCP.
Familiarity with Hadoop, Spark, Kafka; cloud-managed versions OK.
Familiarity with Pandas and Koalas.

Mansioni

Design and develop infrastructure and services for data pipelines at petabyte scale.
Create abstractions over datastores like Cassandra, PostgreSQL, Snowflake.
Build file system abstractions over S3, Azure Blobs, HDFS.
Develop connectors to external data stores.
Build distributed system components for streaming, batching, analytics.
Develop high-performance APIs for AI/ML applications.
Support distributed computations over large-scale data for ML workflows.
Create ML-specific data-systems like feature stores and recommendation engines.
Integrate with Spark, Ray for data exploration and ML orchestration.
Integrate with Pandas, Koalas for data analysis.
Develop and productionize AI/ML models for failure prediction and schema inference.
Work with architects, product managers, and engineers in a collaborative environment.
Contribute to test-driven development and agile delivery.

Conoscenze

Java

C++

Python

Distributed systems

Data pipelines

Object-oriented programming

Algorithms

Git

Cloud platforms

REST

GraphQL

Spark

Kafka

Pandas

Koalas

Formazione

Bachelor of Science in Computer Science, Computer Engineering, or related fields

Strumenti

Git

Hadoop

Spark

Kafka

Pandas

Koalas

Descrizione del lavoro

C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise. Learn more at: C3 AI

C3 AI is looking for Senior Software Engineers to join the rapidly growing Data org within the Platform Engineering department. Successful candidates will get the opportunity to work on high-value technologies at the intersection of large-scale distributed systems, data infrastructure, and machine learning. You will design, develop, and maintain various features in a highly scalable and extensible AI/ML platform for large-scale applications, involving data science, distributed systems, and multi-cloud strategy.

You will be given opportunities to take ownership of components, collaborate to drive technical direction, and work on interesting, impactful projects. Join us in building the next-generation AI/ML platform at petabyte level scale that powers some of the world’s largest companies in Energy, Financial Services, Utilities, Health Care, Aerospace, Defense, etc. Accelerate your career in the leading enterprise AI company that is in a hyper-growth trajectory.

Responsibilities

Design and develop infrastructure and services to enable data pipelines for petabyte level scale and more.
Design and develop abstractions over datastores such as Cassandra, PostgreSQL, Snowflake, etc.
Design and develop file system abstractions over AWS S3, Azure Blobs, HDFS, etc.
Design and develop connectors to various external data stores.
Design and develop distributed system components for stream processing, queueing, batch processing, analytics engines, etc.
Develop and maintain industry-leading, high-performance APIs for AL/ML applications.
Develop and maintain features for distributed computations over large-scale data for ML workflows.
Design and develop ML-specific data-systems such as feature stores and behavioral frameworks such as recommendation engines.
Design and develop integrations with distributed computing technologies such as Apache Spark, Ray, etc. for data exploration and ML workload orchestration.
Design and develop integrations with data analysis libraries such as Pandas, Koalas, etc.
Develop and production AI/ML models for failure prediction, data schema inferencing, etc.
Work on frameworks for performance, scalability, and reliability tracking over different components of a highly extensible AI/ML platform.
Work with architects, product managers, and software engineers across teams in a highly collaborative environment.
Participate and provide insights in technical discussions.
Write clean code following a test-driven methodology.
Deliver commitments promptly following agile software development methodology.

Qualifications

Bachelor of Science in Computer Science, Computer Engineering, or related fields.
A minimum of 5 years of work experience in a fast-paced software company.
Strong understanding of Computer Science fundamentals.
High proficiency in coding with Java, C++, C#, or some other compiled language. Python would also be acceptable.
Strong competency in object-oriented programming, data structures, algorithms, and software design patterns.
Experience with version control systems such as Git.
Experience with large-scale distributed systems.
Experience with any public cloud platform (AWS, Azure, GCP).
Some familiarity with distributed computing technologies (e.g., Hadoop, Spark, Kafka). Familiarity with managed versions of these technologies on public cloud platforms is also acceptable.
Familiarity with technologies in the modern data science/analysis and engineering ecosystem (e.g., Pandas, Koalas).
Good verbal and written technical communication ability to facilitate collaboration.
Thrive in a fast-paced, dynamic environment and value end-to-end ownership of components.
Intellectually curious and open to challenges.

Preferred Qualifications

Advanced degree in engineering, sciences, or related field.
Experience with Agile development methodology.
Experience developing and working with REST and/or GraphQL APIs.
Experience building scalable and reliable data pipelines.
Experience with integration of data from multiple sources.
Experience working with analytics and/or data processing engines.
Experience developing distributed computation over large-scale data.
Experience working with distributed computing frameworks (e.g., Hadoop, Spark, Kafka).
Experience with data science/analysis libraries (e.g., Pandas, Koalas).
Experience with task schedulers in distributed computing (e.g., Spark, Ray, Dask).
Familiarity with machine learning workload orchestration in a distributed computing environment.
Familiarity with workflow execution and/or optimization using DAGs, ideally for machine learning use-cases.
Conceptual understanding of orchestration and resource provisioning systems (Kubernetes)