Senior DataOps Engineer - Artificial Intelligence New York, NY Posted yesterday

Bloomberg L.P.; New York (NY); On-site; USD 100,000 - 150,000; Full time

Job summary

An established industry player is seeking a Senior DataOps Engineer to join their AI Engineering team. In this role, you will design and build robust Data Platforms that enhance the machine learning model lifecycle. You will collaborate with talented engineers to streamline data management and improve efficiency in data practices. This position offers the opportunity to work with cutting-edge technologies and contribute to innovative AI-driven solutions that impact the financial marketplace. If you're passionate about data and AI, this is the perfect opportunity to make a significant impact in a dynamic environment.

Benefits

Health Care Plans

Flexible Work Hours

Professional Development Opportunities

Diversity and Inclusion Initiatives

Qualifications

• 4+ years of experience with object-oriented programming languages.
• Degree in Computer Science, Engineering, Mathematics, or equivalent.

Responsibilities

• Design and build scalable AI Data Platforms for data management.
• Collaborate with ML and Data Engineers to support their data needs.

Skills

Python

Go

Data Management

Problem Solving

Collaboration

Education

Degree in Computer Science

Degree in Engineering

Degree in Mathematics

Tools

Spark

Iceberg

Redis

Flink

Kubernetes

Argo Workflows

Buildpacks

AWS Sagemaker Feature Store

Job description

Bloomberg’s Engineering AI department has 300+ AI practitioners building highly sought-after products and features that often require novel innovations. We are investing in AI to build better search, discovery, and workflow solutions using technologies such as transformers, gradient boosted decision trees, large language models, and dense vector databases. We are expanding our group and seeking highly skilled individuals who will be responsible for contributing to the team (or teams) of Machine Learning (ML) and Software Engineers that are bringing innovative solutions to AI-driven customer-facing products.

At Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets.

Bloomberg has been building Artificial Intelligence applications that offer solutions to these problems with high accuracy and low latency since 2009. We build AI systems to help process and organize the ever-increasing volume of structured and unstructured information needed to make informed decisions. Our use of AI uncovers signals, helps us produce analytics about financial instruments in all asset classes, and delivers clarity when our clients need it most.

We are looking for Senior DataOps Engineers with strong expertise in developing data-intensive systems and a passion for building Data Platforms for ML at scale.

As a Senior DataOps Engineer, you will be responsible for designing and building scalable, robust, and secure Data Platforms that streamline data management for AI and improve the ML model development lifecycle. We are building platform solutions to create, store, access, and manage ML artifacts such as models, datasets, features, and usage logs. Our teams extensively use open source technologies such as OCI registry, Spark, Iceberg, Flink, Kafka, S3, Hadoop, Kubernetes, Argo, Buildpacks, and other distributed data processing and cloud-native MLOps technologies.

We will trust you to:

• Design, build, and maintain multi-tenant, managed AI Data Platforms that help users ingest billions of data points using batch and streaming data processing engines into storage systems like data lakehouses, vector DB, and low latency caches.

• Work with ML and Data Engineers to understand their data needs, provide platform support, identify inefficiencies in their data practices, and set the roadmap for AI Data Platforms.

• Collaborate with open-source communities and AI application teams to build a cohesive AI Data Platform experience.

• Develop systems that provide deep provenance and traceability for data artifacts.

• Operate with understanding of data security, compliance, and integrity.

We'd love to see:

• Prior experience with data technologies such as Spark, Iceberg, Redis, or Flink.

• Experience working with ML Feature Stores such as Feast, Feathr, Databricks, Tecton, or AWS Sagemaker Feature Store.

• Working knowledge of cloud-native technologies such as Kubernetes, Argo Workflows, or Buildpacks.

• Experience contributing to or maintaining an open-source project.

• Experience working with or developing cloud AI Platforms.

You will need to have:

• 4+ years of experience working with an object-oriented programming language (Python, Go, etc).

• A Degree in Computer Science, Engineering, Mathematics, similar field of study or equivalent work experience.

• Working understanding of ML fundamentals and the role of data within the MDLC and MMLC.

• An understanding of Computer Science fundamentals such as data structures and algorithms.

• An honest approach to problem-solving, and ability to collaborate with peers, stakeholders, and management.

Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email [e-mail]