Data Infrastructure Engineer (Hadoop)

110 Magnite, Inc.US; New York (NY); Hybrid; USD 170,000 - 180,000; Full time

Benefits offered by this job

Comprehensive Healthcare Coverage from

Equity and Employee Stock PurchasePlan

401k Retirement Savings Plan with Em­

Disability and Life Insurance

Cell Phone Subsidy

Monthly Fitness and Reimbursement

Family-Focused Benefits and Parental

Generous Time Off Holiday Breaks andQu

Training opportunities

Company events and growth programs

Job summary

Magnite, the world's largest independent sell-side advertising platform, is seeking a Data Infrastructure Engineer (Hadoop) in New York City. This hybrid role combines in-office days with remote work and focuses on building and maintaining enterprise big data platforms to support analytics across the organization.

You will design and operate Hadoop ecosystems, Kafka streams, and NoSQL databases, collaborate with SRE and engineering teams, and drive platform modernization while ensuring security,

Qualifications

• 4+ years of experience administering distributed Big Data Platforms.
• Experience deploying and managing production grade Kafka infrastructure.
• Practical experience administering major NoSQL databases.
• Proficiency with shell scripting (Bash, Python, or similar).
• Experience with relational databases such as PostgreSQL or MySQL.
• Linux administration including storage, networking, security and performance.
• Experience with monitoring platforms such as Grafana, Prometheus, or similar.

Responsibilities

• Cluster & Infrastructure Administration: Hadoop management across MapR/Cloudera/Hortonworks.
• Linux Systems Engineering: manage Linux servers hosting the data platform.
• Performance Tuning: troubleshoot production environments.
• High Availability: backup, disaster recovery, on‑call rotations.
• Cross‑Functional DevOps & SRE Collaboration: IaC/CI‑CD integration.
• Data Ecosystem & Pipeline Management: manage data pipelines.
• Kafka Event Streaming: deploy and scale multi‑node Kafka clusters.
• NoSQL Database Management: admin NoSQL databases.
• Ecosystem Integration: support Hive, Spark, and HDFS.

Skills

Distributed data platforms

Scripting (Bash/Python)

Linux administration

Monitoring (Grafana/Prometheus)

NoSQL databases

Tools

Hadoop (MapR/Cloudera/Hortonworks)

Kafka

HBase/Aerospike/Cassandra/MongoDB

Hive/Spark/HDFS

Kubernetes

Terraform/Spacelift

Puppet/Ansible

AWS

Job description

Data Infrastructure Engineer (Hadoop) New York City, NY Hybrid Schedule (M/F remote, T/W/TH in-office)

At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we’re looking for people to help us tackle that responsibility with creativity and focus. Magnite (NASDAQ: MGNI) is the world’s largest independent sell-side advertising platform. Publishers use our technology to monetize our content across all screens and formats including CTV / streaming, online video, display, and audio. Our tech fuels billions of transactions per day!

About this team

We are seeking a Data Platform Engineer (Hadoop) to join our Infrastructure Engineering team. This role is responsible for designing, building, maintaining, and modernizing our enterprise big data platforms that support large-scale data processing and analytics across the organization. The ideal candidate has extensive experience with distributed data platforms such as Kafka, Hadoop/MapR, ultra-fast NoSQL databases (Redis, DynamoDB, Aerospike), and Linux-based infrastructure. This individual will work closely with Infrastructure, SRE, Database and Engineering teams to ensure our platforms are scalable, highly available, secure and performant. This is a hands‑on engineering role requiring strong operational experience supporting mission‑critical production environments while driving platform modernization initiatives.

In this role you will

• Cluster & Infrastructure Administration: Hadoop Management: Provision, configure, monitor and maintain robust distributed Hadoop clusters (e.g. MapR, Cloudera, Hortonworks)
• Linux Systems Engineering: Manage, optimise, and troubleshoot enterprise Linux servers (RedHat, CentOS, Rocky Linux) hosting the data platform.
• Performance Tuning: Troubleshooting, root cause analysis for production environments.
• High Availability: Maintain cluster backup, disaster recovery, production support and on‑call rotations
• Cross‑Functional DevOps & SRE Collaboration: Infrastructure as Code (Iac) CI/CD Integration
• Data Ecosystem & Pipeline Management:
• Kafka Event Streaming: Deploy, configure, tune and scale multi‑node Kafka clusters, topics, partitions and consumer groups.
• NoSQL Database Management: Administer, schema design, and performance‑tune NoSQL databases (such as HBase, Aerospike, Cassandra, or MongoDB)
• Ecosystem Integration: Support and integrate core Hadoop ecosystem tools including Hive, Spark, and HDFS.

We’re looking for someone with

• 4+ years of experience administering distributed Big Data Platforms.
• Messaging Systems: Proven experience deploying and managing production grade Kafka infrastructure.
• NoSQL Databases: Practical experience administering at least on major NoSQL database
• Scripting: Proficiency with shell scripting (Bash, Python, or similar).
• Experience with relational databases such as PostgreSQL or MySWL
• Linux Administration: Experience in Linux operating systems, including storage management, networking, security and performance troubleshooting.
• Experience with monitoring platforms such as Grafana, Prometheus, or similar

Preferred Qualifications

• Experience with Kubernetes and containerized workloads
• Experience with Ceph or other distributed storage platforms
• Experience with Infrastructure as Code tools such as Terraform or Spacelift
• Experience with configuration management tools such as Puppet or Ansible
• Experience with cloud platforms (AWS)

In New York, the base salary range for this role is $170,000 - $180,000.. Actual compensation will be determined based on location, experience, skills, and internal equity.

This role is also eligible for

• Annual performance-based bonus
• Equity (NASDAQ: MGNI)

Perks and Benefits

• Comprehensive Healthcare Coverage from Day One
• Generous Time Off Holiday Breaks and Quarterly Wellness Days
• Equity and Employee Stock Purchase Plan
• Family-Focused Benefits and Parental Leave
• 401k Retirement Savings Plan with Employer Match
• Disability and Life Insurance
• Cell Phone Subsidy
• Monthly Fitness and Reimbursement

Career Growth: We support internal mobility, skill development, and leadership pathways through structured career frameworks and learning programs.

Company Culture

Magnite’s culture is rooted in collaboration and connection, recognizing that both are essential to success. Our hybrid schedule includes two remote workdays (Monday and Friday) and three in‑office days (Tuesday through Thursday), where employees can take advantage of catered lunches, beverages, snacks, training opportunities, and engaging office events that enhance the work experience. In addition, we support our team through meaningful benefits and programs, including community service and volunteer opportunities, company‑matched charitable contributions, access to mental health resources, structured career development initiatives and growth frameworks, culture and inclusion programs, and our Bonusly peer‑to‑peer recognition platform.

About Us

The world's leading agencies and brands trust our platform to access brand‑safe, high‑quality ad inventory and execute billions of advertising transactions each month. Anchored in bustling New York City, sunny Los Angeles, mile‑high Denver, historic London, and down under in Sydney, Magnite has offices across North America, EMEA, LATAM, and APAC. Magnite is an Equal Opportunity Employer and does not discriminate against applicants due to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation or any other federal, state or local protected class. Our Commitment: We aim to incorporate a wide range of voices into our Magnite culture, cultivating an environment where employees feel welcomed, cared for, and encouraged to freely share ideas. We are committed to employee growth, collaboration, inclusion, and innovation. We invest in Magnite’s local communities. We seek talent from all backgrounds to champion corporate values of seeing the big picture and being catalysts of change.

Recruiting Agency Notice

Magnite does not accept agency resumes and is not responsible for any fees related to unsolicited resumes. Magnite was born in 2020 when the programmatic ad pioneers at Rubicon Project teamed up with the CTV experts at Telaria. To accelerate our CTV ambitions, we acquired CTV leader SpotX and ad management platform SpringServe in 2021. Now, Magnite is the industry’s largest scaled, independent CTV/video ad platform. Though CTV and video are now as important to Magnite as ever, we remain committed to our roots as an omnichannel SSP. Thousands of publishers around the globe rely on our technology to sell advertising on their terms and across every channel and format—including CTV, desktop, mobile, and audio. Likewise, we help the world’s leading agencies and brands reach millions of consumers efficiently, safely, and while respecting their privacy. The Magnite team is made up of hundreds of people across North America, EMEA, LATAM, and APAC, and our stock is traded on NASDAQ as MGNI.