Senior Data Infrastructure Engineer — Build AI Data Pipelines

arena; San Francisco (CA); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation

Health and wellness benefits

Opportunity to work with cutting-edge AI technology

Job summary

Arena is seeking a Software Engineer in San Francisco to design and build data pipelines for AI evaluation. The role focuses on analyzing user vote data to improve model performance assessments.

Ideal candidates have strong backgrounds in software engineering, particularly in data systems, and are proficient in SQL and Python. They will collaborate closely with research and product teams to ensure data quality and innovate data infrastructure solution.

Qualifications

• 5+ years of experience in software engineering with a focus on big data technologies.
• Proficiency in SQL and Python (or similar language).
• Hands-on experience with data processing frameworks.

Responsibilities

• Design and build data pipelines for user vote data processing.
• Collaborate with teams to meet product goals.
• Implement data integrity and quality solutions.

Skills

Software engineering

Data engineering

SQL

Python

Apache Spark

Data quality

Education

5+ years of experience in software engineering

Tools

Apache Spark

Databricks

Snowflake

Job description

Arena is seeking a Software Engineer in San Francisco to design and build data pipelines for AI evaluation. The role focuses on analyzing user vote data to improve model performance assessments.

Ideal candidates have strong backgrounds in software engineering, particularly in data systems, and are proficient in SQL and Python. They will collaborate closely with research and product teams to ensure data quality and innovate data infrastructure solution.