Big Data Engineer

OSI Engineering; Mountain View (CA); On-site; USD 110,208 - 130,872; Full time

Job summary

A leading consumer device company based in Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable cloud services that power the world’s best-selling mobile devices. The role requires expertise in Big Data technologies and involves designing and implementing backend services for predictive data modeling and machine learning. The ideal candidate should possess strong statistical analysis skills and experience in REST API development.

Qualifications

• Hands-on experience in Big Data technologies including Apache Iceberg.
• Strong skills in statistical analysis, correlation and regression analysis.
• Experience designing and maintaining REST APIs.

Responsibilities

• Implement and maintain big data platforms and infrastructures.
• Design and develop backend REST API Services and ETL processes.
• Conduct research to inform architecture and design decisions.

Skills

Big Data technologies (Apache Iceberg, Spark, Kafka)

Statistical analysis

Algorithms

UNIX/Linux

Machine Learning

REST APIs

Data Modeling

Networking

Team collaboration

Education

MS in Computer Science or equivalent experience

Tools

Data Quality tools (Monte Carlo, Great Expectations, Databand)

MLflow

Job description

This range is provided by OSI Engineering. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$80.00/hr - $95.00/hr

A globally leading consumer device company based in Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable cloud services that power the world’s best-selling mobile devices. As part of the Knox Cloud Team, you’ll play a key role in transforming research projects into production-ready cloud platforms and service infrastructures. We’re looking for world-class server software engineers with strong expertise in Big Data infrastructure and data warehousing to join our innovative technology group driving the rapid development of AI-powered, cloud-based, end-to-end mobile applications and services.

Responsibilities Include:

• Implement, maintain and evolve big data platform and infrastructure
• Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system
• Perform extensive research and analysis to make optimal architecture and design decisions
• Write large amounts of code, perform code reviews, write unit tests and documentation
• Interface with other groups including Product Management, QA and Operations
• Work in a scrum team with ML & Cloud Engineers

Candidate Requirements:

• Hand-on experience in Big Data technologies like Apache Iceberg (a must-have), Spark, Spark ML, & Kafka
• Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
• Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
• Hands-on experience in building REST API’s
• Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
• Desire to learn fast and pick up latest and greatest technologies
• MS in Computer Science or equivalent experience

Preferred:

• Data Quality tools such as Monte Carlo, Great Expectations, or Databand
• Experience with teams using MLflow

Type: Contract

Duration: 12 months with extension

Work Location: Mountain View, CA (on-site)

Pay range: $80.00 - $95.00 (DOE)

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Software Development