Senior Data Engineer/ Data Engineering Architect

Petlibro; San Jose (CA); On-site; USD 160,000 - 215,000; Full time

Job summary

A leading technology company seeks a Senior Data Engineer/Data Engineering Architect responsible for designing scalable data architecture for IoT systems. This role involves optimizing data workflows for AI models and ensuring data integrity across various applications. Candidates should have a Bachelor's degree in a related field along with extensive experience in big data technologies and data system architecture.

Benefits

401(k)

401(k) matching

Dental insurance

Health insurance

Paid time off

Vision insurance

Wellness resources

Qualifications

• 5+ years of experience in data engineering focused on data warehousing.
• Expertise in IoT data systems and streaming technologies.
• Familiarity with MLOps practices.

Responsibilities

• Design data system architecture for IoT data collection.
• Optimize workflows for AIoT tasks.
• Collaborate with product owners to develop data solutions.

Skills

Data architecture

Big data technologies

IoT data systems

Data validation

Data processing workflows

MLOps

Education

Bachelor's degree in Computer Science, Data Science, Engineering

Tools

Python

Java

Kafka

Spark

MongoDB

ElasticSearch

S3

Snowflake

Job description

Join to apply for the Senior Data Engineer/ Data Engineering Architect role at Petlibro

Join to apply for the Senior Data Engineer/ Data Engineering Architect role at Petlibro

• Design robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices.
• Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes.
• Design and build a data validation framework to guarantee the accuracy and consistency of data across all stages of the pipeline, ensuring reliable insights and decision-making.
• Implement data architectures to continuously improve AI models through automated feedback loops and data collection processes.
• Optimize data processing workflows for AIoT tasks.
• Collaborate with product owners to translate data requirements into actionable data engineering solutions.
• Collaborate with other engineers, product owners to solve challenging problems.
• Evangelize software engineering best practices and lead by example.
  
  
  

Benefits:

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Paid time off
• Vision insurance
• Wellness resources
  
  
  

Responsibilities

• Design robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices.
• Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes.
• Design and build a data validation framework to guarantee the accuracy and consistency of data across all stages of the pipeline, ensuring reliable insights and decision-making.
• Implement data architectures to continuously improve AI models through automated feedback loops and data collection processes.
• Optimize data processing workflows for AIoT tasks.
• Collaborate with product owners to translate data requirements into actionable data engineering solutions.
• Collaborate with other engineers, product owners to solve challenging problems.
• Evangelize software engineering best practices and lead by example.
  
  
  

Qualifications

• Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
• 5+ years of proven experience in data engineering, with a strong focus on data warehousing and data system architecture.
• Expertise in design and build IoT data systems.
• Expertise in architecting that power high-volume consumer application.
• Expertise in big data and streaming technologies (Python, Java, Kafka, Spark,Spark Streaming).
• Expertise in moderen database technology (MongoDB, ElasticSearch, StarRocks, S3, Snowflake, Bigquery etc).
• Experience with data annotation tools and processes for machine learning datasets.
• Familiarity with MLOps practices and tools for managing AI model lifecycles.
• Knowledge about deploying systems into a production Cloud Native Environment (AWS or similar).
• Experience in Java Spring Framework is a plus
• Experience with video data handling and image processing is a plus

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Petlibro by 2x

Sign in to set job alerts for “Senior Data Engineer” roles.

Senior Software Engineer - Localization and Mapping (SLAM)

Senior Software Engineer, AI/ML, YouTube

Mountain View, CA $204,000.00-$259,000.00 2 weeks ago

Senior System Software Engineer, Cloud Services - GeForce Now

Palo Alto, CA $150,000.00-$200,000.00 2 weeks ago

Senior Software Engineer – Back End, Infrastructure Management

Senior Software Development Engineer, Virtual Network

San Jose, CA $224,000.00-$410,000.00 5 days ago

Senior Technical Marketing Engineer (SASE Visibility and Analytics)

Mountain View, CA $204,000.00-$259,000.00 1 week ago

Senior System Software Engineer, Power and Thermal Management

Senior Software Engineer, Metrics and Evaluation - Autonomous Vehicles

Senior Software Engineer, Fabric Networking - GPU

Santa Clara, CA $148,000.00-$287,500.00 6 days ago

San Jose, CA $200,400.00-$290,100.00 2 days ago

Sr. Software Engineer, HIL Automation, Autonomy

San Jose, CA $181,000.00-$354,200.00 2 weeks ago

Senior Software Engineer, ASIC Verification Tools

Senior Staff, Software Engineer (Client Facing, Test Automation, Networking) - GM1013440

Sunnyvale, CA $194,400.00-$279,450.00 1 week ago

San Jose, CA $120,000.00-$200,000.00 5 days ago

Senior Staff, Software Engineer (C++, System Designs, Linux, Routing & Switching)

Sr. SDE - ML, SEAS, Stores Economics and Science (SEAS)

Embedded Sr. Software Development Engineer, Hardware Compute Group

Sunnyvale, CA $151,300.00-$261,500.00 1 week ago

Business Operations Manager, Data, Developer and AI Infrastructure

Network & Data Security Product Architect

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.