Data Engineer

Remoteworldwide; Remote; USD 90,000 - 130,000; Full time

Job summary

A leading company in the VR space is seeking a Data Engineer to enhance their data infrastructure. This fully remote position involves collaborating with various teams to optimize data solutions and manage data warehousing, while ensuring data privacy and security. Applicants should have strong SQL and Python skills along with 3+ years of experience in the field.

Qualifications

• 3+ years in data engineering.
• Expert in SQL and Python for data pipeline development.
• Experience with Snowflake and AWS.

Responsibilities

• Design and implement data solutions aligned with business objectives.
• Build and maintain batch and real-time data warehouses using Snowflake.
• Develop ETL pipelines for data management.

Skills

SQL

Python

Data Warehousing

Data Orchestration

Problem-Solving

Communication

Job description

We’re looking for a Data Engineer to improve and transform our expanding data capabilities. Reporting to the Head of Data, the Data Engineer will collaborate closely with Data Science, Product, and Engineering to maintain and optimize our data infrastructure and analytics stack. The ideal candidate will have a background in a technical field, will have expertise working with large production data sets, and will have experience building & maintaining a Data Warehouse. This position will be fully remote.

Duties & Responsibilities

• Design and Implement Data Solutions:Translate business requirements and end-to-end designs into technical implementations that align with VRChat's objectives.
• Data Warehouse Management:Build and maintain both batch and real-time data warehousing solutions using Snowflake on AWS to support VRChat's data needs.
• ETL Pipeline Development:Develop complex data pipelines using SQL queries and Python scripts to manage data extraction, transformation, and loading (ETL) processes.
• Data Orchestration:Implement and manage data orchestration tools (e.g., Dagster, Apache Airflow) to ensure seamless data workflow automation.
• Data Integration:Integrate diverse data sources, including MongoDB and SQL databases (e.g., Postgres, MySQL), facilitating comprehensive data analysis and decision-making processes.
• Infrastructure Scalability:Ensure the scalability and performance of data infrastructure to accommodate VRChat's growing data needs, leveraging technologies like Spark.
• System Upgrades and Rollouts:Participate in system rollouts, upgrades, and implementation of data system changes to streamline internal practices and support business growth.
• Cross-Functional Collaboration:Collaborate with Data Science, Product, and Engineering teams to build and maintain data products that drive VRChat's innovation.
• Data Privacy and Security:Ensure compliance with data privacy regulations and ethical standards in data handling, prioritizing user privacy and data security.
• Monitoring and Optimization:Monitor data system performance and resolve issues to ensure uninterrupted data processing and optimal system functionality.
• Stay Updated:Keep up to date on the latest technologies and practices in data engineering to continuously improve VRChat's data infrastructure.

Experience, Skills & Qualifications

• Experience:3+ years in data engineering.
• Technical Proficiency:Expert in SQL and Python for data pipeline development.
• Data Warehousing:Experience with data warehousing concepts and Snowflake.
• Database Knowledge:Familiarity with MongoDB and SQL databases (e.g., Postgres, MySQL).
• Cloud Services:Extensive experience with AWS or other cloud services.
• Data Orchestration:Experience with tools like Dagster or Apache Airflow.
• Communication:Excellent interpersonal and communication skills.
• Problem-Solving:Strong analytical and problem-solving abilities.
• Team Collaboration:Proven ability to work collaboratively in cross-functional teams.

Bonus Points

• Industry Experience:Experience in data engineering at a consumer technology, social media, or gaming company.
• Passion for Technology:Interest in social technology, gaming, or immersive experiences.
• Snowflake Expertise:Extensive experience with Snowflake.
• Distributed Computing Engines:Familiarity with engines like Spark, Flink, or Hive.
• Streaming Platforms:Experience with Kafka, Kinesis, or other streaming platforms.
• VR and Gaming:Understanding of VR, AR, and online communities.
• Certifications:Relevant certifications (e.g., SnowPro, AWS Certified Data Analytics) are a plus.
• Unity 3D:Basic understanding of Unity 3D development.
• Social Platforms:Experience with social platforms, social gaming, or interactive online environments.
• Innovative Thinking:Ability to think creatively and solve complex data challenges.
• Cloud ETL Tools:Experience with cloud-based ETL tools (e.g., Fivetran,Glue, Hevo).

VRChat offers an endless stream of social VR experiences by giving the power of creation to its community.