Platform Data Engineer

Neonredwood; San Francisco (CA); On-site; USD 110,000 - 170,000; Full time

Job summary

Neon Redwood is a data services consulting company seeking a Data Engineer II to help develop and expand our data infrastructure and analytics capabilities. The role targets professionals with at least 2 years of experience and a strong Python/BQ/GCP skill set.

As a full-time member of our team, you will design, implement, and maintain data pipelines, ETL processes, and data warehouses, collaborating closely with the CTO and engineers to deliver robust data solutions and drive data-driven

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field, or equivalent work experience.
• 2+ years of professional data engineering experience.
• Proficiency in Python, BigQuery, and Google Cloud Platform (GCP) or equivalent technologies.
• Experience with data pipeline and ETL process design and development.
• Excellent problem-solving skills and the ability to work independently or as part of a team.
• Strong communication, collaboration, and a passion to develop leadership skills.
• Passion for working with large-scale data sets and staying current with industry trends.
• Experience with Asana or similar project management tools.

Responsibilities

• Collaborate with the CTO and other team members to design, develop, and maintain data pipelines and ETL processes.
• Write clean, efficient, and maintainable code in Python and other relevant technologies.
• Implement and optimize data storage and processing solutions using BigQuery and Google Cloud Platform (GCP).
• Ensure data quality and integrity through proper data validation and monitoring techniques.
• Stay up-to-date with the latest industry trends and technologies to ensure our data infrastructure remains competitive.
• Assist in the development and launch of new data-driven tools and products.
• Mentor and guide junior engineers, fostering a culture of continuous learning and improvement.

Skills

Python

Data pipelines

ETL design

Team collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

BigQuery

Google Cloud Platform (GCP)

Asana

Apache Beam

Dataflow

Job description

Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities.

The Role

We are seeking an experienced Data Engineer II with a strong background in data engineering and a passion for working with large-scale data sets. Help us develop and expand our data infrastructure and analytics capabilities.

The ideal candidate will have at least 2 years of professional experience and a solid understanding of Python, BigQuery, and Google Cloud Platform (GCP) or similar technologies. This full-time role will involve working closely with our CTO and other team members to design, develop, and maintain data pipelines, ETL processes, and data warehousing solutions.

Responsibilities

Collaborate with the CTO and other team members to design, develop, and maintain data pipelines and ETL processes.

Write clean, efficient, and maintainable code in Python and other relevant technologies.

Implement and optimize data storage and processing solutions using BigQuery and Google Cloud Platform (GCP).

Ensure data quality and integrity through proper data validation and monitoring techniques.

Stay up-to-date with the latest industry trends and technologies to ensure our data infrastructure remains competitive.

Assist in the development and launch of new data-driven tools and products.

Mentor and guide junior engineers, fostering a culture of continuous learning and improvement.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.

2+ years of professional data engineering experience.

Proficiency in Python, BigQuery, and Google Cloud Platform (GCP) or equivalent technologies.

Experience with data pipeline and ETL process design and development.

Excellent problem-solving skills and the ability to work independently or as part of a team.

Strong communication, collaboration, and a passion to develop leadership skills.

Passion for working with large-scale data sets and staying current with industry trends.

Experience with Asana or similar project management tools.

Additional Skills (Nice to Have)

Experience with other data processing technologies and platforms (e.g., Apache Beam, Dataflow, Hadoop, Spark).

Experience with data visualization tools and libraries (e.g., Looker, Sigma, D3.js).

Knowledge of machine learning and AI concepts.

Experience with real-time data processing and streaming technologies (e.g., Kafka, Pub/Sub).