Senior Data Engineer

Pattern AI; Hayward Park (CA); On-site; USD 100,000 - 130,000; Full time

Job summary

Pattern AI is seeking a Data Engineer in Hayward Park, California, to join our team. The role focuses on expanding and optimizing data pipelines crucial for our automated machine learning platform. Candidates should have a minimum of 4 years of experience and proficiency in Python and SQL. Responsibilities include building and deploying data architectures and designing analytics solutions.

The position emphasizes collaboration across teams and requires expertise in various data management tools.

Qualifications

• A minimum of 4 years experience in data engineering, analytics engineering, or software engineering.
• Proficiency in Python and advanced SQL is required.
• Experience with Snowflake, BigQuery, Redshift, or similar data warehouses.

Responsibilities

• Build and deploy the data pipelines that power PatternAI’s machine learning platform.
• Develop warehouse architectures that integrate data from diverse sources.
• Design analytics solutions for product development and internal teams.

Skills

Data engineering

Python

SQL

ETL pipelines

Data modeling

Data warehousing

Docker

Git

AWS

Business Intelligence

Tools

Snowflake

BigQuery

Redshift

Meltano

dbt

Airflow

Superset

Job description

PatternAI is an automated machine learning platform that reveals critical patterns in data for narrow business problems.

Job Description

We are looking for a savvy Data Engineer to join our growing team of data experts. The hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

Responsibilities:

• Build and deploy the data pipelines that power PatternAI’s machine learning platform.
• Develop warehouse architectures that integrate data from diverse sources.
• Design analytics solutions for both product development and internal collaborators.

Qualifications

Experience:

• A minimum of 4 years experience in data engineering, analytics engineering, or software engineering with an emphasis on large scale data management and processing systems.
• Proficiency in Python and advanced SQL.
• Advanced experience with ETL pipelines, data modeling and managing data warehouses (Snowflake, BigQuery, Redshift, etc).
• Experience with SQL RDBMS such as MySQL, Postgres, Oracle, SQL Server, etc., as well as NoSQL systems such as MongoDB is required.
• Experience with tools including Meltano, dbt, Airflow, and Superset is required.
• Experience with Docker, Git and AWS (EC2, ECS, S3, Step Functions, and Athena).
• Analytics and Business Intelligence knowledge is highly preferred.
• Experience working with common SaaS APIs (such as CRMs) is preferred.

All your information will be kept confidential according to EEO guidelines.