Data Engineer: Build AI-Driven Pipelines with Ownership

Chartmetric; San Mateo (CA); Ibrido; USD 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Equity

Health insurance

Ownership of pipelines

Cutting-edge tools

Descrizione del lavoro

Chartmetric seeks a data engineer to build scalable ingestion pipelines and data models. You will work with Python, SQL, and Airflow to process data from streaming platforms and third-party vendors, serving insights across departments.

Join a fast-growing startup that values ownership, quality data, and collaboration with senior engineers, product, and data science. Hybrid work requires 3–4 days on-site in San Mateo or New York.

Competenze

• 2–4 years of experience building production data pipelines in high-volume environments.
• Strong Python and SQL, with hands-on Airflow and a columnar warehouse such as ClickHouse or Snowflake, and AWS.
• Experience building pipelines handling millions of records daily, including messy third-party APIs and rate limits.
• Strong communication skills to translate complex technical concepts to cross-functional stakeholders.
• Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience.
• Thrives in dynamic startup environments with evolving requirements and tight delivery timelines.
• Bonus: experience with music industry data, streaming APIs, or social analytics platforms.

Mansioni

• Build and run Python ingestion pipelines that pull data from streaming platforms, social networks, and third-party data vendors, orchestrated in Apache Airflow.
• Work with data for 10M+ artists, 100M+ tracks, and 15M+ playlists, plus fast-growing datasets for creators, brands, and athletes.
• Model and serve data in ClickHouse and Snowflake, and help move our pipelines from Snowflake to S3 and ClickHouse.
• Build and maintain data shares and deliveries for enterprise customers, including major labels and publishers.
• Keep data fresh and correct: data monitoring, data quality checks, etc.
• Work closely with senior engineers, product, and data science on new data products, using AI coding tools as a normal part of your workflow.
• This position is hybrid, in our San Mateo or New York office 3–4 days a week

Conoscenze

Python

SQL

Airflow

AWS

Data pipelines

Formazione

Bachelor’s degree in Computer Science or Data Engineering

Strumenti

ClickHouse

Snowflake

AWS

Descrizione del lavoro

Chartmetric seeks a data engineer to build scalable ingestion pipelines and data models. You will work with Python, SQL, and Airflow to process data from streaming platforms and third-party vendors, serving insights across departments.

Join a fast-growing startup that values ownership, quality data, and collaboration with senior engineers, product, and data science. Hybrid work requires 3–4 days on-site in San Mateo or New York.