Contract Data Engineer: API & DB Pipelines

Talentify; Sunnyvale (CA); On-site; USD 83,000 - 152,000; Full time

Job summary

Talentify is seeking a Contract Data Engineer to build robust data pipelines, focusing on API integration and database management. The role involves Databricks, Snowflake, and relational databases to ensure clean, reliable data for analytics tools like Tableau.

The contractor will design, implement, and optimize ETL/ELT processes, collaborate with BI teams, and maintain data models and documentation in a fast-paced project environment.

Qualifications

• Experience building data pipelines from APIs and handling authentication and parsing.
• Strong SQL skills with database design and query optimization.
• Hands-on with Snowflake, Databricks, and relational databases.

Responsibilities

• Design, develop, and maintain scalable data ingestion pipelines from APIs.
• Implement ETL/ELT processes within the data platform.
• Manage and optimize data storage in Snowflake and Postgres.
• Utilize Databricks for processing and orchestration (PySpark).
• Ensure data quality and integrity across pipelines.
• Collaborate with BI users (Tableau) to shape data models for performance.
• Monitor pipelines for issues and implement fixes.
• Create technical documentation for pipelines and models.
• Troubleshoot data-related issues and provide timely resolutions.
• Follow best practices for data security and governance.

Skills

API integration

SQL/Postgres

Snowflake

Databricks

Python

ETL/ELT

Data quality

Cloud platforms

Tableau BI

Problem solving

Communication

Tools

Postgres

Snowflake

Databricks

Airflow

dbt

Docker

Job description

Talentify is seeking a Contract Data Engineer to build robust data pipelines, focusing on API integration and database management. The role involves Databricks, Snowflake, and relational databases to ensure clean, reliable data for analytics tools like Tableau.

The contractor will design, implement, and optimize ETL/ELT processes, collaborate with BI teams, and maintain data models and documentation in a fast-paced project environment.