Remote Data Engineer: API Pipelines & DB Optimization

Spectraforce Technologies; Sunnyvale (CA); On-site; USD 96,432 - 165,312; Part time

Job summary

Spectraforce Technologies invites a Contract Data Engineer to design and maintain robust data pipelines, integrating multiple APIs while managing Snowflake and PostgreSQL data stores. You will collaborate with BI users to prepare reliable data sources for Tableau, ensuring data quality and governance in a fast-paced contract environment.

The role emphasizes hands-on work with Databricks for processing and orchestration, REST/SOAP API ingestion, and strong SQL/ Python skills to deliver scalable

Qualifications

• Proven experience building data pipelines from diverse APIs
• Strong SQL, data modeling, and query optimization skills
• Hands-on with Snowflake, Databricks, and Postgres databases
• Experience with data quality, governance, and security practices
• Proficiency in Python or similar languages for data engineering
• Experience integrating and preparing data for Tableau or BI tools
• Knowledge of cloud platforms (AWS/Azure/GCP) and data warehousing concepts
• Ability to work independently in fast-paced contract environments

Responsibilities

• Design and maintain scalable data ingestion pipelines from REST and SOAP APIs
• Implement ETL/ELT processes within Snowflake/Postgres data stores
• Leverage Databricks for data processing and orchestration
• Collaborate with BI users to optimize data models for Tableau
• Ensure data quality, lineage, and governance across pipelines
• Monitor pipelines for performance and reliability; troubleshoot data issues
• Document data models, pipelines, and processes
• Provide timely resolutions to data-related issues

Skills

API integration

SQL

Python

Databricks

Snowflake

PostgreSQL

Cloud platforms

BI data modeling

Data quality

Data governance

Tools

Tableau

ETL/ELT

REST APIs

SOAP APIs

dbt

Airflow

Docker

Job description

Spectraforce Technologies invites a Contract Data Engineer to design and maintain robust data pipelines, integrating multiple APIs while managing Snowflake and PostgreSQL data stores. You will collaborate with BI users to prepare reliable data sources for Tableau, ensuring data quality and governance in a fast-paced contract environment.

The role emphasizes hands-on work with Databricks for processing and orchestration, REST/SOAP API ingestion, and strong SQL/ Python skills to deliver scalable