Senior Data Engineer - Cloud & Data Pipelines (Remote)

TSPi; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

TSPi seeks a Data Engineer 4 to lead production data pipelines, interfaces, and cloud services delivering vessel and enforcement data to applications. You will be hands-on with GCP, BigQuery, SQL, APIs, and pipeline architecture, while mentoring teammates in an Agile environment.

Responsibilities include designing secure data workloads, establishing data lineage, CI/CD improvements, and cost-efficient operations across development to production. A government background check is required.

Qualifications

• Minimum 9 years of professional experience in data engineering, systems integration, software engineering, or a related role, including responsibility for complex production systems.
• Advanced experience designing, building, and supporting data pipelines in Google Cloud Platform or a comparable cloud environment.
• Advanced SQL skills and demonstrated experience designing solutions with BigQuery, relational databases, or cloud data warehouses.
• Strong proficiency with Python, Java, or another language used for production data-processing and integration services.
• Demonstrated experience designing REST API integrations, data contracts, schema-evolution strategies, mappings, transformations, and reconciliation processes.
• Experience leading production troubleshooting, incident response, root-cause analysis, and resolution of complex data-quality or integration issues.
• Experience establishing Git or GitHub workflows, code-review standards, automated testing, continuous integration, and deployment pipelines.
• Ability to assess an existing architecture and codebase, identify technical risk, and assume ownership of mission-critical services with limited oversight.
• Strong technical leadership, documentation, communication, mentoring, and cross-functional collaboration skills in an Agile environment.
• Bachelor's degree in computer science, information systems, data engineering, or a related field, or equivalent practical experience.

Responsibilities

• Design, modernize, and support production data pipelines ingesting vessel, permit, trip, and enforcement data.
• Define scalable integration patterns for batch, streaming, and API workloads.
• Translate business needs into source-to-target mappings, canonical models, schema strategies, transformation logic, reference-data rules, and data-quality controls.
• Design and optimize SQL and data-processing logic for ingestion, reconciliation, analytics.
• Establish data lineage, versioning, and controlled schema evolution across systems.
• Lead technical reviews, set engineering standards, and guide source-code, configuration, testing, and release practices through Git or GitHub workflows.
• Architect and implement secure, resilient data workloads using BigQuery and other Google Cloud Platform services.
• Guide the design of cloud storage, orchestration, service identities, secrets, configuration, networking, and deployment settings.
• Improve continuous integration and delivery pipelines and establish automated deployments across environments.
• Evaluate architectural tradeoffs and improve performance, scalability, cost efficiency, recoverability, and observability.
• Apply federal security requirements, least-privilege access, encryption, auditability, and secure service-to-service communication practices.

Skills

GCP

BigQuery

SQL

Python

Java

REST API

Data pipelines

Git/GitHub

Cloud architecture

Data quality

Mentoring

Security best practices

Education

Bachelor's degree

Tools

Docker

Cloud Run

Cloud Functions

Pub/Sub

Cloud Storage

Dataflow

Composer

Observability tools

Job description

TSPi seeks a Data Engineer 4 to lead production data pipelines, interfaces, and cloud services delivering vessel and enforcement data to applications. You will be hands-on with GCP, BigQuery, SQL, APIs, and pipeline architecture, while mentoring teammates in an Agile environment.

Responsibilities include designing secure data workloads, establishing data lineage, CI/CD improvements, and cost-efficient operations across development to production. A government background check is required.