Staff Data Engineer

palmettocleantech; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Remote work in the United States

Job summary

Palmetto Clean Tech is seeking a senior data platform engineer to steer the technical direction and build core data platform components used by product teams, partners, analysts, and AI agents. This role ensures a governed, consistent data view with auditable access.

You will own trusted data products, implement policy-as-code, and collaborate across analytics, engineering, and finance to shape data requirements while mentoring teammates and creating reusable CI templates.

Qualifications

• At least eight years in data engineering with lead ownership of a platform used by multiple teams.
• Strong SQL and Python with solid data warehousing fundamentals (schema design, query planning, distributed computing).
• Experience with dbt or a comparable transformation framework and ETL orchestration tools (e.g., Fivetran, Airflow).
• IaC and container orchestration on cloud platforms (AWS, GCP, or Azure).
• Knowledge of API design, authentication/authorization (OAuth/OIDC, RBAC), and PII handling.
• Experience writing design docs addressing cross-team architecture questions and guiding development workflows.

Responsibilities

• Build and own trusted data products across the data lifecycle for analysts, engineers, product teams, partners, and AI tools.
• Create semantic context, documentation, and interfaces so AI agents can use governed definitions and produce traceable results.
• Implement classification, masking, access policies, and change control as code for audit readiness.
• Build and operate ingestion/orchestration with CI/CD, observability, and alerting.
• Design secure, low-latency data interfaces for diverse users and systems.
• Collaborate with finance, ops, product, and eng to shape data requirements; review code and mentor colleagues.

Skills

SQL

Python

Data warehousing

DBT

Analytical thinking

Education

Bachelor's degree (related field)

Tools

Airflow

Fivetran

Kubernetes

Terraform

Job description

Role overview

Set the technical direction and build core parts of a data platform used by product teams, partners, analysts, and AI agents. This senior individual contributor role brings data from across the customer journey into a governed, consistent view, with shared metric definitions and secure, auditable ways to access the information.

Responsibilities

• Build and own trusted data products across the data lifecycle, serving analysts, engineers, product teams, partners, and AI tools.
• Create semantic context, documentation, and interfaces so AI agents can use governed definitions and return answers traceable to source.
• Implement classification, masking, access policies, and change control as code, supporting compliance audit readiness.
• Build and operate ingestion and orchestration with CI/CD, observability, alerting, and service expectations.
• Design and run secure, authorized, low-latency interfaces through which people and systems consume data.
• Work with finance, operations, product, and engineering to shape data requirements; review code, mentor colleagues, and provide reusable templates and CI checks.

Requirements

• At least eight years in data engineering, including Staff- or lead-level ownership of a platform used by multiple teams.
• Deep SQL and Python skills, plus strong analytical warehouse fundamentals such as schema design, query planning, and distributed computing.
• Substantial experience with dbt or a comparable transformation framework, and with ETL orchestration tools such as Fivetran or Airflow.
• Experience with infrastructure as code and container orchestration on AWS, Google Cloud, or Azure.
• Working knowledge of API design, authentication and authorization such as OAuth/OIDC or RBAC, and personally identifiable information handling.
• Experience using coding agents in development workflows with specifications and tests, and writing design documents that resolve cross-team architecture questions.
• Clear written and verbal communication with non-technical partners.

Nice to have

• Familiarity with reporting tools such as Looker or Hex.

Benefits and work setup

• Remote position based in the United States.