Data Engineer: Scalable, Governed Pipelines for Analytics

3GIMBALS; United States; On-site; USD 135,000 - 185,000; Full time

Job summary

3GIMBALS is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure powering our analytical platform. You’ll ingest, transform, and curate large volumes of data from diverse sources and build automated ETL/ELT workflows for downstream analytics, knowledge graph, and modeling teams.

The role emphasizes scaling with secure environments, governance, and data quality for high-velocity datasets.

Qualifications

• 4+ years of data engineering experience building and operating production data pipelines.
• Strong programming in Python and SQL (Scala/Java a plus).
• Experience with distributed data processing frameworks (Spark, Dask, or similar).
• Hands-on experience with workflow orchestration tools (Airflow, Dagster, Prefect).
• Proficiency with relational and NoSQL databases (PostgreSQL, MongoDB, Elasticsearch).
• Experience with cloud data platforms and services (AWS, Azure, or GCP).

Responsibilities

• Design and build scalable batch and streaming pipelines to ingest structured and unstructured data from diverse sources.
• Develop ETL/ELT workflows to normalize, enrich, and transform data into standardized schemas.
• Build and maintain automated ingestion connectors for web, document, geospatial, and tabular data sources.
• Manage data orchestration and scheduling using Airflow, Dagster, or Prefect.
• Design and maintain data models, schemas, and storage across relational, NoSQL, and object stores.
• Build and maintain data lakes/lakehouses and analysis-ready data marts.
• Optimize partitioning, indexing, and query performance for large datasets.
• Support entity resolution and data linking with knowledge graph and modeling teams.
• Implement data validation, quality checks, and monitoring across pipelines.
• Establish data lineage, cataloging, and metadata management.
• Enforce data governance, provenance tracking, and source attribution for PAI/CAI data.
• Document datasets, schemas, and pipeline logic for downstream consumers.

Skills

Python

SQL

Spark

Airflow

Docker

Kubernetes

Data Modeling

PostgreSQL

NoSQL

Education

Bachelor's degree in Computer Science

Data Engineering

Tools

Airflow

Dagster

Prefect

Docker

Kubernetes

Job description

3GIMBALS is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure powering our analytical platform. You’ll ingest, transform, and curate large volumes of data from diverse sources and build automated ETL/ELT workflows for downstream analytics, knowledge graph, and modeling teams.

The role emphasizes scaling with secure environments, governance, and data quality for high-velocity datasets.