Remote Data Engineer: Scale Lakehouse Pipelines & Products

Pashtek • Salesforce Partner | Data & AI; United States; Remote; USD 83,000 - 179,000; Full time

Job summary

Pashtek • Salesforce Partner | Data & AI is seeking a Data Engineer to build and operate pipelines, tables, and services powering a hybrid data platform across on-premises and AWS. You will implement lakehouse patterns, productionize batch and streaming workloads, and collaborate with security, platform, analytics, and application teams to deliver governed, high-performance data products at scale.

You will develop ELT/ETL jobs using Spark/SQL/dbt/Airflow/Glue, create Iceberg/Delta/Hudi tables,

Qualifications

• 5+ years of data engineering delivering production pipelines on at least two large-scale platforms.
• Hands-on with AWS data services (S3, Glue/EMR, Lake Formation, IAM) and at least one data warehouse (Snowflake or Redshift).
• Deep experience with Apache Spark and related platforms (Databricks, EMR Spark, Snowpark, Dremio, Starburst/Trino).
• Experience with open table formats (Iceberg preferred), Delta Lake, or Apache Hudi; knowledge of metadata and schema evolution.
• On-prem stacks experience (Hadoop/Hive, Spark on Kubernetes, SQL Server/SSIS, Oracle/Exadata); Netezza/Teradata a plus.
• Proven data modeling (3NF, dimensional, Data Vault), ELT/ETL design, and SQL performance tuning.
• Security/governance: RBAC/ABAC, row/column security, masking/tokenization, KMS.
• IaC & CI/CD for data workloads.
• Excellent communicator with stakeholders to meet SLAs and roadmap goals.

Responsibilities

• Build data pipelines and data products using Spark/SQL/dbt/Airflow/Glue.
• Create and maintain lakehouse tables with Iceberg/Delta/Hudi.
• Operate compute engines (Spark, Trino/Starburst, Dremio, Snowflake).
• Model data for analytics and document contracts/SLAs.
• Apply governance, lineage, and security controls; support audit readiness.
• Tune performance and control costs; monitor clusters and workload isolation.
• Execute migrations from legacy on-prem to lakehouse patterns.
• Implement streaming/CDC pipelines with Kafka/MSK/Kinesis; Debezium/DMS/Fivetran.
• Ensure quality and observability with tests, data contracts, and SLO dashboards.
• Contribute to platform guardrails and write runbooks/docs.
• Practice DevOps for data with Terraform/CloudFormation and CI/CD.

Skills

Data modeling

SQL performance tuning

Communication

Security/governance

IaC/CI/CD

Tools

S3

Glue/EMR

Lake Formation

IAM

Snowflake/Redshift

Apache Spark

Iceberg/Delta/Hudi

KMS

Kafka/MSK/Kinesis

Job description

Pashtek • Salesforce Partner | Data & AI is seeking a Data Engineer to build and operate pipelines, tables, and services powering a hybrid data platform across on-premises and AWS. You will implement lakehouse patterns, productionize batch and streaming workloads, and collaborate with security, platform, analytics, and application teams to deliver governed, high-performance data products at scale.

You will develop ELT/ETL jobs using Spark/SQL/dbt/Airflow/Glue, create Iceberg/Delta/Hudi tables,