Data Engineer (114)

Delan Associates, Inc; New York (NY); On-site; USD 100,000 - 165,000; Full time

Job summary

Delan Associates, Inc. is seeking a data professional with 3+ years of experience to improve operational and reporting data processes and infrastructure.

The role involves working in government or community-focused settings, handling SQL, Python, R, and BI tools, and building robust data pipelines in AWS. You will work with platforms like NGP VAN and Salesforce, and implement data engineering solutions using dbt, Dagster, and Docker while navigating secure enterprise networks.

Qualifications

• 3+ years of experience in data processing, analysis, and visualization.
• Experience with SQL databases such as Postgres, MSSQL, and DuckDB.
• Proficiency with Python, R, GIS, Tableau or Looker Data Studio, and advanced Excel/Sheets.
• Experience implementing data engineering pipelines with dbt and orchestration tools.
• Familiarity with enterprise platforms like NGP VAN, Salesforce, Hustle, Mobilize, Reach.
• Ability to operate in highly secure government networks, including TLS/SSL handling and proxies.
• Experience building data pipelines in AWS (EC2, ECR, Fargate, IAM, Lambda, Redshift, S3, VPC).
• Entity resolution and record linkage using probabilistic methods such as Splink.
• Strong written and verbal English communication.

Skills

SQL

Python

R

Tableau

Looker Data Studio

Excel/Google Sheets

dbt

Docker

Git/GitHub

Dagster

DLT

Ducklake

Sling

NGP VAN

Salesforce

Mobilize

Hustle

Reach

AWS

EC2

Redshift

S3

VPC

entity resolution

Splink

privacy & security in gov ecosystems

communication in English

Tools

dbt

Dagster

DLT

Docker

Ducklake

Git/GitHub

Sling

SQL tools (Postgres, MSSQL, DuckDB)

Tableau

Looker Data Studio

Job description

Required Skills

A minimum of 3 years of experience with the following skill sets:

• Working with to improve operational and reporting data processes and infrastructure, including 1+ years working in government, or in community, issue, labor, or political organizing
• Experience using one or more of the following data processing, analysis, and visualization tools in a professional setting: SQL (Postgres, MSSQL, DuckDB), Python, R, GIS, Tableau, Looker Data Studio, Excel/Google Sheets (advanced)
• Experience using one or more of the following tools/frameworks to implement and support data engineering, transformation, and orchestration/automation: dbt and dbt-duckdb, Dagster, DLT, Docker, Ducklake (S3 Postgres), git and GitHub, Sling
• Experience using 1+ of the following platforms: NGP VAN, Salesforce, Hustle, Mobilize and Reach
• Proficiency in working with complex enterprise network environments in highly secure government ecosystems, including differentiating between public and private networks, working within the confines of private networks, managing TLS/SSL and termination, configuring data egress/ingress through forward and reverse proxies.
• Experience processing, cleaning, manipulating, managing, and analyzing large datasets and building pipelines to automate these steps, preferably in an AWS environment with tools such as EC2, ECR, Farget, IAM, Lambda functions, Redshift, S3 buckets, and VPC and private subnetting
• Experience conducting entity resolution and record linkage (i.e., deduplication) using probabilistic frameworks like Splink.
• A demonstrated interest in public service and improving the lives of New Yorkers
• Eagerness to take initiative, ask questions, learn new skills, and solve problems in a fast-paced, mission-driven environment
• Strong written and oral communication skills in English