Data Engineer 114

Delan Associates, Inc; New York (NY); On-site; USD 110,000 - 160,000; Full time

Job summary

Delan Associates, Inc. is seeking a data engineering / analytics professional to enhance operational and reporting data processes within secure government ecosystems.

Responsibilities include building pipelines, data cleaning, and leveraging SQL, Python, and visualization tools to drive insights for NY-focused public service initiatives. Candidates should have 3+ years of experience with enterprise data environments, experience with AWS components, and a proven ability to work in fast-paced,

Qualifications

• At least 3 years building data processing and reporting pipelines.
• Experience in government, or community, labor, or political organizing contexts is preferred.

Skills

SQL

Python

R

GIS

Tableau

Looker

Excel

Google Sheets

Entity resolution

Tools

dbt

dbt-duckdb

Dagster

DLT

Docker

Ducklake

git

GitHub

Sling

Job description

Required Skills

A minimum of 3 years of experience with the following skill sets:

• Working with to improve operational and reporting data processes and infrastructure, including 1+ years working in government, or in community, issue, labor, or political organizing
• Experience using one or more of the following data processing, analysis, and visualization tools in a professional setting: SQL (Postgres, MSSQL, DuckDB), Python, R, GIS, Tableau, Looker Data Studio, Excel/Google Sheets (advanced)
• Experience using one or more of the following tools/frameworks to implement and support data engineering, transformation, and orchestration/automation: dbt and dbt-duckdb, Dagster, DLT, Docker, Ducklake (S3 Postgres), git and GitHub, Sling
• Experience using 1+ of the following platforms: NGP VAN, Salesforce, Hustle, Mobilize and Reach
• Proficiency in working with complex enterprise network environments in highly secure government ecosystems, including differentiating between public and private networks, working within the confines of private networks, managing TLS/SSL and termination, configuring data egress/ingress through forward and reverse proxies.
• Experience processing, cleaning, manipulating, managing, and analyzing large datasets and building pipelines to automate these steps, preferably in an AWS environment with tools such as EC2, ECR, Farget, IAM, Lambda functions, Redshift, S3 buckets, and VPC and private subnetting
• Experience conducting entity resolution and record linkage (i.e., deduplication) using probabilistic frameworks like Splink.
• A demonstrated interest in public service and improving the lives of New Yorkers
• Eagerness to take initiative, ask questions, learn new skills, and solve problems in a fast-paced, mission-driven environment
• Strong written and oral communication skills in English