Data Engineer

1872 Consulting; New York (NY); Remote; USD 100,000 - 130,000; Full time

Job summary

A leading B2B research company is seeking a passionate Data Engineer to join their growing team. The role involves building robust data pipelines and software components, requiring strong proficiency in Python and data engineering expertise. The position offers competitive compensation, remote work flexibility, and opportunities to influence data technologies early in development.

Qualifications

• 3+ years experience in software development required.
• Strong proficiency in Python is essential.
• Experience with big data stack and building data pipelines preferred.

Responsibilities

• Build reliable data pipelines to clean and transform large datasets.
• Develop software components for extracting information from text data.
• Improve search services performance and quality.

Skills

Python

Data Engineering

SQL

Data Pipeline Building

Education

Bachelor's degree in relevant field

Tools

GCP Dataflow

Elasticsearch

Flask

Job description

100% Remote, *but must be able to attend a 9am EST standup

Company Summary:

They are the world's leading B2B research company. We use proprietary, AI-driven search that scans 1.1 billion professionals across 140 industries to find the exact person to answer any kind of question.

About the Role

Developing and enhancing these key systems and platforms requires strong data engineering expertise to solve a wide variety of exciting data problems. We are seeking passionate data engineers with a desire to join a small but fast growing team to get in early and influence our data technologies.

Compensation: $100-130k + 10-15K bonus + stock options (more salary, less equity or less salary, more equity
Hours: 8am-5:30 pm CT *Need to be good with these hours*
Company size: 130 employees right now
Engineering team size: 20

Responsibilities

• Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources.
• Develop versatile software components to extract useful information from various unstructured or semi-structured text data.
• Improve the performance and quality of search services
• Build effective data API endpoints to support data applications across the company

Required

• 3+ yrs experience in software development
• Strong proficiency with Python
• Hands-on experience building large scale batch and streaming data pipelines with mainstream big data stack preferably GCP dataflow
• Bachelor's degree or greater in relevant field of study

Nice to Have

• Experience working with a major Cloud platform (AWS, Azure, GCP), preferably GCP
• Experience with Elasticsearch
• Experience in NLP or Text Mining
• Experience building Flask microservices
• Experience writing SQL, particularly in BigQuery

Interview process:
1. Back end lead interview 30-45 minute phone interview
2. Take home assessment 60 minutes
3. 2.5 hour video conference: with Head of Engineer and HR