Sr. Data Engineer (US)

Craft.co; United States; Remote; USD 160,000 - 184,000; Full time

Job summary

A leading technology company in supplier risk intelligence is seeking an experienced senior Data Engineer to join their dynamic team. The role involves building and optimizing data pipelines, working with diverse datasets, and applying machine learning to drive insights. A strong candidate will possess extensive experience in Python and data engineering techniques, as well as a desire for personal growth. The company offers a competitive salary, equity options, and unlimited vacation time in a supportive work environment.

Benefits

Competitive salary starting at $160,000 USD/year

Equity at a well-funded startup

Unlimited vacation time

99% health + dental + vision insurance for employees and dependents

401K options through Empower

Qualifications

• 4+ years of experience in Data Engineering.
• 4+ years of experience with Python.
• Experience with developing and maintaining data pipelines.

Responsibilities

• Build and optimize data pipelines for batch and streaming.
• Extract, analyze, and model diverse datasets.
• Design maintainable and testable software solutions.

Skills

Data Engineering

Python

Data Lakes

Data Warehousing

ETL/ELT

API Development

Machine Learning

Tools

Python

Pandas

SQL (PostgreSQL)

ElasticSearch

Airflow

Docker

AWS

Terraform

Job description

About Craft:

Craft is the leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers at scale. Our unique, proprietary data platform tracks real-time signals on millions of companies globally, delivering best-in-class monitoring and insight into global supply chains. Our customers include Fortune 500 companies, government agencies, SMEs, and global service platforms. Through our configurable Software-as-a-Service portal, our customers can monitor any company they work with and execute critical actions in real-time. We’ve developed distribution partnerships with some of the largest integrators and software platforms globally.

We are a post-Series B high-growth technology company backed by top-tier investors in Silicon Valley and Europe, headquartered in San Francisco with hubs in Seattle, London, and Warsaw. We support remote and hybrid work, with team members across North America, Canada, and Europe.

We're looking for innovative and driven people passionate about building the future of Enterprise Intelligence to join our growing team!

About the Role:

Craft is looking for an experienced and motivated senior-level Data Engineer to join one of our teams responsible for a key product within the organization. As a core member of this team you will have a great say in how solutions are engineered and delivered. Craft gives engineers a lot of responsibility and authority, which is matched by our investment in their growth and development.

We’re growing quickly and looking to hire data engineers for multiple teams. We’re always looking for folks with strong data engineering experience, Python coding experience, Pandas expertise, and solid software engineering practices. In addition to those skills, we’re looking for two different categories of data engineers. If you feel that your experience aligns with one or both of the categories below, we have a place for you!

1. Someone who has experience with data lakes and data warehousing, graph databases and knowledge graphs

2. Someone who has experience with streaming and batching of data from data partners and building data pipelines for transactional use, as well as experience with API development, FastAPI, and asyncio.

What You’ll Do:

• Build and optimize data pipelines (batch and streaming).

• Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data

• Design software that is easily testable and maintainable.

• Support in setting data strategies and our vision.

• Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.

• Work on extendable data processing systems that allows to add and scale pipelines.

• Apply machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets.

• Leverage AI-powered development tools (e.g. Cursor) to accelerate development, refactoring, and code generation.

Who You Are:

• 4+ years of experience in Data Engineering.

• 4+ years of experience with Python.

• Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.

• Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.

• Strong knowledge of SDLC and solid software engineering practices.

• Familiar with infrastructure-as-code approach.

• Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow.

• Strong problem solving and the ability to communicate ideas effectively.

• Self-starter, independent, likes to take initiative.

• Familiarity with at least some of the technologies in our current tech stack:

  • Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, Docker

  • Databricks, AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS, Amazon Neptune)

  • CircleCI, GitHub, Terraform

• Knowledge surrounding AI-assisted coding and experience with Cursor, Co-Pilot, or Codex

• A strong track record of leveraging AI IDEs like Cursor to:

  • Rapidly scaffold components and APIs

  • Refactor legacy codebases efficiently

  • Reduce context-switching and accelerate documentation

  • Experiment and prototype with near-instant feedback

What We Offer:

• Competitive salary starting at $160,000 USD/ year. This starting number can be increased based on levels of expertise, location, cost of living, taxes, market experience, etc.

• Equity at a well-funded, fast-growing startup

• Unlimited vacation time so you can take what you need, when you need it

• 99% covered health + dental + vision insurance for employees and dependents

• 401K through Empower with options to invest how you want it

A Note to Candidates:

We are an equal opportunity employer who values and encourages diversity, equity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, caste, or disability status.

Don’t meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At Craft, we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we strongly encourage you to apply. You may be just the right candidate for this or other roles!

#BI-Remote