Senior Data Engineer: Scalable Pipelines for Search API

Tavily; New York (NY); On-site; USD 100,000 - 130,000; Full time

Job summary

Tavily is looking for a Data Engineer to join its team in New York, NY. As part of our innovative company, you will design, construct, and maintain scalable data management systems crucial for our Search API.

The ideal candidate has at least 3 years of experience in data engineering, with expertise in Python, SQL, and AWS. You will work collaboratively to ensure data integrity and performance, while also optimizing infrastructure.

This role offers a unique opportunity to shape the data systems that drive our product.

Qualifications

• 3+ years of professional experience as a Data Engineer or in a similar role focused on data infrastructure.
• Solid experience with relational and NoSQL databases.
• Experience with data governance and security best practices.

Responsibilities

• Design and maintain efficient ETL/ELT pipelines for data warehousing.
• Develop and improve data infrastructure.
• Ensure data quality, integrity, and security.

Skills

Python

Data pipeline optimization

SQL

NoSQL

AWS data services

Education

Degree in Computer Science, Statistics, Engineering, or related field

Tools

MongoDB

Snowflake

Redis

Airflow

Docker

Kubernetes

Job description

Tavily is looking for a Data Engineer to join its team in New York, NY. As part of our innovative company, you will design, construct, and maintain scalable data management systems crucial for our Search API.

The ideal candidate has at least 3 years of experience in data engineering, with expertise in Python, SQL, and AWS. You will work collaboratively to ensure data integrity and performance, while also optimizing infrastructure.

This role offers a unique opportunity to shape the data systems that drive our product.