Senior Data Engineer: Architect Scalable Data Pipelines

SalesIntel Research, Inc.; United States; Remote; USD 100,000 - 130,000; Full time

Job summary

SalesIntel Research, Inc. is looking for a Senior Data Engineer responsible for building and extending their data pipeline architecture. You will collaborate with software engineers and data analysts to ensure a consistent data delivery architecture.

The ideal candidate has over 5 years of experience and strong skills in Apache Spark, SQL, and programming languages such as Python and Java. This role is essential for optimizing the company’s data architecture for future products.

Qualifications

• 5+ years of experience in a Data Engineer role.
• 3+ years experience with Apache Spark.
• Deep understanding of Big Data concepts and distributed systems.
• Advanced working SQL knowledge.
• Experience with various data formats: Delta Tables, Parquet, CSV, JSON.

Responsibilities

• Design and build parts of our data pipeline architecture.
• Identify and implement internal process improvements.
• Work with stakeholders on data-related technical issues.
• Collaborate with experts to drive innovation.

Skills

Data engineering

Apache Spark

SQL

Python

Java

Cloud experience

Machine learning

Education

Bachelor’s degree in Engineering or Computer Science

Tools

DataBricks

Postgres

MySQL

Job description

SalesIntel Research, Inc. is looking for a Senior Data Engineer responsible for building and extending their data pipeline architecture. You will collaborate with software engineers and data analysts to ensure a consistent data delivery architecture.

The ideal candidate has over 5 years of experience and strong skills in Apache Spark, SQL, and programming languages such as Python and Java. This role is essential for optimizing the company’s data architecture for future products.