Sr Big Data Engineer (Remote)

Navigate Search; United States; Remote; USD 97,000 - 720,000; Full time

Job summary

A leading company in cloud-native cybersecurity seeks a Senior Associate to enhance their innovative data engineering efforts. This fully remote role involves designing scalable data pipelines, optimizing data lakes on AWS, and ensuring cybersecurity compliance. Ideal candidates will possess strong experience in data engineering and a passion for solving complex challenges in high-impact environments.

Benefits

Competitive salary and 401(k) with employer matching

15 days of paid time off (PTO) plus holidays

Fully remote work environment

Qualifications

• 5+ years of experience as a Data Engineer or similar role.
• Experience with AWS services such as S3, Glue, and Redshift.
• Hands-on background with real-time streaming technologies like Kafka.

Responsibilities

• Design and maintain data pipelines and ETL processes using Python and Spark.
• Architect data lakehouse and optimize performance of high-volume systems.
• Work closely with security teams to meet compliance standards.

Skills

Python

PySpark/Spark

SQL

Data modeling

ETL frameworks

Performance tuning

Tools

AWS

Docker

Terraform

CloudFormation

Job description

Direct message the job poster from Navigate Search

Senior Associate at Navigate Search - Connecting Great Talent to Great Clients

We are a cloud-native cybersecurity and network analytics company based in Atlanta, GA, focused on providing cutting-edge security insights through advanced data engineering. Our team is composed of experts in big data, cloud infrastructure, and cybersecurity, helping organizations make data-driven security decisions. With a fully remote, highly collaborative environment, we empower our engineers to innovate and solve complex challenges in cloud-scale cybersecurity analytics.

Responsibilities

● Design, build, and maintain scalable data pipelines and ETL processes using Spark (PySpark) and Python.

● Architect and optimize data lakehouse and data warehouse solutions on AWS.

● AWS Big Data System Experience Required

● Implement data governance, quality, and observability best practices.

● Optimize performance of high-volume data processing systems.

● Work closely with security teams to ensure compliance with cybersecurity regulations. Requirements

● 5+ years of experience as a Data Engineer, Full Stack Data Engineer, or similar role.

● Strong expertise in Python, PySpark/Spark, and SQL.

● Hands-on experience with AWS services like S3, Glue, Athena, EMR, Redshift, Lambda.

● Experience with real-time streaming (Kafka, Kinesis, etc.).

● Knowledge of data modeling, ETL frameworks, and performance tuning.

● Familiarity with CI/CD, containerization (Docker), and infrastructure-as-code (Terraform, CloudFormation).

● Cybersecurity domain knowledge is a big plus.

● U.S. citizenship is required

Why Join Us?

● Fully remote with a modern, cloud-native environment.

● Work on high-impact cybersecurity and network analytics projects.

● Competitive salary and 401(k) with employer matching.

● 15 days of paid time off (PTO) plus holidays.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

Referrals increase your chances of interviewing at Navigate Search by 2x

Get notified about new Big Data Developer jobs in United States.

United States $170,000.00-$720,000.00 1 week ago

United States $170,000.00-$720,000.00 1 week ago

United States $170,000.00-$720,000.00 3 days ago

United States $97,482.00-$140,000.00 2 weeks ago

New York, NY $139,500.00-$271,566.94 2 weeks ago

California, United States $139,500.00-$271,566.94 2 weeks ago

United States $180,000.00-$220,000.00 1 week ago

California, United States $139,500.00-$271,566.94 2 weeks ago

Illinois, United States $139,500.00-$271,566.94 2 weeks ago

Massachusetts, United States $139,500.00-$271,566.94 2 weeks ago

Texas, United States $139,500.00-$271,566.94 2 weeks ago

Texas, United States $139,500.00-$271,566.94 2 weeks ago

Georgia, United States $139,500.00-$271,566.94 2 weeks ago

Illinois, United States $139,500.00-$271,566.94 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.