Senior Data Engineer, Cybersecurity Platform (Databricks)

Cedent; Boston (MA); On-site; USD 120,000 - 150,000; Full time

Job summary

A cybersecurity company based in Boston is seeking a Senior Data Engineer. The ideal candidate will be responsible for integrating diverse cybersecurity data sources, optimizing ETL/ELT pipelines, and ensuring data quality within a high-performance environment using AWS and Databricks. Strong skills in Python and extensive experience in data governance are required. This is a contract position offering opportunities for mentorship and best practices promotion.

Qualifications

• 8+ years in data engineering experience with a focus on Python, PySpark, and SQL.
• Experience with AWS services like EC2, S3, Lambda, and ELB.
• Proficiency in data quality checks and data governance standards.

Responsibilities

• Integrate diverse cybersecurity data sources and standardize data across platforms.
• Design and develop ETL/ELT pipelines on Databricks.
• Implement automated data quality checks and maintain data integrity.
• Create centralized data models and perform in-depth data analysis.
• Manage secure, high-performance data environments on Databricks.
• Mentor junior engineers and promote best practices in data engineering.

Skills

Python

PySpark

SQL

AWS

Data Governance

Data Visualization Tools

Education

B.S., M.S., or Ph.D. in Computer Science or related field

Tools

Databricks

Power BI

Tableau

Docker

Kubernetes

Job description

A cybersecurity company based in Boston is seeking a Senior Data Engineer. The ideal candidate will be responsible for integrating diverse cybersecurity data sources, optimizing ETL/ELT pipelines, and ensuring data quality within a high-performance environment using AWS and Databricks. Strong skills in Python and extensive experience in data governance are required. This is a contract position offering opportunities for mentorship and best practices promotion.