Sr Data Engineer - Data

Cerby Inc.; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

A leading cybersecurity company seeks a Senior Data Engineer to enhance its data platform and support stakeholders with data initiatives. The role includes building data pipelines, ensuring quality, and leveraging various data technologies for effective data governance and compliance.

Qualifications

• Proficiency in SQL, Python, and libraries like Numpy, Pandas.
• Experience with data technologies like Segment, Spark, Kinesis.
• Strong analytical skills for troubleshooting distributed systems.

Responsibilities

• Architect and design data pipelines and warehouses.
• Implement CI/CD strategies for data services.
• Create dashboards and metrics for stakeholder insights.

Skills

SQL

Python

Data Quality

Collaboration

Automation

Tools

Apache Flink

Spark

AWS Athena

Terraform

Job description

At Cerby, we believe security is everyone’s business. Collaborating across your apps doesn’t need to be chaos. We are a mission-critical cybersecurity company that empowers your teams to operate securely and control their apps completely. We’ve built our product on the idea that teams deserve autonomy over their work apps. When they are given a choice, security comes naturally.

More than 50% of all technology is spent outside of centralized IT organizations. Individual business units are taking their technology destiny into their own hands, and we enable that. End-user onboarded applications are behind more than one third of all cybersecurity hacks. We provide solutions to manage this by enabling users to select their own technology and automatically protect those applications.

About the role

We are seeking a highly skilled and experienced Senior Data Engineer to join our engineering team. This role involves identifying and executing key data initiatives within the company to assist both internal and external stakeholders. You will build on and extend our existing data platform, support the engineering team with technical data needs, design data warehouses, create dashboards, and implement new technologies for the data platform. The role also involves communicating with engineering and non-technical teams to help them leverage data effectively and developing strategies around data governance and compliance.

What you'll do

• Architect and design data pipelines, data warehouses, and specialized datasets.
• Manage our current data platform, making decisions on improvements and technologies used within the cloud.
• Ensure data quality, maintain data dictionaries, and manage sensitive information classification and security.
• Create valuable metrics, dashboards, and decision-making tools to ensure data user success.
• Implement and utilize diverse data tools to provide insights for internal and external stakeholders.

Qualifications

• Proficiency in SQL, Python, and Python libraries such as Numpy, Pandas, PySpark. Knowledge of Scala and Typescript is a plus.
• Strong focus on code quality, testing, and assurance, including unit and integration testing.
• Experience with data technologies like Segment, Apache Flink, Spark, Kinesis, S3 Delta Lake, AWS Athena, DBT, Airflow, Dagster, Pandera, Datadog, Sentry.
• Good understanding of AWS services and configuration management.
• Experience with Infrastructure as Code using Terraform.
• Ability to automate tasks and implement CI/CD strategies for data services.
• Excellent communication and collaboration skills, with experience in Agile environments.
• Strong analytical and troubleshooting skills for distributed systems.