Senior Data Engineer

Zoomcar; Brasil; Presencial; BRL 20.000 - 80.000; Tempo integral

Resumo da oferta

A leading company in cybersecurity ratings is seeking a Senior Data Engineer to join their dynamic Technology team in Brazil. The ideal candidate will have extensive experience in data engineering, functional programming, and cloud technologies. This role involves designing scalable backend systems, leading projects, and collaborating with cross-functional teams to enhance system performance and user experience. The company offers competitive salary, stock options, and various benefits including unlimited PTO and health coverage.

Serviços

Stock options

Health benefits

Unlimited PTO

Parental leave

Tuition reimbursements

Qualificações

• 8+ years of experience in Data Engineering.
• Strong proficiency in functional programming with Scala.
• Experience with cloud platforms, especially AWS.

Responsabilidades

• Design and maintain scalable backend systems and data pipelines.
• Lead end-to-end projects and mentor junior engineers.
• Implement best practices for code quality and performance.

Conhecimentos

Data Engineering

Agile Methodologies

Functional Programming

Cloud Computing

Database Management

Formação académica

Bachelor's Degree in Computer Science or related field

Ferramentas

Scala

Apache Spark

PostgreSQL

AWS

Docker

Terraform

Jenkins

Descrição da oferta de emprego

About SecurityScorecard:

SecurityScorecard is the global leader in cybersecurity ratings, with over 12 million companies continuously rated, operating in 64 countries. Founded in 2013 by security and risk experts Dr. Alex Yampolskiy and Sam Kassoumeh and funded by world-class investors, SecurityScorecard’s patented rating technology is used by over 25,000 organizations for self-monitoring, third-party risk management, board reporting, and cyber insurance underwriting; making all organizations more resilient by allowing them to easily find and fix cybersecurity risks across their digital footprint.

Headquartered in New York City, our culture has been recognized by Inc Magazine as a "Best Workplace,” by Crain’s NY as a "Best Places to Work in NYC," and as one of the 10 hottest SaaS startups in New York for two years in a row. Most recently, SecurityScorecard was named to Fast Company’s annual list of theWorld’s Most Innovative Companies for 2023 and to the Achievers 50 Most Engaged Workplaces in 2023 award recognizing “forward-thinking employers for their unwavering commitment to employee engagement.” SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital.

About the Team:

Join our dynamic Technology team as part of one of our most critical squads. Our team emphasis is collaboration and shared responsibilities, you will be hands-on involved in the entire Software Development Life Cycle. Our team is growing and so will you!

Check out our tech blog below and let us know if you are our next star.

https://techblog.securityscorecard.com/

What You Will Do:

We are looking for a Senior Data Engineer "Staff Backend Engineer" who thrives on building commercial products and plays a key role in delivering reliable, scalable, and maintainable applications. You will lead projects from inception to delivery, collaborating with Product Managers, and UX Designers to define requirements, implement solutions, and ensure ongoing success post-deployment. You will focus on contributing technical insights to enhance the system's performance, stability, and user experience.

• You will be working in the Data Engineering space, and with building and maintaining scalable and high-performance backend systems, and big data pipelines
• You will design, build, and maintain RESTful APIs and integrate with external services.
• Participate in all stages of the software development life cycle, from design and development to deployment and maintenance.
• Follow clean code principles, using best practices to write secure, testable, and well-documented software.
• Work closely with global teams, including engineers, product managers, and UX designers, to build a stable, high-performance platform.
• Implement comprehensive testing and performance tuning to ensure system stability and uptime.

Responsibilities:

• Design complex backend systems that are scalable, reliable, and maintainable.
• Own end-to-end projects across teams, understanding and contributing to all aspects (infrastructure, application tiers, and data tiers).
• Write clean, maintainable code that adheres to best practices in readability, design patterns, reusability, and testing. Review code, ensure quality and maintainability.
• Define and uphold engineering best practices and coding standards through setting technical direction, documentation, and maintaining standards across projects.
• Continuously monitor performance metrics and recommend improvements or refactors.
• Mentor senior and mid-level engineers. Share knowledge through documentation, talks, and pairing.

Our Tech Stack:

• Scala, Apache Spark, Airflow, Python
• Clickhouse, PostgreSQL, ScyllaDB, Hive, Redis, Kafka
• AWS, Docker, Jenkins, Terraform

Required Technologies:

• Programming & Functional Data Processing: Scala, Apache Spark (or equivalent distributed processing framework)
• Database Technologies: PostgreSQL
• Cloud Platforms: AWS (Amazon Web Services)
• Containerization & Deployment: Docker
• CI/CD Tools: Jenkins
• Infrastructure as Code: Terraform

Technical Skills:

• 8+ years of experience in the Data Engineering space.
• Strong proficiency with working in agile environments (ideally Scrum), collaborating with cross-functional teams (engineering, design, product).
• Strong proficiency in functional programming with Scala(with cats), Spark, Airflow, Hive, Redis for building batch data processing pipelines, and with Kafka for real-time data pipelines and event-driven architectures.
• Expertise with analytical databases (ClickHouse preferred), relational databases (PostgreSQL) and large-scale data systems with ETL processes (Apache Spark); experience with NoSQL distributed databases (Cassandra/ScyllaDB).
• Expertise with Jenkins for CI/CD, Terraform, and using Docker for containerization. Experience with AWS services (EC2, S3, Lambda, RDS, SQS/SNS etc.) for cloud-based application deployment and management.
• Experience with a variety of data (structured/unstructured), data formats (flat files, XML, JSON, relational, parquet).
• Strong focus on ensuring code quality and reliability through unit and integration tests, and continuous improvement of the codebase.
• Proficiency with version control tools, particularly Git, for collaborative development and code management.
• Excellent written and verbal communication skills, with the ability to articulate technical challenges and solutions clearly.

Benefits:

Specific to each country, we offer a competitive salary, stock options, Health benefits, and unlimited PTO, parental leave, tuition reimbursements, and much more!

SecurityScorecard is committed to Equal Employment Opportunity and embraces diversity. We believe that our team is strengthened through hiring and retaining employees with diverse backgrounds, skill sets, ideas, and perspectives. We make hiring decisions based on merit and do not discriminate based on race, color, religion, national origin, sex or gender (including pregnancy) gender identity or expression (including transgender status), sexual orientation, age, marital, veteran, disability status or any other protected category in accordance with applicable law.

We also consider qualified applicants regardless of criminal histories, in accordance with applicable law. We are committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. If you need assistance or accommodation due to a disability, please contact [e-mail].

Any information you submit to SecurityScorecard as part of your application will be processed in accordance with the Company’s privacy policy and applicable law.

SecurityScorecard does not accept unsolicited resumes from employment agencies. Please note that we do not provide immigration sponsorship for this position. #LI-DNI