Data Engineer I, Veritas, Security Tools Foundation

Amazon; Seattle (WA); On-site; USD 101,000 - 160,000; Full time

Job summary

Amazon's Veritas team is seeking a Data Engineer I to build and maintain data pipelines for security investigations and threat modeling. You’ll collaborate across roles to gather data requirements, partner with software engineers, and shape scalable data infrastructure using AWS services like EMR, Glue, Athena, and Redshift.

You will work in a fast-paced environment focused on data quality, governance, and AI-driven data object creation across a lake of hundreds of datasets, with exposure to

Qualifications

• 1+ years of data engineering experience.
• Experience with data modeling, warehousing and ETL pipelines.
• Experience with one or more query languages (SQL, HiveQL, SparkSQL, etc.).
• Experience with one or more scripting languages (Python, KornShell).
• Experience with big data technologies such as Hadoop, Hive, Spark, EMR.

Responsibilities

• Develop world class data pipelines by working with customers.
• Create designs for data governance strategy and data schemas.
• Improve data quality and operations via automation and CI/CD pipelines.
• Adopt best practices in data integrity, model, testing and documentation.
• Build end-to-end data pipelines to ingest and transform data from diverse sources.
• Utilize AI/LLM to automate manual data engineering tasks.
• Evaluate big-data technologies to optimize processing of large datasets.
• Write high performing, optimized SQL queries.

Skills

Data engineering

Data modeling

ETL pipelines

SQL / HiveQL / SparkSQL

Python scripting

Big data tech

Job description

Data Engineer I, Veritas, Security Tools Foundation

ID lavoro: 10490830 | Amazon.com Services LLC

Amazon Security (AmSec) is looking for a Data Engineer I to join a team of highly skilled individuals working on our initiatives in resource and application discovery within Amazon security. Our product, Veritas, is a foundational service within Amazon security that provides data for security initiatives like security reviews, threat modeling and detection, access control and incident response.

You will be part of a AmSec organization that spans over ten countries worldwide, catering to a wide variety of customer use cases, including security intelligence, application security, incident response, security operations, risk and compliance, acquisitions and subsidiaries, and external partner security.

You will work closely with a diverse range of roles, such as Software Development Engineers, Data Scientist, Data Engineers, Technical Program Managers, Product managers and our Security Engineer customers, to build high quality datasets for security investigations, application modeling, and more.

You’ll primarily work with AWS services such as EMR, Glue, Athena, Redshift, S3, SNS, SQS, Apache Airflow, along with some internal tools.

You’ll also be part of our transformation journey to build data objects by leveraging AI. Our data lake contains over 500 datasets from various sources, with some handling daily volumes exceeding PBs.

As Data Engineer I, you will be gathering and understanding data requirements, partnering with software engineers, and collaborating across roles and teams to create the necessary data infrastructure and high quality pipelines to drive our team's initiatives. We have high-visibility data ingestion goals in a fast-paced, operational environment. The ideal candidate should enjoy the challenge of operating complex and mission-critical systems under ambiguity.

Key job responsibilities

• Develop world class data pipelines by working with customers
• Create designs for data governance strategy, define data schema and develop tools to enable more efficient data sharing with customers which adhere to highly confidential data handling guidelines.
• Continually improve the data quality and operations, via automation and building full CI/CD data pipelines
• Recognize and adopt best practices in data integrity, data model, testing, analysis, validation, and documentation.
• Build end-to-end data pipelines to ingest and transform data from different types of data sources and systems
• Utilize AI/LLM to automate manual and redundant data engineering task
• Evaluate and implement various big-data technologies and solutions (e.g. Redshift, Iceberg, Hive/EMR, Spark, SNS, SQS) to optimize processing of extremely large datasets
• Understand and analyze business processes, logical data models and relational database implementations
• Write high performing and optimized SQL queries

About the team

Why Amazon Security? At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with opportunities to build experience in a wide variety of areas including cloud, devices, retail, entertainment, healthcare, operations, and physical stores.

Inclusive Team Culture

In Amazon Security, it’s in our nature to learn and be curious. Ongoing DEI events and learning experiences inspire us to continue learning and to embrace our uniqueness. Addressing the toughest security challenges requires that we seek out and celebrate a diversity of ideas, perspectives, and voices.

Training & Career Growth

We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, training, and other career-advancing resources here to help you develop into a better-rounded professional.

Diverse Experiences

Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

Work/Life Balance

We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve.

• 1+ years of data engineering experience
• Experience with data modeling, warehousing and building ETL pipelines
• Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
• Experience with one or more scripting language (e.g., Python, KornShell)
• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

Qualifiche Preferenziali

• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

USA, WA, Seattle - 101,300.00 - 160,000.00 USD annually