Data Engineer: Build Scalable Pipelines & Data Lake

Socket.dev; Austin (TX); On-site; USD 132,000 - 179,000; Full time

Benefits offered by this job

Medical, Dental, and Vision Coverage

Maternity and Parental Leave Options

Paid Time Off (PTO)

401(k) Plan

Job summary

Amazon Austin is seeking a Data Engineer to build and maintain large-scale data pipelines feeding our data lake and analytics platforms. You will collaborate with network and infrastructure teams to gather data requirements and deliver robust ETL solutions.

The role emphasizes data governance, security, and high-availability operations, with opportunities to influence architectural decisions and evolve our data engineering practices.

Qualifications

• 3+ years of data engineering experience.
• Experience with data modeling, warehousing and building ETL pipelines.
• Bachelor's degree or foreign equivalent in computer science, engineering, analytics, mathematics, statistics, IT or equivalent.
• Proficient in Python development.
• Experience with big data technologies (Spark/Hadoop).

Responsibilities

• Develop and maintain data pipelines that ingest data from various sources into our data lake, implementing ETL processes to cleanse, transform, and enrich data for analytical purposes.
• Design scalable data solutions focusing on performance, quality, and reliability while partnering with cross-functional teams to comprehend business requirements.
• Implement data quality controls, metadata management, and data lineage tracking to ensure data integrity, compliance, and accessibility across the organization.
• Establish data governance and security measures to protect delicate information and ensure compliance with regulatory requirements.
• Monitor data infrastructure to identify and resolve issues promptly, maintaining high availability and reliability of our data systems.

Skills

Data engineering

Data modeling

ETL pipelines

Python

Big data: Spark/Hadoop

Education

Bachelor's degree

Tools

Spark

Hadoop

AWS services

Job description

Amazon Austin is seeking a Data Engineer to build and maintain large-scale data pipelines feeding our data lake and analytics platforms. You will collaborate with network and infrastructure teams to gather data requirements and deliver robust ETL solutions.

The role emphasizes data governance, security, and high-availability operations, with opportunities to influence architectural decisions and evolve our data engineering practices.