AWS Data Engineer

Ethereum Technologies; Seattle (WA); Vor Ort; USD 110.000 - 160.000; Vollzeit

Zusammenfassung

Ethereum Technologies is seeking a data engineer to design and operate large-scale data pipelines and platforms in a distributed environment. You will shape architecture, implement cloud data solutions on AWS, and ensure data quality across the data lakehouse ecosystem.

You will work with SQL, Python, Scala, C#, or Go, and collaborate on data warehousing, ETL/ELT, and BI initiatives to empower analytics across the organization.

Qualifikationen

• Experience building distributed data pipelines and data platforms.
• Background in Data Warehouse, ETL/ELT, and BI.
• Experience with data architectures such as Data Mesh and Data Lakehouse.
• Experience with Infrastructure-as-code tools like Cloud Formation and Terraform.
• Experience designing and implementing cloud data solutions using AWS technologies (EC2, EMR, DMS, GLUE, S3, Redshift, etc.).
• Proficiency in SQL, Python, Scala, C#, or Go.
• Solid scripting skills (bash, PowerShell).
• Track record of building scalable Data Lake solutions connecting to distributed storage.

Aufgaben

• Build and maintain automated methods of orchestrating data flows and products.
• Lead data ingestion, extraction, and processing of large data sets.
• Support and enhance data quality and associated infrastructure.
• Extend data platforms with new components and APIs for accessibility.
• Advance data architectures and emerging data technologies.
• Work with stream analytics technologies to enable real-time insights.

Kenntnisse

Data engineering

SQL

Python

Scala

C#

Go

Bash

PowerShell

Distributed systems

Data at scale

Tools

CloudFormation

Terraform

AWS

S3

Redshift

Jobbeschreibung

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Working knowledge of modern data architectures and trends such as Data Mesh, Data Lakehouse, etc.
• Working knowledge of Master Data Management Reltio preferred
• Research, analyze, recommend, and select technical approaches for solving exciting and sophisticated development and integration problems
• Build and maintain automated methods of orchestrating data flows and products while supervising data quality and the status of related infrastructure
• Implement additional project components (API interfaces) for accessibility
• Implement secure cloud data solutions which align to privacy and security controls
• Enable and support data and analytics capabilities and technologies, ensuring functional specifications meet or exceed established business and functional requirements, technical standards, quality

Qualifications:

• A passion for all things data; understanding how to work with it at scale, and more importantly, knowing how to get the most out of it
• Contribute to the overall data platform architecture and evolution
• Experience with data concepts (SQL, NoSQL, Normalization) and working with sophisticated data structures
• Experience with Infrastructure-as-code tools such as Cloud Formation and Terraform
• Experience in designing and implementing cloud data solutions using a broad range of AWS technologies (e.g. EC2, EMR, DMS, GLUE, S3, Lake Formation, Redshift, VPC, IAM, CloudWatch, SQS, Lambda, CloudTrail, Systems Manager, KMS, Kinesis Streams)
• Proficiency in one or more of the following scripting languages; SQL, Python, Scala, C#, or Go
• Solid understanding of scripting languages such as bash or PowerShell
• Track record of successfully building scalable Data Lake solutions that connects to distributed data storage using multiple data connectors
• Must have a background in data engineering – Data Warehouse, ETL/ELT and BI experience
• Serve as an authority; envision and integrate emerging data technologies, anticipate new trends to tackle sophisticated business and technical problems
• Working experience with various stream analytics technologies

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.