Data Engineer

Web3 Tech LLC; Snowflake (AZ); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading technology firm in Arizona is seeking an experienced Data Engineer to join their team. The role involves designing and implementing scalable data architectures, building data processing pipelines, and maintaining cloud data platforms on AWS, Azure, and GCP. Candidates should have a Bachelor's degree and over 5 years of experience in data engineering and cloud platforms. The firm offers a dynamic environment focused on powering AI initiatives across multiple sectors.

Responsibilities

• Design and implement scalable data architectures using modern data stack technologies.
• Build real-time and batch data processing pipelines using Apache Spark, Kafka, and Airflow.
• Develop ETL/ELT processes for data integration across multiple source systems.
• Implement data lake and data warehouse solutions using Snowflake, Databricks, and cloud services.
• Build and maintain cloud-based data platforms on AWS, Azure, and GCP.
• Design data mesh architectures and self-service analytics platforms.
• Optimize data storage, processing, and query performance.

Skills

Advanced Python

SQL

Scala

Education

Bachelor's degree in Computer Science, Engineering, or related field

5+ years of data engineering experience in enterprise environments

3+ years of cloud data platform experience

Job description

Join our data engineering team to build robust, scalable data infrastructure that powers AI/ML initiatives and business intelligence across commercial and government clients. This role focuses on designing and implementing modern data architectures, pipelines, and platforms.

Key Responsibilities

• Design and implement scalable data architectures using modern data stack technologies
• Build real-time and batch data processing pipelines using Apache Spark, Kafka, and Airflow
• Develop ETL/ELT processes for data integration across multiple source systems
• Implement data lake and data warehouse solutions using Snowflake, Databricks, and cloud services
• Build and maintain cloud-based data platforms on AWS, Azure, and GCP
• Design data mesh architectures and self-service analytics platforms
• Optimize data storage, processing, and query performance

Data Governance & Quality

• Implement data quality monitoring and validation frameworks
• Design data cataloging and metadata management solutions
• Ensure data security, privacy, and compliance with federal regulations
• Develop data lineage tracking and impact analysis capabilities

Required Skills and Qualifications

Education & Experience

• Bachelor's degree in Computer Science, Engineering, or related field
• 5+ years of data engineering experience in enterprise environments
• 3+ years of cloud data platform experience

Technical Skills

• Programming: Advanced Python, SQL, Scala; familiarity with Java

Preferred Qualifications

• Data mesh and modern data architecture experience
• Terraform, CloudFormation, or similar IaC experience