Data Engineer - Scalable Pipelines & AI-Driven Analytics

Optomi

Austin (TX)

Presencial

USD 100 000 - 130 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

A leading technology consulting firm in Austin, Texas, is seeking an experienced Data Engineer to design scalable data pipelines and develop ETL workflows optimized for performance. The role requires over 6 years of experience in data engineering, proficiency in Python, Scala, or Java, and hands-on experience with tools like Spark and Kafka. Candidates should have a strong understanding of data modeling and cloud platforms such as AWS, Azure, or GCP. This position offers the opportunity to work on advanced use cases, focusing on AI-driven automation and compliance.

Qualificações

  • 6+ years of experience in data engineering for analytics or ML systems.
  • Hands-on experience with Spark, Kafka, and Airflow (or similar).
  • Strong understanding of data modeling and lakehouse architectures like Iceberg.
  • Experience with Snowflake, Databricks, and OLAP/NRT systems.

Responsabilidades

  • Design and implement scalable batch and near-real-time data pipelines.
  • Develop ETL/ELT workflows optimized for performance and cost.
  • Ensure data integrity, governance, privacy, and compliance.

Conhecimentos

Data Engineering
Python
Scala
Java
Spark
Kafka
Airflow
Data Modeling
AWS
Azure
GCP
Snowflake
Databricks
Tableau
Docker
Kubernetes
MLOps

Ferramentas

CI/CD
GitLab
Grafana
Spinnaker
Datadog

Descrição da oferta de emprego

A leading technology consulting firm in Austin, Texas, is seeking an experienced Data Engineer to design scalable data pipelines and develop ETL workflows optimized for performance. The role requires over 6 years of experience in data engineering, proficiency in Python, Scala, or Java, and hands-on experience with tools like Spark and Kafka. Candidates should have a strong understanding of data modeling and cloud platforms such as AWS, Azure, or GCP. This position offers the opportunity to work on advanced use cases, focusing on AI-driven automation and compliance.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer: Build Scalable Pipelines & Data Lakes
Data Engineer: Build Scalable Pipelines & Data Lakes

Blueridgeinfotech • Virginia (MN)

Presencial
USD 90 000 - 120 000
Data Engineer: API-Driven Pipelines & Data Lakes
Data Engineer: API-Driven Pipelines & Data Lakes

Cloud7Works • EUA

Presencial
USD 100 000 - 130 000
Data Engineer: Build Scalable Pipelines & Real-Time Data
Data Engineer: Build Scalable Pipelines & Real-Time Data

intelycore • EUA

Presencial
USD 90 000 - 130 000
Competitive salary and benefits
Collaborative and innovative work environment
Opportunities for professional growth and learning
+1
Data Engineer: Build Scalable Pipelines for Analytics & ML
Data Engineer: Build Scalable Pipelines for Analytics & ML

SMX Services & Consulting, Inc. • Baton Rouge (LA)

Presencial
USD 55 104 - 63 149
Data Engineering Lead for Scalable AI Pipelines (Remote)
Data Engineering Lead for Scalable AI Pipelines (Remote)

Innowhyte Inc • Irvine (CA)

Teletrabalho
USD 120 000 - 160 000
Flexible work from home
Direct interaction with CXO team
Career growth opportunities
Data Engineer: Build Trusted Data Pipelines for AI & Growth
Data Engineer: Build Trusted Data Pipelines for AI & Growth

Senen Group • EUA

Presencial
USD 80 000 - 100 000
Meaningful work
Creative control
Collaboration opportunities
+1
Senior Data Engineer: Scalable Spark Pipelines & Real-Time
Senior Data Engineer: Scalable Spark Pipelines & Real-Time

3M Consultancy • Washington

Presencial
USD 100 000 - 130 000
Data Engineer: Build Scalable Pipelines & Warehouses
Data Engineer: Build Scalable Pipelines & Warehouses

Skillerszone LLC • Los Angeles (CA)

Presencial
USD 90 000 - 120 000
Data Engineer III — Build Scalable Pipelines (Contract)
Data Engineer III — Build Scalable Pipelines (Contract)

PTR Global • Austin (TX)

Presencial
USD 96 432 - 103 320
Medical benefits
Dental benefits
Vision benefits
+2
Data Engineer: Build Scalable Pipelines & Data Lakes
Data Engineer: Build Scalable Pipelines & Data Lakes

Yeah! Global • Los Angeles (CA)

Presencial
USD 100 000 - 140 000