Data Engineer - Databricks on AWS & Spark

VySystems; Georgia; On-site; USD 100,000 - 130,000; Full time

Job summary

A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations.

Skills

Databricks Lakehouse architecture

PySpark

Spark SQL

Delta Lake

Performance tuning

Informatica PowerCenter

Teradata

Airflow

AWS services

Data reconciliation

Communication skills

Collaboration

Job description

A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations.