Data Engineer

VySystems; Georgia; On-site; USD 100,000 - 130,000; Full time

Job summary

A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow. Strong communication and collaboration skills are essential to convey complex concepts effectively and to work across teams. This role offers an opportunity to significantly impact data platform development and operations.

Skills

Databricks Lakehouse architecture

PySpark

Spark SQL

Delta Lake

Performance tuning

Informatica PowerCenter

Teradata

Airflow

AWS services

Data reconciliation

Communication skills

Collaboration

Job description

Qualifications

• Strong expertise in Databricks Lakehouse architecture on AWS.
• Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning.
• Experience with Informatica power center or IDMC
• Experience with Teradata
• Experience with Airflow for orchestration and scheduling
• Strong knowledge of AWS services used in data platforms
• Familiarity with data reconciliation, observability, and validation frameworks
• Strong communication skills to translate complex technical concepts into business-aligned outcomes
• Ability to collaborate effectively across onshore and offshore delivery models