Data Engineer: ETL, Python & Spark for Scalable Pipelines

Artifintech

Georgia

On-site

USD 90,000 - 150,000

Full time

Just now

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Artifintech in Georgia is hiring an experienced Data Engineer to design, develop, and maintain scalable data pipelines across on-premises and cloud environments. You will work with Python, SQL, Spark, and ETL/ELT workflows to consolidate data from multiple sources and build robust data warehouses and lakes.

Collaborate with data scientists and business teams to ensure data quality, security, and reliability, optimize SQL queries, monitor pipeline performance, and participate in Agile discussions

Qualifications

Experience in designing, developing, and maintaining scalable data pipelines.
Proficiency with Python, SQL, and Spark for data processing.
Knowledge of ETL/ELT workflows and cloud-based data platforms.
Familiarity with data warehousing and big data technologies.

Responsibilities

Design, develop, and maintain scalable data pipelines.
Build and optimize ETL/ELT workflows.
Extract, transform, and load data from multiple sources.
Develop data processing solutions using Python, SQL, and Spark.
Implement data integration and data transformation processes.
Design and maintain data warehouses and data lakes.
Monitor and troubleshoot data pipeline performance.
Collaborate with Data Scientists, Analysts, and Business Teams.
Optimize SQL queries and improve data processing performance.

Skills

Python

SQL

ETL/ELT

Big Data

Data pipelines

Cloud platforms

Tools

Spark

Job description

Collaborate with data scientists and business teams to ensure data quality, security, and reliability, optimize SQL queries, monitor pipeline performance, and participate in Agile discussions

Get your free, confidential resume review.

or drag and drop your file here.