Data Engineer - Scale Production Data Pipelines (Python, Spark)

Anchor Conzult; United States; On-site; USD 120,000 - 150,000; Full time

Job summary

A key banking client in New York City is seeking a Data Engineer to join its team. The role involves designing, building, and scaling production-grade data infrastructure with a strong focus on automation, data quality, performance, and scalability. Candidates should have over 5 years of experience in data engineering, expertise in Python and SQL, and familiarity with ETL/ELT pipelines and cloud-based technologies. This is a full-time position offering competitive salary and benefits.

Qualifications

• 5+ years of hands-on experience in Data Engineering.
• Strong expertise in Python and SQL.
• Experience in building ETL/ELT pipelines.
• Familiarity with distributed computing platforms like Spark or Dask.
• Experience with workflow orchestration tools such as Airflow, Dagster, or Prefect.
• Knowledge of cloud-based data warehouse technologies like Databricks, Snowflake, or Redshift.

Responsibilities

• Design, build, and scale production-grade data infrastructure.
• Focus on automation, data quality, performance, and scalability.

Skills

Python

SQL

Data Engineering

ETL/ELT pipelines

Distributed computing

Workflow orchestration tools

Cloud-based data warehouse

Job description

A key banking client in New York City is seeking a Data Engineer to join its team. The role involves designing, building, and scaling production-grade data infrastructure with a strong focus on automation, data quality, performance, and scalability. Candidates should have over 5 years of experience in data engineering, expertise in Python and SQL, and familiarity with ETL/ELT pipelines and cloud-based technologies. This is a full-time position offering competitive salary and benefits.