Data Engineer: Databricks, Python & Data Pipelines

Cloud Analytics Technologies, LLC; Jersey City (NJ); On-site; USD 68,880 - 110,208; Full time

Job summary

Cloud Analytics Technologies, LLC in Jersey City, NJ is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines. The ideal candidate should have a strong background in Databricks, Python, and database engineering.

In this role, you will work on ETL/ELT workflows, ensuring data quality and supporting analytics and ML initiatives while collaborating with various teams. The position offers varying hourly rates depending on experience and includes potential for contract extension.

Qualifications

• Strong expertise in Databricks and Python.
• Experience in database engineering and ETL/ELT processes.
• Ability to work with large-scale datasets.

Responsibilities

• Design, build, and maintain ETL/ELT workflows on Databricks.
• Develop scalable data pipelines using Python and Spark.
• Optimize data transformation logic for performance and cost efficiency.
• Collaborate with Data Scientists and Analysts.

Skills

Database Engineering

SQL

Cloud Platforms

ETL/ELT tools

Data Engineering

Python

Spark

Job description

Cloud Analytics Technologies, LLC in Jersey City, NJ is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines. The ideal candidate should have a strong background in Databricks, Python, and database engineering.

In this role, you will work on ETL/ELT workflows, ensuring data quality and supporting analytics and ML initiatives while collaborating with various teams. The position offers varying hourly rates depending on experience and includes potential for contract extension.