Data Engineer - Databricks - Remote

ContractStaffingRecruiters.com; Branford (CT); Remote; USD 100,000 - 130,000; Full time

Job summary

ContractStaffingRecruiters.com is seeking a leader with strong Databricks experience to join their fast-moving team in Branford, Connecticut. Your primary role will involve designing and developing ETL processes to transform various forms of raw data into SQL databases.

Additionally, you will work on migrating legacy systems to data marts and lakes, leveraging cloud technologies such as Azure SQL. Strong communication skills and the ability to manage multiple projects are crucial for success in this role.

Qualifications

• Must have Databricks experience.
• Ability to design and develop ETL processes.
• Strong experience with data marts and data lakes.

Responsibilities

• Lead a fast-moving team using Databricks.
• Transform raw data into SQL databases.
• Maintain comprehensive project documentation.

Skills

Databricks experience

Programming languages: Python, SQL, PLSQL, VB

Database platforms: Oracle, SQL Server, MySQL

Big data concepts and technologies

Cloud technologies (Azure SQL)

Job description

Responsibilities

Databricks experience is a must. Looking for a leader that loves Databricks and can work on a fast moving team.

Design and develop ETL processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL databases.

Understands the concept of data marts and data lakes and has experience migrating legacy systems to data marts/lakes.

Uses additional cloud technologies (e.g., understands concepts of cloud services like Azure SQL server).

Maintain comprehensive project documentation.

Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement.

Strong interpersonal and communication skills to work in a team environment with customers, contractors, technical staff, end users, and management.

Manage multiple projects, responsibilities, and competing priorities.

Experience Needed

• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, VB
• Database platforms such as: Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks