Databricks Data Engineer: Build Scalable Pipelines (Hybrid)

NISC; Lake Saint Louis (MO); Hybrid; USD 80,000 - 100,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

Health Savings Account with monthly contributions

401(k) with employer match

Paid Time Off and holidays

Employee Assistance Program

Job summary

A leading technology solution provider located in Lake Saint Louis, MO, seeks an experienced Data Engineer to optimize and curate data pipeline architecture in Databricks. The ideal candidate will support application teams and enhance data flow for various business needs. A Bachelor's degree in a relevant field and proficiency in Databricks and AWS technologies are essential. The position offers a hybrid work model and a comprehensive benefits package.

Qualifications

• Experience optimizing data flow and collection for applications.
• Knowledge of Data Warehouse and Data Lakehouse paradigms.
• Familiarity with message queuing and stream processing.

Responsibilities

• Curate and optimize data pipeline architecture in Databricks.
• Assemble complex data sets meeting business needs.
• Create data tools for analytics and data science teams.

Skills

Building and optimizing data pipelines

Hands-on experience with Databricks

Strong analytic skills

Experience with AWS

Experience with big data tools

Education

Bachelor's degree in Computer Science, Statistics or similar discipline

Tools

Databricks

AWS Lambda

SQL

Hadoop

Spark

Job description

A leading technology solution provider located in Lake Saint Louis, MO, seeks an experienced Data Engineer to optimize and curate data pipeline architecture in Databricks. The ideal candidate will support application teams and enhance data flow for various business needs. A Bachelor's degree in a relevant field and proficiency in Databricks and AWS technologies are essential. The position offers a hybrid work model and a comprehensive benefits package.