Remote Data Architect: Pipelines, Spark & ML

Bitful Consulting; United States; Remote; USD 80,000 - 120,000; Full time

Benefits offered by this job

Education Assistance/Student Loan Repayment

Remote work allowance

Internet reimbursement

Bench pay

Profit share

Healthcare reimbursement

401k - 4% match

Short-Term disability

Long-Term disability

Life Insurance

Job summary

Bitful Consulting seeks a data engineer to develop datasets for data visualization and machine learning. You'll be responsible for building and automating data pipelines and collaborating with analysts and developers.

The ideal candidate will have strong skills in T-SQL, Python, and PySpark, alongside a Databricks certification. This role offers benefits like education assistance, remote work allowance, and profit sharing.

Qualifications

• Strong T-SQL skills with experience in Snowflake.
• Significant experience in Python development.
• Highly proficient at PySpark development.
• Solid grasp of database engineering principles.

Responsibilities

• Develop datasets for data visualization and machine learning.
• Automate data pipelines to ingest and analyze data.
• Build data ingestion pipelines from multiple sources.
• Partner with analysts and developers for data products.

Skills

T-SQL Skills

Python Development

PySpark Development

CI/CD Methods

Education

Databricks Certification

Tools

Snowflake

Data Bricks

Apache Spark

Job description

Bitful Consulting seeks a data engineer to develop datasets for data visualization and machine learning. You'll be responsible for building and automating data pipelines and collaborating with analysts and developers.

The ideal candidate will have strong skills in T-SQL, Python, and PySpark, alongside a Databricks certification. This role offers benefits like education assistance, remote work allowance, and profit sharing.