Senior Data Engineer: AI-Driven Data Pipelines

Beaconcure Inc.; Needham (MA); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Growth mindset culture

Recognition for impactful work

Use of modern tools and technologies

Job summary

Beaconcure Inc. is hiring a Senior Data Engineer in Needham, Massachusetts. This role involves designing and implementing scalable data pipelines, collaborating with cross-functional teams, and ensuring data quality. The ideal candidate has over 3 years of Python experience, proficiency with modern data engineering tools like Databricks, and strong problem-solving skills. Join a tech-forward organization that embraces innovation and values continuous learning. Competitive salary and growth opportunities are offered.

Qualifications

• 3+ years of experience in Python development.
• Strong experience with modern data engineering tools.
• Hands-on experience with Databricks or other distributed data processing frameworks.

Responsibilities

• Design and implement scalable data pipelines and workflows.
• Collaborate with Data Scientists and Analysts on data needs.
• Take ownership of data quality and architecture.

Skills

Python development

Data engineering tools (e.g., Pandas, PySpark, SQLAlchemy)

Databricks

Data modeling

Agile methodologies

Problem-solving skills

English communication skills

Collaboration abilities

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Databricks

Cloud services (AWS and/or Azure)

NoSQL databases (e.g., MongoDB)

Python testing and debugging tools (e.g., PyTest)

Job description

Beaconcure Inc. is hiring a Senior Data Engineer in Needham, Massachusetts. This role involves designing and implementing scalable data pipelines, collaborating with cross-functional teams, and ensuring data quality. The ideal candidate has over 3 years of Python experience, proficiency with modern data engineering tools like Databricks, and strong problem-solving skills. Join a tech-forward organization that embraces innovation and values continuous learning. Competitive salary and growth opportunities are offered.