Data Engineer

Atlantic Talent Recruitment; Boston (MA); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

Competitive salary with performance-based incentives

Comprehensive health, dental, and vision insurance

401(k) retirement plan with company match

Generous paid time off and holidays

Professional development and training opportunities

Flexible working hours

Job summary

A leading e-commerce firm is seeking a Data Engineer in Boston, MA to develop and optimize data pipelines that support large-scale datasets. This role requires a minimum of 4 years of experience in data engineering and proficiency in programming languages such as Python and SQL. You will collaborate with analysts and maintain scalable data solutions in a flexible, hybrid work environment, enjoying a competitive salary and comprehensive benefits package designed to foster both professional and personal growth.

Qualifications

• A minimum of 4 years experience as a Data Engineer.
• Proficiency in programming languages including Python, Java, and Scala.
• Excellent problem-solving skills and attention to detail.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Monitor and troubleshoot data pipeline issues.
• Collaborate with data scientists and analysts to understand data requirements.

Skills

Python

SQL

Apache Spark

Java

Scala

Data warehousing

Education

Bachelor's in Computer Science or related field

Tools

Snowflake

Redshift

Job description

Atlantic Talent is proud to be partnered with aleading online retailer thatserves millions of monthly users. Located in Boston, MA, you will beplaying a crucial role in shaping the data infrastructure to drive business insights and enhance the customer experience.As a Data Engineer, you will be responsible for developing and optimising data pipelines to support the collection, processing, and analysis oflarge-scale datasets.This role offers an exciting opportunity to work on cutting-edge technologies and drive innovation in data engineering within the e-commerce industry.

Role Responsibilities:

• This is a hybrid role, requiring a minimum of 5 days in the Boston office each month. The 5 days can be consecutive or spread out at your choice.
• Design, build, and maintain scalable data pipelines and ETL processes to ingest, transform, and load data into the data warehouse and other storage systems.
• Monitor and troubleshoot data pipeline issues, perform root cause analysis, and implement solutions to prevent recurrence.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and project objectives.
• Upcoming projects includeSQL migration,infrastructure management, and solely Python focused projects.

Essential Skills and Qualifications:

• A minimum of 4 years experience as a Data Engineer.
• Bachelor's in Computer Science, Engineering, or a related field. Advanced degree preferred but not essential.
• Proficiency in programming languages including Python, Java, Scala, and experience with data processing frameworks including Apache Spark, and Apache Flink.
• Experience working with major cloud platforms.
• Strong SQL skills and experience with relational databases and NoSQL databases.
• Familiarity with data warehousing concepts and technologiesincluding Snowflake and Redshift is a bonus but not essential.
• Excellent problem-solving skills and attention to detail, with the ability to work independently and collaboratively in a fast-paced environment.

As the successful candidate, you will enjoy a comprehensive benefits package designed to support your professional and personal growth, including:

• Competitive salary with performance-based incentives.
• Comprehensive health, dental, and vision insurance.
• 401(k) retirement plan with company match.
• Generous paid time off and holidays.
• Professional development and training opportunities.
• Flexible working hours and a hybrid working environment.
• The necessary technology, including a laptop and additional equipment, to create an optimal home working environment.
• Regular team breakfasts, plus monthly team outings.
• An energetic and supportive work environment.