Senior Data Engineer

Bridgenext

United States

Remote

USD 90,000 - 120,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote work

Job summary

Bridgenext is seeking a Data Engineer to join our team and support a sales agency/CPG broker client. You will build data pipelines with MS Fabric, implement transformations in notebooks (Python, PySpark, SQL), and help shape a data lakehouse with Delta tables.

This remote role targets LATAM, ideally Argentina, and offers exposure to enterprise-scale data. You will ingest CSVs and APIs, implement ETL from OneDrive through bronze, silver, and gold layers, and provide SQL endpoints for Power BI

Qualifications

  • Strong knowledge of the Microsoft stack
  • Experience with Microsoft Fabric
  • Experience with SQL
  • Previous working experience with Spark and Notebooks
  • Familiarity with Python
  • Understanding of ETL processes
  • Experience with data warehousing concepts
  • Ability to work with various data formats such as CSVs and APIs
  • Basic understanding of Power BI

Responsibilities

  • Develop and maintain data pipelines using MS Fabric
  • Implement transformation using notebooks (python, pyspark, sql)
  • Experience with medallion data architecture
  • Experience building a datalakehouse (data lake + delta tables)
  • Work with various data sources including CSVs, APIs, and automated activities
  • Implement ETL processes from OneDrive to bronze, silver, and gold layers using Delta tables
  • Persist the gold layer data to a SQL endpoint for Power BI users
  • Assist in data architecture and design decisions
  • Implement auditing and error handling mechanisms in data pipelines
  • Collaborate with the team to troubleshoot and resolve data-related issues
  • Participate in code reviews and ensure code quality
  • Support the testing phase and help resolve tickets
  • Contribute to architectural decisions and improvements

Skills

Microsoft stack
Microsoft Fabric
SQL
Spark
Python
ETL
Data warehousing
CSV/API data formats
Power BI basics

Tools

Spark Notebooks
Delta Tables

Job description

Company Overview:

Bridgenext is a digital consulting services leader that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product engineering, automation, data engineering, and infrastructure modernization services, while elevating brands through digital experience, creative content, and customer data analytics services. Don't just work, thrive. At Bridgenext, you have an opportunity to make a real difference - driving tangible business value for clients, while simultaneously propelling your own career growth. Our flexible and inclusive work culture provides you with the autonomy, resources, and opportunities to succeed.

Position Description:

We are seeking a talented Data Engineer to join our team and assist our sales agency / CPG broker client. As a Data Engineer, you will play a key role in building and maintaining our data infrastructure, enabling us to leverage our data effectively for business insights. This is an exciting opportunity to be part of a growing organization and contribute to building a robust data platform from the ground up.

Key Responsibilities:
  • Develop and maintain data pipelines using MS Fabric
  • Implement transformation using notebooks (python, pyspark, sql)
  • Experience with medallion data architecture
  • Experience building a datalakehouse (data lake + delta tables)
  • Work with various data sources including CSVs, APIs, and automated activities
  • Implement ETL processes from OneDrive to bronze, silver, and gold layers using Delta tables
  • Persist the gold layer data to a SQL endpoint for Power BI users
  • Assist in data architecture and design decisions
  • Implement auditing and error handling mechanisms in data pipelines
  • Collaborate with the team to troubleshoot and resolve data-related issues
  • Participate in code reviews and ensure code quality
  • Support the testing phase and help resolve tickets
  • Contribute to architectural decisions and improvements
Tech Stack:

Microsoft Stack, Fabric Notebooks, Delta Tables, SQL Endpoints, Power BI, OneDrive, CSVs, APIs, Data Volume, Approximately 25 to 50 gigabytes per week, Expected growth to terabytes over time, 225 clients with 8-10 CSVs per week, each CSV roughly 30-50 megabytes.

Workplace:

Remote position for candidates based in LATAM, preferably Argentina.

Must Have Skills:
  • Strong knowledge of the Microsoft stack
  • Experience with Microsoft Fabric
  • Experience with SQL
  • Previous working experience with Spark and Notebooks
  • Familiarity with Python
  • Understanding of ETL processes
  • Experience with data warehousing concepts
  • Ability to work with various data formats such as CSVs and APIs
  • Basic understanding of Power BI
Preferred Skills:
  • Familiarity with Delta tables
  • Understanding of data partitioning
  • Experience with Azure DevOps or GitHub
  • Previous experience working with data volumes in the range of gigabytes to terabytes
Professional Skills:
  • Good English communication and collaboration skills
  • Ability to work hands-on and solve problems independently
  • Maintains composure during all types of situations and is collaborative by nature
  • High standards of professionalism, consistently producing high quality results
  • Self-sufficient, independent requiring very little supervision or intervention
  • Demonstrate flexibility and openness to bring creative solutions to address issues

Bridgenext is an Equal Opportunity Employer

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Bridgenext • United States

Remote
USD 160,000 - 210,000
Remote work
Equal opportunity employer
Senior Remote Data Engineer – LATAM, Fabric & Delta Lake
Senior Remote Data Engineer – LATAM, Fabric & Delta Lake

Bridgenext • United States

Remote
USD 90,000 - 120,000
Remote work
Senior Data Engineer
Senior Data Engineer

UNAVAILABLE • Cleveland (OH)

Remote
USD 140,000 - 190,000
Engineering Director
Engineering Director

Bridgenext • United States

Remote
USD 180,000 - 260,000
Engineering Director
Engineering Director

Bridgenext • Idaho

Remote
USD 180,000 - 270,000
Data Engineer
Data Engineer

Fracht Group - North America • Houston (TX)

On-site
USD 140,000 - 190,000
Data Engineer
Data Engineer

Bridgeway Benefit Technologies • Miami (FL)

Remote
USD 90,000 - 150,000
Senior Data Engineer
Senior Data Engineer

RBA, Inc. • United States

On-site
USD 120,000 - 190,000
Data Engineer
Data Engineer

MissionStaff • Philadelphia

Hybrid
USD 83,000 - 124,000
Senior Data Engineer
Senior Data Engineer

Frederick Fox • Charlotte (NC)

On-site
USD 100,000 - 140,000