Data Engineer - Snowflake / Databricks

Insight Global; Andover (MA); On-site; USD 103,000 - 131,000; Full time

Job summary

Insight Global is seeking a Data Engineer to join a team modernizing a digital platform for data integration, analytics, and operational insights in a mission-critical environment.

The role focuses on building scalable data pipelines, Snowflake/Databricks design, and collaborating with data scientists and developers to empower AI enablement and dashboards. Competitive compensation and benefits included.

Qualifications

• 5+ years of Data Engineering experience.
• Strong SQL and Python development experience.
• Expertise with either Snowflake or Databricks platforms.
• Experience building ETL/ELT pipelines and data integration solutions.
• Experience developing cloud-native data architectures.
• Understanding of data governance, data quality, and security best practices.
• Matillion for ELT pipeline development and orchestration.

Responsibilities

• Build the data foundation powering next-generation strategy.
• Develop scalable data pipelines and integrations across systems.
• Design Snowflake and Databricks solutions for analytics and ML.
• Collaborate with Data Scientists and Application Developers.
• Deliver a modern data platform improving sustainment visibility and readiness.

Skills

Data engineering

SQL

Python

ETL/ELT pipelines

Cloud data architectures

Data governance

CI/CD for data platforms

Tools

Snowflake

Databricks

Matillion

HVR

Unity Catalog

Delta Lake

Git

Azure DevOps

GitHub Actions

AWS

Azure

Job description

"

Job Description

Our client is investing in a next-generation digital platform designed to unify data, analytics, and operational insights across a globally deployed mission-critical environment. Team members will play a key role in a high-visibility modernization initiative focused on data integration, advanced analytics, AI enablement, application development, and operational readiness. This is an opportunity to build impactful solutions from the ground up, work alongside senior technical leaders, and help shape the future of a platform that supports complex operations on a global scale. If you are interested in joining this team as a Data Engineer, you will be:

• Building the data foundation that powers next-generation strategy
• Developing scalable data pipelines and integrations that bring together data from enterprise systems and deployed environments
• Designing Snowflake and Databricks solutions that enable advanced analytics, reporting, and machine learning initiatives
• Working alongside Data Scientists and Application Developers to support AI, predictive analytics, and operational dashboards
• Playing a key role in delivering a modern data platform that improves sustainment visibility and mission readiness

The Snowflake Data Engineer specifically requires Snowflake architecture, CDC/Streams, Matillion, HVR, data governance, and cloud integration experience.

The Databricks Engineer specifically emphasizes Spark, Delta Lake, Unity Catalog, Databricks Workflows, AI/ML platforms, GenAI, RAG, LangChain, CI/CD automation, and modern Lakehouse architecture capabilities.

Compensation: $75-95/HR Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401K retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [e-mail] learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 5+ years of Data Engineering experience
• Strong SQL and Python development experience
• Expertise with either Snowflake or Databricks platforms
• Experience building ETL/ELT pipelines and data integration solutions
• Experience developing cloud-native data architectures
• Understanding of data governance, data quality, and security best practices
• Matillion for ELT pipeline development and orchestration

CDC and streaming architectures

• HVR replication
• Delta Lake, Unity Catalog, Databricks Workflows
• Snowflake Streams and Tasks
• CI/CD for data platforms
• Git, Azure DevOps, GitHub Actions
• AWS and/or Azure cloud environments (Govcloud)
• Medallion architecture and data modeling concepts

Experience supporting DoD, aerospace, or sustainment environments

"