Data Engineer: Production Pipelines & AI-Driven Insights

CoreView; United States; Remote; USD 110,000 - 150,000; Full time

Job summary

CoreView, a leader in Microsoft 365 resilience, seeks a data analytics engineer to build and own customer usage analytics pipelines. You will work in Databricks, craft scalable data products, and help define the platform’s next metrics and signals.

You’ll collaborate across Operations, Product, and Post-Sales, implement CI/CD, and use AI-assisted tooling as part of daily development. Strong SQL/Python and data governance experience are essential.

Qualifications

• 3–5 years of professional experience building and operating production data pipelines in a commercial setting.
• Hands-on Databricks proficiency: Unity Catalog, Spark Declarative Pipelines and metric views with proper access controls.
• Strong SQL and Python applied to data engineering work—from development to production.
• Experience with data transformation/orchestration tools such as Spark Declarative Pipelines or dbt.
• Solid grounding in data modelling (dimensional/star-schema) for analytics consumption.
• Git-based version control and CI/CD practices applied to data pipelines, not only apps.
• Experience ingesting data from CRM (Salesforce, HubSpot), product usage telemetry and other business systems.
• Ability to work with minimal guidance and communicate clearly.

Responsibilities

• Take operational ownership of the usage and adoption pipelines and their alerting.
• Reconcile figures from the product-usage tool to ensure accuracy.
• Separate development and production environments and mature CI/CD so deployment is repeatable and rollback is reliable.
• Build and maintain Bronze-to-Gold pipelines in Databricks and Unity Catalog metric views.
• Extend automated data quality checks across gold-layer tables and validate outputs against Power BI reports.
• Co-own scoping of next usage signals with Product and Post-Sales; prioritise upsell signals and ROI narrative.
• Handle business-system data realities: schema drift, soft deletes, incremental loads.
• Lead consolidation of additional data sources (CRM, logs, etc.) to support a unified data platform.
• Establish documented pipelines, access model for raw/transformed data, and intake process for data requests.

Skills

Production data pipelines

Databricks

SQL

Python

Spark Declarative Pipelines

dbt

Data modelling

CI/CD

Git

CRM data ingestion

Tools

Databricks Unity Catalog

Power BI

dbt

Job description

CoreView, a leader in Microsoft 365 resilience, seeks a data analytics engineer to build and own customer usage analytics pipelines. You will work in Databricks, craft scalable data products, and help define the platform’s next metrics and signals.

You’ll collaborate across Operations, Product, and Post-Sales, implement CI/CD, and use AI-assisted tooling as part of daily development. Strong SQL/Python and data governance experience are essential.