Data Engineer - Remote / Telecommute

Cynet systems Inc; Richmond; Remote; GBP 50,000 - 70,000; Full time

Job summary

A data solutions company in the United Kingdom seeks a skilled data engineer to design and optimize data pipelines, implement ingestion strategies, and leverage statistical methods for analytics. The role involves developing NLP solutions and creating dashboards in Power BI to drive insights and operational efficiency. Ideal candidates will have strong experience with data engineering tools and methodologies.

Responsibilities

• Design, develop, and optimize data pipelines using Databricks.
• Implement data ingestion strategies from sources like SAP and Salesforce.
• Use advanced statistical methods for anomaly detection and forecasting.
• Develop and deploy NLP solutions for text-based data analysis.
• Create AI-driven insights using Power BI dashboards.

Skills

Data pipeline optimization

Data ingestion strategies

Statistical analysis

Natural Language Processing (NLP)

Power BI dashboard creation

Job description

Job Description:

• Design, develop, and optimize data pipelines using Databricks and Medallion architecture for structured and unstructured data.
• Implement data ingestion strategies from diverse sources (SAP, TrackWise, Salesforce, and others) ensuring high-quality, reliable data flow.
• Ingest and process large volumes of data from Azure Blob Storage into Databricks for transformation and analytics.
• Build and maintain silver and gold layers for curated, analytics-ready datasets.
• Apply advanced statistical methods, including:
• Anomaly Detection for identifying irregular patterns in operational and quality data.
• Forecasting for demand, defect trends, and resource planning.
• Root Cause Analysis to identify drivers of failures or complaints.
• Risk Modeling to quantify and predict potential quality or operational risks.
• Predictive Analytics for proactive decision-making and maintenance.
• Pattern Detection to uncover hidden relationships in large datasets.
• Develop and deploy NLP solutions for text-based data analysis, leveraging linguistic schemas for structured interpretation of unstructured data.
• Create Power BI dashboards with:
• Workflow automation (notifications, reminders, messaging).
• AI-driven insights using prepped datasets for predictive and prescriptive analytics.
• Implement near real-time tracking systems and alert mechanisms for critical events and operational KPIs.
• Collaborate with cross-functional teams to align data solutions with business objectives and ensure visibility across the end-to-end operating cycle.
• Document data workflows, maintain traceability, and ensure audit readiness for all data engineering activities.
• Leverage knowledge of Quality Management Systems (QMS) to support compliance and continuous improvement.