Jobs in Calgary, Canada
Data Engineer
Axiom Software Solutions Limited
Kurdish Interpreters Required In Alnwick (NE)
Language Empire
Sales Development Representative - Relocate to Australia!
Smart Energy Group
Talent Acquisition Partner (Tech)
Talent Solutions Staffing UK
Market Research Interviewer - Part Time - St Albans
National Centre for Social Research
Residential Surveyor - Central London
e.surv Chartered Surveyors
Entrez en contact avec des chasseurs de têtes pour postuler à des offres similairesSales Engineer, Enterprise Select - UK
Samsara
Interpreter Translator Required In Barnstaple Devon EX
Language Empire
Associate Manager, Customer Support, SevenRooms Powered by DoorDash
DoorDash
Kurdish Interpreters Required In Gateshead (NE)
Language Empire
Market Research Interviewer - Part Time - Stockport
National Centre for Social Research
Interim Procurement Process Analyst 360pd REMOTE
1st Executive Ltd
Senior Associate, Pharmacovigilance - UK/US - Remote
Worldwide Clinical Trials
Sales Account Executives Power Platform
Cloud Decisions
Dynamics 365 Solutions Architect
Cloud Decisions
Spanish Interpreters Urgently Required In Leeds
Language Empire
Data Engineer
Résumé du poste
A leading software solutions provider in the UK is looking for a Data Engineer for a 6-month remote contract inside IR35. The ideal candidate will have a robust understanding of data structures, strong skills in Python and PySpark for Data Pipeline creation, and experience with GDPR compliance. This role requires expertise in JSON manipulation and data security principles.
Qualifications
- Strong understanding of data concepts and structures.
- Experience managing sensitive datasets and GDPR compliance.
- Proven analytical skills with problem-solving abilities.
Connaissances
Outils
Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies
- Data Engineering: Strong understanding of data concepts, data types, data structures, schemas (both JSON and Spark), schema management
- Strong understanding of complex JSON manipulation
- Experience working with Data Pipelines using a custom Python/PySpark frameworks
- Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data
- Strong understanding of Data Security principles, data owners, access controls
- Row and column level, GDPR compliance including experience of handling sensitive datasets
- Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Required Skills:
- Languages / Frameworks
- JSON
- YAML
- Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
- SQL
- PySpark
- Delta Lake
- Bash (both CLI usage and scripting)
- Git
- Markdown
- Scala (bonus, not compulsory)
- Azure SQL Server as a HIVE Metastore (bonus)
- Technologies
- Azure Databricks
- Apache Spark
- Delta Tables
- Data processing with Python
- PowerBI (Integration / Data Ingestion)
- JIRA
* Le salaire de référence se base sur les salaires cibles des leaders du marché dans leurs secteurs correspondants. Il vise à servir de guide pour aider les membres Premium à évaluer les postes vacants et contribuer aux négociations salariales. Le salaire de référence n’est pas fourni directement par l’entreprise et peut pourrait être beaucoup plus élevé ou plus bas.
plus rapidement
Suivez-nous
