Data Engineer

Deeplight; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

DeepLight is seeking a Data Engineer to join their AI team in the UAE. The successful candidate will be responsible for designing and optimizing data pipelines and infrastructure to facilitate AI systems development. This role demands collaborative efforts with various experts and requires proficiency in big data tools and technologies. Ideal candidates will have experience in both technical execution and collaborative project delivery in a fast-paced environment.

Benefits

Professional development opportunities

Collaborative work culture

Impactful projects in AI

Qualifications

• Proven experience as a Data Engineer with expertise in data modeling and ETL processes.
• Strong hands-on experience with big data technologies and frameworks.
• Excellent analytical skills with the ability to translate complex concepts.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Implement robust data integration processes.
• Collaborate closely with cross-functional teams.

Skills

Data Integration

Performance Optimization

Data Governance

Collaboration

Problem-solving

Education

Bachelor’s Degree in Computer Science or related field

Tools

Hadoop

Spark

Kafka

AWS

Azure

Job description

DeepLight is a pioneering AI company committed to pushing the boundaries of innovation in artificial intelligence. Our mission is to harness the power of data and machine learning to revolutionize industries and create a brighter future. With a dynamic team of experts and a culture of relentless innovation, we are at the forefront of AI research and development.

Position Overview :

DeepLight is seeking an exceptional Data Engineer to join our team of AI specialists in the UAE. As an Expert Data Engineer, you will be responsible for designing, implementing, and optimizing data pipelines and infrastructure to support our cutting-edge AI systems. You will collaborate closely with our multidisciplinary team to ensure the efficient collection, storage, processing, and analysis of large-scale data, enabling us to unlock valuable insights and drive innovation across various domains.

Requirements

• PipelineDevelopment : Design,develop,andmaintainscalableandreliabledatapipelinestoingest,transform,andloaddiversedatasetsfromvarioussources,includingstructuredandunstructureddata,streamingdata,andreal-timefeeds,withconsiderationfordownstreamAI / MLworkloads.
• DataIntegration : Implementrobustdataintegrationprocessestoseamlesslyintegratedatafromdifferentsources,ensuringconsistency,reliability,anddataqualityforanalyticsandAIusecases.
• DataStorage : Designandoptimizedatastoragesolutions,includingrelationaldatabases,NoSQLdatabases,datalakes,andcloudstorageservices,toefficientlystoreandmanagelargevolumesofdataforAIandmachinelearningmodelconsumption.
• PerformanceOptimization : Optimizedataprocessingandqueryperformancetoenhancesystemscalability,reliability,andefficiency,leveragingtechniquessuchasindexing,partitioning,caching,andparallelprocessing—especiallyforAImodeltrainingandinferencepipelines.
• DataGovernance : Implementdatagovernanceframeworkstoensuredatasecurity,privacy,integrity,andcompliancewithregulatoryrequirements,includingdataencryption,accesscontrols,andauditing—crucialforresponsibleAIdeployment.
• MonitoringandMaintenance : Monitordatapipelinesandinfrastructurecomponents,proactivelyidentifyandaddressissues,andperformroutinemaintenancetaskstoensuresystemstabilityandreliabilityacrossAIanddatascienceenvironments.
• Collaboration : Collaboratecloselywithcross-functionalteams,includingdatascientists,MLengineers,architects,anddomainexperts,tounderstandAI / MLrequirements,gatherinsights,anddeliverintegrated,production-readydatasolutions.
• Documentation : Createcomprehensivedocumentation,includingtechnicalspecifications,dataflowdiagrams,andoperationalprocedures,tofacilitateunderstanding,collaboration,andknowledgesharingacrossAIandanalyticsteams.
• Provenexperience asaDataEngineer,withatrackrecordofdesigningandimplementingcomplexdatapipelinesandinfrastructuresolutionsthatsupportadvancedanalyticsandAIinitiatives.
• Expertiseindatamodeling,ETL (Extract,Transform,Load)processes,anddatawarehousingconcepts ,withproficiencyinSQLandscriptinglanguages (e.g.,Python,Scala)—especiallyinAIpipelinepreparationandfeatureengineering.
• Stronghands-onexperience withbigdatatechnologiesandframeworks,suchasHadoop,Spark,Kafka,andFlink,aswellascloudplatforms (e.g.,AWS,Azure,GCP)commonlyusedforAIworkloads.
• Familiaritywithcontainerizationandorchestrationtechnologies ,suchasDockerandKubernetes,andDevOpspracticesforCI / CD (ContinuousIntegration / ContinuousDeployment),includingMLmodeldeploymentanddatapipelineautomation.
• ExperiencesupportingAI / MLinitiatives ,includingthepreparationoftrainingdatasets,modelinput / outputdataflows,MLOpsintegration,andexperimentationtracking.
• Excellentanalytical,problem-solving,andcommunicationskills ,withtheabilitytotranslatecomplextechnicalconceptsintoclearandactionableinsights.
• Provenabilitytoworkeffectivelyinafast-paced,collaborativeenvironment ,withapassionforinnovation,continuouslearning,andcontributingtoAI-drivensolutions.

Why Join DeepLight?

• Impact : Be part of a dynamic team that is shaping the future of AI and making a meaningful impact on industries and society.
• Innovation : Work on cutting-edge projects at the intersection of AI, data engineering, and machine learning, leveraging the latest technologies and methodologies.
• Collaboration : Collaborate with a diverse team of experts from various disciplines, fostering creativity, learning, and growth.
• Opportunity : Enjoy ample opportunities for professional development, career advancement, and leadership roles in a rapidly growing company.
• Culture : Join a culture of curiosity, excellence, and collaboration, where your ideas are valued, and your contributions are recognized and rewarded.

If you are passionate about data engineering, AI, and innovation, and you thrive in a dynamic and collaborative environment, we want to hear from you! Apply now to join DeepLight and be part of our journey to unlock the potential of AI for a brighter future.