Data Engineer - Stream-Aligned Team - 3 months contract - Abu Dhabi

Proximity Works; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading technology company is seeking a Data Engineer for a 3-month contract in Abu Dhabi. The role involves building secure and scalable data pipelines, collaborating across teams, and ensuring the quality of data processes. Candidates should have strong proficiency in Databricks, SQL, and various data integration methodologies. Relocation support is available for qualified candidates, emphasizing an exciting opportunity to impact the organization's success and grow professionally.

Benefits

Relocation support for candidates moving from India

Engagement opportunities through Proximity Talks

Qualifications

• Proficiency in SQL and Python for data handling.
• Experience in building data pipelines and managing data quality.
• Ability to document architecture and communicate decisions effectively.

Responsibilities

• Build and maintain secure, scalable data pipelines using Databricks and Azure.
• Handle data ingestion from diverse sources and ensure data quality validation.
• Collaborate with product teams for machine learning readiness.

Skills

Data Quality

Data Validation

Git

Communication

Data Integration

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Azure

Terraform

Job description

Data Engineer - Stream-Aligned Team - 3 months contract - Abu Dhabi

As a Data Engineer at our company, your primary responsibility will be to build and maintain secure, scalable data pipelines using Databricks and Azure. You will play a crucial role in handling ingestion from diverse sources such as files, APIs, and streaming data. Additionally, you will be involved in data transformation and ensuring the quality validation of the data. Collaboration with subsystem data science and product teams for ML readiness will also be a key part of your role.To excel in this position, you should have a strong technical background with proficiency in tools like Notebooks (SQL, Python), Delta Lake, Unity Catalog, ADLS/S3, job orchestration, APIs, structured logging, and IaC (Terraform). Experience in delivery practices such as Trunk-based development, TDD, Git, and CI/CD for notebooks and pipelines will be beneficial. Familiarity with integration formats like JSON, CSV, XML, Parquet, SQL/NoSQL/graph databases is essential. Effective communication skills are also required, as you should be able to justify decisions, document architecture, and align with enabling teams.In return, you will have the opportunity to engage in Proximity Talks where you can meet other professionals in the field and learn from experts. Working with a world-class team will allow you to challenge yourself constantly and acquire new skills every day. Please note that this is a contract role based in Abu Dhabi. If relocation from India is necessary, the company will cover travel and accommodation expenses in addition to your salary.About Us:Proximity is a trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies globally. Headquartered in San Francisco, we also have offices in Palo Alto, Dubai, Mumbai, and Bangalore. Since 2019, Proximity has developed high-impact, scalable products used by 370 million daily users, with a total net worth of $45.7 billion among our client companies.Our team at Proximity consists of coders, designers, product managers, and experts who are dedicated to solving complex problems and building cutting-edge tech at scale. As a Data Engineer, you will have the opportunity to work with experienced leaders and have a significant impact on the company's success. To learn more about us, you can watch our CEO, Hardik Jagda, talk about Proximity, read about our values, meet some of our team members, explore our website and blog, and get a behind-the-scenes look at our work on Instagram by following @ProxWrks and @H.Jagda.,

Sign-in & see how your skills match this job

• Data Engineer - Stream-Aligned Team - 3 months contract - Abu Dhabi

Find Your perfect Job

Sign-in & Get noticed by top recruiters and get hired fast

Scala, Java, ETL, Data Quality, Data Validation, Git, Containerization, Data Integration, DataStage, Prophecy, Informatica, Ab Initio,RDDs, DataFrames, DataSets, SparkSQL, Spark Streaming, Delta Lake, Data Ingestion, Data Warehouse, Data Modelling, CICD

Predictive Modelling, Classification, Clustering, Regression, NLP, Azure, AWS,Spark MLlib, Databricks ML, Databricks Lakehouse, hyperparameter tuning, AutoML, MLflow, Delta Lake, CICD, Databricks Repos, GitHub Actions, Spark , Databricks Environment, Spark SQL, PySpark, Feature Store, Unity Catalog, timeseries

Scala, Java, ETL, Data Quality, Data Validation, Git, Containerization, Data Integration, DataStage, Prophecy, Informatica, Ab Initio,RDDs, DataFrames, DataSets, SparkSQL, Spark Streaming, Delta Lake, Data Ingestion, Data Warehouse, Data Modelling, CICD

Predictive Modelling, Classification, Clustering, Regression, NLP, Azure, AWS,Spark MLlib, Databricks ML, Databricks Lakehouse, hyperparameter tuning, AutoML, MLflow, Delta Lake, CICD, Databricks Repos, GitHub Actions, Spark , Databricks Environment, Spark SQL, PySpark, Feature Store, Unity Catalog, timeseries