Jobs in Newcastle, United States
Kashmiri linguistic projects- Arabic Script (Remote)
Sigma AI
Scopri più opportunità qui che da qualsiasi altra parte. Trova subito più lavoriRevenue Accountant - UK Working Hours (UK Remote)
Turnitin, LLC
Inuktitut Linguistic Projects - Cans Script (Remote)
Sigma AI
Collegati con i cacciatori di teste per candidarti a posizioni similiUyghur Linguistic Projects - Arabic Script (Remote)
Sigma AI
Junior Network Engineer - Hosting
Hamilton Barnes Associates Limited
Investment Compliance Officer (12-month FTC)
Willow Resourcing
Social Media Specialist (Sporting Goods)
Alexander James Recruiting Ltd.
Home-Based Customer Service Representative
Orca Recruitment
Home-Based Customer Service Representative
Orca Recruitment
Senior Data Engineer IND (Remote)
Descrizione del lavoro
A leading revenue intelligence platform is seeking a skilled Data Engineer to design scalable data pipelines and optimize internal processes. The ideal candidate will have over 10 years of experience and a degree in a technical field, with proficiency in Apache Spark, SQL, and data engineering practices. This remote position offers opportunities to collaborate with cross-functional teams and work on advanced data use cases in a dynamic environment.
Competenze
- 10+ years of recent experience in Data Engineering roles.
- Minimum 5 years hands-on experience with Apache Spark.
- Strong cloud experience with Databricks.
Mansioni
- Design and build scalable data pipelines for ETL processes.
- Implement process improvements and optimize data flows.
- Collaborate with teams to address data-related technical issues.
Conoscenze
Formazione
Strumenti
Location: Remote (Pan India)
Shift Timings: 2:00 PM – 11:00 PM IST
Reporting To: CEO or assigned Lead by Management.
- Design and build scalable data pipelines for extraction, transformation, and loading (ETL) using the latest Big Data technologies.
- Identify and implement internal process improvements like automating manual tasks and optimizing data flows for better performance and scalability.
- Partner with Product, Data, and Engineering teams to address data-related technical issues and infrastructure needs.
- Collaborate with machine learning and analytics experts to support advanced data use cases.
- Bachelor’s degree in Engineering, Computer Science, or a relevant technical field.
- 10+ years of recent experience in Data Engineering roles.
- Minimum 5 years of hands-on experience with Apache Spark, with strong understanding of Spark internals.
- Deep knowledge of Big Data concepts and distributed systems.
- Proficiency in coding with Scala, Python, or Java, with flexibility to switch languages when required.
- Expertise in SQL, and hands-on experience with PostgreSQL, MySQL, or similar relational databases.
- Strong cloud experience with Databricks, including Delta Lake.
- Experience working with data formats like Delta Tables, Parquet, CSV, JSON.
- Comfortable working in Linux environments and scripting.
- Comfortable working in an Agile environment.
- Machine Learning knowledge is a plus.
- Must be capable of working independently and delivering stable, efficient and reliable software.
- Experience supporting and working with cross-functional teams in a dynamic environment.
* Il benchmark retributivo si basa sugli obiettivi retributivi dei leader del mercato nei rispettivi settori. È pensato per orientare gli utenti Premium nella valutazione delle posizioni aperte e aiutarli a negoziare la propria retribuzione. Tale benchmark non è fornito direttamente dall'azienda, quindi la retribuzione effettiva potrà risultare anche notevolmente superiore o inferiore.