Microsoft Azure Cloud Engineer/Developer

Johnson Technology Systems Inc; United States; Remote; USD 110,000 - 140,000; Part time

Job summary

Johnson Technology Systems Inc is seeking a remote Big Data Engineer to design and optimize distributed data processing pipelines using open source technologies.

You will work with Hadoop, Spark, Kafka, Databricks, Hive, and related stacks to deliver scalable ETL/ELT solutions and enhance data access for analytics and ML workloads.

Qualifications

• Experience building big data pipelines with open source tools.
• Strong knowledge of distributed data processing and analytics.

Responsibilities

• Design and optimize distributed data processing pipelines.
• Develop and maintain ETL/ELT workflows.
• Collaborate with data scientists to enable ML workloads.

Skills

Open Source

Distributed Data Processing

SQL Queries

Java/Scala/PySpark

ETL/ELT

Azure Data Factory

Education

Bachelor's degree in Computer Science

Tools

Apache Hadoop

Spark

Databricks

Hive

HBase

Phoenix

Kafka

Job description

• Deep Knowledge on Open Source Technologies for Distributed Data processing, analysis of big data sets including writing jobs to process vast amounts of data and ETL processing, required expertise is over tools such as: Apache Hadoop, MapReduce, Pig, Spark, Databricks, Hive
• Deep Knowledge on Open Source Technologies to perform fast, interactive SQL queries at scale over structured or unstructured big data sets, required expertise is over tools such as: Apache Hive LLAP, Spark SQL, Phoenix
• Deep Knowledge on Open Source Technologies to enable ingestion and processing of millions of streaming events per second: Apache Kafka, Apache Storm, Apache Spark, Apache HBase
• Deep Knowledge on Performance Analysis and Optimization and operation of Apache Hadoop, Spark, Databricks and the others mentioned above.
• Deep Knowledge on Open Source Technologies for Machine Learning such as: MLib
• Strong expertise in ETL/ELT approaches and expertise in technologies such as: Azure Data Factory and SQL Server Integration Services.
• Software Development skills to write code on Java, Spark Scala, PySpark, Python Functional Skills
• Design
• Hosted Services Deployment
• IoT Application Management
• MaaS Assessment Services
• Mobile Application Custom Development
• Mobile Application Database Connectivity
• Mobile Application Offline Architecture
• Open Source Container Orchestration
• Relational Database Architecture for Cloud Applications
• Search Design and Architecture
• Serverless Computing
• Unstructured Data Storage Architecture
• Using Xamarin for cross-platform development
• Web Application API Management
• Web Application Development
• Web Application Security

The role is Remote and 6 Month Contract. TO QUALIFY YOU MUST BE US citizens. PRINCIPALS Only. NO Staffing Agencies!! We promote a Drug-Free Workplace and are an Equal Opportunity Employer (EOE) and Affirmitive Action Employer. Established in 2003, JTSi is an IT & Engineering Services provider with years of documented experience in the Information Technology and Engineering services field. JTSi has a proven track record for successfully delivering mission-critical Professional IT Services to the Public Sector. JTSI SAP/ERP team delivers high-value business solutions to its clients by clearly understanding their core business problems. We deliver quality services at equitable rates and focus on constant improvement in all areas of our operation, with a strong commitment to meeting our Customers’ needs. We view ourselves more as a Business Partner than merely a consulting services provider. US Army ERP Services Contract award to JTSi for a ceiling value of $846M is one of the most prestigious awards of the time. At JTSi "Customer Is Always First" and partnering is our path to customer satisfaction - We do what we say. Visit us at www.jtsusa.com Originally posted on Himalayas