Data Engineer

Insight Global; Bentonville (AR); On-site; USD 110,000 - 150,000; Full time

Job summary

Insight Global is seeking a Data Engineer to support supply chain technology initiatives, building new and upgrading applications for the replenishment order management team.

Candidates should have strong experience with Spark (Scala/Python/Java), data pipelines, and visualization tools such as Tableau/Power BI, and cloud platforms (Azure/AWS).

Qualifications

• 5+ years of experience with Spark and big data technologies.
• Strong data extraction, cleaning, screening, exploration and visualization abilities.
• Experience with SQL and relational databases; familiarity with various databases.

Responsibilities

• Build and optimize large-scale data pipelines and architectures.
• Work with replenishment order management and supply chain teams on data needs.
• Leverage cloud services (Azure/AWS) and visualization tools to deliver insights.

Skills

Spark

Scala

Python

Java

Data extraction

Data cleaning

Data screening

Data exploration

Data visualization

Tools

Tableau

Power BI

Looker

Databricks

Azure Data Factory

Azure HDInsight

Job description

Job Description

One of our largest national retail clients is looking to bring on a Data Engineer to help them with several projects in their supply chain technology organization. These projects consist of building new and upgrading legacy applications for the replenishment order management team.

Skills and Requirements

• 5+ years of experience in Spark-Proficient in Scala/Python & Java-Data Extraction, Data cleaning, Data screening, Data Exploration and Data Visualization of structured and unstructured datasets-Skilled in Big Data Technologies like Spark, Spark SQL, PySpark, HDFS (Hadoop), MapReduce
• Excellent exposure to Data Visualization tools such as Tableau, PowerBI, Looker-Experience with cloud services such as: Azure/AWS Cloud, Databricks, Azure HD Insights, ADF or similar-Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing 'big data' data pipelines, architectures and data sets.
• Strong analytic skills related to working with unstructured datasets.
• Working knowledge of highly scalable 'big data' data stores.
• Google Cloud Platform professional experience

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].