Data Scientist

Avalore, LLC; Chantilly (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

Avalore, LLC is seeking a Data Scientist to support new system capabilities and extend bulk data pipelines across customer cloud environments. The role requires security clearance, experience with Spark, PySpark, Python, and ETL processes, plus building analytic reports in CloudWatch and Kibana.

Responsibilities include data mapping, loading from varied formats, data quality analysis, and collaborating with customers and partners on objectives within an Agile framework.

Qualifications

• Active Security Clearance with appropriate Polygraph.
• Experience with Spark, PySpark and Python.
• Experience data mapping, extraction, transformation and loading.
• Experience building analytic reports in CloudWatch and Kibana.
• Experience converting OS and Data Logs into reports and dashboards.
• Experience RegEx.
• Experience SQL, MySQL, PostgreSQL.
• Experience XML, JSON data formats.
• Experience IDEs and Data Modeling via Notebooks and Visual Studio.
• Experience ETLing data from diverse formats into structured data.
• Experience data review and data quality analysis.
• Experience ETL design documentation with mappings and data dictionaries.
• Experience interfacing with customers and integration partners.
• Experience supporting Agile development.

Responsibilities

• Support requirements for new system capabilities and maintenance of bulk data pipelines.
• Enhance applications in customers' cloud computing environments.
• Collaborate with stakeholders to clarify objectives and deliver data solutions.

Skills

Big data processing

SQL

ETL

Data modeling

Data quality

Python

Spark

Pyspark

Notebooks

Visual Studio

Kibana

Databricks

ELK stack

Pandas

Cloud services

DevOps tools

Tools

Spark

PySpark

Python

SQL

MySQL

PostgreSQL

XML

JSON

Notebooks

Visual Studio

Databricks

Elastic MapReduce

ELK stack

CloudWatch

Lambda

SNS/SQS

EC2

Job description

As a Data Scientist at Avalore, you will support the requirements for new system capabilities, the extension and maintenance of bulk data pipeline and enhancements for multiple applications in the customers’ cloud computing environment.

• Active Security Clearance with appropriate Polygraph
• Demonstrated experience utilizing big data processing tech such as Spark, Pyspark, and Python.
• Demonstrated experience data mapping, extraction, transformation and loading.
• Demonstrated experience building analytic reports in tools such as CloudWatch and Kibana.
• Demonstrated experience processing and converting of OS and Data Logs into reports and metrics Dashboards.
• Demonstrated experience with Regular Expressions (RegEx).
• Demonstrated experience with SQL, MySQL, PostgresSQL.
• Demonstrated experience with Data file type processing XML, JSON.
• Demonstrated experience with IDEs and Data Modeling through Notebooks and Visual Studio.
• Demonstrated experience ETL’ing data from disparate structured & unstructured data formats into enriched, query-friendly structured data in indexed files.
• Demonstrated experience performing extensive data review and data quality analysis.
• Demonstrated experience developing ETL design documentation including source and target mapping and data dictionary information.
• Demonstrated experience interfacing with customers and integration partners for gaining and clarifying detailed objectives.
• Demonstrated experience supporting Agile development by contributing to tasking definition, scope and review.

Desired:

• Demonstrated experience deploying capabilities on the Databricks unified analytics platform.
• Demonstrated experience with Elastic Map Reduce to run big data workloads.
• Demonstrated experience in joining multiple complex data sets using Spark.
• Demonstrated experience in tuning Spark streaming and batch jobs for cluster utilization and speed.
• Demonstrated experience in deploying complex, notebook-based pipelines.
• Demonstrated experience in Python data analysis libraries such as Pandas.
• Demonstrated experience utilizing Cloud services such as Lambda, SNS/SQS, or EC2.
• Demonstrated experience with DevOps tools to include Cloudwatch, Lambda, SQS, Dynamo and RDS.
• Demonstrated experience working with Elastic, ElasticSearch/Logstash/Kibana (ELK stack).

Work Environment:

• Moderate noise (i.e.business office with computers,phoneand printers) and /or occasional Loud noise (airfield, large equipment).

• Ability to sit at a computer terminal for an extended period of time.

Physical Demands:

• While performing the responsibilities of the job, the employeeis required tosit, stand, talk, andhear.

• Employee isoften required to sit and use their hands and fingers tooperatea computer.

• Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Travel:

• Up to 10%/ Occasionaltravel.

Avalore will provide reasonable accommodations to applicants who are unable toutilizeour online application system due to a disability.

Avalore is an Equal Opportunity Employer - Wenot discriminatebased on age, race, national or ethnic origin, gender,veteransstatus, disability, sexual orientation, gender identity or any other legally protected class. Applicants have rights under Federal Employment Laws.

Eligibility requirements apply.

• Employer Contributions to Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (401k, IRA) with a generous matching program
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation, Sick & Public Holidays)
• Short Term & Long Term Disability
• Training & Development
• Employee Assistance Program
• Salary at Avalore is determined by various factors, including but not limited to location, the individual’s particular combinaition of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements.