Title: Data Scientist
Location: Chantilly, VA
Required Clearance: TS/SCI plus full scope polygraph
Description: The Data Scientist will support the customer with the requirements for new system capabilities, the extension and maintenance of bulk data pipeline, and enhancements for multiple applications in the customers' cloud computing environment.
Applicants must have experience
- utilizing big data processing tech such as Spark, Pyspark, and Python.
- data mapping, extraction, transformation and loading.
- building analytic reports in tools such as CloudWatch and Kibana.
- processing and converting of OS and Data Logs into reports and metrics Dashboards.
- with Regular Expressions (RegEx).
- with SQL, MySQL, PostgresSQL.
- with Data file type processing XML, JSON.
- with IDEs and Data Modeling through Notebooks and Visual Studio.
- ETL’ing data from disparate structured & unstructured data formats into enriched, query-friendly structured data in indexed files.
- performing extensive data review and data quality analysis.
- developing ETL design documentation including source and target mapping and data dictionary information.
- interfacing with customers and integration partners for gaining and clarifying detailed objectives.
- supporting Agile development by contributing to tasking definition, scope and review.
- deploying capabilities on the Databricks unified analytics platform.
- with Elastic Map Reduce to run big data workloads.
- joining multiple complex data sets using Spark.
- tuning Spark streaming and batch jobs for cluster utilization and speed.
- deploying complex, notebook-based pipelines.
- with Python data analysis libraries such as Pandas.
- utilizing Cloud services such as Lambda, SNS/SQS, or EC2.
- with DevOps tools to include Cloudwatch, Lambda, SQS, Dynamo and RDS.
- working with Elastic, ElasticSearch/Logstash/Kibana (ELK stack).
MH Corbitt Consulting is a small company with over 25 years of IT experience and several active contracts in the Intelligence Sector. We offer competitive salaries and a top-notch benefits package that includes:
- - 100% company paid medical, dental, vision, long and short-term disability
- - 11 paid holidays + 25 days PTO
- - Employees can use paid holidays at their discretion
- - Employee referral bonus paid out each year the referral stays with the company
- - Training allowances
- - 6% 401k regardless of employee contribution + profit sharing (4%) = At Least 10% total match