Acuity, Inc. is hiring a Data Scientist to support client requirements for new system capabilities and to extend and maintain bulk data pipelines and application enhancements within customers’ cloud computing environments. The role focuses on big data processing, data quality analysis, ETL design and documentation, and coordinating objectives with customers and integration partners.
Responsibilities
- Assist clients with requirements for new system capabilities.
- Extend and maintain bulk data pipelines.
- Support enhancements across multiple applications deployed in customers’ cloud computing environments.
- Interface with customers and integration partners to gain and clarify detailed objectives.
- Support Agile development by contributing to task definition, scope, and review.
Key Requirements
- Proven experience using big data processing technologies such as Spark, PySpark, and Python.
- Proven experience with data mapping and ETL activities including extraction, transformation, and loading.
- Proven experience building analytic reports using tools such as CloudWatch and Kibana.
- Proven experience processing and converting OS and Data Logs into reports and metrics dashboards.
- Working experience with Regular Expressions (RegEx).
- Experience with SQL, MySQL, and PostgresSQL.
- Experience processing data files in XML and JSON formats.
- Experience using IDEs and data modeling through Notebooks and Visual Studio.
- Experience ETLing data from disparate structured and unstructured formats into enriched, query-friendly, structured data in indexed files.
- Experience conducting extensive data review and data quality analysis.
- Experience producing ETL design documentation including source and target mapping and data dictionary information.
- Experience interfacing with customers and integration partners to define and clarify objectives.
- Experience supporting Agile development through tasking definition, scope, and review.
- TS/SCI w/Poly
Technologies
- Spark, PySpark, Python
- CloudWatch, Kibana
- RegEx
- SQL, MySQL, PostgresSQL
- XML, JSON
- Notebooks, Visual Studio
- ETL
- Databricks unified analytics platform
- Elastic Map Reduce, Spark streaming, Spark batch jobs
- Pandas
- Lambda, SNS/SQS, EC2
- Cloudwatch, SQS, Dynamo, RDS
- Elastic, ElasticSearch, Logstash, ELK stack
Preferred Skills
- Experience deploying capabilities on the Databricks unified analytics platform.
- Experience using Elastic Map Reduce for big data workloads.
- Experience joining multiple complex data sets using Spark.
- Experience tuning Spark streaming and batch jobs for cluster utilization and speed.
- Experience deploying complex notebook-based pipelines.
- Experience with Python data analysis libraries such as Pandas.
- Experience using cloud services such as Lambda, SNS/SQS, or EC2.
- Experience with DevOps tools including Cloudwatch, Lambda, SQS, Dynamo, and RDS.
- Experience with Elastic, ElasticSearch/Logstash/Kibana (ELK stack).
Benefits
- Strong work-life balance and a people-first culture.
- Competitive compensation, plus Health/Dental/Vision coverage.
- 401(k) with company match.
- Up to $3,000 annually for training and certifications, and up to $3,000 for degree seeking programs.
Compensation and Location
Location: Virginia (onsite)
Salary: USD 160,000 - 210,000 per year
Clearance Requirements