Big Data Engineer – $120-160K Plus 10% Bonus

ACCsurance, LLC; United States; On-site; USD 120,000 - 150,000; Full time

Job summary

A technology solutions company in the United States is seeking an experienced lead developer to guide technical teams in application development using modern tools and agile methods. The candidate must have a master's degree and extensive experience (7-10 years) in software development, especially with a focus on Continuous Integration and Agile methodologies. Responsibilities include mentoring staff, overseeing deployments, and ensuring adherence to design standards. Knowledge of big data tools and programming languages is essential.

Qualifications

• 7-10 years of related experience in software development.
• Highly experienced with Agile practices/methodologies.
• Specialized training in specific platforms, enterprise or development tools.

Responsibilities

• Lead development teams in determining unit needs and business processes.
• Mentor or provide technical guidance to less experienced staff.
• Develop, modify, or update applications for business and infrastructure.

Skills

Continuous integration tools expertise

Analytic skills for unstructured datasets

Experience in agile practices

Expert proficiency in Object Oriented Design

Expert proficiency in application of non-functional software qualities

Expert proficiency in advanced behavior-driven testing techniques

Education

Master or Other Advanced Degree in Business or Computer Science

Tools

Jenkins

VM Ware

Docker

Hadoop

Spark

Job description

JOB DESCRIPTION:

Use modern tools, techniques, and methods to develop, modify, or update applications used by business units or infrastructure units. Lead, or play lead technical role in development teams’ efforts to determine unit needs and business processes that are automated by the application. Assess high level design issues relating to platform, enterprise software, and interactions with other systems.

KEY JOB FUNCTIONS:

• Support the team in the writing of deployment scripts and place strong emphasis in automated deployment, infrastructure automation solutions, and continuous delivery process.
• Work with product owners and other development team members to determine new features and user stories needed in large/complex development projects
• Create or Update documentation in support of development efforts. Documents may include detailed specifications, implementation guides, architecture diagrams or design documents.
• Participate in code reviews with peers and managers to ensure that each increment adheres to original vision as described in the user story and all standard resource libraries and architecture patterns as appropriate.
• Respond to trouble/support calls for applications in production in order to make quick repair to keep application in production.
• Serve as a technical lead for an Agile team and actively participate in all Agile ceremonies.
• Participate in all team ceremonies including planning, grooming, product demonstration and team retrospectives
• Mentor or provide technical guidance to less experienced staff; may use high end development tools to assist or facilitate development process.
• Leverage Fortune 500 Client DevOps tool stack to build, inspect, deploy, test and promote new or updated features.
• May serve as technical lead, architect, project lead or principle developer in course of large or complex project.
• Expert proficiency in unit testing as well as coding in 1-2 languages (e.g. Java, etc).
• Expert proficiency in Object Oriented Design (OOD) and analysis.
• Expert proficiency in application of analysis/design engineering functions.
• Expert proficiency in application of non-functional software qualities such as resiliency, maintainability, etc.
• Expert proficiency in advanced behavior-driven testing techniques.
• Provide expertise for teams in all matters related to deployment, building and release process.

QUALIFICATIONS:

Master or Other Advanced Degree

Area of Study Preferred

Business or Computer Science

Certifications Preferred

Specialized training in specific platforms, enterprise or development tools

• 7-10 years of related experience; Highly experienced with Agile practices/methodologies (e.g. Scrum, TDD, BDD, etc).

Specialized Knowledge and Skills

• Highly experienced in the use continuous integration tools (e.g. Jenkins, Hudson, etc) and infrastructure automation (VM Ware, Puppet, Chef, Vagrant, Docker, etc).
• Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
• Strong analytic skills related to working with unstructured datasets
• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Build the infrastructure required to process data from a variety of data sources using SQL.
• Create data tools for analytics and data scientists to optimize data
• Experience working with either a Map Reduce or an MPP system on any size/scale
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• 5+ years of Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, et

Preferred Skills:

• SQL experience and No-SQL experience is a plus