Big Data Engineer (Hadoop)

Job description

Description

PURPOSE:

Individual contributor responsible for supporting Big Data analytics within L Brands. Work closely with business partners to translate complex functional and technical requirements into high performing Big Data systems. Work on multiple projects as a technical lead to develop, test, and deliver Big Data solutions.

RESPONSIBILITIES:

• Conducts logical and physical database design
• Identifies unique opportunities to collect new data.
• Designs ETL processes and data pipeleines to build large, complex data sets.
• Strategizes new uses for data and its interaction with data design.
• Finds new uses for existing data sources.
• Conducts statistical modeling and experiment design.
• Discovers “stories” told by the data and presents them to business partners
• Tests and validates predictive models.
• Builds data visualization prototypes.
• Implements automated processes for efficiently producing scale models.
• Designs, modifies and builds new data processes.
• Implement, configure, administer, monitor Hadoop clusters
• Implements new or enhanced software designed to access and handle data more efficiently.
• Prepare and communicate status, issues, and opportunities to the business.
• Provides technical assistance to junior team members
• Create, refine and enforce data management standards, policies, and procedures.
• Evaluates emerging Big Data technologies to develops next-generation Big Data analytics framework
• Responsible for problem escalation to appropriate L Brands teams and third parties as appropriate.
• Provide 24x7 on-call support

AUTHORITY:

* Recommend expenditures as required to meet Big Data support requirements.
* Recommend the initiation of Big Data support activities and projects .
* Recommend Big Data standards/directions/technologies.

Qualifications

Required:
* 4 year degree in Information Systems or an equivalent combination of course work and job experience
* 4–6 years experience with Big Data technologies and analyitics

Desired:
• Experience with multiple Big Data systems/applications including:
o Hadoop (MapR preferred)
o Hive, MapR DB (HBase), MapR Streams (Kafka), Java, Pig, Java
o R/Python
o SQL
o Unix

Soft Skills:
• Ability to work on a team. This is extremely important to us.
• Be able to voice opinions, but also be able to listen to the other person’s point of view.
• Self Sufficient.
• Mentoring ability – Be able to mentor and coach.
• Communication skills very important.
An equal opportunity employer, we do not discriminate in hiring or terms and conditions of employment because of an individual’s race, color, religion, gender, gender identity, national origin, citizenship, age, disability, sexual orientation, marital status or any other protected category recognized by state, federal or local laws. We only hire individuals authorized for employment in the United States.