Big Data Engineer

Job description

Do you have a passion for learning and applying modern software engineering practices to help solve business problems or bring new insight? If so, we are looking for energetic team members to join our agile squad in New York city.

Job Duties:
We are looking for someone to develop a modern, cloud based solution for a strategic initiative that enables IBM to more effectively and efficiently make business decisions based using your solution. Your team's responsibility will be to create the working foundation of infrastructure and architecture design of the large scale, big data solution. This will include the development of the prototype through to a full operational system that many different teams (including yours) perform development within.

The key experiences required include Apache SPARK, Apache Kafka, Python, and Parquet formats. Also, significant experience using ETL (extract, transform, and load tools) not mentioned are needed. Experience with Scala is also a nice to have.

You will also be responsible for selecting and using the DevOps tools for continuous integration, builds, and monitoring of the solutions. You will join and exciting team, in an open landscaped, collaborative environment using agile delivery methods. Any experience in converting legacy ETL into the newer technologies is highly valued as well.

Above all, we are looking for applicants who will thrive in an open, energetic, flexible, fun-spirited, collaborative environment and desire creative freedom and an opportunity to work on high performing teams!

No remote opportunities exist

Must have the ability to work in the US without current/future need for IBM sponsorship

Experience in Jasmine/Karma or a similar unit/functional testing framework.
Experience in Test Driven Development (TDD)
Experience in Automated Testing
Experience with Data Science / Data Analyst and their associated tools.

Auto req ID

255134BR
Required Education

Bachelor's Degree
Role ( Job Role )

Software Developer
State / Province

NEW YORK
Primary job category

Software Development & Support
Company

(0147) International Business Machines Corporation
Contract type

Regular
Employment Type

Full-Time
ERBP

Yes
Is this role a commissionable/sales incentive based position?

No
Travel Required

No Travel
IBM Business Group

F&O
Preferred Education

Master's Degree
City / Township / Village

NEW YORK
Being You @ IBM

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Required Technical and Professional Expertise

·  1 year professional experience using Apache Spark and Kafka
·  2 years professional experience using Python
·  1 year professional experience using Parquet formats
·  2 years professional experience using ETL (extract, transform, and load) tools.
·  1 plus year of Cloud base architecture (for example: IBM Cloud or AWS development)
·  Demonstrated experience to work as part of an Agile team as a strong team playe
Country/Region

United States
Preferred Technical and Professional Experience

·  2 plus years in Full-stack development experience (Apache Spark, Python), with a stronger need for backend experience.
·  2 plus years of advanced practice of Agile development methodologies.
·  2 plus years of experience in DevOps (for example: Jenkins, Travis CI, UrbanCode Deploy, Nagios)
Secondary Job Category

Other Software Development & Support
Eligibility Requirements

·  US Sponsorship
Position Type

Professional
Early Professional Track

Not Applicable - Professional Hire
Location Statement

For additional information about location requirements, please discuss with the recruiter following submission of your application.
Introduction

Software Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the blink of an eye and the world remains safe because of the work our software developers do. Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide. At IBM, you will use the latest software development tools, techniques and approaches and work with leading minds in the industry to build solutions you can be proud of.
Your Life @ IBM

What matters to you when you're looking for your next career challenge?

Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible.

Impact. Inclusion. Infinite Experiences. Do your best work ever.
About Business Unit

The IBM Finance organization is responsible for driving enterprise performance and transformation. We are the financial stewards of IBM, delivering IBM's financial strategy, developing new business models, and mitigating enterprise risk. Do you have a passion for creating business value? Join our team in accounting, financial planning, pricing, business controls, tax, treasury, business development (acquisitions & divestitures), and global financing.
About IBM

IBM's greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries.