Big Data Developer

Job description

Job Description

Big Data Developer

Position Description
CGI is looking for a talented, Big Data Developer with 5+ years of experience who has a passion for solving problems to join our team in Pittsburgh, PA.

At CGI, you get to do more than just sling code; you get to build solutions as a full time consultant with a world-class IT company. You will be involved in a mission critical project working with smart, dedicated people like yourself, and making an impact with both internal and client stakeholders. Tired of the same old thing? Take your talents to a company that inspires personal and professional growth and values your ideas.

Your future duties and responsibilities
• Programming in Scala to develop Custom Producer/Consumer for Near Real Time/Real Time.
• Building/fine tuning Spark Streaming Applications
• Process business rules to Spark/Hive SQL
• Batch Ingestion using Sqoop
• Working on NoSQL DB’s like HBase

Required qualifications to be successful in this role
• 4-5+ years of experience on Hadoop with good Programming experience in Scala.
• Streaming experience with Spark & Kafka integration is required.
• Experience in HIVE, HDFS, Hue, Sqoop, Kafka, SQL, Kerberos, flume, agile, python, data modelling
• Experience in continuous integration skills (DevOps, Jenkins, GIT, uDeploy, CA7, etc.)
• Creative ability to solve problems
• Excellent leadership skills and able to drive solution
• Willing to work and coordinate with offshore team for solution delivery
• Experience working in the banking domain highly desired

Education: BS in Computer Science, Software Engineering, related IT field or equivalent combination of experience and

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI at www.cgi.com .

No unsolicited agency referrals please.

CGI is an equal opportunity employer.

Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status, political affiliation, genetic information, or any other legally protected status or characteristics.

CGI provides reasonable accommodations to qualified individuals with disabilities. If you need an accommodation to apply for a job in the U.S., please email the CGI U.S. Employment Compliance mailbox at US_Employment_Compliance@cgi.com . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need an accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned .

We make it easy to translate military experience and skills! Click here to be directed to our site that is dedicated to veterans and transitioning service members.

All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation. Background investigation components can vary dependent upon specific assignment and/or level of US government security clearance held.

CGI will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with CGI’s legal duty to furnish information.

Skills

·  Hadoop Hive
·  Python

Reference

713613