SENIOR CONSULTANT (HADOOP SME)
Cyberjaya, Selangor Darul Ehsa, MY, 63000
The future is our choice
At Atos, as the global leader in secure and decarbonized digital, our purpose is to help design the future of the information space. Together we bring the diversity of our people’s skills and backgrounds to make the right choices with our clients, for our company and for our own futures.
Hadoop SME - Job Description
Responsibilities:
- Be the Hadoop Subject Matter Expert(Cloudera (V7.X) to engage with customers to provide technological solutions as well as operational improvement recommendations Hadoop infrastructure platforms & Hadoop eco-system incl. Linux & storage.
- Lead the teams on technical directions for the different Hadoop platforms that run 24x7 and support customer critical production operations.
- Major Incident support (service recovering & root cause troubleshooting) for Hadoop and Hadoop eco-system incl. Linux & storage related issues, including communications to senior management and customer.
- Required to get “hands-on” where needed and work along the technical team.
- Support the Hadoop Platform with the tools OOZIE, Apache Ni Fi, Java & Unix must knowledge!
- Well-versed knowledge on Network, Storage and API’s creation and debugging.
- Knowledge on supporting the applications on big data platform and Debugging knowledge of YARN
- Write/debug Python code for the designed frameworks.
- Control the Hadoop clusters with proper access controls and apply the security with the tools Ranger, Kerberos
- Coordinate with product vendors to setup/configure infrastructure, network, nodes.
- Write automation scripts for any alerts and monitoring dashboards from automation perspective with Python.
- Maintaining and troubleshooting the Environment with Ambari
- Integrate Solution knowledge between Hadoop and Reporting tools like Tableau, MicroStrategy, SAS, HDF
- Solutioning different Disaster Recovery approaches for Bigdata
- Tuning and scaling up clusters with several proposals
Skillset:
- Hadoop Hortonworks & Cloudera admin or support L2/L3 Knowledge
- Hive /HBase SQL Tuning for map reducer jobs
Shell/ Python Scripting - Certification Hadoop Administration
- Certification RedHat Linux Administration
- Cloudera Administrator Public and Private cloud
- mySQL/postgreSQL knowledge
- VMware Virtualization knowledge preferred.
- Knowledge on Pure and Isilon storage, S3 file systems is added advantage.
- Must be able to engage with technical people but also with semi-technical senior stakeholders and customer’s application teams.
Years of Experience:
8 to 12 years overall Experience and 5+ Years of Big data Engineering and Production support
Here at Atos, diversity and inclusion are embedded in our DNA. Read more about our commitment to a fair work environment for all.
Atos is a recognized leader in its industry across Environment, Social and Governance (ESG) criteria. Find out more on our CSR commitment.
Choose your future. Choose Atos.