Share this Job

Lead Platform Engineer

Publication Date:  Jan 24, 2023
Ref. No:  403915

Birmingham, GB, B37 7YQ

As a Disability Confident employer, our aim is to ensure that disabled applicants who meet the minimum criteria for this position will be offered an interview. 
The data is only used for the purpose of providing additional support at interview.
If this is applicable to you, please ensure you answer “Yes” to the question regarding disability included in the application form for our awareness.


Role and responsibilities:
•    Manage FCAPS scenarios in production environment
•    Track and manage platform tickets to meet SLA requirements.
•    Monitor and manage cluster capacity based on customer count, events per second Perform Hadoop administration tasks
•    Guide platform engineers to fix day-to-day Operational issues.
•    Setup and manage HDP Platform, handling all Hadoop environment builds, performance tuning and ongoing monitoring.
•    Develop scripts/ tools to automate platform maintenance activities
•    Work with sustenance engineering on emergency fixes
•    Debug day to day job issues in Hadoop platform and provide solutions. 
•    Perform software release management tasks
•    Health monitoring of multiple HDP clusters using centralized dashboards, for Hadoop services, overall server health, custom applications running on the cluster
•    Troubleshoot Log collection and ingestion via Apache NiFi to our MDR platform from various network devices (like Firewall, Switches, Router, Proxy, IPS, WAF, etc..), servers, and Cloud resources.
•    Coordinate with Network, Infrastructure, and other organizations as required
•    Perform root cause analysis on failed components and implements corrective measures
•    Configuration of high level and low level HDP parameters to fine tune performance of the cluster
•    Manage escalations on FCAPS issues

Required skills and experience:
•    Experience in design and operationalizing FCAPS (Fault, Configuration, Availability, Performance, Security) for Hadoop clusters
•    Experience in design of automated Hadoop installation
•    Deep Expertise in managing Hadoop ecosystem components in large production clusters.
•    Expertise in HDP platform/Cloudera
•    Application Deployment using JAVA & Python APIs
•    Good Scripting knowledge in Bash, Python, Anaconda, Ansible
•    Knowledge of Automation/ DevOps Tools Github, Jenkins, Docker, Kubernetes
•    Data Ingestion, Data Access & Data storage using Hadoop Big Data tools like HBase, Flume, Kafka, Nifi, ElasticSearch
•    Good hands-on experience of Linux, its commands and scripting are a must.
•    General operational excellence. This includes good troubleshooting skills, understanding of system’s capacity and bottlenecks, memory management, performance tuning and optimization for Linux and Hadoop.
•    Configuration management and deployment exposure in Open-source environment.
•    Knowledge of Kerberos and Apache Ranger for configuring security
•    Excellent communication skills.
•    Critical thinker and good problem-solver.
•    Ability to work independently with a strong attention to detail


Desirable skills and experience:
•    Exposure and experience of Azure administration
•    Knowledge of Core Java.
•    Ability to work well in a global team environment
•    Able to manage time and prioritise workload
•    UK Security Clearance or eligibility and willingness to obtain security clearance to SC level as required by specific projects
•    Ability to achieve Office of Nuclear Regulation clearance (currently requires UK Born Citizen/UK National)


Our offering:

•    Attractive salary
•    25 days of Annual leave + an option to purchase more through our Flexible Benefits
•    Flex benefits system – exciting opportunity to choose your own benefits
•    Retail discounts
•    Pension - matching contribution up to 10%
•    Private Medical Scheme
•    Life Assurance
•    Enrolment in our Share scheme - subject to scheme eligibility criteria
•    Unlimited opportunities to learn in our Training platforms

If you want to find out more or have questions, contact our recruiter Diana Mihaylova | LinkedIn