Implementing a knowledge management system for public health emergencies: insights from the WHO European Region COVID-19 response

The WHO/Europe KMS was designed and implemented to enhance information sharing and collaboration, and maintain situational awareness with the incident management team, document EURO's COVID-19 operations and lessons learned, and share evidence-based guidance to country operations.Within PHEM, Public Health Emergency Operation Centres (PHEOCs) or Emergency Operations Centres (EOC) are crucial for managing information, enabling multiagency coordination, and supporting emergency response activities (16). This KMS initiative became the backbone of WHO's Regional EOC platform, and the foundation of the EOC systems and products that are currently used across multiple emergencies by WHO EURO. Developing a KMS during a health emergency demands agility, collaboration, user-centered design and leadership buy-in.At WHO's Regional office, the implementation team built the KMS in real-time based on operational and strategic response needs. The design and functionality were identified through regular informal focus group discussions with the senior response leadership team, including the Regional Emergency Director and Regional IM. WHO's IMS structure comprised nine technical areas, all participated in the KMS focus groups. This iterative, inclusive approach fostered ownership and ensured the KMS remained relevant and responsiveoffering a model for future emergency responses.Initially, improvised tools such as Microsoft (MS) Teams, email inboxes, and SharePoint trackers were used. Over time, the KMS evolved to incorporate more structured tools to support PHEM. The development process for these tools is described in the following sections.The WHO's KMS relies on technology and digitization, accelerated by the COVID-19 pandemic's restrictions on physical interactions. The pandemic's early response highlighted the inadequacy of existing KMS, necessitating a redesign. WHO formed remote or hybrid teams, utilizing MS Teams and SharePoint for enhanced collaboration and information accessibility. This transition improved work processes, communication, and created a favorable environment for the development of a KMS to help gather information from various sources in a singular location. WHO leveraged these tools to facilitate remote collaboration and acquire data or information (19).During the peak of the COVID-19 response, information was vast and rapidly evolving. Critical information on the epidemiological situation, operations, and support requests were dispersed across multiple locations. With this increase in activity, a dedicated shared email inbox centralized all COVID-19 correspondence. This inbox used a color-coding system to indicate actions taken, enhancing efficiency in information management and timely task distribution. These measures helped to capture critical operational information and establish situational awareness.To capture additional information on ongoing response activities, Knowledge Management Focal Points (KMFPs) were appointed to each IMS technical area to collect data and information to better support response documentation.As the emergency intensified, the number of technical support operations and deployments across the region increased. Initially, reporting for these activities was compiled through a PowerPoint template, with technical areas providing weekly updates.However, the data collection system evolved to include various tools and standardized formats, transitioning from PowerPoint to a Microsoft Word reporting form with advanced features such as drop-down lists, calendars, and Excel macros. These forms captured granular operational data, including deployments and challenges, and later expanded to collect detailed information on activities, major achievements, and publications. The KMFPs, and WHO Country Office focal points were the main users involved in the systematized data collection process reporting weekly on the COVID-19 situation and response activities.In 2022, multiple emergencies emerged which impacted the WHO European Region simultaneously. To meet these emergency response needs, a versatile electronic reporting tool was developed, designed to be suitable for all-hazard scenarios including disease outbreaks, natural disasters, and population movements.ActivityInfo (19) software was adopted to further advance data management with automated data quality features, built-in validation, and custom data quality rules. Establishing data quality check systems, both manual and automated were critical in refining the acquired data. The software's audit trail features logged changes and tracked data quality over time, supporting data compliance and monitoring. The software was chosen for country-level reporting and integrated with MS tools at the regional level, replacing previously existing forms. Different health emergencies have varying data collection and reporting needs, based on response plans and donor funding. An assessment of the ActivityInfo electronic multiemergency reporting tool identified several advantages over MS Word and Excel macros previously used, including centralized data storage, improved data validation, enhanced collaboration, advanced reporting capabilities, robust security, and better data standardization.Throughout the KMS, the implementation of robust data governance processes ensured high quality and consistent data. This included establishing a shared understanding of the KMS through standardized definitions and SOPs, reviewing classification codes for accuracy, delineating KMFPs roles and responsibilities, deconflicting data reports, and defining data standards.Applying data mining strategies, particularly the application of classification codes for response activities was part of the knowledge refinement process. This involved developing a common set of metrics to code all response activities, identified through focus group discussions and internal analysis of ongoing support. These classification codes were applied by KMFPs allowing for consistent data collection and capturing of operations across different technical areas. These measures were instrumental in the systemization and development of the KMS, guaranteeing data quality, reliability, and usability.The KMS enhanced systematic knowledge documentation across the organization by storing all documents in a standardized set of folders. This approach facilitated easy knowledge retrieval and advanced resource searches. Implementing a standardized document filing system was a crucial part of the KMS, and its application across multiple emergencies ensured predictability and consistency in knowledge retrieval. Mapping information flows also helped to streamline the integration and retrieval of knowledge from various sources including emergency reporting tools and the shared inbox, which were then reflected in knowledgesharing products.The collected data was merged and saved in a data warehouse, allowing for efficient storage and management of refined knowledge received through ActivityInfo and other reporting forms. This setup enabled the development of dashboards that illustrated and quantified WHO support to Member States.Business intelligence tools played a key role in understanding organizational performance during the COVID-19 response by providing a quantitative overview of operations and data visualization. Creating dashboards to showcase WHO support to Member States required extensive consultations to determine visualization and design needs. The final dashboard retrieved data from various response areas, enabling self-service reporting and in-depth analysis (20). This enhanced real-time reporting, decision-making, and overall organizational performance.The shared inbox proved successful in triaging and managing information. The next step was to create a dynamic knowledge-sharing tool. Initially, a MS Teams channel served as a virtual support team, providing daily updates, addressing FAQs, and sharing resources with WHO offices in the Region. Launched at the pandemic's start, this channel evolved into tools like a daily newsletter sent from the shared inbox.This "Daily Digest" newsletter curated critical new resources, including guidance documents, epidemiological data, talking points, and other essential information for WHO Country Offices and response teams. This reliable resource mitigated information overload amid the daily influx of new research, data, and misinformation.In early 2021, weekly KMFP meetings were initiated to enhance knowledge distribution processes. These meetings fostered an internal community of practice, promoting trust, inclusiveness, and collaboration among participants. They addressed various aspects of knowledge sharing, including data quality issues and potential improvements, and facilitated the dissemination of experiences, lessons learned, and innovative ideas. Governance processes were formalized with co-designed terms of reference, standard meeting agendas, and regular action points, ensuring the KMFP group remained focused and effective in distributing knowledge across the organization.The KMS facilitated the consolidation and presentation of information that demonstrated how the WHO/Europe Regional Office supported Member States during the COVID-19 pandemic and other emergencies. Using standardized templates and consistent branding, particularly for COVID-19-related products, the system enabled systematic and recognizable knowledge sharing, contributing to greater transparency and trust. This structure supported real-time decision-making and provided leadership with a comprehensive understanding of organizational performance. It established a common operational picture that enhanced the effectiveness of emergency response efforts. Although primarily designed for internal WHO leadership, the KMS was also accessible and utilized by personnel at both Regional and country levels.The implementation of the KMS standardized documentation processes and improved situational awareness for leadership. It informed key outputs such as response timelines (21), regional reports (22), donor reports, and operational reviews. These outputs drew upon knowledge stored in the data warehouse, documenting response activities and facilitating knowledge exchange both within WHO and with external stakeholders. Furthermore, the system improved the efficiency of information flow throughout the organization. It reduced reporting burdens, expedited information retrieval, ensured timely data provision, and effectively visualized WHO/Europe's emergency response. By providing a centralized platform for data storage and knowledge sharing, the KMS strengthened the documentation of health emergency responses at both country and regional levels.The effectiveness of the KMS can be evaluated through key metrics, including user satisfaction, knowledge utilization, and continuous improvement (23). This demonstrates that the KMS was well-integrated within the organization, aligned with organizational needs and effectively supports PHEM. The COVID-19 response led to significant organizational changes at WHO, empowering the emergency operations team to expand these systems. Knowledge utilization metrics showed that the COVID-19 SharePoint was visited by response team members 448,499 times, with 867 unique views, indicating high usage rates and integration into daily workflows.The COVID-19 emergency fostered team resilience, motivation, innovation, and adaptability within the KM team. The implementation team had a low turnover rate compared to the KMFPs, preventing disruptions in development. The core team consistently operated through various emergencies, gaining experience, refining processes, and collaborating closely from 2020 -2024.Regular KMFP meetings fostered an inclusive environment for co-created knowledge, focusing on the end user. These forums leveraged internal knowledge from individuals with diverse expertise, promoting ownership and integrating the process within the organization.A user satisfaction survey conducted in September 2023, following the conclusion of the acute phase of the COVID-19 response, indicated high levels of comfort with the digital reporting tools among all respondents, several years after their initial rollout. Furthermore, 80% of participants reported feeling adequately trained, well supported by the KM implementation team, and clear about their responsibilities within the KMFP terms of reference.Although most of the KMS was designed and implemented while actively responding to emergencies across the WHO European Region (Figure 1) it was ultimately aligned with the KMS ISO requirements (17). The iterative development of the KMS prioritized user needs, allowing for continuous improvement through regular monitoring and adjustments based on feedback and performance data. This approach maintained alignment with organizational objectives. Although most of the KMS was designed and implemented while actively responding to emergencies across the WHO European Region (Figure 1) it was ultimately aligned with the KMS ISO requirements (17).High risk tolerance within the team and supported by WHO leadership enabled innovation, which in turn supported regular testing and adaptation via prototypes, collaborative ideation, mentoring, and agile methods to meet various informational needs. This culture of continuous improvement is exemplified by the number of response dashboard designs and the quality of the reporting products that were implemented and improved on between 2020 -2024.In responding to the conflict in Ukraine, the KMS was stress tested and the differing nature of activities and emergencies (armed conflict vs. infectious disease) revealed new areas for design and development of the KMS. This process was another learning opportunity as a separate emergency response team was established for WHO's response to the Ukraine Conflict, which created a parallel KMS within the Regional office. Having two separate KMS fragmented the developing KM culture, which created additional challenges, but also provided valuable lessons for strengthening the system amid multiple public health crises. The development and implementation of a single online tool for multi-emergency data collection significantly improved the KMS ability to simultaneously address emergencies of all -hazard.The WHO Regional Office for Europe learned several valuable lessons throughout the COVID-19 pandemic regarding the development and implementation of a single multi-emergency reporting system. These lessons underscore the importance of standardization, consistency, adaptability, and collaboration in managing complex global health emergencies.Ensure that user friendly digital tools are not only established but also consistently utilized, with response teams proficient in using a fundamental set of tools (24). The foundation of the system design is based on the existing software platform and ensures easy integration and reduces the use of new tools. This centralizes information in one place and improved uptake of the KMS.Develop online multi-emergency data collection forms to standardize information gathering, implement data governance processes and ensure high-quality data. This can streamline reporting across different types of emergencies.Apply standardized classification codes for all hazards, to enable crosscutting indicators and visualizations that use data from various emergency types. Carefully considering the addition of new classification codes before inclusion can improve visualization quality (25).Build a team that can lead the design and implementation throughout the lifecycle of the KMS development. Reducing turnover promotes trust, collaboration and psychological safety within the team, helping the team to focus on the tasks at hand and overcome implementation challenges together.Strong leadership, with an appetite for innovation is essential for receiving buy-in, user feedback and design input from all stakeholders (26). The leaders strong understanding of the process, functionality and uses of KMS helped to empower the design team and ensure the necessary engagement within the response team.Develop and implement SOPs, define roles and responsibilities, and conduct regular training sessions to ensure strong governance processes and support for tool deployment. This ensures consistency in reporting practices and enhances overall KMS efficiency.Establish a co-designed community of practice to implement the KMS on a larger scale. This approach fosters knowledge sharing, collaboration, and supports knowledge translation among users, ensuring that the community meets members' expectations and facilitates practical applications to address organizational challenges (27). Co-design supports culture change and the embedding of the KMS into the teams' workflows.Implement a single, consistent channel for disseminating emergency-related information and knowledge to minimize search time and mitigate information overload.WHO's Emergency Response Framework (28) and its IMS specifically relies on the functionality of an emergency operations centre, where the PHEOC is a central location for the coordination of information and resources to support incident management activities, across a variety of event types (16).The extent of the Regional EOC in early 2020 (prior to COVID-19) was a meeting room, with limited teleconferencing functionality and no dedicated EOC staff, KMS or standardised procedures in place. The EOC's watch and alert mode was covered by the health information team, which was separate from the operational response capacity, and predominantly driven by the International Health Regulations (IHR 2005) health information and signal detection requirements (29).The key components that make a PHEOC functional, as documented in the WHO PHEOC framework (30) and handbooks, are plans and procedures, physical infrastructure, information communication technology (ICT) infrastructure, information systems and data, as well as human resources (31). The PHEOC framework defines three types of information required for decision-making. These are incident-specific information, event information, and contextual information (30).As the COVID-19 emerged, so did the need to support the IMT with appropriate clear KM processes, procedures, and information the IMS capacity, a group was to support the regional incident This established and maintained a regional platform, with the KM systems and tools to key operational information to the regional response team and senior WHO WHO is a organization, exemplified by the of both a comprehensive KM operational and KM WHO had not implemented the of KM for emergency response within the WHO/Europe Health and particularly not to the during the COVID-19 response. the of the EOC and KMS reflected the low number of emergencies a WHO operational response to WHO/Europe leadership team, significant in their response capabilities, demonstrated by the of KM and EOC the of the physical EOC and through the continuous support for this area of The WHO/Europe EOC as an established platform for the Health Emergency It is set as a hybrid it can for both remote users and for the team based in the dedicated EOC EOC systems are and information is to WHO for and information development and of the KMS, during COVID-19 and refined in emergencies, helped to establish an all-hazard Regional that during all of the emergency management in both online communication tools and intelligence new that were not at the time of the initial KMS The integration of into KMS for public health emergency facilitates the development of tools that can be into existing work used to to By and manual reduces among users and enhances operational It can also data governance processes, ensuring data quality and consistency, which is critical in emergency can support the design and implementation of KMS, particularly in with limited or technical expertise, and that KM processes significantly improve and across diverse organizational can further enhance operational KM by enabling retrieval and of knowledge, supporting informed decision-making during an the use of within SharePoint like used at are a application for enhancing knowledge retrieval. By these users can search and relevant information from vast document and data By the users can responses based on the structured and knowledge WHO, this helped to information during emergencies these as a for more and effective KMS in public health emergencies. the application of tools in public health emergencies to data and This is particularly critical to the and nature of information during through email and within data include health operational strategies, or other information lead to or the KMS process, KM was with health information management or information This the need for change KM as a approach that process and technology to knowledge sharing and KMS was in time during an established monitoring and systems. a data to its efficiency and system relies on data input across the response teams, including country incident management teams. by teams and technical staff, with turnover was a that required regular and the integration of the KMS into all response team the unique culture of the WHO/Europe Regional Emergency which to flow from of the to senior with appropriate risk to This the of this approach to other The systems, and processes are of WHO/Europe and need adaptation implemented it is that the WHO KMS is not a but dynamic and continuous which be the for most emergency as an and improvised evolved into a system within the WHO Europe Regional organization is demonstrated that a strong KMS can make a for emergency teams that high levels of coordination, collaboration, and information The KMS and appropriate tools to support all levels of the incident management emergencies to technology and implement innovation, the governance WHO Emergency Response and processes in place are as as new technology from the WHO/Europe include establishing a KM and system before an it from the of response, and to continuous This the implementation of governance processes that ensure the system is part of regular and for for the of a KMS, is a KM culture in a community of practice, supported by leadership and resources Knowledge management systems be established as a key of emergency considering a Health response that coordination and information Having a KMS can be a for emergency management system and can be to a in and emergency response information management in are new tools and applications that need to be and designed and integrated into the KMS. KM for consistent use in emergency and systematic documentation of lessons learned be these and innovative tools help ensure more and public health emergency a of additional is in the application of KMS for PHEM. including a of and of KM to health emergencies from or other complex scenarios these through further and documentation is essential for evidence-based practices in public health WHO/Europe response team by a KMS, which improved the and predictability of WHO's Regional The of this is to emergency response systems and support PHEOC teams. WHO/Europe to for and the application of KMS to enhance emergency coordination and response.