NOT-NOT? Yes! : A visualization tool for an advanced search technique

Background: The objective of this program is an in-depth slides-based presentation of how the NOT-NOT device works, how to assess if the device is appropriate for a searcher's need, and guidance on how to use it. The presentation will serve as a reference tool that viewers can return to when they need to consider the NOT-NOT device. Used in systematic searching to reduce recall and improve specificity, NOT-NOT is effective at eliminating specific population groups without excluding desired groups that overlap. Although NOT-NOT has been explained in handouts and webinars, the device can be confusing. The NOT-NOT device employs a nuanced use of Boolean operators and concept nesting. Using it requires knowledge of searching, and a correct technical application.

Description: We have observed through conversation and within expert search focused training that many searchers struggle to understand the device. Furthermore, there is an unease about using the device when the training we receive advises against using NOT in comprehensive searching. The device is applied in very limited circumstances, primarily to exclude non-human studies or to target specific age groups. There could potentially be a much wider use of the device if it were better understood. Studies show that visualization enhances learning. In this project we combined visualization and a precise search example to illustrate the effectiveness of NOT-NOT and increase searchers’ confidence.

To deliver an effective presentation, we explored a number of approaches for describing the device and how it works. This work included testing several search strategies before selecting one that fit the criteria and would allow for a simple explanation. With the strategy in hand, we built a visualization including a diagram and a narrative legend (an infographic).

We are implementing the program by offering the training as a lightning talk to an audience of experienced literature searchers. We hypothesized that learning and confidence would be enhanced with the right visualization including a search and an infographic.

Conclusion: The infographic developed as a result of our project is meant to be a teaching tool. Our goal is to launch the tool as a presentation and deploy it after as a survey. The efficacy will be evaluated with a pre- and post-test measuring searchers’ level of comfort with and understanding of the NOT-NOT device, and reported when the survey is concluded.