Open Collections

An Empirical Study of Interest, Task Complexity, and Search Behaviour on User Engagement

Elsevier

User engagement has become an important outcome measure in interactive information retrieval (IIR) research, as commercial (e.g., search engines and e-commerce companies), and educational (e.g., libraries) enterprises focus on capturing and retaining customers. User engagement pertains to the kind of investment – emotional, cognitive, behavioural – the user is willing to make in an application. While research has shown how characteristics of users (e.g., individual differences and preferences) and the systems and content with which they interact influence engagement, less is understood about how the tasks people perform using digital applications affect their engagement. Drawing upon a wealth of literature in IIR, this study examined the effects of task on search engagement in a within-subjects Amazon Mechanical Turk (MTurk) experiment. Participants completed six search tasks on different task topics using task versions that included or excluded items and dimensions in the task descriptions. Items refer to things being compared (alternatives) and dimensions correspond to attributes by which items may differ. The task topics were meant to influence user interest in the task, and the versions were intended to manipulate the task doer’s degree of certainty as they planned and performed the task, with the expectation that these factors would affect their self-reported engagement. We captured self-reported task perceptions (e.g., complexity, difficulty, interest) and logged search behaviours (e.g., querying, bookmarking) to both validate our manipulations and to understand how these variables related to engagement. Using multi-level modelling (MLM) we discovered that task topic affected user engagement, whereas task version had limited effects. However, participants’ perceptions of the tasks as interesting, difficult, and so on affected their engagement. Through the self-report and behavioural data, we observed that effort (more search engine results page exploration, greater perceived task difficulty) had a negative effect on engagement, while bookmarking pages and the ability to understand the task and how to complete it was associated with positive engagement. These results have implications for designing search tasks, deciphering the relationship between user experience and task complexity in IIR experiments, and aligning self-reports and search behaviours in evaluating online search engagement.

Article; Preprint

eng

Vancouver : University of British Columbia Library

10.14288/1.0398531

Arts, Faculty of; Non UBC; iSchool (Library, Archival and Information Studies)

10.1016/j.ipm.2020.102226

Faculty

DSpace