- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Faculty Research and Publications /
- An Empirical Study of Interest, Task Complexity, and...
Open Collections
UBC Faculty Research and Publications
An Empirical Study of Interest, Task Complexity, and Search Behaviour on User Engagement O'Brien, Heather, 1977-; Arguello, Jaime; Capra, Rob
Abstract
User engagement has become an important outcome measure in interactive information retrieval (IIR) research, as commercial (e.g., search engines and e-commerce companies), and educational (e.g., libraries) enterprises focus on capturing and retaining customers. User engagement pertains to the kind of investment – emotional, cognitive, behavioural – the user is willing to make in an application. While research has shown how characteristics of users (e.g., individual differences and preferences) and the systems and content with which they interact influence engagement, less is understood about how the tasks people perform using digital applications affect their engagement. Drawing upon a wealth of literature in IIR, this study examined the effects of task on search engagement in a within-subjects Amazon Mechanical Turk (MTurk) experiment. Participants completed six search tasks on different task topics using task versions that included or excluded items and dimensions in the task descriptions. Items refer to things being compared (alternatives) and dimensions correspond to attributes by which items may differ. The task topics were meant to influence user interest in the task, and the versions were intended to manipulate the task doer’s degree of certainty as they planned and performed the task, with the expectation that these factors would affect their self-reported engagement. We captured self-reported task perceptions (e.g., complexity, difficulty, interest) and logged search behaviours (e.g., querying, bookmarking) to both validate our manipulations and to understand how these variables related to engagement. Using multi-level modelling (MLM) we discovered that task topic affected user engagement, whereas task version had limited effects. However, participants’ perceptions of the tasks as interesting, difficult, and so on affected their engagement. Through the self-report and behavioural data, we observed that effort (more search engine results page exploration, greater perceived task difficulty) had a negative effect on engagement, while bookmarking pages and the ability to understand the task and how to complete it was associated with positive engagement. These results have implications for designing search tasks, deciphering the relationship between user experience and task complexity in IIR experiments, and aligning self-reports and search behaviours in evaluating online search engagement.
Item Metadata
Title |
An Empirical Study of Interest, Task Complexity, and Search Behaviour on User Engagement
|
Creator | |
Publisher |
Elsevier
|
Date Issued |
2020-02-21
|
Description |
User engagement has become an important outcome measure in interactive information retrieval (IIR) research, as commercial (e.g., search engines and e-commerce companies), and educational (e.g., libraries) enterprises focus on capturing and retaining customers. User engagement pertains to the kind of investment – emotional, cognitive, behavioural – the user is willing to make in an application. While research has shown how characteristics of users (e.g., individual differences and preferences) and the systems and content with which they interact influence engagement, less is understood about how the tasks people perform using digital applications affect their engagement. Drawing upon a wealth of literature in IIR, this study examined the effects of task on search engagement in a within-subjects Amazon Mechanical Turk (MTurk) experiment. Participants completed six search tasks on different task topics using task versions that included or excluded items and dimensions in the task descriptions. Items refer to things being compared (alternatives) and dimensions correspond to attributes by which items may differ. The task topics were meant to influence user interest in the task, and the versions were intended to manipulate the task doer’s degree of certainty as they planned and performed the task, with the expectation that these factors would affect their self-reported engagement. We captured self-reported task perceptions (e.g., complexity, difficulty, interest) and logged search behaviours (e.g., querying, bookmarking) to both validate our manipulations and to understand how these variables related to engagement. Using multi-level modelling (MLM) we discovered that task topic affected user engagement, whereas task version had limited effects. However, participants’ perceptions of the tasks as interesting, difficult, and so on affected their engagement. Through the self-report and behavioural data, we observed that effort (more search engine results page exploration, greater perceived task difficulty) had a negative effect on engagement, while bookmarking pages and the ability to understand the task and how to complete it was associated with positive engagement. These results have implications for designing search tasks, deciphering the relationship between user experience and task complexity in IIR experiments, and aligning self-reports and search behaviours in evaluating online search engagement.
|
Subject | |
Genre | |
Type | |
Language |
eng
|
Date Available |
2022-02-21
|
Provider |
Vancouver : University of British Columbia Library
|
Rights |
Attribution-NonCommercial-NoDerivatives 4.0 International
|
DOI |
10.14288/1.0398531
|
URI | |
Affiliation | |
Citation |
O'Brien, H. L., Arguello, J., & Capra, R. (2020). An empirical study of interest, task complexity, and search behaviour on user engagement. Information Processing & Management, 57(3), 102226
|
Publisher DOI |
10.1016/j.ipm.2020.102226
|
Peer Review Status |
Reviewed
|
Scholarly Level |
Faculty
|
Rights URI | |
Aggregated Source Repository |
DSpace
|
Item Media
Item Citations and Data
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International