- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Theses and Dissertations /
- Using transformers to predict customer satisfaction...
Open Collections
UBC Theses and Dissertations
UBC Theses and Dissertations
Using transformers to predict customer satisfaction for live chat dialogues : guiding applied natural language processing research in contact centres through design thinking Boutet, Patrick
Abstract
Contact centres are one of the most important channels by which many private and public organizations, such as retail brands, banks, airlines, and government departments, interact with millions of people every day. Customer satisfaction is the dominant quality metric that contact centres use for a wide variety of evaluative purposes such as helping inform customer experience, voice of customer reporting, agent service quality, or product and service improvements. Through a qualitative study with six contact centres and drawing on methods from the human-computer interaction field such as design thinking, interviews, and affinity diagrams, we identify several important tasks in contact centres that rely heavily on customer satisfaction scores. We form a collaborative research partnership with the contact centre at lululemon athletica inc., a large apparel retail organization, in order to gain access to a large unique corpus of customer service live chat dialogues and domain experts. Through this partnership, we collaboratively develop a solution to improve the measurement of customer satisfaction. We propose a solution that predicts customer satisfaction scores for live chats based on a supervised machine-learning approach. We treat predicting customer satisfaction scores for live chats as a single-label document classification task and utilize transformer models to achieve notable performance versus several other common document classification models. To the best of our knowledge, this is the first study that shows fine-tuned transformer models are very effective at predicting customer satisfaction for live chats, thus improve the measurement of customer satisfaction in contact centres.
Item Metadata
Title |
Using transformers to predict customer satisfaction for live chat dialogues : guiding applied natural language processing research in contact centres through design thinking
|
Creator | |
Supervisor | |
Publisher |
University of British Columbia
|
Date Issued |
2022
|
Description |
Contact centres are one of the most important channels by which many private and public organizations, such as retail brands, banks, airlines, and government departments, interact with millions of people every day. Customer satisfaction is the dominant quality metric that contact centres use for a wide variety of evaluative purposes such as helping inform customer experience, voice of customer reporting, agent service quality, or product and service improvements. Through a qualitative study with six contact centres and drawing on methods from the human-computer interaction field such as design thinking, interviews, and affinity diagrams, we identify several important tasks in contact centres that rely heavily on customer satisfaction scores. We form a collaborative research partnership with the contact centre at lululemon athletica inc., a large apparel retail organization, in order to gain access to a large unique corpus of customer service live chat dialogues and domain experts. Through this partnership, we collaboratively develop a solution to improve the measurement of customer satisfaction. We propose a solution that predicts customer satisfaction scores for live chats based on a supervised machine-learning approach. We treat predicting customer satisfaction scores for live chats as a single-label document classification task and utilize transformer models to achieve notable performance versus several other common document classification models. To the best of our knowledge, this is the first study that shows fine-tuned transformer models are very effective at predicting customer satisfaction for live chats, thus improve the measurement of customer satisfaction in contact centres.
|
Genre | |
Type | |
Language |
eng
|
Date Available |
2023-01-05
|
Provider |
Vancouver : University of British Columbia Library
|
Rights |
Attribution-NonCommercial-NoDerivatives 4.0 International
|
DOI |
10.14288/1.0422968
|
URI | |
Degree | |
Program | |
Affiliation | |
Degree Grantor |
University of British Columbia
|
Graduation Date |
2023-05
|
Campus | |
Scholarly Level |
Graduate
|
Rights URI | |
Aggregated Source Repository |
DSpace
|
Item Media
Item Citations and Data
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International