File Download
Supplementary
-
Citations:
- Appears in Collections:
postgraduate thesis: Enhancing recommender systems : a comprehensive study from effectivenss to fairness
Title | Enhancing recommender systems : a comprehensive study from effectivenss to fairness |
---|---|
Authors | |
Issue Date | 2024 |
Publisher | The University of Hong Kong (Pokfulam, Hong Kong) |
Citation | Ning, W. [宁文韜]. (2024). Enhancing recommender systems : a comprehensive study from effectivenss to fairness. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. |
Abstract | In the age of information overload, recommender systems play a crucial role in helping users discover relevant and personalized content in various areas, such as e-commerce, entertainment, and social media. In this thesis, we study how to improve the effectiveness and fairness of existing recommender systems. Specifically, we propose new techniques for the effectiveness of meta-path-based and multi-domain recommendations. Furthermore, we propose a new framework to handle the popularity bias issue to improve the fairness of recommender systems.
First, we investigate meta-path-based recommender systems (MPRs) and how to automatically find effective meta-paths as input to these MPRs. We observe that the performance of MPRs is highly sensitive to the meta-paths they use, but existing works manually select the meta-paths from many possible ones. Thus, we propose the Reinforcement learning-based Meta-path Selection (RMS) framework to discover effective meta-paths automatically. We also propose a new MPR called RMS- HRec, which uses an attention mechanism to aggregate information from the meta-paths. We conduct extensive experiments on real datasets. Compared with the manually selected meta-paths, the meta-paths identified by RMS consistently improve recommendation quality, and RMS-HRec outperforms state-of-the-art recommender systems in terms of recommendation accuracy.
Second, we study how to conduct more effective multi-domain rec- recommendation (MDR). We find that existing MDR models are difficult to disentangle knowledge that generalizes across domains (e.g., a user likes cheap items) and knowledge specific to a single domain (e.g., a user likes blue clothing but not blue cars) due to their model-level disentangling mechanism. Therefore, we propose an embedding disentangling recommender focusing on disentangling at the embedding level. We also find that existing MDR methods have limited ability to transfer knowledge across domains with small overlaps, so we propose a random walk-based domain alignment strategy to identify similar users/items from different domains, which further helps knowledge sharing. Extensive experiments show that our method consistently outperforms the baselines on all datasets and domains.
Finally, we focus on the popularity bias issue in recommender systems, which is important to the fairness of recommendations. Popularity bias is the phenomenon that popular items are recommended much more frequently than they should be. This goes against the goal of providing personalized recommendations and harms user experience and recommendation accuracy. Therefore, we aim to increase the personalization of recommendations to handle it. We find that existing debiasing methods overlook that popularity is defined in a "global" manner (thus, we call it global popularity (GP) in this thesis), which is defined as the proportion of all users who have interacted with the item. Hence, we propose "Personal popularity" (PP), which considers the interests of individual users. Furthermore, we propose the Personal Popularity Aware Counterfactual (PPAC) framework that integrates PP and GP to handle popularity bias. Experiment results show that our method can effectively reduce the recommendations of popular items, enhancing the fairness of recommendations. |
Degree | Doctor of Philosophy |
Subject | Recommender systems (Information filtering) |
Dept/Program | Computer Science |
Persistent Identifier | http://hdl.handle.net/10722/350305 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Ning, Wentao | - |
dc.contributor.author | 宁文韜 | - |
dc.date.accessioned | 2024-10-23T09:46:03Z | - |
dc.date.available | 2024-10-23T09:46:03Z | - |
dc.date.issued | 2024 | - |
dc.identifier.citation | Ning, W. [宁文韜]. (2024). Enhancing recommender systems : a comprehensive study from effectivenss to fairness. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. | - |
dc.identifier.uri | http://hdl.handle.net/10722/350305 | - |
dc.description.abstract | In the age of information overload, recommender systems play a crucial role in helping users discover relevant and personalized content in various areas, such as e-commerce, entertainment, and social media. In this thesis, we study how to improve the effectiveness and fairness of existing recommender systems. Specifically, we propose new techniques for the effectiveness of meta-path-based and multi-domain recommendations. Furthermore, we propose a new framework to handle the popularity bias issue to improve the fairness of recommender systems. First, we investigate meta-path-based recommender systems (MPRs) and how to automatically find effective meta-paths as input to these MPRs. We observe that the performance of MPRs is highly sensitive to the meta-paths they use, but existing works manually select the meta-paths from many possible ones. Thus, we propose the Reinforcement learning-based Meta-path Selection (RMS) framework to discover effective meta-paths automatically. We also propose a new MPR called RMS- HRec, which uses an attention mechanism to aggregate information from the meta-paths. We conduct extensive experiments on real datasets. Compared with the manually selected meta-paths, the meta-paths identified by RMS consistently improve recommendation quality, and RMS-HRec outperforms state-of-the-art recommender systems in terms of recommendation accuracy. Second, we study how to conduct more effective multi-domain rec- recommendation (MDR). We find that existing MDR models are difficult to disentangle knowledge that generalizes across domains (e.g., a user likes cheap items) and knowledge specific to a single domain (e.g., a user likes blue clothing but not blue cars) due to their model-level disentangling mechanism. Therefore, we propose an embedding disentangling recommender focusing on disentangling at the embedding level. We also find that existing MDR methods have limited ability to transfer knowledge across domains with small overlaps, so we propose a random walk-based domain alignment strategy to identify similar users/items from different domains, which further helps knowledge sharing. Extensive experiments show that our method consistently outperforms the baselines on all datasets and domains. Finally, we focus on the popularity bias issue in recommender systems, which is important to the fairness of recommendations. Popularity bias is the phenomenon that popular items are recommended much more frequently than they should be. This goes against the goal of providing personalized recommendations and harms user experience and recommendation accuracy. Therefore, we aim to increase the personalization of recommendations to handle it. We find that existing debiasing methods overlook that popularity is defined in a "global" manner (thus, we call it global popularity (GP) in this thesis), which is defined as the proportion of all users who have interacted with the item. Hence, we propose "Personal popularity" (PP), which considers the interests of individual users. Furthermore, we propose the Personal Popularity Aware Counterfactual (PPAC) framework that integrates PP and GP to handle popularity bias. Experiment results show that our method can effectively reduce the recommendations of popular items, enhancing the fairness of recommendations. | - |
dc.language | eng | - |
dc.publisher | The University of Hong Kong (Pokfulam, Hong Kong) | - |
dc.relation.ispartof | HKU Theses Online (HKUTO) | - |
dc.rights | The author retains all proprietary rights, (such as patent rights) and the right to use in future works. | - |
dc.rights | This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. | - |
dc.subject.lcsh | Recommender systems (Information filtering) | - |
dc.title | Enhancing recommender systems : a comprehensive study from effectivenss to fairness | - |
dc.type | PG_Thesis | - |
dc.description.thesisname | Doctor of Philosophy | - |
dc.description.thesislevel | Doctoral | - |
dc.description.thesisdiscipline | Computer Science | - |
dc.description.nature | published_or_final_version | - |
dc.date.hkucongregation | 2024 | - |
dc.date.hkucongregation | 2024 | - |
dc.identifier.mmsid | 991044860752703414 | - |