Logo image
Leveraging transfer learning in reinforcement learning to tackle competitive influence maximization
期刊文章   同儕審查

Leveraging transfer learning in reinforcement learning to tackle competitive influence maximization

Khurshed Ali, Chih-Yu WangYi-Shin Chen
Knowledge and Information Systems, 卷.64(8), 頁碼.2059-2090
08/2022

摘要

Influence maximization Q-Learning Reinforcement learning Social networks Transfer learning Software Information Systems Human-Computer Interaction Hardware and Architecture Artificial Intelligence
Competitive influence maximization (CIM) is a key problem that seeks highly influential users to maximize the party’s reward than the competitor. Heuristic and game theory-based approaches are proposed to tackle the CIM problem. However, these approaches consider a selection of key influential users at the first round after knowing the competitor’s seed nodes. To overcome the first round seed selection, reinforcement learning (RL)-based models are proposed to tackle the competitive influence maximization allowing parties to select seed nodes in multiple rounds without explicitly knowing the competitor’s decision. Despite the successful application of RL-based models for CIM, the proposed RL-based models take extensive training time to train the model for finding an optimal strategy whenever the networks or settings of the agent change. To address the RL model’s efficiency, we extend transfer learning in reinforcement learning-based methods to reduce the training time and utilize the knowledge gained on a source network to a target network. Our objective is twofold; the first one is the appropriate state representation of the source and target networks to efficiently avail the knowledge gained on a source network to a target network. The second is to find an optimal transfer learning (TL) in the reinforcement learning method, which is more suitable to tackle the competitive influence maximization problem. We validate our proposed TL methods under two different settings of the agent. Experimental results demonstrate that our proposed TL methods achieve better or similar performance compared with the baseline model while reducing significant training time on target networks.

相關連結

指標

1 檢視次數

詳細資料

Logo image