Logo image
Few-shot Text Classification with Saliency-equivalent Concatenation
Conference paper

Few-shot Text Classification with Saliency-equivalent Concatenation

Ying-Jia Lin, Yu-Fang Chang, Hung-Yu Kao, Hsin-Yang Wang and Mu Liu
Proceedings - 2022 IEEE 5th International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2022, pp.74-81
2022

Abstract

data augmentation few-shot learning knowledge extraction meta-learning natural language processing Artificial Intelligence Computer Networks and Communications Computer Science Applications Information Systems
In few-shot text classification, the lack of significant features limits models from generalizing to data not included in the training set. Data augmentation is a solution to the classification tasks; however, the standard augmentation methods in natural language processing are not feasible in few-shot learning. In this study, we explore data augmentation in few-shot text classification. We propose saliency-equivalent concatenation (SEC)1. The core concept of SEC is to append additional key information to an input sentence to help a model understand the sentence easier. In the proposed method, we first leverage a pre-trained language model to generate several novel sentences for each sample in datasets. Then we leave the most relevant one and concatenate it with the original sentence as additional information for each sample. Our experiments on the two fewshot text classification tasks verified that the proposed method can boost the performance of meta-learning models and outperform the previous unsupervised data augmentation methods.

Metrics

1 Record Views

Details

Logo image