Feature Fusion Framework Combining Attention Mechanism and Geometric Information

The imbalanced problem is common in the real world, and the highly-skewed distribution of imbalanced data seriously affects the performance of the model.In general, the imbalanced data affects the model performance from two aspects.On the one hand, the imbalance in sample size leads to more updates of parameters in majority classes, which leads to the model biased to majority classes.On the other hand, the sample size of minority classes is too small, and the diversity is insufficient, which leads to the insufficient representation ability of the model.To solve these problems, this paper proposes a feature fusion framework combining attention mechanism and geometric information.Specifically, in the first stage, the model learns the semantic information and discriminative information of the data through pre-training, and combines the attention mechanism to discover where the mo-del pays more attention.In the second stage, the model uses geometric information to mine boundary features, and combines the attentio