23-06-2023 дата публикации
Номер: CN116310983A
Принадлежит:
The invention provides a multi-mode emotion recognition method and device which can be used in the financial field or other fields, and the method comprises the steps: obtaining a video data sample and an actual emotion label; obtaining single-mode feature data and emotion feature data of each mode according to the original data of the video data sample in the multiple modes and the single-mode emotion learning model of each mode; according to the multi-modal emotion recognition model and the original data of each modal, obtaining emotion prediction data; the sentiment feature data, the sentiment prediction data and the actual sentiment labels are substituted into an overall loss function, parameters of all models are adjusted, when the overall loss function value is minimum, training of the models is completed, and the overall loss function comprises a loss function of a multi-mode sentiment recognition model and a loss function of all single-mode sentiment learning models; and obtaining ...
Подробнее