필터 지우기
필터 지우기

Deep learning softmax classification posterior probability calculated from validation/test set

조회 수: 1 (최근 30일)
Hi All
Im working on LSTM classification for a physical system in applied opics and using this example
However, for our particular system/data we always have slightly overfit on training data before accuracy on validation data is optimum (due to the nature of the data). Hence our probability given by the trained model always overestimates our certainty in prediction (on both validation and independent test set). We like to correct for this by recalculating the posterior probability. Can any advise on how it is possible to calculate confidence in prediction (or posterior probability) from a LSTM on the validation or test data instead of the training data that is given by the trained model?
The problem is that unfortunately the classify functions does not allow this
[YPred,scores] = classify(net,sequences) or
[updatedNet,YPred,scores] = classifyAndUpdateState(___)
as they outputs posterior probablity (scores) calculated from training data
Any advise it highly appreciated
Mads
  댓글 수: 1
Image Analyst
Image Analyst 2019년 7월 11일
Original question, in case user edits it away:
Hi All
Im working on LSTM classification for a physical system in applied opics and using this example
However, for our particular system/data we always have slightly overfit on training data before accuracy on validation data is optimum (due to the nature of the data). Hence our probability given by the trained model always overestimates our certainty in prediction (on both validation and independent test set). We like to correct for this by recalculating the posterior probability. Can any advise on how it is possible to calculate confidence in prediction (or posterior probability) from a LSTM on the validation or test data instead of the training data that is given by the trained model?
The problem is that unfortunately the classify functions does not allow this
[YPred,scores] = classify(net,sequences) or
[updatedNet,YPred,scores] = classifyAndUpdateState(___)
as they outputs posterior probablity (scores) calculated from training data
Any advise it highly appreciated
Mads

댓글을 달려면 로그인하십시오.

답변 (0개)

카테고리

Help CenterFile Exchange에서 Sequence and Numeric Feature Data Workflows에 대해 자세히 알아보기

제품


릴리스

R2018a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by