how to install a network structure with two input,one is imageinput,the other is sequence input?
조회 수: 1 (최근 30일)
이전 댓글 표시
I want to improve the performance of a CNN network. So I add a sequencial input(which is match with the CNN image input), and training it with LSTM network ,then join them together in their fullyconnected layers, and use softmax to classify. But the deepNetworkDesigner don't support these two kinds of input. How can I solve this problem?
댓글 수: 0
답변 (1개)
Krishna
2024년 5월 30일
Hi Zhengyun,
It seems you're looking to enhance the performance of a CNN network by incorporating a sequential layer for your image data, which will then be fed into an LSTM network. The output from this would subsequently be merged and passed through a fully connected layer for classification purposes.
You can do this in MATLAB using ‘dlnetwork’. You can pass the data as sequence to an LSTM architecture and as an image to CNN architecture which are two different networks then combine using ‘additionLayer.’ Make sure your dimension of the output are same for both the network. Then pass this combined output through fully connected layer and then a SoftMax function. This is how the architecture should like.
Please go through the following documentation to learn more,
Also please go through this example to learn more about using CNN and RNN together,
Also, for this type of combined networks you need to use Datastores to train the network in MATLAB, please go through the following documentation to learn more,
Hope this helps.
댓글 수: 0
참고 항목
카테고리
Help Center 및 File Exchange에서 Image Data Workflows에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!