필터 지우기
필터 지우기

How to use pretrain networks like vgg19,resnet18?

조회 수: 2 (최근 30일)
Shilpa Sonawane
Shilpa Sonawane 2022년 9월 13일
댓글: Shilpa Sonawane 2023년 1월 24일
I would like to use pretrained network like VGG19, RESNET18. The output of this network should be connected to LSTM.
Which layer should be considered to take output from pretrain network?
  댓글 수: 3
Shilpa Sonawane
Shilpa Sonawane 2022년 10월 18일
i am working on the topic of lipreading. i have done preprocessing & have videos which consists of mouth region of person. I used VGG19 pretrain network. Now its output i would like to connect with LSTM network. I am confused from which layer of VGG19 the output is taken for furter processing. I referred many papers in which first pretrain netwrok is used and then its output is applied to LSTM network. LSTM network is used as input to the system is video which is frame sequence.
Shilpa Sonawane
Shilpa Sonawane 2023년 1월 24일
yes i tried it, thank you.

댓글을 달려면 로그인하십시오.

채택된 답변

Nadia Shaik
Nadia Shaik 2022년 11월 23일
Hi Shilpa,
I understand that you wish to connect the output of CNN to LSTM network. MATLAB supports workflows containing both CNN and LSTM layers.
You can convert the videos to sequences of feature vectors using a pretrained convolutional neural network, such as GoogleNet, to extract features from each frame. And then, train an LSTM network on the sequences to predict the video labels.
Please check the link that contains an example showing the CNN+LSTM workflow https://www.mathworks.com/help/deeplearning/examples/classify-videos-using-deep-learning.html
Similarly, you can use the convolutional neural networks like VGG19, RESNET18 to extract features and then train an LSTM network.
I hope this helps

추가 답변 (0개)

카테고리

Help CenterFile Exchange에서 Image Data Workflows에 대해 자세히 알아보기

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by