Does DeepNetworkDesigner support Transformer Layers?
조회 수: 12 (최근 30일)
이전 댓글 표시
I want to add Transofmrer Layers while designing the network for deep learning using MATLAB DeepNetworkDesigner, but it doesn't show me such option. How can I add Transofmer Layers to the network designed using DeepNetworkDesigner?
댓글 수: 0
답변 (2개)
Matt J
2024년 1월 14일
If the transformer layer is a custom layer that you have created for yourself, you would import it to deepNetworkDesigner from the workspace, as explained here,
댓글 수: 0
David Ho
2024년 1월 18일
Hi Subhadip,
In R2023b, the following layers are supported in Deep Network Designer that are commonly used in transformers:
- selfAttentionLayer
- wordEmbeddingLayer (requires Text Analytics Toolbox)
- sinusoidalPositionEncodingLayer
- positionEmbeddingLayer
- embeddingConcatenationLayer
- indexing1dLayer
- patchEmbeddingLayer (requires Computer Vision Toolbox)
Best regards,
David
댓글 수: 0
참고 항목
카테고리
Help Center 및 File Exchange에서 Image Data Workflows에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!