Snow Hazard Index Using Conditional GAN and Semantic Segmentation
Takato Yasuno, Yachiyo Engineering, Co., Ltd.
Recently, there was a record heavy snowfall due to climate change. In Japan, thousands of vehicles were stuck on the highway for three days. Because of the freezing of the road surface, there was a multi-vehicle accident. Road managers are required to provide indicators to alert drivers regarding snow cover at hazardous locations. During the night, the temperature drops and the road surface tends to freeze. Road managers are required to make decisions on road closures and snow removal work based on the road surface conditions at night.
This session proposes a custom loop deep learning application with live image post-processing to automatically calculate a snow hazard indicator. First, we translate the road surface hidden under snow using a generative adversarial network (GAN), pix2pix. Second, we detect snow-covered and road surface classes by semantic segmentation using DeepLabv3+ with MobileNet as a backbone. Third, we prepare one-to-one paired images and develop a snowy night-to-day translator from the night snow image to the day fake output using the Conditional GAN. Based on these trained networks by MATLAB® toolboxes, we can automatically compute the road to snow rate hazard index, indicating the amount of snow covered on the road surface, even at night.
We demonstrate the applied results to thousands of live snow images of the cold region in Japan. This application has the advantage of using only one live image as the input, without any mining of the before and after paired images dataset. Furthermore, the indicator could be delivered to the road managers and users using our pipeline automatically computed snow hazard ratio index, whose value was zero to 100 for multi-points comparison. As a result, the fake day label output of snowy night images has been well approximated to the real label of snowy day per pixel, with the critical ROI as the snow category for monitoring the winter road safety.
Published: 25 May 2021
Up Next:
Related Videos:
웹사이트 선택
번역된 콘텐츠를 보고 지역별 이벤트와 혜택을 살펴보려면 웹사이트를 선택하십시오. 현재 계신 지역에 따라 다음 웹사이트를 권장합니다:
또한 다음 목록에서 웹사이트를 선택하실 수도 있습니다.
사이트 성능 최적화 방법
최고의 사이트 성능을 위해 중국 사이트(중국어 또는 영어)를 선택하십시오. 현재 계신 지역에서는 다른 국가의 MathWorks 사이트 방문이 최적화되지 않았습니다.
미주
- América Latina (Español)
- Canada (English)
- United States (English)
유럽
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)
아시아 태평양
- Australia (English)
- India (English)
- New Zealand (English)
- 中国
- 日本Japanese (日本語)
- 한국Korean (한국어)