Snow Hazard Index Using Conditional GAN and Semantic Segmentation
Takato Yasuno, Yachiyo Engineering, Co., Ltd.
Recently, there was a record heavy snowfall due to climate change. In Japan, thousands of vehicles were stuck on the highway for three days. Because of the freezing of the road surface, there was a multi-vehicle accident. Road managers are required to provide indicators to alert drivers regarding snow cover at hazardous locations. During the night, the temperature drops and the road surface tends to freeze. Road managers are required to make decisions on road closures and snow removal work based on the road surface conditions at night.
This session proposes a custom loop deep learning application with live image post-processing to automatically calculate a snow hazard indicator. First, we translate the road surface hidden under snow using a generative adversarial network (GAN), pix2pix. Second, we detect snow-covered and road surface classes by semantic segmentation using DeepLabv3+ with MobileNet as a backbone. Third, we prepare one-to-one paired images and develop a snowy night-to-day translator from the night snow image to the day fake output using the Conditional GAN. Based on these trained networks by MATLAB® toolboxes, we can automatically compute the road to snow rate hazard index, indicating the amount of snow covered on the road surface, even at night.
We demonstrate the applied results to thousands of live snow images of the cold region in Japan. This application has the advantage of using only one live image as the input, without any mining of the before and after paired images dataset. Furthermore, the indicator could be delivered to the road managers and users using our pipeline automatically computed snow hazard ratio index, whose value was zero to 100 for multi-points comparison. As a result, the fake day label output of snowy night images has been well approximated to the real label of snowy day per pixel, with the critical ROI as the snow category for monitoring the winter road safety.
Published: 25 May 2021
Up Next:
Related Videos:
Web サイトの選択
Web サイトを選択すると、翻訳されたコンテンツにアクセスし、地域のイベントやサービスを確認できます。現在の位置情報に基づき、次のサイトの選択を推奨します:
また、以下のリストから Web サイトを選択することもできます。
最適なサイトパフォーマンスの取得方法
中国のサイト (中国語または英語) を選択することで、最適なサイトパフォーマンスが得られます。その他の国の MathWorks のサイトは、お客様の地域からのアクセスが最適化されていません。
南北アメリカ
- América Latina (Español)
- Canada (English)
- United States (English)
ヨーロッパ
- Belgium (English)
- Denmark (English)
- Deutschland (Deutsch)
- España (Español)
- Finland (English)
- France (Français)
- Ireland (English)
- Italia (Italiano)
- Luxembourg (English)
- Netherlands (English)
- Norway (English)
- Österreich (Deutsch)
- Portugal (English)
- Sweden (English)
- Switzerland
- United Kingdom (English)
アジア太平洋地域
- Australia (English)
- India (English)
- New Zealand (English)
- 中国
- 日本Japanese (日本語)
- 한국Korean (한국어)