-
Kolmogorov-Arnold Network for Satellite Image Classification in Remote Sensing
Authors:
Minjong Cheon
Abstract:
In this research, we propose the first approach for integrating the Kolmogorov-Arnold Network (KAN) with various pre-trained Convolutional Neural Network (CNN) models for remote sensing (RS) scene classification tasks using the EuroSAT dataset. Our novel methodology, named KCN, aims to replace traditional Multi-Layer Perceptrons (MLPs) with KAN to enhance classification performance. We employed mu…
▽ More
In this research, we propose the first approach for integrating the Kolmogorov-Arnold Network (KAN) with various pre-trained Convolutional Neural Network (CNN) models for remote sensing (RS) scene classification tasks using the EuroSAT dataset. Our novel methodology, named KCN, aims to replace traditional Multi-Layer Perceptrons (MLPs) with KAN to enhance classification performance. We employed multiple CNN-based models, including VGG16, MobileNetV2, EfficientNet, ConvNeXt, ResNet101, and Vision Transformer (ViT), and evaluated their performance when paired with KAN. Our experiments demonstrated that KAN achieved high accuracy with fewer training epochs and parameters. Specifically, ConvNeXt paired with KAN showed the best performance, achieving 94% accuracy in the first epoch, which increased to 96% and remained consistent across subsequent epochs. The results indicated that KAN and MLP both achieved similar accuracy, with KAN performing slightly better in later epochs. By utilizing the EuroSAT dataset, we provided a robust testbed to investigate whether KAN is suitable for remote sensing classification tasks. Given that KAN is a novel algorithm, there is substantial capacity for further development and optimization, suggesting that KCN offers a promising alternative for efficient image analysis in the RS field.
△ Less
Submitted 1 June, 2024;
originally announced June 2024.
-
KARINA: An Efficient Deep Learning Model for Global Weather Forecast
Authors:
Minjong Cheon,
Yo-Hwan Choi,
Seon-Yu Kang,
Yumi Choi,
Jeong-Gil Lee,
Daehyun Kang
Abstract:
Deep learning-based, data-driven models are gaining prevalence in climate research, particularly for global weather prediction. However, training the global weather data at high resolution requires massive computational resources. Therefore, we present a new model named KARINA to overcome the substantial computational demands typical of this field. This model achieves forecasting accuracy comparab…
▽ More
Deep learning-based, data-driven models are gaining prevalence in climate research, particularly for global weather prediction. However, training the global weather data at high resolution requires massive computational resources. Therefore, we present a new model named KARINA to overcome the substantial computational demands typical of this field. This model achieves forecasting accuracy comparable to higher-resolution counterparts with significantly less computational resources, requiring only 4 NVIDIA A100 GPUs and less than 12 hours of training. KARINA combines ConvNext, SENet, and Geocyclic Padding to enhance weather forecasting at a 2.5° resolution, which could filter out high-frequency noise. Geocyclic Padding preserves pixels at the lateral boundary of the input image, thereby maintaining atmospheric flow continuity in the spherical Earth. SENet dynamically improves feature response, advancing atmospheric process modeling, particularly in the vertical column process as numerous channels. In this vein, KARINA sets new benchmarks in weather forecasting accuracy, surpassing existing models like the ECMWF S2S reforecasts at a lead time of up to 7 days. Remarkably, KARINA achieved competitive performance even when compared to the recently developed models (Pangu-Weather, GraphCast, ClimaX, and FourCastNet) trained with high-resolution data having 100 times larger pixels. Conclusively, KARINA significantly advances global weather forecasting by efficiently modeling Earth's atmosphere with improved accuracy and resource efficiency.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Advancing Data-driven Weather Forecasting: Time-Sliding Data Augmentation of ERA5
Authors:
Minjong Cheon,
Daehyun Kang,
Yo-Hwan Choi,
Seon-Yu Kang
Abstract:
Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our research introduces a novel strategy that deviates from the common dependence on high-resolution data, which is often constrained by computational resources, and…
▽ More
Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our research introduces a novel strategy that deviates from the common dependence on high-resolution data, which is often constrained by computational resources, and instead utilizes low-resolution data (2.5 degrees) for global weather prediction and climate data analysis. Our main focus is evaluating data-driven weather prediction (DDWP) frameworks, specifically addressing sample size adequacy, structural improvements to the model, and the ability of climate data to represent current climatic trends. By using the Adaptive Fourier Neural Operator (AFNO) model via FourCastNet and a proposed time-sliding method to inflate the dataset of the ECMWF Reanalysis v5 (ERA5), this paper improves on conventional approaches by adding more variables and a novel approach to data augmentation and processing. Our findings reveal that despite the lower resolution, the proposed approach demonstrates considerable accuracy in predicting atmospheric conditions, effectively rivaling higher-resolution models. Furthermore, the study confirms the model's proficiency in reflecting current climate trends and its potential in predicting future climatic events, underscoring its utility in climate change strategies. This research marks a pivotal step in the realm of meteorological forecasting, showcasing the feasibility of lower-resolution data in producing reliable predictions and opening avenues for more accessible and inclusive climate modeling. The insights gleaned from this study not only contribute to the advancement of climate science but also lay the groundwork for future innovations in the field.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Color of Copper/Copper oxide
Authors:
Su Jae Kim,
Seonghoon Kim,
Jegon Lee,
Youngjae Jo,
Yu-Seong Seo,
Myounghoon Lee,
Yousil Lee,
Chae Ryong Cho,
Jong-pil Kim,
Miyeon Cheon,
Jungseek Hwang,
Yong In Kim,
Young-Hoon Kim,
Young-Min Kim,
Aloysius Soon,
Myunghwan Choi,
Woo Seok Choi,
Se-Young Jeong,
Young Hee Lee
Abstract:
Stochastic inhomogeneous oxidation is an inherent characteristic of copper (Cu), often hindering color tuning and bandgap engineering of oxides. Coherent control of the interface between metal and metal oxide remains unresolved. We demonstrate coherent propagation of an oxidation front in single-crystal Cu thin film to achieve a full-color spectrum for Cu by precisely controlling its oxide-layer t…
▽ More
Stochastic inhomogeneous oxidation is an inherent characteristic of copper (Cu), often hindering color tuning and bandgap engineering of oxides. Coherent control of the interface between metal and metal oxide remains unresolved. We demonstrate coherent propagation of an oxidation front in single-crystal Cu thin film to achieve a full-color spectrum for Cu by precisely controlling its oxide-layer thickness. Grain boundary-free and atomically flat films prepared by atomic-sputtering epitaxy allow tailoring of the oxide layer with an abrupt interface via heat treatment with a suppressed temperature gradient. Color tuning of nearly full-color RGB indices is realized by precise control of oxide-layer thickness; our samples covered ~50.4% of the sRGB color space. The color of copper/copper oxide is realized by the reconstruction of the quantitative yield color from oxide pigment (complex dielectric functions of Cu2O) and light-layer interference (reflectance spectra obtained from the Fresnel equations) to produce structural color. We further demonstrate laser-oxide lithography with micron-scale linewidth and depth through local phase transformation to oxides embedded in the metal, providing spacing necessary for semiconducting transport and optoelectronics functionality.
△ Less
Submitted 15 July, 2021;
originally announced July 2021.
