-
HDKD: Hybrid Data-Efficient Knowledge Distillation Network for Medical Image Classification
Authors:
Omar S. EL-Assiouti,
Ghada Hamed,
Dina Khattab,
Hala M. Ebied
Abstract:
Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when trained with insufficient data due to lack of inherent inductive biases. Distilling knowledge and inductive biases from a Convolutional Neural Network (CNN) teacher has emerged as an effective strategy for enhancing the…
▽ More
Vision Transformers (ViTs) have achieved significant advancement in computer vision tasks due to their powerful modeling capacity. However, their performance notably degrades when trained with insufficient data due to lack of inherent inductive biases. Distilling knowledge and inductive biases from a Convolutional Neural Network (CNN) teacher has emerged as an effective strategy for enhancing the generalization of ViTs on limited datasets. Previous approaches to Knowledge Distillation (KD) have pursued two primary paths: some focused solely on distilling the logit distribution from CNN teacher to ViT student, neglecting the rich semantic information present in intermediate features due to the structural differences between them. Others integrated feature distillation along with logit distillation, yet this introduced alignment operations that limits the amount of knowledge transferred due to mismatched architectures and increased the computational overhead. To this end, this paper presents Hybrid Data-efficient Knowledge Distillation (HDKD) paradigm which employs a CNN teacher and a hybrid student. The choice of hybrid student serves two main aspects. First, it leverages the strengths of both convolutions and transformers while sharing the convolutional structure with the teacher model. Second, this shared structure enables the direct application of feature distillation without any information loss or additional computational overhead. Additionally, we propose an efficient light-weight convolutional block named Mobile Channel-Spatial Attention (MBCSA), which serves as the primary convolutional block in both teacher and student models. Extensive experiments on two medical public datasets showcase the superiority of HDKD over other state-of-the-art models and its computational efficiency. Source code at: https://github.com/omarsherif200/HDKD
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Optical intra-day variability of the blazar S5 0716+714
Authors:
Tushar Tripathi,
Alok C. Gupta,
Ali Takey,
Rumen Bachev,
Oliver Vince,
Anton Strigachev,
Pankaj Kushwaha,
E. G. Elhosseiny,
Paul J. Wiita,
G. Damljanovic,
Vinit Dhiman,
A. Fouad,
Haritma Gaur,
Minfeng Gu,
G. E. Hamed,
Shubham Kishore,
A. Kurtenkov,
Shantanu Rastogi,
E. Semkov,
I. Zead,
Zhongli Zhang
Abstract:
We present an extensive recent multi-band optical photometric observations of the blazar S5 0716+714 carried out over 53 nights with two telescopes in India, two in Bulgaria, one in Serbia, and one in Egypt during 2019 November -- 2022 December. We collected 1401, 689, 14726, and 165 photometric image frames in B, V, R, and I bands, respectively. We montiored the blazar quasi-simultaneously during…
▽ More
We present an extensive recent multi-band optical photometric observations of the blazar S5 0716+714 carried out over 53 nights with two telescopes in India, two in Bulgaria, one in Serbia, and one in Egypt during 2019 November -- 2022 December. We collected 1401, 689, 14726, and 165 photometric image frames in B, V, R, and I bands, respectively. We montiored the blazar quasi-simultaneously during 3 nights in B, V, R, and I bands; 4 nights in B, V, and R; 2 nights in V, R, and I; 5 nights in B and R; and 2 nights in V and R bands. We also took 37 nights of data only in R band. Single band data are used to study intraday flux variability and two or more bands quasi-simultaneous observations allow us to search for colour variation in the source. We employ the power-enhanced F-test and the nested ANOVA test to search for genuine flux and color variations in the light curves of the blazar on intraday timescales. Out of 12, 11, 53, and 5 nights observations, intraday variations with amplitudes between ~3% and ~20% are detected in 9, 8, 31 and 3 nights in B, V, R, and I bands, respectively, corresponding to duty cycles of 75%, 73%, 58% and 60%. These duty cycles are lower than those typically measured at earlier times. On these timescales color variations with both bluer-when-brighter and redder-when-brighter are seen, though nights with no measurable colour variation are also present. We briefly discuss possible explanations for this observed intraday variability.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
-
Multi-band analyses of the bright GRB 230812B and the associated SN2023pel
Authors:
T. Hussenot-Desenonges,
T. Wouters,
N. Guessoum,
I. Abdi,
A. Abulwfa,
C. Adami,
J. F. Agüí Fernández,
T. Ahumada,
V. Aivazyan,
D. Akl,
S. Anand,
C. M. Andrade,
S. Antier,
S. A. Ata,
P. D'Avanzo,
Y. A. Azzam,
A. Baransky,
S. Basa,
M. Blazek,
P. Bendjoya,
S. Beradze,
P. Boumis,
M. Bremer,
R. Brivio,
V. Buat
, et al. (87 additional authors not shown)
Abstract:
GRB~230812B is a bright and relatively nearby ($z =0.36$) long gamma-ray burst (GRB) that has generated significant interest in the community and has thus been observed over the entire electromagnetic spectrum. We report over 80 observations in X-ray, ultraviolet, optical, infrared, and sub-millimeter bands from the GRANDMA (Global Rapid Advanced Network for Multi-messenger Addicts) network of obs…
▽ More
GRB~230812B is a bright and relatively nearby ($z =0.36$) long gamma-ray burst (GRB) that has generated significant interest in the community and has thus been observed over the entire electromagnetic spectrum. We report over 80 observations in X-ray, ultraviolet, optical, infrared, and sub-millimeter bands from the GRANDMA (Global Rapid Advanced Network for Multi-messenger Addicts) network of observatories and from observational partners. Adding complementary data from the literature, we then derive essential physical parameters associated with the ejecta and external properties (i.e. the geometry and environment) of the GRB and compare with other analyses of this event. We spectroscopically confirm the presence of an associated supernova, SN2023pel, and we derive a photospheric expansion velocity of v $\sim$ 17$\times10^3$ km s$^{-1}$. We analyze the photometric data first using empirical fits of the flux and then with full Bayesian Inference. We again strongly establish the presence of a supernova in the data, with a maximum (pseudo-)bolometric luminosity of $5.75 \times 10^{42}$ erg/s, at $15.76^{+0.81}_{-1.21}$ days (in the observer frame) after the trigger, with a half-max time width of 22.0 days. We compare these values with those of SN1998bw, SN2006aj, and SN2013dx. Our best-fit model favours a very low density environment ($\log_{10}({n_{\rm ISM}/{\rm cm}^{-3}}) = -2.38^{+1.45}_{-1.60}$) and small values for the jet's core angle $θ_{\rm core} = 1.54^{+1.02}_{-0.81} \ \rm{deg}$ and viewing angle $θ_{\rm obs} = 0.76^{+1.29}_{-0.76} \ \rm{deg}$. GRB 230812B is thus one of the best observed afterglows with a distinctive supernova bump.
△ Less
Submitted 17 February, 2024; v1 submitted 22 October, 2023;
originally announced October 2023.
-
Multi-parameter study for a new Ground-Based telescope in Egypt
Authors:
Mohamed S. Darwish,
Hazem Badreldin,
Nasser M. Ahmed,
Mostafa Morsy,
E. E. Kohil,
Hany M. Hassan,
I. Helmy,
Ahmed shokry,
M. A. Hassan,
S. M. Saad,
G. M. Hamed,
Z. F. Ghatass,
S. A. Ata
Abstract:
A multi-parameter analysis was conducted to evaluate the impact of meteorological parameters, night sky brightness and seismic hazard on proposed sites for the new optical/infrared Egyptian astronomical telescope. The ERA5 reanalysis data set is used to get the following meteorological parameters: Total cloud coverage fraction, precipitable water vapor, relative humidity, wind speed & direction an…
▽ More
A multi-parameter analysis was conducted to evaluate the impact of meteorological parameters, night sky brightness and seismic hazard on proposed sites for the new optical/infrared Egyptian astronomical telescope. The ERA5 reanalysis data set is used to get the following meteorological parameters: Total cloud coverage fraction, precipitable water vapor, relative humidity, wind speed & direction and Air temperature. To estimate the aerosol optical depth we used the Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2). Light pollution over the candidate sites was measured from Visible Infrared Imaging Radiometer Suite (VIIRS) Day Night Band (DNB). The seismic input in terms of maximum acceleration and response spectra were computed using a physics-based ground motion approach to assess the seismic hazards and consequently the designation of seismic resistant structure for the proposed sites to be able to assess the seismic hazards for the candidate sites. Of the seven nominated sites, two sites are found to have the best measurements and might be considered future sites for the new Egyptian Astronomical telescope. The first site is located in the south of the Sinai peninsula, while the second one is located in the Red Sea mountains region.
△ Less
Submitted 7 October, 2023;
originally announced October 2023.
-
Spectroscopic and Photometric Study of the new $δ$ Scuti Star ASAS J063309+1810.8
Authors:
Mohamed I. Nouh,
Mohamed Abdel-Sabour,
Ahmed Shokry,
Gamal M. Hamed,
Diaa A. Fouda,
Ali Takey
Abstract:
We present BVR observations and low-resolution spectra collected by the Kottamia Astronomical Observatory 1.88 m telescope (KAO) for the new pulsating star ASAS J063309+1810.8 (hereafter it will be called ASAS06+18). The photometric analysis revealed that the star is a $δ$ Scuti star with low amplitude (a=0.054-0.099 in V mag.) and a short period (102.604 min). Fourier analysis of the light curves…
▽ More
We present BVR observations and low-resolution spectra collected by the Kottamia Astronomical Observatory 1.88 m telescope (KAO) for the new pulsating star ASAS J063309+1810.8 (hereafter it will be called ASAS06+18). The photometric analysis revealed that the star is a $δ$ Scuti star with low amplitude (a=0.054-0.099 in V mag.) and a short period (102.604 min). Fourier analysis of the light curves reveals the fundamental mode with two harmonics. The photometric analysis yielded a new value of the updated frequency of 13.0035232 cd-1 with an amplitude of 49.93 mmag at phases 0.326 and S/N 21.75 and to two frequencies (20.2099237cd-1, 5.9130945cd-1). Given the available data, 37 new times of maximum light are presented, and an updated ephemeris for the star and its O-C data. Assuming its period decreases and changes smoothly, a new value of (1/P)dP/dt is determined. We calculated the effective temperature and surface gravity as Teff=7125+- 250 K and log g=4.0+-0.2 dex from model atmosphere analysis of the star's spectra at different phases. The bolometric magnitude Mbol=2.798 (0.016), radius R=1.577(0.077) R_sun, luminosity L=5.714(1.066) L_sun, the mass is M=1.595 M_sun and pulsation constant Q=0{m}.0338(0.0003). The star's locations in the evolutionary mass-luminosity and mass-radius relationships are discussed.
△ Less
Submitted 15 August, 2022;
originally announced August 2022.
-
Photometric and Spectroscopic Analysis of the SX Phe Star BL Cam
Authors:
Mohamed Abdel-Sabour,
Mohamed I. Nouh,
Ahmed Shokry,
Gamal M. Hamed,
Hamed A. Ismail,
Ali Takey,
Saad A. Ata,
Ibrahim Zead
Abstract:
In the present paper, we report the photometric and spectroscopic observations obtained by the 1.88 m telescope at the Kottamia astronomical observatory of the pulsating star BL Cam. Fourier analysis of the light curves reveals that the fundamental mode has two harmonics. The O-C method is used to establish the period changes. So far, the analysis has been very successful in map** the pulsation…
▽ More
In the present paper, we report the photometric and spectroscopic observations obtained by the 1.88 m telescope at the Kottamia astronomical observatory of the pulsating star BL Cam. Fourier analysis of the light curves reveals that the fundamental mode has two harmonics. The O-C method is used to establish the period changes. So far, the analysis has been very successful in map** the pulsation amplitude of the star across the instability strip. By using the formalism of Eddington and Plakidis (1929), we found significant results and strong indications of the evolutionary period change. A total of 55 new maximum light timings are reported. New values of (1/P) dP/dt are estimated using the O-C diagram based on all newly obtained times of maximum light combined with those taken from the literature, assuming the periods are decreasing and changing smoothly. To compute the effective temperature and surface gravity of the star, we performed model atmosphere analysis on its spectra. The physical parameters of the star are calculated and compared with the evolutionary models.
△ Less
Submitted 28 March, 2022;
originally announced March 2022.
-
The mechanism for the exceptionally high tear strength of carbon black/Hevea natural rubber vulcanizates
Authors:
G. Rong,
J. Jiang,
N. Schmitz,
L. Jia,
G. R. Hamed
Abstract:
Natural rubber vucanizates containing 0-50 phr of a fine carbon black (N115,d=27nm) were prepared and tensile strengths of normal (no pre-cut) and edge pre-cut specimens were determined. Normal tensile strengths of all vulcanizates were similar. At the relatively slow strain rate experienced wholesale by normal uncut specimens, all vulcanizates, prior to crack initiation, strain-crystallized suffi…
▽ More
Natural rubber vucanizates containing 0-50 phr of a fine carbon black (N115,d=27nm) were prepared and tensile strengths of normal (no pre-cut) and edge pre-cut specimens were determined. Normal tensile strengths of all vulcanizates were similar. At the relatively slow strain rate experienced wholesale by normal uncut specimens, all vulcanizates, prior to crack initiation, strain-crystallized sufficiently to be strong. However, pre-cut specimens experience increased strain rate at a cut tip. Magnification of the strain rate increases as cut depth c increases. Fracture in the gum NR and vulcanizates with up to 14 phr of black occurred by simple forward crack growth from a cut tip, and all exhibited a critical cut size, above which strength dropped abruptly. Furthermore, for these lightly filled samples, strength and critical cut size decreased with increased black content. This indicates less strain-crystalliation before rupture of pre-cut specimens, when levels of black are low. This effect is attributerd to rapid straining at a cut tip and hindering of the chain mobility necessary for crystallization. When black content was increased to 15 phr, with 1 mm<c<2 mm, about 50% of specimens retained simple lateral fracture and were weak, but the other 50% developed deviated cracks (knotty tearing) and were significantly stronger than corresponding pre-cut gum specimens, especially at large c. High strength with sufficient black levels are attributed to increased strain-crystallization and super-blunting (multiple cracks) at a cut tip. These inhibit forward crack growth. For carbon black to enhance strain-crystallization relative to the gum, it appears there must be enough of it to form a bound rubber/black network. If the black concentration is less than this percolation threshold, strain-crystallization is hindered at a cut tip.
△ Less
Submitted 23 May, 2019;
originally announced May 2019.
-
Studying Spectral Behavior, Accretion Processes and Photometric Behavior of Some Binary Stars in the Ultraviolet and Optical Regions
Authors:
Gamal M. Hamed
Abstract:
We study the evolution of the normalized flux of selected ultraviolet emission lines of three classical novae (PW Vul, V1668 Cyg and V1974 Cyg). Different phases ofthe outbursts are studied. We attribute the spectral behavior of the three systems to the variation of the optical thickness and temperature of the envelope during the different phases of the outbursts. Our results are consistent with t…
▽ More
We study the evolution of the normalized flux of selected ultraviolet emission lines of three classical novae (PW Vul, V1668 Cyg and V1974 Cyg). Different phases ofthe outbursts are studied. We attribute the spectral behavior of the three systems to the variation of the optical thickness and temperature of the envelope during the different phases of the outbursts. Our results are consistent with the theoretical models of classical novae. We also present optical photometric observations of the three systems in the post-novae phase. These observations show the variation of the light curves of these systems and the different times of maxima and minima.
△ Less
Submitted 19 February, 2019;
originally announced February 2019.
-
Reliable Prediction Intervals for Local Linear Regression
Authors:
Mohammad Ghasemi Hamed,
Masoud Ebadi Kivaj
Abstract:
This paper introduces two methods for estimating reliable prediction intervals for local linear least-squares regressions, named Bounded Oscillation Prediction Intervals (BOPI). It also proposes a new measure for comparing interval prediction models named Equivalent Gaussian Standard Deviation (EGSD). The experimental results compare BOPI to other methods using coverage probability, Mean Interval…
▽ More
This paper introduces two methods for estimating reliable prediction intervals for local linear least-squares regressions, named Bounded Oscillation Prediction Intervals (BOPI). It also proposes a new measure for comparing interval prediction models named Equivalent Gaussian Standard Deviation (EGSD). The experimental results compare BOPI to other methods using coverage probability, Mean Interval Size and the introduced EGSD measure. The results were generally in favor of the BOPI on considered benchmark regression datasets. It also, reports simulation studies validating the BOPI method's reliability.
△ Less
Submitted 12 July, 2016; v1 submitted 17 March, 2016;
originally announced March 2016.
-
Discovery of Dramatic Optical Variability in SDSS J1100+4421: A Peculiar Radio-Loud Narrow-Line Seyfert 1 Galaxy?
Authors:
Masaomi Tanaka,
Tomoki Morokuma,
Ryosuke Itoh,
Hiroshi Akitaya,
Nozomu Tominaga,
Yoshihiko Saito,
Lukasz Stawarz,
Yasuyuki T. Tanaka,
Poshak Gandhi,
Gamal Ali,
Tsutomu Aoki,
Carlos Contreras,
Mamoru Doi,
Ahmad Essam,
Gamal Hamed,
Eric Y. Hsiao,
Ikuru Iwata,
Koji S. Kawabata,
Nobuyuki Kawai,
Yuki Kikuchi,
Naoto Kobayashi,
Daisuke Kuroda,
Hiroyuki Maehara,
Emiko Matsumoto,
Paolo A. Mazzali
, et al. (33 additional authors not shown)
Abstract:
We present our discovery of dramatic variability in SDSS J1100+4421 by the high-cadence transient survey Kiso Supernova Survey (KISS). The source brightened in the optical by at least a factor of three within about half a day. Spectroscopic observations suggest that this object is likely a narrow-line Seyfert 1 galaxy (NLS1) at z=0.840, however with unusually strong narrow emission lines. The esti…
▽ More
We present our discovery of dramatic variability in SDSS J1100+4421 by the high-cadence transient survey Kiso Supernova Survey (KISS). The source brightened in the optical by at least a factor of three within about half a day. Spectroscopic observations suggest that this object is likely a narrow-line Seyfert 1 galaxy (NLS1) at z=0.840, however with unusually strong narrow emission lines. The estimated black hole mass of ~ 10^7 Msun implies bolometric nuclear luminosity close to the Eddington limit. SDSS J1100+4421 is also extremely radio-loud, with a radio loudness parameter of R ~ 4 x 10^2 - 3 x 10^3, which implies the presence of relativistic jets. Rapid and large-amplitude optical variability of the target, reminiscent of that found in a few radio- and gamma-ray loud NLS1s, is therefore produced most likely in a blazar-like core. The 1.4 GHz radio image of the source shows an extended structure with a linear size of about 100 kpc. If SDSS J1100+4421 is a genuine NLS1, as suggested here, this radio structure would then be the largest ever discovered in this type of active galaxies.
△ Less
Submitted 3 September, 2014;
originally announced September 2014.
-
Predictive Interval Models for Non-parametric Regression
Authors:
Mohammad Ghasemi Hamed,
Mathieu Serrurier,
Nicolas Durand
Abstract:
Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We name such intervals predictive intervals. This work presents a new method to find two-sided predictive intervals for non-parametric least squares regression wi…
▽ More
Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We name such intervals predictive intervals. This work presents a new method to find two-sided predictive intervals for non-parametric least squares regression without the homoscedasticity assumption. Our predictive intervals are built by using tolerance intervals on prediction errors in the query point's neighborhood. We proposed a predictive interval model test and we also used it as a constraint in our hyper-parameter tuning algorithm. This gives an algorithm that finds the smallest reliable predictive intervals for a given dataset. We also introduce a measure for comparing different interval prediction methods yielding intervals having different size and coverage. These experiments show that our methods are more reliable, effective and precise than other interval prediction methods.
△ Less
Submitted 21 March, 2016; v1 submitted 24 February, 2014;
originally announced February 2014.
