-
A Hybrid Deep Learning Classification of Perimetric Glaucoma Using Peripapillary Nerve Fiber Layer Reflectance and Other OCT Parameters from Three Anatomy Regions
Authors:
Ou Tan,
David S. Greenfield,
Brian A. Francis,
Rohit Varma,
Joel S. Schuman,
David Huang,
Dongseok Choi
Abstract:
Precis: A hybrid deep-learning model combines NFL reflectance and other OCT parameters to improve glaucoma diagnosis. Objective: To investigate if a deep learning model could be used to combine nerve fiber layer (NFL) reflectance and other OCT parameters for glaucoma diagnosis. Patients and Methods: This is a prospective observational study where of 106 normal subjects and 164 perimetric glaucoma…
▽ More
Precis: A hybrid deep-learning model combines NFL reflectance and other OCT parameters to improve glaucoma diagnosis. Objective: To investigate if a deep learning model could be used to combine nerve fiber layer (NFL) reflectance and other OCT parameters for glaucoma diagnosis. Patients and Methods: This is a prospective observational study where of 106 normal subjects and 164 perimetric glaucoma (PG) patients. Peripapillary NFL reflectance map, NFL thickness map, optic head analysis of disc, and macular ganglion cell complex thickness were obtained using spectral domain OCT. A hybrid deep learning model combined a fully connected network (FCN) and a convolution neural network (CNN) to develop and combine those OCT maps and parameters to distinguish normal and PG eyes. Two deep learning models were compared based on whether the NFL reflectance map was used as part of the input or not. Results: The hybrid deep learning model with reflectance achieved 0.909 sensitivity at 99% specificity and 0.926 at 95%. The overall accuracy was 0.948 with 0.893 sensitivity and 1.000 specificity, and the AROC was 0.979, which is significantly better than the logistic regression models (p < 0.001). The second best model is the hybrid deep learning model w/o reflectance, which also had significantly higher AROC than logistic regression models (p < 0.001). Logistic regression with reflectance model had slightly higher AROC or sensitivity than the other logistic regression model without reflectance (p = 0.024). Conclusions: Hybrid deep learning model significantly improved the diagnostic accuracy, without or without NFL reflectance. Hybrid deep learning model, combining reflectance/NFL thickness/GCC thickness/ONH parameter, may be a practical model for glaucoma screen purposes.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Focal Loss Analysis of Peripapillary Nerve Fiber Layer Reflectance for Glaucoma Diagnosis
Authors:
Ou Tan,
Dongseok Choi,
Aiyin Chen,
David S. Greenfield,
Brian A. Francis,
Rohit Varma,
Joel S. Schuman,
David Huang,
Advanced Imaging for Glaucoma Study Group
Abstract:
Purpose: To evaluate nerve fiber layer (NFL) reflectance for glaucoma diagnosis using a large dataset. Methods: Participants were imaged with 4.9mm ONH scans using spectral-domain optical coherence tomography (OCT). The NFL reflectance map was reconstructed from 13 concentric rings of optic nerve head(ONH) scan, then processed by an azimuthal filter to reduce directional reflectance bias due to va…
▽ More
Purpose: To evaluate nerve fiber layer (NFL) reflectance for glaucoma diagnosis using a large dataset. Methods: Participants were imaged with 4.9mm ONH scans using spectral-domain optical coherence tomography (OCT). The NFL reflectance map was reconstructed from 13 concentric rings of optic nerve head(ONH) scan, then processed by an azimuthal filter to reduce directional reflectance bias due to variation of beam incidence angle. The peripapillary thickness and reflectance maps were both divided into 96 superpixels. Low-reflectance and low-thickness superpixels were defined as values below the 5th percentile normative reference for that location. Focal reflectance loss was measured by summing loss, relative to the normal reference average, in low-reflectance superpixels. Focal thickness loss was calculated in a similar fashion. The area under receiving characteristic curve (AROC) was used to assess diagnostic accuracy. Results: Fifty-three normal, 196 pre-perimetric, 132 early perimetric, and 59 moderate and advanced perimetric glaucoma participants were included from the Advanced Imaging for Glaucoma Study. Sixty-seven percent of glaucomatous reflectance maps showed characteristic contiguous wedge or diffuse defects. Focal NFL reflectance loss had significantly higher diagnostic accuracy than the best NFL thickness parameters (both map-based and profile-based): AROC 0.80 v. 0.75 (p<0.004) for distinguishing glaucoma eyes from healthy control eyes. The diagnostic sensitivity was also significantly higher at both 99% and 95% specificity operating points. Conclusions: Focal NFL reflectance loss improved glaucoma diagnostic accuracy compared to the standard NFL thickness parameters.
△ Less
Submitted 31 May, 2024;
originally announced June 2024.
-
Reliability for Nerve Fiber Layer Reflectance Using Spectral Domain Optical Coherence Tomography
Authors:
Kabir Hossain,
Ou Tan,
Po-Han Yeh,
Jie Wang,
Elizabeth White,
Dongseok Choi,
David Huang
Abstract:
Purpose: Reliability for Nerve Fiber Layer Reflectance Using Spectral Domain Optical Coherence Tomography (OCT) Methods: The study utilized OCT to scan participants with a cubic 6x6 mm disc scan. NFL reflectance were normalized by the average of bands below NFL and summarized. We selected several reference bands, including the pigment epithelium complex (PPEC), the band between NFL and Bruch's mem…
▽ More
Purpose: Reliability for Nerve Fiber Layer Reflectance Using Spectral Domain Optical Coherence Tomography (OCT) Methods: The study utilized OCT to scan participants with a cubic 6x6 mm disc scan. NFL reflectance were normalized by the average of bands below NFL and summarized. We selected several reference bands, including the pigment epithelium complex (PPEC), the band between NFL and Bruch's membrane (Post-NFL), and the top 50% of pixels with higher values were selected from the Post-NFL band by Post-NFL-Bright. Especially, we also included NFL attenuation coefficient (AC), which was equivalent to NFL reflectance normalized by all pixels below NFL. An experiment was designed to test the NFL reflectance against different levels of attenuation using neutral density filter (NDF). We also evaluated the within-visit and between-visit repeatability using a clinical dataset with normal and glaucoma eyes. Results: The experiment enrolled 20 healthy participants. The clinical dataset selected 22 normal and 55 glaucoma eyes with at least two visits form functional and structural OCT (FSOCT) study. The experiment showed that NFL reflectance normalized PPEC Max and Post-NFL-Bright had lowest dependence, slope=-0.77 and -1.34 dB/optical density on NDF levels, respectively. The clinical data showed that the NFL reflectance metrics normalized by Post-NFL-Bright or Post-NFL-Mean metrics had a trend of better repeatability and reproducibility than others, but the trend was not significant. All metrics demonstrated similar diagnostic accuracy (0.82-0.87), but Post-NFL-Bright provide the best result. Conclusions: The NFL reflectance normalized by the maximum in PPEC had less dependence of the global attenuation followed by Post-NFL-Bright, PPEC/Mean, Post-NFL-Mean and NFL/AC. But NFL reflectance normalized by Post-NFL-Bright had better result in two datasets.
△ Less
Submitted 31 May, 2024;
originally announced June 2024.
-
Input-length-shortening and text generation via attention values
Authors:
Neşet Özkan Tan,
Alex Yuxuan Peng,
Joshua Bensemann,
Qiming Bao,
Tim Hartill,
Mark Gahegan,
Michael Witbrock
Abstract:
Identifying words that impact a task's performance more than others is a challenge in natural language processing. Transformers models have recently addressed this issue by incorporating an attention mechanism that assigns greater attention (i.e., relevance) scores to some words than others. Because of the attention mechanism's high computational cost, transformer models usually have an input-leng…
▽ More
Identifying words that impact a task's performance more than others is a challenge in natural language processing. Transformers models have recently addressed this issue by incorporating an attention mechanism that assigns greater attention (i.e., relevance) scores to some words than others. Because of the attention mechanism's high computational cost, transformer models usually have an input-length limitation caused by hardware constraints. This limitation applies to many transformers, including the well-known bidirectional encoder representations of the transformer (BERT) model. In this paper, we examined BERT's attention assignment mechanism, focusing on two questions: (1) How can attention be employed to reduce input length? (2) How can attention be used as a control mechanism for conditional text generation? We investigated these questions in the context of a text classification task. We discovered that BERT's early layers assign more critical attention scores for text classification tasks compared to later layers. We demonstrated that the first layer's attention sums could be used to filter tokens in a given sequence, considerably decreasing the input length while maintaining good test accuracy. We also applied filtering, which uses a compute-efficient semantic similarities algorithm, and discovered that retaining approximately 6\% of the original sequence is sufficient to obtain 86.5\% accuracy. Finally, we showed that we could generate data in a stable manner and indistinguishable from the original one by only using a small percentage (10\%) of the tokens with high attention scores according to BERT's first layer.
△ Less
Submitted 13 March, 2023;
originally announced March 2023.
-
Scientific Impact of Graph-Based Approaches in Deep Learning Studies -- A Bibliometric Comparison
Authors:
Ilker Turker,
Serhat Orkun Tan
Abstract:
Applying graph-based approaches in deep learning receives more attention over time. This study presents statistical analysis on the use of graph-based approaches in deep learning and examines the scientific impact of the related articles. Processing the data obtained from the Web of Science database, metrics such as the type of the articles, funding availability, indexing type, annual average numb…
▽ More
Applying graph-based approaches in deep learning receives more attention over time. This study presents statistical analysis on the use of graph-based approaches in deep learning and examines the scientific impact of the related articles. Processing the data obtained from the Web of Science database, metrics such as the type of the articles, funding availability, indexing type, annual average number of citations and the number of access were analyzed to quantitatively reveal the effects on the scientific audience. It's outlined that deep learning-based studies gained momentum after year 2013, and the rate of graph-based approaches in all deep learning studies increased linearly from 1% to 4% within the following 10 years. Conference publications scanned in the Conference Proceeding Citation Index (CPCI) on the graph-based approaches receive significantly more citations. The citation counts of the SCI-Expanded and Emerging SCI indexed publications of the two streams are close to each other. While the citation performances of the supported and unsupported publications of the two sides were similar, pure deep learning studies received more citations on the journal publication side and graph-based approaches received more citations on the conference side. Despite their similar performance in recent years, graph-based studies show twice more citation performance as they get older, compared to traditional approaches. Annual average citation performance per article for all deep learning studies is 11.051 in 2014, while it is 22.483 for graph-based studies. Also, despite receiving 16% more access, graph-based papers get almost the same overall citation over time with the pure counterpart. This is an indication that graph-based approaches need a greater bunch of attention to follow, while pure deep learning counterpart is relatively simpler to get inside.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Machine Learning vs. Deep Learning in 5G Networks -- A Comparison of Scientific Impact
Authors:
Ilker Turker,
Serhat Orkun Tan
Abstract:
Introduction of fifth generation (5G) wireless network technology has matched the crucial need for high capacity and speed needs of the new generation mobile applications. Recent advances in Artificial Intelligence (AI) also empowered 5G cellular networks with two mainstreams as machine learning (ML) and deep learning (DL) techniques. Our study aims to uncover the differences in scientific impact…
▽ More
Introduction of fifth generation (5G) wireless network technology has matched the crucial need for high capacity and speed needs of the new generation mobile applications. Recent advances in Artificial Intelligence (AI) also empowered 5G cellular networks with two mainstreams as machine learning (ML) and deep learning (DL) techniques. Our study aims to uncover the differences in scientific impact for these two techniques by the means of statistical bibliometrics. The performed analysis includes citation performance with respect to indexing types, funding availability, journal or conference publishing options together with distributions of these metrics along years to evaluate the popularity trends in a detailed manner. Web of Science (WoS) database host 2245 papers for ML and 1407 papers for DL-related studies. DL studies, starting with 9% rate in 2013, has reached to 45% rate in 2022 among all DL and ML-related studies. Results related to scientific impact indicate that DL studies get slightly more average normalized citation (2.256) compared to ML studies (2.118) in 5G, while SCI-Expanded indexed papers in both sides tend to have similar citation performance (3.165 and 3.162 respectively). ML-related studies those are indexed in ESCI show twice citation performance compared to DL. Conference papers in DL domain and journal papers in ML domain are superior in scientific interest to their counterparts with minor differences. Highest citation performance for ML studies is achieved for year 2014, while this peak is observed for 2017 for DL studies. We can conclude that both publication and citation rate for DL-related papers tend to increase and outperform ML-based studies in 5G domain by the means of citation metrics.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Observing Nearby Nuclei on Paramagnetic Trityls and MOFs via DNP and Electron Decoupling
Authors:
Kong Ooi Tan,
Luming Yang,
Michael Mardini,
Choon Boon Cheong,
Benoit Driesschaert,
Mircea Dincă,
Robert G Griffin
Abstract:
Dynamic nuclear polarization (DNP) is an NMR sensitivity enhancement technique that mediates polarization transfer from unpaired electrons to NMR-active nuclei. Despite its success in elucidating important structural information on biological and inorganic materials, the detailed polarization-transfer pathway-from the electrons to the nearby and then the bulk solvent nuclei, and finally to the mol…
▽ More
Dynamic nuclear polarization (DNP) is an NMR sensitivity enhancement technique that mediates polarization transfer from unpaired electrons to NMR-active nuclei. Despite its success in elucidating important structural information on biological and inorganic materials, the detailed polarization-transfer pathway-from the electrons to the nearby and then the bulk solvent nuclei, and finally to the molecules of interest-remains unclear. In particular, the nuclei in the paramagnetic polarizing agent play significant roles in relaying the enhanced NMR polarizations to more remote nuclei. Despite their importance, the direct NMR observation of these nuclei is challenging because of poor sensitivity. Here, we show that a combined DNP and electron decoupling approach can facilitate direct NMR detection of these nuclei. We achieved an ~80 % improvement in NMR intensity via electron decoupling at 0.35 T and 80 K on trityl radicals. Moreover, we recorded a DNP enhancement factor of $ε$ ~ 90 and ~11 % higher NMR intensity using electron decoupling on a paramagnetic metal-organic framework, magnesium hexaoxytriphenylene (MgHOTP MOF).
△ Less
Submitted 2 August, 2022;
originally announced August 2022.
-
Integrated, stretched, and adiabatic solid effects
Authors:
Yifan Quan,
Jakob Steiner,
Yifu Ouyang,
Kong Ooi Tan,
W. Thomas Wenckebach,
Patrick Hautle,
Robert G. Griffin
Abstract:
This paper presents a theory describing the dynamic nuclear polarization (DNP) process associated with an arbitrary frequency swept microwave pulse. The theory is utilized to explain the integrated solid effect (ISE) as well as the newly discovered stretched solid effect (SSE) and adiabatic solid effect (ASE). It is verified with experiments performed at 9.4 GHz (0.34 T) on single crystals of naph…
▽ More
This paper presents a theory describing the dynamic nuclear polarization (DNP) process associated with an arbitrary frequency swept microwave pulse. The theory is utilized to explain the integrated solid effect (ISE) as well as the newly discovered stretched solid effect (SSE) and adiabatic solid effect (ASE). It is verified with experiments performed at 9.4 GHz (0.34 T) on single crystals of naphthalene doped with pentacene-d14. It is shown that SSE and ASE can be more efficient than ISE. Furthermore, the theory predicts that the efficiency of the SSE improves at high magnetic fields, where the EPR linewidth is small compared to the nuclear Larmor frequency. In addition, we show that ISE, SSE, and ASE are based on similar physical principles and we suggest definitions to distinguish among them.
△ Less
Submitted 16 May, 2022;
originally announced May 2022.
-
A Unified Description for Polarization-Transfer Mechanisms in Magnetic Resonance in Static Solids: Cross Polarization and DNP
Authors:
Zhenfeng Pang,
Sheetal Jain,
Chen Yang,
Xueqian Kong,
Kong Ooi Tan
Abstract:
Polarization transfers are crucial building blocks in magnetic resonance experiments, i.e., they can be used to polarize insensitive nuclei and correlate nuclear spins in multidimensional NMR spectroscopy. The polarization can be transferred either across different nuclear spin species or from electron spins to the relatively low-polarized nuclear spins. The former route occurring in solid-state N…
▽ More
Polarization transfers are crucial building blocks in magnetic resonance experiments, i.e., they can be used to polarize insensitive nuclei and correlate nuclear spins in multidimensional NMR spectroscopy. The polarization can be transferred either across different nuclear spin species or from electron spins to the relatively low-polarized nuclear spins. The former route occurring in solid-state NMR (ssNMR) can be performed via cross polarization (CP), while the latter route is known as dynamic nuclear polarization (DNP). Despite having different operating conditions, we opinionate that both mechanisms are theoretically similar processes in ideal conditions, i.e., the electron is merely another spin-1/2 particle with a much higher gyromagnetic ratio. Here, we show that the CP and DNP processes can be described using a unified theory based on average Hamiltonian theory (AHT) combined with fictitious operators. The intuitive and unified approach has allowed new insights on the cross effect (CE) DNP mechanism, leading to better design of DNP polarizing agents and extending the applications beyond just hyperpolarization. We explore the possibility of exploiting theoretically predicted DNP transients for electron-nucleus distance measurements--like routine dipolar-recoupling experiments in solid-state NMR.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
Designing broadband pulsed dynamic nuclear polarization sequences in static solids
Authors:
Nino Wili,
Anders Bodholt Nielsen,
Laura Alicia Voelker,
Lukas Schreder,
Niels Chr. Nielsen,
Gunnar Jeschke,
Kong Ooi Tan
Abstract:
Dynamic nuclear polarization (DNP) is an NMR hyperpolarization technique that mediates polarization transfer from highly polarized unpaired electrons to NMR-active nuclei via microwave (mw) irradiation. The ability to generate arbitrarily shaped mw pulses using arbitrary waveform generators opens up the opportunity to remarkably improve the robustness and versatility of DNP, in many ways resemblin…
▽ More
Dynamic nuclear polarization (DNP) is an NMR hyperpolarization technique that mediates polarization transfer from highly polarized unpaired electrons to NMR-active nuclei via microwave (mw) irradiation. The ability to generate arbitrarily shaped mw pulses using arbitrary waveform generators opens up the opportunity to remarkably improve the robustness and versatility of DNP, in many ways resembling the early stages of pulsed NMR. We present here novel design principles based on single-spin vector effective Hamiltonian theory to develop new broadband DNP pulse sequences, namely an adiabatic XiX-DNP experiment and a broadband amplitude modulated signal enhanced (BASE) experiment. We demonstrate that the adiabatic BASE pulse sequence may achieve a DNP $^{1}$H enhancement factor of $\sim$ 360, a record that outperforms all previously known pulsed DNP sequences at $\sim$ 0.35 T and 80 K in static solids. The bandwidth of the BASE-DNP experiments is about 3 times the $^{1}$H Larmor frequency ($\sim$50 MHz).
△ Less
Submitted 14 March, 2022;
originally announced March 2022.
-
Skip Letters for Short Supersequence of All Permutations
Authors:
Oliver Tan
Abstract:
A supersequence over a finite set is a sequence that contains as subsequence all permutations of the set. This paper defines an infinite array of methods to create supersequences of decreasing lengths. This yields the shortest known supersequences over larger sets. It also provides the best results asymptotically. It is based on a general proof using a new property called strong completeness. The…
▽ More
A supersequence over a finite set is a sequence that contains as subsequence all permutations of the set. This paper defines an infinite array of methods to create supersequences of decreasing lengths. This yields the shortest known supersequences over larger sets. It also provides the best results asymptotically. It is based on a general proof using a new property called strong completeness. The same technique also can be used to prove existing supersequences which combines the old and new ones into an unified conceptual framework.
△ Less
Submitted 17 January, 2022;
originally announced January 2022.
-
Focal Loss Analysis of Nerve Fiber Layer Reflectance for Glaucoma Diagnosis
Authors:
Ou Tan,
Liang Liu,
Qisheng You,
Jie Wang,
Aiyin Chen,
Eliesa Ing,
John C. Morrison,
Yali Jia,
David Huang
Abstract:
Purpose: To evaluate nerve fiber layer (NFL) reflectance for glaucoma diagnosis. Methods: Participants were imaged with 4.5X4.5-mm volumetric disc scans using spectral-domain optical coherence tomography (OCT). The normalized NFL reflectance map was processed by an azimuthal filter to reduce directional reflectance bias due to variation of beam incidence angle. The peripapillary area of the map wa…
▽ More
Purpose: To evaluate nerve fiber layer (NFL) reflectance for glaucoma diagnosis. Methods: Participants were imaged with 4.5X4.5-mm volumetric disc scans using spectral-domain optical coherence tomography (OCT). The normalized NFL reflectance map was processed by an azimuthal filter to reduce directional reflectance bias due to variation of beam incidence angle. The peripapillary area of the map was divided into 160 superpixels. Average reflectance was the mean of superpixel reflectance. Low-reflectance superpixels were identified as those with NFL reflectance below the 5 percentile normative cutoff. Focal reflectance loss was measure by summing loss in low-reflectance superpixels. Results: Thirty-five normal, 30 pre-perimetric and 35 perimetric glaucoma participants were enrolled. Azimuthal filtering improved the repeatability of the normalized NFL reflectance, as measured by the pooled superpixel standard deviation (SD), from 0.73 to 0.57 dB (p<0.001, paired t-test) and reduced the population SD from 2.14 to 1.78 dB (p<0.001, t-test). Most glaucomatous reflectance maps showed characteristic patterns of contiguous wedge or diffuse defects. Focal NFL reflectance loss had significantly higher diagnostic sensitivity than the best NFL thickness parameter (overall, inferior, or focal loss volume): 53% v. 23% (p=0.027) in PPG eyes and 100% v. 80% (p=0.023) in PG eyes, with the specificity fixed at 99%. Conclusions: Azimuthal filtering reduces the variability of NFL reflectance measurements. Focal NFL reflectance loss has excellent glaucoma diagnostic accuracy compared to the standard NFL thickness parameters. The reflectance map may be useful for localizing NFL defects.
△ Less
Submitted 24 June, 2020;
originally announced June 2020.
-
Linear Transmission of Composite Gaussian Measurements over a Fading Channel under Delay Constraints
Authors:
Onur Tan,
Deniz Gunduz,
Jesus Gomez Vilardebo
Abstract:
Delay constrained linear transmission (LT) strategies are considered for the transmission of composite Gaussian measurements over an additive white Gaussian noise fading channel under an average power constraint. If the channel state information (CSI) is known by both the encoder and decoder, the optimal LT scheme in terms of the average mean-square error distortion is characterized under a strict…
▽ More
Delay constrained linear transmission (LT) strategies are considered for the transmission of composite Gaussian measurements over an additive white Gaussian noise fading channel under an average power constraint. If the channel state information (CSI) is known by both the encoder and decoder, the optimal LT scheme in terms of the average mean-square error distortion is characterized under a strict delay constraint, and a graphical interpretation of the optimal power allocation strategy is presented. Then, for general delay constraints, two LT strategies are proposed based on the solution to a particular multiple measurements-parallel channels scenario. It is shown that the distortion decreases as the delay constraint is relaxed, and when the delay constraint is completely removed, both strategies achieve the optimal performance under certain matching conditions. If the CSI is known only by the decoder, the optimal LT strategy is derived under a strict delay constraint. The extension for general delay constraints is shown to be hard. As a first step towards understanding the structure of the optimal scheme in this case, it is shown that for the multiple measurements-parallel channels scenario, any LT scheme that uses only a one-to-one linear map** between measurements and channels is suboptimal in general.
△ Less
Submitted 10 November, 2015; v1 submitted 26 May, 2015;
originally announced May 2015.
-
Increasing Smart Meter Privacy Through Energy Harvesting and Storage Devices
Authors:
Onur Tan,
Deniz Gunduz,
H. Vincent Poor
Abstract:
Smart meters are key elements for the operation of smart grids. By providing near realtime information on the energy consumption of individual users, smart meters increase the efficiency in generation, distribution and storage of energy in a smart grid. The ability of the utility provider to track users energy consumption inevitably leads to important threats to privacy. In this paper, privacy in…
▽ More
Smart meters are key elements for the operation of smart grids. By providing near realtime information on the energy consumption of individual users, smart meters increase the efficiency in generation, distribution and storage of energy in a smart grid. The ability of the utility provider to track users energy consumption inevitably leads to important threats to privacy. In this paper, privacy in a smart metering system is studied from an information theoretic perspective in the presence of energy harvesting and storage units. It is shown that energy harvesting provides increased privacy by diversifying the energy source, while a storage device can be used to increase both the energy efficiency and the privacy of the user. For given input load and energy harvesting rates, it is shown that there exists a trade-off between the information leakage rate, which is used to measure the privacy of the user, and the wasted energy rate, which is a measure of the energy-efficiency. The impact of the energy harvesting rate and the size of the storage device on this trade-off is also studied.
△ Less
Submitted 3 May, 2013;
originally announced May 2013.
-
Δ- convergence on time scale
Authors:
M. Seyyit Seyyidoglu,
N. Özkan Tan
Abstract:
In the present paper we will give some new notions, such as Δ-convergence and Δ-Cauchy, by using the Δ-density and investigate their relations. It is important to say that, the results presented in this work generalize some of the results mentioned in the theory of statistical convergence.
In the present paper we will give some new notions, such as Δ-convergence and Δ-Cauchy, by using the Δ-density and investigate their relations. It is important to say that, the results presented in this work generalize some of the results mentioned in the theory of statistical convergence.
△ Less
Submitted 21 September, 2011;
originally announced September 2011.
-
A Polynomial Approximation for Arbitrary Functions
Authors:
Michael A. Cohen,
Can Ozan Tan
Abstract:
We describe an expansion of Legendre polynomials, analogous to the Taylor expansion, to approximate arbitrary functions. We show that the polynomial coefficients in Legendre expansion, therefore the whole series, converge to zero much more rapidly compared to the Taylor expansion of the same order. Furthermore, using numerical analysis using sixth-order polynomial expansion, we demonstrate that th…
▽ More
We describe an expansion of Legendre polynomials, analogous to the Taylor expansion, to approximate arbitrary functions. We show that the polynomial coefficients in Legendre expansion, therefore the whole series, converge to zero much more rapidly compared to the Taylor expansion of the same order. Furthermore, using numerical analysis using sixth-order polynomial expansion, we demonstrate that the Legendre polynomial approximation yields an error at least an order of magnitude smaller than the analogous Taylor series approximation. This strongly suggests that Legendre expansions, instead of Taylor expansions, should be used when global accuracy is important.
△ Less
Submitted 12 March, 2012; v1 submitted 2 August, 2011;
originally announced August 2011.
-
Multiplicative Propagation of Error During Recursive Wavelet Estimation
Authors:
Michael A. Cohen,
Can Ozan Tan
Abstract:
Wavelet coefficients are estimated recursively at progressively coarser scales recursively. As a result, the estimation is prone to multiplicative propagation of truncation errors due to quantization and round-off at each stage. Yet, the influence of this propagation on wavelet filter output has not been explored systematically. Through numerical error analysis of a simple, generic sub-band coding…
▽ More
Wavelet coefficients are estimated recursively at progressively coarser scales recursively. As a result, the estimation is prone to multiplicative propagation of truncation errors due to quantization and round-off at each stage. Yet, the influence of this propagation on wavelet filter output has not been explored systematically. Through numerical error analysis of a simple, generic sub-band coding scheme with a half-band low pass finite impulse-response filter for down sampling, we show that truncation error in estimated wavelet filter coefficients can quickly reach unacceptable levels, and may render the results unreliable especially at coarser scales.
△ Less
Submitted 28 July, 2011;
originally announced July 2011.
-
Integral Transformations Between Some Function Spaces On Time Scales
Authors:
Mustafa Seyyit Seyyidoglu,
Neset Ozkan Tan
Abstract:
In this paper we defined some function spaces on time scale which are Banach spaces respect to supremum norm. We study integral transformations which are carry to some important properties between mentioned above function spaces.
In this paper we defined some function spaces on time scale which are Banach spaces respect to supremum norm. We study integral transformations which are carry to some important properties between mentioned above function spaces.
△ Less
Submitted 28 April, 2011;
originally announced April 2011.
-
Cognitive Maps of Complex Systems Show Hierarchical Structure and Scale-Free Properties
Authors:
Uygar Ozesmi,
Can Ozan Tan
Abstract:
Many networks in natural and human-made systems exhibit scale-free properties and are small worlds. Now we show that people's understanding of complex systems in their cognitive maps also follow a scale-free topology (P_k = k^-lambda, lambda [1.24,3.03]; r^2 <= 0.95). People focus on a few attributes, as indicated by a fat tail in the probability distribution of total degree. These few attribute…
▽ More
Many networks in natural and human-made systems exhibit scale-free properties and are small worlds. Now we show that people's understanding of complex systems in their cognitive maps also follow a scale-free topology (P_k = k^-lambda, lambda [1.24,3.03]; r^2 <= 0.95). People focus on a few attributes, as indicated by a fat tail in the probability distribution of total degree. These few attributes are related with many other variables in the system. Many more attributes have very few connections. The scale-free properties in the cognitive maps of people arise despite the fact that their average distances are not different (Wilcoxon sign-rank test, W=78, p=0.75) than random networks of the same size and connection density. The scale-free property manifests itself in the higher hierarchical structure compared to random networks (Wilcoxon sign-rank test, W=12, p=0.03). People use relatively short explanations to describe systems. These findings may help us to better understand people's perceptions, especially when it comes to decision-making, conflict resolution, politics and management.
△ Less
Submitted 16 December, 2006;
originally announced December 2006.
-
Statistical Predictive Models in Ecology: Comparison of Performances and Assessment of Applicability
Authors:
Can Ozan Tan,
Uygar Ozesmi,
Meryem Beklioglu,
Esra Per,
Bahtiyar Kurt
Abstract:
Ecological systems are governed by complex interactions which are mainly nonlinear. In order to capture this complexity and nonlinearity, statistical models recently gained popularity. However, although these models are commonly applied in ecology, there are no studies to date aiming to assess the applicability and performance. We provide an overview for nature of the wide range of the data sets…
▽ More
Ecological systems are governed by complex interactions which are mainly nonlinear. In order to capture this complexity and nonlinearity, statistical models recently gained popularity. However, although these models are commonly applied in ecology, there are no studies to date aiming to assess the applicability and performance. We provide an overview for nature of the wide range of the data sets and predictive variables, from both aquatic and terrestrial ecosystems with different scales of time-dependent dynamics, and the applicability and robustness of predictive modeling methods on such data sets by comparing different statistical modeling approaches. The methods considered k-NN, LDA, QDA, generalized linear models (GLM) feedforward multilayer backpropagation networks and pseudo-supervised network ARTMAP. For ecosystems involving time-dependent dynamics and periodicities whose frequency are possibly less than the time scale of the data considered, GLM and connectionist neural network models appear to be most suitable and robust, provided that a predictive variable reflecting these time-dependent dynamics included in the model either implicitly or explicitly. For spatial data, which does not include any time-dependence comparable to the time scale covered by the data, on the other hand, neighborhood based methods such as k-NN and ARTMAP proved to be more robust than other methods considered in this study. In addition, for predictive modeling purposes, first a suitable, computationally inexpensive method should be applied to the problem at hand a good predictive performance of which would render the computational cost and efforts associated with complex variants unnecessary.
△ Less
Submitted 16 October, 2005;
originally announced October 2005.
-
Methodological Issues in Building, Training, and Testing Artificial Neural Networks
Authors:
Stacy L. Ozesmi,
Uygar Ozesmi,
Can Ozan Tan
Abstract:
We review the use of artificial neural networks, particularly the feedforward multilayer perceptron with back-propagation for training (MLP), in ecological modelling. Overtraining on data or giving vague references to how it was avoided is the major problem. Various methods can be used to determine when to stop training in artificial neural networks: 1) early stop** based on cross-validation,…
▽ More
We review the use of artificial neural networks, particularly the feedforward multilayer perceptron with back-propagation for training (MLP), in ecological modelling. Overtraining on data or giving vague references to how it was avoided is the major problem. Various methods can be used to determine when to stop training in artificial neural networks: 1) early stop** based on cross-validation, 2) stop** after a analyst defined error is reached or after the error levels off, 3) use of a test data set. We do not recommend the third method as the test data set is then not independent of model development. Many studies used the testing data to optimize the model and training. Although this method may give the best model for that set of data it does not give generalizability or improve understanding of the study system. The importance of an independent data set cannot be overemphasized as we found dramatic differences in model accuracy assessed with prediction accuracy on the training data set, as estimated with bootstrap**, and from use of an independent data set. The comparison of the artificial neural network with a general linear model (GLM) as a standard procedure is recommended because a GLM may perform as well or better than the MLP. MLP models should not be treated as black box models but instead techniques such as sensitivity analyses, input variable relevances, neural interpretation diagrams, randomization tests, and partial derivatives should be used to make the model more transparent, and further our ecological understanding which is an important goal of the modelling process. Based on our experience we discuss how to build a MLP model and how to optimize the parameters and architecture.
△ Less
Submitted 7 October, 2005;
originally announced October 2005.
-
Generalizability of Artificial Neural Network Models in Ecological Applications: Predicting Nest Occurrence and Breeding Success of the Red-winged Blackbird Agelaius phoeniceus
Authors:
Uygar Ozesmi,
Can Ozan Tan,
Stacy L. Ozesmi,
Raleigh J. Robertson
Abstract:
Separate artificial neural network (ANN) models were developed from data in two geographical regions and years apart for a marsh-nesting bird, the red-winged blackbird Agelaius phoeniceus. Each model was independently tested on the spatially and temporally distinct data from the other region to determine how generalizable it was. The first model was developed to predict occurrence of nests in tw…
▽ More
Separate artificial neural network (ANN) models were developed from data in two geographical regions and years apart for a marsh-nesting bird, the red-winged blackbird Agelaius phoeniceus. Each model was independently tested on the spatially and temporally distinct data from the other region to determine how generalizable it was. The first model was developed to predict occurrence of nests in two wetlands on Lake Erie, Ohio in 1995 and 1996. The second model was developed to predict breeding success in two marshes in Connecticut, USA in 1969 and 1970. Independent variables were vegetation durability, stem density, stem/nest height, distance to open water, distance to edge, and water depth. With input variable relevances, sensitivity analyses and neural interpretation diagrams we were able to understand how the different models predicted nest occurrence and breeding success and compare their differences and similarities. Both models also predicted increasing nest occurrence/breeding success with increasing water depth under the nest and increasing distance to edge. However, relationships for prediction differed in the models. Generalizability of the models was poor except when the marshes had similar values of important variables in the model. ANN models performed better than generalized linear models (GLM) on marshes with similar structures. Generalizability of the models did not differ in nest occurrence and breeding success data. Extensive testing also showed that the GLMs were not necessarily more generalizable than ANNs, suggesting that ANN models make good definitions of a study system but are too specific to generalize well to other ecologically complex systems unless input variable distributions are very similar.
△ Less
Submitted 6 October, 2005;
originally announced October 2005.
-
Predictive Models for Characterization of Ecological Data
Authors:
Can Ozan Tan,
Uygar Ozesmi,
Bahtiyar Kurt
Abstract:
Although ARTMAP and ART-based models were introduced in early 70's they were not used in characterizing and classifying ecological observations. ART-based models have been extensively used for classification models based on satellite imagery. This report, to our knowledge, is the first application of ART-based methods and specifically ARTMAP for predicting habitat selection and spatial distribut…
▽ More
Although ARTMAP and ART-based models were introduced in early 70's they were not used in characterizing and classifying ecological observations. ART-based models have been extensively used for classification models based on satellite imagery. This report, to our knowledge, is the first application of ART-based methods and specifically ARTMAP for predicting habitat selection and spatial distribution of species. We compare the performance of ARTMAP to assess the breeding success of three bird species (Lanius senator, Hippolais pallida, and Calandrella brachydactyla) based on multi-spectral satellite imagery and environmental variables. ARTMAP is superior both in terms of performance (percent correctly classified - pcc = 1.00) and generalizability (pcc >0.96) to those of feedforward multilayer backpropogation (>0.87, >0.65), linear and quadratic discriminant analysis (>0.48, >0.46) and k-nearest neighbor (>0.82, >0.66) methods. Compared to other methods, ARTMAP is able to incorporate new observations with far less computational effort and can easily add data to already trained models.
△ Less
Submitted 6 October, 2005;
originally announced October 2005.
-
A Cognitive Model of an Epistemic Community: Map** the Dynamics of Shallow Lake Ecosystems
Authors:
Can O. Tan,
Uygar Ozesmi
Abstract:
We used fuzzy cognitive map** (FCM) to develop a generic shallow lake ecosystem model by augmenting the individual cognitive maps drawn by 8 scientists working in the area of shallow lake ecology. We calculated graph theoretical indices of the individual cognitive maps and the collective cognitive map produced by augmentation. The graph theoretical indices revealed internal cycles showing non-…
▽ More
We used fuzzy cognitive map** (FCM) to develop a generic shallow lake ecosystem model by augmenting the individual cognitive maps drawn by 8 scientists working in the area of shallow lake ecology. We calculated graph theoretical indices of the individual cognitive maps and the collective cognitive map produced by augmentation. The graph theoretical indices revealed internal cycles showing non-linear dynamics in the shallow lake ecosystem. The ecological processes were organized democratically without a top-down hierarchical structure. The steady state condition of the generic model was a characteristic turbid shallow lake ecosystem since there were no dynamic environmental changes that could cause shifts between a turbid and a clearwater state, and the generic model indicated that only a dynamic disturbance regime could maintain the clearwater state. The model developed herein captured the empirical behavior of shallow lakes, and contained the basic model of the Alternative Stable States Theory. In addition, our model expanded the basic model by quantifying the relative effects of connections and by extending it. In our expanded model we ran 4 simulations: harvesting submerged plants, nutrient reduction, fish removal without nutrient reduction, and biomanipulation. Only biomanipulation, which included fish removal and nutrient reduction, had the potential to shift the turbid state into clearwater state. The structure and relationships in the generic model as well as the outcomes of the management simulations were supported by actual field studies in shallow lake ecosystems. Thus, fuzzy cognitive map** methodology enabled us to understand the complex structure of shallow lake ecosystems as a whole and obtain a valid generic model based on tacit knowledge of experts in the field.
△ Less
Submitted 18 September, 2005;
originally announced September 2005.
