Showing 1–50 of 57 results for author: James, A P

TMS-Crossbars with Tactile Sensing

Authors: R. Chithra, A. R. Aswani, A. P. James

Abstract: The first stage of tactile sensing is data acquisition using tactile sensors and the sensed data is transmitted to the central unit for neuromorphic computing. The memristive crossbars were proposed to use as synapses in neuromorphic computing but device intelligence at the sensor level are not investigated in literature. We propose the concept of Transistor Memristor Sensor (TMS)-crossbar by incl… ▽ More The first stage of tactile sensing is data acquisition using tactile sensors and the sensed data is transmitted to the central unit for neuromorphic computing. The memristive crossbars were proposed to use as synapses in neuromorphic computing but device intelligence at the sensor level are not investigated in literature. We propose the concept of Transistor Memristor Sensor (TMS)-crossbar by including sensor to memristor crossbar array configuration in the input layer of the neural network architecture. 2 possible cell configurations of TMS crossbar arrays: 1 Transistor 1 Memristor 1 Sensor (1T1M1S) and 2 Transistor 1 Memristor 1 Sensor (2T1M1S) are presented. We verified the proposed TMS-crossbar in the practical design of analog neural networks based Braille character recognition system. The proposed design is verified with SPICE simulations using circuit equivalent of FLX-A501 force sensor, TiO$_2$ memristors and low power 22nm high-k CMOS transistors. The proposed analog neuromorphic computing system presents a scalable solution and is possible to encode 125 symbols with good accuracy in comparison with other Braille character recognition systems in the literature. The benefits of analog implementation of the TMS crossbar arrays is substantiated with results of accuracy, area and power requirements in comparison with the binary counterparts. △ Less

Submitted 14 November, 2021; originally announced November 2021.

Comments: 5 pages, 7 figures, TCAS2

Journal ref: IEEE Transactions on Circuits and Systems--II: Express Briefs, 2021

Analog Neural Computing with Super-resolution Memristor Crossbars

Authors: A. P. James, L. O. Chua

Abstract: Memristor crossbar arrays are used in a wide range of in-memory and neuromorphic computing applications. However, memristor devices suffer from non-idealities that result in the variability of conductive states, making programming them to a desired analog conductance value extremely difficult as the device ages. In theory, memristors can be a nonlinear programmable analog resistor with memory prop… ▽ More Memristor crossbar arrays are used in a wide range of in-memory and neuromorphic computing applications. However, memristor devices suffer from non-idealities that result in the variability of conductive states, making programming them to a desired analog conductance value extremely difficult as the device ages. In theory, memristors can be a nonlinear programmable analog resistor with memory properties that can take infinite resistive states. In practice, such memristors are hard to make, and in a crossbar, it is confined to a limited set of stable conductance values. The number of conductance levels available for a node in the crossbar is defined as the crossbar's resolution. This paper presents a technique to improve the resolution by building a super-resolution memristor crossbar with nodes having multiple memristors to generate r-simplicial sequence of unique conductance values. The wider the range and number of conductance values, the higher the crossbar's resolution. This is particularly useful in building analog neural network (ANN) layers, which are proven to be one of the go-to approaches for forming a neural network layer in implementing neuromorphic computations. △ Less

Submitted 10 May, 2021; originally announced May 2021.

Comments: 13 pages

Journal ref: IEEE Transactions on Circuits and Systems 1: Regular Papers, 2021 (Special Issue for 50th Birthday of Memristor)

AM-DCGAN: Analog Memristive Hardware Accelerator for Deep Convolutional Generative Adversarial Networks

Authors: Olga Krestinskaya, Bhaskar Choubey, Alex Pappachen James

Abstract: Generative Adversarial Network (GAN) is a well known computationally complex algorithm requiring signficiant computational resources in software implementations including large amount of data to be trained. This makes its implementation in edge devices with conventional microprocessor hardware a slow and difficult task. In this paper, we propose to accelerate the computationally intensive GAN usin… ▽ More Generative Adversarial Network (GAN) is a well known computationally complex algorithm requiring signficiant computational resources in software implementations including large amount of data to be trained. This makes its implementation in edge devices with conventional microprocessor hardware a slow and difficult task. In this paper, we propose to accelerate the computationally intensive GAN using memristive neural networks in analog domain. We present a fully analog hardware design of Deep Convolutional GAN (DCGAN) based on CMOS-memristive convolutional and deconvolutional networks simulated using 180nm CMOS technology. △ Less

Submitted 20 June, 2020; originally announced July 2020.

An overview of memristive cryptography

Authors: Alex Pappachen James

Abstract: Smaller, smarter and faster edge devices in the Internet of things era demands secure data analysis and transmission under resource constraints of hardware architecture. Lightweight cryptography on edge hardware is an emerging topic that is essential to ensure data security in near-sensor computing systems such as mobiles, drones, smart cameras, and wearables. In this article, the current state of… ▽ More Smaller, smarter and faster edge devices in the Internet of things era demands secure data analysis and transmission under resource constraints of hardware architecture. Lightweight cryptography on edge hardware is an emerging topic that is essential to ensure data security in near-sensor computing systems such as mobiles, drones, smart cameras, and wearables. In this article, the current state of memristive cryptography is placed in the context of lightweight hardware cryptography. The paper provides a brief overview of the traditional hardware lightweight cryptography and cryptanalysis approaches. The contrast for memristive cryptography with respect to traditional approaches is evident through this article, and need to develop a more concrete approach to develo** memristive cryptanalysis to test memristive cryptographic approaches is highlighted. △ Less

Submitted 3 June, 2019; originally announced June 2019.

Comments: European Physical Journal: Special Topics, Special Issue on "Memristor-based systems: Nonlinearity, dynamics and application

Wafer Quality Inspection using Memristive LSTM, ANN, DNN and HTM

Authors: Kazybek Adam, Kamilya Smagulova, Olga Krestinskaya, Alex Pappachen James

Abstract: The automated wafer inspection and quality control is a complex and time-consuming task, which can speed up using neuromorphic memristive architectures, as a separate inspection device or integrating directly into sensors. This paper presents the performance analysis and comparison of different neuromorphic architectures for patterned wafer quality inspection and classification. The application of… ▽ More The automated wafer inspection and quality control is a complex and time-consuming task, which can speed up using neuromorphic memristive architectures, as a separate inspection device or integrating directly into sensors. This paper presents the performance analysis and comparison of different neuromorphic architectures for patterned wafer quality inspection and classification. The application of non-volatile memristive devices in these architectures ensures low power consumption, small on-chip area scalability. We demonstrate that Long-Short Term Memory (LSTM) outperforms other architectures for the same number of training iterations, and has relatively low on-chip area and power consumption. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Journal ref: IEEE Electrical Design of Advanced Packaging and Systems Symposium, 2018

Impact of Integrated Circuit Packaging on Synaptic Dynamics of Memristive Devices

Authors: Aidana Irmanova, Grant A. Ellis, Alex Pappachen James

Abstract: The memristor can be used as non volatile memory (NVM) and for emulating neuron behavior. It has the ability to switch between low resistance $R_{on}$ and high resistance values $R_{off}$, and exhibit the synaptic dynamic behaviour such as potentiation and depression. This paper presents a study on potentiation and depression of memristors in Quad Flat Pack. A comparison is drawn between the memri… ▽ More The memristor can be used as non volatile memory (NVM) and for emulating neuron behavior. It has the ability to switch between low resistance $R_{on}$ and high resistance values $R_{off}$, and exhibit the synaptic dynamic behaviour such as potentiation and depression. This paper presents a study on potentiation and depression of memristors in Quad Flat Pack. A comparison is drawn between the memristors with and without the impact of parasitics of packaging, using measured data and equivalent circuit models. The parameters in memristor and packaging models for the SPICE simulations were determined using measured data to reflect the memristor parasitics in Quad Flat Packs. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Journal ref: IEEE Electrical Design of Advanced Packaging and Systems Symposium, 2018

Memristive LSTM network hardware architecture for time-series predictive modeling problem

Authors: Kazybek Adam, Kamilya Smagulova, Alex Pappachen James

Abstract: Analysis of time-series data allows to identify long-term trends and make predictions that can help to improve our lives. With the rapid development of artificial neural networks, long short-term memory (LSTM) recurrent neural network (RNN) configuration is found to be capable in dealing with time-series forecasting problems where data points are time-dependent and possess seasonality trends. Gate… ▽ More Analysis of time-series data allows to identify long-term trends and make predictions that can help to improve our lives. With the rapid development of artificial neural networks, long short-term memory (LSTM) recurrent neural network (RNN) configuration is found to be capable in dealing with time-series forecasting problems where data points are time-dependent and possess seasonality trends. Gated structure of LSTM cell and flexibility in network topology (one-to-many, many-to-one, etc.) allows to model systems with multiple input variables and control several parameters such as the size of the look-back window to make a prediction and number of time steps to be predicted. These make LSTM attractive tool over conventional methods such as autoregression models, the simple average, moving average, naive approach, ARIMA, Holt's linear trend method, Holt's Winter seasonal method, and others. In this paper, we propose a hardware implementation of LSTM network architecture for time-series forecasting problem. All simulations were performed using TSMC 0.18um CMOS technology and HP memristor model. △ Less

Submitted 9 September, 2018; originally announced September 2018.

Comments: IEEE Asia Pacific Conference on Circuits and Systems, 2018

Programmable Memristive Threshold Logic Gate Array

Authors: Olga Krestinskaya, Akshay Kumar Maan, Alex Pappachen James

Abstract: This paper proposes the implementation of programmable threshold logic gate (TLG) crossbar array based on modified TLG cells for high speed processing and computation. The proposed TLG array operation does not depend on input signal and time pulses, comparing to the existing architectures. The circuit is implemented using TSMC $180nm$ CMOS technology. The on-chip area and power dissipation of the… ▽ More This paper proposes the implementation of programmable threshold logic gate (TLG) crossbar array based on modified TLG cells for high speed processing and computation. The proposed TLG array operation does not depend on input signal and time pulses, comparing to the existing architectures. The circuit is implemented using TSMC $180nm$ CMOS technology. The on-chip area and power dissipation of the simulated $3\times 4$ TLG array is $1463 μm^2$ and $425 μW$, respectively. △ Less

Submitted 2 September, 2018; originally announced September 2018.

Comments: IEEE Asia Pacific Conference on Circuits and Systems (IEEE APCCAS 2018)

Learning in Memristive Neural Network Architectures using Analog Backpropagation Circuits

Authors: Olga Krestinskaya, Khaled Nabil Salama, Alex Pappachen James

Abstract: The on-chip implementation of learning algorithms would speed-up the training of neural networks in crossbar arrays. The circuit level design and implementation of backpropagation algorithm using gradient descent operation for neural network architectures is an open problem. In this paper, we proposed the analog backpropagation learning circuits for various memristive learning architectures, such… ▽ More The on-chip implementation of learning algorithms would speed-up the training of neural networks in crossbar arrays. The circuit level design and implementation of backpropagation algorithm using gradient descent operation for neural network architectures is an open problem. In this paper, we proposed the analog backpropagation learning circuits for various memristive learning architectures, such as Deep Neural Network (DNN), Binary Neural Network (BNN), Multiple Neural Network (MNN), Hierarchical Temporal Memory (HTM) and Long-Short Term Memory (LSTM). The circuit design and verification is done using TSMC 180nm CMOS process models, and TiO2 based memristor models. The application level validations of the system are done using XOR problem, MNIST character and Yale face image databases △ Less

Submitted 31 August, 2018; originally announced August 2018.

Journal ref: IEEE Transactions on Circuits and Systems 1: Regular Papers, 2018

Real-time Analog Pixel-to-pixel Dynamic Frame Differencing with Memristive Sensing Circuits

Authors: Olga Krestinskaya, Alex Pappachen James

Abstract: In this paper, we propose an analog pixel differencing circuit for differentiating pixels between frames directly from CMOS pixels. The analog information processing at sensor is a topic of growing appeal to develop edge AI devices. The proposed circuit is integrated into a pixel-parallel and pixel-column architectures. The proposed system is design using TSMC $180nm$ CMOS technology. The power di… ▽ More In this paper, we propose an analog pixel differencing circuit for differentiating pixels between frames directly from CMOS pixels. The analog information processing at sensor is a topic of growing appeal to develop edge AI devices. The proposed circuit is integrated into a pixel-parallel and pixel-column architectures. The proposed system is design using TSMC $180nm$ CMOS technology. The power dissipation of the proposed circuit is $96.64mW$, and on-chip ares is $531.66 μm^2$. The architectures are tested for moving object detection application. △ Less

Submitted 21 August, 2018; originally announced August 2018.

Comments: IEEE SENSORS 2018

Binary Weighted Memristive Analog Deep Neural Network for Near-Sensor Edge Processing

Authors: Olga Krestinskaya, Alex Pappachen James

Abstract: The memristive crossbar aims to implement analog weighted neural network, however, the realistic implementation of such crossbar arrays is not possible due to limited switching states of memristive devices. In this work, we propose the design of an analog deep neural network with binary weight update through backpropagation algorithm using binary state memristive devices. We show that such network… ▽ More The memristive crossbar aims to implement analog weighted neural network, however, the realistic implementation of such crossbar arrays is not possible due to limited switching states of memristive devices. In this work, we propose the design of an analog deep neural network with binary weight update through backpropagation algorithm using binary state memristive devices. We show that such networks can be successfully used for image processing task and has the advantage of lower power consumption and small on-chip area in comparison with digital counterparts. The proposed network was benchmarked for MNIST handwritten digits recognition achieving an accuracy of approximately 90%. △ Less

Submitted 2 August, 2018; originally announced August 2018.

Journal ref: IEEE NANO 2018

Approximate Probabilistic Neural Networks with Gated Threshold Logic

Authors: Olga Krestinskaya, Alex Pappachen James

Abstract: Probabilistic Neural Network (PNN) is a feed-forward artificial neural network developed for solving classification problems. This paper proposes a hardware implementation of an approximated PNN (APNN) algorithm in which the conventional exponential function of the PNN is replaced with gated threshold logic. The weights of the PNN are approximated using a memristive crossbar architecture. In parti… ▽ More Probabilistic Neural Network (PNN) is a feed-forward artificial neural network developed for solving classification problems. This paper proposes a hardware implementation of an approximated PNN (APNN) algorithm in which the conventional exponential function of the PNN is replaced with gated threshold logic. The weights of the PNN are approximated using a memristive crossbar architecture. In particular, the proposed algorithm performs normalization of the training weights, and quantization into 16 levels which significantly reduces the complexity of the circuit. △ Less

Submitted 2 August, 2018; originally announced August 2018.

Journal ref: IEEE NANO 2018

Memristor-based Synaptic Sampling Machines

Authors: Irina Dolzhikova, Khaled Salama, Vipin Kizheppatt, Alex Pappachen James

Abstract: Synaptic Sampling Machine (SSM) is a type of neural network model that considers biological unreliability of the synapses. We propose the circuit design of the SSM neural network which is realized through the memristive-CMOS crossbar structure with the synaptic sampling cell (SSC) being used as a basic stochastic unit. The increase in the edge computing devices in the Internet of things era, drive… ▽ More Synaptic Sampling Machine (SSM) is a type of neural network model that considers biological unreliability of the synapses. We propose the circuit design of the SSM neural network which is realized through the memristive-CMOS crossbar structure with the synaptic sampling cell (SSC) being used as a basic stochastic unit. The increase in the edge computing devices in the Internet of things era, drives the need for hardware acceleration for data processing and computing. The computational considerations of the processing speed and possibility for the real-time realization pushes the synaptic sampling algorithm that demonstrated promising results on software for hardware implementation. △ Less

Submitted 2 August, 2018; originally announced August 2018.

Journal ref: IEEE NANO, 2018

Neuro-memristive Circuits for Edge Computing: A review

Authors: Olga Krestinskaya, Alex Pappachen James, Leon O. Chua

Abstract: The volume, veracity, variability, and velocity of data produced from the ever-increasing network of sensors connected to Internet pose challenges for power management, scalability, and sustainability of cloud computing infrastructure. Increasing the data processing capability of edge computing devices at lower power requirements can reduce several overheads for cloud computing solutions. This pap… ▽ More The volume, veracity, variability, and velocity of data produced from the ever-increasing network of sensors connected to Internet pose challenges for power management, scalability, and sustainability of cloud computing infrastructure. Increasing the data processing capability of edge computing devices at lower power requirements can reduce several overheads for cloud computing solutions. This paper provides the review of neuromorphic CMOS-memristive architectures that can be integrated into edge computing devices. We discuss why the neuromorphic architectures are useful for edge devices and show the advantages, drawbacks and open problems in the field of neuro-memristive circuits for edge computing. △ Less

Submitted 27 November, 2018; v1 submitted 1 July, 2018; originally announced July 2018.

Journal ref: IEEE Transactions on Neural Networks and Learning Systems, 2019

Design of CMOS-memristor Circuits for LSTM architecture

Authors: Kamilya Smagulova, Kazybek Adam, Olga Krestinskaya, Alex Pappachen James

Abstract: Long Short-Term memory (LSTM) architecture is a well-known approach for building recurrent neural networks (RNN) useful in sequential processing of data in application to natural language processing. The near-sensor hardware implementation of LSTM is challenged due to large parallelism and complexity. We propose a 0.18 m CMOS, GST memristor LSTM hardware architecture for near-sensor processing. Th… ▽ More Long Short-Term memory (LSTM) architecture is a well-known approach for building recurrent neural networks (RNN) useful in sequential processing of data in application to natural language processing. The near-sensor hardware implementation of LSTM is challenged due to large parallelism and complexity. We propose a 0.18 m CMOS, GST memristor LSTM hardware architecture for near-sensor processing. The proposed system is validated in a forecasting problem based on Keras model. △ Less

Submitted 6 June, 2018; originally announced June 2018.

Journal ref: IEEE International Conferences on Electron Devices and Solid-State Circuits, 2018

Implementation of Chua's chaotic oscillator with an HP memristor

Authors: Muratkhan Abdirash, Irina Dolzhikova, Alex Pappachen James

Abstract: This paper proposes an innovative chaotic circuit based on Chua's oscillator. It combines traditional realization of a non-linear resistor in Chua's chaotic oscillator with a promising memristive circuitry. This mixed implementation connects old research works that were focused on diodes with relatively new research papers that are, now, concentrated on memristors. As a result, more reliable chaot… ▽ More This paper proposes an innovative chaotic circuit based on Chua's oscillator. It combines traditional realization of a non-linear resistor in Chua's chaotic oscillator with a promising memristive circuitry. This mixed implementation connects old research works that were focused on diodes with relatively new research papers that are, now, concentrated on memristors. As a result, more reliable chaotic circuit with an HP memristor is obtained that could be used as a source of randomness. Dynamic behavior of the circuit is studied by obtaining fft analysis, different chaotic attractors and Lyapunov exponent spectrum. The results show that the addition of a memristor enhances chaotic behavior of the circuit while maintaining the same power dissipation. △ Less

Submitted 18 May, 2018; originally announced May 2018.

Effects of Memristors on Fully Differential Transimpedance Amplifier Performance

Authors: Berik Argimbayev, Olga Krestinskaya, Alex Pappachen James

Abstract: The progress of the Internet of Things(IoT) technologies and applications requires the efficient low power circuits and architectures to maintain and improve the performance of the increasingly growing data processing systems. Memristive circuits and substitution of energy-consuming devices with memristors is a promising solution to reduce on-chip area and power dissipation of the architectures. I… ▽ More The progress of the Internet of Things(IoT) technologies and applications requires the efficient low power circuits and architectures to maintain and improve the performance of the increasingly growing data processing systems. Memristive circuits and substitution of energy-consuming devices with memristors is a promising solution to reduce on-chip area and power dissipation of the architectures. In this paper, we proposed a CMOS-memristive fully differential transimpedance amplifier and assess the impact of memristors on the amplifier performance. The fully differential amplifiers were simulated using 180nm CMOS technology and have 5.3-23MHz bandwidths and 2.3-5.7k$Ω$ transimpedance gains with a 1pF load. We compare the memristor based amplifier with conventional architecture. The gain, frequency response, linear range, power consumption, area, total harmonic distortion and performance variations with temperature are reported. △ Less

Submitted 20 May, 2018; originally announced May 2018.

CMOS-Memristive Analog Multiplier Design

Authors: Ileskhan Kalysh, Olga Krestinskaya, Alex Pappachen James

Abstract: This paper proposes four quadrant analog multiplier using CMOS-memristor circuit. Currently, there are plenty of analog multipliers using resistors and CMOS transistors. They can attain perfect multiplication but have several disadvantages such as lower processing speed, higher power consumption and larger chip areas. Memristor based circuits are introduced to resolve the mentioned drawbacks. In t… ▽ More This paper proposes four quadrant analog multiplier using CMOS-memristor circuit. Currently, there are plenty of analog multipliers using resistors and CMOS transistors. They can attain perfect multiplication but have several disadvantages such as lower processing speed, higher power consumption and larger chip areas. Memristor based circuits are introduced to resolve the mentioned drawbacks. In this paper current mode four quadrant multiplier based on squaring circuits is taken as a framework, and CMOS transistors are replaced with memristors. The circuit design is simulated with SPICE, and variability analysis and performance variation with temperature is performed. The proposed circuit allows faster processing with retained data while dissipating less power retaining the multiplication characteristics. △ Less

Submitted 27 August, 2019; v1 submitted 20 May, 2018; originally announced May 2018.

Comments: the paper is no more relevant and up-to-date

Analysis of Multilayer Perceptron with Rectifier Linear Unit Activation Function

Authors: Meirambek Mukhametkhan, Olga Krestinskaya, Alex Pappachen James

Abstract: The implementation of analog neural network and online analog learning circuits based on memristive crossbar has been intensively explored in recent years. The implementation of various activation functions is important, especially for deep leaning neural networks. There are several implementations of sigmoid and tangent activation function, while the implementation of the neural networks with lin… ▽ More The implementation of analog neural network and online analog learning circuits based on memristive crossbar has been intensively explored in recent years. The implementation of various activation functions is important, especially for deep leaning neural networks. There are several implementations of sigmoid and tangent activation function, while the implementation of the neural networks with linear activation functions is an open problem. Therefore, this paper introduces a multilayer perceptron design with linear activation function. The temperature and noise analysis was performed. The perceptron showed a good performance and strong durability to temperature changes. △ Less

Submitted 27 August, 2019; v1 submitted 20 May, 2018; originally announced May 2018.

Comments: the paper is no more relevant and up-to-date

Variability analysis of Memristor-based Sigmoid Function

Authors: Nursultan Kaiyrbekov, Olga Krestinskaya, Alex Pappachen James

Abstract: Activation functions are widely used in neural networks to decide the activation value of the neural unit based upon linear combinations of the weighted inputs. The effective implementation of activation function is highly important, as they help to represent non-linear complex functional map**s between inputs and outputs of the neural network. One of the non-linear approaches is to use a sigmoi… ▽ More Activation functions are widely used in neural networks to decide the activation value of the neural unit based upon linear combinations of the weighted inputs. The effective implementation of activation function is highly important, as they help to represent non-linear complex functional map**s between inputs and outputs of the neural network. One of the non-linear approaches is to use a sigmoid function. Therefore, there is a growing need in enhancing the performance of sigmoid circuits. In this paper, the main objective is to modify existing current mirror based sigmoid model by replacing CMOS transistors with memristor devices. This model was tested varying different circuit parameters, transistor size and temperature. The the area, power and noise in the modified CMOS-memristive sigmoid circuit are shown. The application of memristors in the sigmoid circuit results in higher component density in an on-chip area, allowing a reduction of power and area by 7$\%$. The proposed sigmoid circuit was simulated in SPICE using 180nm TSMC CMOS technology. △ Less

Submitted 27 August, 2019; v1 submitted 19 May, 2018; originally announced May 2018.

Comments: the paper is no more relevant and up-to-date

Implementation of True Random Number Generator based on Double-Scroll Attractor circuit with GST memristor emulator

Authors: Togzhan Abzhanova, Irina Dolzhikova, Alex Pappachen James

Abstract: The cryptographic security provided by various techniques of random number generator (RNG) construction is one of the develo** researches areas today. Among various types of RNG, the true random bit generator (TRBG) can be considered as the most unpredictable and most secured because its randomness seed is generated from chaotic sources. This paper proposes a design of TRBG model based on double… ▽ More The cryptographic security provided by various techniques of random number generator (RNG) construction is one of the develo** researches areas today. Among various types of RNG, the true random bit generator (TRBG) can be considered as the most unpredictable and most secured because its randomness seed is generated from chaotic sources. This paper proposes a design of TRBG model based on double-scroll attractors circuits with GST memristor. After implementation and simulation of the chaotic circuit with GST memristor emulator, the chaotic behavior of the output voltage and inductor current were received. Moreover, their dependence on the input voltage revealed the close to double-scroll form. The randomness generated from the proposed circuit was tested by receiving Fast Fourier Transform (FFT) and Lyapunov exponents of the output voltage. △ Less

Submitted 19 May, 2018; v1 submitted 17 May, 2018; originally announced May 2018.

Hierarchical Temporal Memory using Memristor Networks: A Survey

Authors: Olga Krestinskaya, Irina Dolzhikova, Alex Pappachen James

Abstract: This paper presents a survey of the currently available hardware designs for implementation of the human cortex inspired algorithm, Hierarchical Temporal Memory (HTM). In this review, we focus on the state of the art advances of memristive HTM implementation and related HTM applications. With the advent of edge computing, HTM can be a potential algorithm to implement on-chip near sensor data proce… ▽ More This paper presents a survey of the currently available hardware designs for implementation of the human cortex inspired algorithm, Hierarchical Temporal Memory (HTM). In this review, we focus on the state of the art advances of memristive HTM implementation and related HTM applications. With the advent of edge computing, HTM can be a potential algorithm to implement on-chip near sensor data processing. The comparison of analog memristive circuit implementations with the digital and mixed-signal solutions are provided. The advantages of memristive HTM over digital implementations against performance metrics such as processing speed, reduced on-chip area and power dissipation are discussed. The limitations and open problems concerning the memristive HTM, such as the design scalability, sneak currents, leakage, parasitic effects, lack of the analog learning circuits implementations and unreliability of the memristive devices integrated with CMOS circuits are also discussed. △ Less

Submitted 8 May, 2018; originally announced May 2018.

Journal ref: IEEE Transactions on Emerging Topics in Computational Intelligence, 2018

Neuron inspired data encoding memristive multi-level memory cell

Authors: Aidana Irmanova, Alex Pappachen James

Abstract: Map** neuro-inspired algorithms to sensor backplanes of on-chip hardware require shifting the signal processing from digital to the analog domain, demanding memory technologies beyond conventional CMOS binary storage units. Using memristors for building analog data storage is one of the promising approaches amongst emerging non-volatile memory technologies. Recently, a memristive multi-level mem… ▽ More Map** neuro-inspired algorithms to sensor backplanes of on-chip hardware require shifting the signal processing from digital to the analog domain, demanding memory technologies beyond conventional CMOS binary storage units. Using memristors for building analog data storage is one of the promising approaches amongst emerging non-volatile memory technologies. Recently, a memristive multi-level memory (MLM) cell for storing discrete analog values has been developed in which memory system is implemented combining memristors in voltage divider configuration. In given example, the memory cell of 3 sub-cells with a memristor in each was programmed to store ternary bits which overall achieved 10 and 27 discrete voltage levels. However, for further use of proposed memory cell in analog signal processing circuits data encoder is required to generate control voltages for programming memristors to store discrete analog values. In this paper, we present the design and performance analysis of data encoder that generates write pattern signals for 10 level memristive memory. △ Less

Submitted 14 March, 2018; originally announced March 2018.

Journal ref: Analog Integrated Circuits and Signal Processing, 2018

Feature extraction without learning in an analog Spatial Pooler memristive-CMOS circuit design of Hierarchical Temporal Memory

Authors: Olga Krestinskaya, Alex Pappachen James

Abstract: Hierarchical Temporal Memory (HTM) is a neuromorphic algorithm that emulates sparsity, hierarchy and modularity resembling the working principles of neocortex. Feature encoding is an important step to create sparse binary patterns. This sparsity is introduced by the binary weights and random weight assignment in the initialization stage of the HTM. We propose the alternative deterministic method f… ▽ More Hierarchical Temporal Memory (HTM) is a neuromorphic algorithm that emulates sparsity, hierarchy and modularity resembling the working principles of neocortex. Feature encoding is an important step to create sparse binary patterns. This sparsity is introduced by the binary weights and random weight assignment in the initialization stage of the HTM. We propose the alternative deterministic method for the HTM initialization stage, which connects the HTM weights to the input data and preserves natural sparsity of the input information. Further, we introduce the hardware implementation of the deterministic approach and compare it to the traditional HTM and existing hardware implementation. We test the proposed approach on the face recognition problem and show that it outperforms the conventional HTM approach. △ Less

Submitted 14 March, 2018; originally announced March 2018.

Journal ref: Analog Integrated Circuits and Signal Processing, 2018

Automated image segmentation for detecting cell spreading for metastasizing assessments of cancer development

Authors: Sholpan Kauanova, Ivan Vorobjev, Alex Pappachen James

Abstract: The automated segmentation of cells in microscopic images is an open research problem that has important implications for studies of the developmental and cancer processes based on in vitro models. In this paper, we present the approach for segmentation of the DIC images of cultured cells using G-neighbor smoothing followed by Kauwahara filtering and local standard deviation approach for boundary… ▽ More The automated segmentation of cells in microscopic images is an open research problem that has important implications for studies of the developmental and cancer processes based on in vitro models. In this paper, we present the approach for segmentation of the DIC images of cultured cells using G-neighbor smoothing followed by Kauwahara filtering and local standard deviation approach for boundary detection. NIH FIJI/ImageJ tools are used to create the ground truth dataset. The results of this work indicate that detection of cell boundaries using segmentation approach even in the case of realistic measurement conditions is a challenging problem. △ Less

Submitted 1 January, 2018; originally announced January 2018.

Journal ref: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, 2017, pp. 2382-2387

Quality assessment metrics for edge detection and edge-aware filtering: A tutorial review

Authors: Diana Sadykova, Alex Pappachen James

Abstract: The quality assessment of edges in an image is an important topic as it helps to benchmark the performance of edge detectors, and edge-aware filters that are used in a wide range of image processing tasks. The most popular image quality metrics such as Mean squared error (MSE), Peak signal-to-noise ratio (PSNR) and Structural similarity (SSIM) metrics for assessing and justifying the quality of ed… ▽ More The quality assessment of edges in an image is an important topic as it helps to benchmark the performance of edge detectors, and edge-aware filters that are used in a wide range of image processing tasks. The most popular image quality metrics such as Mean squared error (MSE), Peak signal-to-noise ratio (PSNR) and Structural similarity (SSIM) metrics for assessing and justifying the quality of edges. However, they do not address the structural and functional accuracy of edges in images with a wide range of natural variabilities. In this review, we provide an overview of all the most relevant performance metrics that can be used to benchmark the quality performance of edges in images. We identify four major groups of metrics and also provide a critical insight into the evaluation protocol and governing equations. △ Less

Submitted 1 January, 2018; originally announced January 2018.

Journal ref: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, 2017, pp. 2366-2369

Automated rating of recorded classroom presentations using speech analysis in kazakh

Authors: Akzharkyn Izbassarova, Aidana Irmanova, A. P. James

Abstract: Effective presentation skills can help to succeed in business, career and academy. This paper presents the design of speech assessment during the oral presentation and the algorithm for speech evaluation based on criteria of optimal intonation. As the pace of the speech and its optimal intonation varies from language to language, develo** an automatic identification of language during the presen… ▽ More Effective presentation skills can help to succeed in business, career and academy. This paper presents the design of speech assessment during the oral presentation and the algorithm for speech evaluation based on criteria of optimal intonation. As the pace of the speech and its optimal intonation varies from language to language, develo** an automatic identification of language during the presentation is required. Proposed algorithm was tested with presentations delivered in Kazakh language. For testing purposes the features of Kazakh phonemes were extracted using MFCC and PLP methods and created a Hidden Markov Model (HMM) [5], [5] of Kazakh phonemes. Kazakh vowel formants were defined and the correlation between the deviation rate in fundamental frequency and the liveliness of the speech to evaluate intonation of the presentation was analyzed. It was established that the threshold value between monotone and dynamic speech is 0.16 and the error for intonation evaluation is 19%. △ Less

Submitted 1 January, 2018; originally announced January 2018.

Journal ref: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, 2017, pp. 393-397

Facial emotion recognition using min-max similarity classifier

Authors: Olga Krestinskaya, Alex Pappachen James

Abstract: Recognition of human emotions from the imaging templates is useful in a wide variety of human-computer interaction and intelligent systems applications. However, the automatic recognition of facial expressions using image template matching techniques suffer from the natural variability with facial features and recording conditions. In spite of the progress achieved in facial emotion recognition in… ▽ More Recognition of human emotions from the imaging templates is useful in a wide variety of human-computer interaction and intelligent systems applications. However, the automatic recognition of facial expressions using image template matching techniques suffer from the natural variability with facial features and recording conditions. In spite of the progress achieved in facial emotion recognition in recent years, the effective and computationally simple feature selection and classification technique for emotion recognition is still an open problem. In this paper, we propose an efficient and straightforward facial emotion recognition algorithm to reduce the problem of inter-class pixel mismatch during classification. The proposed method includes the application of pixel normalization to remove intensity offsets followed-up with a Min-Max metric in a nearest neighbor classifier that is capable of suppressing feature outliers. The results indicate an improvement of recognition performance from 92.85% to 98.57% for the proposed Min-Max classification method when tested on JAFFE database. The proposed emotion recognition technique outperforms the existing template matching methods. △ Less

Submitted 1 January, 2018; originally announced January 2018.

Journal ref: 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Udupi, 2017, pp. 752-758

Level-Shifted Neural Encoded Analog-to-Digital Converter

Authors: Aigerim Tankimanova, Akshay Kumar Maan, Alex Pappachen James

Abstract: This paper presents the new approach in implementation of analog-to-digital converter (ADC) that is based on Hopfield neural-network architecture. Hopfield neural ADC (NADC) is a type of recurrent neural network that is effective in solving simple optimization problems, such as analog-to-digital conversion. The main idea behind the proposed design is to use multiple 2-bit Hopfield NADCs operating… ▽ More This paper presents the new approach in implementation of analog-to-digital converter (ADC) that is based on Hopfield neural-network architecture. Hopfield neural ADC (NADC) is a type of recurrent neural network that is effective in solving simple optimization problems, such as analog-to-digital conversion. The main idea behind the proposed design is to use multiple 2-bit Hopfield NADCs operating as quantizers in parallel, where analog input signal to each successive 2-bit Hopfield ADC block is passed through a voltage level shifter. This is followed by a neural network encoder to remove the quantization errors. In traditional Hopfield NADC based designs, increasing the number of bits could require proper scaling of the network parameters, in particular digital output operating region. Furthermore, the resolution improvement of traditional Hopfield NADC creates digital error that increases with the increasing number of bits. The proposed design is scalable in number of bits and number of quantization levels, and can maintain the magnitude of digital output code within a manageable operating voltage range. △ Less

Submitted 1 January, 2018; originally announced January 2018.

Journal ref: 2017 IEEE International Conference on Electronics, Circuits and Systems (ICECS)

Memristive System Design for Variable Pixel G-Neighbor Denoising Filter

Authors: Kamilla Aliakhmet, Diana Sadykova, Joshin Mathew, Alex Pappachen James

Abstract: Image blurring artifact is the main challenge to any spatial, denoising filters. This artifact is contributed by the heterogeneous intensities within the given neighborhood or window of fixed size. Selection of most similar intensities (G-Neighbors) helps to adapt the window shape which is of edge-aware nature and subsequently reduce this blurring artifact. The paper presents a memristive circuit… ▽ More Image blurring artifact is the main challenge to any spatial, denoising filters. This artifact is contributed by the heterogeneous intensities within the given neighborhood or window of fixed size. Selection of most similar intensities (G-Neighbors) helps to adapt the window shape which is of edge-aware nature and subsequently reduce this blurring artifact. The paper presents a memristive circuit design to implement this variable pixel G-Neighbor filter. The memristive circuits exhibits parallel processing capabilities (near real-time) and neuromorphic architectures. The proposed design is demonstrated as simulations of both algorithm (MATLAB) and circuit (SPICE). Circuit design is evaluated for various parameters such as processing time, fabrication area used, and power consumption. Denoising performance is demonstrated using image quality metrics such as peak signal-to-noise ratio (PSNR), mean square error (MSE), and structural similarity index measure (SSIM). Combining adaptive filtering method with mean filter resulted in average improvement of MSE to about 65\% reduction, increase of PSNR and SSIM to nearly 18\% and 12\% correspondingly. △ Less

Submitted 24 September, 2017; originally announced September 2017.

Comments: Journal of Intelligent and Fuzzy Systems, 2018

On-chip Face Recognition System Design with Memristive Hierarchical Temporal Memory

Authors: Timur Ibrayev, Ulan Myrzakhan, Olga Krestinskaya, Aidana Irmanova, Alex Pappachen James

Abstract: Hierarchical Temporal Memory is a new machine learning algorithm intended to mimic the working principle of neocortex, part of the human brain, which is responsible for learning, classification, and making predictions. Although many works illustrate its effectiveness as a software algorithm, hardware design for HTM remains an open research problem. Hence, this work proposes an architecture for HTM… ▽ More Hierarchical Temporal Memory is a new machine learning algorithm intended to mimic the working principle of neocortex, part of the human brain, which is responsible for learning, classification, and making predictions. Although many works illustrate its effectiveness as a software algorithm, hardware design for HTM remains an open research problem. Hence, this work proposes an architecture for HTM Spatial Pooler and Temporal Memory with learning mechanism, which creates a single image for each class based on important and unimportant features of all images in the training set. In turn, the reduction in the number of templates within database reduces the memory requirements and increases the processing speed. Moreover, face recognition analysis indicates that for a large number of training images, the proposed design provides higher accuracy results (83.5\%) compared to only Spatial Pooler design presented in the previous works. △ Less

Submitted 24 September, 2017; originally announced September 2017.

Comments: Journal of Intelligent and Fuzzy Systems, 2018

Multi-level Memristive Memory with Resistive Networks

Authors: Aidana Irmanova, Alex Pappachen James

Abstract: Analog memory is of great importance in neurocomputing technologies field, but still remains difficult to implement. With emergence of memristors in VLSI technologies the idea of designing scalable analog data storage elements finds its second wind. A memristor, known for its history dependent resistance levels, independently can provide blocks of binary or discrete state data storage. However, us… ▽ More Analog memory is of great importance in neurocomputing technologies field, but still remains difficult to implement. With emergence of memristors in VLSI technologies the idea of designing scalable analog data storage elements finds its second wind. A memristor, known for its history dependent resistance levels, independently can provide blocks of binary or discrete state data storage. However, using single memristor to save the analog value is practically limited due to the device variability and implementation complexity. In this paper, we present a new design of discrete state memory cell consisting of subcells constructed from a memristor and its resistive network. A memristor in the sub-cells provides the storage element, while its resistive network is used for programming its resistance. Several sub-cells are then connected in parallel, resembling potential divider configuration. The output of the memory cell is the voltage resulting from distributing the input voltage among the sub-cells. Here, proposed design was programmed to obtain 10 and 27 different output levels depending on the configuration of the combined resistive networks within the sub-cell. Despite the simplicity of the circuit, this realization of multilevel memory provides increased number of output levels compared to previous designs of memory technologies based on memristors. Simulation results of proposed memory are analyzed providing explicit data on the issues of distinguishing discrete analog output levels and sensitivity of the cell to oscillations in write signal patterns. △ Less

Submitted 13 September, 2017; originally announced September 2017.

Comments: IEEE PRIMEASIA 2017

High Voltage Insulator Surface Evaluation Using Image Processing

Authors: Damira Pernebayeva, Mehdi Bagheri, Alex Pappachen James

Abstract: High voltage insulators are widely deployed in power systems to isolate the live- and dead-part of overhead lines as well as to support the power line conductors mechanically. Permanent, secure and safe operation of power transmission lines require that the high voltage insulators are inspected and monitor, regularly. Severe environment conditions will influence insulator surface and change creepa… ▽ More High voltage insulators are widely deployed in power systems to isolate the live- and dead-part of overhead lines as well as to support the power line conductors mechanically. Permanent, secure and safe operation of power transmission lines require that the high voltage insulators are inspected and monitor, regularly. Severe environment conditions will influence insulator surface and change creepage distance. Consequently, power utilities and transmission companies face significant problem in operation due to insulator damage or contamination. In this study, a new technique is developed for real-time inspection of insulator and estimating the snow, ice and water over the insulator surface which can be a potential risk of operation breakdown. To examine the proposed system, practical experiment is conducted using ceramic insulator for capturing the images with snow, ice and wet surface conditions. Gabor and Standard deviation filters are utilized for image feature extraction. The best achieved recognition accuracy rate was 87% using statistical approach the Standard deviation. △ Less

Submitted 19 August, 2017; originally announced August 2017.

Comments: 2017 International Symposium on Electrical Insulating Materials, September 12-15, 2017

Memristor Threshold Logic: An Overview to Challenges and Applications

Authors: Alex Pappachen James

Abstract: Once referred to as the missing circuit component, memristor has come long way across to be recognized and taken as important to future circuit designs. The memristor due to its ability to memorize the state, switch between different resistance level, smaller size and low leakage currents makes it useful for a wide range of intelligent memory and computing applications. This overview paper highlig… ▽ More Once referred to as the missing circuit component, memristor has come long way across to be recognized and taken as important to future circuit designs. The memristor due to its ability to memorize the state, switch between different resistance level, smaller size and low leakage currents makes it useful for a wide range of intelligent memory and computing applications. This overview paper highlights broadly provides the uses of memristor in the implementation of cognitive cells for different imaging and pattern matching applications. △ Less

Submitted 6 December, 2016; originally announced December 2016.

Comments: Invited paper, International Conference on Contemporary Computing and Informatics, Dec, 2016

CMOS-Memristor Hybrid Integrated Pixel Sensors

Authors: Kamilya Smagulova, Aigerim Tankimanova, Alex Pappachen James

Abstract: Increase in image resolution require the ability of image sensors to pack an increased number of circuit components in a given area. On the the other hand a high speed processing of signals from the sensors require the ability of pixel to carry out pixel parallel operations. In the paper, we propose a modified 3T and 4T CMOS wide dynamic range pixels, which we refer as 2T-M and 3T-M configurations… ▽ More Increase in image resolution require the ability of image sensors to pack an increased number of circuit components in a given area. On the the other hand a high speed processing of signals from the sensors require the ability of pixel to carry out pixel parallel operations. In the paper, we propose a modified 3T and 4T CMOS wide dynamic range pixels, which we refer as 2T-M and 3T-M configurations, comprising of MOSFETS and memristors. The low leakage currents and low area of memristors helps to achieve the objective of reducing the area, while the possibility to create arrays of memristors and MOSFETs across different layers within the chip, ensure the possibility to scale the circuit architecture. △ Less

Submitted 15 October, 2016; originally announced October 2016.

Comments: to appear in Proceedings of IEEE International Symposium on Nanoelectronic and Information Systems, December 19-21, Gwalior, India

CMOS-Memristor Dendrite Threshold Circuits

Authors: Askhat Zhanbossinov, Kamilya Smagulova, Alex Pappachen James

Abstract: Non-linear neuron models overcomes the limitations of linear binary models of neurons that have the inability to compute linearly non-separable functions such as XOR. While several biologically plausible models based on dendrite thresholds are reported in the previous studies, the hardware implementation of such non-linear neuron models remain as an open problem. In this paper, we propose a circui… ▽ More Non-linear neuron models overcomes the limitations of linear binary models of neurons that have the inability to compute linearly non-separable functions such as XOR. While several biologically plausible models based on dendrite thresholds are reported in the previous studies, the hardware implementation of such non-linear neuron models remain as an open problem. In this paper, we propose a circuit design for implementing logical dendrite non-linearity response of dendrite spike and saturation types. The proposed dendrite cells are used to build XOR circuit and intensity detection circuit that consists of different combinations of dendrite cells with saturating and spiking responses. The dendrite cells are designed using a set of memristors, Zener diodes, and CMOS NOT gates. The circuits are designed, analyzed and verified on circuit boards. △ Less

Submitted 16 September, 2016; originally announced September 2016.

Comments: Zhanbossinov, K. Smagulova, A. P. James, CMOS-Memristor Dendrite Threshold Circuits, 2016 IEEE APCCAS, Jeju, Korea, October 25-28, 2016

Voltage Controlled Memristor Threshold Logic Gates

Authors: Akshay Kumar Maan, Alex Pappachen James

Abstract: In this paper, we present a resistive switching memristor cell for implementing universal logic gates. The cell has a weighted control input whose resistance is set based on a control signal that generalizes the operational regime from NAND to NOR functionality. We further show how threshold logic in the voltage-controlled resistive cell can be used to implement a XOR logic. Building on the same p… ▽ More In this paper, we present a resistive switching memristor cell for implementing universal logic gates. The cell has a weighted control input whose resistance is set based on a control signal that generalizes the operational regime from NAND to NOR functionality. We further show how threshold logic in the voltage-controlled resistive cell can be used to implement a XOR logic. Building on the same principle we implement a half adder and a 4-bit CLA (Carry Look-ahead Adder) and show that in comparison with CMOS-only logic, the proposed system shows significant improvements in terms of device area, power dissipation and leakage power. △ Less

Submitted 16 September, 2016; originally announced September 2016.

Comments: To appear in 2016 IEEEE Asia Pacific Conference on Circuits & Systems (IEEE APCCAS 2016), Jeju, Korea, October 25-28, 2016

RFID-Cloud Smart Cart System

Authors: Yerlan Berdaliyev, Alex Pappachen James

Abstract: The main purpose of this work is in reducing the queuing delays in major supermarkets or other shop** centers by means of an Electronic Smart Cart System which will introduce an intellectual approach to billing process through RFID technology. Smart Cart System is a cooperative performance of three separate systems: a website developed for the shop** market, electronic smart cart device and an… ▽ More The main purpose of this work is in reducing the queuing delays in major supermarkets or other shop** centers by means of an Electronic Smart Cart System which will introduce an intellectual approach to billing process through RFID technology. Smart Cart System is a cooperative performance of three separate systems: a website developed for the shop** market, electronic smart cart device and anti-theft RFID gates. This project focuses on develo** the electronic smart cart device itself. It involves an embedded electronic hardware that consists of an OLED display, Arduino Mega 2560 board, a specifically designed PCB, a Wi-Fi module, 13.56 MHz HF RFID reader, a power supply and a shop** cart. △ Less

Submitted 12 August, 2016; originally announced August 2016.

Comments: to appear as a poster paper in International Conference on Advances in Computing, Communications and Informatics, 2016

Speech Signal Analysis for the Estimation of Heart Rates Under Different Emotional States

Authors: Aibek Ryskaliyev, Sanzhar Askaruly, Alex Pappachen James

Abstract: A non-invasive method for the monitoring of heart activity can help to reduce the deaths caused by heart disorders such as stroke, arrhythmia and heart attack. The human voice can be considered as a biometric data that can be used for estimation of heart rate. In this paper, we propose a method for estimating the heart rate from human speech dynamically using voice signal analysis and by the devel… ▽ More A non-invasive method for the monitoring of heart activity can help to reduce the deaths caused by heart disorders such as stroke, arrhythmia and heart attack. The human voice can be considered as a biometric data that can be used for estimation of heart rate. In this paper, we propose a method for estimating the heart rate from human speech dynamically using voice signal analysis and by the development of an empirical linear predictor model. The correlation between the voice signal and heart rate are established by classifiers and prediction of the heart rates with or without emotions are done using linear models. The prediction accuracy was tested using the data collected from 15 subjects, it is about 4050 samples of speech signals and corresponding electrocardiogram samples. The proposed approach can use for early non-invasive detection of heart rate changes that can be correlated to an emotional state of the individual and also can be used as a tool for diagnosis of heart conditions in real-time situations. △ Less

Submitted 12 August, 2016; originally announced August 2016.

Comments: to appear in Proceedings of International Conference on Advances in Computing, Communications and Informatics, IEEE, 2016

A Survey of Memristive Threshold Logic Circuits

Authors: Akshay Kumar Maan, Deepthi Anirudhan Jayadevi, Alex Pappachen James

Abstract: In this paper, we review the different memristive threshold logic (MTL) circuits that are inspired from the synaptic action of flow of neurotransmitters in the biological brain. Brain like generalisation ability and area minimisation of these threshold logic circuits aim towards crossing the Moores law boundaries at device, circuits and systems levels.Fast switching memory, signal processing, cont… ▽ More In this paper, we review the different memristive threshold logic (MTL) circuits that are inspired from the synaptic action of flow of neurotransmitters in the biological brain. Brain like generalisation ability and area minimisation of these threshold logic circuits aim towards crossing the Moores law boundaries at device, circuits and systems levels.Fast switching memory, signal processing, control systems, programmable logic, image processing, reconfigurable computing, and pattern recognition are identified as some of the potential applications of MTL systems. The physical realization of nanoscale devices with memristive behaviour from materials like TiO2, ferroelectrics, silicon, and polymers has accelerated research effort in these application areas inspiring the scientific community to pursue design of high speed, low cost, low power and high density neuromorphic architectures. △ Less

Submitted 24 April, 2016; originally announced April 2016.

Journal ref: IEEE Transactions on Neural Networks and Learning Systems, 2016

Edge Detection for Pattern Recognition: A Survey

Authors: Alex Pappachen James

Abstract: This review provides an overview of the literature on the edge detection methods for pattern recognition that inspire from the understanding of human vision. We note that edge detection is one of the most fundamental process within the low level vision and provides the basis for the higher level visual intelligence in primates. The recognition of the patterns within the images relate closely to th… ▽ More This review provides an overview of the literature on the edge detection methods for pattern recognition that inspire from the understanding of human vision. We note that edge detection is one of the most fundamental process within the low level vision and provides the basis for the higher level visual intelligence in primates. The recognition of the patterns within the images relate closely to the spatiotemporal processes of edge formations, and its implementation needs a crossdisciplanry approach in neuroscience, computing and pattern recognition. In this review, the edge detectors are grouped in as edge features, gradients and sketch models, and some example applications are provided for reference. We note a significant increase in the amount of published research in the last decade that utilizes edge features in a wide range of problems in computer vision and image understanding having a direct implication to pattern recognition with images. △ Less

Submitted 15 February, 2016; originally announced February 2016.

Comments: Int. J. of Applied Pattern recognition, Vol 3, 2015

Detection and Analysis of Emotion From Speech Signals

Authors: Assel Davletcharova, Sherin Sugathan, Bibia Abraham, Alex Pappachen James

Abstract: Recognizing emotion from speech has become one the active research themes in speech processing and in applications based on human-computer interaction. This paper conducts an experimental study on recognizing emotions from human speech. The emotions considered for the experiments include neutral, anger, joy and sadness. The distinuishability of emotional features in speech were studied first follo… ▽ More Recognizing emotion from speech has become one the active research themes in speech processing and in applications based on human-computer interaction. This paper conducts an experimental study on recognizing emotions from human speech. The emotions considered for the experiments include neutral, anger, joy and sadness. The distinuishability of emotional features in speech were studied first followed by emotion classification performed on a custom dataset. The classification was performed for different classifiers. One of the main feature attribute considered in the prepared dataset was the peak-to-peak distance obtained from the graphical representation of the speech signals. After performing the classification tests on a dataset formed from 30 different subjects, it was found that for getting better accuracy, one should consider the data collected from one person rather than considering the data from a group of people. △ Less

Submitted 22 June, 2015; originally announced June 2015.

Comments: 2nd International Symposium on Computer Vision and the Internet, 2015; to appear in Procedia Computer Science Journal, Elsevier, 2015

Memristor Load Current Mirror Circuit

Authors: Olga Krestinskaya, Irina Fedorova, Alex Pappachen James

Abstract: Simple current mirrors with semiconductor resistive loads suffer from large on-chip area, leakage currents and thermal effects. In this paper, we report the feasibility of using memristive loads as a replacement of semiconductor resistors in simplistic current mirror configuration. We report power, area and total harmonic distribution, and report the corner conditions on resistance tolerances. Simple current mirrors with semiconductor resistive loads suffer from large on-chip area, leakage currents and thermal effects. In this paper, we report the feasibility of using memristive loads as a replacement of semiconductor resistors in simplistic current mirror configuration. We report power, area and total harmonic distribution, and report the corner conditions on resistance tolerances. △ Less

Submitted 22 June, 2015; originally announced June 2015.

Comments: 4th International Conference on Advances in Computing, Communications and Informaticst, IEEE, August, 2015

Adaptive Digital Scan Variable Pixels

Authors: Sherin Sugathan, Reshma Scaria, Alex Pappachen James

Abstract: The square and rectangular shape of the pixels in the digital images for sensing and display purposes introduces several inaccuracies in the representation of digital images. The major disadvantage of square pixel shapes is the inability to accurately capture and display the details in the objects having variable orientations to edges, shapes and regions. This effect can be observed by the inaccur… ▽ More The square and rectangular shape of the pixels in the digital images for sensing and display purposes introduces several inaccuracies in the representation of digital images. The major disadvantage of square pixel shapes is the inability to accurately capture and display the details in the objects having variable orientations to edges, shapes and regions. This effect can be observed by the inaccurate representation of diagonal edges in low resolution square pixel images. This paper explores a less investigated idea of using variable shaped pixels for improving visual quality of image scans without increasing the square pixel resolution. The proposed adaptive filtering technique reports an improvement in image PSNR. △ Less

Submitted 22 June, 2015; originally announced June 2015.

Comments: 4th International Conference on Advances in Computing, Communications and Informatics, August, 2015

A Review of Feature and Data Fusion with Medical Images

Authors: Alex Pappachen James, Belur Dasarathy

Abstract: The fusion techniques that utilize multiple feature sets to form new features that are often more robust and contain useful information for future processing are referred to as feature fusion. The term data fusion is applied to the class of techniques used for combining decisions obtained from multiple feature sets to form global decisions. Feature and data fusion interchangeably represent two imp… ▽ More The fusion techniques that utilize multiple feature sets to form new features that are often more robust and contain useful information for future processing are referred to as feature fusion. The term data fusion is applied to the class of techniques used for combining decisions obtained from multiple feature sets to form global decisions. Feature and data fusion interchangeably represent two important classes of techniques that have proved to be of practical importance in a wide range of medical imaging problems △ Less

Submitted 30 May, 2015; originally announced June 2015.

Comments: Multisensor Data Fusion: From Algorithm and Architecture Design to Applications, CRC Press, 2015. arXiv admin note: substantial text overlap with arXiv:1401.0166

Spatial Stimuli Gradient Sketch Model

Authors: Joshin John Mathew, Alex Pappachen James

Abstract: The inability of automated edge detection methods inspired from primal sketch models to accurately calculate object edges under the influence of pixel noise is an open problem. Extending the principles of image perception i.e. Weber-Fechner law, and Sheperd similarity law, we propose a new edge detection method and formulation that use perceived brightness and neighbourhood similarity calculations… ▽ More The inability of automated edge detection methods inspired from primal sketch models to accurately calculate object edges under the influence of pixel noise is an open problem. Extending the principles of image perception i.e. Weber-Fechner law, and Sheperd similarity law, we propose a new edge detection method and formulation that use perceived brightness and neighbourhood similarity calculations in the determination of robust object edges. The robustness of the detected edges is benchmark against Sobel, SIS, Kirsch, and Prewitt edge detection methods in an example face recognition problem showing statistically significant improvement in recognition accuracy and pixel noise tolerance. △ Less

Submitted 14 February, 2015; originally announced February 2015.

Comments: accepted for publication in IEEE Signal Processing Letters, 2015

Journal ref: Volume: 22 Issue: 9 On page(s): 1336-1339, 2015

Sparse distributed localized gradient fused features of objects

Authors: Swathikiran Sudhakarana, Alex Pappachen James

Abstract: The sparse, hierarchical, and modular processing of natural signals is related to the ability of humans to recognize objects with high accuracy. In this study, we report a sparse feature processing and encoding method, which improved the recognition performance of an automated object recognition system. Randomly distributed localized gradient enhanced features were selected before employing aggreg… ▽ More The sparse, hierarchical, and modular processing of natural signals is related to the ability of humans to recognize objects with high accuracy. In this study, we report a sparse feature processing and encoding method, which improved the recognition performance of an automated object recognition system. Randomly distributed localized gradient enhanced features were selected before employing aggregate functions for representation, where we used a modular and hierarchical approach to detect the object features. These object features were combined with a minimum distance classifier, thereby obtaining object recognition system accuracies of 93% using the Amsterdam library of object images (ALOI) database, 92% using the Columbia object image library (COIL)-100 database, and 69% using the PASCAL visual object challenge 2007 database. The object recognition performance was shown to be robust to variations in noise, object scaling, and object shifts. Finally, a comparison with eight existing object recognition methods indicated that our new method improved the recognition accuracy by 10% with ALOI, 8% with the COIL-100 database, and 10% with the PASCAL visual object challenge 2007 database. △ Less

Submitted 19 November, 2014; originally announced November 2014.

Comments: Pages 13

Journal ref: Pattern Recognition, Available online 31 October 2014

Threshold Logic Computing: Memristive-CMOS Circuits for Fast Fourier Transform and Vedic Multiplication

Authors: Alex Pappachen James, Dinesh S. Kumar, Arun Ajayan

Abstract: Brain inspired circuits can provide an alternative solution to implement computing architectures taking advantage of fault tolerance and generalisation ability of logic gates. In this brief, we advance over the memristive threshold circuit configuration consisting of memristive averaging circuit in combination with operational amplifier and/or CMOS inverters in application to realizing complex com… ▽ More Brain inspired circuits can provide an alternative solution to implement computing architectures taking advantage of fault tolerance and generalisation ability of logic gates. In this brief, we advance over the memristive threshold circuit configuration consisting of memristive averaging circuit in combination with operational amplifier and/or CMOS inverters in application to realizing complex computing circuits. The developed memristive threshold logic gates are used for designing FFT and multiplication circuits useful for modern microprocessors. Overall, the proposed threshold logic outperforms previous memristive-CMOS logic cells on every aspect, however, indicate a lower chip area, lower THD, and controllable leakage power, but a higher power dissipation with respect to CMOS logic. △ Less

Submitted 19 November, 2014; originally announced November 2014.

Comments: 5 Pages, IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2014

Memristive Threshold Logic Circuit Design of Fast Moving Object Detection

Authors: Akshay Kumar Maan, Dinesh Sasi Kumar, Sherin Sugathan, Alex Pappachen James

Abstract: Real-time detection of moving objects involves memorisation of features in the template image and their comparison with those in the test image. At high sampling rates, such techniques face the problems of high algorithmic complexity and component delays. We present a new resistive switching based threshold logic cell which encodes the pixels of a template image. The cell comprises a voltage divid… ▽ More Real-time detection of moving objects involves memorisation of features in the template image and their comparison with those in the test image. At high sampling rates, such techniques face the problems of high algorithmic complexity and component delays. We present a new resistive switching based threshold logic cell which encodes the pixels of a template image. The cell comprises a voltage divider circuit that programs the resistances of the memristors arranged in a single node threshold logic network and the output is encoded as a binary value using a CMOS inverter gate. When a test image is applied to the template-programmed cell, a mismatch in the respective pixels is seen as a change in the output voltage of the cell. The proposed cell when compared with CMOS equivalent implementation shows improved performance in area, leakage power, power dissipation and delay. △ Less

Submitted 6 October, 2014; originally announced October 2014.

Comments: To be published in IEEE Transactions on Very Large Scale Integration (VLSI) Systems

Medical Image Fusion: A survey of the state of the art

Authors: A. P. James, B. V. Dasarathy

Abstract: Medical image fusion is the process of registering and combining multiple images from single or multiple imaging modalities to improve the imaging quality and reduce randomness and redundancy in order to increase the clinical applicability of medical images for diagnosis and assessment of medical problems. Multi-modal medical image fusion algorithms and devices have shown notable achievements in i… ▽ More Medical image fusion is the process of registering and combining multiple images from single or multiple imaging modalities to improve the imaging quality and reduce randomness and redundancy in order to increase the clinical applicability of medical images for diagnosis and assessment of medical problems. Multi-modal medical image fusion algorithms and devices have shown notable achievements in improving clinical accuracy of decisions based on medical images. This review article provides a factual listing of methods and summarizes the broad scientific challenges faced in the field of medical image fusion. We characterize the medical image fusion research based on (1) the widely used image fusion methods, (2) imaging modalities, and (3) imaging of organs that are under study. This review concludes that even though there exists several open ended technological and scientific challenges, the fusion of medical images has proved to be useful for advancing the clinical reliability of using medical imaging for medical diagnostics and analysis, and is a scientific discipline that has the potential to significantly grow in the coming years. △ Less

Submitted 31 December, 2013; originally announced January 2014.

Comments: Information Fusion, 2014