-
Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPT
Authors:
Amirhossein Abaskohi,
Sara Baruni,
Mostafa Masoudi,
Nesa Abbasi,
Mohammad Hadi Babalou,
Ali Edalat,
Sepehr Kamahi,
Samin Mahdizadeh Sani,
Nikoo Naghavian,
Danial Namazifard,
Pouya Sadeghi,
Yadollah Yaghoobzadeh
Abstract:
This paper explores the efficacy of large language models (LLMs) for Persian. While ChatGPT and consequent LLMs have shown remarkable performance in English, their efficiency for more low-resource languages remains an open question. We present the first comprehensive benchmarking study of LLMs across diverse Persian language tasks. Our primary focus is on GPT-3.5-turbo, but we also include GPT-4 a…
▽ More
This paper explores the efficacy of large language models (LLMs) for Persian. While ChatGPT and consequent LLMs have shown remarkable performance in English, their efficiency for more low-resource languages remains an open question. We present the first comprehensive benchmarking study of LLMs across diverse Persian language tasks. Our primary focus is on GPT-3.5-turbo, but we also include GPT-4 and OpenChat-3.5 to provide a more holistic evaluation. Our assessment encompasses a diverse set of tasks categorized into classic, reasoning, and knowledge-based domains. To enable a thorough comparison, we evaluate LLMs against existing task-specific fine-tuned models. Given the limited availability of Persian datasets for reasoning tasks, we introduce two new benchmarks: one based on elementary school math questions and another derived from the entrance exams for 7th and 10th grades. Our findings reveal that while LLMs, especially GPT-4, excel in tasks requiring reasoning abilities and a broad understanding of general knowledge, they often lag behind smaller pre-trained models fine-tuned specifically for particular tasks. Additionally, we observe improved performance when test sets are translated to English before inputting them into GPT-3.5. These results highlight the significant potential for enhancing LLM performance in the Persian language. This is particularly noteworthy due to the unique attributes of Persian, including its distinct alphabet and writing styles.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
Cell-Free Massive MIMO in O-RAN: Energy-Aware Joint Orchestration of Cloud, Fronthaul, and Radio Resources
Authors:
Özlem Tuğfe Demir,
Meysam Masoudi,
Emil Björnson,
Cicek Cavdar
Abstract:
For the energy-efficient deployment of cell-free massive MIMO functionality in a practical wireless network, the end-to-end (from radio site to the cloud) energy-aware operation is essential. In line with the cloudification and virtualization in the open radio access networks (O-RAN), it is indisputable to envision prospective cell-free infrastructure on top of the O-RAN architecture. In this pape…
▽ More
For the energy-efficient deployment of cell-free massive MIMO functionality in a practical wireless network, the end-to-end (from radio site to the cloud) energy-aware operation is essential. In line with the cloudification and virtualization in the open radio access networks (O-RAN), it is indisputable to envision prospective cell-free infrastructure on top of the O-RAN architecture. In this paper, we explore the performance and power consumption of cell-free massive MIMO technology in comparison with traditional small-cell systems, in the virtualized O-RAN architecture. We compare two different functional split options and different resource orchestration mechanisms. In the end-to-end orchestration scheme, we aim to minimize the end-to-end power consumption by jointly allocating the radio, optical fronthaul, and virtualized cloud processing resources. We compare end-to-end orchestration with two other schemes: i) "radio-only" where radio resources are optimized independently from the cloud and ii) "local cloud coordination" where orchestration is only allowed among a local cluster of radio units. We develop several algorithms to solve the end-to-end power minimization and sum spectral efficiency maximization problems. The numerical results demonstrate that end-to-end resource allocation with fully virtualized fronthaul and cloud resources provides a substantial additional power saving than the other resource orchestration schemes.
△ Less
Submitted 29 January, 2024; v1 submitted 15 January, 2023;
originally announced January 2023.
-
Cell-Free Massive MIMO in Virtualized CRAN: How to Minimize the Total Network Power?
Authors:
Özlem Tuğfe Demir,
Meysam Masoudi,
Emil Björnson,
Cicek Cavdar
Abstract:
Previous works on cell-free massive MIMO mostly consider physical-layer and fronthaul transport aspects. How to deploy cell-free massive MIMO functionality in a practical wireless system is an open problem. This paper proposes a new cell-free architecture that can be implemented on top of a virtualized cloud radio access network (V-CRAN). We aim to minimize the end-to-end power consumption by join…
▽ More
Previous works on cell-free massive MIMO mostly consider physical-layer and fronthaul transport aspects. How to deploy cell-free massive MIMO functionality in a practical wireless system is an open problem. This paper proposes a new cell-free architecture that can be implemented on top of a virtualized cloud radio access network (V-CRAN). We aim to minimize the end-to-end power consumption by jointly considering the radio, optical fronthaul, virtualized cloud processing resources, and spectral efficiency requirements of the user equipments. The considered optimization problem is cast in a mixed binary second-order cone programming form and, thus, the global optimum can be found using a branch-and-bound algorithm. The optimal power-efficient solution of our proposed cell-free system is compared with conventional small-cell implemented using V-CRAN, to determine the benefits of cell-free networking. The numerical results demonstrate that cell-free massive MIMO increases the maximum rate substantially, which can be provided with almost the same energy per bit. We show that it is more power-efficient to activate cell-free massive MIMO already at low spectral efficiencies (above 1 bit/s/Hz).
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Computer Aided Detection for Pulmonary Embolism Challenge (CAD-PE)
Authors:
Germán González,
Daniel Jimenez-Carretero,
Sara Rodríguez-López,
Carlos Cano-Espinosa,
Miguel Cazorla,
Tanya Agarwal,
Vinit Agarwal,
Nima Tajbakhsh,
Michael B. Gotway,
Jianming Liang,
Mojtaba Masoudi,
Noushin Eftekhari,
Mahdi Saadatmand,
Hamid-Reza Pourreza,
Patricia Fraga-Rivas,
Eduardo Fraile,
Frank J. Rybicki,
Ara Kassarjian,
Raúl San José Estépar,
Maria J. Ledesma-Carbayo
Abstract:
Rationale: Computer aided detection (CAD) algorithms for Pulmonary Embolism (PE) algorithms have been shown to increase radiologists' sensitivity with a small increase in specificity. However, CAD for PE has not been adopted into clinical practice, likely because of the high number of false positives current CAD software produces. Objective: To generate a database of annotated computed tomography…
▽ More
Rationale: Computer aided detection (CAD) algorithms for Pulmonary Embolism (PE) algorithms have been shown to increase radiologists' sensitivity with a small increase in specificity. However, CAD for PE has not been adopted into clinical practice, likely because of the high number of false positives current CAD software produces. Objective: To generate a database of annotated computed tomography pulmonary angiographies, use it to compare the sensitivity and false positive rate of current algorithms and to develop new methods that improve such metrics. Methods: 91 Computed tomography pulmonary angiography scans were annotated by at least one radiologist by segmenting all pulmonary emboli visible on the study. 20 annotated CTPAs were open to the public in the form of a medical image analysis challenge. 20 more were kept for evaluation purposes. 51 were made available post-challenge. 8 submissions, 6 of them novel, were evaluated on the 20 evaluation CTPAs. Performance was measured as per embolus sensitivity vs. false positives per scan curve. Results: The best algorithms achieved a per-embolus sensitivity of 75% at 2 false positives per scan (fps) or of 70% at 1 fps, outperforming the state of the art. Deep learning approaches outperformed traditional machine learning ones, and their performance improved with the number of training cases. Significance: Through this work and challenge we have improved the state-of-the art of computer aided detection algorithms for pulmonary embolism. An open database and an evaluation benchmark for such algorithms have been generated, easing the development of further improvements. Implications on clinical practice will need further research.
△ Less
Submitted 30 March, 2020;
originally announced March 2020.
-
Energy Efficient Power Allocation for Device-to-Device Communications Underlaid Cellular Networks Using Stochastic Geometry
Authors:
Negar Zabetian,
Abbas Mohammadi,
Meysam Masoudi
Abstract:
In this paper, we study an energy efficiency maximization problem in uplink for D2D communications underlaid with cellular networks on multiple bands. Utilizing stochastic geometry, we derive closed-form expressions for the average sum rate, successful transmission probability, and energy efficiency of cellular and D2D users. Then, we formulate an optimization problem to jointly maximize the energ…
▽ More
In this paper, we study an energy efficiency maximization problem in uplink for D2D communications underlaid with cellular networks on multiple bands. Utilizing stochastic geometry, we derive closed-form expressions for the average sum rate, successful transmission probability, and energy efficiency of cellular and D2D users. Then, we formulate an optimization problem to jointly maximize the energy efficiency of D2D and cellular users and obtain optimum transmission power of both D2D and cellular users. In the optimization problem, we guarantee the QoS of users by taking into account the success transmission probability on each link. To solve the problem, first we convert the problem into canonical convex form. Afterwards, we solve the problem in two phases, energy efficiency maximization of devices and energy efficiency maximization of cellular users. In the first phase, we maximize the energy efficiency of D2D users and feed the solution to the second phase where we maximize the energy efficiency of cellular users. Simulation results reveal that significant energy efficiency can be attained e.g., 10% energy efficiency improvement compared to fix transmission power in high density scenario.
△ Less
Submitted 6 September, 2019;
originally announced September 2019.
-
Joint Functional Splitting and Content Placement for Green Hybrid CRAN
Authors:
Ajay Sriram,
Meysam Masoudi,
Abdulrahman Alabbasi,
Cicek Cavdar
Abstract:
A hybrid cloud radio access network (H-CRAN) architecture has been proposed to alleviate the midhaul capacity limitation in C-RAN. In this architecture, functional splitting is utilized to distribute the processing functions between a central cloud and edge clouds. The flexibility of selecting specific split point enables the H-CRAN designer to reduce midhaul bandwidth, or reduce latency, or save…
▽ More
A hybrid cloud radio access network (H-CRAN) architecture has been proposed to alleviate the midhaul capacity limitation in C-RAN. In this architecture, functional splitting is utilized to distribute the processing functions between a central cloud and edge clouds. The flexibility of selecting specific split point enables the H-CRAN designer to reduce midhaul bandwidth, or reduce latency, or save energy, or distribute the computation task depending on equipment availability. Meanwhile, techniques for caching are proposed to reduce content delivery latency and the required bandwidth. However, caching imposes new constraints on functional splitting. In this study, considering H-CRAN, a constraint programming problem is formulated to minimize the overall power consumption by selecting the optimal functional split point and content placement, taking into account the content access delay constraint. We also investigate the trade-off between the overall power consumption and occupied midhaul bandwidth in the network. Our results demonstrate that functional splitting together with enabling caching at edge clouds reduces not only content access delays but also fronthaul bandwidth consumption but at the expense of higher power consumption.
△ Less
Submitted 29 June, 2019;
originally announced July 2019.
-
Optimized Resource Provisioning and Operation Control for Low-power Wide-area IoT Networks
Authors:
Amin Azari,
Meysam Masoudi,
Cicek Cavdar
Abstract:
The tradeoff between cost of the access network and quality of offered service to IoT devices, in terms of reliability and durability of communications, is investigated. We first develop analytical tools for reliability evaluation in uplink-oriented large-scale IoT networks. These tools comprise modeling of interference from heterogeneous interfering sources with time-frequency asynchronous radio-…
▽ More
The tradeoff between cost of the access network and quality of offered service to IoT devices, in terms of reliability and durability of communications, is investigated. We first develop analytical tools for reliability evaluation in uplink-oriented large-scale IoT networks. These tools comprise modeling of interference from heterogeneous interfering sources with time-frequency asynchronous radio-resource usage patterns, and benefit from realistic distribution processes for modeling channel fading and locations of interfering sources. We further present a cost model for the access network as a function of provisioned resources like density of access points (APs), and a battery lifetime model for IoT devices as a function of intrinsic parameters, e.g. level of stored energy, and network parameters, e.g. reliability of communication. The derived models represent the ways in which a required level of reliability can be achieved by either sacrificing battery lifetime (durability), e.g. increasing number of replica transmissions, or sacrificing network cost and increasing provisioned resources, e.g. density of the APs. Then, we investigate optimal resource provisioning and operation control strategies, where the former aims at finding the optimized investment in the access network based on the cost of each resource; while the latter aims at optimizing data transmission strategies of IoT devices. The simulation results confirm tightness of derived analytical expressions, and show how the derived expressions can be used in finding optimal operation points of IoT networks.
△ Less
Submitted 25 April, 2018;
originally announced April 2018.
-
Device vs Edge Computing for Mobile Services: Delay-aware Decision Making to Minimize Power Consumption
Authors:
Meysam Masoudi,
Cicek Cavdar
Abstract:
A promising technique to provide mobile applications with high computation resources is to offload the processing task to the cloud. Utilizing the abundant processing capabilities of the clouds, mobile edge computing enables mobile devices with limited batteries to run resource hungry applications and to save power. However, it is not always true that edge computing consumes less power compared to…
▽ More
A promising technique to provide mobile applications with high computation resources is to offload the processing task to the cloud. Utilizing the abundant processing capabilities of the clouds, mobile edge computing enables mobile devices with limited batteries to run resource hungry applications and to save power. However, it is not always true that edge computing consumes less power compared to device computing. It may take more power for the mobile device to transmit a file to the cloud than running the task itself. This paper investigates the power minimization problem for the mobile devices by data offloading in multi-cell multi-user OFDMA mobile edge computing networks. We consider the maximum acceptable delay as QoS metric to be satisfied in our network. We formulate the problem as a mixed integer nonlinear problem which is converted into a convex form using D.C. approximation. To solve the converted optimization problem, we have proposed centralized and distributed algorithms for joint power allocation and channel assignment together with decision-making. Simulation results illustrate that by utilizing the proposed algorithms, considerable power savings can be achieved, e.g., about 60 % for large bit stream size compared to local computing baseline.
△ Less
Submitted 21 June, 2019; v1 submitted 10 November, 2017;
originally announced November 2017.
-
Grant-free Radio Access IoT Networks: Scalability Analysis in Coexistence Scenarios
Authors:
Meysam Masoudi,
Amin Azari,
Emre Altug Yavuz,
Cicek Cavdar
Abstract:
IoT networks with grant-free radio access, like SigFox and LoRa, offer low-cost durable communications over unlicensed band. These networks are becoming more and more popular due to the ever-increasing need for ultra durable, in terms of battery lifetime, IoT networks. Most studies evaluate the system performance assuming single radio access technology deployment. In this paper, we study the impac…
▽ More
IoT networks with grant-free radio access, like SigFox and LoRa, offer low-cost durable communications over unlicensed band. These networks are becoming more and more popular due to the ever-increasing need for ultra durable, in terms of battery lifetime, IoT networks. Most studies evaluate the system performance assuming single radio access technology deployment. In this paper, we study the impact of coexisting competing radio access technologies on the system performance. Considering $\mathpzc K$ technologies, defined by time and frequency activity factors, bandwidth, and power, which share a set of radio resources, we derive closed-form expressions for the successful transmission probability, expected battery lifetime, and experienced delay as a function of distance to the serving access point. Our analytical model, which is validated by simulation results, provides a tool to evaluate the coexistence scenarios and analyze how introduction of a new coexisting technology may degrade the system performance in terms of success probability and battery lifetime. We further investigate solutions in which this destructive effect could be compensated, e.g., by densifying the network to a certain extent and utilizing joint reception.
△ Less
Submitted 1 November, 2017;
originally announced November 2017.
-
Microaneurysm Detection in Fundus Images Using a Two-step Convolutional Neural Networks
Authors:
Noushin Eftekheri,
Mojtaba Masoudi,
Hamidreza Pourreza,
Kamaledin Ghiasi Shirazi,
Ehsan Saeedi
Abstract:
Diabetic Retinopathy (DR) is a prominent cause of blindness in the world. The early treatment of DR can be conducted from detection of microaneurysms (MAs) which appears as reddish spots in retinal images. An automated microaneurysm detection can be a helpful system for ophthalmologists. In this paper, deep learning, in particular convolutional neural network (CNN), is used as a powerful tool to e…
▽ More
Diabetic Retinopathy (DR) is a prominent cause of blindness in the world. The early treatment of DR can be conducted from detection of microaneurysms (MAs) which appears as reddish spots in retinal images. An automated microaneurysm detection can be a helpful system for ophthalmologists. In this paper, deep learning, in particular convolutional neural network (CNN), is used as a powerful tool to efficiently detect MAs from fundus images. In our method a new technique is used to utilise a two-stage training process which results in an accurate detection, while decreasing computational complexity in comparison with previous works. To validate our proposed method, an experiment is conducted using Keras library to implement our proposed CNN on two standard publicly available datasets. Our results show a promising sensitivity value of about 0.8 at the average number of false positive per image greater than 6 which is a competitive value with the state-of-the-art approaches.
△ Less
Submitted 8 July, 2018; v1 submitted 14 October, 2017;
originally announced October 2017.
-
A dataset for Computer-Aided Detection of Pulmonary Embolism in CTA images
Authors:
Mojtaba Masoudi,
Hamidreza Pourreza,
Mahdi Saadatmand Tarzjan,
Fateme Shafiee Zargar,
Masoud Pezeshki Rad,
Noushin Eftekhari
Abstract:
Todays, researchers in the field of Pulmonary Embolism (PE) analysis need to use a publicly available dataset to assess and compare their methods. Different systems have been designed for the detection of pulmonary embolism (PE), but none of them have used any public datasets. All papers have used their own private dataset. In order to fill this gap, we have collected 5160 slices of computed tomog…
▽ More
Todays, researchers in the field of Pulmonary Embolism (PE) analysis need to use a publicly available dataset to assess and compare their methods. Different systems have been designed for the detection of pulmonary embolism (PE), but none of them have used any public datasets. All papers have used their own private dataset. In order to fill this gap, we have collected 5160 slices of computed tomography angiography (CTA) images acquired from 20 patients, and after labeling the image by experts in this field, we provided a reliable dataset which is now publicly available. In some situation, PE detection can be difficult, for example when it occurs in the peripheral branches or when patients have pulmonary diseases (such as parenchymal disease). Therefore, the efficiency of CAD systems highly depends on the dataset. In the given dataset, 66% of PE are located in peripheral branches, and different pulmonary diseases are also included.
△ Less
Submitted 5 July, 2017;
originally announced July 2017.
-
Designing high-speed, low-power full adder cells based on carbon nanotube technology
Authors:
Mehdi Masoudi,
Milad Mazaheri,
Aliakbar Rezaei,
Keivan Navi
Abstract:
This article presents novel high speed and low power full adder cells based on carbon nanotube field effect transistor (CNFET). Four full adder cells are proposed in this article. First one (named CN9P4G) and second one (CN9P8GBUFF) utilizes 13 and 17 CNFETs respectively. Third design that we named CN10PFS uses only 10 transistors and is full swing. Finally, CN8P10G uses 18 transistors and divided…
▽ More
This article presents novel high speed and low power full adder cells based on carbon nanotube field effect transistor (CNFET). Four full adder cells are proposed in this article. First one (named CN9P4G) and second one (CN9P8GBUFF) utilizes 13 and 17 CNFETs respectively. Third design that we named CN10PFS uses only 10 transistors and is full swing. Finally, CN8P10G uses 18 transistors and divided into two modules, causing Sum and Cout signals are produced in a parallel manner. All inputs have been used straight, without inverting. These designs also used the special feature of CNFET that is controlling the threshold voltage by adjusting the diameters of CNFETs to achieve the best performance and right voltage levels. All simulation performed using Synopsys HSPICE software and the proposed designs are compared to other classical and modern CMOS and CNFET-based full adder cells in terms of delay, power consumption and power delay product.
△ Less
Submitted 9 November, 2014;
originally announced November 2014.
