Skip to main content

Showing 1–19 of 19 results for author: Lam, A Y

Searching in archive cs. Search in all archives.
.
  1. arXiv:2306.05278  [pdf, other

    cs.CL

    Revisit Few-shot Intent Classification with PLMs: Direct Fine-tuning vs. Continual Pre-training

    Authors: Haode Zhang, Haowen Liang, Liming Zhan, Xiao-Ming Wu, Albert Y. S. Lam

    Abstract: We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this problem is through continual pre-training, i.e., fine-tuning pre-trained language models (PLMs) on external resources (e.g., conversational corpora, public intent det… ▽ More

    Submitted 8 June, 2023; originally announced June 2023.

    Comments: ACL 2023, Findings

  2. arXiv:2205.12914  [pdf, other

    cs.CL

    New Intent Discovery with Pre-training and Contrastive Learning

    Authors: Yuwei Zhang, Haode Zhang, Li-Ming Zhan, Xiao-Ming Wu, Albert Y. S. Lam

    Abstract: New intent discovery aims to uncover novel intent categories from user utterances to expand the set of supported intent classes. It is a critical task for the development and service expansion of a practical dialogue system. Despite its importance, this problem remains under-explored in the literature. Existing approaches typically rely on a large amount of labeled utterances and employ pseudo-lab… ▽ More

    Submitted 25 May, 2022; originally announced May 2022.

    Comments: Accepted to ACL 2022

  3. arXiv:2205.07208  [pdf, other

    cs.CL

    Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization

    Authors: Haode Zhang, Haowen Liang, Yuwei Zhang, Liming Zhan, Xiao-Ming Wu, Xiaolei Lu, Albert Y. S. Lam

    Abstract: It is challenging to train a good intent classifier for a task-oriented dialogue system with only a few annotations. Recent studies have shown that fine-tuning pre-trained language models with a small amount of labeled utterances from public benchmarks in a supervised manner is extremely helpful. However, we find that supervised pre-training yields an anisotropic feature space, which may suppress… ▽ More

    Submitted 26 May, 2022; v1 submitted 15 May, 2022; originally announced May 2022.

    Comments: NAACL 2022

  4. arXiv:2202.10064  [pdf, other

    cs.GT

    Two-Stage Auction Mechanism for Long-Term Participation in Crowdsourcing

    Authors: Timothy Shin Heng Mak, Albert Y. S. Lam

    Abstract: Crowdsourcing has become an important tool to collect data for various artificial intelligence applications and auction can be an effective way to allocate work and determine reward in a crowdsourcing platform. In this paper, we focus on the crowdsourcing of small tasks such as image labelling and voice recording where we face a number of challenges. First, workers have different limits on the amo… ▽ More

    Submitted 21 February, 2022; originally announced February 2022.

    Comments: 14 pages, 5 figures, accepted for publication in IEEE Transactions on Computational Social Systems

  5. arXiv:2109.05782  [pdf, other

    cs.CL

    Effectiveness of Pre-training for Few-shot Intent Classification

    Authors: Haode Zhang, Yuwei Zhang, Li-Ming Zhan, Jiaxin Chen, Guangyuan Shi, Xiao-Ming Wu, Albert Y. S. Lam

    Abstract: This paper investigates the effectiveness of pre-training for few-shot intent classification. While existing paradigms commonly further pre-train language models such as BERT on a vast amount of unlabeled corpus, we find it highly effective and efficient to simply fine-tune BERT with a small set of labeled utterances from public datasets. Specifically, fine-tuning BERT with roughly 1,000 labeled d… ▽ More

    Submitted 13 September, 2021; originally announced September 2021.

    Comments: Accepted as a short paper in Findings of EMNLP 2021

  6. arXiv:2106.08616  [pdf, other

    cs.CL cs.LG

    Out-of-Scope Intent Detection with Self-Supervision and Discriminative Training

    Authors: Li-Ming Zhan, Haowen Liang, Bo Liu, Lu Fan, Xiao-Ming Wu, Albert Y. S. Lam

    Abstract: Out-of-scope intent detection is of practical importance in task-oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on strong assumptions on data distribution such as mixture of Gaussians to make inference, resulting in either complex multi-step training procedures or hand-crafted rules such as conf… ▽ More

    Submitted 17 June, 2021; v1 submitted 16 June, 2021; originally announced June 2021.

    Comments: Published as long oral paper in ACL 2021

  7. arXiv:1711.07652  [pdf, other

    eess.SY cs.CE

    A Unified Framework for Wide Area Measurement System Planning

    Authors: James J. Q. Yu, Albert Y. S. Lam, David J. Hill, Victor O. K. Li

    Abstract: Wide area measurement system (WAMS) is one of the essential components in the future power system. To make WAMS construction plans, practical models of the power network observability, reliability, and underlying communication infrastructures need to be considered. To address this challenging problem, in this paper we propose a unified framework for WAMS planning to cover most realistic concerns i… ▽ More

    Submitted 21 November, 2017; originally announced November 2017.

  8. Delay Aware Intelligent Transient Stability Assessment System

    Authors: James J. Q. Yu, Albert Y. S. Lam, David J. Hill, Victor O. K. Li

    Abstract: Transient stability assessment is a critical tool for power system design and operation. With the emerging advanced synchrophasor measurement techniques, machine learning methods are playing an increasingly important role in power system stability assessment. However, most existing research makes a strong assumption that the measurement data transmission delay is negligible. In this paper, we focu… ▽ More

    Submitted 21 November, 2017; originally announced November 2017.

  9. A multi-layer market for vehicle-to-grid energy trading in the smart grid

    Authors: Albert Y. S. Lam, Longbo Huang, Alonso Silva, Walid Saad

    Abstract: In this work, we propose a multi-layer market for vehicle-to-grid energy trading. In the macro layer, we consider a double auction mechanism, under which the utility company act as an auctioneer and energy buyers and sellers interact. This double auction mechanism is strategy-proof and converges asymptotically. In the micro layer, the aggregators, which are the sellers in the macro layer, are paid… ▽ More

    Submitted 6 September, 2016; originally announced September 2016.

    Journal ref: IEEE INFOCOM Workshop on Green Networking and Smart Grids (CCSES), Mar 2012, Orlando, Florida, United States. pp.85 - 90

  10. arXiv:1507.02492  [pdf, ps, other

    cs.NE

    Adaptive Chemical Reaction Optimization for Global Numerical Optimization

    Authors: James J. Q. Yu, Albert Y. S. Lam, Victor O. K. Li

    Abstract: A newly proposed chemical-reaction-inspired metaheurisic, Chemical Reaction Optimization (CRO), has been applied to many optimization problems in both discrete and continuous domains. To alleviate the effort in tuning parameters, this paper reduces the number of optimization parameters in canonical CRO and develops an adaptive scheme to evolve them. Our proposed Adaptive CRO (ACRO) adapts better t… ▽ More

    Submitted 9 July, 2015; originally announced July 2015.

  11. Combinatorial Auction-Based Pricing for Multi-tenant Autonomous Vehicle Public Transportation System

    Authors: Albert Y. S. Lam

    Abstract: A smart city provides its people with high standard of living through advanced technologies and transport is one of the major foci. With the advent of autonomous vehicles (AVs), an AV-based public transportation system has been proposed recently, which is capable of providing new forms of transportation services with high efficiency, high flexibility, and low cost. For the benefit of passengers, m… ▽ More

    Submitted 20 September, 2015; v1 submitted 3 March, 2015; originally announced March 2015.

    Comments: 12 pages, 7 figures

  12. Chemical Reaction Optimization for the Set Covering Problem

    Authors: James J. Q. Yu, Albert Y. S. Lam, Victor O. K. Li

    Abstract: The set covering problem (SCP) is one of the representative combinatorial optimization problems, having many practical applications. This paper investigates the development of an algorithm to solve SCP by employing chemical reaction optimization (CRO), a general-purpose metaheuristic. It is tested on a wide range of benchmark instances of SCP. The simulation results indicate that this algorithm gi… ▽ More

    Submitted 31 January, 2015; originally announced February 2015.

  13. An Inter-molecular Adaptive Collision Scheme for Chemical Reaction Optimization

    Authors: James J. Q. Yu, Victor O. K. Li, Albert Y. S. Lam

    Abstract: Optimization techniques are frequently applied in science and engineering research and development. Evolutionary algorithms, as a kind of general-purpose metaheuristic, have been shown to be very effective in solving a wide range of optimization problems. A recently proposed chemical-reaction-inspired metaheuristic, Chemical Reaction Optimization (CRO), has been applied to solve many global optimi… ▽ More

    Submitted 31 January, 2015; originally announced February 2015.

  14. Optimal V2G Scheduling of Electric Vehicles and Unit Commitment using Chemical Reaction Optimization

    Authors: James J. Q. Yu, Victor O. K. Li, Albert Y. S. Lam

    Abstract: An electric vehicle (EV) may be used as energy storage which allows the bi-directional electricity flow between the vehicle's battery and the electric power grid. In order to flatten the load profile of the electricity system, EV scheduling has become a hot research topic in recent years. In this paper, we propose a new formulation of the joint scheduling of EV and Unit Commitment (UC), called EVU… ▽ More

    Submitted 31 January, 2015; originally announced February 2015.

  15. Sensor Deployment for Air Pollution Monitoring Using Public Transportation System

    Authors: James J. Q. Yu, Victor O. K. Li, Albert Y. S. Lam

    Abstract: Air pollution monitoring is a very popular research topic and many monitoring systems have been developed. In this paper, we formulate the Bus Sensor Deployment Problem (BSDP) to select the bus routes on which sensors are deployed, and we use Chemical Reaction Optimization (CRO) to solve BSDP. CRO is a recently proposed metaheuristic designed to solve a wide range of optimization problems. Using t… ▽ More

    Submitted 31 January, 2015; originally announced February 2015.

  16. Real-Coded Chemical Reaction Optimization with Different Perturbation Functions

    Authors: James J. Q. Yu, Albert Y. S. Lam, Victor O. K. Li

    Abstract: Chemical Reaction Optimization (CRO) is a powerful metaheuristic which mimics the interactions of molecules in chemical reactions to search for the global optimum. The perturbation function greatly influences the performance of CRO on solving different continuous problems. In this paper, we study four different probability distributions, namely, the Gaussian distribution, the Cauchy distribution,… ▽ More

    Submitted 31 January, 2015; originally announced February 2015.

  17. Evolutionary Artificial Neural Network Based on Chemical Reaction Optimization

    Authors: James J. Q. Yu, Albert Y. S. Lam, Victor O. K. Li

    Abstract: Evolutionary algorithms (EAs) are very popular tools to design and evolve artificial neural networks (ANNs), especially to train them. These methods have advantages over the conventional backpropagation (BP) method because of their low computational requirement when searching in a large solution space. In this paper, we employ Chemical Reaction Optimization (CRO), a newly developed global optimiza… ▽ More

    Submitted 31 January, 2015; originally announced February 2015.

  18. arXiv:1404.0142  [pdf, other

    cs.IT eess.SY math.OC

    Information-Theoretic Bounds for Performance of Resource-Constrained Communication Systems

    Authors: Albert Y. S. Lam, Yanhui Geng, Victor O. K. Li

    Abstract: Resource-constrained systems are prevalent in communications. Such a system is composed of many components but only some of them can be allocated with resources such as time slots. According to the amount of information about the system, algorithms are employed to allocate resources and the overall system performance depends on the result of resource allocation. We do not always have complete info… ▽ More

    Submitted 1 April, 2014; originally announced April 2014.

    Comments: Submitted to IEEE Transactions on Communications

  19. arXiv:1204.5226  [pdf, ps, other

    math.OC cs.IT eess.SY

    An Optimal and Distributed Method for Voltage Regulation in Power Distribution Systems

    Authors: Baosen Zhang, Albert Y. S. Lam, Alejandro Dominguez-Garcia, David Tse

    Abstract: This paper addresses the problem of voltage regulation in power distribution networks with deep-penetration of distributed energy resources, e.g., renewable-based generation, and storage-capable loads such as plug-in hybrid electric vehicles. We cast the problem as an optimization program, where the objective is to minimize the losses in the network subject to constraints on bus voltage magnitudes… ▽ More

    Submitted 7 February, 2015; v1 submitted 23 April, 2012; originally announced April 2012.

    Comments: To Appear in IEEE Transaction on Power Systems