-
PiTL: Cross-modal Retrieval with Weakly-supervised Vision-language Pre-training via Prompting
Authors:
Zixin Guo,
Tzu-Jui Julius Wang,
Selen Pehlivan,
Abduljalil Radman,
Jorma Laaksonen
Abstract:
Vision-language (VL) Pre-training (VLP) has shown to well generalize VL models over a wide range of VL downstream tasks, especially for cross-modal retrieval. However, it hinges on a huge amount of image-text pairs, which requires tedious and costly curation. On the contrary, weakly-supervised VLP (W-VLP) explores means with object tags generated by a pre-trained object detector (OD) from images.…
▽ More
Vision-language (VL) Pre-training (VLP) has shown to well generalize VL models over a wide range of VL downstream tasks, especially for cross-modal retrieval. However, it hinges on a huge amount of image-text pairs, which requires tedious and costly curation. On the contrary, weakly-supervised VLP (W-VLP) explores means with object tags generated by a pre-trained object detector (OD) from images. Yet, they still require paired information, i.e. images and object-level annotations, as supervision to train an OD.
To further reduce the amount of supervision, we propose Prompts-in-The-Loop (PiTL) that prompts knowledge from large language models (LLMs) to describe images. Concretely, given a category label of an image, e.g. refinery, the knowledge, e.g. a refinery could be seen with large storage tanks, pipework, and ..., extracted by LLMs is used as the language counterpart. The knowledge supplements, e.g. the common relations among entities most likely appearing in a scene. We create IN14K, a new VL dataset of 9M images and 1M descriptions of 14K categories from ImageNet21K with PiTL. Empirically, the VL models pre-trained with PiTL-generated pairs are strongly favored over other W-VLP works on image-to-text (I2T) and text-to-image (T2I) retrieval tasks, with less supervision. The results reveal the effectiveness of PiTL-generated pairs for VLP.
△ Less
Submitted 14 July, 2023;
originally announced July 2023.
-
Entanglement distribution quantum networking within deployed telecommunications fibre-optic infrastructure
Authors:
Marcus J Clark,
Obada Alia,
Rui Wang,
Sima Bahrani,
Matej Peranic,
Djeylan Aktas,
George T Kanellos,
Martin Loncaric,
Zeljko Samec,
Anton Radman,
Mario Stipcevic,
Reza Nejabati,
Dimitra Simeonidou,
John G Rarity,
Siddarth K Joshi
Abstract:
Quantum networks have been shown to connect users with full-mesh topologies without trusted nodes. We present advancements on our scalable polarisation entanglement-based quantum network testbed, which has the ability to perform protocols beyond simple quantum key distribution. Our approach utilises wavelength multiplexing, which is ideal for quantum networks across local metropolitan areas due to…
▽ More
Quantum networks have been shown to connect users with full-mesh topologies without trusted nodes. We present advancements on our scalable polarisation entanglement-based quantum network testbed, which has the ability to perform protocols beyond simple quantum key distribution. Our approach utilises wavelength multiplexing, which is ideal for quantum networks across local metropolitan areas due to the ease of connecting additional users to the network without increasing the resource requirements per user. We show a 10 user fully connected quantum network with metropolitan scale deployed fibre links, demonstrating polarisation stability and the ability to generate secret keys over a period of 10.8 days with a network wide average-effective secret key rate of 3.38 bps.
△ Less
Submitted 10 February, 2023; v1 submitted 16 November, 2022;
originally announced November 2022.
-
Polarization compensation methods for quantum communication networks
Authors:
Matej Peranic,
Marcus Clark,
Rui Wang,
Sima Bahrani,
Obada Alia,
Soren Wengerowsky,
Anton Radman,
Martin Loncaric,
Mario Stipcevic,
John Rarity,
Reza Nejabati,
Siddarth K Joshi
Abstract:
The information-theoretic unconditional security offered by quantum key distribution has spurred the development of larger quantum communication networks. However, as these networks grow so does the strong need to reduce complexity and overheads. Polarization based entanglement distribution networks are a promising approach due to their scalability and lack of trusted nodes. Nevertheless, they are…
▽ More
The information-theoretic unconditional security offered by quantum key distribution has spurred the development of larger quantum communication networks. However, as these networks grow so does the strong need to reduce complexity and overheads. Polarization based entanglement distribution networks are a promising approach due to their scalability and lack of trusted nodes. Nevertheless, they are only viable if the birefringence of all optical distribution fibres in the network is compensated to preserve the polarization based quantum state. The brute force approach would require a few hundred fibre polarization controllers for even a moderately sized network. Instead, we propose and investigate four different methods of polarization compensation. We compare them based on complexity, effort, level of disruption to network operations and performance.
△ Less
Submitted 30 November, 2023; v1 submitted 29 August, 2022;
originally announced August 2022.
