-
Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment
Authors:
William Merrill,
Zhaofeng Wu,
Norihito Naka,
Yoon Kim,
Tal Linzen
Abstract:
Do LMs infer the semantics of text from co-occurrence patterns in their training data? Merrill et al. (2022) argue that, in theory, probabilities predicted by an optimal LM encode semantic information about entailment relations, but it is unclear whether neural LMs trained on corpora learn entailment in this way because of strong idealizing assumptions made by Merrill et al. In this work, we inves…
▽ More
Do LMs infer the semantics of text from co-occurrence patterns in their training data? Merrill et al. (2022) argue that, in theory, probabilities predicted by an optimal LM encode semantic information about entailment relations, but it is unclear whether neural LMs trained on corpora learn entailment in this way because of strong idealizing assumptions made by Merrill et al. In this work, we investigate whether their theory can be used to decode entailment judgments from neural LMs. We find that a test similar to theirs can decode entailment relations between natural sentences, well above random chance, though not perfectly, across many datasets and LMs. This suggests LMs implicitly model aspects of semantics to predict semantic effects on sentence co-occurrence patterns. However, we find the test that predicts entailment in practice works in the opposite direction to the theoretical test. We thus revisit the assumptions underlying the original test, finding its derivation did not adequately account for redundancy in human-written text. We argue that correctly accounting for redundancy related to explanations might derive the observed flipped test and, more generally, improve linguistic theories of human speakers.
△ Less
Submitted 29 February, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Diffusion-related lifetime of indirect excitons in diamond
Authors:
K. Konishi,
I. Akimoto,
J. Isberg,
N. Naka
Abstract:
We investigate the lifetime of indirect excitons in extremely high purity diamond grown by the chemical vapor deposition method. A clear correlation is found between the lifetime and small strain (magnitude $< $10$^{-4}$) assessed using birefringence, thanks to the effective absence of impurity traps. A surface recombination model, extended for nonradiative recombination at dislocations due to exc…
▽ More
We investigate the lifetime of indirect excitons in extremely high purity diamond grown by the chemical vapor deposition method. A clear correlation is found between the lifetime and small strain (magnitude $< $10$^{-4}$) assessed using birefringence, thanks to the effective absence of impurity traps. A surface recombination model, extended for nonradiative recombination at dislocations due to exciton diffusion, is proposed to explain the temperature-dependent lifetime. Based on the derived radiative lifetime, our model enables the prediction of lifetimes at any temperature as well as the highest achievable internal quantum efficiency of exciton luminescence in diamond, which can generally be applicable to a wide range of materials with high exciton binding energies.
△ Less
Submitted 29 September, 2020;
originally announced September 2020.
-
Study of detailed balance between excitons and free carriers in pristine diamond using terahertz spectroscopy
Authors:
T. Ichii,
Y. Hazama,
N. Naka,
K. Tanaka
Abstract:
A fundamental understanding of the photoexcited carrier system in diamond is crucial to facilitate its application in photonic and electronic devices. Here, we studied the detailed balance between free carriers and excitons in pristine diamond by using a deep-ultraviolet (DUV) pump in combination with terahertz (THz) probe spectroscopy. We investigated the transformation of photoexcited carriers t…
▽ More
A fundamental understanding of the photoexcited carrier system in diamond is crucial to facilitate its application in photonic and electronic devices. Here, we studied the detailed balance between free carriers and excitons in pristine diamond by using a deep-ultraviolet (DUV) pump in combination with terahertz (THz) probe spectroscopy. We investigated the transformation of photoexcited carriers to excitons via an internal transition of excitons, which was newly found to occur at a frequency of approximately 15 THz. We determined the equilibrium constant in the Saha equation from the temperature dependence of the free-carrier density measured at chemical equilibrium. The derived exciton binding energy was larger than the conventional value, which indicated an energy shift due to the fine-structure splitting of the exciton states.
△ Less
Submitted 7 March, 2020;
originally announced March 2020.
-
Quantitative relevance of substitutional impurities to carrier dynamics in diamond
Authors:
Takaaki Shimomura,
Yoshiki Kubo,
Julien Barjon,
Norio Tokuda,
Ikuko Akimoto,
Nobuko Naka
Abstract:
We have quantified substitutional impurity concentrations in synthetic diamond crystals down to sub parts-per-billion levels. The capture lifetimes of electrons and excitons injected by photoexcitation were compared for several samples with different impurity concentrations. Based on the assessed impurity concentrations, we have determined the capture cross section of electrons to boron impurity,…
▽ More
We have quantified substitutional impurity concentrations in synthetic diamond crystals down to sub parts-per-billion levels. The capture lifetimes of electrons and excitons injected by photoexcitation were compared for several samples with different impurity concentrations. Based on the assessed impurity concentrations, we have determined the capture cross section of electrons to boron impurity, sA=1.3x10^-14 cm2, and that of excitons to nitrogen impurity, sD^ex=3.1x10^-14 cm2. The general tendency of the mobility values for different carrier species is successfully reproduced by including carrier scattering by impurities and by excitons.
△ Less
Submitted 25 May, 2018;
originally announced May 2018.
-
The phonon assisted absorption of excitons in Cu$_2$O
Authors:
Florian Schöne,
Heinrich Stolz,
Nobuko Naka
Abstract:
The basic theoretical foundation for the modelling of phonon assisted absorption spectra in direct bandgap semiconductors, introduced by Elliott 60 years ago using second order perturbation theory, results in a square root shaped dependency close to the absorption edge. A careful analysis of the experiments reveals that for the yellow S excitons in Cu$_2$O the lineshape does not follow that square…
▽ More
The basic theoretical foundation for the modelling of phonon assisted absorption spectra in direct bandgap semiconductors, introduced by Elliott 60 years ago using second order perturbation theory, results in a square root shaped dependency close to the absorption edge. A careful analysis of the experiments reveals that for the yellow S excitons in Cu$_2$O the lineshape does not follow that square root dependence. The reexamination of the theory shows that the basic assumptions of constant matrix elements and constant energy denominators is invalid for semiconductors with dominant exciton effects like Cu$_2$O, where the phonon assisted absorption proceeds via intermediate exciton states. The overlap between these and the final exciton states strongly determines the dependence of the absorption on the photon energy. To describe the experimental observed line shape of the indirect absorption of the yellow S exciton states we find it necessary to assume a momentum dependent deformation potential for the optical phonons.
△ Less
Submitted 18 September, 2017; v1 submitted 26 May, 2017;
originally announced May 2017.
-
Condensation of Excitons in Cu2O at Ultracold Temperatures: Experiment and Theory
Authors:
Heinrich Stolz,
Rico Schwartz,
Frank Kieseling,
Sunipa Som,
Maria Kaupsch,
Siegfried Sobkowiak,
Dirk Semkat,
Nobuko Naka,
Thomas Koch,
Holger Fehske
Abstract:
We present experiments on the luminescence of excitons confined in a potential trap at milli-Kelvin bath temperatures under cw-excitation. They reveal several distinct features like a kink in the dependence of the total integrated luminescence intensity on excitation laser power and a bimodal distribution of the spatially resolved luminescence. Furthermore, we discuss the present state of the theo…
▽ More
We present experiments on the luminescence of excitons confined in a potential trap at milli-Kelvin bath temperatures under cw-excitation. They reveal several distinct features like a kink in the dependence of the total integrated luminescence intensity on excitation laser power and a bimodal distribution of the spatially resolved luminescence. Furthermore, we discuss the present state of the theoretical description of Bose-Einstein condensation of excitons with respect to signatures of a condensate in the luminescence. The comparison of the experimental data with theoretical results with respect to the spatially resolved as well as the integrated luminescence intensity shows the necessity of taking into account a Bose-Einstein condensed excitonic phase in order to understand the behaviour of the trapped excitons.
△ Less
Submitted 8 November, 2012; v1 submitted 29 June, 2012;
originally announced June 2012.
-
Bosonic stimulation of cold 1s excitons into a harmonic potential minimum in Cu$_2$O
Authors:
N. Naka,
N. Nagasawa
Abstract:
Density distribution of cold exciton clouds generated into a strain-induced potential well by two-photon excitation in Cu$_2$O is studied at 2 K. We find that an anomalous spike, which can be interpreted as accumulation of the excitons into the ground state, emerges at the potential minimum. The accumulation can be due to stimulated scattering of cold excitons, mediated by acoustic phonon emissi…
▽ More
Density distribution of cold exciton clouds generated into a strain-induced potential well by two-photon excitation in Cu$_2$O is studied at 2 K. We find that an anomalous spike, which can be interpreted as accumulation of the excitons into the ground state, emerges at the potential minimum. The accumulation can be due to stimulated scattering of cold excitons, mediated by acoustic phonon emission. Possibility of the formation of the thermodynamic Bose-Einstein condensate of paraexcitons has been discussed.
△ Less
Submitted 7 February, 2003;
originally announced February 2003.
