-
Assessing the Impact of Prompting Methods on ChatGPT's Mathematical Capabilities
Authors:
Yuhao Chen,
Chloe Wong,
Hanwen Yang,
Juan Aguenza,
Sai Bhujangari,
Benthan Vu,
Xun Lei,
Amisha Prasad,
Manny Fluss,
Eric Phuong,
Minghao Liu,
Raja Kumar,
Vanshika Vats,
James Davis
Abstract:
This study critically evaluates the efficacy of prompting methods in enhancing the mathematical reasoning capability of large language models (LLMs). The investigation uses three prescriptive prompting methods - simple, persona, and conversational prompting - known for their effectiveness in enhancing the linguistic tasks of LLMs. We conduct this analysis on OpenAI's LLM chatbot, ChatGPT-3.5, on e…
▽ More
This study critically evaluates the efficacy of prompting methods in enhancing the mathematical reasoning capability of large language models (LLMs). The investigation uses three prescriptive prompting methods - simple, persona, and conversational prompting - known for their effectiveness in enhancing the linguistic tasks of LLMs. We conduct this analysis on OpenAI's LLM chatbot, ChatGPT-3.5, on extensive problem sets from the MATH, GSM8K, and MMLU datasets, encompassing a broad spectrum of mathematical challenges. A grading script adapted to each dataset is used to determine the effectiveness of these prompting interventions in enhancing the model's mathematical analysis power. Contrary to expectations, our empirical analysis reveals that none of the investigated methods consistently improves over ChatGPT-3.5's baseline performance, with some causing significant degradation. Our findings suggest that prompting strategies do not necessarily generalize to new domains, in this study failing to enhance mathematical performance.
△ Less
Submitted 20 February, 2024; v1 submitted 22 December, 2023;
originally announced December 2023.
-
Electronic coherence in $δ$-Pu: A DMFT study
Authors:
C. A. Marianetti,
K. Haule,
G. Kotliar,
M. J. Fluss
Abstract:
A combination of Density Functional Theory and the Dynamical Mean Field theory (DMFT) is used to calculate the magnetic susceptibility, heat capacity, and the temperature dependence of the valence band photoemission spectra. The continuous-time hybridization expansion quantum Monte-Carlo is utilized to provide the first approximation-free DMFT solution of \emph{fcc} $δ$-Pu which includes the ful…
▽ More
A combination of Density Functional Theory and the Dynamical Mean Field theory (DMFT) is used to calculate the magnetic susceptibility, heat capacity, and the temperature dependence of the valence band photoemission spectra. The continuous-time hybridization expansion quantum Monte-Carlo is utilized to provide the first approximation-free DMFT solution of \emph{fcc} $δ$-Pu which includes the full rotationally-invariant exchange interaction. We predict that $δ$-Pu has a Pauli-like magnetic susceptibility near ambient temperature, as in experiment, indicating that electronic coherence causes the absence of local moments. Additionally, We show that volume expansion causes a crossover from incoherent to coherent electronic behavior at increasingly lower temperatures.
△ Less
Submitted 12 May, 2008;
originally announced May 2008.
-
Muon spin rotation measurements of the superfluid density in fresh and aged superconducting PuCoGa$_5$
Authors:
K. Ohishi,
R. H. Heffner,
G. D. Morris,
E. D. Bauer,
M. J. Graf,
J. -X. Zhu,
L. A. Morales,
J. L. Sarrao,
M. J. Fluss,
D. E. MacLaughlin,
L. Shu,
W. Higemoto,
T. U. Ito
Abstract:
We have measured the temperature dependence and magnitude of the superfluid density $ρ_{\rm s}(T)$ via the magnetic field penetration depth $λ(T)$ in PuCoGa$_5$ (nominal critical temperature $T_{c0} = 18.5$ K) using the muon spin rotation technique in order to investigate the symmetry of the order parameter, and to study the effects of aging on the superconducting properties of a radioactive mat…
▽ More
We have measured the temperature dependence and magnitude of the superfluid density $ρ_{\rm s}(T)$ via the magnetic field penetration depth $λ(T)$ in PuCoGa$_5$ (nominal critical temperature $T_{c0} = 18.5$ K) using the muon spin rotation technique in order to investigate the symmetry of the order parameter, and to study the effects of aging on the superconducting properties of a radioactive material. The same single crystals were measured after 25 days ($T_c = 18.25$ K) and 400 days ($T_c = 15.0$ K) of aging at room temperature. The temperature dependence of the superfluid density is well described in both materials by a model using d-wave gap symmetry. The magnitude of the muon spin relaxation rate $σ$ in the aged sample, $σ\propto 1/λ^2\proptoρ_s/m^*$, where $m^*$ is the effective mass, is reduced by about 70% compared to fresh sample. This indicates that the scattering from self-irradiation induced defects is not in the limit of the conventional Abrikosov-Gor'kov pair-breaking theory, but rather in the limit of short coherence length (about 2 nm in PuCoGa$_5$) superconductivity.
△ Less
Submitted 29 June, 2007;
originally announced June 2007.
-
Plutonium and Quantum Criticlity
Authors:
G. Chapline,
M. Fluss,
S. McCall
Abstract:
The unusual properties of elemental plutonium have long been a puzzle. It has been suggested that these properties may be related to quantum criticality [G. Chapline, J. L. Smith LA Sci 26 (2000) 1]. In this talk we will describe some experimental observations on rare earth and actinide materials which suggest that there are pairing correlations in all f-electron metals, and that the anomalous p…
▽ More
The unusual properties of elemental plutonium have long been a puzzle. It has been suggested that these properties may be related to quantum criticality [G. Chapline, J. L. Smith LA Sci 26 (2000) 1]. In this talk we will describe some experimental observations on rare earth and actinide materials which suggest that there are pairing correlations in all f-electron metals, and that the anomalous properties of the elemental actinides in the vicinity of Np/Pu/Am,even at elevated temperatures, is associated with a critical point in the variation of the density of paired electrons with atomic number.
△ Less
Submitted 4 January, 2007;
originally announced January 2007.
-
Multiple ordered phases in the filled skutterudite compound PrOs$_{4}$As$_{12}$
Authors:
W. M. Yuhasz,
N. P. Butch,
T. A. Sayles,
P. -C. Ho,
J. R. Jeffries,
T. Yanagisawa,
N. A. Frederick,
M. B. Maple,
Z. Henkie,
A. Pietraszko,
S. K. McCall,
M. W. McElfresh,
M. J. Fluss
Abstract:
Magnetization, specific heat, and electrical resistivity measurements were made on single crystals of the filled skutterudite compound PrOs$_{4}$As$_{12}$. Specific heat measurements indicate an electronic specific heat coefficient $γ$ $\sim 50-200$ mJ/mol K$^{2}$ at temperatures 10 K $\leq T \leq 18$ K, and $\sim 1$ J/mol K$^{2}$ for $T \leq 1.6$ K. Magnetization, specific heat, and electrical…
▽ More
Magnetization, specific heat, and electrical resistivity measurements were made on single crystals of the filled skutterudite compound PrOs$_{4}$As$_{12}$. Specific heat measurements indicate an electronic specific heat coefficient $γ$ $\sim 50-200$ mJ/mol K$^{2}$ at temperatures 10 K $\leq T \leq 18$ K, and $\sim 1$ J/mol K$^{2}$ for $T \leq 1.6$ K. Magnetization, specific heat, and electrical resistivity measurements reveal the presence of two, or possibly three, ordered phases at temperatures below $\sim 2.3$ K and in fields below $\sim 3$ T. The low temperature phase displays antiferromagnetic characteristics, while the nature of the ordering in the other phase(s) has yet to be determined.
△ Less
Submitted 7 March, 2006; v1 submitted 14 December, 2005;
originally announced December 2005.
-
New limits on the ordered moments in alpha-Pu and Ga-stabilized delta-Pu
Authors:
R. H. Heffner,
G. D. Morris,
M. J. Fluss,
B. Chung,
D. E. MacLaughlin,
L. Shu,
J. E. Anderson
Abstract:
We present the first muon spin relaxation measurements ever performed on elemental Pu, and set the most stringent upper limits to date on the magnitude of the ordered moment in alpha-Pu and delta-stabilized Pu (alloyed with 4.3 at. % Ga). Assuming a nominal hyperfine coupling field of 1 kOe per Bohr magneton we set an upper limit of 0.001 Bohr magnetons for both materials at T = 4 K.
We present the first muon spin relaxation measurements ever performed on elemental Pu, and set the most stringent upper limits to date on the magnitude of the ordered moment in alpha-Pu and delta-stabilized Pu (alloyed with 4.3 at. % Ga). Assuming a nominal hyperfine coupling field of 1 kOe per Bohr magneton we set an upper limit of 0.001 Bohr magnetons for both materials at T = 4 K.
△ Less
Submitted 29 August, 2005;
originally announced August 2005.
-
The symmetry of the superconducting order parameter in PuCoGa$_5$
Authors:
G. D Morris,
R. H. Heffner,
E. D. Bauer,
L. A. Morales,
J. S. Sarrao,
M. J. Fluss,
D. E. MacLaughlin,
L. Shu,
J. E. Anderson
Abstract:
The symmetry of the superconducting order parameter in single-crystalline PuCoGa$_5$ ($T_{\rm c} = 18.5$ K) is investigated via zero- and transverse- field muon spin relaxation ($μ$SR) measurements, probing the possible existence of orbital and/or spin moments (time reversal-symmetry violation TRV) associated with the superconducting phase and the in-plane magnetic-field penetration depth…
▽ More
The symmetry of the superconducting order parameter in single-crystalline PuCoGa$_5$ ($T_{\rm c} = 18.5$ K) is investigated via zero- and transverse- field muon spin relaxation ($μ$SR) measurements, probing the possible existence of orbital and/or spin moments (time reversal-symmetry violation TRV) associated with the superconducting phase and the in-plane magnetic-field penetration depth $λ(T)$ in the mixed state, respectively. We find no evidence for TRV, and show that the superfluid density, or alternatively, $Δλ(T) = λ(T) - λ(0)$, are $\propto T$ for $T/T_{\rm c} \leq 0.5$. Taken together these measurements are consistent with an even-parity (pseudo-spin singlet), d-wave pairing state.
△ Less
Submitted 14 January, 2005;
originally announced January 2005.
