-
Combining Automated Optimisation of Hyperparameters and Reward Shape
Authors:
Julian Dierkes,
Emma Cramer,
Holger H. Hoos,
Sebastian Trimpe
Abstract:
There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies on these design choices. Also, most RL research is conducted on known benchmarks where knowledge about these choices already exists. However, novel practical ap…
▽ More
There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies on these design choices. Also, most RL research is conducted on known benchmarks where knowledge about these choices already exists. However, novel practical applications often pose complex tasks for which no prior knowledge about good hyperparameters and reward functions is available, thus necessitating their derivation from scratch. Prior work has examined automatically tuning either hyperparameters or reward functions individually. We demonstrate empirically that an RL algorithm's hyperparameter configurations and reward function are often mutually dependent, meaning neither can be fully optimised without appropriate values for the other. We then propose a methodology for the combined optimisation of hyperparameters and the reward function. Furthermore, we include a variance penalty as an optimisation objective to improve the stability of learned policies. We conducted extensive experiments using Proximal Policy Optimisation and Soft Actor-Critic on four environments. Our results show that combined optimisation significantly improves over baseline performance in half of the environments and achieves competitive performance in the others, with only a minor increase in computational costs. This suggests that combined optimisation should be best practice.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
Efficient Utilization of Large Pre-Trained Models for Low Resource ASR
Authors:
Peter Vieting,
Christoph Lüscher,
Julian Dierkes,
Ralf Schlüter,
Hermann Ney
Abstract:
Unsupervised representation learning has recently helped automatic speech recognition (ASR) to tackle tasks with limited labeled data. Following this, hardware limitations and applications give rise to the question how to take advantage of large pre-trained models efficiently and reduce their complexity. In this work, we study a challenging low resource conversational telephony speech corpus from…
▽ More
Unsupervised representation learning has recently helped automatic speech recognition (ASR) to tackle tasks with limited labeled data. Following this, hardware limitations and applications give rise to the question how to take advantage of large pre-trained models efficiently and reduce their complexity. In this work, we study a challenging low resource conversational telephony speech corpus from the medical domain in Vietnamese and German. We show the benefits of using unsupervised techniques beyond simple fine-tuning of large pre-trained models, discuss how to adapt them to a practical telephony task including bandwidth transfer and investigate different data conditions for pre-training and fine-tuning. We outperform the project baselines by 22% relative using pretraining techniques. Further gains of 29% can be achieved by refinements of architecture and training and 6% by adding 0.8 h of in-domain adaptation data.
△ Less
Submitted 17 August, 2023; v1 submitted 26 October, 2022;
originally announced October 2022.
-
A Deeply Buried Narrow-Line Seyfert 1 Nucleus Uncovered in Scattered Light
Authors:
Xiang Pan,
Honglin Lu,
S. Komossa,
Dawei Xu,
Weimin Yuan,
Luming Sun,
Paul S. Smith,
Shaohua Zhang,
Peng Jiang,
Chenwei Yang,
Wenjuan Liu,
Ning Jiang,
Y. E. Rashed,
A. Eckart,
Jens Dierkes,
Hongyan Zhou
Abstract:
We present spectropolarimetric and spectrophotometric observations of the peculiar active galactic nucleus (AGN) SDSS J120300.19+162443.7 (hereafter J1203+1624) at $z=0.1656$. Its optical total flux spectra clearly show broad emission lines (BELs) in H$α$ and H$β$. After removal of narrow emission lines (NELs), the full width at half maximum of the lorentzian BEL is $FWHM_{\rm BEL} \approx 1,270$…
▽ More
We present spectropolarimetric and spectrophotometric observations of the peculiar active galactic nucleus (AGN) SDSS J120300.19+162443.7 (hereafter J1203+1624) at $z=0.1656$. Its optical total flux spectra clearly show broad emission lines (BELs) in H$α$ and H$β$. After removal of narrow emission lines (NELs), the full width at half maximum of the lorentzian BEL is $FWHM_{\rm BEL} \approx 1,270$ km s$^{-1}$, fulfilling the conventional definition of a narrow line Seyfert 1 (NLS1) galaxy. However, its NELs are unprecedentedly strong when compared to type 1AGNs. This, together with its large MIR excess ($g-W_4 = 13.172$ mag), implies that the observer and the narrow emission line region (NELR) might see a different ionization continuum. Our optical spectropolarimetry confirms its type 2 nature by detecting a polarized blue continuum and Balmer BELs ($FWHM_{\rm Polarized~BEL} \approx 1,183$ km s$^{-1}$), with a high polarization degree of $> 20$% in the blue wing. The mass and Eddington rate of the central black hole is estimated based on both transmitted and scattered AGN radiation, which is $M_{\bullet} < 2.9 \times 10^7 M_\odot$ and $L_{\rm bol}/L_{\rm Edd} > 1.5$. Severe extinction of the AGN emission also enables a clear view of the compact host galaxy. Discovery of J1203+1624 suggests that NLS1 follows AGN unfication scheme, studying of its analogs could blaze a new trail for exploring the connection between black hole growth and star formation in the host galaxy. Interesting features of J1203+1624 like the peculiar NELs, inflowing scattering clouds within sublimation radius are worth detailed follow-ups in the future.
△ Less
Submitted 11 October, 2019; v1 submitted 15 November, 2018;
originally announced November 2018.
-
A low-luminosity type-1 QSO sample: IV. Molecular gas contents and conditions of star formation in three nearby Seyfert galaxies
Authors:
Lydia Moser,
Melanie Krips,
Gerold Busch,
Julia Scharwaechter,
Sabine Koenig,
Andreas Eckart,
Semir Smajic,
Macarena Garcia-Marin,
Monica Valencia-S.,
Sebastian Fischer,
Jens Dierkes
Abstract:
We present a pilot study of ~ 3" resolution observations of low CO transitions with the Submillimeter Array in three nearby Seyfert galaxies, which are part of the low-luminosity quasi-stellar object (LLQSOs) sample consisting of 99 nearby (z = 0.06) type-1 active galactic nuclei (AGN) taken from the Hamburg/ESO quasi-stellar object (QSO) survey. Two sources were observed in 12CO(2-1) and 13CO(2-1…
▽ More
We present a pilot study of ~ 3" resolution observations of low CO transitions with the Submillimeter Array in three nearby Seyfert galaxies, which are part of the low-luminosity quasi-stellar object (LLQSOs) sample consisting of 99 nearby (z = 0.06) type-1 active galactic nuclei (AGN) taken from the Hamburg/ESO quasi-stellar object (QSO) survey. Two sources were observed in 12CO(2-1) and 13CO(2-1) and the third in 12CO(3-2) and HCO+(4-3). None of the sources is detected in continuum emission. More than 80% of the 12CO detected molecular gas is concentrated within a diameter (FWHM) < 1.8 kpc. 13CO is tentatively detected, while HCO+ emission could not be detected. All three objects show indications of a kinematically decoupled central unresolved molecular gas component. The molecular gas masses of the three galaxies are in the range M_mol = (0.7 - 8.7) x 10^9 M_sun. We give lower limits for the dynamical masses of M_dyn > 1.5 x 10^9 M_sun and for the dust masses of M_dust > 1.6 x 10^6 M_sun. The R21 =12CO/13CO(2-1) line luminosity ratios show Galactic values of R21 ~ 5 - 7 in the outskirts and R21 > 20 in the central region, similar to starbursts and (ultra)luminous infrared galaxies ((U)LIRGs; i.e. LIRGs and ULIRGs), implying higher temperatures and stronger turbulence. All three sources show indications of 12CO(2-1)/12CO(1-0) ratios of ~ 0.5, suggesting a cold or diffuse gas phase. Strikingly, the 12CO(3-2)/(1-0) ratio of ~ 1 also indicates a higher excited phase. Since these galaxies have high infrared luminosities of L_IR > 10^11 L_sun and seem to contain a circumnuclear starburst with minimum surface densities of gas and star formation rate (SFR) around Σ_mol = 50 - 550 M_sun pc^-2 and Σ_SFR = 1.1 - 3.1 M_sun kpc^-2 yr^-1, we conclude that the interstellar medium in the centers of these LIRG Seyferts is strongly affected by violent star formation and better ...
△ Less
Submitted 4 July, 2017;
originally announced July 2017.
-
A low-luminosity type-1 QSO sample. V. Overluminous host spheroids and their excitation mechanisms
Authors:
Gerold Busch,
Nastaran Fazeli,
Andreas Eckart,
Mónica Valencia-S.,
Semir Smajić,
Lydia Moser,
Julia Scharwächter,
Jens Dierkes,
Sebastian Fischer
Abstract:
We present near-infrared (NIR) $H+K$-band longslit spectra of eleven galaxies which are obtained with SOFI at the NTT (ESO). The galaxies are chosen from the low-luminosity type-1 quasi-stellar object (LLQSO) sample which comprises the 99 closest ($z\leq 0.06$) QSOs from the Hamburg/ESO survey for bright UV-excess QSOs. These objects are ideal targets to study the gap between local Seyfert galaxie…
▽ More
We present near-infrared (NIR) $H+K$-band longslit spectra of eleven galaxies which are obtained with SOFI at the NTT (ESO). The galaxies are chosen from the low-luminosity type-1 quasi-stellar object (LLQSO) sample which comprises the 99 closest ($z\leq 0.06$) QSOs from the Hamburg/ESO survey for bright UV-excess QSOs. These objects are ideal targets to study the gap between local Seyfert galaxies and high-redshift quasars, since they show much stronger AGN activity compared to local objects but are still close enough for a detailed structural analysis.
We fit hydrogen recombination, molecular hydrogen, and [FeII] lines after carefully subtracting the continuum emission. From the broad Pa$α$ components, we estimate black hole masses and enlarge the sample of LLQSOs that show a deviation from the $M_\mathrm{BH}-L_\mathrm{bulge}$ relations of inactive galaxies from 12 to 16 objects.
All objects show emission from hot dust ($T\sim 1200\,\mathrm{K}$) as well as stellar contribution. However, the particular fractions vary a lot between the objects. More than half of the objects show H$_2$ emission lines that are indicating a large reservoir of molecular gas which is needed to feed the AGN and star formation.
In the NIR diagnostic diagram all objects lie in the location of AGN dominated objects. However, most of the objects show indications of star formation activity, suggesting that their offset location with respect to $M_\mathrm{BH}-L_\mathrm{bulge}$ relations of inactive galaxies may be a consequence of overluminous bulges.
△ Less
Submitted 3 November, 2015;
originally announced November 2015.
-
SUBARU and e-Merlin observations of NGC3718. Diaries of an SMBH recoil?
Authors:
K. Markakis,
J. Dierkes,
A. Eckart,
S. Nishiyama,
S. Britzen,
M. García-Marín,
M. Horrobin,
T. Muxlow,
J. A. Zensus
Abstract:
NGC3718 is a LINER $L1.9$ galaxy, lying at a distance of about $\sim 17.4$ Mpc away from earth and its similarities with NGC5128 often award it the name "northern Centaurus A". We use high angular resolution ($\sim100$ mas) e-Merlin radio and SUBARU NIR ($\sim170$ mas) data, to take a detailed view of the processes taking place in its central region. In order to preserve some objectivity in our in…
▽ More
NGC3718 is a LINER $L1.9$ galaxy, lying at a distance of about $\sim 17.4$ Mpc away from earth and its similarities with NGC5128 often award it the name "northern Centaurus A". We use high angular resolution ($\sim100$ mas) e-Merlin radio and SUBARU NIR ($\sim170$ mas) data, to take a detailed view of the processes taking place in its central region. In order to preserve some objectivity in our interpretation, we combine our results with literature values and findings from previous studies. Our NIR maps suggest, on one hand, that towards the stellar bulge there are no large scale absorption phenomena caused by the apparent dust lane and, on the other, that there is a significant (local) contribution from hot ($\sim1000$ K) dust to the nuclear NIR emission. The position where this takes place appears to be closer to the offset compact radio emission from our e-Merlin $6$ cm map, lying offset by $\sim4.25$ pc from the center of the underlying stellar bulge. The shape of the radio map suggests the presence of one (or possibly two, forming an X-shape) bipolar structure(s) $\sim1$ ($\sim0.6$) arcsec across, which combined with the balance between the gas and the stellar velocity dispersions and the presence of hard X-ray emission, point towards effects expected by AGN feedback. We also argue that NGC3718 has a "core" in its surface brightness profile, despite the fact that it is a gas-rich galaxy and we discuss its mixed photometric and spectroscopic characteristics. The latter combined with the observed spatial and radio offsets, the relative redshift between the broad and the narrow $H{\mathrmα}$ line, the limited star formation activity and AGN feedback, strongly imply the existence of an SMBH recoil. Finally, we discuss a possible interpretation, that could naturally incorporate all these findings into one physically consistent picture.
△ Less
Submitted 14 April, 2015;
originally announced April 2015.
