-
A solution for secure use of Kibana and Elasticsearch in multi-user environment
Authors:
Wataru Takase,
Tomoaki Nakamura,
Yoshiyuki Watase,
Takashi Sasaki
Abstract:
Monitoring is indispensable to check status, activities, or resource usage of IT services. A combination of Kibana and Elasticsearch is used for monitoring in many places such as KEK, CC-IN2P3, CERN, and also non-HEP communities. Kibana provides a web interface for rich visualization, and Elasticsearch is a scalable distributed search engine. However, these tools do not support authentication and…
▽ More
Monitoring is indispensable to check status, activities, or resource usage of IT services. A combination of Kibana and Elasticsearch is used for monitoring in many places such as KEK, CC-IN2P3, CERN, and also non-HEP communities. Kibana provides a web interface for rich visualization, and Elasticsearch is a scalable distributed search engine. However, these tools do not support authentication and authorization features by default. In the case of single Kibana and Elasticsearch services shared among many users, any user who can access Kibana can retrieve other's information from Elasticsearch. In multi-user environment, in order to protect own data from others or share part of data among a group, fine-grained access control is necessary.
The CERN cloud service group had provided cloud utilization dashboard to each user by Elasticsearch and Kibana. They had deployed a homemade Elasticsearch plugin to restrict data access based on a user authenticated by the CERN Single Sign On system. It enabled each user to have a separated Kibana dashboard for cloud usage, and the user could not access to other's one. Based on the solution, we propose an alternative one which enables user/group based Elasticsearch access control and Kibana objects separation. It is more flexible and can be applied to not only the cloud service but also the other various situations. We confirmed our solution works fine in CC-IN2P3. Moreover, a pre-production platform for CC-IN2P3 has been under construction.
We will describe our solution for the secure use of Kibana and Elasticsearch including integration of Kerberos authentication, development of a Kibana plugin which allows Kibana objects to be separated based on user/group, and contribution to Search Guard which is an Elasticsearch plugin enabling user/group based access control. We will also describe the effect on performance from using Search Guard.
△ Less
Submitted 30 June, 2017;
originally announced June 2017.
-
Belle II Technical Design Report
Authors:
T. Abe,
I. Adachi,
K. Adamczyk,
S. Ahn,
H. Aihara,
K. Akai,
M. Aloi,
L. Andricek,
K. Aoki,
Y. Arai,
A. Arefiev,
K. Arinstein,
Y. Arita,
D. M. Asner,
V. Aulchenko,
T. Aushev,
T. Aziz,
A. M. Bakich,
V. Balagura,
Y. Ban,
E. Barberio,
T. Barvich,
K. Belous,
T. Bergauer,
V. Bhardwaj
, et al. (387 additional authors not shown)
Abstract:
The Belle detector at the KEKB electron-positron collider has collected almost 1 billion Y(4S) events in its decade of operation. Super-KEKB, an upgrade of KEKB is under construction, to increase the luminosity by two orders of magnitude during a three-year shutdown, with an ultimate goal of 8E35 /cm^2 /s luminosity. To exploit the increased luminosity, an upgrade of the Belle detector has been pr…
▽ More
The Belle detector at the KEKB electron-positron collider has collected almost 1 billion Y(4S) events in its decade of operation. Super-KEKB, an upgrade of KEKB is under construction, to increase the luminosity by two orders of magnitude during a three-year shutdown, with an ultimate goal of 8E35 /cm^2 /s luminosity. To exploit the increased luminosity, an upgrade of the Belle detector has been proposed. A new international collaboration Belle-II, is being formed. The Technical Design Report presents physics motivation, basic methods of the accelerator upgrade, as well as key improvements of the detector.
△ Less
Submitted 1 November, 2010;
originally announced November 2010.
-
Building A High Performance Parallel File System Using Grid Datafarm and ROOT I/O
Authors:
Y. Morita,
H. Sato,
Y. Watase,
O. Tatebe,
S. Sekiguchi,
S. Matsuoka,
N. Soda,
A. Dell'Acqua
Abstract:
Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the…
▽ More
Sheer amount of petabyte scale data foreseen in the LHC experiments require a careful consideration of the persistency design and the system design in the world-wide distributed computing. Event parallelism of the HENP data analysis enables us to take maximum advantage of the high performance cluster computing and networking when we keep the parallelism both in the data processing phase, in the data management phase, and in the data transfer phase. A modular architecture of FADS/ Goofy, a versatile detector simulation framework for Geant4, enables an easy choice of plug-in facilities for persistency technologies such as Objectivity/DB and ROOT I/O. The framework is designed to work naturally with the parallel file system of Grid Datafarm (Gfarm). FADS/Goofy is proven to generate 10^6 Geant4-simulated Atlas Mockup events using a 512 CPU PC cluster. The data in ROOT I/O files is replicated using Gfarm file system. The histogram information is collected from the distributed ROOT files. During the data replication it has been demonstrated to achieve more than 2.3 Gbps data transfer rate between the PC clusters over seven participating PC clusters in the United States and in Japan.
△ Less
Submitted 14 June, 2003;
originally announced June 2003.
-
A data Grid testbed environment in Gigabit WAN with HPSS
Authors:
Atsushi Manabe,
Kohki Ishikawa,
Yoshihiko Itoh,
Setsuya Kawabata,
Tetsuro Mashimo,
Youhei Morita,
Hiroshi Sakamoto,
Takashi Sasaki,
Hiroyuki Sato,
Junichi Tanaka,
Ikuo Ueda,
Yoshiyuki Watase,
Satomi Yamamoto,
Shigeo Yashiro
Abstract:
For data analysis of large-scale experiments such as LHC Atlas and other Japanese high energy and nuclear physics projects, we have constructed a Grid test bed at ICEPP and KEK. These institutes are connected to national scientific gigabit network backbone called SuperSINET. In our test bed, we have installed NorduGrid middleware based on Globus, and connected 120TB HPSS at KEK as a large scale…
▽ More
For data analysis of large-scale experiments such as LHC Atlas and other Japanese high energy and nuclear physics projects, we have constructed a Grid test bed at ICEPP and KEK. These institutes are connected to national scientific gigabit network backbone called SuperSINET. In our test bed, we have installed NorduGrid middleware based on Globus, and connected 120TB HPSS at KEK as a large scale data store. Atlas simulation data at ICEPP has been transferred and accessed using SuperSINET. We have tested various performances and characteristics of HPSS through this high speed WAN. The measurement includes comparison between computing and storage resources are tightly coupled with low latency LAN and long distant WAN.
△ Less
Submitted 3 September, 2003; v1 submitted 12 June, 2003;
originally announced June 2003.
-
Study of variable stars in the MOA data base: long-period red variables in the Large Magellanic Cloud
Authors:
S. Noda,
M. Takeuti,
F. Abe,
I. A. Bond,
R. J. Dodd,
J. B. Hearnshaw,
M. Honda,
M. Honma,
J. Jugaku,
S. Kabe,
Y. Kan-ya,
Y. Kato,
P. M. Kilmartin,
Y. Matsubara,
K. Masuda,
Y. Muraki,
T. Nakamura,
G. R. Nankivell,
C. Noguchi,
K. Ohnishi,
M. Reid,
N. J. Rattenbury,
To. Saito,
H. Sato,
M. Sekiguchi
, et al. (9 additional authors not shown)
Abstract:
One hundred and forty six long-period red variable stars in the Large Magellanic Cloud (LMC) from the three year MOA project database were analysed. A careful periodic analysis was performed on these stars and a catalogue of their magnitudes, colours, periods and amplitudes is presented. We convert our blue and red magnitudes to $K$ band values using 19 oxygen-rich stars. A group of red short-pe…
▽ More
One hundred and forty six long-period red variable stars in the Large Magellanic Cloud (LMC) from the three year MOA project database were analysed. A careful periodic analysis was performed on these stars and a catalogue of their magnitudes, colours, periods and amplitudes is presented. We convert our blue and red magnitudes to $K$ band values using 19 oxygen-rich stars. A group of red short-period stars separated from the Mira sequence has been found on a (log P, K) diagram. They are located at the short period side of the Mira sequence consistent with the work of Wood and Sebo (1996). There are two interpretations for such stars; a difference in pulsation mode or a difference in chemical composition. We investigated the properties of these stars together with their colour, amplitude and periodicity. We conclude that they have small amplitudes and less regular variability. They are likely to be higher mode pulsators. A large scatter has been also found on the long period side of the (log P, K) diagram. This is possibly a systematic spread given that the blue band of our photometric system covers both standard B and V bands and affects carbon-rich stars.
△ Less
Submitted 18 November, 2001;
originally announced November 2001.
-
Study by MOA of extra-solar planets in gravitational microlensing events of high magnification
Authors:
I. A. Bond,
N. J. Rattenbury,
J. Skuljan,
F. Abe,
R. J. Dodd,
J. B. Hearnshaw,
M. Honda,
J. Jugaku,
P. M. Kilmartin,
A. Marles,
K. Masuda,
Y. Matsubara,
Y. Muraki,
T. Nakamura,
G. Nankivell,
S. Noda,
C. Noguchi,
K. Ohnishi,
M. Reid,
To. Saito,
H. Sato,
M. Sekiguchi,
D. J. Sullivan,
T. Sumi,
M. Takeuti
, et al. (5 additional authors not shown)
Abstract:
A search for extra-solar planets was carried out in three gravitational microlensing events of high magnification, MACHO 98-BLG-35, MACHO 99-LMC-2, and OGLE 00-BUL-12. Photometry was derived from observational images by the MOA and OGLE groups using an image subtraction technique. For MACHO 98-BLG-35, additional photometry derived from the MPS and PLANET groups was included. Planetary modeling o…
▽ More
A search for extra-solar planets was carried out in three gravitational microlensing events of high magnification, MACHO 98-BLG-35, MACHO 99-LMC-2, and OGLE 00-BUL-12. Photometry was derived from observational images by the MOA and OGLE groups using an image subtraction technique. For MACHO 98-BLG-35, additional photometry derived from the MPS and PLANET groups was included. Planetary modeling of the three events was carried out in a super-cluster computing environment. The estimated probability for explaining the data on MACHO 98-BLG-35 without a planet is <1%. The best planetary model has a planet of mass ~(0.4-1.5) X 10^-5 M_Earth at a projected radius of either ~1.5 or ~2.3 AU. We show how multi-planet models can be applied to the data. We calculated exclusion regions for the three events and found that Jupiter-mass planets can be excluded with projected radii from as wide as about 30 AU to as close as around 0.5 AU for MACHO 98-BLG-35 and OGLE 00-BUL-12. For MACHO 99-LMC-2, the exclusion region extends out to around 10 AU and constitutes the first limit placed on a planetary companion to an extragalactic star. We derive a particularly high peak magnification of ~160 for OGLE 00-BUL-12. We discuss the detectability of planets with masses as low as Mercury in this and similar events.
△ Less
Submitted 4 February, 2002; v1 submitted 11 February, 2001;
originally announced February 2001.
-
Real-Time Difference Imaging Analysis of MOA Galactic Bulge Observations During 2000
Authors:
I. A. Bond,
F. Abe,
R. J. Dodd,
J. B. Hearnshaw,
M. Honda,
J. Jugaku,
P. M. Kilmartin,
A. Marles,
K. Masuda,
Y. Matsubara,
Y. Muraki,
T. Nakamura,
G. Nankivell,
S. Noda,
C. Noguchi,
K. Ohnishi,
N. J. Rattenbury,
M. Reid,
To. Saito,
H. Sato,
M. Sekiguchi,
J. Skuljan,
D. J. Sullivan,
T. Sumi,
M. Takeuti
, et al. (5 additional authors not shown)
Abstract:
We describe observations carried out by the MOA group of the Galactic Bulge during 2000 that were designed to detect efficiently gravitational microlensing of faint stars in which the magnification is high and/or of short duration. These events are particularly useful for studies of extra-solar planets and faint stars. Approximately 17 degrees square were monitored at a sampling rate of up to 6…
▽ More
We describe observations carried out by the MOA group of the Galactic Bulge during 2000 that were designed to detect efficiently gravitational microlensing of faint stars in which the magnification is high and/or of short duration. These events are particularly useful for studies of extra-solar planets and faint stars. Approximately 17 degrees square were monitored at a sampling rate of up to 6 times per night. The images were analysed in real-time using a difference imaging technique. Twenty microlensing candidates were detected, of which 8 were alerted to the microlensing community whilst in progress. Approximately half of the candidates had high magnifications (>~10), at least one had very high magnification (>~50), and one exhibited a clear parallax effect. The details of these events are reported here, together with details of the on-line difference imaging technique. Some nova-like events were also observed and these are described, together with one asteroid.
△ Less
Submitted 22 July, 2001; v1 submitted 10 February, 2001;
originally announced February 2001.
-
Recent results by the MOA group on gravitational microlensing
Authors:
P. Yock,
I. Bond,
N. Rattenbury,
J. Skuljan,
T. Sumi,
FR. Abe,
R. Dodd,
J. Hearnshaw,
M. Honda,
J. Jugaku,
P. Kilmartin,
A. Marles,
K. Masuda,
Y. Matsubara,
Y. Muraki,
T. Nakamura,
G. Nankivell,
S. Noda,
C. Noguchi,
K. Ohnishi,
M. Reid,
To. Saito,
H. Sato,
M. Sekiguchi,
D. Sullivan
, et al. (3 additional authors not shown)
Abstract:
Recent work by the MOA gravitational microlensing group is briefly described, including (i) the current observing strategy, (ii) use of a high-speed parallel computer for analysis of results by inverse ray shooting, (iii) analysis of the light curve of event OGLE-2000-BUL12 in terms of extra-solar planets, and (iv) the MOA alert system using difference imaging.
Recent work by the MOA gravitational microlensing group is briefly described, including (i) the current observing strategy, (ii) use of a high-speed parallel computer for analysis of results by inverse ray shooting, (iii) analysis of the light curve of event OGLE-2000-BUL12 in terms of extra-solar planets, and (iv) the MOA alert system using difference imaging.
△ Less
Submitted 23 July, 2000; v1 submitted 20 July, 2000;
originally announced July 2000.
-
Test by JANZOS of the Standard Model of Cosmic Ray Acceleration in the COMPTEL/ROSAT Supernova Renmant
Authors:
F. Abe,
I. Bond,
E. Budding,
A. Daniel,
P. Dobcsanyi,
H. Fujii,
Z. Fujii,
N. Hayashida,
J. Hearnshaw,
K. Hibino,
S. Kabe,
K. Kasahara,
P. Kilmartin,
S. Laurence,
A. Masaike,
Y. Matsubara,
Y. Muraki,
T. Nakamura,
G. Nankivell,
M. Nishizawa,
N. Rattenbury,
M. Reid,
N. Rumsey,
M. Sakata,
H. Sato
, et al. (9 additional authors not shown)
Abstract:
A search for ultra-high energy gamma-rays emitted by the young, nearby supernova remnant that was discovered recently by the COMPTEL and ROSAT satellites was made using the JANZOS database for the period 1987-1993. A 95% confidence upper limit on the flux above 100 TeV of 3x10^(-13)cm^(-2)sec^(-1) was obtained. This is an order of magnitude below the expected flux based on the standard model of…
▽ More
A search for ultra-high energy gamma-rays emitted by the young, nearby supernova remnant that was discovered recently by the COMPTEL and ROSAT satellites was made using the JANZOS database for the period 1987-1993. A 95% confidence upper limit on the flux above 100 TeV of 3x10^(-13)cm^(-2)sec^(-1) was obtained. This is an order of magnitude below the expected flux based on the standard model of cosmic ray acceleration in supernova shocks. An optical survey of the region that has been commenced is also reported. This uses UK and ESO Schmidt plates, and CCD images by a NZ/Japan microlensing group.
△ Less
Submitted 21 November, 1999;
originally announced November 1999.
-
Photometry of pulsating stars in the Magellanic Clouds as observed in the MOA project
Authors:
J. B. Hearnshaw,
I. A. Bond,
N. J. Rattenbury,
S. Noda,
M. Takeuti,
F. Abe,
B. S. Carter,
R. J. Dodd,
M. Honda,
J. Jugaku,
S. Kabe,
P. M. Kilmartin,
B. S. Koribalski. Y. Matsubara,
K. Masuda,
Y. Muraki,
T. Nakamura,
M. Reid,
N. J. Rumsey,
To. Saito,
H. Sato,
M. Sekiguchi,
D. J. Sullivan,
T. Sumi,
Y. Watase,
T. Yanagisawa
, et al. (2 additional authors not shown)
Abstract:
A review of the MOA (Microlensing Observations in Astrophysics) project is presented. MOA is a collaboration of approximately 30 astronomers from New Zealand and Japan established with the aim of finding and detecting microlensing events towards the Magellanic Clouds and the Galactic bulge, which may be indicative of either dark matter or of planetary companions. The observing program commenced…
▽ More
A review of the MOA (Microlensing Observations in Astrophysics) project is presented. MOA is a collaboration of approximately 30 astronomers from New Zealand and Japan established with the aim of finding and detecting microlensing events towards the Magellanic Clouds and the Galactic bulge, which may be indicative of either dark matter or of planetary companions. The observing program commenced in 1995, using very wide band blue and red filters and a nine-chip mosaic CCD camera.
As a by-product of these observations a large database of CCD photometry for 1.4 million stars towards both LMC and SMC has been established. In one preliminary analysis 576 bright variable stars were confirmed, nearly half of them being Cepheids. Another analysis has identified large numbers of blue variables, and 205 eclipsing binaries are included in this sample. In addition 351 red variables (AGB stars) have been found. Light curves have been obtained for all these stars. The observations are carried out on a 61-cm f/6.25 telescope at Mt John University Observatory where a new larger CCD camera was installed in 1998 July. From this latitude (44 S) the Magellanic Clouds can be monitored throughout the year.
△ Less
Submitted 17 November, 1999;
originally announced November 1999.
-
On Planetary Companions to the MACHO-98-BLG-35 Microlens Star
Authors:
S. H. Rhie,
D. P. Bennett,
A. C. Becker,
B. A. Peterson,
P. C. Fragile,
B. R. Johnson,
J. L. Quinn,
A. Crouch,
J. Gray,
L. King,
B. Messenger,
S. Thomson,
I. A. Bond,
F. Abe,
B. S. Carter,
R. J. Dodd,
J. B. Hearnshaw,
M. Honda,
J. Jugaku,
S. Kabe,
P. M. Kilmartin,
B. S. Koribalski,
K. Masuda,
Y. Matsubara,
Y. Muraki
, et al. (16 additional authors not shown)
Abstract:
We present observations of microlensing event MACHO-98-BLG-35 which reached a peak magnification factor of almost 80. These observations by the Microlensing Planet Search (MPS) and the MOA Collaborations place strong constraints on the possible planetary system of the lens star and show intriguing evidence for a low mass planet with a mass fraction $4\times 10^{-5} \leq ε\leq 2\times 10^{-4}$. A…
▽ More
We present observations of microlensing event MACHO-98-BLG-35 which reached a peak magnification factor of almost 80. These observations by the Microlensing Planet Search (MPS) and the MOA Collaborations place strong constraints on the possible planetary system of the lens star and show intriguing evidence for a low mass planet with a mass fraction $4\times 10^{-5} \leq ε\leq 2\times 10^{-4}$. A giant planet with $ε= 10^{-3}$ is excluded from 95% of the region between 0.4 and 2.5 $R_E$ from the lens star, where $R_E$ is the Einstein ring radius of the lens. This exclusion region is more extensive than the generic "lensing zone" which is $0.6 - 1.6 R_E$. For smaller mass planets, we can exclude 57% of the "lensing zone" for $ε= 10^{-4}$ and 14% of the lensing zone for $ε= 10^{-5}$. The mass fraction $ε= 10^{-5}$ corresponds to an Earth mass planet for a lensing star of mass $\sim 0.3 \msun$. A number of similar events will provide statistically significant constraints on the prevalence of Earth mass planets. In order to put our limits in more familiar terms, we have compared our results to those expected for a Solar System clone averaging over possible lens system distances and orientations. We find that such a system is ruled out at the 90% confidence level. A copy of the Solar System with Jupiter replaced by a second Saturn mass planet can be ruled out at 70% confidence. Our low mass planetary signal (few Earth masses to Neptune mass) is significant at the $4.5σ$ confidence level. If this planetary interpretation is correct, the MACHO-98-BLG-35 lens system constitutes the first detection of a low mass planet orbiting an ordinary star without gas giant planets.
△ Less
Submitted 25 January, 2000; v1 submitted 12 May, 1999;
originally announced May 1999.
-
MACHO Alert 95-30 : First Real-Time Observation of Extended Source Effects in Gravitational Microlensing
Authors:
C. Alcock,
W. H. Allen,
R. A. Allsman,
D. Alves,
T. S. Axelrod,
T. S. Banks,
S. F. Beaulieu,
A. C. Becker,
R. H. Becker,
D. P. Bennett,
I. A. Bond,
B. S. Carter,
K. H. Cook,
R. J. Dodd,
K. C. Freeman,
M. Gregg,
K. Griest,
J. B. Hearnshaw,
A. Heller,
M. Honda,
J. Jugaku,
S. Kabe,
S. Kaspi,
P. M. Kilmartin,
A. Kitamura
, et al. (32 additional authors not shown)
Abstract:
We present analysis of MACHO Alert 95-30, a dramatic gravitational microlensing event towards the Galactic bulge whose peak magnification departs significantly from the standard point-source microlensing model. Alert 95-30 was observed in real-time by the Global Microlensing Alert Network (GMAN), which obtained densely sampled photometric and spectroscopic data throughout the event. We interpret…
▽ More
We present analysis of MACHO Alert 95-30, a dramatic gravitational microlensing event towards the Galactic bulge whose peak magnification departs significantly from the standard point-source microlensing model. Alert 95-30 was observed in real-time by the Global Microlensing Alert Network (GMAN), which obtained densely sampled photometric and spectroscopic data throughout the event. We interpret the light-curve ``fine structure'' as indicating transit of the lens across the extended face of the source star. This signifies resolution of a star several kpc distant. We find a lens angular impact parameter theta_{min}/theta_{source} = 0.715 +/- 0.003. This information, along with the radius and distance of the source, provides an additional constraint on the lensing system. Spectroscopic and photometric data indicate the source is an M4 III star of radius 61 +/- 12 Rsun, located on the far side of the bulge at 9 kpc. We derive a lens angular velocity, relative to the source, of 21.5 +/- 4.9 km/s/kpc, where the error is dominated by uncertainty in the source radius. Likelihood analysis yields a median lens mass of 0.67{+2.53}{-0.46} Msun, located with 80% probability in the Galactic bulge at a distance of 6.93{+1.56}{-2.25} kpc. If the lens is a main-sequence star, we can include constraints on the lens luminosity. This modifies our estimates to M_lens = 0.53{+0.52}{-0.35} Msun and D_lens = 6.57{+0.99}{-2.25} kpc. Spectra taken during the event show that the absorption line equivalent widths of H alpha and the TiO bands near 6700 A vary, as predicted for microlensing of an extended source. This is most likely due to center-to-limb variation in the stellar spectral lines. These data demonstrate the feasibility of using microlensing limb crossings as a tool to probe stellar atmospheres directly.
△ Less
Submitted 22 February, 1997;
originally announced February 1997.
