3264527
Designing and mining multi-terabyte astronomy archives: the Sloan Digital Sky Survey
The next-generation astronomy digital archives will cover most of the sky at fine resolution in many wavelengths, from X-rays, through ultraviolet, optical, and infrared. The archives will be stored at diverse geographical locations. One of the first of these projects, the Sloan Digital Sky Survey (SDSS) is creating a 5-wavelength catalog over 10,000 square degrees of the sky (see http://www.sdss.org/). The 200 million objects in the multi-terabyte database will have mostly numerical attributes in a 100+ dimensional space. Points in this space have highly correlated distributions.
The archive will enable astronomers to explore the data interactively. Data access will be aided by multidimensional spatial and attribute indices. The data will be partitioned in many ways. Small tag objects consisting of the most popular attributes will accelerate frequent searches. Splitting the data among multiple servers will allow parallel, scalable I/O and parallel data analysis. Hashing techniques will allow efficient clustering, and pair-wise comparison algorithms that should parallelize nicely. Randomly sampled subsets will allow de-bugging otherwise large queries at the desktop. Central servers will operate a data pump to support sweep searches touching most of the data. The anticipated queries will require special operators related to angular distances and complex similarity tests of object properties, like shapes, colors, velocity vectors, or temporal behaviors. These issues pose interesting data management challenges.
14193738
Cosmological Parameters from Eigenmode Analysis of Sloan Digital Sky Survey Galaxy Redshifts
We present estimates of cosmological parameters from the application of the Karhunen-Loeve transform to the analysis of the three-dimensional power spectrum of density fluctuations using Sloan Digital Sky Survey galaxy redshifts. We use Ωmh and fb = Ωb/Ωm to describe the shape of the power spectrum, σ for the (linearly extrapolated) normalization, and β to parameterize linear theory redshift-space distortions. On scales k 0.16 h Mpc-1, our maximum likelihood values are Ωmh = 0.264 ± 0.043, fb = 0.286 ± 0.065, σ = 0.966 ± 0.048, and β = 0.45 ± 0.12. When we take a prior on Ωb from the Wilkinson Microwave Anisotropy Probe (WMAP), we find Ωmh = 0.207 ± 0.030, which is in excellent agreement with WMAP and the Two-Degree Field. This indicates that we have reasonably measured the gross shape of the power spectrum, but we have difficulty breaking the degeneracy between Ωmh and fb, because the baryon oscillations are not resolved in the current spectroscopic survey window function.
12139365
TeraScale SneakerNet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange
Large datasets are most economically trnsmitted via parcel post given the current economics of wide-area networking. This article describes how the Sloan Digital Sky Survey ships terabyte scale datasets both within the US and to Europe and Asia. We 3GT storage bricks (Ghz processor, GB ram, GbpsEthernet, TB disk) for about 2k$ each. These bricks act as database servers on the LAN. They are loaded at one site and read at the second site. The paper describes the bricks, their economics, and some software issues that they raise.
3204824
Designing a multi-petabyte database for LSST
The 3.2 giga-pixel LSST camera will produce approximately half a petabyte of archive images every month. These data need to be reduced in under a minute to produce real-time transient alerts, and then added to the cumulative catalog for further analysis. The catalog is expected to grow about three hundred terabytes per year. The data volume, the real-time transient alerting requirements of the LSST, and its spatio-temporal aspects require innovative techniques to build an efficient data access system at reasonable cost. As currently envisioned, the system will rely on a database for catalogs and metadata. Several database systems are being evaluated to understand how they perform at these data rates, data volumes, and access patterns. This paper describes the LSST requirements, the challenges they impose, the data access philosophy, results to date from evaluating available database technologies against LSST requirements, and the proposed database architecture to meet the data challenges.
17368591
The Sloan Digital Sky Survey Science Archive: Migrating a Multi-Terabyte Astronomical Archive from Object to Relational DBMS
The Sloan Digital Sky Survey Science Archive is the first in a series of multi-Terabyte digital archives in Astronomy and other data-intensive sciences. To facilitate data mining in the SDSS archive, we adapted a commercial database engine and built specialized tools on top of it. Originally we chose an object-oriented database management system due to its data organization capabilities, platform independence, query performance and conceptual fit to the data. However, after using the object database for the first couple of years of the project, it soon began to fall short in terms of its query support and data mining performance. This was as much due to the inability of the database vendor to respond our demands for features and bug fixes as it was due to their failure to keep up with the rapid improvements in hardware performance, particularly faster RAID disk systems. In the end, we were forced to abandon the object database and migrate our data to a relational database. We describe below the technical issues that we faced with the object database and how and why we migrated to relational technology.
19318578
Extending the SDSS Batch Query System to the National Virtual Observatory Grid
The Sloan Digital Sky Survey science database is approaching 2TB. While the vast majority of queries normally execute in seconds or minutes, this interactive execution time can be disproportionately increased by a small fraction of queries that take hours or days to run; either because they require non-index scans of the largest tables or because they request very large result sets. In response to this, we added a multi-queue job submission and tracking system. The transfer of very large result sets from queries over the network is another serious problem. Statistics suggested that much of this data transfer is unnecessary; users would prefer to store results locally in order to allow further cross matching and filtering. To allow local analysis, we implemented a system that gives users their own personal database (MyDB) at the portal site. Users may transfer data to their MyDB, and then perform further analysis before extracting it to their own machine. 
We intend to extend the MyDB and asynchronous query ideas to multiple NVO nodes. This implies development, in a distributed manner, of several features, which have been demonstrated for a single node in the SDSS Batch Query System (CasJobs). The generalization of asynchronous queries necessitates some form of MyDB storage as well as workflow tracking services on each node and coordination strategies among nodes.
119385831
Gravitational instantons, extra dimensions and form fields.
A broad class of higher-dimensional instanton solutions are found for a theory which contains gravity, a scalar field and antisymmetric tensor fields of arbitrary rank. The metric used, a warp product of an arbitrary number of any compact Einstein manifolds, includes many of great interest in particle physics and cosmology. For example 4D FRW universes with additional dimensions compactified on a Calabi-Yau three fold, a torus, a compact hyperbolic manifold or a sphere are all included. It is shown that the solution of this form which dominates the Hartle Hawking path integral is always a higher-dimensional generalisation of a Hawking Turok instanton when the potential of the scalar field is such that these instantons can exist. On continuation to lorentzian signature such instantons give rise to a spacetime in which all of the spatial dimensions are of equal size and where the spatial topology is that of a sphere. The extra dimensions are thus not hidden. In the case where the potential for the scalar field is generated solely by a dilatonic coupling to the form fields we find no integrable instantons at all. In particular we find no integrable solutions of the type under consideration for the supergravity theories which are the low energy effective field theories of superstrings.
10633484
Stabilizing all geometric moduli in heterotic Calabi-Yau vacua
We propose a scenario to stabilize all geometric moduli - that is, the complex structure, Kahler moduli and the dilaton - in smooth heterotic Calabi-Yau compactifications without Neveu-Schwarz three-form flux. This is accomplished using the gauge bundle required in any heterotic compactification, whose perturbative effects on the moduli are combined with non-perturbative corrections. We argue that, for appropriate gauge bundles, all complex structure and a large number of other moduli can be perturbatively stabilized - in the most restrictive case, leaving only one combination of Kahler moduli and the dilaton as a flat direction. At this stage, the remaining moduli space consists of Minkowski vacua. That is, the perturbative superpotential vanishes in the vacuum without the necessity to fine-tune flux. Finally, we incorporate non-perturbative effects such as gaugino condensation and/or instantons. These are strongly constrained by the anomalous U(1) symmetries which arise from the required bundle constructions. We present a specific example, with a consistent choice of non-perturbative effects, where all remaining flat directions are stabilized in an AdS vacuum.
96427576
The Atiyah class and complex structure stabilization in heterotic Calabi-Yau compactifications
Holomorphic gauge fields in N = 1 supersymmetri cheterotic compactifications can constrain the complex structure moduli of a Calabi-Yau manifold. In this paper, the tools necessary to use holomorphic bundles as a mechanism for moduli stabilization are systematically developed. We review the requisite deformation theory — including the Atiyah class, which determines the deformations of the complex structure for which the gauge bundle becomes non-holomorphic and, hence, non-supersymmetric. In addition, two equivalent approaches to this mechanism of moduli stabilization are presented. The first isan efficient computational algorithm for determining the supersymmetric moduli space, while the second is an F-term potential in the four-dimensional theory associated with vector bundle holomorphy. These three methods are proven to be rigorously equivalent. We present explicit examples in which large numbers of complex structure moduli are stabilized. Finally, higher-order corrections to the moduli space are discussed.
118713151
Heterotic domain wall solutions and SU(3) structure manifolds
A bstractWe examine compactifications of heterotic string theory on manifolds with SU(3) structure. In particular, we study $ \mathcal{N} = {{1} \left/ {2} \right.} $ domain wall solutions which correspond to the perturbative vacua of the 4D, $ \mathcal{N} = 1 $ supersymmetric theories associated to these compactifications. We extend work which has appeared previously in the literature in two important regards. Firstly, we include two additional fluxes which have been, heretofore, omitted in the general analysis of this situation. This allows for solutions with more general torsion classes than have previously been found. Secondly, we provide explicit solutions for the fluxes as a function of the torsion classes. These solutions are particularly useful in deciding whether equations such as the Bianchi identities can be solved, in addition to the Killing spinor equations themselves. Our work can be used to straightforwardly decide whether any given SU(3) structure on a six-dimensional manifold is associated with a solution to heterotic string theory. To illustrate how to use these results, we discuss a number of examples taken from the literature.
14395401
Perturbative antibrane potentials in heterotic M theory
We derive the perturbative four-dimensional effective theory describing heterotic M theory with branes and antibranes in the bulk space. The backreaction of both the branes and antibranes is explicitly included. To first order in the heterotic {epsilon}{sub S} expansion, we find that the forces on branes and antibranes vanish and that the Kachru-Kallosh-Linde-Trivedi (KKLT) procedure of simply adding to the supersymmetric theory the probe approximation to the energy density of the antibrane reproduces the correct potential. However, there are additional nonsupersymmetric corrections to the gauge-kinetic functions and matter terms. The new correction to the gauge-kinetic functions is important in a discussion of moduli stabilization. At second order in the {epsilon}{sub S} expansion, we find that the forces on the branes and antibranes become nonvanishing. These forces are not precisely in the naive form that one may have anticipated and, being second order in the small parameter {epsilon}{sub S}, they are relatively weak. This suggests that moduli stabilization in heterotic models with antibranes is achievable.