The GRHydro code: three-dimensional relativistic hydrodynamics

Original authors: Luca Baiotti, Ian Hawke, Pedro Montero
Contributors: Sebastiano Bernuzzi, Giovanni Corvino, Toni Font, Joachim Frieben,
Roberto De Pietri, Thorsten Kellermann, Frank Löffler, Christian D. Ott,
Luciano Rezzolla, Nikolaos Stergioulas, Aaryn Tonita,
and many others,
especially those who were in the European Network “Sources of Gravitational Waves”

Date: 2009-12-07 19:20:47 -0600 (Mon, 07 Dec 2009)

Abstract

GRHydro is a fully general-relativistic three-dimensional hydrodynamics code. It evolves the hydrodynamics using High Resolution Shock Capturing methods and can work with realistic equations of state. The evolution of the spacetime can be done by any other “appropriate” thorn, such as the CCATIE code, maintained and developed at the Albert-Einstein-Institut (Potsdam).

1 Introduction

The GRHydro1 code is based upon the public version of the Whisky code which is a product of the EU Network on Sources of Gravitational Radiation2 , and was initially written by Luca Baiotti, Ian Hawke and Pedro Montero, based on the publicly available GR3D code and with many other important contributors. With the help of large parts of the community, the GRHydro code got improved, extended and included into the Einstein Toolkit.

2 Using This Thorn

What follows is a brief introduction to using GRHydro. It assumes that you know the required physics and numerical methods, and also the basics of Cactus3 . If you don’t, then skip this section and come back to it after reading the rest of this ThornGuide of Cactus. For more details such as thornlists and parameter files, take a look at the Einstein Toolkit web page which is currently stored at

http://www.einsteintoolkit.org

GRHydro uses the hydro variables defined in HydroBase and provides own “conserved” hydro variables and methods to evolve them. It does not provide any information about initial data or equations of state. For these, other thorns are required. A minimal list of thorns for performing a shock-tube test is given in the shock-tube test parameter file, found at

GRHydro/test/GRHydro_test_shock.par

and will include the essential thorns

GRHydro EOS_Omni ADMBase ADMCoupling MoL

Initial data for shocks can be set using

GRHydro_Init_Data

Initial data for spherically symmetric static stars (with perturbations or multiple “glued” stars) can be set by

TOVSolver

The actual evolution in time is controlled by the Method of Lines thorn MoL. For full details see the relevant ThornGuide. For the purposes of GRHydro at least two parameters are relevant; ode_method and mol_timesteps. If second-order accuracy is all that is required then ode_method can be set to either "rk2" (second-order TVD Runge-Kutta evolution) or "icn" (Iterative Crank Nicholson, number of iterations controlled by mol_timesteps, defaults to three), and mol_timesteps can be ignored. A more generic (and hence less efficient) method can be chosen by setting ode_method to "genrk" which is a Shu-Osher type TVD Runge-Kutta evolution. Then the parameter mol_timesteps controls the number of intermediate steps and hence the order of accuracy. First to seventh order are currently supported.

GRHydro currently uses a Reconstruction-Evolution type method. The type of reconstruction is controlled by the parameter recon_method. The currently supported values are "tvd" for slope limited TVD reconstruction, "ppm" for the Colella-Woodward PPM method, and "eno" for the Essentially Non-Oscillatory method of Harten et al. Each of these has further controlling parameters. For example there are a number of slope limiters controlled by the keyword tvd_limiter, the PPM method supports shock detection by the Boolean ppm_detect, and the ENO method can have various orders of accuracy controlled by eno_order. Note that the higher-order methods such as PPM and ENO require the stencil size to be increased using GRHydro_stencil and driver::ghost_size.

For the evolution various approximate Riemann solvers are available, controlled by riemann_solver. Currently implemented are "HLLE", "Roe" and "Marquina". For the Roe and Marquina methods there are added options to choose which method is used for calculating the left eigenvectors. This now defaults to the efficient methods of the Valencia group, but the explicit matrix inversion is still there for reference.

For the equations of state, two “types” are recognized, controlled by the parameter GRHydro_eos_type. These are "Polytype" where the pressure is a function of the rest-mass density, P = P(ρ), and the more generic "General" type where the pressure is a function of the rest-mass density and the specific internal energy, P = P(ρ,𝜖). For the Polytype equations of state one fewer equation is evolved and the specific internal energy is set directly from the rest-mass density. The actual equation of state used is controlled by the parameter GRHydro_eos_table. Polytype equations of state include "2D_Polytrope" and general equations of state include "Ideal_Fluid".

2.1 Obtaining This Thorn

The public version of GRHydro can be found on the website http://www.einsteintoolkit.org.

2.2 Basic Usage

The simplest way to start using GRHydro would be to download some example parameter files from the web page to try it. There are a number of essential parameters which might reward some experimentation. These include:

2.3 Special Behaviour

Although in theory GRHydro can deal with conformal metrics as well as physical metrics, this part of the code is completely untested as we don’t have conformal initial data (although this would not be hard - we just haven’t had the incentive).

2.4 Interaction With Other Thorns

GRHydro provides the appropriate contribution to the stress energy through the TmunuBase interface. Those spacetime evolvers that use this interface can use GRHydro without change.

GRHydro uses the MoL thorn to perform the actual time evolution. This means that if all other evolution thorns are also using MoL then the complete evolution will have the accuracy of the MoL evolution method without change. This (currently) allows for up to fourth-order accuracy in time without any changes to GRHydro.

For the general equations of state GRHydro uses the EOS_Omni interface. This returns the necessary hydrodynamical quantities, such as the pressure and derivatives with general function calls. The parameter GRHydro_eos_table controls which equation of state is used during evolution.

For the metric quantities GRHydro uses the standard CactusEinstein arrangement, especially ADMBase. This allows the standard thorns to be used for the calculation of constraint violations, emission of gravitational waves, location of the apparent horizon, and more.

2.5 Support and Feedback

GRHydro is part of the Einstein Toolkit, with its web page located at

http://www.einsteintoolkit.org

It contains information on obtaining the code, together with thornlists and sample parameter files. For questions, send an email to the Einstein Toolkit mailing list users@einsteintoolkit.org.

3 Physical System

The equations of general relativistic hydrodynamics can be written in the flux conservative form

tq + xif(i)(q) = s(q), (1)

where q is a set of conserved variables, f(i)(q) the fluxes and s(q) the source terms. The five conserved variables are labeled D, Si, and τ, where D is the generalized particle number density, Si are the generalized momenta in each direction, and τ is an internal energy term. These conserved variables are composed from a set of primitive variables, which are ρ, the rest-mass density, p, the pressure, vi, the fluid 3-velocities, 𝜖, the specific internal energy, and W, the Lorentz factor, via the following relations  

D = γWρ Si = γρhW2 vi τ = γ ρhW2 p D, (2)

where γ is the determinant of the spatial 3-metric γij and h 1 + 𝜖 + pρ. Only five of the primitive variables are independent. Usually the Lorentz factor is defined in terms of the velocities and the metric as W = (1 γijvivj)12. Also one of the pressure, rest-mass density or specific internal energy terms is given in terms of the other two by an equation of state.

The fluxes are usually defined in terms of both the conserved variables and the primitive variables:

Fi(U) = [D(αvi βi),S j(αvi βi) + pδ ji,τ(αvi βi) + pvi]T. (3)

The source terms are

s(U) = 0,Tμν μgνj + Γμνδg δj,αTμ0 μ lnα TμνΓ νμ0. (4)

Note that the source terms do not contain differential operators acting on the stress-energy tensor and that this is important for the numerical preservation of the hyperbolicity character of the system. Also note that in a curved spacetime the equations are not in a strictly-homogeneous conservative form, which is recovered only in flat spacetime. This conservative form of the relativistic Euler equations was first derived by the group at the Universidad de Valencia [3] and therefore was named the Valencia formulation.

For more detail see the review of Font [9].

4 Numerical Implementation

5 High Resolution Shock Capturing methods

The numerical evolution of a hydrodynamical problem is complicated by the occurrence of shocks, i.e. genuine nonlinear discontinuities that will generically form. It is also complicated by the conservation constraint. In a High Resolution Shock Capturing (HRSC) method the requirement of conservation is used to ensure the correct evolution of a shock. A HRSC method also avoids spurious oscillations at shocks which are known as Gibbs’ phenomena, while retaining a high order of accuracy over the majority of the domain.

For a full introduction to HRSC methods see [14], [20], [15], [16] and [9].

In the GRHydro code it was decided to use the method of lines as a base for the HRSC scheme. The method of lines is a way of turning a partial differential equation such as (1) into an ordinary differential equation. For the GRHydro code the following steps are required.

This ordinary differential equation can be solved by the Cactus thorn MoL. All that GRHydro has to do is to return the values of the discrete spatial differential operator

L(q) = sd3x +xj122xj+122 xk123xk+123 f(1)(q(x i121,y,z))dydz xj122xj+122 xk123xk+123 f(1)(q(x i+121,y,z))dydz + (6)

given the data q, and to supply the boundary conditions that will be required to calculate this right hand side at the next time level. We note that in the current implementation of MoL the solution to the ordinary differential equation (5) will be Nth-order accurate provided that the time integrator used by MoL is Nth-order accurate in time, and that the discrete operator L is Nth-order accurate in space and first-order (or better) accurate in time. For more details on the method of lines, and the options given with the time integration for MoL, see the relevant chapter in the ThornGuide.

In this implementation of GRHydro the right hand side operator L will be simplified considerably by approximating the integrals by the midpoint rule to get

L(q) = si,j,k + fi12,j,k(1) f i+12,j,k(1) + (7)

where the dependence of the flux on q and spatial position is implicit in the notation. Given this simplification, the calculation of the right hand side operator splits simply into the following two parts:

  1. Calculate the source terms s(q(xi1,xj2,xk3)):

    Given that q̄ is a second-order accurate approximation to q at the midpoint of the cell, which is precisely (xi1,xj2,xk3), for second-order accuracy it is sufficient to use s(q̄i,j,k).

  2. In each coordinate direction xa, calculate the intercell flux f(a)(qi+12,j,k):

    From the initial data q̄ given at time tn we can reconstruct the data at the cell boundary, (qi+12,j,k) to any required accuracy in space (except in the vicinity of a shock, where only first-order accuracy is guaranteed). However this will only be zeroth-order accurate in time. To ensure first-order accuracy in time, we have to find (qi+12,j,k)(t) while retaining the high spatial order of accuracy. This requires two steps:

    1. Reconstruct the data q over the cells adjacent to the required cell boundary. This reconstruction should use the high spatial order of accuracy. This gives two values of (qi+12,j,k), which we call qL and qR, where qL is obtained from cell i (left cell) and qR from cell i + 1 (right cell).
    2. The values qL,R are used as initial data for the Riemann problem. This is the initial value problem given by the partial differential equation (1) with semi-infinite piecewise constant initial data qL,R. As the true function q is probably not piecewise constant we will not get the exact solution of the general problem even if we solve the local Riemann problem exactly. However, it will be first-order accurate in time and retain the high order of accuracy in space which, as explained in the documentation to the MoL thorn, is sufficient to ensure that the method as a whole has a high order of accuracy.

So, the difficult part of GRHydro is expressed in two routines. One that reconstructs the function q at the boundaries of a computational cell given the cell average data q̄, and another that calculates the intercell flux f at this cell boundary.

6 Reconstruction

In the reduction of all of GRHydro to two routines in the last section one point was glossed over. That is, in order for the numerical method to be consistent and convergent it must retain conservation and not introduce spurious oscillations. Up to this point all the steps have either been exact or have neither changed the conservation properties or the profile of the function. Also, the calculation of the intercell flux from the Riemann problem can be made to be “exactly correct”. That is, even though as explained above it may not be the true flux for the real function q, it will be the exact physical solution for the values qL,R given by the reconstruction routine, so the intercell flux cannot violate conservation or introduce oscillations. Unphysical effects such as these can only be introduced by an incorrect reconstruction.

For a full explanation of reconstruction methods see Laney [14], Toro [20], Leveque [15]. For the moment we will concentrate on the simplest methods that are better than first-order accurate in space, the TVD slope-limited methods. More complex methods such as ENO will be introduced later.

In the late 1950’s Godunov proved a theorem that, in this context, says

Any linear reconstruction method of higher-than-first-order accuracy may introduce spurious oscillations.

For this theorem linear meant that the reconstruction method was independent of the data it was reconstructing. Simple centred differencing is a linear second-order method and is oscillatory near a shock. Instead we must find a reconstruction method that depends on the data q being reconstructed.

Switching our attention to conservation, we note that there is precisely one conservative first-order reconstruction method,

qFirst(x) = q̄ i,x [xi12,xi+12], (8)

and that any second-order conservative method can be written in terms of a slope or rather difference Δi as

qSecond(x) = q̄ i + x xi xi+12 xi12Δi,x [xi12,xi+12]. (9)

6.1 TVD Reconstruction

As we want a method that is accurate (i.e., at least to second order) while being stable (i.e., only first order or nonlinear at shocks) then the obvious thing to do is to use some second-order method in the form of equation (9) in smooth regions but which changes to the form of equation (8) smoothly near shocks.

In the articles describing the GRAstro_Hydro code4 , this was described as an average of the two reconstructions,

qTV D(x) = ϕ(q)qSecond + (1 ϕ(q))qFirst, (10)

where ϕ [0,1] varies smoothly in some sense, and is zero near a shock and 1 in smooth regions. In Toro’s notation [20] (which we usually adopt here) the slope limiter function ϕ (having the same attributes as above) directly multiplies the slope, giving

qTV D(x) = q̄ i + x xi xi+12 xi12ϕ(q)Δi,x [xi12,xi+12]. (11)

Equations (10) and (11) are equivalent.

For details on how to construct a limiter, on their stability regions and on the explicit expressions for the limiters used here, see [20]. The GRHydro code implements the minmod limiter (the most diffusive and the default), the Van Leer Monotonized Centred (MC) (VanLeerMC) limiter in a number of forms (which should give equivalent results), and the Superbee limiter. The limiter specified by the parameter value VanLeerMC2 is the recommended one.

As an example, we show how TVD with the minmod limiter is implemented in the code. First, we define the minmod function:

minmod(a,b) = min(|a|,|b|)if (ab > 0) 0 otherwise. (12)

For reconstructing q we choose two differences

Δupw =qi qi1 Δloc =qi+1 qi, (13)

and write

qTV D,minmod(x) = q̄ i + x xi xi+12 xi12minmod(Δupw,Δloc),x [xi12,xi+12]. (14)

6.2 PPM reconstruction

The piecewise parabolic method (PPM) of Colella and Woodward [4] is a rather more complex method that requires a number of steps. The implementation in the GRHydro code is specialized to use evenly spaced grids. Also, some of the more complex features are not implemented; in particular, the dissipation algorithm is only the simplest given in the original article. Here we just give the implementation details. For more details on the method we refer to the original article.

Again we assume we are reconstructing a scalar function q as a function of x in one dimension on an evenly spaced grid, with spacing Δx. The first step is to interpolate a quadratic polynomial to the cell boundary,

qi+12 = 1 2 qi+1 + qi + 1 6 δmqi δmqi+1 , (15)

where

δmqi = min(|δqi|,2|qi+1 qi|,2|qi qi1|) sign(δqi)if (qi+1 qi)(qi qi1) > 0, 0 otherwise. , (16)

and

δqi = 1 2(qi+1 qi1). (17)

At this point we set both left and right states at the interface to be equal to this,

qiR = q i+1L = q 1+12. (18)

This reconstruction will be oscillatory near shocks. To preserve monotonicity, the following replacements are made:

qiL = q iR = q i if (qiR q i)(qi qiL) 0 (19) qiL = 3q i 2qiR if (q iR q iL) q i 1 2(qiL + q iR) > 1 6(qiR q iL)2 (20) qiR = 3q i 2qiL if (q iR q iL) q i 1 2(qiL + q iR) < 1 6(qiR q iL)2. (21)

However, before applying the monotonicity preservation two other steps may be applied. Firstly we may steepen discontinuities. This is to ensure sharp profiles and is only applied to contact discontinuities. This may be switched on or off using the parameter ppm_detect. This part of the method replaces the cell boundary reconstructions of the density with

ρiL = ρ iL(1 η) + ρ i1 + 1 2δmρi1 η (22) ρiR = ρ iR(1 η) + ρ i+1 1 2δmρi+1 η (23)

where η is only applied if the discontinuity is mostly a contact (see [4] for the details) and is defined as

η = max(0,min(1,η1(η̃ η2))), (24)

where η1,η2 are positive constants and

η̃ = ρi2ρi+2+4δρi 12δρi  if  δ2ρi+1δ2ρi1 < 0 (ρi+1 ρi1) 𝜖min(|ρi+1|,|ρi1|) > 0 0 otherwise ,

with 𝜖 another positive constant and

δ2ρ i = ρi+1 2ρi + ρi1 6Δx2 . (25)

Another step that is performed before monotonicity enforcement is to flatten the zone structure near shocks. This adds simple dissipation and is always in the code. In short, the reconstructions are again altered to

qiL,R = ν iqiL,R + (1 ν i)qi, (26)

where

νi = max(0,1 max(0,ω2(pi+1pi1 pi+2pi2 ω1))) if ω0min(pi1,pi+1) < |pi+1 pi1| and vi1x vi+1x > 0 1 otherwise (27)

and ω0,ω1,ω2 are constants.

The above flattening procedure is not the one in the original article of Colella and Woodward, but it has been adapted from it in order to have a stencil of three points. The original flattening procedure is also implemented in GRHydro. Instead of 26, it consists in the formula

qiL,R = ν̃ iqiL,R + (1 ν̃ i)qi, (28)

where

ν̃i = maxνi,νi+sign(pi1pi+1) (29)

and νi is given by 27. This can be activated by setting the parameter ppm_flatten to stencil_4. Formula 28, despite requiring more computational resources (especially when mesh refinement is used), usually gives very similar results to 26, so we routinely use 26.

6.3 ENO Reconstruction

An alternative way of getting higher-than-second-order accuracy is the implementation of the Essentially Non-Oscillatory methods of Harten et.al [11]. The essential idea is to alter the stencil to use those points giving the smoothest reconstruction. The only restriction is that the stencil must include the cell to be reconstructed (for stability). Here we describe the simplest ENO type reconstruction: piecewise polynomial reconstruction using the (un)divided differences to measure the smoothness.

Let k be the order of the reconstruction. Suppose we are reconstructing the scalar function q in cell i. We start with the cell Ii. We then add to the stencil cell Ij, where j = i ± 1, where we choose j to minimize the Newton divided differences

q xi1,xi = qi qi1 xi+12 xi32 (30) q xi,xi+1 = qi+1 qi xi+32 xi12. (31)

We then recursively add more cells, minimizing the higher-order Newton divided differences q xik,,xi+j defined by

q xik,,xi+j = q xik+1,,xi+j q xik,,xi+j1 xi+j xik . (32)

The reconstruction at the cell boundary is given by a standard kth-order polynomial interpolation on the chosen stencil.

[19] has outlined an elegant way of calculating the cell boundary values solely in terms of the stencil and the known data. If the stencil is given by

S(i) = Iir,,Ii+kr1 , (33)

for some integer r, then there exist constants crj depending only on the grid xi such that the boundary values for cell Ii are given by

qi+12 = j=0k1c rjqir+j,qi12 = j=0k1c r1,jqir+j. (34)

The constants crj are given by the rather complicated formula

crj = m=j+1k l=0,lmk q=0,qm,lk xi+12 xir+q12 l=0,lmk xir+m12 xir+L12 Δxir+j. (35)

This simplifies considerably if the grid is even. The coefficients for an even grid are given (up to seventh order) by [19].

7 Riemann Problems

Given the reconstructed data, we then solve a local Riemann problem in order to get the intercell flux. The Riemann problem is specified by an equation in flux conservative homogeneous form,

tq + xif(i)(q) = 0 (36)

with piecewise constant initial data qL,R separated by a discontinuity at x(1) = 0. Flux terms for the other directions are given similarly. There is no intrinsic scale to this problem and so the solution must be a self similar solution with similarity variable ξ = x(1)t. The solution is given in terms of waves which separate different states, with each state being constant. The waves are either shocks, across which all hydrodynamical variables change discontinuously, rarefactions, across which all the variables change continuously (the wave is not a single value of ξ for a rarefaction, but spreads across a finite range), or contact or tangential discontinuities, across which some but not all of the hydrodynamical variables change discontinuously and the rest are constant. The characteristics of the matter evolution converge and break at a shock, diverge at a rarefaction and are parallel at the other linear discontinuities.

The best references for solving the Riemann problem either exactly or approximately are [15], [20], [14]. Here, we start by giving a simple outline. We start by considering the N dimensional linear problem in one dimension given by

tq + Axq = 0, (37)

where A is a N × N matrix with constant coefficients. We define the eigenvalues λj with associated right and left eigenvectors rj,lj, where the eigenvectors are normalized to each other (i.e., their dot product is δji). We shall assume that the eigenvectors span the space. The characteristic variables wi are defined by

wi = li q. (38)

Then equation (37) when written in terms of the characteristic variables becomes

tw + Λxw = 0, (39)

where Λ is the matrix containing the eigenvalues λi on the diagonals and zeros elsewhere. Hence each characteristic variable wi obeys the linear advection equation with velocity a = λi. This solves the Riemann problem in terms of characteristic variables.

In order to write the solution in terms of the original variables q we order the variables in such a way that λ1 λN. We also define the differences in the characteristic variables Δwi = (wi)L (wi)R across the ith characteristic wave. These differences are single numbers (‘scalars’). We note that these differences can easily be found from the initial data using

Δwi = li qL qR . (40)

As the change in the solution across each wave is precisely the difference in the associated characteristic variable, the solution of the Riemann problem in terms of characteristic variables can be written as either

wi = (wi)L + j=1MΔw jejifλ M < ξ < λM+1, (41)

or

w = (wi)R j=M+1NΔw jejifλ M < ξ < λM+1, (42)

or as the average

wi = 1 2 (wi)L + (wi)R + j=1MΔw jej j=M+1NΔw jej ifλ M < ξ < λM+1, (43)

where ei is the column vector (ei)j = δji.

Converting back to the original variables q we have the solution

q = 1 2 qL + qR + i=1MΔw iri i=M+1NΔw iri ifλ M < ξ < λM+1. (44)

In the case where we are only interested in the flux along the characteristic ξ = 0 we can write the solution in the simple form

f(q) = 1 2 f(qL) + f(qR) i=1N|λ i|Δwiri . (45)

All exact Riemann solvers have to solve at least an implicit equation and so are computationally very expensive. As the solution of Riemann problems takes a large portion of the time to run in a HRSC code, approximations that speed the calculation of the intercell flux are often essential. This is especially true in higher dimensions (¿1), where the solution of the ordinary differential equation to give the relation across a rarefaction wave makes the use of an exact Riemann solver impractical.

Approximate Riemann solvers can have problems, as shown in depth by Quirk [17]. Hence it is best to compare the results of as many different solvers as possible. Here we shall describe the three approximate solvers used in this code, starting with the simplest.

7.1 HLLE solver

The Harten-Lax-van Leer-Einfeldt (HLLE) solver of Einfeldt [7] is a simple two-wave approximation. We assume that the maximum and minimum wave speeds ξ± are known. The solution of the Riemann problem is then given by requiring conservation to hold across the waves. The solution takes the form

q = qLifξ < ξ qifξ < ξ < ξ+ qRifξ > ξ+, (46)

and the intermediate state q is given by

q = ξ+qR ξqL f(qR) + f(qL) ξ+ ξ . (47)

If we just want the numerical flux along the boundary then this takes the form

f(q) = ξ̂+f(qL) ξ̂f(qR) + ξ̂+ξ̂(qR qL) ξ̂+ ξ̂ , (48)

where

ξ̂ = min(0,ξ),ξ̂+ = max(0,ξ+). (49)

Knowledge of the precise minimum and maximum characteristic velocities ξ± requires knowing the solution of the Riemann problem. Instead, the characteristic velocities are usually found from the eigenvalues of the Jacobian matrix fq evaluated at some intermediate state. To ensure that the maximum and minimum eigenvalues over the entire range between the left and right states are found, we evaluate the Jacobian in both the left and right states and take the maximum and minimum over all eigenvalues. This ensures, for the systems of equations considered here, that the real maximum and minimum characteristic velocities are contained within [ξ,ξ+].

If we set α = max(|ξ|,|ξ+|) and replace the characteristic velocities ξ± with ± α, we find the Lax–Friedrichs flux (cf. also Tadmor’s semi-discrete scheme [13])

f(q) = 1 2 f(qL) + f(qR) + α(qL qR). (50)

This is very diffusive, but also very stable.

7.2 Roe solver

The linearized solver of Roe [18] is probably the most popular approximate Riemann solver. The simplest interpretation is that the Jacobian fq is linearized about some intermediate state. Then the conservation form reduces to the linear equation

tq + Axq = 0, (51)

where A is a constant coefficient matrix. This is identical to equation (37) and so all the results of section 7 on linear systems hold. We reiterate that the standard form for the flux along the characteristic ray ξ = 0 is

f(q) = 1 2 f(qL) + f(qR) i=1N|λ i|Δwiri . (52)

There is a choice of which intermediate state the Jacobian should be evaluated at. Roe gives three criteria that ensure the consistency and stability of the numerical flux:

  1. A(qRoe) qR qL = f(qR) f(qL),
  2. A(qRoe) is diagonalizable with real eigenvalues,
  3. A(qRoe) fq smoothly as qRoe q.

A true Roe average for relativistic hydrodynamics, i.e., an intermediate state that satisfies all these conditions, has been constructed by Eulderink [8]. However, frequently it is sufficient to use

qRoe = 1 2 qR + qL , (53)

which satisfies only the last two conditions. For simplicity we have implemented this arithmetic average.

7.3 Marquina solver

Unlike all the other Riemann solvers introduced so far, the Marquina solver as outlined in [6] does not solve the Riemann problem completely. Instead, only the flux along the characteristic ray ξ = 0 is given. It can be seen as a generalized Roe solver, as the results are the same except at sonic points. These points are where the fluid velocity is equal to the speed of sound of the fluid. In the context of Riemann problems, sonic points are found when the ray ξ = 0 is within a rarefaction wave.

Firstly define the left l(qL,R) and right r(qL,R) eigenvectors and the eigenvalues λ(qL,R) of the Jacobian matrix fq evaluated at the left and right states. Next define left and right characteristic variables wL,R and fluxes ϕL,R by

(wi)L,R = li(qL,R) qL,R,(ϕi)L,R = li(qL,R) f(qL,R). (54)

Then the algorithm chooses the correct-sided characteristic flux if the eigenvalues λi(qL), λi(qR) have the same sign, and uses a Lax–Friedrichs type flux if they change sign. In full, the algorithm is given in figure 1.


Fori = 1,,Ndo Ifλi(qL)λi(qR) > 0then Ifλi(qL) > 0then ϕ+i =ϕLi ϕi =0 else ϕ+i =0 ϕi =ϕRi endif else αi =max(|λi(qL),λi(qR)|) ϕ+i =1 2 ϕLi + αiw Li ϕi =1 2 ϕRi αiw Ri endif enddo (55)

Figure 1: The algorithm to calculate the Marquina flux.

Then the numerical flux is given by

f(q) = i=1N ϕ +iri(q L) + ϕiri(q R). (56)

The above implementation is based on [1].

8 Other points in GRHydro

There are a number of other things done by GRHydro which, whilst not as important as reconstruction and evolution, are still essential.

8.1 Source terms

In a curved spacetime the equations are not in homogeneous conservation-law form but also contain source terms. These are actually calculated first, before the flux terms (it simplifies the loop very slightly). There are a few points to note about the calculation of the sources.

In what follows Greek letters range from 0 to 3 and roman letters from 1 to 3.

For the following computations, we need the expression of some of the 4-Christoffel symbols (4)Γμνρ applied to the 3+1 decomposed variables. In order to remove time derivatives we will frequently make use of the ADM evolution equation for the 3-metric in the form

tγij = 2 αKij + (iβj) (3)Γ ijkβ k . (57)

As it is used in what follows, we also recall that is the covariant derivative associated with the spatial 3-surface and we note that it is compatible with the 3-metric:

iγjk = iγjk + 2(3)Γ iljγlk = 0. (58)

We start from the (4)Γ000 symbol:

(4)Γ 000 = 1 2α2 tβkβk + 2α tα + 2βi tβi βi iβkβk + 2αβi iα (59)

and we expand the derivatives as

tβkβk = tγjkβjβk = 2γ jkβj tβk + βjβk tγjk = = 2βktβk 2αK jkβjβk + 2βjβk jβk 2(3)Γ kjiβ iβjβk (60)

and

iβkβk = iγjkβ jβk = 2γjkβ jiβk + βjβkiγjk = 2β kiβk 2(3)Γ ikjβ jβk, (61)

where we have used (57) and (58), respectively. Inserting (60) and (61), equation (59) becomes

(4)Γ 000 = 1 αtα + βi iα + Kjkβjβk. (62)

With the same strategy we then compute

(4)Γ i00 = 1 2α2i(βkβ k α2) βj( iβj jβi + tγij) = 1 αiα βjK ij (63)

and

(4)Γ ij0 = 1 2α2iβj + jβi tγij βk( iγkj + jγki kγij) = 1 αKij. (64)

Other more straightforward calculations give

(4)Γ 00j = (4)Γ 0jνg ν0 = 1 2j βkβk α2 , (65) (4)Γ l0j = (4)Γ ljνg ν0 = αKlj + lβj + jβl βk(3)Γ ljk, (66) (4)Γ 0lj = (4)Γ 0jνg νl = αKjl + lβj βk(3)Γ ljk, (67) (4)Γ lmj = (4)Γ ljνg νm = (3)Γ lmj, (68)

where (57) was used to derive (66) and (67).

8.1.1 Source term for Sk

Now we have all the expressions for calculating the source terms. The ones for the variables Sk are

𝒮Skj = TνμΓ μjν = TμνΓ μνj. (69)

After expanding the derivative in (65), the coefficient of the T00 term in (69) becomes

(4)Γ 00j = 1 2βlβm jγlm αjα + βmjβm. (70)

The coefficient of the T0i term is

(4)Γ 0ij + (4)Γ i0j = jβi = βl iγjl + γiljβl. (71)

The coefficient of the Tlm term is simply

(3)Γ lmj = 1 2jγml + mγjl lγmj. (72)

Finally, summing (70)–(72) we find

𝒮Skj = T00 1 2βlβm jγlm αjα + T0iβl jγil + Ti0 jβi + 1 2Tlm jγlm, (73)

which is the expression implemented in the code.

8.1.2 Source term for τ

The source term for τ is [cf. (4)]

𝒮τ = α Tμ0 μα αTμν(4)Γ μν0 . (74)

For clarity, again we consider separately the terms containing as a factor the different components of Tμν. From (62) we find the coefficient of T00 to be

αtα α(4)Γ 000 = αβi iα + βkβlK kl. (75)

The coefficient of the term T0i is given by

αiα 2α(4)Γ i00 = 2αβjK ij αiα (76)

and, finally, the coefficient for Tij is

α2(4)Γ ij0 = αK ij. (77)

The final expression implemented in the code is thus

𝒮τ = αT00 βiβjK ij βi iα + T0i iα + 2βjK ij + TijK ij. (78)

8.2 Conversion from conservative to primitive variables

As noted in section 3 the variables that are evolved are the conserved variables D,Si,τ. But in order to calculate the fluxes and sources we require the primitive variables ρ,vi,P. Conversion from primitive to conservative is given analytically by equation (2). Converting in the other direction is not possible in a closed form except in certain special circumstances.

There are a number of methods for converting from conservative to primitive variables; see [16]. Here we use a Newton-Raphson type iteration. If we are using a general equation of state such as an ideal gas, then we find a root of the pressure equation. Given an initial guess for the pressure P̄ we find the root of the function

f = P̄ P(ρ̄,𝜖̄), (79)

where the approximate density and specific internal energy are given by

ρ̄ = D̃ τ̃ + P̄ + D̃ (τ̃ + P̄ + D̃)2 S2, (80) W̄ = τ̃ + P̄ + D̃ (τ ̃ + P ̄ + D ̃ )2 S2, (81) 𝜖̄ = D̃1 (τ ̃ + P ̄ + D ̃ )2 S2 P̄W̄ D̃. (82)

Here the conserved variables are all “undensitized”, e.g.,

D̃ = γ12D, (83)

where γ is the determinant of the 3-metric, and S2 is given by

S2 = γijS̃ iS̃j. (84)

In order to perform a Newton-Raphson iteration we need the derivative of the function with respect to the dependent variable, here the pressure. This is given by

f = 1 P ρ ρ P P 𝜖 𝜖 P, (85)

where P ρ and P 𝜖 given by calls to EOS_Base, and

ρ P = D̃S2 (τ ̃ + P ̄ + D ̃ )2 S2(τ̃ + P̄ + D̃)2, (86) 𝜖 P = P̄S2 ρ (τ̃ + P̄ + D̃)2 S2 (τ̃ + P̄ + D̃). (87) (88)

For a polytropic type equation of state, the function is given by

f = ρ̄W̄ D̃, (89)

where ρ̄ is the variable solved for, the pressure, specific internal energy and enthalpy h̄ are set from the EOS and the Lorentz factor is found from

W̄ = 1 + S2 (D̃h̄)2. (90)

The derivative is given by

f = W̄ ρ̄S2h̄ W̄D̃2h̄3, (91)

where

h̄ = ρ̄1P ρ . (92)

8.3 A note on the Roe and Marquina Riemann Solvers

Finding the Roe or Marquina fluxes as given is section 7 requires the left eigenvectors to either be supplied analytically or calculated numerically.

When this is done by inverting the matrix of right eigenvectors, in the actual code this is combined with the calculation of, e.g., the characteristic jumps Δw. Normally the eigenvalues and vectors are ordered lexicographically. However for the polytropic equation of state one of the equations is redundant, so the matrix formed by these eigenvectors is linearly dependent and hence singular. It turns out that this is only a minor problem; by rearranging the order of the eigenvalues and vectors it is possible to numerically invert the matrix. This means that no specific ordering of the eigenvalues should be assumed. It also explains the slightly strange ordering in the routines GRHydro_EigenProblem*.F90.

The current default is that the left eigenvectors are calculated analytically - for the expressions see Font [9]. For both the Roe and the Marquina solvers an optimized version of the flux calculation has been implemented. For more details on the analytical form and the optimized flux calculation see Ibáñez et al. [12], Aloy et al. [2] and Frieben et al. [10].

8.4 The atmosphere

In simulations of compact objects, often the matter is located only on a (small) portion of the numerical grid. In fact, over much of the evolved domain the physical situation is likely to be sufficiently well approximated by vacuum. However, in the vacuum limit the continuity equations describing the fluid break down. The speed of sound tends to the speed of light and everything fails (especially the conversion from conserved to primitive variables).

To avoid this problem it is customary to introduce an atmosphere. In our implementation, this is a low-density region surrounding the compact objects and initially it has no velocity and is in equilibrium. The introduction of an atmosphere is managed by the initial data thorns.

However GRHydro itself also knows about the atmosphere, of course. If the conserved variables D or τ are beneath some minimum value, or an evolution step might push them below such a value, then the relevant cell is not evolved. Also, if the density should fall below a minimum value in the routine that converts from conservative to primitive variables, all the variables are reset to the values adopted for the atmosphere.

Probably the hardest part of using GRHydro is to correctly set these atmosphere values. In the current implementation the atmosphere is used in three separate places. These are

  1. Set up of the initial data. Initial-data routines should set an atmosphere consistent with the one that will be evolved.
  2. In the routine that converts from conserved variables to primitive variables. This is where the majority of the atmosphere resets will occur.

    If the equation of state is polytropic then an attempt is made to convert to primitive variables. If the iterative algorithm returns a negative (and hence unphysical) value of ρ, then ρ is reset to the atmosphere value, the velocities are set to zero, and P, 𝜖, Si and τ are reset to be consistent with ρ (and D). Note that even though the polytropic equation of state gives us sufficient information to calculate a consistent value of D, this is not done.

    If the equation of state is the more general type (such as that of an ideal fluid) and if ρ is less than the specified minimum, then, as above, we assume we are in the atmosphere and call the routine that changes from the conserved to the primitive variables for the polytrope.

  3. When applying the update. If the calculated update terms for a specific cell would lead to either D or τ becoming negative, then two steps are taken. First, we do not update this specific cell. Second, the data in this cell is reset to be the atmosphere.

The reason why the routine that converts to the primitive variables does not ensure that D is consistent with the other variables is practical rather than accurate. If the value of the variables is set such that they all lie precisely on the atmosphere, then small errors (typically initially of the order of 1025 for a 643-point TOV star in octant symmetry) would move certain cells above the atmosphere values. Combined with the necessary atmosphere treatment this leads to high-frequency noise. This will lead to waves of matter falling onto the star. Despite their extremely low density (typically only an order of magnitude higher than the floor) they will result in visible secondary overtones in the oscillations of, e.g., the central density.

The parameters controlling the atmosphere are the following.

The motivation for these parameters referring only to the initial data is that it is sometimes best to set the initial atmosphere to slightly below the atmosphere cutoff used during evolution, as this avoids truncation error and metric evolution leading to low density waves travelling across the atmosphere.

The routines essential to the atmosphere are contained in GRHydro_Minima.F90, GRHydro_Con2Prim.F90, GRHydro_UpdateMask.F90.

8.5 Advection of passive scalars (’tracers’)

For some astrophysical problems it is necessary to advect passive compositional scalars such as the electron fraction Y e (number of electrons per baryon). For a generic tracer Xk, the evolution equation looks like

t(DXk) + xjf(j)(DX k) = 0, (93)

where D is the generalized particle number density as defined in Eq. (2). GRHydro currently supports any number of independent tracer variables. The following parameters have to be set to use the tracers:

Note, that your initial data thorn must set initial data for GRHydro::tracer[k] and GRHydro::cons_tracer[k] for all tracers you want to advect. GRHydro::cons_tracer[k] stores DXk.

8.5.1 Implementation and Limitations

9 History

The approximate time line is something like this:

This is necessarily only a sketch; many people have contributed to the history of this code, and the present authors were not around for most of it...

9.1 Thorn Source Code

This was initially written by Luca Baiotti, Ian Hawke and Pedro Montero with considerable assistance from Luciano Rezzolla, Toni Font, Nick Stergioulas and Ed Seidel. This led to the basic GRHydro thorns, GRHydro itself, GRHydro_Init_Data and GRHydro_RNSID.

Since then most of the maintenance has been done by Ian Hawke, Luca Baiotti and Frank Löffler. Various people have contributed to the development. In particular

9.2 Thorn Documentation

This documentation was first written largely by Ian Hawke and Scott Hawley in 2002. Long due, rather necessary and considerably large updates were made in 2008 by Luca Baiotti.

9.3 Acknowledgements

As already mentioned, the history behind this code leads to a long list of people to be acknowledged.

Firstly, without the work of the Valencia group this sort of code would be impossible.

Secondly, the incomparable work of Mark Miller and the Washington University - AEI Collaboration in producing the GR3D and GRAstro_Hydro codes gave an essential benchmark to aim for, and encouragement that it was possible!

Thirdly, the support of the Cactus team, especially Tom Goodale, Gabrielle Allen and Thomas Radke made life a lot easier.

Finally, for their work in coding, ideas and suggestions, or just plain encouragement, we would like to thank all at the AEI and in the EU Network, especially Toni Font, Luciano Rezzolla, Nick Stergioulas, Ed Seidel, Carsten Gundlach and José-Maria Ibáñez.

Originally Ed Seidel and then Luciano Rezzolla and Gabrielle Allen and many others have been granting (in addition to valuable scientific advice) financial support and human resources to the development of the code.

References

[1]   Aloy M.A., Ibánez J.M., MartíJ.M., Müller E. Astroph. J. Supp., 122: 151 (1999).

[2]   M. A. Aloy, J. A. Pons, and J. M. Ibáñez. An efficient implementation of flux formulae in multidimensional relativistic hydrodynamical codes. Comput. Phys. Commun., 120:115–121, 1999.

[3]   Banyuls F., Font J.A., Ibánez J.M., Martí J.M., Miralles J.A. Astrophys. J., 476: 221 (1997).

[4]   P. Colella and P. R. Woodward. The Piecewise Parabolic Method (PPM) for Gas-Dynamical Simulations. J. Comput. Phys., 54, 174–201, 1984.

[5]   G. Cook Initial Data for Numerical Relativity Living Rev. Relativity, 3, 2000. [Article in on-line journal], cited on 31/08/02, http://www.livingreviews.org/ Articles/Volume3/2000-5cook/index.html.

[6]   R. Donat and A. Marquina. Capturing shock reflections: An improved flux formula. J. Comput. Phys., 125:42–58, 1996.

[7]   Einfeldt B. Journal of Computational Physics, 25: 294 (1988).

[8]   Eulderink F., Mellema G. Astron. Astrophys., 284: 652 (1994).

[9]   J. A. Font. Numerical hydrodynamics in General Relativity. Living Rev. Relativity, 3, 2000. [Article in on-line journal], cited on 31/07/01, http://www.livingreviews.org/ Articles/Volume3/2000-2font/index.html.

[10]   J. Frieben, J. M. Ibáñez, and J. Pons. in preparation

[11]   A. Harten, B. Engquist, S. Osher, and S. R. Chakravarthy. Uniformly high order accurate essentially non-oscillatory schemes, III. J. Comput. Phys., 71:231–303, 1987.

[12]   J. M. Ibáñez et al. in Godunov Methods: Theory and Applications. New York, 485–503, (2001)

[13]   A. Kurganov and E. Tadmor. New high-resolution central schemes for nonlinear conservation laws and convection-diffusion equations. J. Comput. Phys., 160:241, 2000.

[14]   C. B. Laney. Computational Gasdynamics. Cambridge University Press, 1998.

[15]   R. J. LeVeque. Nonlinear conservation laws and finite volume methods for astrophysical fluid flow. In O. Steiner and A. Gautschy, editors, Computational Methods for Astrophysical Fluid Flow. Springer-Verlag, 1998.

[16]   J. M. Martí and E. Müller. Numerical hydrodynamics in Special Relativity. Living Rev. Relativity, 2, 1999. [Article in on-line journal], cited on 31/7/01, http://www.livingreviews.org/Articles/Volume2/1999-3marti/index.html.

[17]   J. J. Quirk. A contribution to the great Riemann solver debate. Int. J. Numer. Methods Fluids, 18:555–574, 1994.

[18]   Roe P.L. J. Comput. Phy., 43: 357 (1981).

[19]   C. Shu. High Order ENO and WENO Schemes for Computational Fluid Dynamics. In T. J. Barth and H. Deconinck, editors High-Order Methods for Computational Physics. Springer, 1999. A related on-line version can be found under Essentially Non-Oscillatory and Weighted Essentially Non-Oscillatory Schemes for Hyperbolic Conservation Laws at http://www.icase.edu/library/reports/rdp/97/97-65RDP.tex.refer.html.

[20]   E. F. Toro. Riemann Solvers and Numerical Methods for Fluid Dynamics. Springer-Verlag, 2nd edition, 1999.

10 Parameters




constrain_to_1d
Scope: private  BOOLEAN



Description: Set fluid velocities to zero for non-radial motion



  Default: no






use_cxx_code
Scope: private  BOOLEAN



Description: Use experimental C++ code?



  Default: yes






verbose
Scope: private  BOOLEAN



Description: Some debug output



  Default: no






apply_h_viscosity
Scope: restricted  BOOLEAN



Description: H viscosity is useful to fix the carbuncle instability seen at strong shocks



  Default: no






atmo_falloff_power
Scope: restricted  REAL



Description: The power at which the atmosphere level falls off as (atmo_falloof_radius/r)**atmo_falloff_power



Range   Default: 0.0
0:*
Anything positive






atmo_falloff_radius
Scope: restricted  REAL



Description: The radius for which the atmosphere starts to falloff as (atmo_falloff_radius/r)**atmo_falloff_power



Range   Default: 50.0
0:*
Anything positive






atmo_tolerance_power
Scope: restricted  REAL



Description: The power at which the atmosphere tolerance increases as (r/atmo_tolerance_radius)**atmo_tolerance_power



Range   Default: 0.0
0:*
Anything positive






atmo_tolerance_radius
Scope: restricted  REAL



Description: The radius for which the atmosphere tolerance starts to increase as (r/atmo_tolerance_radius)**atmo_tolerance_power



Range   Default: 50.0
0:*
Anything positive






avec_gauge
Scope: restricted  KEYWORD



Description: Which gauge condition to use when evolving the vector potential



Range   Default: lorenz
algebraic
Algebraic gauge
lorenz
Lorenz gauge






bound
Scope: restricted  KEYWORD



Description: Which boundary condition to use - FIXME



Range   Default: none
flat
Zero order extrapolation
none
None
static
Static, no longer supported
scalar
Constant






c2p_reset_pressure
Scope: restricted  BOOLEAN



Description: If the pressure guess is unphysical should we recompute it?



  Default: no






c2p_reset_pressure_to_value
Scope: restricted  REAL



Description: The value to which the pressure is reset to when a failure occurrs in C2P



Range   Default: 1.e-20
0:
greater than zero






c2p_resort_to_bisection
Scope: restricted  BOOLEAN



Description: If the pressure guess is unphysical, should we try with bisection (slower, but more robust)



  Default: no






calculate_bcom
Scope: restricted  BOOLEAN



Description: Calculate the comoving contravariant magnetic 4-vector bâ?



  Default: no






check_for_trivial_rp
Scope: restricted  BOOLEAN



Description: Do check for trivial Riemann Problem



  Default: yes






check_rho_minimum
Scope: restricted  BOOLEAN



Description: Should a check on rho < GRHydro_rho_min be performed and written as WARNING level 2?



  Default: no






clean_divergence
Scope: restricted  BOOLEAN



Description: Use hyperbolic divergence cleaning



  Default: no






comoving_attenuate
Scope: restricted  KEYWORD



Description: Which attenuation method for the comoving shift



Range   Default: tanh
sqrt
Multiply by sqrt(rho/rho_max)
tanh
”Multiply by 1/2*(1+tanh(factor*( rho/rho_max - offset)))”






comoving_factor
Scope: restricted  REAL



Description: Factor multiplying the velocity for the comoving shift



Range   Default: 0.0
0.0:2.0
[0,2] is allowed, but [0,1] is probably reasonable






comoving_tanh_factor
Scope: restricted  REAL



Description: The factor in the above tanh attenuation



Range   Default: 10.0
(0.0:*
Any positive number






comoving_tanh_offset
Scope: restricted  REAL



Description: The offset in the above tanh attenuation



Range   Default: 0.05
0.0:1.0
Only makes sense in [0,1]






comoving_v_method
Scope: restricted  KEYWORD



Description: Which method for getting the radial velocity



Range   Default: projected
projected
vr = x_i . vî / r
components
vr = sqrt(v_i vî)






con2prim_oct_hack
Scope: restricted  BOOLEAN



Description: Disregard c2p failures in oct/rotsym90 boundary cells with xyz < 0



  Default: no






decouple_normal_bfield
Scope: restricted  BOOLEAN



Description: when using divergence cleaning properly decouple Bx,psidc subsystem



  Default: yes






enhanced_ppm_c2
Scope: restricted  REAL



Description: Parameter for enhancecd ppm limiter. Default from McCorquodale & Colella 2011



Range   Default: 1.25
*:*
must be greater than 1. According to Colella&Sekora 2008, enhanced ppm is insensitive to C in [1.25,5]






enhanced_ppm_c3
Scope: restricted  REAL



Description: Parameter for enhancecd ppm limiter. Default from McCorquodale & Colella 2011



Range   Default: 0.1
0:*
must be greater than 0.






eno_order
Scope: restricted  INT



Description: The order of accuracy of the ENO reconstruction



Range   Default: 2
1:*
Anything above 1, but above 5 is pointless






eos_change
Scope: restricted  BOOLEAN



Description: Recalculate fluid quantities if changing the EoS



  Default: no






eos_change_type
Scope: restricted  KEYWORD



Description: Change polytropic K or Gamma?



Range   Default: Gamma
K
Change the K
Gamma
Change the Gamma
GammaKS
Change K and Gamma, Shibata et al. 2004 3-D GR Core Collapse style






evolve_tracer
Scope: restricted  BOOLEAN



Description: Should we advect tracers?



  Default: no






gradient_method
Scope: restricted  KEYWORD



Description: Which method is used to set GRHydro::DiffRho?



Range   Default: First diff
First diff
Standard first differences
Curvature
Curvature based method of Paramesh / FLASH
Rho weighted
Based on the size of rho






grhydro_atmo_tolerance
Scope: restricted  REAL



Description: A point is set to atmosphere in the Con2Prim’s if its rho < GRHydro_rho_min *(1+GRHydro_atmo_tolerance). This avoids occasional spurious oscillations in carpet buffer zones lying in the atmosphere (because prolongation happens on conserved variables)



Range   Default: 0.0
0.0:
Zero or larger. A useful value could be 0.0001






grhydro_c2p_failed_action
Scope: restricted  KEYWORD



Description: what to do when we detect a c2p failure



Range   Default: abort
abort
abort with error
terminate
request termination






grhydro_c2p_reset_eps_tau_hot_eos
Scope: restricted  BOOLEAN



Description: As a last resort, reset tau



  Default: no






grhydro_c2p_warn_from_reflevel
Scope: restricted  INT



Description: Start warning on given refinement level and on higher levels



Range   Default: (none)
0:
Greater or equal to 0






grhydro_c2p_warnlevel
Scope: restricted  INT



Description: Warnlevel for Con2Prim warnings



Range   Default: (none)
0:1
Either 0 or 1






grhydro_countmax
Scope: restricted  INT



Description: Maximum number of iterations for Con2Prim solve



Range   Default: 100
1:*
Must be positive






grhydro_countmin
Scope: restricted  INT



Description: Minimum number of iterations for Con2Prim solve



Range   Default: 1
0:*
Must be non negative






grhydro_del_ptol
Scope: restricted  REAL



Description: Tolerance for primitive variable solve (absolute)



Range   Default: 1.e-18
0:
Do we really want both tolerances?






grhydro_enable_internal_excision
Scope: restricted  BOOLEAN



Description: Set this to ’false’ to disable the thorn-internal excision.



  Default: true






grhydro_eos_hot_eps_fix
Scope: restricted  BOOLEAN



Description: Activate quasi-failsafe mode for hot EOSs



  Default: no






grhydro_eos_hot_prim2con_warn
Scope: restricted  BOOLEAN



Description: Warn about temperature workaround in prim2con



  Default: yes






grhydro_eos_rf_prec
Scope: restricted  REAL



Description: Precision to which root finding should be carried out



Range   Default: 1.0e-8
(0.0:*
anything larger than 0 goes






grhydro_eos_table
Scope: restricted  STRING



Description: Name for the Equation of State



Range   Default: Ideal_Fluid
.*
Can be anything






grhydro_eos_type
Scope: restricted  KEYWORD



Description: Type of Equation of State



Range   Default: General
Polytype
P = P(rho) or P = P(eps)
General
P = P(rho, eps)






grhydro_eps_min
Scope: restricted  REAL



Description: Minimum value of specific internal energy - this is now only used in GRHydro_InitData’s GRHydro_Only_Atmo routine



Range   Default: 1.e-10
0:
Positive






grhydro_hot_atmo_temp
Scope: restricted  REAL



Description: Temperature of the hot atmosphere in MeV



Range   Default: 0.1e0
(0.0:*
Larger than 0 MeV






grhydro_hot_atmo_y_e
Scope: restricted  REAL



Description: Y_e of the hot atmosphere



Range   Default: 0.5e0
0.0:*
Larger than 0






grhydro_hydro_excision
Scope: restricted  INT



Description: Turns excision automatically on in HydroBase



Range   Default: 1
1:1
Only ’1’ allowed






grhydro_lorentz_overshoot_cutoff
Scope: restricted  REAL



Description: Set the Lorentz factor to this value in case it overshoots (1/0)



Range   Default: 1.e100
0:*
Some big value






grhydro_max_temp
Scope: restricted  REAL



Description: maximum temperature we allow



Range   Default: 90.0e0
(0.0:*
Larger than 0 MeV






grhydro_maxnumconstrainedvars
Scope: restricted  INT



Description: The maximum number of constrained variables used by GRHydro



Range   Default: 37
7:48
A small range, depending on testing or not






grhydro_maxnumevolvedvars
Scope: restricted  INT



Description: The maximum number of evolved variables used by GRHydro



Range   Default: 5
when using multirate
5:12
dens scon[3] tau (B/A)vec[3] psidc ye entropy Aphi






grhydro_maxnumevolvedvarsslow
Scope: restricted  INT



Description: The maximum number of evolved variables used by GRHydro



Range   Default: (none)
do not use multirate
5:12
dens scon[3] tau (B/A)vec[3] psidc ye entropy Aphi






grhydro_maxnumsandrvars
Scope: restricted  INT



Description: The maximum number of save and restore variables used by GRHydro



Range   Default: 16
0:16
A small range, depending on testing or not






grhydro_nan_verbose
Scope: restricted  INT



Description: The warning level for NaNs occuring within GRHydro



Range   Default: 2
0:*
The warning level






grhydro_oppm_reflevel
Scope: restricted  INT



Description: Ref level where oPPM is used instead of ePPM (used with use_enhaced_ppm=yes).



Range   Default: -1
-1:10
0-10 (the reflevel number) or -1 (off)






grhydro_perc_ptol
Scope: restricted  REAL



Description: Tolerance for primitive variable solve (percent)



Range   Default: 1.e-8
0:
Do we really want both tolerances?






grhydro_polish
Scope: restricted  INT



Description: Number of extra iterations after root found



Range   Default: (none)
0:*
Must be non negative






grhydro_rho_central
Scope: restricted  REAL



Description: Central Density for Star



Range   Default: 1.e-5
:






grhydro_stencil
Scope: restricted  INT



Description: Width of the stencil



Range   Default: 2
0:
Must be positive






grhydro_y_e_max
Scope: restricted  REAL



Description: maximum allowed Y_e



Range   Default: 1.0
0.0:*
Larger than or equal to zero; 1 is default






grhydro_y_e_min
Scope: restricted  REAL



Description: minimum allowed Y_e



Range   Default: 0.0
0.0:*
Larger than or equal to zero






hlle_type
Scope: restricted  KEYWORD



Description: Which HLLE type to use



Range   Default: Standard
Standard
Standard HLLE solver
Tadmor
Tadmor’s simplification of HLLE






initial_atmosphere_factor
Scope: restricted  REAL



Description: A relative (to the initial atmosphere) value for rho in the atmosphere. This is used at initial time only. Unused if negative.



Range   Default: -1.0
-1.0:






initial_gamma
Scope: restricted  REAL



Description: If changing Gamma, what was the value used in the initial data routine?



Range   Default: 1.3333
(0.0:
Positive






initial_k
Scope: restricted  REAL



Description: If changing K, what was the value used in the initial data routine?



Range   Default: 100.0
(0.0:
Positive






initial_rho_abs_min
Scope: restricted  REAL



Description: An absolute value for rho in the atmosphere. To be used by initial data routines only. Unused if negative.



Range   Default: -1.0
-1.0:






initial_rho_rel_min
Scope: restricted  REAL



Description: A relative (to the central density) value for rho in the atmosphere. To be used by initial data routines only. Unused if negative.



Range   Default: -1.0
-1.0:






kap_dc
Scope: restricted  REAL



Description: The kap parameter for divergence cleaning



Range   Default: 10.0
0:*
Any non-negative value, but 1.0 to 10.0 seems preferred






left_eigenvectors
Scope: restricted  KEYWORD



Description: How to compute the left eigenvectors



Range   Default: analytical
analytical
Analytical left eigenvectors
numerical
Numerical left eigenvectors






max_magnetic_to_gas_pressure_ratio
Scope: restricted  REAL



Description: consider pressure to be magnetically dominated if magnetic pressure to gas pressure ratio is higher than this



Range   Default: -1.0
(0:*
any positive value, eg. 100.
-1.0
disable






method_type
Scope: restricted  KEYWORD



Description: Which type of method to use



Range   Default: RSA FV
RSA FV
”Reconstruct-Solve-A verage finite volume method”
Flux Split FD
Finite difference using Lax-Friedrichs flux splitting






min_tracer
Scope: restricted  REAL



Description: The floor placed on the tracer



Range   Default: 0.0
*:*
Anything






mp5_adaptive_eps
Scope: restricted  BOOLEAN



Description: Same as WENO adaptive epsilon: adaptively reduce mp5_eps according to norm of stencil. Original algorithm does not use this.



  Default: no






mp5_alpha
Scope: restricted  REAL



Description: alpha parameter for MP5 reconstruction



Range   Default: 4.0
0:*
positive






mp5_eps
Scope: restricted  REAL



Description: epsilon parameter for MP5 reconstruction



Range   Default: 0.0
0:*
0.0 or very small and positive. 1e-10 is suggested by Suresh&Huynh. TOV star requires 0.0






myfloor
Scope: restricted  REAL



Description: A minimum number for the TVD reconstruction routine



Range   Default: 1.e-10
0.0:
Must be positive






number_of_arrays
Scope: restricted  INT



Description: Number of arrays to evolve



Range   Default: (none)
0:3
Either zero or three, depending on the particles






number_of_particles
Scope: restricted  INT



Description: Number of particles to track



Range   Default: (none)
0:*
0 switches off particle tracking






number_of_tracers
Scope: restricted  INT



Description: Number of tracer variables to be advected



Range   Default: (none)
0:*
positive or zero






numerical_viscosity
Scope: restricted  KEYWORD



Description: How to compute the numerical viscosity



Range   Default: fast
fast
Fast numerical viscosity
normal
Normal numerical viscosity






particle_interpolation_order
Scope: restricted  INT



Description: What order should be used for the particle interpolation



Range   Default: 2
1:*
A valid positive interpolation order






particle_interpolator
Scope: restricted  STRING



Description: What interpolator should be used for the particles



Range  Default: Lagrange polynomial interpolation
.+
A valid interpolator name






ppm_detect
Scope: restricted  BOOLEAN



Description: Should the PPM solver use shock detection?



  Default: no






ppm_epsilon
Scope: restricted  REAL



Description: Epsilon for PPM zone flattening



Range   Default: 0.33
0.0:
Must be positive. Default is from Colella & Woodward






ppm_epsilon_shock
Scope: restricted  REAL



Description: Epsilon for PPM shock detection



Range   Default: 0.01
:
Anything goes. Default is from Colella & Woodward






ppm_eta1
Scope: restricted  REAL



Description: Eta1 for PPM shock detection



Range   Default: 20.0
:
Anything goes. Default is from Colella & Woodward






ppm_eta2
Scope: restricted  REAL



Description: Eta2 for PPM shock detection



Range   Default: 0.05
:
Anything goes. Default is from Colella & Woodward






ppm_flatten
Scope: restricted  KEYWORD



Description: Which flattening procedure should the PPM solver use?



Range   Default: stencil_3
stencil_3
our flattening procedure, which requires only stencil 3 and which may work
stencil_4
original C&W flattening procedure, which requires stencil 4






ppm_k0
Scope: restricted  REAL



Description: K0 for PPM shock detection



Range   Default: 0.2
:
Anything goes. Default suggested by Colella & Woodward is: (polytropic constant)/10.0






ppm_mppm
Scope: restricted  INT



Description: Use modified (enhanced) ppm scheme



Range   Default: (none)
0:1
0 (off, default) or 1 (on)






ppm_mppm_debug_eigenvalues
Scope: restricted  INT



Description: write eigenvalues into debug grid variables



Range   Default: (none)
0:1
0 (off, default) or 1 (on)






ppm_omega1
Scope: restricted  REAL



Description: Omega1 for PPM zone flattening



Range   Default: 0.75
:
Anything goes. Default is from Colella & Woodward






ppm_omega2
Scope: restricted  REAL



Description: Omega2 for PPM zone flattening



Range   Default: 10.0
:
Anything goes. Default is from Colella & Woodward






ppm_omega_tracer
Scope: restricted  REAL



Description: Omega for tracer PPM zone flattening



Range   Default: 0.50
:
Anything goes. Default is from Plewa & Mueller






ppm_small
Scope: restricted  REAL



Description: A floor used by PPM shock detection



Range   Default: 1.e-7
0.0:1.0
In [0,1]






psidcspeed
Scope: restricted  KEYWORD



Description: Which speed to set for psidc



Range   Default: light speed
char speed
Based on the characteristic speeds
light speed
Set the characteristic speeds to speed of light
set speed
”Manually set the characteristic speeds: [setcharmin,setcharm ax]”






recon_method
Scope: restricted  KEYWORD



Description: Which reconstruction method to use



Range   Default: tvd
tvd
Slope limited TVD
ppm
PPM reconstruction
eno
ENO reconstruction
weno
WENO reconstruction
weno-z
WENO-Z reconstruction
mp5
MP5 reconstruction






recon_vars
Scope: restricted  KEYWORD



Description: Which type of variables to reconstruct



Range   Default: primitive
primitive
Reconstruct the primitive variables
conservative
Reconstruct the conserved variables






reconstruct_temper
Scope: restricted  BOOLEAN



Description: if set to true, temperature will be reconstructed



  Default: no






reconstruct_wv
Scope: restricted  BOOLEAN



Description: Reconstruct the primitive velocity W_Lorentz*vel, rather than just vel.



  Default: no






rho_abs_min
Scope: restricted  REAL



Description: A minimum rho below which evolution is turned off (atmosphere). If negative, the relative minimum will be used instead.



Range   Default: -1.0
-1.0:






rho_abs_min_after_recovery
Scope: restricted  REAL



Description: A new absolute value for rho in the atmosphere. To be used after recovering. Unused if negative.



Range   Default: -1.0
-1.0:






rho_rel_min
Scope: restricted  REAL



Description: A minimum relative rho (rhomin = centden * rho_rel_min) below which evolution is turned off (atmosphere). Only used if rho_abs_min < 0.0



Range   Default: 1.e-9
0:






riemann_solver
Scope: restricted  KEYWORD



Description: Which Riemann solver to use



Range   Default: HLLE
Roe
Standard Roe solver
Marquina
Marquina flux
HLLE
HLLE
HLLC
HLLC
LLF
Local Lax-Friedrichs (MHD only at the moment)






set_trivial_rp_grid_function
Scope: restricted  INT



Description: set gf for triv. rp (only for debugging)



Range   Default: (none)
0:1
0 for no (default), 1 for yes






setcharmax
Scope: restricted  REAL



Description: Maximum characteristic speed for psidc if psidcspeed is set



Range   Default: 1.0
0:1
Any value smaller than speed of light






setcharmin
Scope: restricted  REAL



Description: Minimum characteristic speed for psidc if psidcspeed is set



Range   Default: -1.0
-1:0
Any value smaller than speed of light - sign should be negative






sources_spatial_order
Scope: restricted  INT



Description: Order of spatial differencing of the source terms



Range   Default: 2
2
2nd order finite differencing
4
4th order finite differencing






sqrtdet_thr
Scope: restricted  REAL



Description: Threshold to apply cons rescalings deep inside the horizon



Range   Default: -1.0
1.0:
Larger values guarantees this sort of rescaling only deep inside the horizon
-1.0
Do not apply limit






sync_conserved_only
Scope: restricted  BOOLEAN



Description: Only sync evolved conserved quantities during evolution.



  Default: no






tau_rel_min
Scope: restricted  REAL



Description: A minimum relative tau (taumin = maxtau(t=0) * tau_rel_min) below which tau is reschaled



Range   Default: 1.e-10
0:






tmunu_damping_radius_max
Scope: restricted  REAL



Description: damping radius at which Tmunu becomes 0



Range   Default: -1
-1
damping switched off
0:*
greater than minimum radius above






tmunu_damping_radius_min
Scope: restricted  REAL



Description: damping radius at which we start to damp with a tanh function



Range   Default: -1
-1
damping switched off
0:*
damping radius at which we start to damp






track_divb
Scope: restricted  BOOLEAN



Description: Track the magnetic field constraint violations



  Default: no






transport_constraints
Scope: restricted  BOOLEAN



Description: Use constraint transport for magnetic field



  Default: no






tvd_limiter
Scope: restricted  KEYWORD



Description: Which slope limiter to use



Range   Default: minmod
minmod
Minmod
vanleerMC2
Van Leer MC - Luca
Superbee
Superbee






use_enhanced_ppm
Scope: restricted  BOOLEAN



Description: Use the enhanced ppm reconstruction method proposed by Colella & Sekora 2008 and McCorquodale & Colella 2011



  Default: no






use_evolution_mask
Scope: restricted  KEYWORD



Description: Set this to ’always’ to skip validity tests in regions where CarpetEvolutionMask::evolution_mask vanishes.



Range   Default: never
always
use the mask
auto
check if CarpetEvolutionMask is active, then use the mask
never
do not use the mask






use_min_tracer
Scope: restricted  BOOLEAN



Description: Should there be a floor on the tracer?



  Default: no






use_mol_slow_multirate_sector
Scope: restricted  BOOLEAN



Description: Whether to make use of MoL’s slow multirate sector



  Default: no






use_optimized_ppm
Scope: restricted  BOOLEAN



Description: use C++ templated version of PPM. Experimental



  Default: no






use_weighted_fluxes
Scope: restricted  BOOLEAN



Description: Weight the flux terms by the cell surface areas



  Default: no






weno_adaptive_epsilon
Scope: restricted  BOOLEAN



Description: use modified smoothness indicators that take into account scale of solution (adaptive epsilon)



  Default: yes






weno_eps
Scope: restricted  REAL



Description: WENO epsilon parameter. For WENO-z, 1e-40 is recommended



Range   Default: 1e-26
0:*
small and positive






weno_order
Scope: restricted  INT



Description: The order of accuracy of the WENO reconstruction



Range   Default: 5
5
Fifth-order






wk_atmosphere
Scope: restricted  BOOLEAN



Description: Use some of Wolfgang Kastauns atmosphere tricks



  Default: no






use_mask
Scope: shared from SPACEMASK BOOLEAN



11 Interfaces

General

Implements:

grhydro

Inherits:

admbase

boundary

spacemask

tmunubase

hydrobase

Grid Variables

11.0.1 PRIVATE GROUPS




  Group Names     Variable Names     Details   




inlastmolpoststep   compact0
InLastMoLPostStep   descriptionFlag to indicate if we are currently in the last MoL_PostStep
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




execute_mol_step   compact0
execute_MoL_Step   descriptionFlag indicating whether we use the slow sector of multirate RK time integration
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




execute_mol_poststep   compact0
execute_MoL_PostStep  descriptionFlag indicating whether we use the slow sector of multirate RK time integration
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




grhydro_con_bext   compact0
densplus   descriptionConservative variables extended to the cell boundaries
sxplus   dimensions3
syplus   distributionDEFAULT
szplus   group typeGF
tauplus   tagsProlongation=”None” checkpoint=”no”
densminus   timelevels1
sxminus  variable typeREAL




grhydro_mhd_con_bext   compact0
Bconsxplus   descriptionConservative variables extended to the cell boundaries
Bconsyplus   dimensions3
Bconszplus   distributionDEFAULT
Bconsxminus   group typeGF
Bconsyminus   tagsProlongation=”None” checkpoint=”no”
Bconszminus   timelevels1
 variable typeREAL




grhydro_mhd_prim_bext   compact0
Bvecxplus   descriptionPrimitive mhd variables extended to the cell boundaries
Bvecyplus   dimensions3
Bveczplus   distributionDEFAULT
Bvecxminus   group typeGF
Bvecyminus   tagsProlongation=”None” checkpoint=”no”
Bveczminus   timelevels1
 variable typeREAL








  Group Names     Variable Names    Details   




grhydro_avec_bext   compact0
Avecxplus   descriptionVector potential extended to the cell boundaries
Avecyplus   dimensions3
Aveczplus   distributionDEFAULT
Avecxminus   group typeGF
Avecyminus   tagsProlongation=”None” checkpoint=”no”
Aveczminus   timelevels1
 variable typeREAL




grhydro_aphi_bext   compact0
Aphiplus   descriptionVector potential phi extended to the cell boundaries
Aphiminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_mhd_psidc_bext   compact0
psidcplus   descriptionDivergence cleaning variable extended to the cell boundaries for diverence cleaning
psidcminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_entropy_prim_bext   compact0
entropyplus   descriptionPrimitive entropy extended to the cell boundaries
entropyminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_entropy_con_bext   compact0
entropyconsplus   descriptionConservative entropy extended to the cell boundaries
entropyconsminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




whichpsidcspeed   compact0
whichpsidcspeed   descriptionWhich speed to set for psidc? Set in ParamCheck
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT








  Group Names     Variable Names     Details   




grhydro_coords   compact0
GRHydro_x   descriptionCoordinates to use with the comoving shift
GRHydro_y   dimensions3
GRHydro_z   distributionDEFAULT
  group typeGF
  timelevels3
 variable typeREAL




grhydro_coords_rhs   compact0
GRHydro_x_rhs   descriptionRHS for coordinates to use with the comoving shift
GRHydro_y_rhs   dimensions3
GRHydro_z_rhs   distributionDEFAULT
  group typeGF
  tagsProlongation=”None”
  timelevels1
 variable typeREAL




grhydro_trivial_rp_gf_group   compact0
GRHydro_trivial_rp_gf_x  descriptionset gf for triv. rp (only for debugging)
GRHydro_trivial_rp_gf_y  dimensions3
GRHydro_trivial_rp_gf_z  distributionDEFAULT
  group typeGF
  tagsProlongation=”None”
  timelevels1
 variable typeINT




flux_splitting   compact0
densfplus   descriptionFluxes for use in the flux splitting
densfminus   dimensions3
sxfplus   distributionDEFAULT
sxfminus   group typeGF
syfplus   tagsProlongation=”None” checkpoint=”no”
syfminus   timelevels1
szfplus  variable typeREAL




fs_alpha   compact0
fs_alpha1   descriptionMaximum characteristic speeds for the flux splitting
fs_alpha2   dimensions0
fs_alpha3   distributionCONSTANT
fs_alpha4   group typeSCALAR
fs_alpha5   timelevels1
 variable typeREAL




y_e_plus   compact0
Y_e_plus   descriptionPlus state for the electron fraction
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL








  Group Names     Variable Names    Details   




y_e_minus   compact0
Y_e_minus   descriptionMinus state for the electron fraction
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




tempplus   compact0
tempplus   descriptionPlus state for the temperature
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




tempminus   compact0
tempminus   descriptionMinus state for the temperature
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_tracer_rhs   compact0
cons_tracerrhs   descriptionRHS for the tracer
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_sizenumber_of_tracers
 variable typeREAL




grhydro_tracer_flux   compact0
cons_tracerflux   descriptionFlux for the tracer
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_sizenumber_of_tracers
 variable typeREAL




grhydro_tracer_cons_bext   compact0
cons_tracerplus   descriptionCell boundary values for the tracer
cons_tracerminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_sizenumber_of_tracers
 variable typeREAL








  Group Names     Variable Names     Details   




grhydro_tracer_prim_bext   compact0
tracerplus   descriptionPrimitive cell boundary values for the tracer
tracerminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_sizenumber_of_tracers
 variable typeREAL




grhydro_tracer_flux_splitting   compact0
tracerfplus   descriptionFlux splitting for the tracer
tracerfminus   dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_sizenumber_of_tracers
 variable typeREAL




grhydro_mppm_eigenvalues   compact0
GRHydro_mppm_eigenvalue_x_left   descriptiondebug variable for flux eigenvalues in mppm
GRHydro_mppm_eigenvalue_x_right  dimensions3
GRHydro_mppm_eigenvalue_y_left   distributionDEFAULT
GRHydro_mppm_eigenvalue_y_right  group typeGF
GRHydro_mppm_eigenvalue_z_left   tagsProlongation=”None” checkpoint=”no”
GRHydro_mppm_eigenvalue_z_right  timelevels1
GRHydro_mppm_xwind  variable typeREAL




particles   compact0
particle_x   descriptionCoordinates of particles to be tracked
particle_y   dimensions1
particle_z   distributionDEFAULT
  ghostsize0
  group typeARRAY
  sizeNUMBER_OF_PARTICLES
  timelevels3
 variable typeREAL




particle_rhs   compact0
particle_x_rhs   descriptionRHS functions for particles to be tracked
particle_y_rhs   dimensions1
particle_z_rhs   distributionDEFAULT
  ghostsize0
  group typeARRAY
  sizeNUMBER_OF_PARTICLES
  timelevels1
 variable typeREAL




particle_arrays   compact0
particle_vx   descriptionTemporaries to hold interpolated values for particle tracking
particle_vy   dimensions1
particle_vz   distributionDEFAULT
particle_alp   ghostsize0
particle_betax   group typeARRAY
particle_betay   sizeNUMBER_OF_PARTICLES
particle_betaz   tagscheckpoint=”no”
  timelevels1
 variable typeREAL








  Group Names     Variable Names     Details   




grhydro_maxima_location   compact0
maxima_i   descriptionThe location (point index) of the maximum value of rho
maxima_j   dimensions0
maxima_k   distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeREAL




grhydro_maxima_iteration   compact0
GRHydro_maxima_iteration  descriptionIteration on which maximum was last set
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  timelevels1
 variable typeINT




grhydro_maxima_separation   compact0
GRHydro_separation   descriptionThe distance between the centres (locations of maximum density) of a binary NS
GRHydro_proper_separation  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeREAL




diffrho   compact0
DiffRho   descriptionThe first difference in rho
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




eos_temps   compact0
eos_cs2_p   descriptionTemporaries for the EOS calls
eos_cs2_m   dimensions3
eos_dpdeps_p   distributionDEFAULT
eos_dpdeps_m   group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




roeaverage_temps   compact0
rho_ave   descriptionTemporaries for the Roe solver
velx_ave   dimensions3
vely_ave   distributionDEFAULT
velz_ave   group typeGF
eps_ave   tagsProlongation=”None” checkpoint=”no”
press_ave   timelevels1
eos_cs2_ave  variable typeREAL








  Group Names    Variable Names    Details   




con2prim_temps   compact0
press_old   descriptionTemporaries for the conservative to primitive conversion
press_new   dimensions3
eos_dpdeps_temp   distributionDEFAULT
eos_dpdrho_temp   group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




h_viscosity_temps   compact0
eos_c   descriptionTemporaries for H viscosity
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




11.0.2 PUBLIC GROUPS




  Group Names     Variable Names     Details   




grhydro_eos_scalars   compact0
GRHydro_eos_handle   descriptionHandle number for EOS
GRHydro_polytrope_handle  dimensions0
  distributionCONSTANT
  group typeSCALAR
  timelevels1
 variable typeINT




grhydro_minima   compact0
GRHydro_rho_min   descriptionAtmosphere values
GRHydro_tau_min   dimensions0
  distributionCONSTANT
  group typeSCALAR
  timelevels1
 variable typeREAL




dens   compact0
dens   descriptiongeneralized particle number
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” tensorweight=+1.0 jacobian=”inverse_jacobian” interpolator=”matter”
  timelevels3
 variable typeREAL




tau   compact0
tau   descriptioninternal energy
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” tensorweight=+1.0 jacobian=”inverse_jacobian” interpolator=”matter”
  timelevels3
 variable typeREAL




scon   compact0
scon   descriptiongeneralized momenta
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”D” tensorweight=+1.0 jacobian=”inverse_jacobian” interpolator=”matter”
  timelevels3
 vararray_size3
 variable typeREAL




bcons   compact0
Bcons   descriptionB-field conservative variable
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”U” tensorparity=-1 tensorweight=+1.0 jacobian=”jacobian” interpolator=”matter”
  timelevels3
 vararray_size3
 variable typeREAL








  Group Names    Variable Names    Details   




evec   compact0
Evec   descriptionElectric field at edges
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”U” tensorweight=+1.0 jacobian=”jacobian” interpolator=”matter”
  timelevels1
 vararray_size3
 variable typeREAL




y_e_con   compact0
Y_e_con   descriptionConserved electron fraction
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” tensorweight=+1.0 jacobian=”inverse_jacobian” interpolator=”matter”
  timelevels3
 variable typeREAL




entropycons   compact0
entropycons   descriptionConserved entropy density
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” tensorweight=+1.0 jacobian=”inverse_jacobian” interpolator=”matter”
  timelevels3
 variable typeREAL




grhydro_tracers   compact0
tracer   descriptionTracers
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar”
  timelevels3
 vararray_sizenumber_of_tracers
 variable typeREAL




sdetg   compact0
sdetg   descriptionSqrt of the determinant of the 3-metric
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” tensortypealias=”Scalar” tensorweight=+1.0 interpolator=”matter” checkpoint=”no”
  timelevels1
 variable typeREAL




psidc   compact0
psidc   descriptionPsi parameter for divergence cleaning
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” tensorweight=+1.0 tensorparity=-1 jacobian=”inverse_jacobian” interpolator=”matter”
  timelevels3
 variable typeREAL








  Group Names    Variable Names    Details   




densrhs   compact0
densrhs   descriptionUpdate term for dens
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




taurhs   compact0
taurhs   descriptionUpdate term for tau
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




srhs   compact0
srhs   descriptionUpdate term for s
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_size3
 variable typeREAL




bconsrhs   compact0
Bconsrhs   descriptionUpdate term for Bcons
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_size3
 variable typeREAL




avecrhs   compact0
Avecrhs   descriptionUpdate term for Avec
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 vararray_size3
 variable typeREAL




aphirhs   compact0
Aphirhs   descriptionUpdate term for Aphi
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL








  Group Names    Variable Names    Details   




psidcrhs   compact0
psidcrhs   descriptionUpdate term for psidc
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




entropyrhs   compact0
entropyrhs   descriptionUpdate term for entropycons
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




divb   compact0
divB   descriptionMagnetic field constraint
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”Restrict” checkpoint=”no” tensorparity=-1
  timelevels1
 variable typeREAL




bcom   compact0
bcom   descriptionbî: comoving contravariant magnetic field 4-vector spatial components
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”U” tensorparity=-1 interpolator=”matter”
  timelevels3
 vararray_size3
 variable typeREAL




bcom0   compact0
bcom0   descriptionb0̂ component of the comoving contravariant magnetic field 4-vector
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” interpolator=”matter”
  timelevels3
 variable typeREAL




bcom_sq   compact0
bcom_sq   descriptionhalf of magnectic pressure: contraction of b_a bâ
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar” interpolator=”matter”
  timelevels3
 variable typeREAL








  Group Names     Variable Names    Details   




lvel   compact0
lvel   descriptionlocal velocity vî
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”U” jacobian=”jacobian” interpolator=”matter”
  timelevels3
 vararray_size3
 variable typeREAL




lbvec   compact0
lBvec   descriptionlocal Magnetic field components Bî
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”U” jacobian=”jacobian” tensorparity=-1 interpolator=”matter”
  timelevels3
 vararray_size3
 variable typeREAL




local_metric   compact0
gaa   descriptionlocal ADM metric g_ij
gab   dimensions3
gac   distributionDEFAULT
gbb   group typeGF
gbc   tagsProlongation=”None” checkpoint=”no”
gcc   timelevels3
 variable typeREAL




local_extrinsic_curvature   compact0
kaa   descriptionlocal extrinsic curvature K_ij
kab   dimensions3
kac   distributionDEFAULT
kbb   group typeGF
kbc   tagsProlongation=”None” checkpoint=”no”
kcc   timelevels1
 variable typeREAL




local_shift   compact0
betaa   descriptionlocal ADM shift betaî
betab   dimensions3
betac   distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_prim_bext   compact0
rhoplus   descriptionPrimitive variables extended to the cell boundaries
velxplus   dimensions3
velyplus   distributionDEFAULT
velzplus   group typeGF
pressplus   tagsProlongation=”None” checkpoint=”no”
epsplus   timelevels1
w_lorentzplus  variable typeREAL








  Group Names     Variable Names     Details   




grhydro_scalars   compact0
flux_direction   descriptionWhich direction are we taking the fluxes in and the offsets
xoffset   dimensions0
yoffset   distributionCONSTANT
zoffset   group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




grhydro_atmosphere_mask   compact0
atmosphere_mask   descriptionFlags to say whether a point needs to be reset to the atmosphere
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None”
  timelevels1
 variable typeINT




grhydro_atmosphere_mask_real   compact0
atmosphere_mask_real   descriptionFlags to say whether a point needs to be reset to the atmosphere. This is sync’ed (and possibly interpolated)!
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”sync” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_atmosphere_descriptors   compact0
atmosphere_field_descriptor   dimensions0
atmosphere_atmosp_descriptor  distributionCONSTANT
atmosphere_normal_descriptor  group typeSCALAR
  timelevels1
 variable typeINT




grhydro_cons_tracers   compact0
cons_tracer   descriptionThe conserved tracer variable
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongationParameter=”HydroBase::prolongation_type” tensortypealias=”Scalar”
  timelevels3
 vararray_sizenumber_of_tracers
 variable typeREAL




grhydro_maxima_position   compact0
maxima_x   descriptionThe position (coordinate values) of the maximum value of rho
maxima_y   dimensions0
maxima_z   distributionCONSTANT
maximum_density   group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeREAL








  Group Names     Variable Names    Details   




maxrho_global   compact0
maxrho_global   descriptionstore the global maximum of rho
    descriptionfor refinment-grid steering
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeREAL




grhydro_c2p_failed   compact0
GRHydro_C2P_failed  descriptionMask that stores the points where C2P has failed
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”restrict” tensortypealias=”Scalar” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_fluxes   compact0
densflux   descriptionFluxes for each conserved variable
sxflux   dimensions3
syflux   distributionDEFAULT
szflux   group typeGF
tauflux   tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_bfluxes   compact0
Bconsxflux   descriptionFluxes for each B-field variable
Bconsyflux   dimensions3
Bconszflux   distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_psifluxes   compact0
psidcflux   descriptionFluxes for the divergence cleaning parameter
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_entropyfluxes   compact0
entropyflux   descriptionFluxes for the conserved entropy density
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL








  Group Names    Variable Names    Details   




grhydro_avecfluxes   compact0
Avecxflux   descriptionFluxes for each Avec variable
Avecyflux   dimensions3
Aveczflux   distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




grhydro_aphifluxes   compact0
Aphiflux   descriptionFluxes for Aphi
  dimensions3
  distributionDEFAULT
  group typeGF
  tagsProlongation=”None” checkpoint=”no”
  timelevels1
 variable typeREAL




evolve_y_e   compact0
evolve_Y_e   descriptionAre we evolving Y_e? Set in Paramcheck
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




evolve_temper   compact0
evolve_temper   descriptionAre we evolving temperature? Set in Paramcheck
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




evolve_entropy   compact0
evolve_entropy   descriptionAre we evolving entropy? Set in Paramcheck
  dimensions0
  distributionCONSTANT
  group typeSCALAR
  tagscheckpoint=”no”
  timelevels1
 variable typeINT




evolve_mhd