CartGrid3D

Gabrielle Allen
Gerd Lanfermann
Joan Masso
Jonathan Thornburg

\( \)Date\( \)

Abstract

CartGrid3D allows you to set up coordinates on a 3D Cartesian grid in a flexible manner. You can choose different grid domains (eg octant) to allow you to exploit any symmetry in your problem. CartGrid3D also provides routines for registering symmetries of grid functions and applying symmetry conditions across the coordinate axes.

1 Specifying the Grid Symmetry

CartGrid3D allows you to specify the grid symmetry (or lack thereof) with the grid::domain parameter:

grid::domain = "full"


There are no symmetries.

grid::domain = "bitant"


The grid includes only the \(z \ge 0\) half-space (plus symmetry zones); there is a reflection symmetry across the \(z=0\) plane.

grid::domain = "quadrant"


The grid includes only the \(\{x \ge 0, y \ge 0\}\) quadrant (plus symmetry zones); there is a reflection symmetry across both the \(x=0\) plane and the \(y=0\) plane.

grid::domain = "octant"


The grid includes only the \(\{x \ge 0, y \ge 0, z \ge 0\}\) octant (plus symmetry zones); there is a reflection symmetry across each of the \(x=0\) plane, the \(y=0\) plane, and the \(z=0\) plane.

Note that the implementation of symmetries in CartGrid3D is deprecated, and the SymBase infrastructure should be used instead. The above symmetries can be implemented using SymBase and the ReflectionSymmetry thorn. Additionally, there are rotational symmetries provided by the RotatingSymmetry180 and RotatingSymmetry90 thorns.

In each case except grid::domain = "full", symmetry zones are introduced just on the “other side” of each symmetry grid boundary. Each symmetry zone has a width (perpendicular to the boundary) of driver::ghost_size extra grid points. For centered 2nd order finite differencing, a width of driver::ghost_size = 1 should be sufficient, but for (centered) 4th order finite differencing, or for upwinded 2nd order, a width of driver::ghost_size = 2 is needed. Making driver::ghost_size too large is fairly harmless (it just slightly reduces performance), but making it too small will almost certainly result in horribly wrong finite differencing near the symmetry boundaries, and may also result in core dumps from out-of-range array accessing.

Note that the symmetry zones must be explicitly included in driver::global_nx, driver::global_ny, and driver::global_nz, but should not be included in any of the grid::type = "byrange" parameters grid::xmin, grid::xmax, grid::ymin, grid::ymax, grid::zmin, grid::zmax, grid::xyzmin, and/or grid::xyzmax described in the next section.

Note also that driver::global_nx, driver::global_ny, and driver::global_nz do not include any ghost zones introduced for multiprocessor synchronization. (For more information on ghost zones, see the section “Ghost Size” in the “Cactus Variables” chapter of the Cactus Users’ Guide.)

2 Specifying the Grid Size, Range, and Spacing

CartGrid3D provides several different methods for setting up the integer grid size (eg 128), floating-point grid spacing (eg 0.1), and floating-point grid range (eg 12.8).1 You specify which method to use, with the grid::type parameter:

grid::type = "byrange"


You specify the \(x\), \(y\), and \(z\) grid ranges, either with separate grid::xmin, grid::xmax, grid::ymin, grid::ymax, grid::zmin, and grid::zmax parameters, or with the grid::xyzmin and grid::xyzmax parameters. The grid spacings are then determined automagically from this information and the driver::global_nx, driver::global_ny, and driver::global_nz grid-size parameters. You should also choose the grid::domain parameter consistent with all these other parameters. (It’s not clear whether or not the code ever explicitly checks this.)

grid::type = "box"


This is a special case of grid::type = "byrange" with the grid ranges hard-wired to grid::xyzmin = -0.5 and grid::xyzmax = +0.5.

grid::type = "byspacing"


You specify the \(x\), \(y\), and \(z\) grid spacings, either with separate grid::dx, grid::dy, and grid::dz parameters, or with the grid::dxyz parameter. You also specify the grid symmetry with the grid::domain parameter. The \(x\), \(y\), and \(z\) grid ranges are then determined automagically from this information and the driver::global_nx, driver::global_ny, and driver::global_nz grid-size parameters: Each coordinate’s range is chosen to be either symmetric about zero, or to extend from 0 up to a maximum value.

There are also a number of optional parameters which can be used to specify whether or not it’s ok to have a grid point with an \(x\), \(y\), and/or \(z\) coordinate exactly equal to 0:

grid::no_originx, grid::no_originy, grid::no_originz, grid::no_origin


These parameters are all deprecated — don’t use them!

grid::avoid_originx


This is a Boolean parameter; if set to true (grid::avoid_originx = "true" or grid::avoid_originx = "yes" or grid::avoid_originx = 1) then the grid will be “half-centered” across \(x=0\), ie there will be grid points at …, \(x = - \frac {3}{2} \Delta x\), \(x = - \frac {1}{2} \Delta x\), \(x = + \frac {1}{2} \Delta x\), \(x = + \frac {3}{2} \Delta x\), …, but not at \(x=0\).

grid::avoid_originy


Same thing for \(y\).

grid::avoid_originz


Same thing for \(z\).

grid::avoid_origin


Same thing for all 3 axes \(x\) and \(y\) and \(z\), ie no grid point will have \(x=0\) or \(y=0\) or \(z=0\).

3 An Example

Here is an example of setting up a grid using the PUGH unigrid driver. The relevant parts of the parameter file are as follows:

# PUGH
driver::ghost_size = 2
driver::global_nx = 61
driver::global_ny = 61
driver::global_nz = 33

# CartGrid3D
grid::avoid_origin = "no"
grid::domain = "bitant"
grid::type = "byrange"
grid::xmin = -3.0
grid::xmax = +3.0
grid::ymin = -3.0
grid::ymax = +3.0
grid::zmin =  0.0
grid::zmax = +3.0

The resulting Cactus output (describing the grid) is as follows:

INFO (CartGrid3D): Grid Spacings:
INFO (CartGrid3D):  dx=>1.0000000e-01  dy=>1.0000000e-01  dz=>1.0000000e-01
INFO (CartGrid3D): Computational Coordinates:
INFO (CartGrid3D):  x=>[-3.000, 3.000]  y=>[-3.000, 3.000]  z=>[-0.200, 3.000]
INFO (CartGrid3D): Indices of Physical Coordinates:
INFO (CartGrid3D):  x=>[0,60]  y=>[0,60]  z=>[2,32]
INFO (PUGH): Single processor evolution
INFO (PUGH): 3-dimensional grid functions
INFO (PUGH):   Size: 61 61 33

Since there’s no symmetry in the \(x\) and \(y\) directions, the grid is set up just as specified, with floating-point coordinates running from \(-3.0\) to \(3.0\) inclusive, and 61 grid points with integer grid indices \([0,60]\) (C) or \([1,61]\) (Fortran).

However, in the \(z\) direction there’s a reflection symmetry across the \(z=0\) plane, so the specified range of the grid, \(z \in [0.0,3.0]\), is automagically widened to include the symmetry zone of driver::ghost_size = 2 grid points. The grid thus actually includes the range of floating-point coordinates \(z \in [-0.2,3.0]\). The original specification of 33 grid points is left alone, however, so the grid points have integer array indices \([0,32]\) (C) or \([1,33]\) (Fortran). The “physical” (ie non-symmetry-zone) part of the grid is precisely the originally-specified range, \(z \in [0.0,3.0]\), and has the integer array indices \([2,32]\) (C) or \([3,33]\) (Fortran).

4 Coordinates

CartGrid3D defines (registers) four coordinate systems: cart3d, cart2d, cart1d, and spher3d.

The Cartesian coordinates supplied by this thorn are grid functions with the standard names x, y, and z. To use these coordinates you need to inherit from grid, ie you need to have an

inherits: grid

line in your interface.ccl file. In addition a grid function r is provided, containing the radial coordinate from the origin where

    ∘ -----------
r =   x2 + y2 + z2

CartGrid3D registers the lower and upper range of each coordinate with the flesh.

5 Symmetries for Grid Functions

If your problem and initial data allow it, CartGrid3D allows you to enforce even or odd parity for any grid function at (across) each coordinate axis. For a function \(\phi (x,y,z)\), even parity symmetry on the \(x\)-axis means

ϕ(− x,y,z) = ϕ(x,y,z)

while odd parity symmetry means

ϕ(− x,y,z) = − ϕ(x,y,z)

Note that the symmetries will only be enforced if a symmetry domain is chosen (that is, if grid::domain is set to something other than grid::domain = "full".

5.1 Registering Symmetry Behaviour

Each grid function can register how it behaves under a coordinate change using function calls in CartGrid3D. These symmetry properties can then be used by other thorns, for example CactusBase/Boundary uses them to enforce symmetry boundary conditions across coordinate axes. Symmetries should obviously be registered before they are used, but since they can be different for different grids, they must be registered after the CCTK_STARTUP timebin. The usual place to register symmetries is in the CCTK_BASEGRID timebin.

For example, to register the symmetries of the xy component of the metric tensor from C, you first need to get access to the include file by putting the line

uses include: Symmetry.h

in your interface.ccl file. Then in your thorn you can write (C)

#include "Symmetry.h"
static int one=1;
int sym[3];
sym[0] = -one;
sym[1] = -one;
sym[2] =  one;
SetCartSymVN(cctkGH, sym,"ADMBase::gxy");

5.2 Calling Symmetry Boundary Conditions

CartGrid3D provides the following two routines to apply symmetry boundary conditions to a variable group:

CartSymGI(cGH *GH, int *gi)
CartSymGN(cGH *GH, const char *gn)

and for a specific variable it provides:

CartSymVI(cGH *GH, int *vi)
CartSymVN(cGH *GH, const char *gn)

A group or variable can be specified by its index value or name (use the ’I’ or ’N’ version respectively). The Fortran versions of these functions take an additional first argument, which is an integer which will hold the return value.

6 Parameters




avoid_origin
Scope: private BOOLEAN



Description: Don’t place grid points on the coordinate origin/axes



Range Default: yes
:






avoid_originx
Scope: private BOOLEAN



Description: Don’t place grid points on the x-coordinate origin/axes



Range Default: yes
:






avoid_originy
Scope: private BOOLEAN



Description: Don’t place grid points on the y-coordinate origin/axes



Range Default: yes
:






avoid_originz
Scope: private BOOLEAN



Description: Don’t place grid points on the z-coordinate origin/axes



Range Default: yes
:






no_origin
Scope: private BOOLEAN



Description: DEPRECATED: Don’t place grid points on the coordinate origin/axes



Range Default: yes
:






no_originx
Scope: private BOOLEAN



Description: DEPRECATED: Don’t place grid points on the x-coordinate origin/axes



Range Default: yes
:






no_originy
Scope: private BOOLEAN



Description: DEPRECATED: Don’t place grid points on the y-coordinate origin/axes



Range Default: yes
:






no_originz
Scope: private BOOLEAN



Description: DEPRECATED: Don’t place grid points on the z-coordinate origin/axes



Range Default: yes
:






register_default_coordinate_systems
Scope: private BOOLEAN



Description: register cartnd as the default coordinate systems



Default: yes






set_coordinate_ranges_on
Scope: private KEYWORD



Description: On which grids to set the coordinate ranges



Range Default: all grids
all grids
set ranges in local mode, on the coarsest level
all maps
set ranges in singlemap mode, on the coarsest level
first level
set ranges in level mode, on the first level






bitant_plane
Scope: restricted KEYWORD



Description: Plane defining bitant domain



Range Default: xy
xy
xy-plane
xz
xz-plane
yz
yz-plane






domain
Scope: restricted KEYWORD



Description: Domain type



Range Default: full
octant
Use an octant about the origin
quadrant
Use a quadrant in x-y plane
see [1] below
Use a quadrant with rotation symmetry about an axis
bitant
Use a bitant about the x-y plane
bitant_rotate
Use a bitant with rotation symmetry about an axis
full
Use the full domain



[1]

quadrant\_reflect\_rotate




dx
Scope: restricted REAL



Description: Coarse grid spacing in x-direction



Range Default: 0.3
0:*
Positive






dxyz
Scope: restricted REAL



Description: Coarse grid spacing in x,y,z-directions



Range Default: 0.0
0:*
Positive






dy
Scope: restricted REAL



Description: Coarse grid spacing in y-direction



Range Default: 0.3
0:*
Positive






dz
Scope: restricted REAL



Description: Coarse grid spacing in z-direction



Range Default: 0.3
0:*
Positive






quadrant_direction
Scope: restricted KEYWORD



Description: Direction defining quadrant domain



Range Default: z
x
x-direction
y
y-direction
z
z-direction






rotation_axis
Scope: restricted KEYWORD



Description: Axis about which the rotation symmetry is to be applied



Range Default: z
x
x-axis
y
y-axis
z
z-axis






symmetry_xmax
Scope: restricted BOOLEAN



Description: Symmetry boundary condition on upper x boundary



Range Default: no
:
Logical






symmetry_xmin
Scope: restricted BOOLEAN



Description: Symmetry boundary condition on lower x boundary



Range Default: no
:
Logical






symmetry_ymax
Scope: restricted BOOLEAN



Description: Symmetry boundary condition on upper y boundary



Range Default: no
:
Logical






symmetry_ymin
Scope: restricted BOOLEAN



Description: Symmetry boundary condition on lower y boundary



Range Default: no
:
Logical






symmetry_zmax
Scope: restricted BOOLEAN



Description: Symmetry boundary condition on upper z boundary



Range Default: no
:
Logical






symmetry_zmin
Scope: restricted BOOLEAN



Description: Symmetry boundary condition on lower z boundary



Range Default: no
:
Logical






type
Scope: restricted KEYWORD



Description: Grid type



Range Default: box
box
Box grid from -0.5 to 0.5
byrange
Specify min and max values
byspacing
Specify grid spacings
coordbase
Get specification from CoordBase
multipatch
Get specification from MultiPatch






xmax
Scope: restricted REAL



Description: Coordinate maximum in x-direction



Range Default: 1.0
:
Anything






xmin
Scope: restricted REAL



Description: Coordinate minimum in x-direction



Range Default: -1.0
:
Anything






xyzmax
Scope: restricted REAL



Description: Coordinate maximum in xyz-directions



Range Default: -424242
:
Anything






xyzmin
Scope: restricted REAL



Description: Coordinate minimum in x,y,z-directions



Range Default: -424242
:
Anything






ymax
Scope: restricted REAL



Description: Coordinate maximum in y-direction



Range Default: 1.0
:
Anything






ymin
Scope: restricted REAL



Description: Coordinate minimum in y-direction



Range Default: -1.0
:
Anything






zmax
Scope: restricted REAL



Description: Coordinate maximum in z-direction



Range Default: 1.0
:
Anything






zmin
Scope: restricted REAL



Description: Coordinate minimum in z-direction



Range Default: -1.0
:
Anything






periodic
Scope: shared from DRIVERBOOLEAN






periodic_x
Scope: shared from DRIVERBOOLEAN






periodic_y
Scope: shared from DRIVERBOOLEAN






periodic_z
Scope: shared from DRIVERBOOLEAN



7 Interfaces

General

Implements:

grid

Inherits:

coordbase

Grid Variables

7.0.1 PUBLIC GROUPS





  Group Names     Variable Names   Details    




gridspacings compact 0
coarse_dx description 3D Cartesian grid spacings
coarse_dy dimensions 0
coarse_dz distribution CONSTANT
group type SCALAR
tags Checkpoint=”no”
timelevels 1
variable type REAL




coordinates compact 0
x description 3D Cartesian grid coordinates
y dimensions 3
z distribution DEFAULT
r group type GF
tags Prolongation=”None” Checkpoint=”no”
timelevels 1
variable type REAL




Adds header:

Symmetry.h

Uses header:

CoordBase.h

8 Schedule

This section lists all the variables which are assigned storage by thorn CactusBase/CartGrid3D. Storage can either last for the duration of the run (Always means that if this thorn is activated storage will be assigned, Conditional means that if this thorn is activated storage will be assigned for the duration of the run if some condition is met), or can be turned on for the duration of a schedule function.

Storage

 

Always:  
coordinates gridspacings  
   

Scheduled Functions

CCTK_STARTUP

  symmetrystartup

  register gh extension for gridsymmetry

 

  Language: c
  Type: function

CCTK_WRAGH

  registercartgrid3dcoords

  register coordinates for the cartesian grid

 

  Language: c
  Options: meta
  Type: function

BoundaryConditions

  cartgrid3d_applybc

  apply symmetry boundary conditions

 

  Language: c
  Type: function

SymmetryRegister

  cartgrid3d_registersymmetryboundaries

  register symmetry boundaries

 

  Language: c
  Options: meta
  Type: function

CCTK_PARAMCHECK

  paramcheck_cartgrid3d

  check coordinates for cartgrid3d

 

  Language: c
  Type: function

CCTK_BASEGRID (conditional)

  cartgrid3d_setranges

  set up ranges for spatial 3d cartesian coordinates (on all grids)

 

  Before: spatialcoordinates
  Language: c
  Type: function
  Writes: grid::gridspacings(everywhere)

CCTK_BASEGRID (conditional)

  cartgrid3d_setranges

  set up ranges for spatial 3d cartesian coordinates (on all maps)

 

  Before: spatialcoordinates
  Language: c
  Options: singlemap
  Type: function
  Writes: grid::gridspacings(everywhere)

CCTK_BASEGRID (conditional)

  cartgrid3d_setranges

  set up ranges for spatial 3d cartesian coordinates (on first level)

 

  Before: spatialcoordinates
  Language: c
  Options: level
  Reads: grid::gridspacings(everywhere)
  Type: function

CCTK_BASEGRID

  cartgrid3d_setcoordinates

  set up spatial 3d cartesian coordinates on the gh

 

  Language: c
  Type: function
  Writes: grid::coordinates(everywhere)

CCTK_POSTREGRIDINITIAL

  cartgrid3d_setcoordinates

  set coordinates after regridding

 

  Language: c
  Type: function
  Writes: grid::coordinates(everywhere)

CCTK_POSTREGRID

  cartgrid3d_setcoordinates

  set coordinates after regridding

 

  Language: c
  Type: function
  Writes: grid::coordinates(everywhere)

Aliased Functions

 

Alias Name:         Function Name:
CartGrid3D_SetCoordinates SpatialCoordinates
CartGrid3D_SetRanges SpatialSpacings