Suzaku Project Data Management Plan (PDMP)
Suzaku Project Data Management Plan (PDMP)
Suzaku Project Data Management Plan (PDMP)
Version 2.0
September 27, 2007
Version History
v0.0 (September 9, 2005) — Revision from the PDMP of the Astro-E(1) project. Remove
explanations about the instruments.
v0.1 (December 3, 2005) — Revision with comments from Ken Ebisawa. Update the software
description. Remove documents about the XRS.
v0.2 (January 17, 2006) — Additional post-launch information included.
v1.0 (April 17, 2007) — First official version, corresponding to Version 1.X processing.
v1.1 (April 20, 2007) — Including description in the Suzaku memo. Adding comments from
Yoshitaka Ishisaki.
v2.0 (September 27, 2007) — The version corresponding to Version 2.X processing. Adding
comments from Ken Ebisawa, Yoshitomo Maeda, Yukikatsu Terada, Tadayuki Takahashi,
Hironori Matsumoto, Masanobu Ozaki.
Contents
1 Introduction 4
1.1 Scope of this Document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2 Mission Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.3 The Suzaku Guest Observer Facility . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.4 Related Documents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
2 Observations Types 7
2.1 Observations Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.1.1 In-Orbit Checkout . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.1.2 Observatory Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.1.3 Science Working Group Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.1.4 GO Observations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.1.5 Calibration Observations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.1.6 Target of Opportunity Observations . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.1.7 HXD WAM Observations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.2 Proprietary Period . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.3 Satellite and Instrument Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4 Data Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4.1 Data Retrieval and Raw Data Archives . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4.2 Data Processing at ISAS and GSFC . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4.3 Data Delivery to Suzaku Observers . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.4.4 Suzaku Archives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
3 Software Principles 12
3.1 General Software Design Principles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.2 Suzaku Specific Design Principles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3.3 Suzaku Software Standards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.3.1 Languages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3.3.2 Coding Rules and Compiler Requirements . . . . . . . . . . . . . . . . . . . . . . . . 14
3.3.3 Systems Supported . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.3.4 Coordination and Version Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.3.5 Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.4 Suzaku FTOOLS Global Development Scheme . . . . . . . . . . . . . . . . . . . . . . . . . 14
3.5 Suzaku Ftools Release Plan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
1
CONTENTS 2
7 Calibration 35
7.1 Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
7.2 Calibration Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
7.3 Calibration Database (CALDB) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
7.3.1 Structure and Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
7.3.2 Time-Dependent Calibration Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
7.3.3 Calibration File Name . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
7.3.4 Version Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
7.4 Important Calibration Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
7.4.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
7.4.2 XRT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
7.4.3 XIS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
7.4.4 HXD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
7.5 Suzaku Calibration File Release Plan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
CONTENTS 3
A Acronyms 44
Introduction
Suzaku, formerly Astro-E2, is the fifth Japanese X-ray astronomy satellite built by the Institute of Space
and Astronautical Sciences of Japan Aerospace Exploration Agency (ISAS/JAXA). It was launched from
the Uchinoura Space Center (USC) on 2005 July 10. Suzaku is the second ISAS X-ray astronomy satellite
built in close collaboration with National Aeronautics and Space Administration’s Goddard Space Flight
Center (NASA/GSFC).
• An brief overview of the mission, the instruments on-board, and the Suzaku Guest Observer Facility
(GOF).
• An overview of the end-to-end flow of data, from the satellite to the user and the archive, and
the division of labor between ISAS/JAXA and NASA/GSFC, as well as that among groups within
NASA/GSFC.
• The Suzaku data and data products.
• The support given to guest observers (GOs)
• High level agreements between ISAS/JAXA and NASA/GSFC, such as the allocation of observing
time.
• Detailed technical information about the instruments, including design and calibration.
• Technical information about the telemetry.
In chapter 2, Suzaku operation and types of observations are briefly explained. Suzaku software design
principles and agreements are presented in chapter 3. Further details of software are described in chapters
4, 5, and 6. Important issues regarding the calibration are given in chapter 7. Tasks regarding the Guest
Observer support are shown in chapter 8, and Suzaku archives are explained in chapter 9.
In appendix A, acronyms used in this document are defined. Guidelines for FTOOLS developers are
described in appendix B. A flow chart of the pipe-line processing is displayed in appendix C. Coordinate
system of each detector is listed in appendix D.
4
Suzaku PDMP v2.0 (September 27, 2007) 5
• The Suzaku Technical Description — Design of the entire satellite, instruments, and their specifica-
tion. This is available at
http://suzaku.gsfc.nasa.gov/docs/suzaku/prop tools/suzaku td/
Suzaku PDMP v2.0 (September 27, 2007) 6
• Suzaku FITS File Formats — FITS formats of the Suzaku HK and event files, calibration files and
other important files (e.g., attitude files and orbit files)
• Suzaku Interface Control Document (ICD) — it defines the interface between Suzaku processing
processing systems and the HEASARC, and contains the directory structure and file name convention
for files that are delivered.
• Suzaku Calibration — How Suzaku instruments and data are calibrated is explained. See 7.1 for
details.
• Suzaku data analysis guide (also known as the ABC Guide) — Provides an overview of Suzaku data
analysis. This document will be available at
http://suzaku.gsfc.nasa.gov/docs/suzaku/analysis/suzaku abc/
Chapter 2
Observations Types
In this chapter, we provide a brief description of various types of Suzaku observations, because different
types of observations are treated differently in data distribution and archiving.
Figure 2.1 shows a flowchart illustrating various processes in the Suzaku observation program from
GOs’ proposal submission to the data reception. Important issues for individual processes outlined in this
chapter are explained in more details in later chapters.
7
Suzaku PDMP v2.0 (September 27, 2007) 8
2.1.4 GO Observations
Suzaku entered the guest observer (GO) phase of the mission in April 2006. During this period, all non-
Observatory Time observations are selected from the world-wide astronomy community, with the exception
of the delayed SWG observations (see above). Some GO observations were carried out in February and
March 2006, before the nominal start of the GO period.
Targets are selected through a competitive process from observing proposals submitted by guest ob-
servers (GOs). Proposals by principal investigators (PIs) affiliated with a US institution are submitted to,
and selected by, NASA, through the annual NASA Research Announcement (NRA) process.
PIs affiliated with an institution in an ESA member country submit their proposals through ESA, who
conduct their own proposal review. Proposals submitted to ISAS/JAXA (principally by Japanese PIs,
although PIs from non-US, non-ESA country may also apply through ISAS/JAXA) are judged by ISAS.
The ESA list is folded into the Japanese list.
The final accepted target list is determined at the Japan-US merging meeting based on the Japanese
(including ESA) and US target lists. In case there are identical targets on the Japanese and US target lists,
the same target may be assigned to a Japanese PI and a US PI. Such targets are referred to as “merged.”
The GOF serves as the principal point of contact for US PIs, including co-PIs of merged targets. This
includes observation planning, notification of availability of processed data, and support in analyzing the
processed data (chapter 8).
version will be made available), so that archive users are able to obtain exactly the same datasets as the
original Guest Observers have received. From time to time, contents of the archives ma be updated, after
being reprocessed with updated software and calibration files. Details of the Suzaku archives are explained
in chapter 9.
SWG Suzaku
Observations Science Working Group
Observations
Selection Proposals Japanese
in Japan Guest Observers
GO
Observations
ISAS
Attitude
Proposal Determination Attitude
Database Files
Telemetry Pipe-line Processed
Database First FITS
Observation Files Processing Products
(SIRIUS) FITS
Scheduling Database Conversion
Operation Orbit
Center Files
Raw Packet
Telemetry Calibration
Operation
Commands (RPT) Database
Log
Delivery Mirrored
11
Observation Archival
Database Database
Mirrored
Chapter 3
Software Principles
In this chapter, we present the Suzaku software principles and agreements, which all the software developers
need to follow throughout the Suzaku project.
1. Standard and portable data format — FITS (Flexible Image Transport System) format is adopted
for all the binary files. System dependent binary files will never be used. Moreover, the existing
OGIP conventions should be followed wherever possible, and new conventions should be submitted
to HEASARC FITS Working Group to check for consistencies with other missions. Use of ASCII
format is allowed for small files.
2. Universal and unique software — There should not be multiple channels of the data analysis. Software
releases are controlled, and the same routines used for the instrumental calibrations by hardware
teams are used for the scientific data analysis by Guest Observers.
3. Designed for multimission analysis — Existing software infrastructures will be utilized as much as
possible. Users will be able to analyze Suzaku data with standard high-level X-ray data analysis
packages such as XSPEC, XIMAGE, XRONOS, etc.
4. Easy to install and use — The software will be easy to install and use, and extensive help, support
and documentation will be provided. Suzaku specific software for low-level tasks are distributed in
the standard FTOOLS package, providing user friendly interface on most standard platforms (section
3.3.3).
5. Free and public software — Users will not have to purchase any commercial software packages (such
as IDL), and all the source codes will be open and easily available at free of charge. Users will not
have to worry about license issues, and software authors shall not claim any privileges or credits.
Users may modify and distribute Suzaku software freely on their responsibility.
12
Suzaku PDMP v2.0 (September 27, 2007) 13
1. The raw telemetry will be converted to FITS format before distribution. There is only
one set of software (mk1stfits; section 6.3.1) to access and interpret the raw telemetry data and to
convert them to the FITS format (First FITS Files; section 6.3). Mk1stfits, as well as other processing
software, must be fully tested and ready before the launch of the satellite.
2. All the calibration and data processing should start from the First FITS Files. To that
end, the First FITS Files should reflect the original structure of the raw telemetry as much as possible.
3. All the scientific analysis starts from the standard calibrated FITS files. The First FITS
Files are further processed by the standard software with instrumental calibration information, and
the Calibrated FITS Files (section 6.3) are produced. Scientific outputs are produced always from
the official Calibrated FITS Files, and there should not be other routes for scientific analysis.
4. The same processing system to calibrate the First FITS files should run at GSFC and
ISAS. Thereby, US and Japanese Suzaku Observers shall receive the identical Calibrated FITS Files.
5. Important calibration tools/software should be made promptly available to GOs. At any
given time, there shall be always a single version of the official instrument calibration files and software
controlled by the Suzaku GOF and instrument teams. This ensures that the Suzaku Observers can
apply the latest calibration information to the observing data.
6. Suzaku software will be written by the Suzaku software and hardware teams at GSFC,
ISAS and other institutions in Japan. Tasks which require deep understanding of the Suzaku
instruments, spacecraft and telemetry formats will be mainly written by the members of the hardware
teams and ISAS. On the other hand, higher level tasks, in which user-friendliness, standardization
and conformity with other high energy missions should have a high priority, will be mainly written
by the software team at GSFC.
7. All the software for public release will be delivered to Suzaku GOF before the release.
Suzaku GOF will ensure that the software follow the rules presented in this chapter, and will package
them in a form which is suitable for general release. Suzaku GOF will be responsible for releasing and
maintaining the packages. When modifications or bug fixes are necessary, the Suzaku GOF will be
responsible for the fix and the re-release, contacting the original authors as needed. When significant
changes are necessary, Suzaku GOF will always consult the original authors in advance.
8. Tasks required for the Pipe-line processing should run in scripts. In the automated pipe-
line processing system (section 6.6), series of data processing tasks are run as background jobs by
scripts. Therefore, all the processing tasks including those which make use of GUI are required to
run in scripts.
3.3.5 Documentation
All software intended for distribution should be fully documented in English. Comments in the source
codes should be written in English, but Japanese translation might be added for convenience and may not
have to be stripped when distributed.
All subroutines/programs of general use shall contain a standard header. The GOF will provide a script
to strip out these headers and make them available over the Web. The GOF will also provide template
routines containing the standard header.
The FITS file format of Suzaku related files is fully explained in a separate document maintained by
the Suzaku GOF.
The extension includes the following: (1) Both upper and lower case letter are allowed. (2) END DO are allowed. (3) DO
WHILE loops are allowed. (4) INCLUDE statements are allowed. (5) INTEGER*2 data type is allowed. (6) Variable can be
up to 31 character long. (7) IMPLICIT NONE is allowed.
Suzaku PDMP v2.0 (September 27, 2007) 15
Suzaku
GSFC Official
ftools release anonymous Users in US
(once or twice a ftp and Europe
Test year)
Develop Release
Ftools Ftools
Build Suzaku
weekly Used
Test add-on for
GOF analysis
Repository
Build anonymous
Suzaku ftools Suzaku ftp
as needed
Ftools Users
team pipe-line
processing
system
Software
Development Processing
Coordinator Ftools
Processing Release
pipe-line
Center processing Ftools ftp Suzaku
Software Users in Japan
system
Development Suzaku
Coordinator add-on
Processing
Check Ftools
Consistency Used
for
analysis
Suzaku
XIS team Users
Test
HXD team
Test ISAS
Figure 3.1: Suzaku FTOOLS global development and version control scheme.
To accommodate both requirements of the rigorous version control and prompt release, the following
scheme, which is illustrated in figure 3.1, has been proposed and will be practiced for the Suzaku FTOOLS
development, version control, and release.
1. At GSFC, the FTOOLS team maintains the FTOOLS “Repository”, for which only the team mem-
bers are granted the write permission. The FTOOLS team receives original source codes from the
“Contact” groups (through ISAS when the Contact groups are in Japan; see 6 below), and put
the codes in the Repository, after minimal programmatic changes if necessary. The codes in the
Repository should be considered the genuine copy of the latest official FTOOLS.
2. The entire FTOOLS directory tree is built weekly from the Repository. This FTOOLS is called
“Develop” FTOOLS, and only available inside GSFC. The Develop FTOOLS are tested at GSFC,
and the codes will be fixed if any problems are found, and put in the Repository again. Note that
the Develop FTOOLS reflect updates of all the FTOOLS including Suzaku.
3. From time to time, the entire FTOOLS package is released to public. This package is called the
“Release” FTOOLS. Frequency of the release is typically once or twice a year.
Suzaku PDMP v2.0 (September 27, 2007) 16
4. In order to keep up with short development cycle, whenever Suzaku FTOOLS in the Repository
are updated, the FTOOLS team will build the Suzaku FTOOLS against the Release FTOOLS, and
install the “Suzaku add-on”. Interval of the Suzaku add-on build will be as short as one week (=
Develop FTOOLS build cycle). The Release FTOOLS with the Suzaku add-on is the one Suzaku
users will use for their data analysis. The Suzaku add-on package will be promptly released to Suzaku
users, so that they can install it on their own Release FTOOLS.
5. The Release FTOOLS with the Suzaku add-on will be mirrored daily to ISAS, and will be used
for Suzaku data analysis at ISAS. Japanese Suzaku users outside of ISAS may obtain the original
package from GSFC or mirrored one from ISAS.
6. Instrument teams in Japan will test and modify the source codes in the Suzaku add-on package
to reflect the latest calibration, and they will deliver the new codes to the Software Development
Coordinator at ISAS. The Software Development Coordinator will make sure that the codes from
different groups are consistent and can be built cleanly using gcc. After that, he or she will deliver
the codes to the FTOOLS team at GSFC (go back to step 1).
7. The Processing team at GSFC will obtain the Release FTOOLS with the Suzaku add-on, which
will become the base of the pipe-line processing. The Processing FTOOLS, as well as the pipe-line
processing scripts, will be mirrored to the ISAS processing center from GSFC, so that the data centers
at GSFC and ISAS use the identical system to produce standard Suzaku data products.
8. The processing software should be built-in the software packages HEAsoft, and the processing should
be performed with the the latest release (ver. 6.0.3 in November 2005).
There will be software modules that are used repeatedly in various stages of the Suzaku mission, from the
satellite operation to the scientific data analysis. In order to avoid overhead and inconsistency, functions
supposed to be used by two or more tools will be included in the Suzaku function libraries.
There will be at least three such function libraries for Suzaku; aste tool, which includes functions for
Suzaku specific tasks, atFunctions, which includes functions for generic attitude and orbital related tasks1 ,
and xrrt, which is for XRT ray-tracing. They are implemented in the FTOOLS package as libastetool.a,
libatFunctions.a, libxrrt.a, respectively2 .
17
Suzaku PDMP v2.0 (September 27, 2007) 18
In this chapter, Suzaku software used for observation planning and simulation are explained.
5.1.2 MAKI
MAKI is developed at GSFC for Suzaku and future multimission planning1 . Users may run MAKI through
a Web browser (users will need to obtain and install the “LHEA Plug-In”2 ). Users may place different
satellite fields of view on a sky image to plan out observation (Euler angles are automatically calculated).
These FOVs may be rotated, and MAKI will indicate if the roll is allowed or not by different colors for a
given time period. Users can also view the sun angle visibility limits for several missions, as well as adding
phase constraints. MAKI is expected to replace the ASCA command planning program “adcongra” which
had similar but more primitive functions.
MAKI accepts a sky image file from “SkyView”3 , or almost any FITS image files. It also lets users save
and reload the results. In figure 5.1, an example of MAKI output is shown.
Radio to Gamma-Ray. See http://skyview.gsfc.nasa.gov/skyview.html for details. MAKI can launch from the SkyView
output page if “Advanced” interface is selected.
20
Suzaku PDMP v2.0 (September 27, 2007) 21
Figure 5.1: An examples of the MAKI plot. An XRS field of view is displayed on an optical image obtained
from SkyView.
considered more effective. Finally, simulated data sets will be used to verify software for data analysis and
processing.
http://heasarc.gsfc.nasa.gov/Tools/w3pimms.html.
5 The WWW version of the XSPEC spectral simulation, WebSpec, is available at
http://heasarc.gsfc.nasa.gov/webspec/webspec.html.
Suzaku PDMP v2.0 (September 27, 2007) 22
GOF has released a suite of the Suzaku response functions for spectral simulation purposes. See,
http://heasarc.gsfc.nasa.gov/docs/suzaku/aehp prop tools.html for details.
6 the xissim software package can be downloaded from http://heasarc.gsfc.nasa.gov/docs/astroe/prop tools/xissim/xissim usage.html
Chapter 6
In this chapter, we define and explain Suzaku software tasks that are used for the data processing at ISAS
and GSFC and for the data analysis by Suzaku observers. The naming conventions of product files and
directory structures can be found in more detail in the Interface Control Document (ICD)1 .
6.1 Overview
In figure 6.1, we provide an overview of the Suzaku data flow, which we divide into four stages: satellite
specific calibration (Stage 0), production of the First FITS files (Stage 1), instrument specific calibration
(Stage 2) and data analysis (Stage 3).
In general, software tools used in the earlier stages (Stage 0, 1) do not need to be portable since they
run only at ISAS and/or GSFC, but they must be stable so that data need not be run through these stages
repeatedly. On the other hand, software used in the later stages (Stage 2, 3) must be portable and flexible
since they are distributed to Suzaku users for data analysis and for reprocessing when new calibration
information becomes available. All distributable Suzaku software are built and distributed within the
FTOOLS package (table 6.3 for a full list).
23
Suzaku PDMP v2.0 (September 27, 2007) 24
Suzaku Uchinoura
Satellite Space
Center
Raw Telemetry
Processing products
Stage 3 Data Analysis
GOAL
Presentation
Publication Guest
Observers
• The hardware teams may test and debug the 1st Stage Software with the RPT files.
• The GSFC processing team may generate new version of the First FITS Files from the RPT files
when the 1st Stage Software is revised.
ISAS shall routinely transfer to GSFC the RPT files, the 1st Stage Software and related files for back-up,
the First FITS Files for the Stage 2 processing as necessary.
HK Files
Instrument names are the same as the event files. Suffix of the HK files is “hk”. The HK identifiers, their
meanings and examples are shown in table 6.2.
Suzaku PDMP v2.0 (September 27, 2007) 27
The task xisexposureinfo (TBD) records onto the EXPOSURES extension the XIS exposure area,
or more precisely, the area the data are taken and downlinked. The area discriminated by the
onboard processor is excluded from the list. The list is written in the RAWXY coordinate by each
CCD exposure. This information is used for making the exposure map, for example (section 6.5.3).
The final products of the 2nd Stage are the Unscreened event files (the file extension of “ uf.evt”).
Those files are separated by instrumental modes and have all the necessary keywords and correct GTI
extensions, which are required for extraction of the scientific data products. They still include intervals
which is generally excluded for the scientific data analysis, such as high background and Earth occultation.
Suzaku PDMP v2.0 (September 27, 2007) 29
Filter Events
The instrument teams have studied detector signals through ground and on-board calibrations and found
that certain types of events are more likely to be due to X-rays than others. Events satisfying such criteria
are selected as X-ray events.
be removed in any scientific analysis. While the 55 Fe illumination produces strong background at
∼6 keV, it is almost negligible in the other bands. Therefore, events on the masking area can be
useful for soft source analysis, for example. Those events are not removed in the Cleaned Event Files
in the pipeline processing at ISAS and GSFC.
• Select HXD events in the Fast vs. Slow decay-time plane
Fluorescent lights from both GSO and BGO scintillators in the WELL unit are detected with one
PMT at the bottom. Since GSO has faster fluorescence decay time-scales than BGO, signals from
GSO can be discriminated using the pulse shape. Practically, the analog electronics has Fast and
Slow integration circuits with decaying time-scales of GSO and BGO, respectively. Pulses from GSO
and BGO fall onto different regions on the two dimensional Fast vs. Slow circuit pulse height plane.
With those information, the on-board PSD (Pulse Shape Discriminator) can discriminate and flag
the GSO events. However, to check the on-board algorithm and to optimize the region in the Fast
vs. Slow decay-time plane in on-ground data screening, the flookup task is available.4 .
• Select HXD PIN and/or GSO events
An HXD Unscreened event file include all events which hit PIN, GSO, or both. The users can choose
any sets of these events from the grade information using the task fselect.
one dimensional matrix, ARF, describes the combination of telescope effective area and transparency of
the XRT thermal shield and of contamination onto the OBF by X-ray energy.
The HXD team have generated on-axis detector response files. The flux from the source at off-axis is
corrected by the auxiliary file, which describe the efficiency ratio relative to the on-axis source.
The instrument teams study the HXD and XIS background from the blank sky, the night Earth and day
Earth data. For the XIS, non-X-ray background is accumulated from the night Earth data and the database
is available from the trend archive. The users can extract background image or spectra from the event files
using xselect. A task generates NXB spectra optimized for the observing and analyzing conditions such
as exposure distribution against COR in an observation and event extracting regions (TBD). The database
for this task will be stored in CALDB (TBD). For the HXD, the background level strongly increases after
the SAA passage and internal background will gradually increase with time since high energy particles
radio-activate PIN and GSO. The instrument team studies behavior of the background spectra in various
conditions, generates database of events during earth occultation sorted with parameters sensitive to the
background level, and reproduces background events for each observation from the database. The HXD
team will prepare archives of background event files for each observation, or develop a tool to reproduce
background events (hxdbackest: TBD).
5 The ASCA pipeline processing scripts was developed at GSFC ADF and ran only at GSFC. It contains over 14,000 lines
of ksh code.
Suzaku PDMP v2.0 (September 27, 2007) 33
ISAS GSFC
Backup
RPT RPT
mk1stfits
Distribution
FFF FFF
Critical Critical
FTOOLS FTOOLS
SFF SFF
(_uf) Comparison (_uf)
Data Data
Screening Screening
_cl _cl
DARTS HEASARC
Archive Archive
Figure 6.2: Overview of the Suzaku data pipeline processing at ISAS and GSFC.
Suzaku PDMP v2.0 (September 27, 2007) 34
Calibration
The instrument teams are responsible for the calibration of instruments, which they will release in the form
of documents, software, and calibration files. The latter are released to the public through the calibration
database (CALDB; section 7.3). Suzaku GOF is responsible for obtaining the calibration products from
the instrument teams and providing them to GOs.
7.1 Documentation
In cooperation with the instrument teams and the OGIP CALDB team, Suzaku GOF will provide a set
of documents which describe the Suzaku calibration. These documents should be public and available on-
line in text, postscript, pdf or HTML format. At minimum, the document set should cover the following
subjects:
35
Suzaku PDMP v2.0 (September 27, 2007) 36
GSFC ISAS
GOF
CALDB
files and are referenced by CALDB softwares. Recommended naming convention for the Suzaku calibration
files is the following:
ae inst kind yyyymmdd.ext
where inst is the name of the instrument3 , kind is brief description of the file contents, and must be less
than 8 characters, yyyy, mm and dd are year, month and day of the release, respectively. ext is the file
extension, which can be fits or any other letters to describe the nature of the file (e.g., rmf or arf). Both
inst and kind should not include hyphens (’-’), underscores or periods (’.’).
7.4.1 General
• Telescope definition files
Alignments between the telescopes and instruments are described. In addition, parameters of the
instruments and the coordinate systems, such as focal lengths and detector pixel sizes are written.
There may be separate telescope definition files for different detectors.
• Satellite Information Base (SIB)
Parameters for conversion from the digitized HK telemetry to the physical units are stored in the
multimission database named Satellite Information Base (SIB) located at ISAS. Essential parts of
the SIB will be extracted and put in the calibration files. These calibration files are used to interpret
HK parameters in the telemetry (section 4.1.4).
7.4.2 XRT
• Effective area
The XRT effective area corresponding to a certain encircled radius is given as a function of energy
for different off-axis and azimuthal angles. Separate files are made for XRT-I and XRT-S. If the four
XRT-Is have different effective areas, there shall be more than one file for XRT-I.
These files are made from calibration measurements and ray-tracing simulations (section 5.2.3), and
used to calculate ARFs and vignetting maps (section 6.5.3).
• Point spread functions
Although point spread functions can be created from ray-tracing simulations, a set of ready-made
point spread functions for different off-axis and azimuthal angles, and possibly for different photon
energies, will be provided for convenience.
Point spread functions are necessary when making ARFs (section 6.5.3) and for image analysis such
as image fitting and image deconvolution.
• Files for the ray-tracing simulations
The ray-tracing program (section 5.2.3) requires two calibration files describing the telescope param-
eters, one for reflectivity and the other for geometrical structure of the foils.
7.4.3 XIS
• Time variable XIS calibration files
Variable instrumental parameters required to calculate PI from PHA for building spectral responses
and effective area are written as functions of time. Gain history (pulse-peak of the calibration
source), Charge Transfer Inefficiency (CTI), quantum efficiency and the OBF contamination will be
such examples.4 Positions of the bad pixels and columns may also slowly vary with time. The µ code
database is updated when an observation uses a new CCD clock pattern.
• Time invariant XIS parameter files
Important time invariant XIS parameters such as area of calibration masks and DAC setup are
written.
4 In the case of ASCA SIS, RDD (Residual Dark-current Distribution) and echo parameters are also variable, and time
history of these parameters are also saved in the individual calibration files. RDD should not be present for XIS.
Suzaku PDMP v2.0 (September 27, 2007) 39
7.4.4 HXD
• HXD collimator transmission map
Energy dependent collimator transmission is written as a function of the pointing vectors on the
satellite frame. The direction which gives the maximum transmission becomes the bore-site. This
file will be necessary to make HXD ARFs.
• HXD detector parameter file
Important detector parameters required to build responses are written. These parameters should
include, e.g., dimensions of the GSO crystals, silicon PIN diodes and the detector assembly. This file
will be necessary to make HXD RMFs.
• HXD gain history table (GHT)
History of the energy gain of the PIN, GSO, and WAM detectors are written.
Process to generate GHT: There are two types of GHTs, GHT daily and GHT caldb. GHT daily
is automatically generated with hxdmkgainhist every observation (one file for each detector – PIN,
GSO – per observation, not per FFF) and stored in the Trend Archive. GHT caldb is generated from
GHF daily by the HXD team and stored in CALDB. The task hxdpi calibrates the data with the
latest GHF caldb in any processing. The update intervals are TBD (possibly, ∼1 month).
• HXD background parameter file (TBD)
The HXD background is modeled empirically (section 6.5.3). Model parameters necessary to con-
struct HXD background will be stored in the calibration file.
5. When existing files are updated, the format and keywords must not be changed, except for those
keywords that are associated with a particular release (FILENAME, VERSION etc).
6. When new types of the calibration files are created by the instrument teams, their formats and
keywords must be agreed to between ISAS and HEASARC before being ingested into the CALDB.
7. For each delivery of the calibration files, reason of the new delivery and difference from the previous
version should be explained.
Chapter 8
In this chapter, we describe Suzaku GOF’s primary functions for Guest Observer (GO) support. GOF
focuses its effort on supporting professional astronomers located in the United States who submit Suzaku
proposals and analyze Suzaku data. Suzaku observers in Japan and other countries and the Suzaku archives
users all over the world are also within the scope of the Suzaku GOF support, though their primary contact
should be the Japanese help desk at RIKEN laboratory.
In order to perform the following GO support tasks, Suzaku GOF in cooperation with other groups
under OGIP will develop infrastructures such as software, documents and database systems.
40
Suzaku PDMP v2.0 (September 27, 2007) 41
may make small changes at this stage (e.g., slight change of the roll-angle) consulting GOF advice. Suzaku
GOF conveys the final GO observation plans to ISAS, and the ISAS satellite operation team incorporates
the final plans into the command stream.
42
Suzaku PDMP v2.0 (September 27, 2007) 43
9.2.2 Contents
The outputs of the pipeline processing are immediately delivered to the HEASARC kept encrypted until
the end of the proprietary periods, when the data are decrypted.
The products produced in the pipeline processing will be put in subdirectories of each observation
sequence.
Acronyms
Acronyms often used in the Suzaku project are summarized with their full-names and related items.
DE Digital Electronics
DP Data Processor
44
APPENDIX A. ACRONYMS 45
SI Scientific Instruments
SIB Satellite Information Base
SWG Science Working Group
Here is a guideline by the GSFC FTOOLS team for the programmers developing Suzaku FTOOLS. This
guideline is particularly aimed for Japanese instrument members who are developing in the ANL environ-
ment and going to convert ANL modules into FTOOLS.
• Software
– Source Codes
– Parameter files (default)
– Makefile
– Documents: in plain ASCII text and IRAF “lroff” format.
• Examples:
– Relevant input files and resulted output files.
– Test parameter files or test script.
46
APPENDIX B. FTOOLS DEVELOPERS GUIDELINE 47
• For C or FORTRAN FTOOLS, use the cdummyftool and fdummyftool as templates. They can be
found in src/examples/src in FTOOLS release.
• Subroutine or function name must be unique. This is a requirement of packaging the FTOOLS.
• Do not use the hard-coded “scanf” or command line options to read in the parameter in C or Fortran
codes. Use XPI parameter interface. The routines are documented in pfile.h for the C FTOOLS.
• Do not directly write the message to stdout, use the fcecho or fcerr routines in cFTOOLS and xpi
libraries. Put messages into the stdout directly will prevent the task from being used in a pipeline.
In case the use of fcecho/fcerr is undesirable in the development environment, as a compromise, a
centralized output routine should be used whenever “printf” is necessary.
• Provide the English translations for the important comments written in other languages.
• For handling of FITS files, use cfitsio. Do not try to read/write the files using specialized routines.
• In C FTOOLS, do not use the obsolete fcfitsio routines, which are the wrapped Fortran fitsio routines,
which are the wrapped cfitsio routines.
• Before calling the cfitsio routine, make sure the error status is set to zero, otherwise, the routine
returns immediately.
• After calling the cfitsio routine, make sure that the error status still stays at zero. If not, provide the
error handling and return gracefully.
• CFITSIO routine “ffopen” automatically handles the filename parsing, file existing tests etc. Do not
use any parsing routine or file open routines before ffopen. It can hinder the abilities of cfitsio to
open a network file or compressed file.
• “stderr” should only be used to output critical error messages, since the presence of stderr messages
are used by many scripts as part of the error handling mechanism. This restriction does not apply
to “stdout,” but even this should be used with restraint.
• The Suzaku FTOOLS defines the chatter levels in the softwares from 0 (min) to 5 (max) as does
the Swift package. Each chatter level displays 0: critical error messages only, 1: warning messages,
2 (default): useful information, 3: debugging level 1, 4: debugging level 2, 5: maximum debugging
level.
• Finally, do not try to be fancy and clever, do not reinvent the wheel, and KISS (Keep It Simple,
Stupid).
B.3 Parameters
It is well documented in URL: http://heasarc.gsfc.nasa.gov/ftools/others/pfiles.html
B.4 Makefiles
For FTOOLS development, “hmake” is used, which is a version of the “make” utility developed locally
by the HEASARC. It is not necessary for the developers to write the “hmake” style make file. However,
developers should provide a makefile in one of the popular Unix platforms (OSF, Solaris, SunOS, HPUX,
Linux or SGI, Apple/Darwin). the software and understand the dependencies between modules.
APPENDIX B. FTOOLS DEVELOPERS GUIDELINE 48
B.5 Documents
The help file should be provided in a plain ASCII text file with the extension .txt and a file with the IRAF
“lroff” format and extension .hlp. The “lroff” format is quite similar to the UNIX nroff/troff. You can
find it in any .hlp files in FTOOLS distribution.
The help file should include the following sections:
Legend
========================================
[ ] critical ftools
( ) user data
" " outputs to trend area
** CALDB access
========================================
NOTE: The Common processes MUST be executed before HXD and XIS processings.
-----------------------------------------------------------------------------
Attitude file: aeXXXXXXXXX.att
(Attitude file) --> [aeattcor] --> [aeaspect] --> (New attitude file)
^
|
(orbit file) --+
(common HK file) --’
49
APPENDIX C. FLOW CHART OF THE PIPELINE PROCESSING 50
-----------------------------------------------------------------------------
(WEL FFF) -->
[hxdtime] --> [hxdmkgainhist] --> [hxdpi] --> [hxdgrade] --> (WEL UFF)
** | ** ** **
+--> "aeXXXXXXXXXhxd_0_gso.ghf"
‘--> "aeXXXXXXXXXhxd_0_pin.ghf"
-----------------------------------------------------------------------------
(WAM FFF) -->
[hxdwamtime] --> [hxdmkwamgainhist] --> [hxdwampi] --> ...continue...
** | ^ **
| |
+--> "aeXXXXXXXXXhxd_0_wam.ghf"
-----------------------------------------------------------------------------
XIS hk file: aeXXXXXXXXXxiN_0.hk
(XIS frame FFF) --> [aeaspect] --> [xisucode] --> (XIS frame SFF)
^
|
(New attitude file)
-----------------------------------------------------------------------------
XIS darkframe FFF: aeXXXXXXXXXxiN_n_dfiNN.fff
(XIS event FFF) --> [aeaspect] --> [xisucode] --> [xistime] --> ...continue...
^ ^
| |
(New attitude file) (Tim file)
...--> [xiscoord] --> [xisputpixelquality] --> [xispi] --> (XIS event SFF)
^ ^
APPENDIX C. FLOW CHART OF THE PIPELINE PROCESSING 52
| |
(New attitude file) (XIS hk file)
-----------------------------------------------------------------------------
XIS psum FFF: aeXXXXXXXXXxiN_n_timpMMM.fff
(XIS psum FFF) --> [aeaspect] --> [xisucode] --> [xistime] --> ...continue...
^ ^
| |
(New attitude file) (Tim file)
:
:
• RAW coordinates:
Original digitized values in the telemetry to identify pixels of the events. May not reflect physical
locations of the pixels on the sensor. For example, XIS RAW X and Y coordinates will have values
from 0 to 255 on each Segment1 .
• PPU coordinates:
Coordinates system used for the Dark Frame mode of the XISs. The PPU coordinates add copied
pixels (2 pixels) at the front and back of the RAW X coordinate.
• ACT coordinates:
ACT is defined only for XIS. The ACT X and Y values are defined to represent actual pixel locations
in the CCD chips. ACT XY will take 0 to 1023 to denote the 1024 × 1024 pixels in the chip. The
XIS RAW to ACT conversion depends on the observation modes (such as Window Options) and will
require housekeeping information. The XIS ACT coordinates is defined by looking-down the sensors.
• DET coordinates:
Physical positions of the pixels within each sensor. Misalignments between the sensors are not taken
into account. The DETX/Y coordinates are defined by looking up the sensor, such that the satellite
+Y direction2 becomes the −DETY direction (the same as the ASCA convention). The DET X and
Y values take 1 to 1024 for XIS.
• FOC coordinates:
Focal plane coordinate common to all the sensors in unit of arcmin. Misalignments between the
sensors as well as the difference of the focal length are taken into account so that the FOC images
of different sensors can be superposed. FOC is calculated from DET by linear transformation to
represent the instrumental misalignment, i.e., the offset and the rotation angle, and the focal length
of the XRT. Information of these misalignment and the focal length are written in the teldef files.
• SKY coordinates:
Positions of the events on the sky. The conversion from FOC to SKY is made using the satellite
1 Each of the four XIS sensors has a single CCD chip, and a single chip is divided into four Segments.
2 Satellite Z-axis points the telescope direction, and +Y direction is toward the solar paddle.
53
APPENDIX D. DEFINITION OF THE COORDINATE SYSTEM USED FOR SUZAKU 54
attitude in the attitude file and the alignment matrix (3×3) written in the teldef file. For each XIS
event, the equatorial coordinates of the pixel center projected on a tangential plane are given3 .
In this scheme, it is important that the conversion from RAW to DET does not depend on the mis-
alignments between the sensors. Therefore, DET XY, as well as RAW XY, can be written in the event
FITS files without having the calibration information. The DET to FOC conversion requires information
of the focal length and the misalignment between the sensors. The same routines/functions can be used
for FOC to SKY conversions for different sensors not depending on the individual characteristics.
HXD
Type Minimum Maximum Origin Size of the Pixel
SENSOR Integer 0 15 – –
HXD is not an imaging instrument and will not have coordinate columns. The average pointing direction
may be written in the event FITS file header.
3 There are several projection methods, such as -TAN, -SIN, -ARC and -STG.
See http://www.cv.nrao.edu/fits/documents/wcs/wcs.all.ps for details. The tangential projection (-TAN) is widely used,
and will be adopted for Suzaku event files too.
Bibliography
[1] “The Scientific Satellite Astro-E Interim Report” (“Kagaku Eisei Astro-E Chuukan Houkokusho”),
ISAS, 1998, in Japanese
[2] Serlemitsos, P. J. et al. 1995, PASJ, 47 105
[3] Serlemitsos, P. J. and Soong, Y. 1996, Astrophys. Sp. Sci., 239, 177
55
Index
56
INDEX 57
vignetting map, 31
W3Browse, 42
WebSpec, 21
XSPEC, 21