Difference: CookBook2dfdr (5 vs. 6)

Revision 62007-01-29 - RonHeald

Line: 1 to 1

CookBook for AAOmega data reduction with 2dfdr

AAOmega data is processed using a revised version of the 2dfdr software package. 2dfdr currently has modes which reduce data for a number of instruments including AAOmega with both the 2df and Spiral IFU top ends, 2dF, 6dF, FMOS and the older Spiral. In upgrading the software to work with AAOmega data a number of fundamental changes to the software have been required. At this time, the full 2dfdr manual

Line: 11 to 11

Download the software

2dfdr is rapidly evolving as more is learned about AAOmega data. The high quality of AAOmega spectra, in comparison to what was achievable with the older 2dF spectrograph (which was, it must be stressed, principally designed to record low resolution redshifts of bright galaxies) means that there are many improvements required in the reduction system to do justice to the data recorded with AAOmega. The user should check the ftp site below to ensure they have the every latest version of the software before starting a campaign of data reduction. This rate of evolution will deminish once a small number of outstanding issues are addressed.

Changed:

<
<

The software is only available as a set of binary executables. The system is created with the Starlink software library and cannot be built without a Starlink installation. While this software is not proprietary, we cannot support external builds at this time. With the demise of the Starlink project in 2005, it may become necessary to completely remove the Starlink components in the future.

>
>

The software is only available as a set of binary executables and support files. The system is created with the Starlink software library and cannot be built without a Starlink installation. While this software is not proprietary, we cannot support external builds at this time. With the demise of the Starlink project in 2005, it may become necessary to completely remove the Starlink components in the future.

Changed:

<
<

The executables are currently only available for the RedHat Enterprise3 Linux. This system has been tested and works well under current implementations of RedHat Enterprise4 and most installations of Fedora, Scientific Linux and other popular flavors. Spme problems have been tracked to older Tcl libraries being used. Limited support can be offered for other operating systems. A Solaris version can be made available on request, but due to speed problems is unlikely to receive much use. A version for Mac OSX is not available at this time due to complications with running elements of the Starlink libraries on the Mac.

>
>

The executables are currently only available for the RedHat Enterprise3 Linux. This system has been tested and works well under current implementations of RedHat Enterprise4 and most installations of Fedora, Scientific Linux and other popular flavors. Some problems have been tracked to older Tcl libraries being used. Limited support can be offered for other operating systems. A Solaris version can be made available on request, but due to speed problems is unlikely to receive much use. A version for Mac OSX is not available at this time due to complications with running elements of the Starlink libraries on the Mac.

Download the latest tar file from the FTP site

Line: 22 to 22

Unpack the tar file and to extract the software to your chosen working directory

Changed:

<
<

tar -zxvf 2dfdr-RH3E_060610.tgz

>
>

tar xvzf 2dfdr-RH3E_060610.tgz

Running 2dfdr for AAOmega

Line: 78 to 78

The basic files needed to reduce AAOmega data are:

Changed:

<
<

a multi-fibre flat field exposure (class MFFFF) These exposures are made with a quartz lamp that provides a uniform spectrum. They are used to calibrate the detector, and to find the centre and profile of the spectra.

>
>

a multi-fibre flat field exposure (class MFFFF) These exposures are made with a quartz lamp that provides a uniform spectrum. They are used to calibrate the detector, and to find the centre and profile of each spectra.

an arc exposure (class MFARC) These exposures are made with lamps having various known strong lines. They are used to calibrate the central wavelength and dispersion.

Line: 86 to 86

Additional frames of various types may be needed, depending on the nature of your data. To start the automatic reduction process, hit the Setup button in the upper right hand section of the GUI. The window shown here will appear.

Added:

>
>

Added:

>
>

The automatic data reduction depends on the use of a file naming convention in which the name has a root that is the same for all files. The root name is followed by a four-digit integer run number. Raw data from the AAT conforms to this convention with names of the form 13apr0001.fits, 13apr0002.fits etc . Data from the archive also conforms to the convention though the names are changed to run0001.fts, etc.

Line: 96 to 98

Once Setup has run, the file information will be available in the left Data tab section of the main GUI as shown here.

Added:

>
>

Added:

>
>

Changed:

<
<

Here we see the the first file, Run 1, is file 28jun20001.fits (which is run 1 for ccd2 from 28th June). The file is a Multi-Fibre Fibre Flat Field (MFFFF, please refer to the full manual for an explanation of this insane classification convention). The file is Not Reduced and so there is no Reduced File. We can use the up and down spinner buttons to right of Run. or select a file from the File chooser to cycle through the current available data to view the other files with the same root name in the local directory. If we hit the Plot button below the file information, we can see the 2D image to check that everything looks okay. Note that the full CCD is 2kx4k and so many of the displays you will see during reduction are heavily aliased and will often show strange artifacts which are simply not in the data.

>
>

Here we see the the first file, Run 1, is file 28jun20001.fits (which is run 1 for ccd2 from 28th June). The file is a Multi-Fibre Fibre Flat Field (class MFFFF, please refer to the full manual for an explanation of this insane classification convention). The file is Not Reduced and so there is no Reduced File. We can use the up and down spinner buttons to right of Run. or select a file from the File chooser to cycle through the current available data to view the other files with the same root name in the local directory.

If we hit the Plot button below the file information, we can see the 2D image shown here. It's useful to check that everything looks okay. Note that the full CCD is 2kx4k and so many of the displays you will see during reduction are heavily aliased and will often show strange artifacts which are simply not in the data.

Line: 108 to 114

Reduce the data

Changed:

<
<

The user should now be able to simply hit the Start button, on the upper right of the main GUI, to reduce the data in the current working directory.

>
>

The user should now be able to simply hit the Start button, on the upper right of the main GUI, to reduce the data in the current working directory.

The process runs as follows:

Changed:

<
<

Reduce any and all multi-fibre flat field frame
Reduce any and all arc frame
Re-reduce the flat field frames using the accurate wavelength solution to compute a better average illumination correction

>
>

Reduce any and all multi-fibre flat field frames
Reduce any and all arc frames
Re-reduce the flat field frames using the accurate wavelength solution obtained from the arc frame reduction to compute a better average illumination correction

Reduce any and all science frames
Combine the science frames

Line: 132 to 138

Known problems

Deleted:

<
<

See the current bug list

Release notes: There are two outstanding issues with the new 2dfdr implementation. Both are related to the use of STARLINK libraries and are currently under review.

1. The software will not run correctly if the path to the executables is to long (greater than 40 characters). The error means that 2dfdr will appear to start okay, but on attempting to plot data the system will report that it cannot find the xwindow to display to.

Note for users using Linux: You may have problems trying to reduce data on SUN/Solaris disks running 2dfdr under Linux: 2dfdr may simply fail giving an error message like this: "Task drexec2 has crashed while executing an action" This seems to be a problem related to accessing data over NFS between SUN and Linux machines. We don't have a solution for this, but the workaround is to copy the data to a local Linux disk, and reduce from there.

Changed:

<
<

-- RonHeald - 19 Jan 2007

>
>

-- RonHeald - 29 Jan 2007

META FILEATTACHMENT	attr="" autoattached="1" comment="setup GUI" date="1168487738" name="setup_gui.jpg" path="setup_gui.jpg" size="14515" user="Main.RonHeald" version="1"
META FILEATTACHMENT	attr="" autoattached="1" comment="2dfdr Main GUI" date="1168487622" name="2dfdr_gui.jpg" path="2dfdr_gui.jpg" size="85650" user="Main.RonHeald" version="1"

View topic | History: r8 < r7 < r6 < r5 | More topic actions...