Logged in as guest
Viewing Data/17410 Full headers
Private message: yes no
Notes: JRM and MG contacted (ME: 23-Mar-2005) ODF to be re-processed; info to be provided to user after evaluation closed 31-Mar-2005 Notification:
Date: Wed, 23 Mar 2005 12:32:55 GMT From: cocj@roe.ac.uk To: xmmhelp@xmm.vilspa.esa.es Subject: evselect gives null images, as in pipeline data
Name: Olivia Johnson Email_Address: cocj@roe.ac.uk Topic: data products Other_Topic: missing attitude data? Usage_Mode: command line SAS_Release: xmmsas_20040318_1831 - aka 6.0.0 Task_Version: evselect-3.58.1 & eexpmap-3.37.2 Type: report a showstopper Title: evselect gives null images, as in pipeline data Description: If you look at the pipeline products for Observation 0201330201, you'll notice there are no images. I've just rerun emchain and epchain on this data, but have come up with the same problem. My filtered event lists look fine (i.e.I can plot the X and Y columns in fv and see sources) and evselect runs with no errors, but returns an image will all 0 values. This happens for both PN and MOS exposures. I wonder if it might have to do with missing attitude data, as I got these warnings while running the chains: * atthkgen: warning (TemporalOverlapInAHF), Temporal overlap of 0.039978s between AHF entries 729 (2004-12-30T10:42:50.000) and 730 (2004-12-30T10:59:38.000) - adjusting duration of entry 729 accordingly ** atthkgen: warning (NoAttitude), The attitude was requested for time 220753105.184 which is more than 20 s outside the period for which the attitude is known (closest time is 21 s away). Suggestions? Thanks. Operating_System: other Other_Operating_System: Debian Instrument: Data_Type: imaging Observation_Identifier: 0201330201 Exposure_Identifier: S001, S002, S003 Private: Submitted_From: 195.194.120.18 (195.194.120.18) Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.0.2) Gecko/20030208 Netscape/7.02 Referer: http://xmm.vilspa.esa.es/external/xmm_user_support/helpdesk_or_frame.shtml Identify:
From: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es> To: cocj@roe.ac.uk Subject: Re: evselect gives null images, as in pipeline data (PR#17410) Date: Wed Mar 23 16:54:01 2005
Dear Olivia Johnson, I am just processing the data here myself to check the warning messages. The fact that also the pipeline processing at SSC could not generate any reasonable sky images makes me think that there probably is a problem already with the ODF (raw data). I have therefore contacted our ODF expert with your report. Due to the Easter holidays a response will have some delay unfortunately. We will keep you posted. Kind regards, Matthias -- Dr Matthias Ehle XMM-Newton User Support Group European Space Astronomy Centre
From: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es> To: cocj@roe.ac.uk Subject: Re: evselect gives null images, as in pipeline data (PR#17410) Date: Mon Mar 28 15:07:58 2005
Dear Olivia Johnson, please find attached below now results of the analysis by our ODF expert: There is no problem with "evselect" (the OR has to be rejected as such), but with the data. A request to reprocess the ODF had already been submitted on February 3, 2005, to (verbatim) "recover missing science files". Once the reprocessed data are validated, it will be decided whether this ODF is sent to SSC for new pipeline processing, or the observation needs to be repeated. We will inform you at that point. Kind regards, Matthias
Date: Mon, 28 Mar 2005 16:11:17 +0100 (BST) From: Olivia Johnson <cocj@roe.ac.uk> Subject: Re: evselect gives null images, as in pipeline data (PR#17410) To: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es>
OK, thanks very much. If the observation does not need to be repeated, would it be possible for you to pass along the validated ODF to me? I always reprocess XMM data from the ODF stage, so would not need to wait for the SSC processing. Thanks again, -Olivia On Mon, 28 Mar 2005, Matthias Ehle wrote: > Dear Olivia Johnson, > > please find attached below now results of the analysis by our ODF expert: > > There is no problem with "evselect" (the OR has to be rejected as such), but > with the data. A request to reprocess the ODF had already been submitted on > February 3, 2005, to (verbatim) "recover missing science files". Once the > reprocessed data are validated, it will be decided whether this ODF is sent to > SSC for new pipeline processing, or the observation needs to be repeated. > > We will inform you at that point. > > Kind regards, > Matthias >
From: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es> To: cocj@roe.ac.uk Subject: Re: evselect gives null images, as in pipeline data (PR#17410) Date: Mon Mar 28 15:22:56 2005
Hi Olivia, I will let you know as soon as I get any news about the newly generated ODF. Cheers, Matthias
From: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es> To: cocj@roe.ac.uk Subject: Re: evselect gives null images, as in pipeline data (PR#17410) Date: Thu Mar 31 15:10:54 2005
Dear Olivia, the ODF expert just informed me: "Version 3 of ODF 0926_0201330201 has been fixed and is currently being delivered to XSA and SSC" (for pipeline processing). I checked and see that this ODF is already avaialble in the XSA archive. Althought the products (of course) are not yet updated, you might want to download the new ODF version 3 to re-process the data yourself. (BTW the version is given in the *SUM.ASC ODF file - look for "ODF_VERSION") Kind regards, Matthias
Date: Thu, 31 Mar 2005 16:31:12 +0100 (BST) From: Olivia Johnson <cocj@roe.ac.uk> Subject: Re: evselect gives null images, as in pipeline data (PR#17410) To: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es>
Fantastic, that was much quicker than I'd expected! Thanks very much for your help. -olivai On Thu, 31 Mar 2005, Matthias Ehle wrote: > Dear Olivia, > > the ODF expert just informed me: > "Version 3 of ODF 0926_0201330201 has been fixed and is currently being > delivered to XSA and SSC" (for pipeline processing). > > I checked and see that this ODF is already avaialble in the XSA archive. > Althought the products (of course) are not yet updated, you might want > to download the new ODF version 3 to re-process the data yourself. > (BTW the version is given in the *SUM.ASC ODF file - look for "ODF_VERSION") > > Kind regards, > Matthias > >
Date: Thu, 31 Mar 2005 17:59:16 +0100 (BST) From: Olivia Johnson <cocj@roe.ac.uk> Subject: Re: evselect gives null images, as in pipeline data (PR#17410) To: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es>
Hi once again, I am not able to retrieve the dataset from the XSA because it is still in its proprietary period and I am not the PI. Will the PI be able to retrieve it from there? If not, is there any other way we can get our hands on it before it filters through the SSC? Thanks again, -olivia On Thu, 31 Mar 2005, Matthias Ehle wrote: > Dear Olivia, > > the ODF expert just informed me: > "Version 3 of ODF 0926_0201330201 has been fixed and is currently being > delivered to XSA and SSC" (for pipeline processing). > > I checked and see that this ODF is already avaialble in the XSA archive. > Althought the products (of course) are not yet updated, you might want > to download the new ODF version 3 to re-process the data yourself. > (BTW the version is given in the *SUM.ASC ODF file - look for "ODF_VERSION") > > Kind regards, > Matthias > >
From: Matthias Ehle <xmmhelp@xmm.vilspa.esa.es> To: cocj@roe.ac.uk Subject: Re: evselect gives null images, as in pipeline data (PR#17410) Date: Fri Apr 1 08:00:12 2005
Hi Olivia, as soon as pipeline products for a specific observation arrive in the XSA archive, the PI get's an automatic notification e-mail with all the details on how to download the data. This must have happened in the past for the ObsId we are talking about already as the data had been processed previously. So, yes, you will need to use the PI's dedicated account and password to retrieve the new and re-created ODF. Cheers, Matthias