Thursday, April 24, 2008

Status April 24

The three streams are holding at the end of their spin up periods. Some refinements are being made to the budget output diagnostics for better closure. We have also been reviewing our input data holdings. A gap in the PAOB data set was found from 1997 through the end of 2000. The PAOB data starts back up in 2001 through our CDAS input data stream.

After checking this issue with Jack Woolen at NCEP, we found that he had just finished preparing revised PAOB data set (including about 4x more data) from 1985-2000 using JRA25 and ERA40's data holdings. In short, we are aiming to implement these data (many thanks to Jack, and counterparts at JMA and ECMWF). So, the restarts will be delays a few days to test this implementation.

For further information on PAOB, see http://www.bom.gov.au/bmrc/basic/wksp16/papers/Seaman.pdf

A consistent positive impact from the PAOB data suggests that this is worth a couple days to put into the system.

Friday, April 18, 2008

Status April 18 - Rewind

The data drop reported in the last status posting prompted some deeper digging in the input data streams. One issue led to another, then another. Briefly, a bug fix that should have been zero difference actually caused double counting in some of the input data streams, affecting the 1979 and 1989 streams. Further, a resource file had incorrect settings in the 1998 stream, leading to several observation systems not being assimilated.

The net result is that the data cannot be used as expected, and almost all the production processing needs to be re-run. The estimate for getting production restarted is Wednesday Apr 23. In addition, these errors have exposed some blind spots in our monitoring routines and adjustments are being made, and more personnel time is being devoted to monitoring.

Tuesday, April 15, 2008

Status Apr 15

Over the past weekend, Sondes dropped out for a day (mid-Oct 1979) from the data stream (they exist, but the something in the computing environment skipped a beat). So, on Monday AM 4/14, the 1979 stream was backed up to the previous restart before the data drop, and restarted. The monitoring team is looking for issues like this routinely.

Checkout the revised Production Progress web page. Updated regularly with the current day that is being produced.

http://gmao.gsfc.nasa.gov/research/merra/progress-events.php

Friday, April 11, 2008

Status Apr 11 - Long

There has been much going on, and a lot keeping me from these updates, unfortunately. There are several items I'll include here.

First, our late 90's "scout run" (2 degree resolution, same system as MERRA) was running well ahead of the reanalysis, but encountered a problem in a single file of MSU data. There was a corruption in the input file. it has been found and corrected. That's the benefit of these coars scout runs, they should find the problems that would otherwise slow down the processing.

The system had been running at just over 10 days per calendar day for some time. However, we have been only getting ~7 days per day lately. It's a technical problem that the computer folks are working. It basically comes down to increased usage on the machine, affecting the MERRA jobs. People are looking at it, to try to get the performance back up.

We have a monitoring routine established. Some climate maps are being inspected each month of reanalysis. (Some examples posted below) Soon we hope to make those available on the internet. The monitoring code also includes range checking on each and every variable and layer produced by the system. We have some hits in the range checking from variables SHLAND (land only sensible heat flux) and TSTAR (surface layer temperature scale). TSTAR seems to be spiking sporadically, but in conditions with low wind speed and near the change from night to day (stable to unstable) conditions. It does not appear to be a severe problem, there is no plan to stop or back up MERRA for these flags. SHLAND is showing range check errors at a few, very repeatable points. Those are where the fraction of land is much smaller than that for ocean. So, it appears that ocean is driving a surface atmosphere that is causing convergence problems in the land parameterization where the fraction of land is small. For example dry soil with a dominantly tropical ocean point. So far, the grid average sensible heat seems reasonable, so there is no immediate plans to correct this, or stop and rewind MERRA.

Range checking has also found occasional occurrences of shortwave radiation diagnostics are reporting negative numbers. The magnitude is very very small, and the result of roundoff in the interpolation, and not protecting against such negative values. The net effect of these should be extremely small, but may trip code that expects perfectly zero values of shortwave radiation components. Users will be advised to clear such negative values.

A systematic difference from other reanalyses has been occurring monthly and in each season. Below the zonal specific humidity and 850mb map of specific humidity compared to ERA40 in JJA 1979 is attached. These biases were noted in validation. The contour interval is small and the range close. The MERRA data is dry in the tropics at 85omb and wet above 700mb. This is an interesting result, considering that the total column water and precipitation have been very well reproduced.

There's more to come, including online access to figures that the GMAO is using for monitoring.

Zonal mean specific humidity for JJA 1979 compared to ERA40.
850 mb Specific Humidity for July 1979 compared to ERA40.
Global Precipitation difference of existing long reanalyses compared to GPCP (CMAP differences included for reference) for July 1979.