MODIS Atmosphere
MODIS Atmosphere Home Products  Images  Validation  News  Staff  Forum  Reference  Tools  Help
Aerosol Product  Water Vapor Product  Cloud Product  Atmosphere Profile Product  Cloud Mask Product   Joint Atmosphere ProductLevel-2 Products
Daily Global Product  Eight-Day Global Product  Monthly Global ProductLevel-3 Products       Filled Land Surface Albedo ProductFilled Normalized Difference Vegetative Index ProductOne-Minute Land Ecosystem Classification ProductLevel-3 Ancillary Land Surface Products
MOD06_L2
Introduction
Format & Content
Grids & Mapping
Sample Images
QA Information
Product Modification History
Acquiring Data
Filename Convention
Analysis Tools
Theoretical Basis
Validation
Detailed File Spec
Algorithm Software
Production Plan
Support Team

HISTORY

General PGE Information

The MOD06_L2 and MYD06_L2 products are produced from the Program Executable (PGE) identified as PGE06. To determine the current PGE06 version that has completed: 1) baseline procedure, 2) integration & testing, and 3) MODAPS operations implementation, visit the PGE Status Chart. For information on reconciling Algorithm process version and PGE version, visit the PGE06 Version History File.


Tool/Command for PGE Determination

One may identify the maturity and quality of an HDF data product by finding the PGE (program executable) version that was used to produce the file. This information can be obtained directly from the HDF file itself by using the HDF utility ncdump. The (UNIX) command for finding the PGE version that was used to create a particular HDF file is

ncdump -h *.hdf | awk '/PGEVERSIONCLASS/,/END_GROUP/'

One may also find PGE version information in the ascii met (metadata) file associated with a particular HDF file.


PGE06 Algorithm History - Product Impact Changes

PGE06 Version Detail
Product impact changes only
High Impact = High Impact     Moderate Impact = Moderate Impact     Low Impact = Low Impact
(Dates show approximate starting production date)

PGE06 v4.3.0 includes:       ( Aqua Forward & Reprocess [004]: ~01.Jan.2004 )

  • Cloud Top Properties (v4.2.0)
      High Impact Cloud Top Pressure Improvement. Perform check on cloud pressure function to ensure intersection with observed radiance data. Eliminates many spurious high cloud retrievals. This improves the Cloud Top Pressure, as well as the Cloud Top Temperature, parameter.
      High Impact Improved Low Cloud Characterization. Use atmospherically corrected radiance data in the "window channel" method, provides improved results for low clouds especially in moist atmospheres.
      Moderate Impact Increase CO2-slicing retrievals. Lower noise limits (allowable clear vs. cloudy radiance values), which results in more CO2-slicing retrievals.
      Moderate Impact Improved Vertical Resolution. Implement new transmittance model coefficient files at 101 vertical levels. This replaces the prior 42-level coefficient files. This allows for processing at 101 discrete levels, allowing results to be reported at higher vertical resolution.
      Moderate Impact Improved Atmospheric Transmittance Calculation. Improve atmospheric transmittance calculations by adding climatological ozone profiles as input.
  • Cirrus Detection (v4.0.2)
      Low Impact ECS Metadata Change. This version of the Cirrus Detection code is promoted to Aqua Collection 4. The science algorithm is identical to v4.0.1, but the ECS metadata interface is changed to support ingest into Collection 4 (for Aqua).
  • Run Time Scripts
      Low Impact Build and Runtime Changes. Inventory attribute VersionId (the Collection identifier) in the ECS metadata interface was changed from a value of 3 to 4 in all Aqua metadata configuration files (MCFs).


Start of Aqua Collection 004


PGE06 v4.2.6 includes:       ( Terra Forward [004]: ~01.Jan.2004       Aqua Forward: Changes promoted in v4.3.0 )

  • Cloud Optical Properties (v4.2.4)
      High Impact Bad NISE (snow cover extent) Data Checks. The NISE product is made mandatory input to PGE06. Algorithm halts processing and outputs error message when NISE (or Cloud Mask) data is unreadable or missing. The following rule now applies: First, search for data on a 6-day interval centered on the collection period midpoint. If that fails, expand the search to a centered 14-day interval. If that fails, halt processing. Previous versions allowed the Optical Properties algorithm to run if the NISE ancillary data files were corrupted. In this case, the algorithm proceeded as if the NISE data was absent.
  • Cloud Top Properties (v4.0.6)
      Low Impact Bug Fix. A minor bug in the driver routine was fixed. The quotes around argument routine_name in the call to write subroutine message following the set_archive_metadata function were removed.
  • Run Time Scripts
      Low Impact Build and Runtime Changes. 1.) The build script was modified to run under SDPTK (toolkit) 5.2.9v1 and is backward compatible to earlier SDPTK versions. A reference to the HDF5 library is required for successful compilation and linking with the 5.2.9v1 toolkit. 2.) Attribute ProcessingEnvironment was added to the Archive metadata record to identify the computer host and operating system that produced the product. MODAPS (MODIS Adaptive Processing System) currently operates on IRIX and Linux hosts.

PGE06 v4.2.5 includes:       ( Terra Forward: ~07.Jan.2003       Aqua Forward: ~07.Jan.2003 )

  • Cloud Optical Properties (v4.2.3)
      Moderate Impact Cloud Retrieval Processing Path (RPP) Flag Correction. Incorrect setting of the Retrieval Processing Path (RPP) Flag for polar night scenes was identified and effectively eliminated. Previously, polar night scenes were erroneously being flagged as 'clear' (RPP=1) rather than 'not processed' (RPP=0), which had a negative impact on cloud fraction computed at L3. This was corrected by implementing new logic in the retrieval code, which allows handling of the cloud mask bit as 'undetermined'. Now polar night scenes are correctly labeled as 'not processed' (effectively).   (Note: A small problem remains in this version. A thin stripe of "clear" (RPP=1) pixels are still being erroneously set in the immediate vicinity of the polar darkness boundary.)
      Low Impact Water Path Correction. A small number of bad (out of bounds) cloud water path (Water_Path) data points (mostly over the Antarctic) were identified and eliminated. This was done by screening cloud optical thickness data used to calculate the cloud water path. These out of bound values were occurring when out-of-family detectors in the MODIS 1.2 µm band produced anomalous reflectances.
      Low Impact Ancillary Input Removal. The NCEP TOVS ozone (OZ_DAILY) product was removed as ancillary input to MOD_PR06OD.
  • Cloud Top Properties (v4.0.5)
      Moderate Impact Bug Fix. The reference to the NCEP REYNSST product in the ECS InputPointer metadata list was replaced with a pointer to the SEA_ICE product.

PGE06 v4.2.4 includes:       ( Terra Forward: Changes promoted in v4.2.5       Aqua Forward: Changes promoted in v4.2.5 )

  • Cloud Top Properties (v4.0.4)
      Moderate Impact Platform Dependent CO2-Slicing Noise Thresholds. The noise thresholds for CO2-slicing were made platform-dependent (differing values for Aqua vs. Terra). Aqua LW IR radiances are less noisy than for Terra, therefore this adjustment will allow more frequent use of the full CO2-slicing algorithm in Aqua processing. (Note: The Terra values are unchanged.)
      Low Impact Ancillary (NCEP) Input Removal. Access to the NCEP Reynolds sea surface temperature (REYNSST) and TOVS ozone (OZ_DAILY) products was removed from the ancillary data interface as these parameters are not presently used by the cloud top science algorithm.

PGE06 v4.2.3 includes:       ( Terra Forward: Changes promoted in v4.2.5       Aqua Forward: Changes promoted in v4.2.5 )

  • Cloud Optical Properties (v4.2.2)
      Low Impact Ancillary (NCEP) Input Changes. 1.) The Reynolds sea surface temperature file (REYNSST) can now be accessed in either the original ascii format or the new binary format. (NCEP plans to cease production of the ascii format in January 2003.) 2.) Requests for NCEP grib products (GDAS_0ZF, OZ_DAILY and SEA_ICE) are now made by separate calls for each product rather than a single call for all three. This removes a longstanding issue with the grib reader which had required access to all three grib products even if only one or two were actually needed by the science algorithm. 3.) The status of the tovs ozone (OZ_DAILY) product was changed from required input to optional.
  • Cloud Top Properties (v4.0.3)
      Low Impact Ancillary (NCEP) Input Changes. 1.) The Reynolds sea surface temperature file (REYNSST) can now be accessed in either the original ascii format or the new binary format. (NCEP plans to cease production of the ascii format in January 2003.) 2.) Requests for NCEP grib products (GDAS_0ZF, OZ_DAILY and SEA_ICE) are now made by separate calls for desired products rather than a single call for all three at once. This removes a longstanding issue with the grib reader which had required access to all three products even if only one or two were actually needed by the science algorithm.

PGE06 v4.2.2 includes:       ( Terra Forward: ~20.Nov.2002       Aqua Forward: Changes promoted in v4.2.5 )
                                * Note that this version was used to reprocess all the Terra data back to the start of the forward stream (11/1/02).
                                  Also, inadvertently, this version was not promoted into Aqua operations; changes related to this version were not promoted into Aqua operations until the v4.2.5 promotion.

  • Cloud Optical Properties (v4.2.1)
      Moderate Impact Sunglint Pixel Elimination. Activated sunglint test to help eliminate pixels in oceanic sunglint contaminated regions from being erroneously processed as clouds.
      Low Impact Cloud Temperature Units Bug Fix. Corrected a bug in the units specification of cloud top temperature in the cloud retrieval algorithm.
      Low Impact Library Numerical Instability Fix. Updated forward model libraries to correct a small random error in the data due to a numerical instability problem.

PGE06 v4.2.1 includes:       ( Terra Forward: ~10.Nov.2002       Aqua Forward: ~10.Nov.2002 )

  • Shared Source Code - UW (v4.0.3)
      Low Impact Local Attribute (long_name) Change. The long_name local attribute was updated for several cloud optical parameters: Cloud_Optical_Thickness, Effective_Particle_Radius, Effective_Radius_Difference, and Water_Path.

PGE06 v4.2.0 includes:       ( Terra Forward: ~04.Nov.2002       Aqua Forward: ~04.Nov.2002 )

  • Cloud Optical Properties (v4.2.0)
      High Impact Above-Cloud Atmosphere Emission Correction Improvement. Added a new ancillary data package module for above-cloud mean temperature by weighting by the corresponding atmospheric water vapor profile as originally intended. This improved the above-cloud atmospheric emission in the 3.7 and 11 µm bands.
      High Impact Cloud Effective Radius Improvement. Made numerous science corrections and improvements to produce more realistic 3.7 µm cloud effective radius retrievals, which were often failing for ice clouds prior to these improvements. The new ice library addresses discontinuities in single scattering albedo in moving from one set of crystal habits to another. These are now smoothed permitting the retrieval code to finish successfully for the vast majority of ice cloud pixels.
      Moderate Impact New Solar Irradiance. Incorporated a new 3.7 µm solar irradiance value (11.297 W m-2 µm-1).
      Moderate Impact Brightness Temperature Calculation Improvement. Added a new band weighted Planck brightness temperature calculation for the 3.7 and 11 µm wavelength bands. The new routine includes the latest instrument calibration information.
      Moderate Impact Cloud Phase Determination Improvement. Implemented a correction to the cloud phase determination logic. The phase decision routine now includes separate thresholds for ice/snow covered surfaces.
      Moderate Impact Cloud Retrieval Processing Path (RPP) Flag Correction. Fixed the Retrieval Processing Path algorithm by defining three new "failed" categories (5, 6, & 7) and correctly assigning the flags in all categories. The newly defined RPP Flags are: 0="Fill", 1="Clear/Stop", 2="Successful Water Cloud Retrieval", 3="Successful Ice Cloud Retrieval", 4="Successful Undetermined Phase Cloud Retrieval", 5="Failed Water Cloud Retrieval", 6="Failed Ice Cloud Retrieval", 7="Failed Undetermined Phase Cloud Retrieval". In previous versions, both the failed and successful retrievals were assigned to the successful category, which had a negative impact on the Cloud Fraction statistics in L3.
      Moderate Impact Cloud Retrieval Confidence QA Bug Fix. Some problems in the new confidence QA setting code from v4.1.0 have been isolated and fixed. QA are now set properly.
      Low Impact Transmittance Correction Smoothing. Performed bilinear smoothing of the transmittance correction data for each wavelength.
      Low Impact Water and Ice Library Improvement. Updated the water (Library_05x_water) and ice (Library_05x_ice) library files - identified now as v2.
  • Cloud Top Properties (v4.0.2)
      High Impact Cloud Top Pressure Improvement. Fixed code bug to allow proper specification of moisture profiles from input GDAS data, which improves the accuracy of cloud pressure retrievals for mid- and high-level clouds.
  • Cirrus Detection (v4.0.1)
      High Impact Cirrus Detection & Cirrus Reflectance Calculation Improvement. Improved cirrus detection by raising the threshold for identifying cirrus clouds in the 1.375µm channel to compensate for the MODIS 1.375µm channel receiving a small amount of energy (crosstalk) from other MODIS channels. The cirrus reflectance product was improved by raising the threshold parameter "cirrus_refl_min" from 0.005 to 0.010.

PGE06 v4.1.1 includes:       ( Terra Forward: Changes promoted in v4.2.0       Aqua Forward: ~05.Sep.2002 )

  • Cloud Optical Properties (v4.1.1)
      High Impact Ice Retrieval Bug Fix. The (hardwired) ice radii index (the number of radii in the forward calculation lookup tables) was corrected from 15 to 12. The previous incorrect value of 15 caused anomalous ice library interpolations and many failed ice retrievals.

PGE06 v4.1.0 includes:       ( Terra Forward: Changes promoted in v4.2.0       Aqua Forward: Changes promoted in v4.1.1 )

  • Cloud Optical Properties (v4.1.0)
      High Impact Thermodynamic Phase Test Reduces Undetermined Phase Cloud Retrievals. A bispectral threshold test (Baum), shortwave infrared tests (Riédi), and cloud top temperature sanity checks (e.g., water clouds for cloud top temperature > 273 K) were added to the cloud phase discrimination algorithm. Far fewer cloudy pixels are now labeled 'undetermined' and the confidence in the detection of ice cloud and water cloud pixels is greatly increased. Click for Confidence QA Plot Detail
      Moderate Impact Cloud Retrieval Confidence QA Implementation. Developed a Confidence Flag for the Cloud Retrieval algorithm using four quality settings: 0="Fill or No Confidence", 1="Marginal Confidence", 2="Good Confidence", 3="Very Good Confidence". The Level 3 gridded calculations use these flags to give less weight to lower confidence retrievals. Confidence assignments are based on the proximity of the optical thickness and effective radius solution to the limits of the solution space inherent in the forward model lookup tables. Click on thumbnail, right, for detail. Note that in previous versions, all retrievals had a quality flag of 3 (very good) assigned by default.
      Moderate Impact Single Scattering Albedo Threshold Correction. The single scattering albedo threshold was not set consistently between the forward model code and the retrieval code, which resulted in reduction in the frequency of optical thickness retrievals in a narrow range (~13 for water, ~7 for ice clouds). Retrievals now correctly distinguish between the conservative and non-conservative calculation of optical thickness at the beginning of the retrieval.
      Moderate Impact 30 µm Liquid Water Cloud Effective Radius Set to Fill. Retrievals that hit the limit of the water libraries (30 µm) are caught as outliers and set to the fill value.
      Moderate Impact Higher Resolution IGBP Surface Type Map. A new higher resolution version of the IGBP surface type map was implemented. Surface albedo is substantially improved in resolution and accuracy.
      Low Impact Hierarchical Data Format (HDF) Lookup Tables. Forward model lookup tables were converted to consistently documented HDF files, allowing a greatly simplified reading interface.
  • Cloud Top Properties (v4.0.1)
      Moderate ImpactCO2-Slicing Confidence Flag Set to 3. Hardwired the CO2-slicing confidence flag to 3 (highest quality), which was deemed necessary for Level 3 statistical calculations to be done properly.
  • Shared Source Code - UW (v4.0.2)
      Moderate Impact Invert Dimensions in Effective_Radius_Difference Array. Module was revised to mirror changes in the MODIS Cloud Product. The 1st and 3rd dimension of the Effective_Radius_Difference array were switched. This allows subsetting of the radius difference by band (relative to 2.1).

PGE06 v4.0.0 includes:       ( Terra Forward: Changes promoted in v4.2.0       Aqua Forward: ~24.Jun.2002 )

  • Cloud Optical Properties (v4.0.0)
      Low Impact Local Attribute "scale_factor" Change. Changed the scale_factor local attribute from 0.1 to 0.01 for Cloud_Optical_Thickness, Effective_Particle_Radius, and Effective_Radius_Difference. This provides more significant digits in the output arrays.
      Low Impact Conflict Exit. Retrieval now exits when there is an apparent conflict between IGBP and NISE data
      Low Impact Fine Changes to Library Files. All 16 flux and reflectance library files and the algorithm control file were updated with fine changes. The library files were also renamed to accurately reflect their contents.


Start of Terra Collection 004 Start of Aqua Collection 003


PGE06 v3.2.0 includes:       ( Terra Forward: ~01.Apr.2002 )

  • Cloud Top Properties (v3.1.0)
      Moderate Impact Transmittance Profile Coefficient Update. Added transmittance profile coefficients for Aqua and updated those for Terra. Profiles now have 42 levels instead of 40.
      Moderate Impact Response Function Update. Added response functions for the new Aqua channels, updated response functions for Terra.
      Moderate Impact Fewer Missing Retrievals From Mixing Ratio Check Update. Modified the check on mixing ratio values from ancillary data. This results in many fewer missing values of cloud top pressure and cloud effective emissivity.
      Moderate Impact Invalid Cloud Mask - Bug Fix. Pixels with invalid cloud mask results will now be listed as "missing" instead of "clear".

PGE06 v3.1.0 includes:       ( Terra Forward: ~01.Jan.2002 )

  • Cirrus Detection (v3.1.0)
      Moderate Impact Above-Cloud Water Vapor Transmittance Estimate Improvement. A new algorithm using a one-slope approach to estimate the transmittance of water vapor above cirrus clouds was implemented. This contrasts with previous versions in which a less accurate three-slope procedure was used.
      Moderate Impact Contrail Parameters - Set To Fill. All contrail-related parameters are no longer computed.

PGE06 v3.0.5 includes:       ( Terra Forward: ~15.Nov.2001 )

  • Cloud Optical Properties (v3.0.5)
      Moderate ImpactBug Fix - Band/Albedo Sanity Checking. Corrected the band/albedo sanity checking logic, which permitted 1.24µm retrievals over snow and sea ice.
      Moderate Impact Bug Fix - QA Array Dimension. Corrected the QA array dimension from 2D to 3D.
      Moderate Impact Bug Fix - Total Precipitable Water Units Correction. Corrected the units specification for the above-cloud total precipitable water calculation.

PGE06 v3.0.1 includes:       ( Terra Forward: ~01.July.2001 )

  • Cloud Optical Properties (v3.0.1)
      Moderate ImpactBug Fixes. The following bug fixes were made: 1.) corrected sds read error in an ancillary input land surface temperature sds, 2.) corrected the order of the dimension arguments passed to transmittance subroutine, and 3.) corrected the units of cosine angle argument.

PGE06 v3.0.0 includes:       ( Terra Forward: ~15.June.2001 )

  • Cloud Optical Properties (v3.0.0)
      High ImpactAtmospheric Water Vapor Correction . Added an atmospheric water vapor correction algorithm. This is based on a lookup table derived from model calculations. Currently this algorithm corrected transmittances for bands up to 3.7 µm (2 way transmittances for the visible bands and 1 and 2 way transmittances for 3.7µm).
      High ImpactNew Water and Ice Libraries. Using new water and ice library calculations generated from code by P. Soulen and P. Yang. The new water libraries use a different set of effective radii, as well as measured MODIS RSR's.
      Moderate ImpactNew Final Retrieval Solution Interpolation. Completely replaced the final solution interpolation in the retrieval algorithm. The previous scheme interpolated on the square of the Measurement-Library residual. This was found to be demonstrably inacccurate. The new scheme interpolates on the values of the residual and attempts to exit gracefully and set a fill value if the residual curve has an unphysical profile.
      Moderate ImpactBug Fix - Ancillary Data. Corrected the assignment of ancillary data to the ancillary data arrays. Previously these arrays were copied incorrectly from the temporary HDF file, so that some lines of the data were corrupted.
      Moderate ImpactBug Fix - Failed Solution Set To Fill. Corrected a logical error where failed solutions would result in an initialized array number output as the solution. Such values are now correctly set to the fill value.
      Moderate ImpactBug Fix - Sea Ice Reflectances. Added code to use snow/ice bits correctly. Code now uses the snow/ice percentage to weight the reflectance for sea ice.
      Moderate ImpactBug Fix - Clear Pixels Not Processed. Removed a Cloud Mask test that could return a decision to process a pixel as cirrus cloud (ice) when the cloud mask determines that the pixel is clear. Such pixels are now left as clear pixels.
      Moderate ImpactMOD12 Ecosystem Map Update. IGBP ecosystem map updated with MOD12 ecosystem map (continue to use CERES tundra classification, NISE snow/ice classifications).
      Moderate ImpactMODIS "White Sky" Albedos. CERES albedos replaced by November 2000 MOD43 "white sky" albedos aggregated versus ecosystem. Tropical albedos have no seasonal dependence. Seasonal dependencies added poleward of 30 degrees (sinusoid). A linear interpolation between 20 and 30 degrees is used (excluding desert ecosystem).
  • Cirrus Detection (v3.0.0)
      Moderate ImpactSmall Reflectance Cutoff. Applied the cutoff of small-reflectance pixels at 0.03. This substantially improves some cases in polar regions. Also modified the algorithm to remove the "long tail" in 1.38-0.66µm scatter plot.


Start of Terra Collection 003


Next Page
DATA