GeoEco.DataProducts.NASA.PODAAC.GHRSSTLevel4.CreateArcGISRasters

classmethod GHRSSTLevel4.CreateArcGISRasters(username, password, shortName, variableName, outputWorkspace, mode='add', rotationOffset=None, spatialExtent=None, startDate=None, endDate=None, datasetType='netcdf', timeout=60, maxRetryTime=300, cacheDirectory=None, metadataCacheLifetime=86400.0, rasterExtension='.img', rasterNameExpressions=None, convertToCelsius=True, useUnscaledData=False, calculateStatistics=True, buildRAT=False, buildPyramids=False)

Creates rasters for a GHRSST Level 4 product published by NASA JPL PO.DAAC.

The Group for High-Resolution Sea Surface Temperature (GHRSST) provides a new generation of global high-resolution (<10km) SST products to the operational oceanographic, meteorological, climate and general scientific community. The overall aim of the GHRSST is to provide the best quality sea surface temperature data for applications in short, medium and decadal/climate time scales in the most cost effective and efficient manner through international collaboration and scientific innovation.

This tool accesses Level 4 (L4) gap-free gridded SST products published in near real-time by the GHRSST Global Data Assembly Center (GDAC) at the NASA JPL Physical Oceanography Distributed Active Archive Center (PO.DAAC) and subsequently hosted and distributed by NASA Earthdata. These products provide regional and global daily cloud-free estimates of SST at spatial resolutions ranging from 0.25 degrees to down 1 km. To fill in cloudy areas, data from multiple satellite and in-situ sensors are combined and regions without any data are filled in various interpolation and modeling techniques.

All products accessed by this tool are published at a daily timestep. Some products are updated on a continual basis and available in near real time; others are updated infrequently and are intended mainly for historical analysis. The temporal extent, spatial resolution and extent, and sensors and interpolation technique used vary by product. All products use the WGS 1984 geographic coordinate system. GHRSST temperatures are published in kelvin. By default, this tool converts them to degrees Celsius but provides an option to obtain the original kelvin values.

This tool supports many but not all of the GHRSST L4 published by PO.DAAC. If you see a GHRSST L4 product on PO.DAAC that is not available with this tool, please contact the MGET development team for assistance.

Please see these instructions on how to acknowledge your use of PO.DAAC products.

Requires: ArcGIS Pro 3.2.0 or later or ArcGIS Server equivalent to ArcGIS Pro 3.2.0 or later, Python numpy module, Python requests module, Python netCDF4 module.

Parameters:

  • username (str) – NASA Earthdata account user name. Minimum length꞉ 1.

  • password (str) – NASA Earthdata account password. Minimum length꞉ 1.

  • shortName (str) –

    PO.DAAC Short Name of the GHRSST L4 product to access. Currently, the following products are supported:

    All products use the WGS 1984 geographic coordinate system and are published at a daily time-step. Some products are updated on a continual basis and available in near real time; others are updated infrequently and are intended mainly for historical analysis. The temporal extent, spatial resolution and extent, sensors and, interpolation technique used vary by product. Please see the products’ documentation for details.

    This tool supports many but not all of the GHRSST L4 products published by PO.DAAC. If you see a product on PO.DAAC that is not available with this tool, please contact the MGET development team for assistance.

    Allowed values꞉ 'AVHRR_OI-NCEI-L4-GLOB-v2.0', 'AVHRR_OI-NCEI-L4-GLOB-v2.1', 'CMC0.1deg-CMC-L4-GLOB-v3.0', 'CMC0.2deg-CMC-L4-GLOB-v2.0', 'DMI_OI-DMI-L4-GLOB-v1.0', 'GAMSSA_28km-ABOM-L4-GLOB-v01', 'Geo_Polar_Blended-OSPO-L4-GLOB-v1.0', 'Geo_Polar_Blended_Night-OSPO-L4-GLOB-v1.0', 'K10_SST-NAVO-L4-GLOB-v01', 'MUR-JPL-L4-GLOB-v4.1', 'MUR25-JPL-L4-GLOB-v04.2', 'MW_IR_OI-REMSS-L4-GLOB-v5.0', 'MW_IR_OI-REMSS-L4-GLOB-v5.1', 'MW_OI-REMSS-L4-GLOB-v5.0', 'MW_OI-REMSS-L4-GLOB-v5.1', 'OISST_HR_NRT-GOS-L4-BLK-v2.0', 'OISST_HR_NRT-GOS-L4-MED-v2.0', 'OISST_UHR_NRT-GOS-L4-BLK-v2.0', 'OISST_UHR_NRT-GOS-L4-MED-v2.0', 'OSTIA-UKMO-L4-GLOB-REP-v2.0', 'OSTIA-UKMO-L4-GLOB-v2.0', 'RAMSSA_09km-ABOM-L4-AUS-v01'. Case sensitive.

  • variableName (str) –

    GHRSST variable to access, one of:

    • analysed_sst - product-specific estimate of SST.

    • analysis_error - product-specific estimate of of the error in the SST estimate.

    Please see the product documentation for details about what these variables mean and how they were calculated. These variable names are case-sensitive.

    Allowed values꞉ 'analysed_sst', 'analysis_error'. Case sensitive.

  • outputWorkspace (str) – Directory or geodatabase to receive the rasters. Unless you have a specific reason to store the rasters in a geodatabase, we recommend you store them in a directory because it will be faster and allow the rasters to be organized in a tree. The tree structure and raster names will be generated automatically unless you provide a value for the Raster Name Expressions parameter. Minimum length꞉ 1.

  • mode (str, optional) –

    Overwrite mode, one of:

    • Add - create rasters that do not exist and skip those that already exist. This is the default.

    • Replace - create rasters that do not exist and overwrite those that already exist.

    The ArcGIS Overwrite Output environment setting has no effect on this tool. If ‘Replace’ is selected the rasters will be overwritten, regardless of the ArcGIS Overwrite Output setting.

    Allowed values꞉ 'Add', 'Replace'.

  • rotationOffset (float, optional) – Degrees to rotate the outputs about the polar axis. This parameter may only be used for global products. The outputs can only be rotated in whole cells. The value you provide will be rounded off to the closest cell. The value may be positive or negative.

  • spatialExtent (str, optional) – Spatial extent of the outputs, in degrees. This parameter is applied after the rotation parameter and uses coordinates that result after rotation. The outputs can only be clipped in whole grid cells. The values you provide will be rounded off to the closest cell. Minimum length꞉ 1. Must match regular expression꞉ ([-+]?[0-9]*\.?[0-9]+([eE][-+]?[0-9]+)?)\s+([-+]?[0-9]*\.?[0-9]+([eE][-+]?[0-9]+)?)\s+([-+]?[0-9]*\.?[0-9]+([eE][-+]?[0-9]+)?)\s+([-+]?[0-9]*\.?[0-9]+([eE][-+]?[0-9]+)?).

  • startDate (datetime, optional) – Start date for the outputs to create. Outputs will be created for images that occur on or after the start date and on or before the end date. If you do not provide a start date, the date of the first available time slice will be used.

  • endDate (datetime, optional) – End date for the outputs to create. Outputs will be created for images that occur on or after the start date and on or before the end date. If you do not specify an end date, the date of the most recent time slice will be used.

  • datasetType (str, optional) –

    Dataset type to access. Currently only netCDF is supported. netCDF files will be downloaded and cached locally. If you specify a Cache Directory, they will be stored there and not deleted. Otherwise a temporary directory will be created to hold the files while the download is in progress and deleted when the relevent data are extracted and execution is complete.

    The disadvantage with this approach is that when your study area is small and you’re accessing a global product, a lot of bandwidth and disk space is wasted. This problem can become acute if you’re accessing a global product with very high resolution, such as one of the 1 km resolution datasets. If this proves too problematic, contact the MGET development team for assistance. We may be able to implement an alternative access method that allows downloads to be limited to a geographic bounding box.

    Allowed values꞉ 'netCDF'.

  • timeout (int, optional) –

    Number of seconds to wait for the server to respond before failing with a timeout error.

    If you also provide a Maximum Retry Time and it is larger than the timeout value, the failed request will be retried automatically (with the same timeout value) until it succeeds or the Maximum Retry Time has elapsed.

    If you receive a timeout error you should investigate the server to determine if it is malfunctioning or just slow. Check the Earthdata website to see if NASA has posted a notice about the problem, or contact the NASA directly. If the server just slow, increase the timeout value to a larger number, to give the server more time to respond.

    Minimum value꞉ 1.

  • maxRetryTime (int, optional) –

    Number of seconds to retry requests to the server before giving up.

    Use this parameter to cope with transient failures. For example, you may find that the server is rebooted nightly during a maintenance cycle. If you start a long running operation and want it to run overnight without failing, set the maximum retry time to a duration that is longer than the time that the server is offline during the maintenance cycle.

    To maximize performance while minimizing load during failure situations, retries are scheduled with progressive delays:

    • The first retry is issued immediately.

    • Then, so long as fewer than 10 seconds have elapsed since the original request was issued, retries are issued every second.

    • After that, retries are issued every 30 seconds until the maximum retry time is reached or the request succeeds.

    Minimum value꞉ 1.

  • cacheDirectory (str, optional) –

    Directory for caching local copies of downloaded data. A cache directory is optional but highly recommended if you plan to repeatedly access data for the same range of dates.

    When data are requested, the cache directory will be checked for data that was downloaded and cached during prior requests. If cached data exists that can fulfill part of the current request, the request will be serviced by reading from cache files rather than downloading from the server. If the entire request can be serviced from the cache, the server will not be accessed at all and the request will be completed extremely quickly. Any parts of the request that cannot be serviced from the cache will be downloaded from the server and added to the cache, speeding up future requests for the same data.

    If you use a cache directory, be aware of these common pitfalls:

    • The caching algorithm permits the cache to grow to infinite size and never deletes any cached data. If you access a large amount of data (e.g. an entire 20 terabyte collection of satellite images) it will all be added to the cache. Be careful that you do not fill up your hard disk. To mitigate this, manually delete the entire cache or selected directories or files within it.

    • The caching algorithm stores data in uncompressed files, so that subsets of those files may be quickly accessed. To save space on your hard disk, you can enable compression of the cache directory using the operating system. On Windows, right click on the directory in Windows Explorer, select Properties, click Advanced, and enable “Compress contents to save disk space”.

    • The caching algorithm cannot detect when portions of a dataset have been replaced on the server, thereby making the cached data obsolete. Thus, if a data provider republishes a dataset with improved data values, the caching algorithm will continue to use the old, obsolete values. To mitigate this, you should monitor when data providers reprocess their datasets, and delete the cached files when they become obsolete.

    Minimum length꞉ 1.

  • metadataCacheLifetime (float, optional) –

    Maximum amount of time, in seconds, that granule metadata downloaded from the NASA Earthdata Common Metadata Repository (CMR) will be cached.

    Downloading metadata from the NASA Earthdata CMR can be slow. If this parameter and a cache directory are both provided, when the CMR is queried for all granule metadata for a given collection_concept_id, the downloaded metadata will be cached in the directory for this amount of time. During this period, the cached metadata will be accessed instead of the server, which can greatly speed up processing involving NASA Earthdata granules. However, if new datasets are stored in the CMR, they will not be discovered until the cached metadata has expired.

    If this parameter is not provided (the default), then granule metadata will not be cached.

    Minimum value꞉ 1.0.

  • rasterExtension (str, optional) – File extension to use for output rasters. This parameter is ignored if the rasters are stored in a geodatabase rather than the file system, or if the Raster Name Expressions parameter is provided (in which case it determines the file extension). The default is ‘.img’, for ERDAS IMAGINE format. Another popular choice is ‘.tif’, the GeoTIFF format. Please see the ArcGIS documentation for the extensions of the supported formats. Minimum length꞉ 1.

  • rasterNameExpressions (list of str, optional) –

    List of expressions specifying how the output rasters should be named. If you do not provide anything, a default naming scheme will be used.

    If the output workspace is a file system directory, you may provide one or more expressions. Each expression defines a level in a directory tree. The final expression specifies the raster file name. If the output workspace is a geodatabase, you should provide only one expression, which specifies the raster name.

    Each expression may contain any sequence of characters permitted by the output workspace. Each expression may optionally contain one or more of the following case-sensitive codes. The tool replaces the codes with appropriate values when creating each raster:

    • %(ShortName)s - PO.DAAC Short Name of the GHRSST L4 product.

    • %(VariableName)s - GHRSST variable represented in the output raster, usually either analysed_sst or analysis_error.

    • %%Y - four-digit year of the raster. This and the following codes are only available for datasets that have time coordinates.

    • %%m - two-digit month of the raster.

    • %%d - two-digit day of the month of the raster.

    • %%j - three-digit day of the year of the raster.

    • %%H - two-digit hour of the raster.

    • %%M - two-digit minute of the raster.

    • %%S - two-digit second of the raster.

    Minimum length꞉ 1.

  • convertToCelsius (bool, optional) – If True (the default), temperature values will be converted from kelvin to degrees Celsius. If False, temperature values will be in the original kelvin values.

  • useUnscaledData (bool, optional) – If True and the original data is stored as integers that are processed through a “scaling equation” to produce the actual floating point values, the output rasters will be created with the integers rather the floating point values. If False, or the original data is not processed through a scaling equation, the output rasters will be created using the data’s original data type.

  • calculateStatistics (bool, optional) – If True and the output rasters use an integer data type, raster attribute tables (RATs) will be built for the output rasters using the ArcGIS Build Raster Attribute Table tool. Raster attribute tables are essentially histograms: they store the counts of cells having each value. If you do not need this information, you can skip the building of raster attribute tables to speed up the creation of the output rasters. Note that for certain raster formats, such as ArcInfo Binary Grid, the explicit buliding of raster attribute tables is not necessary because it happens automatically when the rasters are created. This option is ignored if the output rasters use a floating point data type.

  • buildRAT (bool, optional) – If True and the output rasters use an integer data type, raster attribute tables (RATs) will be built for the output rasters using the ArcGIS Build Raster Attribute Table tool. Raster attribute tables are essentially histograms: they store the counts of cells having each value. If you do not need this information, you can skip the building of raster attribute tables to speed up the creation of the output rasters. Note that for certain raster formats, such as ArcInfo Binary Grid, the explicit buliding of raster attribute tables is not necessary because it happens automatically when the rasters are created. This option is ignored if the output rasters use a floating point data type.

  • buildPyramids (bool, optional) – If True, pyramids will be built for the output rasters using the ArcGIS Build Pyramids tool. Pyramids, also known as overviews, are reduced resolution versions of the rasters that can improve the speed at which they are displayed in the ArcGIS user interface.

Returns:

Updated output workspace.

Return type:

str