1
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Outline • Introduction to RDA • Overview of web site • Searching for data • Examples of available data • Dataset web pages
2
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
3
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
4
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Data SupportData Section Research Archive (RDA) at NCAR • Mission - support climate & weather research by curating, organizing, documenting, and creating access to research datasets • To extent possible, all data and services are free and open
5
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Research Data Archive (RDA) Archive (RDA) at NCAR •Research EstablishedData in 1960s • 600+ datasets, 4M files, 600 TB – Every dataset has a web page
• Many datasets routinely updated – daily, weekly, monthly
• 7000 unique users annually – ~2000 from US
• ~580TBs provided in 2011
6
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Core Data Categories Examples of Research Areas Supported Climate Synoptic Oceanographic Hydrologic Weather Prediction Numerical Modeling Renewable Energy (Wind/Solar)
7
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
RDA web site : rda.ucar.edu
8
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
9
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
10
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
11
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
12
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
13
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
14
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
15
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
16
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
17
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
18
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
19
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Core Data Categories Meteorological and Oceanographic Observations
Remote Sensing Observations
20
5/25/201 2
Operational and Reanalysis model outputs
Topography/Bathymetry , Vegetation, Land Use
NCAR is operated by UCAR under sponsorship of the NSF
Meteorology/Oceanography Observations Fixed Stations
• 141 Total Datasets • 107 w/ Air Temp • 77 w/ Wind • 78 w/ Rainfall
Ships
• 72 Total Datasets • 10 w/ Water Temp • 41 w/ Air Temp • 8 w/ Rainfall
Miscellaneous 21
5/25/201 2
• Cyclone Tracks • Station Libraries • Visibility
NCAR is operated by UCAR under sponsorship of the NSF
22
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
23
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Meteorology/Oceanography Observations Fixed Stations
• 141 Total Datasets • 107 w/ Air Temp • 77 w/ Wind • 78 w/ Rainfall
Ships
• 72 Total Datasets • 10 w/ Water Temp • 41 w/ Air Temp • 8 w/ Rainfall
Miscellaneous 24
5/25/201 2
• Cyclone Tracks • Station Libraries • Visibility
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
25
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
ICOADS Description Dates
26
• Marine surface and subsurface data • Ships, buoys, coastal stations and others • rda.ucar.edu/datasets/ds540.0 • 1662 – 2007 (rel 2.5) • 2008 – 2010 (prelim extension) • -> 2012 available
Variables
• • • •
Statistics
• 261 million obs • Hourly to daily observations • Monthly statistics at 1x1 degree boxes
5/25/201 2
Air Temperature Water Temperature Salinity Winds
NCAR is operated by UCAR under sponsorship of the NSF
Evolution of the Marine Climate Data System
TOTAL
27
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
28
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
NCAR Upper Air Database Description Dates Variables Levels 29
5/25/201 2
• Meteorological land stations • 2x (4x) daily balloon launches • rda.ucar.edu/datasets/ds370.0 • 1920’s to 2011 (winds only) • 1940’s to 2011 (thermal ) • 1973 -> available via web • • • •
Temperature Moisture Wind Height
• 15 Standard pressure levels • Significant levels • Height above surface
NCAR is operated by UCAR under sponsorship of the NSF
Content of Upper Air Archive Stations Reporting 30 Times/ Month or More 1200
1000
# Stations
800
600
400
200
30
YEAR NCAR is operated by UCAR under sponsorship of the NSF
1995
1990
1985
1980
1975
1970
1965
1960
1955
1950
1945
1940
1935
1930
5/25/201 2
1925
1920
0
Station Coverage Evolution in UADB
31
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
32
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
33
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
NCEP Operational Surface Description Dates Range Variables Domain 34
5/25/201 2
• Meteorological land stations • Observations taken 3x, 4x, 6x, 8x or 24x daily • rda.ucar.edu/datasets/ds461.0 • 1977 to 2012 • • • •
Temperature Moisture Precipitation Winds
• Global
NCAR is operated by UCAR under sponsorship of the NSF
Synoptic Stations in NCEP Surface
~ 1000 stations in North America ~ 5 obs/day per station
35
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Metar Stations in NCEP Surface
~ 2700 stations in North America ~ 30 obs/day per station
36
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
37
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
GHCN Summary of the Day/Month Description Dates Variables Domain 38
5/25/201 2
• Meteorological land stations • Summary of the day and month • Web : coming soon • 1800’s to 2011 • Most stations start in 1900’s • Minimum Temperature • Maximum Temperature • Precipitation • Global
NCAR is operated by UCAR under sponsorship of the NSF
39 5/25/201 2 Year
NCAR is operated by UCAR under sponsorship of the NSF
2010
2005
2000
1995
1990
1985
1980
1975
1970
1965
1960
1955
1950
1945
1940
1935
1930
1925
1920
1915
1910
1905
1900
1895
1890
1885
1880
1875
1870
1865
1860
1855
1850
Number of Stations
Total GHCN Daily Data in US
25000
20000
15000
Precip
10000 Tmin
5000
0
Annual Precipitation Anomalies from GHCN
40
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Platform Observations
41
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
U.S. and Canada Surface Hourly Data Description Dates Variables Domain 42
5/25/201 2
• Meteorological land stations • Observations 24x daily • rda.ucar.edu/datasets/ds472.0 • 1977 thru 2011 • • • •
Temperature Moisture Precipitation Wind
• U.S. and Canada
NCAR is operated by UCAR under sponsorship of the NSF
43 5/25/201 2 Year
NCAR is operated by UCAR under sponsorship of the NSF
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
2000
1999
1998
1997
1996
1995
1994
1993
1992
1991
1990
1989
1988
1987
1986
1985
1984
1983
1982
1981
1980
1979
1978
1977
# of Stations
Number of Stations in the U.S. and Canada Hour Data
3000
2500
2000
1500
1000
500
0
Core Data Categories Meteorological and Oceanographic Observations
Remote Sensing Observations
44
5/25/201 2
Operational and Reanalysis model outputs
Topography/Bathymetry , Vegetation, Land Use
NCAR is operated by UCAR under sponsorship of the NSF
Operational and Reanalysis Model Output Operational Reanalysis Variables 45
5/25/201 2
• Provide real time forecasts • 18 Total datasets • 2 Global Primary • 1 Regional
• 8 Projects currently archived • 6 global • 2 regional
• Temperature • Moisture • Winds • Radiation • Usually well over 100/model
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data
46
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Description Dates Range Variables Domain 47
5/25/201 2
• • • •
TIGGE
Global Ensemble Forecast Data Output from 10 different centers Near real time (48 hours) rda.ucar.edu/datasets/ds330.2
• Oct, 2006 - > 2012 • Forecasts : 0 -> 15 days • Temperature • Moisture • Precipitation • Winds
~ 30 total variables ~ 13 levels
• Global
NCAR is operated by UCAR under sponsorship of the NSF
TIGGE data A phased approach was chosen beginning with mirrored data collections of global medium-range ensemble forecasts from 10 NWP providers at three TIGGE Archive Centres: CMA, ECMWF, and NCAR. TIGGE data is made available for research after a 48-hour delay. Near real-time access may be granted for specific projects through the THORPEX International Project Office.
[email protected]
Description Dates Range Variables Domain 49
5/25/201 2
• • • •
TIGGE
Global Ensemble Forecast Data Output from 10 different centers Near real time (48 hours) rda.ucar.edu/datasets/ds330.2
• Oct, 2006 - > 2012 • Forecasts : 0 -> 15 days • Temperature • Moisture • Precipitation • Winds
~ 30 total variables ~ 13 levels
• Global
NCAR is operated by UCAR under sponsorship of the NSF
50
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
51
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data
52
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data
53
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km)
Global and Regional 2002 - Present
Daily
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
UNIDATA IDD Description Dates Range Variables Domain 54
5/25/201 2
• • • •
Collection of model output NCEP and ECMWF Global and regional models rda.ucar.edu/datasets/ds335.0
• Dec, 2002 - > 2012 • Forecasts : 0 -> 16 days • Updated daily (48 hourly delay) • Temperature • Moisture • Precipitation • Winds
~ 52 total variables ~ 25 levels
• Global • Regional
NCAR is operated by UCAR under sponsorship of the NSF
Models in UNIDATA IDD Dataset Model
Analysis
Forecasts
# of Variables
Region
RUC2 CONUS
Hourly
3 hourly -> 12 hours
16
Continental U.S. (20km)
NAM CONUS
00,06,12,18 UTC
3 hourly -> 84 hours
16
Continental U.S. (12km)
GFS
00,06,12,18 UTC
3 houlry -> 180 hours
16
Global (1 degree)
GFS
00,06,12,18 UTC
12 houlry 192 -> 384 hours
16
Global (2.5 degree)
GFS
00,06,12,18 UTC
NCEP Regional Ensemble
00, 12 UTC
6 hourly -> 84 hours
5/25/201 ECMWF 55
00, 12 UTC
24 hourly 5 NCAR is operated by UCAR under sponsorship of the NSF -> 168 hours
2
16
Global (0.5 degree)
8
North and Central America (1.5 degree) Global (2.5)
Featured Datasets
Operational Model Data
56
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km)
Global and Regional 2002 - Present
Daily
NCEP ETA/NAM (40km)
North America 1995 Present
Monthly
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
NCEP NAM Description Dates Range Variables Domain 57
5/25/201 2
• North American regional model • Great for WRF input • rda.ucar.edu/datasets/ds609.2 • 2002 - > 2012 • Forecasts : 0 -> 60 hours • Updated monthly • Temperature • Moisture • Precipitation • Winds
~ 15 total variables ~ 35 levels
• North America • 40km ??
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
Operational Model Data
58
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km)
Global and Regional 2002 - Present
Daily
NCEP ETA/NAM (40km)
North America 1995 Present
Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg)
Global 1985 - Present
Bi-Yearly
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
ECMWF Description Dates Range Variables Domain 59
5/25/201 2
• ECMWF Data assimilation system • Backbone for ECMWF forecast system • rda.ucar.edu/datasets/ds113.0 • 1985 - > 2011 • Updated bi-monthly • Temperature • Moisture • Precipitation • Winds
> 60 total variables ~ 25 levels
• Global • ~1.125 degree -> 2010 • .14 degree 2011 ->
NCAR is operated by UCAR under sponsorship of the NSF
60
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
61
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Data
62
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km)
Global and Regional 2002 - Present
Daily
NCEP ETA/NAM (40km)
North America 1995 Present
Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg)
Global 1985 - Present
Bi-Yearly
NCEP GDAS Final Analysis (1x1 Deg)
Global 1999 - Present
Daily
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
NCEP GDAS Description
63
• NCEP Global Data Assimilation system • Used to initialize the GFS • Backbone for NWS forecasts
Dates Range
• 1985 - > 2012 • Updated daily
Variables
• Temperature • Moisture • Precipitation • Winds
Domain
• Global • 1.0 degree
5/25/201 2
> 60 total variables ~ 25 levels
NCAR is operated by UCAR under sponsorship of the NSF
KATRINA
64
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Data
65
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km)
Global and Regional 2002 - Present
Daily
NCEP ETA/NAM (40km)
North America 1995 Present
Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg)
Global 1985 - Present
Bi-Yearly
NCEP GDAS Final Analysis (1x1 Deg)
Global 1999 - Present
Daily
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Data
66
Dataset Title
Coverage
Update Frequency
Thorpex Interactive Grand Global Ensemble (TIGGE)
Global 2006 - Present
Hourly
Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km)
Global and Regional 2002 - Present
Daily
NCEP ETA/NAM (40km)
North America 1995 Present
Monthly
ECMWF Operational Deterministic (1.25 x 1.25 Deg)
Global 1985 - Present
Bi-Yearly
NCEP GDAS Final Analysis (1x1 Deg)
Global 1999 - Present
Daily
NCEP OI Global SST (1x1 Deg)
Global 1981 - Present
Weekly
NOAA OI Global SST (0.25 x 0.25 Deg)
Global 1981 - Present
Monthly
Hadley Centre Global Sea Ice and SST
Global 1850 - Present
Monthly
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
67
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Reanalysis Model Output
68
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Evolution 1985
1990
1995
2000
2005
2010
Cycle R34L34
ChangeifPhysics Unknown changes in time series caused by modelAdddiscontinuities or Levels change in climate New Cycle R35L34
Cycle R36L50
Radiation
Cycle R37L50
69
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Operational Model Evolution 1985
1990
1995
2000
2005
Cycle R34L34
2010
Changes in time series caused by Change Physics change in climate or other factors Cycle R35L34
Add Levels Cycle R36L50
New Radiation
Cycle R37L50
Reanalysis
70
5/25/201 2
R37L50
NCAR is operated by UCAR under sponsorship of the NSF
HighFeatured Resolution Datasets Re-Analysis
1870
2011
High Resolution Re-Analysis
71
Dataset Title
Coverage
ERA-40 (T159) ERA-Interim (N128 Gaussian)
5/25/201 2
Update Frequency
Resolution
Dataset ID
Global 1957 2002
Static Set
~1.125
Ds117.0
Global 1989 Present
Yearly
~.7023
Ds627.0
NCAR is operated by UCAR under sponsorship of the NSF
HighFeatured Resolution Datasets Re-Analysis
1870
2011
High Resolution Re-Analysis
72
Dataset Title
Coverage
ERA-40 (T159) ERA-Interim (N128 Gaussian)
5/25/201 2
Update Frequency
Resolution
Dataset ID
Global 1957 2002
Static Set
~1.125
Ds117.0
Global 1989 Present
Yearly
~.7023
Ds627.0
NCAR is operated by UCAR under sponsorship of the NSF
73
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
74
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
HighFeatured Resolution Datasets Re-Analysis
1870
2011
High Resolution Re-Analysis Dataset Title
Coverage
ERA-40 (T159)
Global 1957 2002
ERA-Interim (N128 Gaussian) JRA-25 (1.125 Deg Gaussian) NCEP/DOE (T62)
75
Global 1989 Present Global 1979 – Present Global 1979 Present
Update Frequency
Resolution
Dataset ID
Static Set
~1.125
Ds117.0
Yearly
~.7023
Ds627.0
Yearly
~1.125
Ds625.0
Static Set
~ 2.0
NCEP/NCAR (T62)
Global 1948 Present
Quarterly
~2.0
Ds090.0
NARR (32 x 32 km)
North America 1979 - Present
Quarterly
32km
Ds608.0
CFSR (0.5 x 0.5 Deg)
Global 1979 Present
Monthly
.5 x .5
Ds093.0 Ds094.0
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Featured Datasets
76
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
1870
HighFeatured Resolution Datasets Re-Analysis
2011
High Resolution Re-Analysis Dataset Title
Coverage
ERA-40 (T159)
Global 1957 2002
ERA-Interim (N128 Gaussian) JRA-25 (1.125 Deg Gaussian) NCEP/DOE (T62)
77
Global 1989 Present Global 1979 – Present Global 1979 Present
Update Frequency
Resolution
Dataset ID
Static Set
~1.125
Ds117.0
Yearly
~.7023
Ds627.0
Yearly
~1.125
Ds625.0
Static Set
~ 2.0
NCEP/NCAR (T62)
Global 1948 Present
Quarterly
~2.0
Ds090.0
NARR (32 x 32 km)
North America 1979 - Present
Quarterly
32km
Ds608.0
CFSR (0.5 x 0.5 Deg)
Global 1979 Present
Monthly
.5 x .5
Ds093.0 Ds094.0
5/25/201 th 2NOAA-CIRES 20 Century
Global 1870 – 2008
Static Set
1.875
Ds131.1
NCAR is operated by UCAR under sponsorship of the NSF
78
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
Dataset Web Pages
79
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
80
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
81
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
82
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
83
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
84
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF
SUMMARY : RDA WEB SITE : rda.ucar.edu 641 datasets covering: Meteorology and oceanographic obs Numerical Weather Output Many other datasets Email :
[email protected] 85
5/25/201 2
NCAR is operated by UCAR under sponsorship of the NSF