介绍气候数据分析工具—Climate Data Analysis Tools(python)

hillside

http://www2-pcmdi.llnl.gov/cdat
http://www-pcmdi.llnl.gov/software/
http://www-pcmdi.llnl.gov/software/cdat/support/documentation.php

描述:          

       PCMDI开发和维护几种用于气候研究的软件包。最常用的基于python语言的CDAT (Climate Data Analysis Tools) 软件包，有数据分析，制图等强大功能。


        CDAT能够用于发现、检测和相互耦合的多模式气候数据。通过与气候研究机构，计算组织和其他科学界的合作，CDAT的开发者社区是一路领先，提供成熟的数据管理，分析，可视化和诊断功能来帮助科学家。 CDAT这种社会各界的广泛努力，已经发展成为一个强大的和有见地的应用程序的观察和模拟气候数据的知识发现。在地球系统网格（ESG）数据基础设施的分析引擎，CDAT可以远程访问和设在世界各地的多个站点的气候数据进行分析。
注：中文系结合网络来源略作编辑，非直接翻译。

CDAT is deprecated and is now part of UV-CDAT
CDAT makes use of an open-source, object-oriented, easy-to-learn scripting language (Python) to link together separate software subsystems and packages to form an integrated environment for data analysis. Outside collaborators work independently and contribute on an equal basis with PCMDI.

Climate Data Analysis Tools (CDAT) is a software infrastructure that uses an object-oriented scripting language to link together separate software subsystems and packages thus forming an integrated environment for solving model diagnosis problems. The power of the system comes from Python and its ability to seamlessly interconnect software. Python provides a general purpose and full-featured scripting language with a variety of user interfaces including command-line interaction, stand-alone scripts (applications) and graphical user interfaces (GUI). The CDAT subsystems, implemented as modules, provide access to and management of gridded data (Climate Data Management System or CDMS); large-array numerical operations (Numerical Python); and visualization (Visualization and Control System or VCS).

One of the most difficult challenges facing climate researchers today is the cataloging and analysis of massive amounts of multi-dimensional global atmospheric and oceanic model data. To reduce the labor intensive and time-consuming process of data management, retrieval, and analysis, PCMDI and other DOE sites have come together to develop intelligent filing system and data management software for the linking of storage devices located throughout the United States and the international climate research community. This effort, headed by PCMDI, NCAR, and ANL will allow users anywhere to remotely access this distributed multi-petabyte archive and perform analysis. PCMDI's CDAT is an innovative system that supports exploration and visualization of climate scientific datasets. As an "open system", the software sub-systems (i.e., modules) are independent and freely available to the global climate community. CDAT is easily extended to include new modules and as a result of its flexibility, PCMDI has integrated other popular software components, such as: the popular Live Access Server (LAS) and the Distributed Oceanographic Data System (DODS). Together with ANL's Globus middleware software, CDAT's focus is to allow climate researchers the ability to access and analyze multi-dimensional distributed climate datasets.

CDAT Documentation
CDAT Readme (html) | word | pdf
Climate Model Output Rewriter (CMOR)

The "Climate Model Output Rewriter" (CMOR, pronounced "Seymour") comprises a set of FORTRAN 90 functions that can be used to produce CF-compliant netCDF files that fulfill the requirements of many of the climate community's standard model experiments.  These experiments are collectively referred to as MIP's and include, for example, AMIP, CMIP, CFMIP, PMIP, APE, and IPCC scenario runs. The output resulting from CMOR is "self-describing" and facilitates analysis of results across models.

Much of the metadata written to the output files is defined in MIP-specific tables, typically made available from each MIP's web site.  CMOR relies on these tables to provide much of the metadata that is needed in the MIP context, thereby reducing the programming effort required of the individual MIP contributors.

CMOR User's Guide
CDAT's  major subsystems are:

cdms - Climate Data Management System (file I/O,  variables, types, metadata, grids)
cdutil - Climate Data Specific Utilities (spatial and temporal averages, custom seasons, climatologies)
genutil - General Utilities (statistical and other convenience functions)
numPy - Numerical Python (large-array numerical operations)
vcs - Visualization and Control System  (manages graphical window: picture template, graphical methods, data)

VCDAT is the graphical user interface for CDAT and helps users become familiar with CDAT by translating every button press and keystroke into Python scripts. VCDAT does not require learning Python and the CDAT software.

CDAT is public domain software with unrestricted use. For details, see the license.

CDAT and VCDAT screenshot  thumbnails.
Please, click on the image icon to see larger image.
Download and InstallUp one levelObtaining and Installing CDAT In Depth Installation GuideIn Depth Instructins to install CDAT on your systemKnown install problems/tweaks for CDATSome known tweaks to install CDAT

Obtaining and Installing CDAT
CDAT is no longer supported as is, it has been superseded by UV-CDAT
For UV-CDAT install instructions see:    UV-CDAT install site
For UV-CDAT see:    UV-CDAT site
The following are the old instruction for CDAT 5.2 which is no longer supported
Download Stable Releases

• CDAT is no longer available via tarball, instead it is distributed via "subversion".
• Subversion can be obtained at: http://subversion.tigris.org/
• Current version is:
  
  
  
  • CDAT Version 5.2 (September 14h, 2009)
    
    
    
    • svn export http://www-pcmdi.llnl.gov/svn/repository/cdat/tags/5.2 cdat-5.2-src
      
    • Once you got the sources you can install CDAT as follow:
      
    • # Now you need to build cdat, terms in between [] are optional./configure --prefix=CDAT_BUILD [--with-externals=CDAT_EXTERNALS] [--with-python=MY_PYTHON] [--with-opendap]# use ./configure --help for a list of all options!# Clean previous build, just in casemake clean# And finally make and build cdatmake# You can now start CDAT with the commandCDAT_BUILD/bin/cdat
    • In addition 5.2 comes a few UNSUPPORTED binary tarball, these (and a tarball of the sources) can be found at:
    • http://sourceforge.net/projects/cdat/files/Releases/5.2
    • For more info on these binaries see this.
      

Download Bleeding-Edge Source Code via Subversion

• If you're brave or a developper you may want to access our development branch, this includes our latest version BUT may content unstable code.
• to do so follow these instruction:
  
  
  
  • Create a directory to store your sources: CDAT_SRC, and choose a location where to build cdat: CDAT_BUILD
  • Optionally you may decide on a directory where to install the externals libraries and programs needed by cdat CDAT_EXTERNALS (default is CDAT_BUILD/Externals)
  • You can also use your own python if you want (it will still build packages in CDAT_BUILD, so you need to have write access to this location): MY_PYTHON
    

cd CDAT_SRC# The first time do:svn co http://www-pcmdi.llnl.gov/svn/repository/cdat/trunk .# Thereafter, to simply obtain the changes since your last time simply dosvn update# Now you need to build cdat, terms in between [] are optional./configure --prefix=CDAT_BUILD [--with-externals=CDAT_EXTERNALS] [--with-python=MY_PYTHON] [--with-opendap]# use ./configure --help for a list of all options!# Clean previous build, just in csaemake clean# And finally make and build cdatmake

Wait a while... You should now have a fully working cdat, if you run into any problem please contact us and send us the logs located under the logs directory

Old Versions:

• CDAT Version 4.3 available via: (November 2007)
  
  
  
  • svn export http://www-pcmdi.llnl.gov/svn/repository/cdat/tags/CDAT-4.3
    
  
  
  • Read the README.txt file, and then run express_install.
    

PCMDI Documents

1.       Tutorials (available by download)

2.       Climate Data ManagementSystem (CDMS)

1.  Version 4.0 (PDF)

2.  Version3.3 (PDF)

3.    VisualizationControl System -VCS- (pdf)

0.                             quickstart (pdf)(postscript)  

1.                             quickreference (pdf)(postscript)

4.    CDATUtilities (pdf)(postscript)

5.    Xmgrace

2.             External Packages andUsers Contributions (contributionspage)
0.                     Numeric Python (pdf ) (web site ) Includes Masked Arrays !

1.                     PyClimate (pdf)(postscript ) (web site)

2.                     Pyfort(pdf ) (web site )

General PythonDocumentation

·                Python for Newbies -- The very thing if you are new to Python-based codes.

·                Python Documentation -- tutorial, library reference, ...

Related Links

1.             Climate Analysis

1.       PyClimate , Python tools for climate variability analysis from theDepartment of Applied Physics II, Faculty of Sciences, University of the BasqueCountry.

2.       mtaCDF is a Python module implementing some objects for an easyhandling of multivariate time series in NetCDF files and some objects forstatistical analysis of this time series from Institut fur Meereskunde, Kiel

2.             Python

0.                     SWIG (Software Wrapper Interface Generator) connects your C orC++ to Python in a jiffy.

1.                     FPIG, a Python / Fortranconnection tool. See FPIG Home Page.

2.                     CXX, the C++ toolkit forwriting Python extensions. See CXX Project Page.

Pyfort, a Python / Fortran connection tool. See Pyfort Home Page.

注：本人对于具体内容并不了解，只是介绍。

Jasonluo

多谢楼主的好资料呀！这个东东确实很有用，包罗万象！

yl1992

很有用，谢谢楼主

黎明的夕阳

学习学习。谢谢共享

threedeng

哈哈，长长见识

jackshen016

这个东东确实很有用，包罗万象！多谢楼主的好资料呀！

jackshen016

这个东东确实很有用，包罗万象！多谢楼主的好资料呀！

一颗永恒的流星

好东西啊，收藏了，多谢楼主！

linikiku

好东西啊，！

gmengmeng

多谢楼主分享