Skip to content

Develop Climate Data Viz: The goal for this repository is to open the CDV to the world, to help create a climate data visualization tool that our scientists, educators, friends and families can use to connect with the hundreds of petabytes of data that are provided freely by science teams at NASA, NOAA, CDC, NWS, and science institutions without…

License

danieloostra/climatedataviewer

Repository files navigation

#Climate DATA Viewer (CDV) - Data Viz

##Why support this project?

The goal for this repository is to open the CDV to the world via GitHub, to help create the ultimate data visualization tool that our scientists, educators, friends and families can use to connect with the hundreds of petabytes of data that are provided freely by science teams at NASA, NOAA, CDC, NWS, and science institutions without politics or strings attached.

By supporting and working on this project, you'll be contributing to the efforts of literally thousands of man-hours spent to make data viz on the web an afterthought. The real power lies within the insights and "ah-ha" moments we can create in the Earth science students around the world. Think about this: Why are we so tuned into the weather? Well, it's always available and interpereted for us--24/7... What's needed in the media and in our daily lives is a comprehensive understanding of our climates and how they affect our environments that we rely and hope to be predictable. Let's put climate data on the web.

##What does this software already do?

The Climate Data Viewer (CDV) is a web server that can be configured to allow users to access climate and Earth science data. The CDV uses DODs networking to enable data users to view distributed datasets in one viewer, or host data locally. The CDV uses the Ferret visualization engine to visualize data within the CDV, however, other applications such as Matlab, IDL, GrADS can also be used within the CDV as it currently stands.

The CDV can also be used to visualize other data, on other servers throughout the world. The CDV has been used by NOAA, NASA, and other governmental agencies to visualize data, providing an easy-to-use way to access geo-referenced scientific data.

##What can I do?

Recent developments have forced individual users to introduce the CDV (also known as the Live Access Server - LAS) into a mainstream crowd-sourced software package, to insure the safety of its’ use by current and future users. What really needs to happen here is that you need to help make the CDV bombproof. If you have a background in securing Java based applications against attacks such as XSS, Command Injection, SQL-injection or related vulnerabilities, *please lend a hand in making this software as secure as you can. *

##Who initially developed the CDV?

The Climate Data Viewer was originally developed by the dedicated staff at the PMEL – Pacific Marine Environmental Lab, with all credit going to them for the initial, current, and on-going development. I’ve been in close contact with lead developer at PMEL, and we will share any concrete developments with the team at PMEL for evaluation and feedback.

##Requirements ###You must have the following software installed before you install CDV.

  • Java 1.6+ (you need the full SE JDK not just the Run-time Environment (JRE).) We recommend Java 7.
  • Tomcat v6.x or higher. We recommend Tomcat 7. We are running all of our servers at Tomcat 7.
  • T DS (The THREDDS Data Server) 4.2.5+ You must use TDS 4. We do not recommend 4.3 yet due to problems with the NCML aggregations.
  • ant 1.8+ (if the Java code does not compile and you have the right JDK it's probably because your ant is old.)
  • Ferret 6.842 or higher with the etopo05.nc data set and the Ferret environment that goes with the release.

#First steps to installing the CDV

##Prerequisites ###You must have the following software installed before you install

  1. Java 1.6+ (you need the full SE JDK not just the Run-time Environment (JRE).) We recommend Java 7.
  2. Tomcat v6.x or higher. We recommend Tomcat 7. We are running all of our servers at Tomcat 7.
  3. TDS (The THREDDS Data Server) 4.2.5+ You must use TDS 4. We do not recommend 4.3 yet due to problems with the NCML aggregations.
  4. ant 1.8+ (if the Java code does not compile and you have the right JDK it's probably because your ant is old.)
  5. Ferret 6.842 or higher with the etopo05.nc data set and the Ferret environment that goes with the release.

###Install Java 1.6+

Read the documentation for details.

  1. Go to oracle.com to get Java 1.6.
  2. Follow the instructions for the RPM or self-extracting binary installation as appropriate for your system.

###Install Tomcat 6.x +

Here's a quick and dirty "how-to" for Tomcat (read the documentation for details).

  1. Go to tomcat.apache.org get the latest 6.x version.
  2. Follow the link on the left and download the "core" tar.gz file.
  3. Explode the tomcat tar file into a directory of your choosing:
     tar -xzf apache-tomcat-6.0.32.tar.gz
  4. I usually make a link from the complicated name (apache-tomcat-6.0.32) to a simple name (tomcat) using a soft link. That way the "tomcat" name can always point to the latest version you have installed:
    ln -s apache-tomcat-6.0.32/ tomcat
  5. If the default port numbers are being used by some other application, you'll need to edit the tomcat/conf/server.xml file to change the three port numbers (the shutdown port, the HTTP Connector port, and the Connector/AJP port). You can also just comment out the AJP connector port since we don't use it in our set up.

    E.g.
    <Server port="8005" shutdown="SHUTDOWN">
    ...
    <!-- Define a non-SSL HTTP/1.1 Connector on port 8080 -->
    <Connector port="8080" maxHttpHeaderSize="8192"
    maxThreads="150" minSpareThreads="25" maxSpareThreads="75"
    enableLookups="false" redirectPort="8443" acceptCount="100"
    connectionTimeout="20000" disableUploadTimeout="true" />
    ...
    <!-- Define an AJP 1.3 Connector on port 8009 -->
    <!-- For the basic LAS installation this connector is not used and could be commented out. -->
    <Connector port="8009"
    enableLookups="false" redirectPort="8443" protocol="AJP/1.3" />

    That's it. Now remember the full path name of the directory where you installed your tomcat and the port number you selected for the HTTP Connector port. You'll need these in the LAS configure process.

###Install the THREDDS Data Server ####This is not hard, but there are a lot of steps you need to follow.

Because of all the details needed to integrate TDS and LAS we've created a separate page with instructions.

###Install Ant 1.8+

This is very easy. The promise of "write once install anywhere in action".

  1. Check your version with ant -version
  2. If it's old go to ant.apache.org.
  3. Look for the download link on the welcome page.
  4. Expand the tar ball somewhere.
  5. Set your path so that this installation appears in the path ahead of the old version you're trying to replace.

###Install Ferret 6.842 or higher

  1. Download the appropriate package from the Ferret downloads page.
  2. There is a detailed installation guide and help from the mailing list.
    • N.B. You also need the Ferret environment that goes with this release.
  3. You also need to install the etopo05.nc data set in your FER_DATA directory since this version of LAS depends on this file for computing masks for user defined variables. The example configuration also includes a new dataset, ocean_atlas_subset.nc, a 4-Dimensional dataset for demonstrating LAS capabilities. Both of these files are in the Ferret datasets tar file listed on the Ferret downloads pages. Download the Ferret datasets tar file and install the data to update your installation.

##Further Questions? Insights? We need your help! Feel free to email me privately or post to your thoughts on this project. I've been a user of this software for many years, I'm not an expert at application security, but making this software bulletproof will allow students from around the world access research quality data. Our team would like to use this software to make data accessible for teachers to expand their student's understanding and experiences in the areas of Earth science, math, engineering, and above all, insights into the world around them.

####Please refer to the home page of the Live Access Server for more technical information and NOAA PMEL releases. Live Access Server Home

About

Develop Climate Data Viz: The goal for this repository is to open the CDV to the world, to help create a climate data visualization tool that our scientists, educators, friends and families can use to connect with the hundreds of petabytes of data that are provided freely by science teams at NASA, NOAA, CDC, NWS, and science institutions without…

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published