Skip to content

Tutorial created by Chelle Gentemann for Ocean Sciences 2020 Meeting

License

Notifications You must be signed in to change notification settings

asteiker/osm2020tutorial

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pangeo Tutorial materials for AGU Ocean Sciences 2020

pangeo-logo

This repository tutorial materials for a 30 min workshop that showcase Pangeo data analysis on the cloud. The notebooks directory contains Jupyter notebooks that illustrate how to access cloud-based data and analyze it using cloud computing. The links below will launch an interactive environment on binder.pangeo.io Note that binder environments are ephemeral. Any changes you make will be lost once your session ends, and you shouldn't store passwords.

AGU 2020 Ocean Sciences Tutorial

To explore 3 difference cloud-optimized datasets (MUR SST, AVISO, CMIP6), select GCP-specific content, and then, once the binder initializes, select the button below 'Pangeo Binder GCE us-central1'.

| badge |

To explore only MUR SST on AWS, which will be faster because that is where it is stored, select button below 'Pangeo Binder AWS US-west1', and then, once the binder initializes, select 'AWS-notebooks'.

badge

Tutorial Highlights


  • About Pangeo: Pangeo is a community effort for big data in the geosciences using Python. A key component of the Pangeo effort is the improved integration of Xarray and Dask to enable analysis of very large datasets.
  • About Jupyter: Project Jupyter exists to develop open-source software, open-standards, and services for interactive computing across dozens of programming languages. The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more.
  • About Xarray: Xarray is an open source project and Python package that aims to bring the labeled data power of pandas to the physical sciences, by providing N-dimensional variants of the core pandas data structures.
  • About Dask: Dask is a flexible parallel computing library for analytic computing.
  • About Geopandas: Geopandas is a library to facilitate analysis of geospatial vector data
  • About Intake: Intake is a cataloging system designed to "Take the pain out of data access and distribution"

Workshops

Acknowledgements

At its core, Pangeo is a community effort built around open-source software. As such, the credit for the developments of the software described here belongs with the community that created it.

Elements of this tutorial were taken from the xarray, Dask, Cartopy, Holoviews, and Geoviews documentation. Some pieces of text in the xarray portion of the tutorial were adapted from Hoyer and Hamman (2016).

Pangeo is supported by the National Science Foundation (NSF) via the EarthCube Program and the National Aeronautics and Space Administration via the ACCESS Program. NCAR is separately supported by the National Science Foundation (NSF).

Google provided compute credits on Google Compute Engine. Amazon provided compute credits on AWS

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

About

Tutorial created by Chelle Gentemann for Ocean Sciences 2020 Meeting

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%