Enter Note Done
Go to previous page in this tab
Session
  • Presentation | IN21D: Open-Source Geospatial Workflows in the Cloud: Tools and Techniques for Data Access, Analysis, Visualization, Storytelling, and Sharing in the Python and Jupyter Ecosystem I Poster
  • Poster
  • Share Icon
    Bookmark Icon
  • IN21D-0361: OPeNDAP in the Cloud: Metadata Driving Performant, Interoperable, and Sustainable Geospatial Workflows
    • Schedule
    Notes
  • Board 0361‚ Hall EFG (Poster Hall)
    NOLA CC
    Set Timezone

Generic 'disconnected' Message
Author(s):
Miguel Jimenez-Urias, OPeNDAP, Inc. (First Author, Presenting Author)
James Gallagher, OPeNDAP, Inc.
Hannah Robertson, OPeNDAP, Inc.


Geoscientists often work with large, complex datasets that require aggregation, subsampling, and include variables not defined on regular latitude–longitude grids. Furthermore, the rapid growth of data collections and emerging cyberinfrastructure can make existing scientific workflows quickly outdated, standing in contrast to the principles of open science, which emphasize the need for reusable and interoperable workflows.


To help address these challenges, the OPeNDAP team exposes a DMR++, an external reference file that acts as a map to the location of individual data chunks within archival formats such as HDF4 and HDF5. Using DMR++, an OPeNDAP server—or a compatible client—can perform efficient data subsetting without needing to reformat entire data collections. Today, DMR++ is used on cloud-based OPeNDAP servers, and tools like earthaccess and VirtualiZarr use it to stream data directly into cloud-native formats like Zarr.


In this presentation, we will introduce DMR++, explain how it works, highlight its current applications, discuss its current limitations, and outline our development roadmap. We will also showcase efforts to promote reusable workflows taking advantage of DMR++. We aim to lower technical barriers, support a growing community of users and developers, and foster broader, more inclusive participation in open geospatial science.




Scientific Discipline
Suggested Itineraries
Neighborhood
Type
Main Session
Discussion