Apache SDAP – A Disruptive Technology Solution for Earth Science
Presenting Author: Thomas Huang
Organization: NASA Jet Propulsion Laboratory, California Institute of Technology
OceanWorks is a NASA AIST integration project to establish an Integrated Ocean Science Data Analytics Platform at NASA's Physical Oceanography Distributed Active Archive Center (PO.DAAC) for big ocean science. As a technology integration and advancement project, the team is chartered to create a coherent architecture to streamline the flow of science data and information, and address resource sharing through services consolidation. The project established the open source Apache Science Data Analytics Platform (SDAP) (https://sdap.apache.org) to develop in the open under an internationally-recognized open source governance process. Apache SDAP is a disruptive technology for the Earth Science research community, because it is a technology for scientists to conduct their researches without having to find and copy massive amount of data to their local computing environment. It hides the complexity of the big data analytic infrastructure such as local computing cluster and the elastic cloud. This AIST-funded open source technology project is now enabling a growing collection of NASA funded projects for domain-specific science needs. It includes the NASA Sea Level Change Portal, ACCESS-17 ECCO-Cloud, NASA CMC's Notebook Analytics: Parallel Climate Model Evaluation, and GRACE Science Portal. It is also enabling international efforts such as the NASA-ESA joint Multi-mission Algorithm and Analysis Platform (MAAP), and the CEOS Ocean Variables Enabling Research and Applications for GEO (COVERAGE). This presentation discusses the open source Apache SDAP as a disruptive technology solution and introduces the growing portfolio of projects this ESTO/AIST technology is enabling.