Towards Portable Large-Scale Image Processing with High-Performance Computing
SCIE
SCOPUS
- Title
- Towards Portable Large-Scale Image Processing with High-Performance Computing
- Authors
- Huo Yuankai; Blaber Justin; Damon Stephen M.; Boyd Brian D.; Bao Shunxing; Parvathaneni Prasanna; Noguera Camilo Bermudez; Chaganti Shikha; Nath Vishwesh; Greer Jasmine M.; Lyu Ilwoo; French William R.; Newton Allen T.; Rogers Baxter P.; Landman Bennett A.
- Date Issued
- 2018-06
- Publisher
- Springer Verlag
- Abstract
- High-throughput, large-scale medical image computing demands tight integration of high-performance computing (HPC) infrastructure for data storage, job distribution, and image processing. The Vanderbilt University Institute for Imaging Science (VUIIS) Center for Computational Imaging (CCI) has constructed a large-scale image storage and processing infrastructure that is composed of (1) a large-scale image database using the eXtensible Neuroimaging Archive Toolkit (XNAT), (2) a content-aware job scheduling platform using the Distributed Automation for XNAT pipeline automation tool (DAX), and (3) a wide variety of encapsulated image processing pipelines called "spiders." The VUIIS CCI medical image data storage and processing infrastructure have housed and processed nearly half-million medical image volumes with Vanderbilt Advanced Computing Center for Research and Education (ACCRE), which is the HPC facility at the Vanderbilt University. The initial deployment was natively deployed (i.e., direct installations on a bare-metal server) within the ACCRE hardware and software environments, which lead to issues of portability and sustainability. First, it could be laborious to deploy the entire VUIIS CCI medical image data storage and processing infrastructure to another HPC center with varying hardware infrastructure, library availability, and software permission policies. Second, the spiders were not developed in an isolated manner, which has led to software dependency issues during system upgrades or remote software installation. To address such issues, herein, we describe recent innovations using containerization techniques with XNAT/DAX which are used to isolate the VUIIS CCI medical image data storage and processing infrastructure from the underlying hardware and software environments. The newly presented XNAT/DAX solution has the following new features: (1) multi-level portability from system level to the application level, (2) flexible and dynamic software development and expansion, and (3) scalable spider deployment compatible with HPC clusters and local workstations.
- URI
- https://oasis.postech.ac.kr/handle/2014.oak/120820
- DOI
- 10.1007/s10278-018-0080-0
- ISSN
- 0897-1889
- Article Type
- Article
- Citation
- Journal of Digital Imaging, vol. 31, no. 3, page. 304 - 314, 2018-06
- Files in This Item:
- There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.