IOPS

Abstract: A spectrum-matching and look-up-table (LUT) methodology has been developed and evaluated to extract environmental information from remotely sensed hyperspectral imagery. The LUT methodology works as follows. First, a database of remote-sensing reflectance (Rrs) spectra corresponding to various water depths, bottom reflectance spectra, and water-column inherent optical properties (IOPs) is constructed using a special version of the HydroLight radiative transfer numerical model. Second, the measured Rrs spectrum for a particular image pixel is compared with each spectrum in the database, and the closest match to the image spectrum is found using a least-squares minimization. The environmental conditions in nature are then assumed to be the same as the input conditions that generated the closest matching HydroLight-generated database spectrum. The LUT methodology has been evaluated by application to an Ocean Portable Hyperspectral Imaging Low-Light Spectrometer image acquired near Lee Stocking Island, Bahamas, on 17 May 2000. The LUT-retrieved bottom depths were on average within 5% and 0.5 m of independently obtained acoustic depths. The LUT-retrieved bottom classification was in qualitative agreement with diver and video spot classification of bottom types, and the LUT-retrieved IOPs were consistent with IOPs measured at nearby times and locations.

Abstract: The IO performance of storage devices has accelerated from hundreds of IOPS five years ago, to hundreds of thousands of IOPS today, and tens of millions of IOPS projected in five years. This sharp evolution is primarily due to the introduction of NAND-flash devices and their data parallel design. In this work, we demonstrate that the block layer within the operating system, originally designed to handle thousands of IOPS, has become a bottleneck to overall storage system performance, specially on the high NUMA-factor processors systems that are becoming commonplace. We describe the design of a next generation block layer that is capable of handling tens of millions of IOPS on a multi-core system equipped with a single storage device. Our experiments show that our design scales graciously with the number of cores, even on NUMA systems with multiple sockets.

Abstract: This paper presents the design, implementation and evaluation of Direct File System (DFS) for virtualized flash storage. Instead of using traditional layers of abstraction, our layers of abstraction are designed for directly accessing flash memory devices. DFS has two main novel features. First, it lays out its files directly in a very large virtual storage address space provided by FusionIO's virtual flash storage layer. Second, it leverages the virtual flash storage layer to perform block allocations and atomic updates. As a result, DFS performs better and it is much simpler than a traditional Unix file system with similar functionalities. Our microbenchmark results show that DFS can deliver 94,000 I/O operations per second (IOPS) for direct reads and 71,000 IOPS for direct writes with the virtualized flash storage layer on FusionIO's ioDrive. For direct access performance, DFS is consistently better than ext3 on the same platform, sometimes by 20%. For buffered access performance, DFS is also consistently better than ext3, and sometimes by over 149%. Our application benchmarks show that DFS outperforms ext3 by 7% to 250% while requiring less CPU power.