Optimization Techniques for GPU Programming
54
TL;DR: In this article , a survey discusses various optimization techniques found in 450 articles published in the last 14 years and analyzes the optimizations from different perspectives which shows that the various optimizations are highly interrelated, explaining the need for techniques such as auto-tuning.
read more
Abstract: In the past decade, Graphics Processing Units have played an important role in the field of high-performance computing and they still advance new fields such as IoT, autonomous vehicles, and exascale computing. It is therefore important to understand how to extract performance from these processors, something that is not trivial. This survey discusses various optimization techniques found in 450 articles published in the last 14 years. We analyze the optimizations from different perspectives which shows that the various optimizations are highly interrelated, explaining the need for techniques such as auto-tuning.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Unleashing the potential: AI empowered advanced metasurface research
Yunlai Fu,Xuxi Zhou,Yiwan Yu,Jiawang Chen,Shuming Wang,Shining Zhu,Zhenlin Wang +6 more
TL;DR: AI-powered advanced metasurface research explores the intersection of AI and metasurfaces, leveraging AI's computational power to design, analyze, and optimize metasurfaces for various applications.
GPU acceleration of Levenshtein distance computation between long strings
TL;DR: In this paper , a GPU implementation of the WFA algorithm and a new optimization that can halve the elements to be computed, providing additional performance gains, are presented, which is the best ever reported.
7
Progress and Opportunities of Foundation Models in Bioinformatics
Qing Li,Zhihang Hu,Yixuan Wang,Lei Li,Yimin Fan,Irwin King,Le Song,Yu Li +7 more
TL;DR: A systematic investigation and summary of FMs in bioinformatics, tracing their evolution, current research status, and the methodologies employed, aiming to guide the research community in choosing appropriate FMs for their research needs.
6
Sustainable Optimizing Performance and Energy Efficiency in Proof of Work Blockchain: A Multilinear Regression Approach
Meennapa Rukhiran,Songwut Boonsong,Paniti Netinant +2 more
TL;DR: The results reveal that strategically adjusting GPU hardware, software, and configuration can preserve substantial energy while preserving computational efficiency, and offer practical recommendations for optimizing the feature configurations of GPUs to reduce energy consumption, mitigate the environmental impacts of blockchain operations, and contribute to the current research on performance in PoW blockchain applications.
6
References
Memory capacity aware non-blocking data transfer on GPGPU
Hao-Wei Liu,Hsien-Kai Kuo,Kuan-Ting Chen,Bo-Cheng Charles Lai +3 more
- 01 Jan 2013
TL;DR: This paper proposes a capacity aware scheduling algorithm that exploits the non-blocking data transfer in modern GPGPUs and demonstrates an average of 24.01 % performance improvement when compared to existing approaches that only consider memory capacity.
6
Accelerating discrete wavelet transforms on GPUS
David Barina,Michal Kula,Michal Matysek,Pavel Zemcik +3 more
- 14 Sep 2017
TL;DR: This paper shows that corresponding horizontal and vertical lifting parts of the lifting scheme can be merged into non-separable lifting units, which halves the number of steps, and discusses an optimization strategy leading to a reduction in theNumber of arithmetic operations.
5
A Warp-Synchronous Implementation for Multiple-Length Multiplication on the GPU
Takumi Honda,Yasuaki Ito,Koji Nakano +2 more
- 08 Dec 2015
TL;DR: The idea of the GPU implementation is to adopt warp-synchronous programming, and the experimental results show that theGPU implementation on NVIDIA GeForce GTX 980 attains a speed-up factor of 62 for 1024-bit multiple-length multiplication over the single CPU implementation.
SpMV and BiCG-Stab optimization for a class of hepta-diagonal-sparse matrices on GPU
TL;DR: A customized storage scheme that takes advantage of generalized hepta-diagonal sparsity pattern and stencil regularity by optimizing both storage and matrix–vector computation and an in-kernel optimization for implementing sparse matrix– vector multiply and biconjugate gradient stabilized solver.
5
A Case Study of SWIM: Optimization of Memory Intensive Application on GPGPU
Wei Yi,Yuhua Tang,Guibin Wang,Xudong Fang +3 more
- 18 Dec 2010
TL;DR: This paper attempts to optimize the performance and energy consumption of the SWIM application utilizing different memory access mechanisms and present optimization methods including matrix transposition and kernel fusion.
5