{"product_id":"semcache-semantics-aware-caching-for-efficient-gpu-offloading-von-nabeel-al-saber","title":"SemCache: Semantics-Aware Caching for Efficient GPU Offloading","description":"\u003cp\u003eIn this book, we introduce SemCache, a semantics-aware GPU cache that automatically manages CPU-GPU communication in addition to optimizing communication by eliminating redundant transfers using caching. It uses library semantics to determine the appropriate caching granularity for a given offloaded library. Our caching technique is efficient; it only tracks matrices instead of tracking every memory access at fine granularity. We applied SemCache to Basic Linear Algebra Subprograms (BLAS) library to provide a GPU drop-in replacement library. SemCache++ extends SemCache to support offloading to multiple GPUs. SemCache++ is used to build the first multi-GPU drop-in replacement library that (a) uses the virtual memory to automatically manage and optimize multi-GPU communication and (b) requires no program rewriting or annotations. SemCache++ also enables new features like asynchronous transfers, parallel execution and overlapping communication with computation. Experimental results show that our system can dramatically reduce redundant communication for real-world computational science application and deliver significant improvements, beating exciting GPU-based implementations.\u003c\/p\u003e\u003cdiv class=\"aw-variant-hidden-subtitle-div\" id=\"aw-variant-subtitle-9783659878145\"\u003e\u003ch3\u003e\u003c\/h3\u003e\u003c\/div\u003e","brand":"Libri","offers":[{"title":"Softcover - 9783659878145","offer_id":39449998753885,"sku":"9783659878145","price":49.9,"currency_code":"EUR","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0940\/0622\/files\/b53b770b-b9f9-403e-b166-2802b20260f4.jpg?v=1773295787","url":"https:\/\/shop.autorenwelt.de\/en\/products\/semcache-semantics-aware-caching-for-efficient-gpu-offloading-von-nabeel-al-saber","provider":"Autorenwelt Shop","version":"1.0","type":"link"}