A Survey of Efficient Storage Management in LLM Serving
Under submission.
Animesh Trivedi
Assistant Professor
Research Focus
Storage Systems, Distributed Systems, Modern hardware
Contact
Links
Publications
Supervised
Teaching
Publications
PDF
Cite
Characterizing Energy Efficiency Trade-offs in the Linux Storage Stack for Flash-based NVMe SSDs
2026 IEEE International Symposium on Workload Characterization (IISWC)
PDF
Cite
Storage-Based Approximate Nearest Neighbor Search: What are the Performance, Cost, and I/O Characteristics?
2025 IEEE International Symposium on Workload Characterization (IISWC)
PDF
Cite
Does Linux Provide Performance Isolation for NVMe SSDs? Configuring cgroups for I/O Control in the NVMe Era
2025 IEEE International Symposium on Workload Characterization (IISWC)
An I/O Characterizing Study of Offloading LLM Models and KV Caches to NVMe SSD
5th Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems (CHEOPS'25) @ EuroSys 2025
PDF
Cite
Columbo: A Reasoning Framework for Kubernetes’ Configuration Space
16th ACM/SPEC International Conference on Performance Engineering (ICPE 2025)
PDF
Cite
Exploring GPU-to-GPU Communication Insights into Supercomputer Interconnects
2024 International Conference for High Performance Computing, Networking, Storage and Analysis (SC24)
PDF
Cite
The computing continuum: From IoT to the cloud
Internet of Things 27: 101272 (2024)
PDF
Cite
Exploring I/O Management Performance in ZNS with ConfZNS++
Proceedings of the 17th ACM International Systems and Storage Conference (SYSTOR'24)
PDF
Cite
A Systematic Configuration Space Exploration of the Linux Kyber I/O Scheduler
Workshop on Hot Topics in Cloud Computing Performance (HotCloudPerf'24@ICPE'24)
ZWAL: Rethinking Write-ahead Logs for ZNS SSDs with Zone Appends
ACM SIGOPS Operating Systems Review
PDF
Cite
ZWAL: Rethinking Write-ahead Logs for ZNS SSDs with Zone Appends
4th Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems (CHEOPS'24) @ EuroSys 2024
zns-tools: An eBPF-powered, Cross-Layer Storage Profiling Tool for NVMe ZNS SSDs
4th Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems (CHEOPS'24) @ EuroSys 2024
PDF
Cite
BFQ, Multiqueue-Deadline, or Kyber? Performance Characterization of Linux Storage Schedulers in the NVMe Era
ACM/SPEC International Conference on Performance Engineering (ICPE 24)
Reviving Storage Systems Education in the 21st Century — An experience report
IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing 2024
PDF
Cite
Performance Measurement of Distributed Storage on Edge Devices
International Conference on COMmunication Systems & NETworkS (COMSNETS 23)
PDF
Cite
DPFS: DPU-Powered File System Virtualization
Proceedings of the 16th ACM International Systems and Storage Conference (SYSTOR 23)
PDF
Cite
Performance Characterization of NVMe Flash Devices with Zoned Namespaces (ZNS)
2023 IEEE International Conference on Cluster Computing (CLUSTER)
CPU-free Computing: A Vision with a Blueprint
Workshop on Hot Topics in Operating Systems (HotOS)
PDF
Cite
A Trace-driven Performance Evaluation of Hash-based Task Placement Algorithms for Cache-enabled Serverless Computing
2023 ACM International Conference on Computing Frontiers (CF '23)
PDF
Cite
Performance Characterization of Modern Storage Stacks: POSIX I/O, libaio, SPDK, and io_uring
CHEOPS 2023
Can My WiFi Handle the Metaverse? A Performance Evaluation Of Meta’s Flagship Virtual Reality Hardware
ICPE HotCloudPerf 2023
PDF
Cite
Continuum: Automate Infrastructure Deployment and Benchmarking in the Compute Continuum
ICPE FastContinuum 2023
Efficiently Improving the Performance of Serverless Applications with Microtask-based Scheduling
4th International Workshop on Cloud, IoT and Fog Systems (CIFS’22) (co-located with UCC), Dec 2022
PDF
Cite
Hyperion: A Unified, Zero-CPU Data-Processing Unit (DPU)
11th Workshop on Systems for Post-Moore Architectures (SPMA’22) workshop (co-located with EuroSys), Feb 2022
PDF
Cite
Understanding modern storage APIs: a systematic study of libaio, SPDK, and io_uring
ACM SYSTOR 2022: Proceedings of the 15th ACM International Conference on Systems and Storage, June 2022, Pages 120–127
PDF
Cite
Healthor: Heterogeneity-aware Flow Control in DLTs to Increase Performance and Decentralization
ACM Journal of Distributed Ledger Technologies: Research and Practice, Accepted on July 2022.
PDF
Cite
Empirical Characterization of User Reports about Cloud Failures
ACSOS 2021
PDF
Cite
GradeML: Towards Holistic Performance Analysis for Machine Learning Workflows
HotCloudPerf 2021
PDF
Cite
Healthor: Protecting the Weak in HeterogeneousDLTs with Health-aware Flow Control
SERIAL 2020
Grade10: A Framework for Performance Characterization of Distributed Graph Processing
IEEE International Conference on Cluster Computing (CLUSTER)
PDF
Cite
Stratus: Clouds with Microarchitectural Resource Management
(joint first co-authors) 12th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud’20)
PDF
Cite
Sharing and Caring of Data at the Edge
(joint first co-authors) 3rd USENIX Workshop on Hot Topics in Edge Computing (HotEdge 2020)
PDF
Cite
Towards Supporting Millions of Users in Modifiable Virtual Environments by Redesigning Minecraft-Like Games as Serverless Systems
12th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud'20)
Unification of Temporary Storage in the NodeKernel Architecture
(accepted at) the 2019 USENIX Conference on Usenix Annual Technical Conference
PDF
Cite
The AtLarge Vision on the Design of Distributed Systems and Ecosystems.
IEEE International Conference on Distributed Computing Systems (ICDCS 2019)
PDF
Cite
Pocket: elastic ephemeral storage for serverless analytics
Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation (OSDI)
PDF
Cite
Albis: high-performance file format for big data systems
Proceedings of the 2018 USENIX Conference on Usenix Annual Technical Conference (USENIX ATC)
PDF
Cite
Understanding ephemeral storage for serverless analytics
Proceedings of the 2018 USENIX Conference on Usenix Annual Technical Conference (USENIX ATC)
PDF
Cite
FlashNet: flash/network stack co-design
ACM Transactions on Storage (TOS) Volume 14 Issue 4
PDF
Cite
FlashNet: flash/network stack co-design
Proceedings of the 10th ACM International Systems and Storage Conference (SYSTOR)
PDF
Cite
On the [ir]relevance of network performance for data processing
Proceedings of the 8th USENIX Conference on Hot Topics in Cloud Computing (HotCloud)
PDF
Cite
RStore: A Direct-Access DRAM-based Data Store
IEEE 35th International Conference on Distributed Computing Systems (ICDCS)
PDF
Cite
A Hybrid I/O Virtualization Framework for RDMA-capable Network Interfaces
Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE)
PDF
Cite
DaRPC: Data Center RPC
Proceedings of the ACM Symposium on Cloud Computing (SOCC)
PDF
Cite
On limitations of network acceleration
Proceedings of the ninth ACM conference on Emerging networking experiments and technologies (CoNEXT)
PDF
Cite
jVerbs: ultra-low latency for data center applications
Proceedings of the 4th annual Symposium on Cloud Computing (SOCC)
PDF
Cite
Unified high-performance I/O: one stack to rule them all
Proceedings of the 14th USENIX conference on Hot Topics in Operating Systems (HotOS)
PDF
Cite
Wimpy nodes with 10GbE: leveraging one-sided operations in soft-RDMA to boost memcached
Proceedings of the 2012 USENIX conference on Annual Technical Conference (USENIX ATC)
PDF
Cite
A Case for RDMA in Clouds: Turning Supercomputer Networking into Commodity
Proceedings of the 2nd ACM SIGOPS Asia-Pacific Workshop on Systems (APSys 2011)
PDF
Cite
PDF
Cite
Characterizing Energy Efficiency Trade-offs in the Linux Storage Stack for Flash-based NVMe SSDs
2026 IEEE International Symposium on Workload Characterization (IISWC)
PDF
Cite
Storage-Based Approximate Nearest Neighbor Search: What are the Performance, Cost, and I/O Characteristics?
2025 IEEE International Symposium on Workload Characterization (IISWC)
PDF
Cite
Does Linux Provide Performance Isolation for NVMe SSDs? Configuring cgroups for I/O Control in the NVMe Era
2025 IEEE International Symposium on Workload Characterization (IISWC)
An I/O Characterizing Study of Offloading LLM Models and KV Caches to NVMe SSD
5th Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems (CHEOPS'25) @ EuroSys 2025
PDF
Cite
Columbo: A Reasoning Framework for Kubernetes’ Configuration Space
16th ACM/SPEC International Conference on Performance Engineering (ICPE 2025)
PDF
Cite
Exploring GPU-to-GPU Communication Insights into Supercomputer Interconnects
2024 International Conference for High Performance Computing, Networking, Storage and Analysis (SC24)
PDF
Cite
The computing continuum: From IoT to the cloud
Internet of Things 27: 101272 (2024)
PDF
Cite
Exploring I/O Management Performance in ZNS with ConfZNS++
Proceedings of the 17th ACM International Systems and Storage Conference (SYSTOR'24)
PDF
Cite
A Systematic Configuration Space Exploration of the Linux Kyber I/O Scheduler
Workshop on Hot Topics in Cloud Computing Performance (HotCloudPerf'24@ICPE'24)
ZWAL: Rethinking Write-ahead Logs for ZNS SSDs with Zone Appends
ACM SIGOPS Operating Systems Review
PDF
Cite
ZWAL: Rethinking Write-ahead Logs for ZNS SSDs with Zone Appends
4th Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems (CHEOPS'24) @ EuroSys 2024
zns-tools: An eBPF-powered, Cross-Layer Storage Profiling Tool for NVMe ZNS SSDs
4th Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems (CHEOPS'24) @ EuroSys 2024
PDF
Cite
BFQ, Multiqueue-Deadline, or Kyber? Performance Characterization of Linux Storage Schedulers in the NVMe Era
ACM/SPEC International Conference on Performance Engineering (ICPE 24)
Reviving Storage Systems Education in the 21st Century — An experience report
IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing 2024
PDF
Cite
Performance Measurement of Distributed Storage on Edge Devices
International Conference on COMmunication Systems & NETworkS (COMSNETS 23)
PDF
Cite
DPFS: DPU-Powered File System Virtualization
Proceedings of the 16th ACM International Systems and Storage Conference (SYSTOR 23)
PDF
Cite
Performance Characterization of NVMe Flash Devices with Zoned Namespaces (ZNS)
2023 IEEE International Conference on Cluster Computing (CLUSTER)
CPU-free Computing: A Vision with a Blueprint
Workshop on Hot Topics in Operating Systems (HotOS)
PDF
Cite
A Trace-driven Performance Evaluation of Hash-based Task Placement Algorithms for Cache-enabled Serverless Computing
2023 ACM International Conference on Computing Frontiers (CF '23)
PDF
Cite
Performance Characterization of Modern Storage Stacks: POSIX I/O, libaio, SPDK, and io_uring
CHEOPS 2023
Can My WiFi Handle the Metaverse? A Performance Evaluation Of Meta’s Flagship Virtual Reality Hardware
ICPE HotCloudPerf 2023
PDF
Cite
Continuum: Automate Infrastructure Deployment and Benchmarking in the Compute Continuum
ICPE FastContinuum 2023
Efficiently Improving the Performance of Serverless Applications with Microtask-based Scheduling
4th International Workshop on Cloud, IoT and Fog Systems (CIFS’22) (co-located with UCC), Dec 2022
PDF
Cite
Hyperion: A Unified, Zero-CPU Data-Processing Unit (DPU)
11th Workshop on Systems for Post-Moore Architectures (SPMA’22) workshop (co-located with EuroSys), Feb 2022
PDF
Cite
Understanding modern storage APIs: a systematic study of libaio, SPDK, and io_uring
ACM SYSTOR 2022: Proceedings of the 15th ACM International Conference on Systems and Storage, June 2022, Pages 120–127
PDF
Cite
Healthor: Heterogeneity-aware Flow Control in DLTs to Increase Performance and Decentralization
ACM Journal of Distributed Ledger Technologies: Research and Practice, Accepted on July 2022.
PDF
Cite
Empirical Characterization of User Reports about Cloud Failures
ACSOS 2021
PDF
Cite
GradeML: Towards Holistic Performance Analysis for Machine Learning Workflows
HotCloudPerf 2021
PDF
Cite
Healthor: Protecting the Weak in HeterogeneousDLTs with Health-aware Flow Control
SERIAL 2020
Grade10: A Framework for Performance Characterization of Distributed Graph Processing
IEEE International Conference on Cluster Computing (CLUSTER)
PDF
Cite
Stratus: Clouds with Microarchitectural Resource Management
(joint first co-authors) 12th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud’20)
PDF
Cite
Sharing and Caring of Data at the Edge
(joint first co-authors) 3rd USENIX Workshop on Hot Topics in Edge Computing (HotEdge 2020)
PDF
Cite
Towards Supporting Millions of Users in Modifiable Virtual Environments by Redesigning Minecraft-Like Games as Serverless Systems
12th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud'20)
Unification of Temporary Storage in the NodeKernel Architecture
(accepted at) the 2019 USENIX Conference on Usenix Annual Technical Conference
PDF
Cite
The AtLarge Vision on the Design of Distributed Systems and Ecosystems.
IEEE International Conference on Distributed Computing Systems (ICDCS 2019)
PDF
Cite
Pocket: elastic ephemeral storage for serverless analytics
Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation (OSDI)
PDF
Cite
Albis: high-performance file format for big data systems
Proceedings of the 2018 USENIX Conference on Usenix Annual Technical Conference (USENIX ATC)
PDF
Cite
Understanding ephemeral storage for serverless analytics
Proceedings of the 2018 USENIX Conference on Usenix Annual Technical Conference (USENIX ATC)
PDF
Cite
FlashNet: flash/network stack co-design
ACM Transactions on Storage (TOS) Volume 14 Issue 4
PDF
Cite
FlashNet: flash/network stack co-design
Proceedings of the 10th ACM International Systems and Storage Conference (SYSTOR)
PDF
Cite
On the [ir]relevance of network performance for data processing
Proceedings of the 8th USENIX Conference on Hot Topics in Cloud Computing (HotCloud)
PDF
Cite
RStore: A Direct-Access DRAM-based Data Store
IEEE 35th International Conference on Distributed Computing Systems (ICDCS)
PDF
Cite
A Hybrid I/O Virtualization Framework for RDMA-capable Network Interfaces
Proceedings of the 11th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE)
PDF
Cite
DaRPC: Data Center RPC
Proceedings of the ACM Symposium on Cloud Computing (SOCC)
PDF
Cite
On limitations of network acceleration
Proceedings of the ninth ACM conference on Emerging networking experiments and technologies (CoNEXT)
PDF
Cite
jVerbs: ultra-low latency for data center applications
Proceedings of the 4th annual Symposium on Cloud Computing (SOCC)
PDF
Cite
Unified high-performance I/O: one stack to rule them all
Proceedings of the 14th USENIX conference on Hot Topics in Operating Systems (HotOS)
PDF
Cite
Wimpy nodes with 10GbE: leveraging one-sided operations in soft-RDMA to boost memcached
Proceedings of the 2012 USENIX conference on Annual Technical Conference (USENIX ATC)
PDF
Cite
A Case for RDMA in Clouds: Turning Supercomputer Networking into Commodity
Proceedings of the 2nd ACM SIGOPS Asia-Pacific Workshop on Systems (APSys 2011)
PDF
Cite
Supervised Master Theses
Edgeless: Design and Implementation of Serverless Computing at the Edge for Performance in Precision Agriculture
FrogFishDB - A Timeseries Database for in-order timeseries using the TimeTree datastructure on ash SSDs
TropoDB: Design, Implementation and Evaluation of an Optimised KV-Store for NVMe Zoned Namespace Devices
Healthor: Heterogeneity-aware Flow Control in DLTs to Increase Performance and Decentralization
Edgeless: Design and Implementation of Serverless Computing at the Edge for Performance in Precision Agriculture
FrogFishDB - A Timeseries Database for in-order timeseries using the TimeTree datastructure on ash SSDs
TropoDB: Design, Implementation and Evaluation of an Optimised KV-Store for NVMe Zoned Namespace Devices
Healthor: Heterogeneity-aware Flow Control in DLTs to Increase Performance and Decentralization
Supervised Bachelor Theses
Kavier: Exploring Performance, Sustainability, and Efficiency of LLM Ecosystems under Inference through Cache-Aware Discrete-Event Simulation
Optimizing Metadata Handling with vkFS: A Hybrid Key-Value Store File System leveraging RocksDB
Embedded Domain Specific Language: A Streamlined Approach for Framework Abstraction
Kavier: Exploring Performance, Sustainability, and Efficiency of LLM Ecosystems under Inference through Cache-Aware Discrete-Event Simulation
Optimizing Metadata Handling with vkFS: A Hybrid Key-Value Store File System leveraging RocksDB
Embedded Domain Specific Language: A Streamlined Approach for Framework Abstraction
Supervised Literature Surveys
A survey on flash storage disaggregation: performance and quality of service considerations
A Survey of Energy Measurement Methodologies for Computer Systems
Survey of Serverless Workflows
Fairness, Isolation, Predictability and Performance Management in NVMe Devices: A Survey
Exploring the Performance-Isolation Trade-off for Isolation Mechanisms
Serverless Computing at the Edge in Precise Agriculture
Literature Study: Timeseries Databases
Persistent Memory File Systems: A Survey
Key-Value Stores on Flash Storage Devices: A Survey
A survey on flash storage disaggregation: performance and quality of service considerations
A Survey of Energy Measurement Methodologies for Computer Systems
Survey of Serverless Workflows
Fairness, Isolation, Predictability and Performance Management in NVMe Devices: A Survey
Exploring the Performance-Isolation Trade-off for Isolation Mechanisms
Serverless Computing at the Edge in Precise Agriculture
Literature Study: Timeseries Databases
Persistent Memory File Systems: A Survey
Key-Value Stores on Flash Storage Devices: A Survey
Teaching
Advanced Topics in Distributed Systems, MSc, VU (2020-ongoing)
Advanced Network Programming, BSc, VU (2020-ongoing)
Storage Systems, MSc, VU (2020-ongoing)
Advanced Topics in Distributed Systems, MSc, VU (2020-ongoing)
Advanced Network Programming, BSc, VU (2020-ongoing)
Storage Systems, MSc, VU (2020-ongoing)