FlexLLM: Composable HLS Library for Flexible Hybrid LLM Accelerator Design

This paper introduces FlexLLM, a composable High-Level Synthesis (HLS) library designed for flexible hybrid Large Language Model (LLM) accelerator design. It aims to streamline the development of efficient and adaptable hardware for LLM inference, addressing the growing computational demands of state-of-the-art AI models for real-world deployment.