Recent advancements in large language models (LLMs) have enabled the creation of sophisticated agentic systems that utilize tools and APIs to answer user queries through function calling. However, deploying these models on edge devices remains largely unexplored due to their significant size and high computational requirements, which generally necessitate cloud-based infrastructure.
In a new paper TinyAgent: Function Calling at the Edge, a research team from UC Berkeley and ICSI…
Read the full article here