“We Have No Moat”: Tracking the Exponential Growth of Open Source LLM Performance (Latency and Throughout)

Like the Unix, Solaris, Irix, AIX Open Source operating systems that became the Linux-led open source operating system and the broader open source software movement (over a 30 to 40 year time period) the open source large language model “market” is poised to eat up market share in an exponentially fast time frame. Hugging Face has created an “Open LLM-Perf Leaderboard”  for your organization to track, quantify and evaluate this exponential growth of LLM performance.