Small But Mighty: Small Language Models Breakthroughs in the Era of Dominant Large Language Models

In the ever-evolving domain of Artificial Intelligence (AI), where models like GPT-3 have been dominant for a long time, a silent but groundbreaking shift is taking place. Small Language Models (SLM) are emerging and challenging the prevailing narrative of their larger counterparts. GPT 3 and similar Large Language Models (LLM), such as BERT, famous for its bidirectional context understanding, T-5 with its text-to-text approach, and XLNet, which combines autoregressive and autoencoding…