Microsoft, in partnership with OpenAI, has been steadily implementing AI capabilities in its products and services and also building smaller case-specific models. Microsoft Research unveiled a new AI model called Orca, which learns by imitating large language models. According to the research paper, Orca is designed to overcome the limitations of smaller models by imitating the reasoning processes of large foundation models like GPT-4.
Language models like Orca can be optimized for specific…
Read the full article here