LlamaLineage

OpenSource LanguageModels, derived from Facebook's original leaked LlaMA model.

https://ai.facebook.com/blog/large-language-model-llama-meta-ai/

https://www.marktechpost.com/2023/07/10/meet-longllama-a-large-language-model-capable-of-handling-long-contexts-of-256k-tokens/

Llama accessed from CPlusPlus : https://github.com/ggerganov/llama.cpp

LongLlama has context window of 256k https://www.marktechpost.com/2023/07/10/meet-longllama-a-large-language-model-capable-of-handling-long-contexts-of-256k-tokens/

Llema is a math focused derivative: https://venturebeat.com/ai/meet-llemma-the-math-focused-open-source-ai-that-outperforms-rivals/