The Rise of Open Source LLMs

September 20, 2023

When Meta released LLaMA 2 in July 2023, it was a watershed moment for the AI community. For the first time, a state-of-the-art large language model was available under a permissive license that allowed commercial use. The implications were enormous.

Why Open Source Matters

Before LLaMA 2, if you wanted to build with a capable LLM, your options were limited: pay for API access to OpenAI's GPT-4 or GPT-3.5, or use one of the smaller, less capable open models. This created a dependency on a handful of companies and made it impossible to run models on your own infrastructure for privacy-sensitive use cases.

LLaMA 2 changed this overnight. Available in 7B, 13B, and 70B parameter sizes, it offered performance competitive with GPT-3.5 while running on hardware you control. The 7B model could even run on consumer GPUs.

The Ecosystem Explosion

What happened next was remarkable. Within weeks of LLaMA 2's release:

  • Fine-tuning frameworks like QLoRA made it possible to customize models on a single GPU
  • Quantization tools like GPTQ and GGML shrunk models to run on laptops and even phones
  • Community fine-tunes appeared on Hugging Face daily — models tuned for coding, conversation, instruction following, and more
  • Code Llama followed in August, giving developers an open source coding assistant rivaling GitHub Copilot

What This Means for Turkey

For the Turkish AI community, open source LLMs are particularly significant. They enable:

  1. Turkish language fine-tuning — adapting models for Turkish without relying on API providers who may deprioritize non-English languages
  2. Data sovereignty — running models locally means sensitive data never leaves your infrastructure
  3. Cost control — no per-token API costs, just compute

We are seeing Turkish researchers and engineers already building on top of LLaMA 2, creating models better suited to our language and use cases. This is just the beginning.

Looking Ahead

The open source LLM race is accelerating. Mistral AI, a French startup, has already released competitive models. The gap between open and closed models is narrowing with every release. We expect 2024 to bring even more capable open models, and the Turkish AI community is well-positioned to contribute to and benefit from this movement.

The era of AI being locked behind a few API endpoints is ending. The future is open.