Kolibri Has Landed: A Sovereign Open-Weight Model — Aleph Alpha
aleph-alpha.com
Kolibri is an English-German Mixture-of-Experts model with 78B total and 3B active parameters, a context of up to 1M tokens and open weights under Apache 2.0, specialized for sovereign, mission-critical work.
  • lobsters__tombh@crustaceanson.theshelf.topM
    1·
    11 days ago

    Aleph Alpha, along with other notable AI companies like Anthropic and OpenAI, are signatories to the EU’s General-Purpose AI Code Of Practice[1]. In Section 1.4 they address LLM output:

    Measure 1.4, Mitigate the risk of copyright-infringing outputs

    (1) In order to mitigate the risk that a downstream AI system, into which a general-purpose AI model is integrated, generates output that may infringe rights in works or other subject matter protected by Union law on copyright or related rights, Signatories commit:

    • a) to implement appropriate and proportionate technical safeguards to prevent their models from generating outputs that reproduce training content protected by Union law on copyright and related rights in an infringing manner, and

    • b) to prohibit copyright-infringing uses of a model in their acceptable use policy, terms and conditions, or other equivalent documents, or in case of general-purpose AI models released under free and open source licenses to alert users to the prohibition of copyright infringing uses of the model in the documentation accompanying the model without prejudice to the free and open source nature of the license.

    In the paper, LiCoEval: Evaluating LLMs on License Compliance in Code Generation[2], they conclude that:

    Using LiCoEval, we evaluate 14 popular LLMs, finding that even top-performing LLMs produce a non-negligible proportion (0.88% to 2.01%) of code strikingly similar to existing open-source implementations. Notably, most LLMs fail to provide accurate license information, particularly for code under copyleft licenses.

    I can’t vouch for the percentages, but I can say I’ve never seen or heard of an LLM providing licensing information for the code it generates. I know it’s just a code of practice and not law, but I don’t think anybody is even attempting to honour Section 1.4.

    1. https://digital-strategy.ec.europa.eu/en/policies/contents-code-gpai
    2. https://arxiv.org/html/2408.02487v3

    score 2 · canonical