language:

• pt license: apache-2.0 library_name: transformers tags:
• 葡萄牙语
• 巴西
• gemma
• 葡萄牙文
• 指令 datasets:
• rhaymison/superset pipeline_tag: text-generation widget:
• text: 请向我解释计算机的工作原理。 example_title: 计算机
• text: 请讲述人类登月的故事。 example_title: 人类登月
• text: 讲述一个关于世界历史的趣闻 example_title: 历史
• text: 写一首关于太阳和花朵的优美诗歌 example_title: 创作诗歌 model-index:
• name: gemma-portuguese-luana-2b results:
  • task: type: text-generation name: 文本生成 dataset: name: ENEM挑战赛（无图像） type: eduagarcia/enem_challenge split: train args: num_few_shot: 3 metrics:
    • type: acc value: 24.42 name: 准确率 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: BLUEX（无图像） type: eduagarcia-temp/BLUEX_without_images split: train args: num_few_shot: 3 metrics:
    • type: acc value: 24.34 name: 准确率 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: OAB律师资格考试 type: eduagarcia/oab_exams split: train args: num_few_shot: 3 metrics:
    • type: acc value: 27.11 name: 准确率 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: Assin2 RTE type: assin2 split: test args: num_few_shot: 15 metrics:
    • type: f1_macro value: 70.86 name: 宏观F1分数 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: Assin2 STS type: eduagarcia/portuguese_benchmark split: test args: num_few_shot: 15 metrics:
    • type: pearson value: 1.51 name: 皮尔逊相关系数 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: FaQuAD NLI type: ruanchaves/faquad-nli split: test args: num_few_shot: 15 metrics:
    • type: f1_macro value: 43.97 name: 宏观F1分数 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: HateBR二元分类 type: ruanchaves/hatebr split: test args: num_few_shot: 25 metrics:
    • type: f1_macro value: 40.05 name: 宏观F1分数 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: 葡萄牙语仇恨言论二元分类 type: hate_speech_portuguese split: test args: num_few_shot: 25 metrics:
    • type: f1_macro value: 51.83 name: 宏观F1分数 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜
  • task: type: text-generation name: 文本生成 dataset: name: tweetSentBR type: eduagarcia/tweetsentbr_fewshot split: test args: num_few_shot: 25 metrics:
    • type: f1_macro value: 30.42 name: 宏观F1分数 source: url: https://huggingface.co/spaces/eduagarcia/open_pt_llm_leaderboard?query=rhaymison/gemma-portuguese-luana-2b name: 葡萄牙语LLM公开排行榜

gemma-葡萄牙语-2b-luana模型