🚀 Tiny-Agent-α

Tiny-Agent-α 是 Dria-Agent-a 的扩展，它基于 Qwen2.5-Coder 系列模型进行训练，可用于边缘设备。这些模型通过量化感知训练进行了精细微调，以最大程度减少量化后的性能损失。

Tiny-Agent-α 采用了 Python 函数调用 方式，即大语言模型（LLMs）使用 Python 代码块与提供的工具进行交互并输出操作。这种方法受到了许多先前工作的启发，包括但不限于 DynaSaur、RLEF、ADAS 和 CAMEL。与传统的基于 JSON 的函数调用方法相比，这种函数调用方式具有以下优势：

1. 一次性并行多函数调用：该模型可以在一次对话中利用多个同步进程来找到解决方案，而其他函数调用模型可能需要多次对话才能实现。
2. 自由形式的推理和操作：模型可以自然地以自然语言提供推理过程，并在 ```python ``` 代码块中输出操作，无需特殊提示或调整。这有助于缓解在 Let Me Speak Freely? 中讨论的对大语言模型输出施加特定格式可能导致的性能损失。
3. 即时生成复杂解决方案：模型提供的解决方案本质上是一个 Python 程序，但排除了一些“危险”的内置函数，如 exec、eval 和 compile（完整列表见下面的快速开始部分）。这使得模型能够通过条件语句和同步管道（在下一个函数的参数中使用前一个函数的输出）实现自定义的复杂逻辑，而目前基于 JSON 的函数调用方法（据我们所知）无法做到这一点。

🚀 快速开始

你可以使用 dria_agent 包轻松使用 Tiny-Agent-α：

pip install dria_agent

这个包可以处理模型、工具、代码执行和后端（支持 mlx、ollama 和 transformers）。

💻 使用示例

基础用法

使用 @tool 装饰器将函数暴露给代理：

from dria_agent import tool

@tool
def check_availability(day: str, start_time: str, end_time: str) -> bool:
    """
    Checks if a given time slot is available.

    :param day: The date in "YYYY-MM-DD" format.
    :param start_time: The start time of the desired slot (HH:MM format, 24-hour).
    :param end_time: The end time of the desired slot (HH:MM format, 24-hour).
    :return: True if the slot is available, otherwise False.
    """
    # Mock implementation
    if start_time == "12:00" and end_time == "13:00":
        return False
    return True

创建一个带有自定义工具的代理：

from dria_agent import ToolCallingAgent

agent = ToolCallingAgent(
    tools=[check_availability]
)

使用 agent.run(query) 结合工具执行任务：

execution = agent.run("Check my calendar for tomorrow noon", print_results=True)

输出如下：

let me help you check your availability for a 1-hour meditation session       
starting at noon tomorrow.                                                    
                                                                                
Step-by-step reasoning:                                                       
 1. We need to check availability for a specific time slot (noon)              
 2. The duration is 1 hour, so we'll use the same start and end times          
 3. Since it's tomorrow, we should format the date as "YYYY-MM-DD"             
 4. Use the check_availability() function with these parameters                
                                                                                
Here's the code to check your availability:                                   
                                                                                
```python                                                                     
tomorrow = (datetime.now() + timedelta(days=1)).strftime("%Y-%m-%d")          
start_time = "12:00"  # Noon in 24-hour format                                
end_time = "13:00"   # One hour after noon                                    
                                                                                
availability = check_availability(tomorrow, start_time, end_time)             

The code will:

• Calculate tomorrow's date using datetime and timedelta
• Set the time slot to noon (12:00) for 1 hour duration
• Check if this time slot is available using the check_availability function

The availability variable will contain True if you're available, or False if
not.

如果使用 `dria_agent`，系统提示和工具可以直接使用，无需额外设置。

你也可以直接使用 `transformers` 库来使用 Tiny-Agent-α-3B：

```python
import json
from typing import Any, Dict, List
from transformers import AutoModelForCausalLM, AutoTokenizer

# Load model and tokenizer
model_name = "driaforall/Tiny-Agent-a-3B"
model = AutoModelForCausalLM.from_pretrained(
    model_name, device_map="auto", torch_dtype="auto", trust_remote_code=True
)
tokenizer = AutoTokenizer.from_pretrained(model_name)

# System prompt for optimal performance
SYSTEM_PROMPT = """
You are an expert AI assistant that specializes in providing Python code to solve the task/problem at hand provided by the user.

You can use Python code freely, including the following available functions:

<|functions_schema|>
{{functions_schema}}
<|end_functions_schema|>

The following dangerous builtins are restricted for security:
- exec
- eval
- execfile
- compile
- importlib
- input
- exit

Think step by step and provide your reasoning, outside of function calls.
You can write Python code and use the available functions. Provide all your Python code in a SINGLE markdown code block.

DO NOT use print() statements AT ALL. Avoid mutating variables whenever possible.
""".strip()

# Example function schema (define the functions available to the model)
FUNCTIONS_SCHEMA = """
def check_availability(day: str, start_time: str, end_time: str) -> bool:
    """
    Checks if a given time slot is available.

    :param day: The date in "YYYY-MM-DD" format.
    :param start_time: The start time of the desired slot (HH:MM format, 24-hour).
    :param end_time: The end time of the desired slot (HH:MM format, 24-hour).
    :return: True if the slot is available, otherwise False.
    """
    pass
"""

# Format system prompt
system_prompt = SYSTEM_PROMPT.replace("{{functions_schema}}", FUNCTIONS_SCHEMA)

# Example user query
USER_QUERY = "Check if I'm available for an hour long meditation at tomorrow noon."

# Format messages for the model
messages = [
    {"role": "system", "content": system_prompt},
    {"role": "user", "content": USER_QUERY},
]

# Prepare input for the model
text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)

# Generate response
generated_ids = model.generate(
    **model_inputs,
    max_new_tokens=512
)

# Extract new generated tokens
generated_ids = [
    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]

# Decode response
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
print(response)

📊 评估与性能

我们在 Dria-Pythonic-Agent-Benchmark (DPAB) 上对模型进行了评估。这个基准测试是我们通过合成数据生成、基于模型的验证、过滤和手动选择精心策划的，用于评估大语言模型的 Python 函数调用能力，涵盖了多个场景和任务。更多信息请参阅 博客。

以下是 DPAB 的评估结果：

当前各种模型的基准测试结果（严格模式）：

📄 引用

@misc{Dria-Agent-a,
      url={https://huggingface.co/blog/andthattoo/dria-agent-a},
      title={Dria-Agent-a},
      author={"andthattoo", "Atakan Tekparmak"}
}

📄 许可证

本项目采用 qwen-research 许可证。