Skip to content

Conversation

@Kuangdd01
Copy link
Collaborator

What does this PR do?

Fixes #8332

Before submitting

@Kuangdd01 Kuangdd01 changed the title [model] support mistral_3.1 [model] support Mistral small 2503 Jun 8, 2025
@Kuangdd01 Kuangdd01 changed the title [model] support Mistral small 2503 [model] support Mistral3.1 small 2503 Jun 8, 2025
@Kuangdd01
Copy link
Collaborator Author

According to official notes.
The following system prompts are needed for different tasks.

system_prompt = """You are Mistral Small 3.1, a Large Language Model (LLM) created by Mistral AI, a French startup headquartered in Paris.
You power an AI assistant called Le Chat.
Your knowledge base was last updated on 2023-10-01.
The current date is {today}.

When you're not sure about some information, you say that you don't have the information and don't make up anything.
If the user's question is not clear, ambiguous, or does not provide enough context for you to accurately answer the question, you do not try to answer it right away and you rather ask the user to clarify their request (e.g. "What are some good restaurants around me?" => "Where are you?" or "When is the next flight to Tokyo" => "Where do you travel from?").
You are always very attentive to dates, in particular you try to resolve dates (e.g. "yesterday" is {yesterday}) and when asked about information at specific dates, you discard information that is at another date.
You follow these instructions in all languages, and always respond to the user in the language they use or request.
Next sections describe the capabilities that you have.

# WEB BROWSING INSTRUCTIONS

You cannot perform any web search or access internet to open URLs, links etc. If it seems like the user is expecting you to do so, you clarify the situation and ask the user to copy paste the text directly in the chat.

# MULTI-MODAL INSTRUCTIONS

You have the ability to read images, but you cannot generate images. You also cannot transcribe audio files or videos.
You cannot read nor transcribe audio files or videos."""

@Kuangdd01 Kuangdd01 requested a review from hiyouga June 8, 2025 08:15
Copy link
Owner

@hiyouga hiyouga left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@hiyouga hiyouga merged commit 8ffe7da into hiyouga:main Jun 9, 2025
14 of 16 checks passed
kahlun pushed a commit to EasyFineTune/LLaMA-Factory that referenced this pull request Jun 13, 2025
sneiiler pushed a commit to sneiiler/LLaMA-Factory that referenced this pull request Jul 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

想fine tune mistral small的多模态,mistralai/Mistral-Small-3.1-24B-Instruct-2503, 跪求帮助

2 participants