:::success DB-GPT提供了一系列的工具来帮助开发者排除故障并解决可能遇到的一些问题。
:::
Trace日志
DB-GPT将一些关键的系统运行时信息写入跟踪日志中，默认情况下，他们位于logs/dbgpt*.jsonl中。
DB-GPT还提供了一个命令行工具dbgpt trace 来帮助分析这些跟踪日志。 可以通过如下命令查看具体的用法：
dbgpt trace --help
查看聊天详情
可以通过dbgpt trace chat 命令查看聊天详情。默认会显示最新的对话信息。
查看服务运行时信息
dbgpt trace chat --hide_conv
可以看到如下输出:
+------------------------+--------------------------+-----------------------------+------------------------------------+| Config Key (Webserver) | Config Value (Webserver) | Config Key (EmbeddingModel) | Config Value (EmbeddingModel) |+------------------------+--------------------------+-----------------------------+------------------------------------+| host | 0.0.0.0 | model_name | text2vec || port | 5000 | model_path | /app/models/text2vec-large-chinese || daemon | False | device | cuda || share | False | normalize_embeddings | None || remote_embedding | False | | || log_level | None | | || light | False | | |+------------------------+--------------------------+-----------------------------+------------------------------------++--------------------------+-----------------------------+----------------------------+------------------------------+| Config Key (ModelWorker) | Config Value (ModelWorker) | Config Key (WorkerManager) | Config Value (WorkerManager) |+--------------------------+-----------------------------+----------------------------+------------------------------+| model_name | vicuna-13b-v1.5 | model_name | vicuna-13b-v1.5 || model_path | /app/models/vicuna-13b-v1.5 | model_path | /app/models/vicuna-13b-v1.5 || device | cuda | worker_type | None || model_type | huggingface | worker_class | None || prompt_template | None | model_type | huggingface || max_context_size | 4096 | host | 0.0.0.0 || num_gpus | None | port | 5000 || max_gpu_memory | None | daemon | False || cpu_offloading | False | limit_model_concurrency | 5 || load_8bit | False | standalone | True || load_4bit | False | register | True || quant_type | nf4 | worker_register_host | None || use_double_quant | True | controller_addr | http://127.0.0.1:5000 || compute_dtype | None | send_heartbeat | True || trust_remote_code | True | heartbeat_interval | 20 || verbose | False | log_level | None |+--------------------------+-----------------------------+----------------------------+------------------------------+
查看最新对话信息
dbgpt trace chat --hide_run_params
输出如下
+-------------------------------------------------------------------------------------------------------------------------------------------+| Chat Trace Details |+----------------+--------------------------------------------------------------------------------------------------------------------------+| Key | Value Value |+----------------+--------------------------------------------------------------------------------------------------------------------------+| trace_id | 5d1900c3-5aad-4159-9946-fbb600666530 || span_id | 5d1900c3-5aad-4159-9946-fbb600666530:14772034-bed4-4b4e-b43f-fcf3a8aad6a7 || conv_uid | 5e456272-68ac-11ee-9fba-0242ac150003 || user_input | Who are you? || chat_mode | chat_normal || select_param | None || model_name | vicuna-13b-v1.5 || temperature | 0.6 || max_new_tokens | 1024 || echo | False || llm_adapter | FastChatLLMModelAdaperWrapper(fastchat.model.model_adapter.VicunaAdapter) || User prompt | A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polit || | e answers to the user's questions. USER: Who are you? ASSISTANT: || Model output | You can call me Vicuna, and I was trained by Large Model Systems Organization (LMSYS) researchers as a language model. |+----------------+--------------------------------------------------------------------------------------------------------------------------+
查看聊天详情和调用链
dbgpt trace chat --hide_run_params --tree
可以看到如下输出
Invoke Trace Tree:Operation: DB-GPT-Web-Entry (Start: 2023-10-12 03:06:43.180, End: None)Operation: get_chat_instance (Start: 2023-10-12 03:06:43.258, End: None)Operation: get_chat_instance (Start: 2023-10-12 03:06:43.258, End: 2023-10-12 03:06:43.424)Operation: stream_generator (Start: 2023-10-12 03:06:43.425, End: None)Operation: BaseChat.stream_call (Start: 2023-10-12 03:06:43.426, End: None)Operation: WorkerManager.generate_stream (Start: 2023-10-12 03:06:43.426, End: None)Operation: DefaultModelWorker.generate_stream (Start: 2023-10-12 03:06:43.428, End: None)Operation: DefaultModelWorker_call.generate_stream_func (Start: 2023-10-12 03:06:43.430, End: None)Operation: DefaultModelWorker_call.generate_stream_func (Start: 2023-10-12 03:06:43.430, End: 2023-10-12 03:06:48.518)Operation: DefaultModelWorker.generate_stream (Start: 2023-10-12 03:06:43.428, End: 2023-10-12 03:06:48.518)Operation: WorkerManager.generate_stream (Start: 2023-10-12 03:06:43.426, End: 2023-10-12 03:06:48.518)Operation: BaseChat.stream_call (Start: 2023-10-12 03:06:43.426, End: 2023-10-12 03:06:48.519)Operation: stream_generator (Start: 2023-10-12 03:06:43.425, End: 2023-10-12 03:06:48.519)Operation: DB-GPT-Web-Entry (Start: 2023-10-12 03:06:43.180, End: 2023-10-12 03:06:43.257)+-------------------------------------------------------------------------------------------------------------------------------------------+| Chat Trace Details |+----------------+--------------------------------------------------------------------------------------------------------------------------+| Key | Value Value |+----------------+--------------------------------------------------------------------------------------------------------------------------+| trace_id | 5d1900c3-5aad-4159-9946-fbb600666530 || span_id | 5d1900c3-5aad-4159-9946-fbb600666530:14772034-bed4-4b4e-b43f-fcf3a8aad6a7 || conv_uid | 5e456272-68ac-11ee-9fba-0242ac150003 || user_input | Who are you? || chat_mode | chat_normal || select_param | None || model_name | vicuna-13b-v1.5 || temperature | 0.6 || max_new_tokens | 1024 || echo | False || llm_adapter | FastChatLLMModelAdaperWrapper(fastchat.model.model_adapter.VicunaAdapter) || User prompt | A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polit || | e answers to the user's questions. USER: Who are you? ASSISTANT: || Model output | You can call me Vicuna, and I was trained by Large Model Systems Organization (LMSYS) researchers as a language model. |+----------------+--------------------------------------------------------------------------------------------------------------------------+
根据trace_id查看聊天详情
dbgpt trace chat --hide_run_params --trace_id ec30d733-7b35-4d61-b02e-2832fd2e29ff
输出如下
+-------------------------------------------------------------------------------------------------------------------------------------------+| Chat Trace Details |+----------------+--------------------------------------------------------------------------------------------------------------------------+| Key | Value Value |+----------------+--------------------------------------------------------------------------------------------------------------------------+| trace_id | ec30d733-7b35-4d61-b02e-2832fd2e29ff || span_id | ec30d733-7b35-4d61-b02e-2832fd2e29ff:0482a0c5-38b3-4b38-8101-e42489f90ccd || conv_uid | 87a722de-68ae-11ee-9fba-0242ac150003 || user_input | Hello || chat_mode | chat_normal || select_param | None || model_name | vicuna-13b-v1.5 || temperature | 0.6 || max_new_tokens | 1024 || echo | False || llm_adapter | FastChatLLMModelAdaperWrapper(fastchat.model.model_adapter.VicunaAdapter) || User prompt | A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polit || | e answers to the user's questions. USER: Hello ASSISTANT: || Model output | Hello! How can I help you today? Is there something specific you want to know or talk about? I'm here to answer any ques || | tions you might have, to the best of my ability. |+----------------+--------------------------------------------------------------------------------------------------------------------------+
更多chat命令用法
dbgpt trace chat --help
Usage: dbgpt trace chat [OPTIONS] [FILES]...Show conversation detailsOptions:--trace_id TEXT Specify the trace ID to analyze. If None,show latest conversation details--tree Display trace spans as a tree--hide_conv Hide your conversation details--hide_run_params Hide run params--output [text|html|csv|latex|json]The output format--help Show this message and exit.
根据trace_id查看调用树
dbgpt trace tree --trace_id ec30d733-7b35-4d61-b02e-2832fd2e29ff
输出如下：
Operation: DB-GPT-Web-Entry (Start: 2023-10-12 03:22:10.592, End: None)Operation: get_chat_instance (Start: 2023-10-12 03:22:10.594, End: None)Operation: get_chat_instance (Start: 2023-10-12 03:22:10.594, End: 2023-10-12 03:22:10.658)Operation: stream_generator (Start: 2023-10-12 03:22:10.659, End: None)Operation: BaseChat.stream_call (Start: 2023-10-12 03:22:10.659, End: None)Operation: WorkerManager.generate_stream (Start: 2023-10-12 03:22:10.660, End: None)Operation: DefaultModelWorker.generate_stream (Start: 2023-10-12 03:22:10.675, End: None)Operation: DefaultModelWorker_call.generate_stream_func (Start: 2023-10-12 03:22:10.676, End: None)Operation: DefaultModelWorker_call.generate_stream_func (Start: 2023-10-12 03:22:10.676, End: 2023-10-12 03:22:16.130)Operation: DefaultModelWorker.generate_stream (Start: 2023-10-12 03:22:10.675, End: 2023-10-12 03:22:16.130)Operation: WorkerManager.generate_stream (Start: 2023-10-12 03:22:10.660, End: 2023-10-12 03:22:16.130)Operation: BaseChat.stream_call (Start: 2023-10-12 03:22:10.659, End: 2023-10-12 03:22:16.130)Operation: stream_generator (Start: 2023-10-12 03:22:10.659, End: 2023-10-12 03:22:16.130)Operation: DB-GPT-Web-Entry (Start: 2023-10-12 03:22:10.592, End: 2023-10-12 03:22:10.673)
列出Trace信息
列出所有的Trace信息
dbgpt trace list
输出如下
+--------------------------------------+---------------------------------------------------------------------------+-----------------------------------+------------------+| Trace ID | Span ID | Operation Name | Conversation UID |+--------------------------------------+---------------------------------------------------------------------------+-----------------------------------+------------------+| eaf4830f-976f-45a4-9a50-244f3ab6f9e1 | eaf4830f-976f-45a4-9a50-244f3ab6f9e1:f650065f-f761-4790-99f7-8109c15f756a | run_webserver | None || eaf4830f-976f-45a4-9a50-244f3ab6f9e1 | eaf4830f-976f-45a4-9a50-244f3ab6f9e1:b2ff279e-0557-4b2d-8959-85e25dcfe94e | EmbeddingLoader.load | None || eaf4830f-976f-45a4-9a50-244f3ab6f9e1 | eaf4830f-976f-45a4-9a50-244f3ab6f9e1:b2ff279e-0557-4b2d-8959-85e25dcfe94e | EmbeddingLoader.load | None || eaf4830f-976f-45a4-9a50-244f3ab6f9e1 | eaf4830f-976f-45a4-9a50-244f3ab6f9e1:3e8b1b9d-5ef2-4382-af62-6b2b21cc04fd | WorkerManager._start_local_worker | None || eaf4830f-976f-45a4-9a50-244f3ab6f9e1 | eaf4830f-976f-45a4-9a50-244f3ab6f9e1:3e8b1b9d-5ef2-4382-af62-6b2b21cc04fd | WorkerManager._start_local_worker | None || eaf4830f-976f-45a4-9a50-244f3ab6f9e1 | eaf4830f-976f-45a4-9a50-244f3ab6f9e1:4c280ec9-0fd6-4ee8-b79f-1afcab0f9901 | DefaultModelWorker.start | None |+--------------------------------------+---------------------------------------------------------------------------+-----------------------------------+------------------+
根据Trace类型查看trace信息
dbgpt trace list --span_type chat+--------------------------------------+---------------------------------------------------------------------------+-------------------+--------------------------------------+| Trace ID | Span ID | Operation Name | Conversation UID |+--------------------------------------+---------------------------------------------------------------------------+-------------------+--------------------------------------+| 5d1900c3-5aad-4159-9946-fbb600666530 | 5d1900c3-5aad-4159-9946-fbb600666530:14772034-bed4-4b4e-b43f-fcf3a8aad6a7 | get_chat_instance | 5e456272-68ac-11ee-9fba-0242ac150003 || 5d1900c3-5aad-4159-9946-fbb600666530 | 5d1900c3-5aad-4159-9946-fbb600666530:14772034-bed4-4b4e-b43f-fcf3a8aad6a7 | get_chat_instance | 5e456272-68ac-11ee-9fba-0242ac150003 || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:0482a0c5-38b3-4b38-8101-e42489f90ccd | get_chat_instance | 87a722de-68ae-11ee-9fba-0242ac150003 || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:0482a0c5-38b3-4b38-8101-e42489f90ccd | get_chat_instance | 87a722de-68ae-11ee-9fba-0242ac150003 |+--------------------------------------+---------------------------------------------------------------------------+-------------------+--------------------------------------+
搜索Trace信息
dbgpt trace list --search Hello+--------------------------------------+---------------------------------------------------------------------------+----------------------------------------------+--------------------------------------+| Trace ID | Span ID | Operation Name | Conversation UID |+--------------------------------------+---------------------------------------------------------------------------+----------------------------------------------+--------------------------------------+| ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:0482a0c5-38b3-4b38-8101-e42489f90ccd | get_chat_instance | 87a722de-68ae-11ee-9fba-0242ac150003 || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:0482a0c5-38b3-4b38-8101-e42489f90ccd | get_chat_instance | 87a722de-68ae-11ee-9fba-0242ac150003 || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:03de6c87-34d6-426a-85e8-7d46d475411e | BaseChat.stream_call | None || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:03de6c87-34d6-426a-85e8-7d46d475411e | BaseChat.stream_call | None || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:19593596-b4c7-4d15-a3c1-0924d86098dd | DefaultModelWorker_call.generate_stream_func | None || ec30d733-7b35-4d61-b02e-2832fd2e29ff | ec30d733-7b35-4d61-b02e-2832fd2e29ff:19593596-b4c7-4d15-a3c1-0924d86098dd | DefaultModelWorker_call.generate_stream_func | None |+--------------------------------------+---------------------------------------------------------------------------+----------------------------------------------+--------------------------------------+
更多list相关命令用法
dbgpt trace list --helpUsage: dbgpt trace list [OPTIONS] [FILES]...List your trace spansOptions:--trace_id TEXT Specify the trace ID to list--span_id TEXT Specify the Span ID to list.--span_type TEXT Specify the Span Type to list.--parent_span_id TEXT Specify the Parent Span ID to list.--search TEXT Search trace_id, span_id, parent_span_id,operation_name or content in metadata.-l, --limit INTEGER Limit the number of recent span displayed.--start_time TEXT Filter by start time. Format: "YYYY-MM-DDHH:MM:SS.mmm"--end_time TEXT Filter by end time. Format: "YYYY-MM-DDHH:MM:SS.mmm"--desc Whether to use reverse sorting. By default,sorting is based on start time.--output [text|html|csv|latex|json]The output format--help Show this message and exit.
若有收获，就点个赞吧
0 人点赞
