Commit bd28ce2
committed
feat(multimodal): report prompt prefill timings separately
- isolate MTMD prompt evaluation from text generation timings
- synchronize pending backend work at explicit multimodal phase boundaries
- measure text, image, and audio prompt chunks in one context interval
- skip additional timing synchronization for fully cached prompts
- label multimodal prompt metrics before completion resets the counters
Signed-off-by: JamePeng <jame_peng@sina.com>1 parent 161af08 commit bd28ce2
1 file changed
Lines changed: 27 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1170 | 1170 | | |
1171 | 1171 | | |
1172 | 1172 | | |
| 1173 | + | |
| 1174 | + | |
| 1175 | + | |
| 1176 | + | |
| 1177 | + | |
| 1178 | + | |
| 1179 | + | |
| 1180 | + | |
| 1181 | + | |
| 1182 | + | |
| 1183 | + | |
| 1184 | + | |
| 1185 | + | |
| 1186 | + | |
1173 | 1187 | | |
1174 | 1188 | | |
1175 | 1189 | | |
| |||
1194 | 1208 | | |
1195 | 1209 | | |
1196 | 1210 | | |
| 1211 | + | |
1197 | 1212 | | |
1198 | 1213 | | |
1199 | 1214 | | |
| |||
1256 | 1271 | | |
1257 | 1272 | | |
1258 | 1273 | | |
| 1274 | + | |
| 1275 | + | |
| 1276 | + | |
| 1277 | + | |
| 1278 | + | |
| 1279 | + | |
| 1280 | + | |
| 1281 | + | |
| 1282 | + | |
| 1283 | + | |
| 1284 | + | |
| 1285 | + | |
1259 | 1286 | | |
1260 | 1287 | | |
1261 | 1288 | | |
| |||
0 commit comments