Hi, thanks a lot for replying. Here’s a few logs, please let me know if this is enough
2025-07-15 15:21:30.519 [info] CPP Request Log with id be184b96-2a15-4d74-be4e-ccd504178719
2025-07-15 15:21:30.519 [info] =======>Model output
2025-07-15 15:21:30.519 [info] =======>Debug stream time 338.7377339999657
2025-07-15 15:21:30.519 [info] =======>Debug ttft time 338.1100999999326
2025-07-15 15:21:30.523 [info] Average of latest 20 ttft time 220.99147584994063
2025-07-15 15:21:30.523 [info] Average of latest 20 stream time 539.743240500013
2025-07-15 15:21:30.523 [info] Average of latest 20 total time NaN
2025-07-15 15:21:30.523 [info] Average of latest 20 client time 2869.6821411132814
2025-07-15 15:21:30.523 [info] Average of latest 20 discrepencies NaN
2025-07-15 15:21:30.523 [info] CPP RT LOG: All stats {"streamingtime":2698.388427734375,"actualTtftFromStart":31355784.68334961,"timeTillServerRequest":31353420.588867188,"requestToTtft":2364.094482421875,"totalTime":31356118.970947266}
2025-07-15 15:22:04.789 [info] CURSOR LOG: requestId 653034af-2cb9-43a7-bf36-74d3df588c01
2025-07-15 15:22:08.122 [info] CURSOR LOG: Done streaming cpp with id 653034af-2cb9-43a7-bf36-74d3df588c01
2025-07-15 15:22:08.122 [info] CPP RT LOG: Time taken for streaming cpp 3333.618408203125 with request 653034af-2cb9-43a7-bf36-74d3df588c01
2025-07-15 15:22:08.122 [info] CPP Request Log with id 653034af-2cb9-43a7-bf36-74d3df588c01
2025-07-15 15:22:08.122 [info] =======>Model output
2025-07-15 15:22:08.122 [info] =======>Debug stream time 607.9775650000665
2025-07-15 15:22:08.122 [info] =======>Debug ttft time 433.3792189999949
2025-07-15 15:22:08.123 [info] Average of latest 20 ttft time 232.875030999961
2025-07-15 15:22:08.123 [info] Average of latest 20 stream time 568.2252095000047
2025-07-15 15:22:08.123 [info] Average of latest 20 total time NaN
2025-07-15 15:22:08.123 [info] Average of latest 20 client time 2897.50703125
2025-07-15 15:22:08.123 [info] Average of latest 20 discrepencies NaN
2025-07-15 15:22:08.123 [info] CPP RT LOG: All stats {"streamingtime":3333.618408203125,"actualTtftFromStart":31356166.619628906,"timeTillServerRequest":31353432.625,"requestToTtft":2733.99462890625,"totalTime":31356766.22241211}
Will be happy to share any additional info if needed