You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-07 - 09:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot3s.osadl.org (updated Fri Feb 07, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137262318305,10sleep10-21swapper/119:09:521
137282315307,5sleep30-21swapper/319:09:543
134162315308,5sleep20-21swapper/219:05:522
136702314308,4sleep00-21swapper/019:09:070
14004993110,310cyclictest30196-21kworker/u16:3+efi_rts_wq20:00:131
14004993110,310cyclictest15469-21kworker/u16:2+efi_rts_wq23:45:491
14003993090,308cyclictest3576-21kworker/u16:0+efi_rts_wq22:20:130
14006993080,307cyclictest30196-21kworker/u16:3+efi_rts_wq23:00:123
14003993070,306cyclictest30196-21kworker/u16:3+efi_rts_wq20:25:130
14005993060,305cyclictest15469-21kworker/u16:2+efi_rts_wq00:05:522
14005993040,302cyclictest30196-21kworker/u16:3+efi_rts_wq23:30:082
14005993040,302cyclictest30196-21kworker/u16:3+efi_rts_wq19:15:122
14005993030,302cyclictest25088-21kworker/u16:0+efi_rts_wq00:20:102
14005993030,302cyclictest25088-21kworker/u16:0+efi_rts_wq00:20:102
14004993030,302cyclictest3576-21kworker/u16:0+efi_rts_wq22:00:121
14004993020,301cyclictest30196-21kworker/u16:3+efi_rts_wq23:15:121
14004993010,300cyclictest3576-21kworker/u16:0+efi_rts_wq20:10:151
14004993000,299cyclictest15469-21kworker/u16:2+efi_rts_wq00:15:131
14003992990,298cyclictest25088-21kworker/u16:0+efi_rts_wq00:35:130
14003992990,296cyclictest30196-21kworker/u16:3+efi_rts_wq20:55:130
14004992980,297cyclictest30196-21kworker/u16:3+efi_rts_wq21:40:141
14003992980,297cyclictest25088-21kworker/u16:0+efi_rts_wq23:50:090
14005992970,296cyclictest3576-21kworker/u16:0+efi_rts_wq20:20:132
14004992970,296cyclictest3576-21kworker/u16:0+efi_rts_wq21:50:091
14004992970,294cyclictest30196-21kworker/u16:3+efi_rts_wq20:05:171
14003992970,296cyclictest3576-21kworker/u16:0+efi_rts_wq23:05:430
14004992960,295cyclictest3576-21kworker/u16:0+efi_rts_wq21:30:221
14005992950,294cyclictest15469-21kworker/u16:2+efi_rts_wq23:40:132
14004992940,293cyclictest25088-21kworker/u16:0+efi_rts_wq23:50:081
14006992930,292cyclictest30196-21kworker/u16:3+efi_rts_wq21:55:103
14006992930,292cyclictest30196-21kworker/u16:3+efi_rts_wq19:30:153
14005992930,292cyclictest3576-21kworker/u16:0+efi_rts_wq22:20:322
14006992910,290cyclictest30196-21kworker/u16:3+efi_rts_wq21:05:133
14005992910,290cyclictest30196-21kworker/u16:3+efi_rts_wq22:35:152
14005992910,290cyclictest28398-21kworker/u16:2+efi_rts_wq19:40:132
14004992910,289cyclictest30196-21kworker/u16:3+efi_rts_wq23:10:091
14004992890,288cyclictest3576-21kworker/u16:0+efi_rts_wq22:20:131
14005992880,287cyclictest18469-21kworker/u16:1+efi_rts_wq23:20:132
14006992860,285cyclictest30196-21kworker/u16:3+efi_rts_wq22:35:153
14004992850,284cyclictest3576-21kworker/u16:0+efi_rts_wq21:00:121
14004992840,283cyclictest3576-21kworker/u16:0+efi_rts_wq20:15:111
14003992840,283cyclictest30196-21kworker/u16:3+efi_rts_wq19:45:140
14006992830,282cyclictest30196-21kworker/u16:3+efi_rts_wq19:15:013
14006992830,282cyclictest28398-21kworker/u16:2+efi_rts_wq19:50:173
14003992830,282cyclictest3576-21kworker/u16:0+efi_rts_wq20:20:120
14006992800,279cyclictest3576-21kworker/u16:0+efi_rts_wq21:20:133
14004992740,273cyclictest3576-21kworker/u16:0+efi_rts_wq21:15:131
14004992730,272cyclictest28398-21kworker/u16:2+efi_rts_wq19:10:161
14005992700,269cyclictest3576-21kworker/u16:0+efi_rts_wq21:30:232
14006992650,264cyclictest3576-21kworker/u16:0+efi_rts_wq22:00:293
14006992630,262cyclictest30196-21kworker/u16:3+efi_rts_wq22:40:143
14004992620,261cyclictest30196-21kworker/u16:3+efi_rts_wq21:55:101
14003992600,259cyclictest28398-21kworker/u16:2+efi_rts_wq19:20:000
14006992590,258cyclictest30196-21kworker/u16:3+efi_rts_wq20:10:103
14006992580,257cyclictest15469-21kworker/u16:2+efi_rts_wq00:00:133
14003992580,257cyclictest30196-21kworker/u16:3+efi_rts_wq19:40:040
14006992570,256cyclictest3576-21kworker/u16:0+efi_rts_wq20:40:143
14003992570,256cyclictest28398-21kworker/u16:2+efi_rts_wq19:14:590
14006992550,254cyclictest25088-21kworker/u16:0+efi_rts_wq23:55:153
14005992550,254cyclictest30196-21kworker/u16:3+efi_rts_wq19:25:132
14004992530,252cyclictest18469-21kworker/u16:1+efi_rts_wq23:20:131
14003992530,252cyclictest30196-21kworker/u16:3+efi_rts_wq19:30:140
14005992510,250cyclictest30196-21kworker/u16:3+efi_rts_wq20:50:162
14004992500,249cyclictest25088-21kworker/u16:0+efi_rts_wq00:10:091
14003992500,249cyclictest3576-21kworker/u16:0+efi_rts_wq21:50:080
14006992490,248cyclictest30196-21kworker/u16:3+efi_rts_wq20:55:193
14004992470,246cyclictest30196-21kworker/u16:3+efi_rts_wq22:30:071
14004992460,245cyclictest30196-21kworker/u16:3+efi_rts_wq19:45:141
14004992460,245cyclictest15469-21kworker/u16:2+efi_rts_wq23:25:461
14005992420,241cyclictest30196-21kworker/u16:3+efi_rts_wq20:00:082
14006992400,237cyclictest30196-21kworker/u16:3+efi_rts_wq20:35:133
14003992400,239cyclictest25088-21kworker/u16:0+efi_rts_wq23:40:130
14004992380,237cyclictest30196-21kworker/u16:3+efi_rts_wq23:00:411
14004992380,237cyclictest30196-21kworker/u16:3+efi_rts_wq19:25:131
14003992360,235cyclictest3576-21kworker/u16:0+efi_rts_wq21:30:260
14005992350,234cyclictest3576-21kworker/u16:0+efi_rts_wq21:50:282
14004992340,232cyclictest3576-21kworker/u16:0+efi_rts_wq22:55:141
14006992330,232cyclictest30196-21kworker/u16:3+efi_rts_wq20:50:163
14003992330,232cyclictest28398-21kworker/u16:2+efi_rts_wq19:35:140
14003992330,232cyclictest25088-21kworker/u16:0+efi_rts_wq00:10:540
14005992320,231cyclictest30196-21kworker/u16:3+efi_rts_wq20:45:142
14004992310,230cyclictest3576-21kworker/u16:0+efi_rts_wq22:10:091
14005992300,228cyclictest30196-21kworker/u16:3+efi_rts_wq23:35:132
14003992300,229cyclictest3576-21kworker/u16:0+efi_rts_wq23:15:440
14004992290,228cyclictest28398-21kworker/u16:2+efi_rts_wq19:40:121
14003992290,228cyclictest3576-21kworker/u16:0+efi_rts_wq22:00:110
14003992290,228cyclictest30196-21kworker/u16:3+efi_rts_wq19:20:130
14005992280,227cyclictest3576-21kworker/u16:0+efi_rts_wq22:50:082
14003992280,227cyclictest30196-21kworker/u16:3+efi_rts_wq22:15:150
14005992270,226cyclictest30196-21kworker/u16:3+efi_rts_wq21:10:212
14004992260,225cyclictest3576-21kworker/u16:0+efi_rts_wq21:20:241
14004992240,223cyclictest30196-21kworker/u16:3+efi_rts_wq21:25:241
14003992240,223cyclictest30196-21kworker/u16:3+efi_rts_wq20:45:160
14004992220,221cyclictest3576-21kworker/u16:0+efi_rts_wq21:35:121
14003992220,221cyclictest3576-21kworker/u16:0+efi_rts_wq22:55:140
14005992210,220cyclictest30196-21kworker/u16:3+efi_rts_wq22:15:142
14004992200,219cyclictest30196-21kworker/u16:3+efi_rts_wq19:20:141
14006992190,218cyclictest3576-21kworker/u16:0+efi_rts_wq20:05:093
14005992170,216cyclictest3576-21kworker/u16:0+efi_rts_wq20:10:152
14003992160,215cyclictest25088-21kworker/u16:0+efi_rts_wq00:30:080
14003992150,214cyclictest3576-21kworker/u16:0+efi_rts_wq20:40:140
14005992130,211cyclictest30196-21kworker/u16:3+efi_rts_wq23:10:082
14005992090,208cyclictest30196-21kworker/u16:3+efi_rts_wq20:35:142
14005992060,205cyclictest30196-21kworker/u16:3+efi_rts_wq22:40:132
14006992050,204cyclictest30196-21kworker/u16:3+efi_rts_wq22:15:313
14006992040,203cyclictest30196-21kworker/u16:3+efi_rts_wq23:35:133
14003992010,200cyclictest25088-21kworker/u16:0+efi_rts_wq00:20:570
14003992010,200cyclictest25088-21kworker/u16:0+efi_rts_wq00:20:560
14006991970,196cyclictest15469-21kworker/u16:2+efi_rts_wq00:25:563
14003991970,196cyclictest30196-21kworker/u16:3+efi_rts_wq23:00:130
14003991970,196cyclictest30196-21kworker/u16:3+efi_rts_wq20:15:140
14004991950,194cyclictest30196-21kworker/u16:3+efi_rts_wq19:50:061
14006991940,193cyclictest30196-21kworker/u16:3+efi_rts_wq23:10:093
14003991930,192cyclictest30196-21kworker/u16:3+efi_rts_wq22:05:290
14003991900,189cyclictest3576-21kworker/u16:0+efi_rts_wq21:15:220
14005991880,187cyclictest30196-21kworker/u16:3+efi_rts_wq20:25:142
14004991860,185cyclictest28398-21kworker/u16:2+efi_rts_wq19:35:131
14005991800,177cyclictest25088-21kworker/u16:0+efi_rts_wq00:35:132
14004991800,179cyclictest30196-21kworker/u16:3+efi_rts_wq21:45:271
14004991800,179cyclictest30196-21kworker/u16:3+efi_rts_wq20:55:131
14003991790,178cyclictest3576-21kworker/u16:0+efi_rts_wq22:50:090
14004991770,176cyclictest25088-21kworker/u16:0+efi_rts_wq00:30:081
14003991770,177cyclictest30196-21kworker/u16:3+efi_rts_wq21:05:200
14004991740,173cyclictest30196-21kworker/u16:3+efi_rts_wq19:55:141
14003991740,173cyclictest30196-21kworker/u16:3+efi_rts_wq22:25:350
14003991720,172cyclictest30196-21kworker/u16:3+efi_rts_wq23:30:460
14005991690,168cyclictest28398-21kworker/u16:2+efi_rts_wq19:35:032
14004991690,167cyclictest25088-21kworker/u16:0+efi_rts_wq23:55:511
14006991680,167cyclictest3576-21kworker/u16:0+efi_rts_wq22:55:403
14005991650,164cyclictest30196-21kworker/u16:3+efi_rts_wq21:40:142
14004991600,159cyclictest3576-21kworker/u16:0+efi_rts_wq20:30:171
14003991600,159cyclictest28398-21kworker/u16:2+efi_rts_wq19:50:160
14003991570,156cyclictest3576-21kworker/u16:0+efi_rts_wq21:35:120
14005991550,154cyclictest30196-21kworker/u16:3+efi_rts_wq22:30:342
14004991550,154cyclictest30196-21kworker/u16:3+efi_rts_wq22:40:131
14006991540,153cyclictest3576-21kworker/u16:0+efi_rts_wq22:10:313
14003991510,150cyclictest3576-21kworker/u16:0+efi_rts_wq21:00:130
14005991500,149cyclictest28398-21kworker/u16:2+efi_rts_wq19:10:162
14005991470,146cyclictest30196-21kworker/u16:3+efi_rts_wq20:30:122
14006991400,139cyclictest30196-21kworker/u16:3+efi_rts_wq20:15:133
14003991370,136cyclictest30196-21kworker/u16:3+efi_rts_wq21:40:270
14005991360,135cyclictest15469-21kworker/u16:2+efi_rts_wq00:00:132
14004991350,132cyclictest30196-21kworker/u16:3+efi_rts_wq21:10:171
14003991350,134cyclictest25088-21kworker/u16:0+efi_rts_wq00:00:520
14006991340,132cyclictest30196-21kworker/u16:3+efi_rts_wq23:15:113
14006991330,132cyclictest3576-21kworker/u16:0+efi_rts_wq22:45:383
14003991320,132cyclictest15469-21kworker/u16:2+efi_rts_wq00:15:550
14003991320,131cyclictest28398-21kworker/u16:2+efi_rts_wq19:55:080
14003991310,130cyclictest30196-21kworker/u16:3+efi_rts_wq22:35:370
14003991280,127cyclictest30196-21kworker/u16:3+efi_rts_wq21:10:170
14005991260,125cyclictest3576-21kworker/u16:0+efi_rts_wq22:55:132
14004991251,123cyclictest30196-21kworker/u16:3+efi_rts_wq23:35:481
14005991210,120cyclictest25088-21kworker/u16:0+efi_rts_wq00:10:082
14006991180,117cyclictest30196-21kworker/u16:3+efi_rts_wq20:20:113
230842570,0sleep10-21swapper/123:34:191
14006993329,4cyclictest808-21snmpd19:45:263
14006993329,3cyclictest808-21snmpd23:05:053
14006993328,4cyclictest808-21snmpd19:25:073
14005993330,2cyclictest808-21snmpd21:05:532
14006993229,3cyclictest808-21snmpd00:08:383
14006993229,2cyclictest808-21snmpd21:27:383
14006993227,4cyclictest808-21snmpd23:29:283
14005993230,2cyclictest808-21snmpd23:59:142
14005993230,2cyclictest808-21snmpd23:09:002
14005993230,2cyclictest808-21snmpd22:26:192
14004993229,2cyclictest808-21snmpd22:26:411
14006993129,2cyclictest808-21snmpd22:51:303
14005993130,1cyclictest808-21snmpd23:29:162
14005993130,1cyclictest808-21snmpd19:24:412
14005993129,2cyclictest808-21snmpd23:04:202
14005993129,2cyclictest808-21snmpd20:06:082
14005993128,2cyclictest808-21snmpd22:08:242
14004993129,2cyclictest808-21snmpd22:47:391
14004993128,2cyclictest808-21snmpd20:40:391
14004993128,2cyclictest808-21snmpd00:26:031
14003993129,2cyclictest808-21snmpd21:48:060
14006993029,1cyclictest808-21snmpd23:41:303
14006993029,1cyclictest808-21snmpd21:45:233
14006993029,1cyclictest808-21snmpd00:38:083
14006993028,2cyclictest808-21snmpd21:30:323
14006993027,3cyclictest808-21snmpd20:26:103
14006993027,2cyclictest808-21snmpd22:24:293
14005993029,1cyclictest808-21snmpd23:15:462
14005993029,1cyclictest808-21snmpd20:16:312
14005993029,1cyclictest808-21snmpd00:32:592
14005993028,2cyclictest808-21snmpd22:13:042
14005993028,2cyclictest1841-21cat19:55:142
14004993029,1cyclictest808-21snmpd22:05:361
14004993029,1cyclictest808-21snmpd20:50:071
14004993029,1cyclictest808-21snmpd20:46:041
14004993029,1cyclictest808-21snmpd20:37:101
14004993028,2cyclictest808-21snmpd00:36:031
14003993030,0cyclictest17594-21kworker/0:1+events23:48:520
14003993030,0cyclictest17594-21kworker/0:1+events23:20:160
14003993029,1cyclictest808-21snmpd22:14:120
14003993029,1cyclictest808-21snmpd21:25:110
14003993029,1cyclictest808-21snmpd20:04:560
14003993029,1cyclictest28214-21kworker/0:1+events22:30:320
14003993029,1cyclictest22854-21kworker/0:0+events22:45:350
14003993029,1cyclictest15858-21kworker/0:2+events20:05:210
14003993028,2cyclictest808-21snmpd23:55:220
14003993028,2cyclictest808-21snmpd20:13:060
14003993027,2cyclictest808-21snmpd23:27:390
14006992928,1cyclictest808-21snmpd23:21:213
14006992928,1cyclictest808-21snmpd22:05:393
14006992928,1cyclictest808-21snmpd00:30:203
14006992926,3cyclictest808-21snmpd00:10:193
14005992928,1cyclictest808-21snmpd21:38:262
14005992928,1cyclictest808-21snmpd20:40:482
14005992928,1cyclictest808-21snmpd19:50:322
14005992927,2cyclictest808-21snmpd23:47:382
14005992927,2cyclictest808-21snmpd22:04:132
14004992928,1cyclictest808-21snmpd22:53:471
14003992929,0cyclictest808-21snmpd23:39:330
14003992929,0cyclictest15858-21kworker/0:2+events20:39:180
14003992928,1cyclictest808-21snmpd20:31:180
14003992928,1cyclictest22854-21kworker/0:0+events22:40:080
14003992928,1cyclictest12999-21kworker/0:0+events23:11:400
14003992927,2cyclictest808-21snmpd21:20:090
14006992827,1cyclictest808-21snmpd00:15:273
14006992826,2cyclictest808-21snmpd23:47:113
14006992826,2cyclictest808-21snmpd21:04:373
14006992825,3cyclictest808-21snmpd19:22:113
14006992823,5cyclictest25916-21cat19:35:153
14005992827,1cyclictest808-21snmpd00:27:232
14005992827,1cyclictest808-21snmpd00:18:052
14005992826,2cyclictest808-21snmpd23:54:012
14004992827,1cyclictest808-21snmpd23:43:581
14004992827,1cyclictest808-21snmpd21:05:371
14004992826,2cyclictest808-21snmpd19:30:101
14004992825,2cyclictest808-21snmpd20:21:211
14003992827,1cyclictest2930-21kworker/0:3+events00:05:000
14006992726,1cyclictest808-21snmpd20:01:243
14006992723,4cyclictest808-21snmpd23:31:393
14005992726,1cyclictest808-21snmpd22:46:162
14005992726,1cyclictest808-21snmpd21:18:472
14005992726,1cyclictest808-21snmpd20:58:112
14004992726,1cyclictest808-21snmpd20:26:161
14004992725,2cyclictest808-21snmpd00:01:221
14003992727,0cyclictest15858-21kworker/0:2+events20:50:250
14003992726,1cyclictest808-21snmpd19:26:010
14003992725,2cyclictest808-21snmpd21:55:060
14006992625,1cyclictest808-21snmpd21:50:043
14006992625,1cyclictest808-21snmpd21:35:173
14006992623,2cyclictest808-21snmpd22:25:193
14005992625,1cyclictest808-21snmpd21:21:412
14006992525,0cyclictest75150irq/134-enp1s022:33:203
14005992524,1cyclictest808-21snmpd21:56:482
14005992523,2cyclictest808-21snmpd21:04:312
14004992523,2cyclictest808-21snmpd22:35:171
14003992424,0cyclictest4275-21kworker/0:0+events00:25:410
14006992320,3cyclictest808-21snmpd21:44:503
14006992220,2cyclictest3256-21cat21:15:163
14006992218,4cyclictest808-21snmpd23:53:523
14005992220,2cyclictest808-21snmpd21:29:352
14005992120,1cyclictest808-21snmpd19:46:502
14004992119,2cyclictest808-21snmpd23:08:481
14004991917,2cyclictest815-21ntpd19:18:411
14004991917,2cyclictest808-21snmpd22:16:091
14006991816,2cyclictest16695-21cat20:30:193
14006991716,1cyclictest808-21snmpd00:21:473
14006991716,1cyclictest808-21snmpd00:21:473
14004991716,1cyclictest808-21snmpd00:24:541
14004991716,1cyclictest808-21snmpd00:24:531
14004991716,1cyclictest808-21snmpd00:05:311
14006991615,1cyclictest808-21snmpd20:45:083
14005991615,1cyclictest808-21snmpd19:32:052
14006991311,2cyclictest28039-21cat19:40:153
140069990,2cyclictest2966-21chrt19:59:183
140069984,4cyclictest15902-21cat19:15:013
140069982,2cyclictest1194-21cat21:10:183
140059965,1cyclictest14369-21cat21:50:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional