You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 11:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot3s.osadl.org (updated Wed Nov 12, 2025 00:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55092317303,5sleep10-21swapper/119:09:411
52102317310,5sleep20-21swapper/219:05:532
54572315308,4sleep00-21swapper/019:09:030
53932315307,5sleep30-21swapper/319:08:153
5799993010,300cyclictest15218-21kworker/u16:3+efi_rts_wq20:25:122
5800993000,299cyclictest4531-21kworker/u16:2+efi_rts_wq20:24:453
5798993000,299cyclictest15183-21kworker/u16:0+efi_rts_wq23:50:211
5800992960,294cyclictest12667-21kworker/u16:3+efi_rts_wq23:10:133
5798992960,295cyclictest15183-21kworker/u16:0+efi_rts_wq00:10:141
5798992960,294cyclictest4531-21kworker/u16:2+efi_rts_wq21:00:151
5797992960,293cyclictest15218-21kworker/u16:3+efi_rts_wq22:00:130
5800992950,294cyclictest15218-21kworker/u16:3+efi_rts_wq20:50:183
5799992950,294cyclictest4531-21kworker/u16:2+efi_rts_wq19:40:152
5800992940,293cyclictest4531-21kworker/u16:2+efi_rts_wq22:25:053
5800992940,293cyclictest4531-21kworker/u16:2+efi_rts_wq22:25:043
5797992940,293cyclictest15218-21kworker/u16:3+efi_rts_wq19:25:120
5798992921,290cyclictest4531-21kworker/u16:2+efi_rts_wq19:50:131
5798992920,291cyclictest15218-21kworker/u16:3+efi_rts_wq20:54:481
5798992910,290cyclictest15218-21kworker/u16:3+efi_rts_wq19:10:151
5800992900,289cyclictest4531-21kworker/u16:2+efi_rts_wq22:35:153
5800992900,289cyclictest15218-21kworker/u16:3+efi_rts_wq19:45:173
5800992870,285cyclictest32073-21kworker/u16:0+efi_rts_wq22:55:103
5800992860,285cyclictest4531-21kworker/u16:2+efi_rts_wq20:45:143
5797992840,283cyclictest15218-21kworker/u16:3+efi_rts_wq20:50:180
5800992820,281cyclictest15218-21kworker/u16:3+efi_rts_wq22:30:143
5800992820,281cyclictest15218-21kworker/u16:3+efi_rts_wq19:15:143
5799992820,281cyclictest4531-21kworker/u16:2+efi_rts_wq22:05:172
5799992810,280cyclictest4531-21kworker/u16:2+efi_rts_wq21:10:132
5799992810,280cyclictest26269-21kworker/u16:2+efi_rts_wq23:40:182
5797992810,279cyclictest10176-21kworker/u16:1+efi_rts_wq23:10:120
5799992780,277cyclictest15183-21kworker/u16:0+efi_rts_wq00:05:142
5800992770,275cyclictest12667-21kworker/u16:3+efi_rts_wq23:15:143
5798992750,274cyclictest15218-21kworker/u16:3+efi_rts_wq19:45:161
5800992740,273cyclictest4531-21kworker/u16:2+efi_rts_wq21:55:133
5799992740,273cyclictest4531-21kworker/u16:2+efi_rts_wq21:35:162
5797992740,273cyclictest15218-21kworker/u16:3+efi_rts_wq20:55:130
5798992730,272cyclictest15218-21kworker/u16:3+efi_rts_wq21:05:171
5798992730,269cyclictest15183-21kworker/u16:0+efi_rts_wq23:40:121
5800992720,271cyclictest15218-21kworker/u16:3+efi_rts_wq21:44:573
5797992720,271cyclictest3111-21kworker/u16:2+efi_rts_wq00:20:140
5800992710,270cyclictest4531-21kworker/u16:2+efi_rts_wq19:35:173
5799992690,268cyclictest4531-21kworker/u16:2+efi_rts_wq20:45:132
5798992690,268cyclictest32073-21kworker/u16:0+efi_rts_wq22:55:131
5797992690,268cyclictest15218-21kworker/u16:3+efi_rts_wq20:40:190
5798992660,265cyclictest4531-21kworker/u16:2+efi_rts_wq20:00:171
5797992660,265cyclictest15183-21kworker/u16:0+efi_rts_wq23:30:130
5798992650,264cyclictest15183-21kworker/u16:0+efi_rts_wq00:30:151
5800992640,263cyclictest32073-21kworker/u16:0+efi_rts_wq23:00:143
5800992640,263cyclictest29370-21kworker/u16:1+efi_rts_wq22:45:083
5799992630,260cyclictest15218-21kworker/u16:3+efi_rts_wq20:05:142
5797992630,262cyclictest3111-21kworker/u16:2+efi_rts_wq00:35:130
5797992620,261cyclictest4531-21kworker/u16:2+efi_rts_wq22:20:140
5800992610,260cyclictest12667-21kworker/u16:3+efi_rts_wq23:35:133
5797992600,258cyclictest15218-21kworker/u16:3+efi_rts_wq22:25:130
5797992600,258cyclictest15218-21kworker/u16:3+efi_rts_wq22:25:130
5799992580,257cyclictest4531-21kworker/u16:2+efi_rts_wq19:55:142
5800992560,255cyclictest15218-21kworker/u16:3+efi_rts_wq19:10:143
5799992560,255cyclictest7556-21kworker/u16:2+efi_rts_wq23:00:142
5799992550,254cyclictest4531-21kworker/u16:2+efi_rts_wq22:15:132
5799992550,254cyclictest4531-21kworker/u16:2+efi_rts_wq20:35:152
5797992550,254cyclictest15183-21kworker/u16:0+efi_rts_wq00:05:210
5800992540,253cyclictest4531-21kworker/u16:2+efi_rts_wq21:30:143
5800992540,253cyclictest15218-21kworker/u16:3+efi_rts_wq20:25:133
5798992530,252cyclictest28773-21kworker/u16:1+efi_rts_wq23:55:121
5798992530,252cyclictest15218-21kworker/u16:3+efi_rts_wq21:40:131
5799992520,249cyclictest15218-21kworker/u16:3+efi_rts_wq22:40:122
5798992520,251cyclictest26269-21kworker/u16:2+efi_rts_wq23:45:141
5797992510,249cyclictest7556-21kworker/u16:2+efi_rts_wq23:05:140
5800992490,245cyclictest15218-21kworker/u16:3+efi_rts_wq21:15:133
5799992470,246cyclictest28773-21kworker/u16:1+efi_rts_wq23:55:212
5799992460,245cyclictest4531-21kworker/u16:2+efi_rts_wq21:30:142
5798992460,245cyclictest4531-21kworker/u16:2+efi_rts_wq19:30:131
5800992450,244cyclictest26269-21kworker/u16:2+efi_rts_wq23:45:203
5799992440,243cyclictest15218-21kworker/u16:3+efi_rts_wq20:15:132
5798992420,241cyclictest4531-21kworker/u16:2+efi_rts_wq19:24:331
5797992420,241cyclictest4531-21kworker/u16:2+efi_rts_wq19:20:130
5799992410,240cyclictest15218-21kworker/u16:3+efi_rts_wq20:55:132
5798992410,240cyclictest3111-21kworker/u16:2+efi_rts_wq00:20:251
5798992400,239cyclictest15218-21kworker/u16:3+efi_rts_wq20:34:451
5799992390,238cyclictest15218-21kworker/u16:3+efi_rts_wq19:49:372
5799992390,238cyclictest15183-21kworker/u16:0+efi_rts_wq00:30:272
5798992390,238cyclictest15183-21kworker/u16:0+efi_rts_wq00:05:141
5798992380,237cyclictest4531-21kworker/u16:2+efi_rts_wq21:45:141
5799992360,235cyclictest15218-21kworker/u16:3+efi_rts_wq21:50:132
5800992350,234cyclictest15218-21kworker/u16:3+efi_rts_wq22:05:013
5797992350,234cyclictest15218-21kworker/u16:3+efi_rts_wq21:19:530
5798992340,233cyclictest4531-21kworker/u16:2+efi_rts_wq20:35:161
5798992340,233cyclictest15218-21kworker/u16:3+efi_rts_wq22:00:121
5797992340,233cyclictest28773-21kworker/u16:1+efi_rts_wq23:55:120
5799992330,232cyclictest4531-21kworker/u16:2+efi_rts_wq20:10:142
5798992330,232cyclictest15218-21kworker/u16:3+efi_rts_wq21:15:141
5798992320,231cyclictest12667-21kworker/u16:3+efi_rts_wq23:20:141
5799992310,230cyclictest32073-21kworker/u16:0+efi_rts_wq22:45:142
5798992310,230cyclictest4531-21kworker/u16:2+efi_rts_wq20:10:141
5798992310,230cyclictest15218-21kworker/u16:3+efi_rts_wq21:25:161
5799992300,229cyclictest4531-21kworker/u16:2+efi_rts_wq19:20:132
5800992260,225cyclictest15183-21kworker/u16:0+efi_rts_wq00:15:133
5799992250,224cyclictest32073-21kworker/u16:0+efi_rts_wq22:55:132
5799992250,224cyclictest12667-21kworker/u16:3+efi_rts_wq23:20:162
5797992250,224cyclictest15218-21kworker/u16:3+efi_rts_wq21:40:130
5800992230,222cyclictest4531-21kworker/u16:2+efi_rts_wq19:50:123
5797992230,222cyclictest15218-21kworker/u16:3+efi_rts_wq19:15:000
5797992230,222cyclictest12667-21kworker/u16:3+efi_rts_wq23:15:130
5800992220,221cyclictest4531-21kworker/u16:2+efi_rts_wq21:20:143
5800992210,220cyclictest15218-21kworker/u16:3+efi_rts_wq21:54:593
5798992190,218cyclictest4531-21kworker/u16:2+efi_rts_wq19:35:161
5799992150,214cyclictest29370-21kworker/u16:1+efi_rts_wq22:50:132
5799992150,214cyclictest15183-21kworker/u16:0+efi_rts_wq00:25:152
5800992130,212cyclictest4531-21kworker/u16:2+efi_rts_wq20:30:143
5797992120,211cyclictest12667-21kworker/u16:3+efi_rts_wq23:20:150
5800992090,208cyclictest3111-21kworker/u16:2+efi_rts_wq00:00:123
5800992070,205cyclictest7556-21kworker/u16:2+efi_rts_wq23:05:133
5799992050,204cyclictest15183-21kworker/u16:0+efi_rts_wq23:30:122
5800992020,200cyclictest28773-21kworker/u16:1+efi_rts_wq23:50:133
5800992010,200cyclictest15218-21kworker/u16:3+efi_rts_wq20:19:443
5800992000,199cyclictest15218-21kworker/u16:3+efi_rts_wq22:10:123
5797991980,197cyclictest15218-21kworker/u16:3+efi_rts_wq22:10:130
5799991940,193cyclictest15218-21kworker/u16:3+efi_rts_wq19:25:132
5798991930,192cyclictest15218-21kworker/u16:3+efi_rts_wq21:34:551
5798991890,188cyclictest4531-21kworker/u16:2+efi_rts_wq20:49:471
5800991880,187cyclictest4531-21kworker/u16:2+efi_rts_wq20:14:423
5800991860,185cyclictest3111-21kworker/u16:2+efi_rts_wq00:35:143
5799991850,184cyclictest26269-21kworker/u16:2+efi_rts_wq23:45:152
5798991840,183cyclictest3111-21kworker/u16:2+efi_rts_wq00:35:271
5800991820,181cyclictest4531-21kworker/u16:2+efi_rts_wq21:10:133
5798991820,181cyclictest7556-21kworker/u16:2+efi_rts_wq23:05:141
5800991800,179cyclictest4531-21kworker/u16:2+efi_rts_wq20:00:173
5800991790,178cyclictest4531-21kworker/u16:2+efi_rts_wq21:04:513
5797991760,175cyclictest15183-21kworker/u16:0+efi_rts_wq23:25:160
5797991710,170cyclictest4531-21kworker/u16:2+efi_rts_wq21:39:560
5798991700,169cyclictest15218-21kworker/u16:3+efi_rts_wq19:29:331
5800991680,167cyclictest15183-21kworker/u16:0+efi_rts_wq00:25:143
5799991670,166cyclictest15218-21kworker/u16:3+efi_rts_wq19:15:012
5800991630,162cyclictest15183-21kworker/u16:0+efi_rts_wq23:25:153
5797991630,162cyclictest15218-21kworker/u16:3+efi_rts_wq21:25:160
5798991600,159cyclictest15218-21kworker/u16:3+efi_rts_wq20:44:461
5797991560,154cyclictest3111-21kworker/u16:2+efi_rts_wq00:00:130
5799991510,150cyclictest15218-21kworker/u16:3+efi_rts_wq22:20:032
5797991490,148cyclictest15218-21kworker/u16:3+efi_rts_wq21:05:170
5800991480,147cyclictest15218-21kworker/u16:3+efi_rts_wq22:15:033
5798991470,146cyclictest4531-21kworker/u16:2+efi_rts_wq21:20:141
5798991470,146cyclictest15218-21kworker/u16:3+efi_rts_wq19:19:311
5799991450,144cyclictest4531-21kworker/u16:2+efi_rts_wq21:24:542
5798991450,144cyclictest29370-21kworker/u16:1+efi_rts_wq22:40:131
5798991450,143cyclictest29370-21kworker/u16:1+efi_rts_wq22:50:131
5799991420,141cyclictest15218-21kworker/u16:3+efi_rts_wq21:29:552
5799991410,140cyclictest15183-21kworker/u16:0+efi_rts_wq23:35:182
5799991390,138cyclictest15218-21kworker/u16:3+efi_rts_wq22:10:122
5798991380,137cyclictest12667-21kworker/u16:3+efi_rts_wq23:10:121
5799991290,128cyclictest15183-21kworker/u16:0+efi_rts_wq00:15:242
5799991280,127cyclictest12667-21kworker/u16:3+efi_rts_wq23:15:132
5798991240,123cyclictest15218-21kworker/u16:3+efi_rts_wq20:15:131
5798991230,122cyclictest4531-21kworker/u16:2+efi_rts_wq22:35:161
5800991220,122cyclictest15218-21kworker/u16:3+efi_rts_wq22:40:083
5798991210,120cyclictest4531-21kworker/u16:2+efi_rts_wq22:05:171
5800991130,112cyclictest15218-21kworker/u16:3+efi_rts_wq20:09:423
5800991090,108cyclictest15183-21kworker/u16:0+efi_rts_wq00:10:133
5799991080,106cyclictest3111-21kworker/u16:2+efi_rts_wq00:00:212
5799993330,2cyclictest795-21snmpd00:35:082
5799993229,2cyclictest795-21snmpd19:33:132
5799993229,2cyclictest795-21snmpd00:14:432
5798993230,2cyclictest795-21snmpd21:59:481
5797993230,2cyclictest29419-21cat21:20:150
5797993229,2cyclictest795-21snmpd20:18:180
5800993128,2cyclictest795-21snmpd00:21:193
5800993128,2cyclictest795-21snmpd00:09:223
5799993129,2cyclictest795-21snmpd22:38:392
5799993129,2cyclictest795-21snmpd22:02:052
5799993129,2cyclictest795-21snmpd20:23:422
5799993128,2cyclictest795-21snmpd21:55:032
5798993129,2cyclictest795-21snmpd23:04:471
5798993129,2cyclictest795-21snmpd00:29:111
5798993129,2cyclictest10424-21cat00:15:151
5797993129,2cyclictest795-21snmpd22:56:410
5797993129,2cyclictest795-21snmpd21:50:290
5797993129,2cyclictest795-21snmpd20:36:570
5800993029,1cyclictest795-21snmpd23:58:403
5800993029,1cyclictest795-21snmpd22:21:063
5800993029,1cyclictest795-21snmpd21:47:333
5800993029,1cyclictest795-21snmpd19:33:403
5800993028,2cyclictest795-21snmpd00:30:563
5800993028,2cyclictest31452-21cat21:25:163
5799993029,1cyclictest795-21snmpd23:25:572
5799993029,1cyclictest795-21snmpd20:41:012
5799993029,1cyclictest795-21snmpd19:36:132
5799993028,2cyclictest795-21snmpd20:50:012
5798993029,1cyclictest807-21lldpd21:37:321
5798993029,1cyclictest795-21snmpd22:49:501
5798993029,1cyclictest795-21snmpd22:10:381
5798993028,2cyclictest795-21snmpd20:26:381
5798993028,2cyclictest795-21snmpd20:23:211
5797993029,1cyclictest795-21snmpd20:28:570
5797993029,1cyclictest795-21snmpd00:13:500
5797993028,2cyclictest795-21snmpd23:36:090
5797993028,2cyclictest795-21snmpd22:37:520
5797993027,2cyclictest795-21snmpd20:01:440
5800992928,1cyclictest795-21snmpd23:34:573
5800992928,1cyclictest795-21snmpd22:50:263
5800992928,1cyclictest795-21snmpd20:39:483
5800992926,2cyclictest795-21snmpd19:20:033
5799992928,1cyclictest795-21snmpd23:54:422
5799992928,1cyclictest795-21snmpd23:06:502
5799992928,1cyclictest795-21snmpd00:24:112
5799992926,2cyclictest795-21snmpd21:48:002
5799992926,2cyclictest795-21snmpd21:07:452
5798992929,0cyclictest32652-21kworker/1:0+events22:30:401
5798992929,0cyclictest32102-21kworker/1:2+events23:18:401
5798992929,0cyclictest30639-21kworker/1:1+events00:03:041
5798992929,0cyclictest21687-21kworker/1:0+events23:39:341
5798992928,1cyclictest795-21snmpd22:28:221
5798992928,1cyclictest795-21snmpd22:28:221
5798992928,1cyclictest795-21snmpd22:23:121
5798992927,1cyclictest795-21snmpd20:57:281
5797992928,1cyclictest795-21snmpd23:46:220
5797992928,1cyclictest795-21snmpd22:40:240
5797992928,1cyclictest795-21snmpd21:55:480
5797992928,1cyclictest795-21snmpd19:35:450
5797992927,2cyclictest795-21snmpd19:41:380
5800992827,1cyclictest795-21snmpd19:58:053
5799992827,1cyclictest795-21snmpd21:16:082
5798992827,1cyclictest795-21snmpd21:53:111
5798992826,2cyclictest795-21snmpd19:44:081
5797992827,1cyclictest795-21snmpd19:51:410
5797992827,1cyclictest31993-21cat23:50:160
5797992826,2cyclictest795-21snmpd23:43:460
5800992725,2cyclictest795-21snmpd23:40:533
5800992725,2cyclictest795-21snmpd20:59:363
5799992726,1cyclictest795-21snmpd21:43:572
5799992726,1cyclictest795-21snmpd19:10:432
5799992725,2cyclictest795-21snmpd22:30:012
5798992727,0cyclictest795-21snmpd23:25:061
5797992727,0cyclictest73850irq/131-enp1s022:52:160
5797992726,1cyclictest795-21snmpd22:33:550
5797992726,1cyclictest795-21snmpd20:05:160
5797992726,1cyclictest795-21snmpd19:10:040
5797992725,2cyclictest795-21snmpd21:10:310
5797992725,2cyclictest795-21snmpd20:31:420
5797992725,2cyclictest795-21snmpd00:32:200
5799992625,1cyclictest795-21snmpd21:04:132
5798992625,1cyclictest795-21snmpd23:30:111
5798992625,1cyclictest795-21snmpd20:06:491
5798992625,1cyclictest795-21snmpd19:55:131
5797992625,1cyclictest795-21snmpd20:46:310
5800992524,1cyclictest795-21snmpd22:00:153
5799992524,1cyclictest795-21snmpd20:00:382
5797992523,2cyclictest795-21snmpd22:49:320
5800992423,1cyclictest795-21snmpd19:25:253
5797992423,1cyclictest795-21snmpd21:00:040
5800992322,1cyclictest795-21snmpd23:20:033
5799992321,2cyclictest795-21snmpd23:14:332
5798992322,1cyclictest795-21snmpd22:17:071
5797992321,2cyclictest795-21snmpd19:59:190
5800992219,2cyclictest795-21snmpd21:05:393
5800992219,2cyclictest795-21snmpd20:43:133
5799992220,2cyclictest795-21snmpd19:51:052
5797992220,2cyclictest795-21snmpd20:22:480
5799992119,2cyclictest795-21snmpd22:25:012
5799992119,2cyclictest795-21snmpd22:25:002
5798992121,0cyclictest15897-21kworker/1:1+events21:12:241
5799992019,1cyclictest795-21snmpd20:34:542
5797991918,1cyclictest795-21snmpd23:00:100
5797991918,1cyclictest795-21snmpd22:05:510
5800991615,1cyclictest795-21snmpd21:37:563
5797991615,1cyclictest795-21snmpd22:19:400
5797991615,1cyclictest795-21snmpd19:49:490
5797991615,1cyclictest795-21snmpd00:25:460
5797991614,2cyclictest795-21snmpd21:33:010
5797991311,2cyclictest795-21snmpd21:49:330
57979976,1cyclictest795-21snmpd00:15:250
58009965,1cyclictest19263-21diskstats19:40:143
57979965,1cyclictest401-21taskset20:12:160
57979965,1cyclictest16436-21taskset19:33:520
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional