You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-05 - 10:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot3s.osadl.org (updated Wed Nov 05, 2025 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34092316308,5sleep30-21swapper/319:07:593
33932315308,5sleep20-21swapper/219:07:462
33602315307,5sleep10-21swapper/119:07:211
32162314307,5sleep00-21swapper/019:05:310
3836992950,294cyclictest3696-21kworker/u16:1+efi_rts_wq20:05:152
3835992920,291cyclictest3696-21kworker/u16:1+efi_rts_wq19:15:141
3835992910,290cyclictest24866-21kworker/u16:3+efi_rts_wq23:00:111
3837992900,289cyclictest3696-21kworker/u16:1+efi_rts_wq21:04:413
3837992900,289cyclictest22535-21kworker/u16:1+efi_rts_wq23:45:123
3835992900,289cyclictest24866-21kworker/u16:3+efi_rts_wq23:10:141
3834992900,289cyclictest24866-21kworker/u16:3+efi_rts_wq22:40:170
3837992890,288cyclictest3696-21kworker/u16:1+efi_rts_wq21:20:153
3836992890,288cyclictest24831-21kworker/u16:2+efi_rts_wq00:10:142
3835992890,288cyclictest3696-21kworker/u16:1+efi_rts_wq21:20:141
3834992890,288cyclictest24831-21kworker/u16:2+efi_rts_wq23:50:090
3835992870,285cyclictest6052-21kworker/u16:0+efi_rts_wq23:15:141
3836992860,285cyclictest6052-21kworker/u16:0+efi_rts_wq23:40:132
3837992850,284cyclictest22535-21kworker/u16:1+efi_rts_wq00:35:123
3837992840,283cyclictest3696-21kworker/u16:1+efi_rts_wq19:55:173
3834992840,283cyclictest24866-21kworker/u16:3+efi_rts_wq20:59:400
3836992820,281cyclictest24866-21kworker/u16:3+efi_rts_wq23:30:052
3834992820,281cyclictest3696-21kworker/u16:1+efi_rts_wq22:09:500
3834992820,281cyclictest3696-21kworker/u16:1+efi_rts_wq21:10:150
3834992820,281cyclictest3696-21kworker/u16:1+efi_rts_wq19:59:270
3837992810,280cyclictest24866-21kworker/u16:3+efi_rts_wq20:25:143
3837992810,280cyclictest24866-21kworker/u16:3+efi_rts_wq19:40:133
3836992810,280cyclictest24866-21kworker/u16:3+efi_rts_wq20:55:142
3835992800,279cyclictest3696-21kworker/u16:1+efi_rts_wq22:15:131
3835992800,279cyclictest24866-21kworker/u16:3+efi_rts_wq22:00:121
3834992800,279cyclictest3696-21kworker/u16:1+efi_rts_wq20:45:140
3834992800,279cyclictest24866-21kworker/u16:3+efi_rts_wq23:05:130
3835992740,273cyclictest3696-21kworker/u16:1+efi_rts_wq19:25:121
3834992720,271cyclictest22535-21kworker/u16:1+efi_rts_wq00:15:140
3834992710,268cyclictest3696-21kworker/u16:1+efi_rts_wq21:30:150
3834992700,269cyclictest3696-21kworker/u16:1+efi_rts_wq20:35:140
3836992680,267cyclictest3696-21kworker/u16:1+efi_rts_wq22:50:132
3835992680,267cyclictest24866-21kworker/u16:3+efi_rts_wq19:50:131
3834992680,267cyclictest3696-21kworker/u16:1+efi_rts_wq21:59:490
3835992670,266cyclictest3696-21kworker/u16:1+efi_rts_wq22:35:141
3836992660,265cyclictest6052-21kworker/u16:0+efi_rts_wq23:25:152
3837992640,263cyclictest3696-21kworker/u16:1+efi_rts_wq19:20:133
3834992640,263cyclictest3696-21kworker/u16:1+efi_rts_wq22:39:570
3834992630,262cyclictest3696-21kworker/u16:1+efi_rts_wq22:20:120
3835992620,261cyclictest3696-21kworker/u16:1+efi_rts_wq20:30:171
3835992620,261cyclictest24866-21kworker/u16:3+efi_rts_wq21:50:141
3835992620,261cyclictest24866-21kworker/u16:3+efi_rts_wq21:50:141
3835992610,260cyclictest3696-21kworker/u16:1+efi_rts_wq20:20:171
3834992600,259cyclictest24866-21kworker/u16:3+efi_rts_wq23:00:120
3837992590,258cyclictest6052-21kworker/u16:0+efi_rts_wq23:40:133
3835992590,256cyclictest3696-21kworker/u16:1+efi_rts_wq21:35:141
3835992560,255cyclictest6052-21kworker/u16:0+efi_rts_wq23:20:131
3834992560,255cyclictest24866-21kworker/u16:3+efi_rts_wq22:10:140
3834992550,254cyclictest24866-21kworker/u16:3+efi_rts_wq20:50:120
3835992540,253cyclictest24866-21kworker/u16:3+efi_rts_wq22:25:141
3836992520,251cyclictest24866-21kworker/u16:3+efi_rts_wq23:05:132
3834992500,249cyclictest24866-21kworker/u16:3+efi_rts_wq19:24:210
3836992490,248cyclictest22535-21kworker/u16:1+efi_rts_wq00:20:142
3835992490,248cyclictest24866-21kworker/u16:3+efi_rts_wq22:55:141
3835992470,246cyclictest24866-21kworker/u16:3+efi_rts_wq21:25:131
3834992450,244cyclictest24866-21kworker/u16:3+efi_rts_wq19:54:270
3834992450,244cyclictest24831-21kworker/u16:2+efi_rts_wq23:55:130
3834992430,242cyclictest24866-21kworker/u16:3+efi_rts_wq20:00:140
3837992420,241cyclictest3696-21kworker/u16:1+efi_rts_wq22:45:153
3837992420,241cyclictest3696-21kworker/u16:1+efi_rts_wq21:45:163
3835992420,241cyclictest22535-21kworker/u16:1+efi_rts_wq23:50:151
3834992390,238cyclictest22535-21kworker/u16:1+efi_rts_wq00:30:120
3836992380,237cyclictest3696-21kworker/u16:1+efi_rts_wq20:20:172
3836992370,236cyclictest24866-21kworker/u16:3+efi_rts_wq19:50:132
3834992370,236cyclictest24866-21kworker/u16:3+efi_rts_wq19:35:150
3835992360,235cyclictest6052-21kworker/u16:0+efi_rts_wq23:35:121
3834992360,235cyclictest6052-21kworker/u16:0+efi_rts_wq23:15:130
3837992350,234cyclictest24866-21kworker/u16:3+efi_rts_wq20:50:133
3837992350,234cyclictest22535-21kworker/u16:1+efi_rts_wq00:00:143
3837992340,233cyclictest24831-21kworker/u16:2+efi_rts_wq00:10:143
3837992330,231cyclictest24866-21kworker/u16:3+efi_rts_wq23:10:133
3835992320,231cyclictest24866-21kworker/u16:3+efi_rts_wq20:54:391
3834992320,231cyclictest22535-21kworker/u16:1+efi_rts_wq00:35:130
3837992310,230cyclictest24866-21kworker/u16:3+efi_rts_wq19:10:133
3834992310,230cyclictest3696-21kworker/u16:1+efi_rts_wq21:39:470
3835992300,229cyclictest22535-21kworker/u16:1+efi_rts_wq00:20:151
3836992260,225cyclictest6052-21kworker/u16:0+efi_rts_wq23:20:132
3835992260,225cyclictest24831-21kworker/u16:2+efi_rts_wq23:45:061
3835992240,223cyclictest24866-21kworker/u16:3+efi_rts_wq21:05:091
3836992230,222cyclictest3696-21kworker/u16:1+efi_rts_wq19:15:012
3836992230,221cyclictest24866-21kworker/u16:3+efi_rts_wq20:29:332
3836992210,218cyclictest24866-21kworker/u16:3+efi_rts_wq19:40:132
3836992200,219cyclictest3696-21kworker/u16:1+efi_rts_wq22:35:142
3834992160,215cyclictest24866-21kworker/u16:3+efi_rts_wq20:15:170
3837992150,214cyclictest22535-21kworker/u16:1+efi_rts_wq00:15:133
3834992150,214cyclictest22535-21kworker/u16:1+efi_rts_wq00:25:150
3836992140,213cyclictest24866-21kworker/u16:3+efi_rts_wq22:30:152
3835992140,213cyclictest24866-21kworker/u16:3+efi_rts_wq22:30:151
3836992130,212cyclictest6052-21kworker/u16:0+efi_rts_wq23:35:142
3835992120,211cyclictest3696-21kworker/u16:1+efi_rts_wq22:05:161
3834992100,209cyclictest3696-21kworker/u16:1+efi_rts_wq19:45:130
3835992090,208cyclictest3696-21kworker/u16:1+efi_rts_wq21:45:161
3834992090,208cyclictest24866-21kworker/u16:3+efi_rts_wq19:30:140
3837992060,205cyclictest3696-21kworker/u16:1+efi_rts_wq23:05:013
3837992050,204cyclictest3696-21kworker/u16:1+efi_rts_wq20:10:283
3836992040,203cyclictest3696-21kworker/u16:1+efi_rts_wq19:25:132
3836992040,202cyclictest22535-21kworker/u16:1+efi_rts_wq00:30:132
3834992020,201cyclictest24866-21kworker/u16:3+efi_rts_wq20:44:360
3834992000,198cyclictest6052-21kworker/u16:0+efi_rts_wq23:40:130
3836991980,197cyclictest3696-21kworker/u16:1+efi_rts_wq22:20:142
3837991930,192cyclictest24866-21kworker/u16:3+efi_rts_wq21:15:133
3834991920,191cyclictest24831-21kworker/u16:2+efi_rts_wq00:00:110
3834991910,190cyclictest3696-21kworker/u16:1+efi_rts_wq21:24:420
3835991860,185cyclictest24866-21kworker/u16:3+efi_rts_wq23:05:131
3837991850,184cyclictest24866-21kworker/u16:3+efi_rts_wq21:25:143
3834991850,184cyclictest24866-21kworker/u16:3+efi_rts_wq21:15:130
3835991840,183cyclictest24866-21kworker/u16:3+efi_rts_wq20:40:181
3834991840,183cyclictest3696-21kworker/u16:1+efi_rts_wq22:54:590
3837991820,181cyclictest24866-21kworker/u16:3+efi_rts_wq22:14:513
3834991820,181cyclictest24866-21kworker/u16:3+efi_rts_wq19:14:190
3836991810,180cyclictest24866-21kworker/u16:3+efi_rts_wq19:39:232
3835991810,180cyclictest24866-21kworker/u16:3+efi_rts_wq19:44:251
3835991800,179cyclictest3696-21kworker/u16:1+efi_rts_wq20:14:311
3835991800,179cyclictest3696-21kworker/u16:1+efi_rts_wq19:49:251
3835991790,178cyclictest24866-21kworker/u16:3+efi_rts_wq21:19:431
3835991740,173cyclictest22535-21kworker/u16:1+efi_rts_wq00:25:161
3837991710,170cyclictest3696-21kworker/u16:1+efi_rts_wq19:34:213
3837991710,170cyclictest22535-21kworker/u16:1+efi_rts_wq00:25:143
3834991700,169cyclictest24866-21kworker/u16:3+efi_rts_wq21:54:490
3834991700,169cyclictest24866-21kworker/u16:3+efi_rts_wq21:54:480
3834991690,168cyclictest24866-21kworker/u16:3+efi_rts_wq22:29:550
3836991640,163cyclictest24866-21kworker/u16:3+efi_rts_wq22:00:122
3837991610,160cyclictest6052-21kworker/u16:0+efi_rts_wq23:25:043
3836991550,154cyclictest24866-21kworker/u16:3+efi_rts_wq21:40:172
3835991540,153cyclictest3696-21kworker/u16:1+efi_rts_wq21:30:141
3835991530,152cyclictest24866-21kworker/u16:3+efi_rts_wq21:40:181
3836991510,150cyclictest22535-21kworker/u16:1+efi_rts_wq00:05:122
3836991410,140cyclictest3696-21kworker/u16:1+efi_rts_wq22:19:532
3834991400,139cyclictest3696-21kworker/u16:1+efi_rts_wq20:10:270
3837991320,131cyclictest24866-21kworker/u16:3+efi_rts_wq22:55:143
3837991280,127cyclictest24866-21kworker/u16:3+efi_rts_wq22:44:583
3837991240,123cyclictest11170-21kworker/u16:2+efi_rts_wq23:15:023
3835991220,120cyclictest24831-21kworker/u16:2+efi_rts_wq00:05:111
3834991220,121cyclictest24866-21kworker/u16:3+efi_rts_wq22:49:580
3835991200,119cyclictest22535-21kworker/u16:1+efi_rts_wq23:55:081
3835991170,116cyclictest6052-21kworker/u16:0+efi_rts_wq23:25:141
3834991160,115cyclictest24866-21kworker/u16:3+efi_rts_wq19:40:130
3836991130,112cyclictest3696-21kworker/u16:1+efi_rts_wq20:30:172
3835991120,111cyclictest24866-21kworker/u16:3+efi_rts_wq19:35:151
3835991090,108cyclictest3696-21kworker/u16:1+efi_rts_wq22:50:131
3834991040,104cyclictest3696-21kworker/u16:1+efi_rts_wq20:24:330
3834991020,101cyclictest24831-21kworker/u16:2+efi_rts_wq00:10:140
3836991000,99cyclictest3696-21kworker/u16:1+efi_rts_wq21:55:142
383499990,98cyclictest24866-21kworker/u16:3+efi_rts_wq21:44:480
383499980,97cyclictest3696-21kworker/u16:1+efi_rts_wq20:09:290
383699960,95cyclictest3696-21kworker/u16:1+efi_rts_wq21:49:492
383699960,95cyclictest24866-21kworker/u16:3+efi_rts_wq20:04:292
3836993430,4cyclictest799-21snmpd00:00:452
3837993229,2cyclictest799-21snmpd20:31:363
3836993229,3cyclictest799-21snmpd21:37:172
3836993229,3cyclictest799-21snmpd21:34:492
3836993229,3cyclictest799-21snmpd21:24:362
3836993229,2cyclictest799-21snmpd00:26:002
3836993228,4cyclictest799-21snmpd20:41:572
3834993230,2cyclictest799-21snmpd19:16:590
3837993129,2cyclictest799-21snmpd19:53:103
3836993129,2cyclictest799-21snmpd23:13:192
3836993129,2cyclictest799-21snmpd22:29:572
3836993128,3cyclictest799-21snmpd21:25:132
3835993130,1cyclictest799-21snmpd22:24:531
3835993129,2cyclictest799-21snmpd00:10:431
3835993129,2cyclictest14058-21cat22:10:151
3834993130,1cyclictest799-21snmpd20:30:570
3834993129,2cyclictest799-21snmpd22:55:220
3834993129,2cyclictest799-21snmpd20:26:080
3834993129,2cyclictest799-21snmpd00:22:190
3837993029,1cyclictest799-21snmpd22:19:593
3837993029,1cyclictest799-21snmpd20:01:353
3837993028,2cyclictest799-21snmpd22:39:403
3837993028,2cyclictest799-21snmpd00:05:423
3836993029,1cyclictest799-21snmpd22:46:312
3836993029,1cyclictest799-21snmpd21:54:352
3836993029,1cyclictest799-21snmpd21:54:342
3836993029,1cyclictest799-21snmpd20:19:432
3836993029,1cyclictest799-21snmpd19:30:372
3836993028,2cyclictest799-21snmpd21:16:012
3835993030,0cyclictest32042-21kworker/1:1+events00:02:361
3835993029,1cyclictest799-21snmpd21:00:011
3835993029,1cyclictest799-21snmpd20:17:311
3835993027,3cyclictest799-21snmpd22:42:181
3834993029,1cyclictest799-21snmpd22:19:030
3834993028,2cyclictest799-21snmpd23:29:190
3837992928,1cyclictest799-21snmpd22:20:213
3837992928,1cyclictest799-21snmpd21:05:033
3837992928,1cyclictest799-21snmpd20:22:083
3837992928,1cyclictest799-21snmpd19:29:433
3837992928,1cyclictest799-21snmpd00:30:463
3837992927,2cyclictest799-21snmpd23:02:543
3837992927,2cyclictest799-21snmpd22:06:113
3837992927,2cyclictest799-21snmpd20:47:293
3837992927,2cyclictest799-21snmpd20:07:113
3836992928,1cyclictest799-21snmpd23:58:562
3836992927,2cyclictest799-21snmpd23:01:572
3836992926,3cyclictest799-21snmpd21:05:342
3836992926,3cyclictest799-21snmpd20:53:242
3836992926,3cyclictest799-21snmpd00:15:212
3835992929,0cyclictest20364-21kworker/1:2+events23:40:321
3835992929,0cyclictest17618-21kworker/1:1+events23:32:081
3835992928,1cyclictest799-21snmpd20:29:171
3835992928,1cyclictest799-21snmpd00:37:491
3835992927,2cyclictest799-21snmpd22:46:521
3834992929,0cyclictest799-21snmpd23:23:020
3834992928,1cyclictest799-21snmpd23:46:170
3834992928,1cyclictest799-21snmpd23:34:560
3834992928,1cyclictest799-21snmpd22:30:350
3834992928,1cyclictest799-21snmpd22:01:410
3837992828,0cyclictest22535-21kworker/u16:1+atlantic23:54:543
3837992827,1cyclictest799-21snmpd23:59:033
3837992827,1cyclictest799-21snmpd22:51:303
3837992827,1cyclictest799-21snmpd22:34:523
3837992827,1cyclictest799-21snmpd19:49:013
3837992826,2cyclictest799-21snmpd23:20:193
3837992826,2cyclictest799-21snmpd22:29:183
3837992826,2cyclictest799-21snmpd20:17:253
3837992826,2cyclictest799-21snmpd19:35:253
3836992827,1cyclictest799-21snmpd19:55:482
3836992823,3cyclictest799-21snmpd23:50:332
3835992827,1cyclictest799-21snmpd21:13:031
3835992827,1cyclictest799-21snmpd19:13:061
3834992828,0cyclictest799-21snmpd23:35:350
3834992828,0cyclictest799-21snmpd23:12:320
3834992826,2cyclictest799-21snmpd00:09:070
3837992725,2cyclictest21563-21cat23:35:153
3836992727,0cyclictest73850irq/136-enp1s023:16:242
3836992726,1cyclictest799-21snmpd19:13:352
3836992724,3cyclictest799-21snmpd23:45:082
3836992724,3cyclictest799-21snmpd22:40:512
3836992724,3cyclictest799-21snmpd22:08:122
3835992725,2cyclictest799-21snmpd21:59:531
3834992725,2cyclictest799-21snmpd21:28:520
3837992626,0cyclictest3696-21kworker/u16:1+atlantic21:35:303
3837992623,2cyclictest799-21snmpd20:56:233
3836992626,0cyclictest74050irq/138-enp1s022:55:102
3836992625,1cyclictest799-21snmpd20:46:352
3835992624,2cyclictest799-21snmpd19:55:181
3835992624,2cyclictest799-21snmpd19:33:191
3837992524,1cyclictest799-21snmpd23:32:073
3837992524,1cyclictest799-21snmpd00:24:283
3837992523,2cyclictest10323-21cat20:40:193
3836992524,1cyclictest799-21snmpd20:12:592
3836992524,1cyclictest799-21snmpd00:39:162
3836992523,2cyclictest799-21snmpd22:11:542
3835992524,1cyclictest799-21snmpd20:39:391
3834992525,0cyclictest24866-21kworker/u16:3+atlantic19:29:370
3834992523,2cyclictest799-21snmpd21:08:460
3836992423,1cyclictest799-21snmpd21:11:162
3835992423,1cyclictest799-21snmpd20:46:301
3834992423,1cyclictest799-21snmpd21:47:590
3836992322,1cyclictest799-21snmpd19:45:042
3835992322,1cyclictest799-21snmpd20:06:131
3834992321,2cyclictest799-21snmpd21:01:420
3837992222,0cyclictest799-21snmpd21:50:263
3837992222,0cyclictest799-21snmpd21:50:253
3837992220,2cyclictest799-21snmpd19:15:033
3835992220,2cyclictest799-21snmpd19:20:071
3837992120,1cyclictest799-21snmpd21:56:283
3837992120,1cyclictest799-21snmpd21:10:403
3837992119,2cyclictest799-21snmpd21:41:163
3835992120,1cyclictest799-21snmpd00:15:061
3835992018,2cyclictest799-21snmpd21:03:181
3835991817,1cyclictest799-21snmpd00:30:161
3837991717,0cyclictest24866-21kworker/u16:3+atlantic20:38:373
3835991616,0cyclictest8294-21kworker/1:0+events20:01:381
3836991514,1cyclictest799-21snmpd20:38:022
3836991210,2cyclictest9225-21cat19:20:162
38369985,3cyclictest180952sleep221:02:002
38379965,1cyclictest30229-21ps21:30:203
38379965,1cyclictest10954-21seq22:03:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional