You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 10:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot3s.osadl.org (updated Thu Sep 18, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
99632323315,5sleep20-21swapper/219:06:472
99262317302,5sleep10-21swapper/119:06:221
100662317309,5sleep30-21swapper/319:08:083
98532314306,5sleep00-21swapper/019:05:250
10478992970,296cyclictest23335-21kworker/u16:0+efi_rts_wq22:45:122
10476992950,294cyclictest21072-21kworker/u16:1+efi_rts_wq23:50:130
10479992940,293cyclictest21072-21kworker/u16:1+efi_rts_wq23:50:133
10476992910,290cyclictest3299-21kworker/u16:2+efi_rts_wq20:15:130
10477992900,289cyclictest1223-21kworker/u16:1+efi_rts_wq19:10:131
10476992900,289cyclictest12615-21kworker/u16:2+efi_rts_wq00:00:100
10479992890,288cyclictest1223-21kworker/u16:1+efi_rts_wq19:25:103
10477992890,288cyclictest12615-21kworker/u16:2+efi_rts_wq00:01:181
10476992890,288cyclictest1223-21kworker/u16:1+efi_rts_wq21:40:140
10479992880,287cyclictest23335-21kworker/u16:0+efi_rts_wq22:40:143
10477992880,287cyclictest3299-21kworker/u16:2+efi_rts_wq21:45:101
10477992880,287cyclictest12615-21kworker/u16:2+efi_rts_wq23:15:121
10476992880,287cyclictest3299-21kworker/u16:2+efi_rts_wq19:50:140
10476992870,286cyclictest1223-21kworker/u16:1+efi_rts_wq21:30:150
10476992860,285cyclictest3299-21kworker/u16:2+efi_rts_wq22:09:170
10476992860,285cyclictest21072-21kworker/u16:1+efi_rts_wq23:46:150
10476992850,284cyclictest3299-21kworker/u16:2+efi_rts_wq20:40:130
10478992840,283cyclictest3299-21kworker/u16:2+efi_rts_wq22:35:142
10479992830,281cyclictest23335-21kworker/u16:0+efi_rts_wq22:59:273
10479992810,280cyclictest3299-21kworker/u16:2+efi_rts_wq21:54:133
10478992810,280cyclictest23335-21kworker/u16:0+efi_rts_wq23:05:142
10478992810,280cyclictest12615-21kworker/u16:2+efi_rts_wq23:55:142
10479992770,276cyclictest12615-21kworker/u16:2+efi_rts_wq23:44:373
10479992770,276cyclictest1223-21kworker/u16:1+efi_rts_wq21:15:143
10478992770,276cyclictest3299-21kworker/u16:2+efi_rts_wq20:25:142
10476992760,275cyclictest3299-21kworker/u16:2+efi_rts_wq21:10:110
10478992750,273cyclictest23335-21kworker/u16:0+efi_rts_wq23:10:152
10476992750,274cyclictest3299-21kworker/u16:2+efi_rts_wq22:00:120
10479992740,273cyclictest12615-21kworker/u16:2+efi_rts_wq23:20:153
10479992740,273cyclictest1223-21kworker/u16:1+efi_rts_wq20:45:133
10476992740,273cyclictest1223-21kworker/u16:1+efi_rts_wq21:09:040
10479992730,272cyclictest1223-21kworker/u16:1+efi_rts_wq22:25:123
10479992730,272cyclictest1223-21kworker/u16:1+efi_rts_wq20:05:143
10478992730,272cyclictest3299-21kworker/u16:2+efi_rts_wq20:00:112
10477992730,272cyclictest23335-21kworker/u16:0+efi_rts_wq22:54:261
10477992730,272cyclictest21072-21kworker/u16:1+efi_rts_wq00:20:131
10479992720,271cyclictest1223-21kworker/u16:1+efi_rts_wq20:54:023
10478992720,271cyclictest12615-21kworker/u16:2+efi_rts_wq00:30:142
10477992720,271cyclictest1223-21kworker/u16:1+efi_rts_wq20:05:131
10477992710,270cyclictest12615-21kworker/u16:2+efi_rts_wq23:45:151
10476992700,269cyclictest21072-21kworker/u16:1+efi_rts_wq00:15:170
10476992700,269cyclictest12615-21kworker/u16:2+efi_rts_wq23:15:130
10479992690,268cyclictest3299-21kworker/u16:2+efi_rts_wq22:35:143
10477992690,268cyclictest23335-21kworker/u16:0+efi_rts_wq23:29:341
10476992680,267cyclictest3299-21kworker/u16:2+efi_rts_wq21:20:130
10479992670,265cyclictest3299-21kworker/u16:2+efi_rts_wq22:34:223
10478992660,265cyclictest1223-21kworker/u16:1+efi_rts_wq21:59:142
10478992650,264cyclictest21072-21kworker/u16:1+efi_rts_wq00:16:212
10477992650,264cyclictest21072-21kworker/u16:1+efi_rts_wq00:35:131
10476992630,262cyclictest1223-21kworker/u16:1+efi_rts_wq21:35:150
10477992620,261cyclictest23335-21kworker/u16:0+efi_rts_wq22:45:121
10477992620,261cyclictest1223-21kworker/u16:1+efi_rts_wq20:30:121
10478992610,260cyclictest23335-21kworker/u16:0+efi_rts_wq23:30:102
10477992590,258cyclictest1223-21kworker/u16:1+efi_rts_wq22:10:131
10478992570,256cyclictest3299-21kworker/u16:2+efi_rts_wq21:24:092
10477992560,255cyclictest21072-21kworker/u16:1+efi_rts_wq23:39:361
10479992550,254cyclictest3299-21kworker/u16:2+efi_rts_wq22:50:143
10478992540,253cyclictest3299-21kworker/u16:2+efi_rts_wq19:48:512
10478992540,253cyclictest3299-21kworker/u16:2+efi_rts_wq19:48:502
10477992540,253cyclictest3299-21kworker/u16:2+efi_rts_wq22:20:151
10477992540,253cyclictest12615-21kworker/u16:2+efi_rts_wq00:10:151
10477992530,252cyclictest1223-21kworker/u16:1+efi_rts_wq20:10:131
10476992520,251cyclictest1223-21kworker/u16:1+efi_rts_wq19:40:120
10477992510,250cyclictest1223-21kworker/u16:1+efi_rts_wq20:20:121
10477992500,249cyclictest23335-21kworker/u16:0+efi_rts_wq23:10:151
10478992490,248cyclictest3299-21kworker/u16:2+efi_rts_wq19:53:512
10479992480,247cyclictest1223-21kworker/u16:1+efi_rts_wq21:39:123
10476992470,246cyclictest21072-21kworker/u16:1+efi_rts_wq00:25:130
10479992430,242cyclictest3299-21kworker/u16:2+efi_rts_wq20:15:143
10479992430,241cyclictest12615-21kworker/u16:2+efi_rts_wq23:55:143
10478992410,240cyclictest3299-21kworker/u16:2+efi_rts_wq22:20:172
10478992410,240cyclictest1223-21kworker/u16:1+efi_rts_wq20:20:122
10477992400,239cyclictest3299-21kworker/u16:2+efi_rts_wq19:35:121
10476992400,239cyclictest3299-21kworker/u16:2+efi_rts_wq20:28:570
10478992390,238cyclictest1223-21kworker/u16:1+efi_rts_wq20:35:132
10479992380,235cyclictest1223-21kworker/u16:1+efi_rts_wq19:15:153
10476992370,236cyclictest3299-21kworker/u16:2+efi_rts_wq20:03:530
10479992350,234cyclictest21072-21kworker/u16:1+efi_rts_wq00:05:153
10477992330,232cyclictest1223-21kworker/u16:1+efi_rts_wq21:25:131
10479992310,230cyclictest12615-21kworker/u16:2+efi_rts_wq23:34:343
10477992310,230cyclictest1223-21kworker/u16:1+efi_rts_wq19:40:131
10478992300,229cyclictest23335-21kworker/u16:0+efi_rts_wq22:44:252
10476992300,229cyclictest1223-21kworker/u16:1+efi_rts_wq21:49:130
10477992290,228cyclictest21072-21kworker/u16:1+efi_rts_wq00:26:241
10476992280,227cyclictest1223-21kworker/u16:1+efi_rts_wq22:10:130
10479992270,226cyclictest3299-21kworker/u16:2+efi_rts_wq19:45:143
10479992270,226cyclictest3299-21kworker/u16:2+efi_rts_wq19:45:133
10479992250,224cyclictest1966-21kworker/u16:1+efi_rts_wq23:00:153
10478992250,224cyclictest1223-21kworker/u16:1+efi_rts_wq22:19:182
10477992250,224cyclictest3299-21kworker/u16:2+efi_rts_wq19:33:471
10477992250,224cyclictest1223-21kworker/u16:1+efi_rts_wq20:38:591
10477992230,222cyclictest1966-21kworker/u16:1+efi_rts_wq22:55:151
10476992230,222cyclictest3299-21kworker/u16:2+efi_rts_wq22:24:190
10476992230,222cyclictest1223-21kworker/u16:1+efi_rts_wq22:15:120
10478992220,220cyclictest3299-21kworker/u16:2+efi_rts_wq22:30:142
10476992220,221cyclictest12615-21kworker/u16:2+efi_rts_wq00:31:240
10476992210,220cyclictest1223-21kworker/u16:1+efi_rts_wq19:13:440
10478992160,214cyclictest12615-21kworker/u16:2+efi_rts_wq00:00:102
10477992150,214cyclictest3299-21kworker/u16:2+efi_rts_wq19:45:131
10477992150,214cyclictest3299-21kworker/u16:2+efi_rts_wq19:45:131
10477992090,208cyclictest3299-21kworker/u16:2+efi_rts_wq19:23:461
10476992070,206cyclictest3299-21kworker/u16:2+efi_rts_wq20:59:030
10479992050,204cyclictest3299-21kworker/u16:2+efi_rts_wq21:14:053
10477992050,204cyclictest1223-21kworker/u16:1+efi_rts_wq19:15:001
10478992040,203cyclictest12615-21kworker/u16:2+efi_rts_wq23:25:132
10477992030,202cyclictest12615-21kworker/u16:2+efi_rts_wq23:55:151
10476992030,202cyclictest3299-21kworker/u16:2+efi_rts_wq19:30:140
10477991980,197cyclictest1223-21kworker/u16:1+efi_rts_wq21:55:091
10476991960,195cyclictest1223-21kworker/u16:1+efi_rts_wq19:20:130
10476991940,193cyclictest1223-21kworker/u16:1+efi_rts_wq21:29:100
10476991920,191cyclictest1223-21kworker/u16:1+efi_rts_wq20:13:560
10476991910,190cyclictest3299-21kworker/u16:2+efi_rts_wq22:50:130
10477991880,187cyclictest23335-21kworker/u16:0+efi_rts_wq23:09:291
10478991870,186cyclictest1223-21kworker/u16:1+efi_rts_wq21:44:132
10479991850,184cyclictest12615-21kworker/u16:2+efi_rts_wq23:35:143
10478991840,183cyclictest1223-21kworker/u16:1+efi_rts_wq19:55:132
10476991810,180cyclictest23335-21kworker/u16:0+efi_rts_wq22:39:230
10479991780,177cyclictest1223-21kworker/u16:1+efi_rts_wq19:55:133
10479991780,177cyclictest1223-21kworker/u16:1+efi_rts_wq19:20:143
10479991750,175cyclictest21692-21kworker/u16:0+efi_rts_wq00:36:253
10476991740,173cyclictest1223-21kworker/u16:1+efi_rts_wq20:49:010
10476991710,170cyclictest3299-21kworker/u16:2+efi_rts_wq22:30:130
10476991710,170cyclictest12615-21kworker/u16:2+efi_rts_wq23:25:140
10478991690,169cyclictest3299-21kworker/u16:2+efi_rts_wq22:04:172
10479991671,164cyclictest23335-21kworker/u16:0+efi_rts_wq22:45:123
10478991670,166cyclictest1223-21kworker/u16:1+efi_rts_wq21:19:092
10476991650,164cyclictest1223-21kworker/u16:1+efi_rts_wq19:58:520
10478991640,164cyclictest1966-21kworker/u16:1+efi_rts_wq23:00:152
10477991610,160cyclictest1966-21kworker/u16:1+efi_rts_wq23:04:281
10479991600,160cyclictest1223-21kworker/u16:1+efi_rts_wq20:33:583
10476991600,159cyclictest1223-21kworker/u16:1+efi_rts_wq20:50:170
10477991560,155cyclictest3299-21kworker/u16:2+efi_rts_wq21:10:111
10476991530,150cyclictest1223-21kworker/u16:1+efi_rts_wq21:00:130
10477991510,150cyclictest1223-21kworker/u16:1+efi_rts_wq19:28:461
10479991450,144cyclictest1223-21kworker/u16:1+efi_rts_wq21:00:133
10478991400,140cyclictest12615-21kworker/u16:2+efi_rts_wq00:11:202
10476991390,138cyclictest21072-21kworker/u16:1+efi_rts_wq00:35:130
10477991290,128cyclictest1223-21kworker/u16:1+efi_rts_wq21:04:051
10476991250,124cyclictest23335-21kworker/u16:0+efi_rts_wq22:40:130
10476991230,122cyclictest12615-21kworker/u16:2+efi_rts_wq23:20:140
10477991200,119cyclictest3299-21kworker/u16:2+efi_rts_wq22:00:131
10476991200,119cyclictest1223-21kworker/u16:1+efi_rts_wq22:29:200
10477991110,110cyclictest1223-21kworker/u16:1+efi_rts_wq19:55:121
10479991060,105cyclictest21072-21kworker/u16:1+efi_rts_wq00:21:223
10476991000,99cyclictest3299-21kworker/u16:2+efi_rts_wq20:08:540
238892640,0sleep30-21swapper/320:55:193
10479993329,1cyclictest12673-21kworker/3:1+events20:20:143
10478993230,2cyclictest799-21snmpd21:13:072
10477993230,2cyclictest799-21snmpd22:05:561
10477993230,2cyclictest799-21snmpd21:53:031
10476993228,3cyclictest799-21snmpd22:48:400
10479993130,1cyclictest4814-21kworker/3:0+events23:29:303
10479993130,1cyclictest4814-21kworker/3:0+events23:10:273
10479993130,1cyclictest26856-21kworker/3:1+events23:47:383
10479993130,1cyclictest2006-21kworker/3:2+events00:02:083
10479993129,2cyclictest799-21snmpd22:12:333
10479993129,2cyclictest799-21snmpd20:40:173
10479993129,2cyclictest799-21snmpd20:36:093
10479993129,2cyclictest12503-21kworker/3:1+events23:07:063
10478993129,2cyclictest799-21snmpd21:54:452
10478993129,2cyclictest799-21snmpd21:30:172
10478993129,2cyclictest799-21snmpd19:17:542
10478993129,2cyclictest799-21snmpd00:05:322
10477993129,2cyclictest799-21snmpd22:17:171
10477993129,2cyclictest799-21snmpd21:19:101
10477993129,2cyclictest32743-21cat20:00:121
10476993130,1cyclictest799-21snmpd19:16:140
10476993129,2cyclictest30522-21cat23:40:150
10476993129,1cyclictest799-21snmpd19:27:390
10479993029,1cyclictest799-21snmpd21:57:323
10479993029,1cyclictest799-21snmpd21:31:523
10479993029,1cyclictest799-21snmpd20:14:133
10479993029,1cyclictest799-21snmpd00:19:393
10479993029,1cyclictest2611-21cat21:25:153
10479993028,2cyclictest799-21snmpd21:07:493
10479993028,2cyclictest799-21snmpd19:37:453
10479993028,2cyclictest4814-21kworker/3:0+events23:15:223
10478993029,1cyclictest799-21snmpd19:36:422
10478993028,2cyclictest799-21snmpd23:47:472
10478993028,2cyclictest799-21snmpd23:19:492
10478993028,2cyclictest799-21snmpd21:27:192
10478993028,2cyclictest799-21snmpd20:40:442
10478993028,2cyclictest799-21snmpd00:22:512
10477993029,1cyclictest799-21snmpd23:24:011
10477993029,1cyclictest799-21snmpd22:41:181
10477993029,1cyclictest799-21snmpd22:35:391
10477993029,1cyclictest799-21snmpd20:17:471
10477993029,1cyclictest799-21snmpd00:05:451
10477993028,2cyclictest799-21snmpd23:31:041
10477993028,2cyclictest799-21snmpd22:29:181
10476993028,2cyclictest799-21snmpd20:37:260
10476993028,2cyclictest799-21snmpd19:38:210
10476993028,2cyclictest799-21snmpd00:10:560
10479992929,0cyclictest26856-21kworker/3:1+events00:27:343
10479992929,0cyclictest26856-21kworker/3:1+events00:13:343
10479992929,0cyclictest25424-21kworker/3:0+events22:24:473
10479992929,0cyclictest1692-21kworker/3:0+events21:40:203
10479992929,0cyclictest12974-21kworker/3:2+events22:19:343
10479992929,0cyclictest12974-21kworker/3:2+events22:05:003
10479992929,0cyclictest12673-21kworker/3:1+events19:40:033
10479992929,0cyclictest12673-21kworker/3:1+events19:30:173
10479992928,1cyclictest12673-21kworker/3:1+events21:20:183
10478992929,0cyclictest73950irq/137-enp1s022:57:242
10478992928,1cyclictest799-21snmpd20:31:022
10478992928,1cyclictest799-21snmpd19:44:262
10478992928,1cyclictest799-21snmpd19:30:402
10477992929,0cyclictest3299-21kworker/u16:2+atlantic20:41:311
10477992928,1cyclictest799-21snmpd20:50:071
10477992928,1cyclictest799-21snmpd19:53:281
10476992928,1cyclictest799-21snmpd23:33:490
10476992928,1cyclictest799-21snmpd21:16:160
10476992928,1cyclictest799-21snmpd20:22:000
10476992927,2cyclictest799-21snmpd21:51:380
10476992927,2cyclictest799-21snmpd00:24:240
10476992926,2cyclictest799-21snmpd23:56:120
10479992828,0cyclictest26856-21kworker/3:1+events00:30:063
10479992828,0cyclictest26455-21kworker/3:0+events19:10:173
10479992828,0cyclictest1692-21kworker/3:0+events21:45:143
10479992828,0cyclictest12974-21kworker/3:2+events22:00:213
10479992827,1cyclictest799-21snmpd19:51:553
10479992827,1cyclictest12673-21kworker/3:1+events20:25:153
10479992827,1cyclictest12673-21kworker/3:1+events20:00:103
10478992827,1cyclictest799-21snmpd23:52:082
10478992827,1cyclictest799-21snmpd22:14:542
10478992827,1cyclictest799-21snmpd20:52:512
10478992827,1cyclictest799-21snmpd19:20:432
10477992827,1cyclictest799-21snmpd21:34:051
10477992827,1cyclictest799-21snmpd21:22:201
10477992827,1cyclictest799-21snmpd21:06:271
10477992827,1cyclictest799-21snmpd20:45:331
10477992826,2cyclictest799-21snmpd22:30:481
10476992827,1cyclictest799-21snmpd23:37:440
10476992827,1cyclictest799-21snmpd23:06:590
10476992827,1cyclictest799-21snmpd23:04:040
10476992827,1cyclictest799-21snmpd19:47:160
10476992827,1cyclictest799-21snmpd19:47:160
10478992725,2cyclictest799-21snmpd23:39:102
10477992726,1cyclictest799-21snmpd20:27:561
10477992726,1cyclictest799-21snmpd00:17:311
10478992625,1cyclictest799-21snmpd21:04:032
10476992624,2cyclictest799-21snmpd20:30:120
10478992524,1cyclictest799-21snmpd20:16:572
10478992523,2cyclictest799-21snmpd20:48:122
10477992525,0cyclictest799-21snmpd23:40:501
10478992424,0cyclictest73850irq/136-enp1s023:40:522
10478992423,1cyclictest799-21snmpd21:39:162
10477992322,1cyclictest799-21snmpd20:55:271
10476992322,1cyclictest799-21snmpd21:59:320
10478992221,1cyclictest799-21snmpd22:27:002
10478992221,1cyclictest799-21snmpd20:09:532
10476992221,1cyclictest808-21lldpd00:05:390
10478992120,1cyclictest799-21snmpd22:51:092
10477992121,0cyclictest1223-21kworker/u16:1+atlantic21:40:311
10478992018,2cyclictest799-21snmpd19:10:362
10478992018,2cyclictest23459-21cat20:55:142
10477992020,0cyclictest12615-21kworker/u16:2+atlantic00:31:101
10476992020,0cyclictest74050irq/138-enp1s023:10:460
10476992020,0cyclictest73850irq/136-enp1s022:55:340
10478991917,2cyclictest799-21snmpd23:21:282
10478991917,2cyclictest799-21snmpd21:45:352
10478991917,2cyclictest799-21snmpd20:13:432
10477991919,0cyclictest799-21snmpd23:54:081
10478991818,0cyclictest1223-21kworker/u16:1+atlantic22:09:402
10478991615,1cyclictest799-21snmpd19:26:182
10478991615,1cyclictest799-21snmpd00:38:582
10478991514,1cyclictest799-21snmpd21:05:092
10477991515,0cyclictest1223-21kworker/u16:1+atlantic21:37:401
104789965,1cyclictest18530-21chrt00:25:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional