You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 18:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue Sep 01, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
246389910531050,3cyclictest22475-21kworker/3:0+events10:42:353
246389910521051,1cyclictest3394-21kworker/3:0+events08:56:473
246389910521050,2cyclictest4108-21kworker/3:0+events11:28:173
246389910521050,2cyclictest32318-21kworker/3:0+events09:52:103
246389910521050,2cyclictest31629-21kworker/3:1+events11:50:543
246389910521050,2cyclictest30023-21kworker/3:1+events10:26:513
246389910521049,3cyclictest3394-21kworker/3:0+events09:19:073
246389910521049,3cyclictest32318-21kworker/3:0+events09:41:253
246389910521049,3cyclictest14058-21kworker/3:2+events08:11:053
246389910511049,2cyclictest8345-21kworker/3:1+events08:02:133
246389910511049,2cyclictest8345-21kworker/3:1+events07:53:393
246389910511049,2cyclictest32318-21kworker/3:0+events10:14:113
246389910511049,2cyclictest32318-21kworker/3:0+events09:45:223
246389910511049,2cyclictest31629-21kworker/3:1+events11:24:253
246389910511049,2cyclictest18909-21kworker/3:2+events09:24:123
246389910511049,2cyclictest18115-21kworker/3:0+events08:17:153
246389910511049,2cyclictest16564-21kworker/3:3+events11:16:063
246389910511049,2cyclictest14058-21kworker/3:2+events08:05:433
246389910511049,2cyclictest11403-21kworker/3:1+events09:57:353
246389910511049,2cyclictest11036-21kworker/3:0+events07:56:283
246389910511048,3cyclictest22475-21kworker/3:0+events10:57:113
246389910501048,2cyclictest32318-21kworker/3:0+events10:23:493
246389910501048,2cyclictest31629-21kworker/3:1+events11:44:053
246389910501048,2cyclictest30023-21kworker/3:1+events10:08:023
246389910501048,2cyclictest23650-21kworker/3:0+events11:49:133
246389910501048,2cyclictest22475-21kworker/3:0+events10:49:443
246389910501048,2cyclictest17583-21kworker/3:2+events10:35:203
246389910501048,2cyclictest1125-21kworker/3:2+events08:50:443
246389910501047,3cyclictest21389-21kworker/3:0+events11:10:453
246269910501046,3cyclictest8756-21kworker/0:2+events09:27:230
246389910491047,2cyclictest32318-21kworker/3:0+events10:01:503
246389910491047,2cyclictest31629-21kworker/3:1+events11:33:183
246389910491046,3cyclictest15172-21kworker/3:1+events11:02:113
246269910491047,2cyclictest1455-21kworker/0:2+events12:11:050
246389910481046,2cyclictest32318-21kworker/3:0+events09:37:473
246389910471044,3cyclictest30023-21kworker/3:1+events10:17:213
246269910471045,2cyclictest28323-21kworker/0:1+events11:59:410
246269910471045,2cyclictest1455-21kworker/0:2+events12:25:230
246269910461043,3cyclictest32685-21turbostat10:14:550
246389910451043,2cyclictest22475-21kworker/3:0+events10:54:033
246389910441042,2cyclictest16564-21kworker/3:3+events11:07:583
246269910441041,3cyclictest28323-21kworker/0:1+events09:32:130
246269910431042,1cyclictest11120-21kworker/0:0+events12:18:040
246299910411040,1cyclictest11401-21kworker/1:0+events12:31:371
246269910401035,4cyclictest1455-21kworker/0:2+events12:06:060
246389910371035,2cyclictest31629-21kworker/3:1+events11:37:113
246299910351033,2cyclictest20832-21kworker/1:2+events09:10:431
246269910351032,3cyclictest1455-21kworker/0:2+events12:21:590
246389910331030,3cyclictest30023-21kworker/3:1+events10:30:443
246269910331031,2cyclictest9231-21turbostat09:14:550
246299910301029,1cyclictest20832-21kworker/1:2+events09:02:381
246339910221020,2cyclictest21822-21kworker/2:1+events12:03:082
246389910211019,2cyclictest24607-21turbostat12:24:563
246339910161014,2cyclictest28079-21turbostat10:09:552
246299910071006,1cyclictest26823-21kworker/1:1+events07:48:181
2462999991990,1cyclictest11401-21kworker/1:0+events12:37:581
2462699991988,3cyclictest31528-21turbostat08:49:540
2462999986985,1cyclictest20832-21kworker/1:2+events09:05:441
2462999984983,1cyclictest29448-21kworker/1:1+events08:43:191
2463899971969,2cyclictest20545-21turbostat08:24:543
2462999958957,1cyclictest20832-21kworker/1:2+events08:46:471
2462999957956,1cyclictest3923-21kworker/1:2+events07:37:561
2462999957956,1cyclictest26823-21kworker/1:1+events07:20:441
2462699957955,2cyclictest4872-21turbostat10:19:560
2462999955954,1cyclictest6041-21kworker/1:0+events08:31:501
2462999955954,1cyclictest3949-21kworker/1:0+events07:18:471
2462999953952,1cyclictest20832-21kworker/1:2+events08:29:461
2462999952951,1cyclictest31171-21kworker/1:2+events07:25:461
2462999951950,1cyclictest6041-21kworker/1:0+events08:35:441
2462999951950,1cyclictest20832-21kworker/1:2+events08:22:561
2462999950949,1cyclictest6041-21kworker/1:0+events07:41:531
2462999947946,1cyclictest26823-21kworker/1:1+events07:33:441
2462999944943,1cyclictest3949-21kworker/1:0+events07:12:321
2462999934932,2cyclictest1130-21turbostat11:59:551
2462999926924,2cyclictest9923-21turbostat10:24:551
2462999918916,2cyclictest29256-21turbostat12:29:561
2462699871869,2cyclictest18472-21turbostat08:19:540
2463899864862,2cyclictest5731-21turbostat12:04:563
2463899684682,2cyclictest27785-21turbostat09:34:553
2463899614610,4cyclictest9231-21turbostat09:14:553
2463899605602,3cyclictest6352-21turbostat07:49:543
2462699598595,3cyclictest28931-21turbostat11:54:560
2462699596593,3cyclictest5731-21turbostat12:04:550
2462699588586,2cyclictest18545-21turbostat09:24:560
2463899568567,1cyclictest31528-21turbostat08:49:543
2463399536533,3cyclictest1130-21turbostat11:59:552
2462999535531,4cyclictest18472-21turbostat08:19:541
2462999527525,2cyclictest3168-21turbostat08:59:561
2463899240,24cyclictest791-21runrttasks11:59:413
24633991919,0cyclictest21822-21kworker/2:1+events_freezable11:51:202
24633991919,0cyclictest21822-21kworker/2:1+events_freezable10:04:112
24638991818,0cyclictest67750irq/123-lan12:39:563
24638991818,0cyclictest67750irq/123-lan07:30:213
24638991817,1cyclictest67750irq/123-lan12:15:143
24638991817,1cyclictest67750irq/123-lan12:10:173
24638991817,1cyclictest67750irq/123-lan07:35:173
24633991817,1cyclictest784-21snmpd09:07:162
24638991717,0cyclictest67750irq/123-lan12:31:313
24638991717,0cyclictest67750irq/123-lan08:40:153
24638991717,0cyclictest67750irq/123-lan07:20:153
24638991716,1cyclictest67750irq/123-lan12:06:163
24633991717,0cyclictest6291-21kworker/2:2+events_freezable12:38:532
24633991717,0cyclictest21822-21kworker/2:1+events_freezable10:53:052
24633991717,0cyclictest21822-21kworker/2:1+events_freezable09:55:122
24638991615,1cyclictest67750irq/123-lan12:28:063
24638991615,1cyclictest67750irq/123-lan08:30:183
24638991615,1cyclictest67750irq/123-lan07:25:113
24638991615,1cyclictest67750irq/123-lan07:15:133
24633991616,0cyclictest784-21snmpd11:47:282
24633991616,0cyclictest784-21snmpd11:15:412
24633991616,0cyclictest784-21snmpd11:05:392
24633991616,0cyclictest784-21snmpd10:32:202
24633991616,0cyclictest784-21snmpd09:49:062
24633991616,0cyclictest784-21snmpd09:17:572
24633991616,0cyclictest784-21snmpd08:19:332
24633991616,0cyclictest21822-21kworker/2:1+events_freezable10:19:562
24638991515,0cyclictest67750irq/123-lan07:10:143
24638991514,1cyclictest67750irq/123-lan09:25:173
24638991514,1cyclictest67750irq/123-lan08:35:163
24638991514,1cyclictest67750irq/123-lan08:25:173
24633991515,0cyclictest784-21snmpd12:34:222
24633991515,0cyclictest784-21snmpd12:22:502
24633991515,0cyclictest784-21snmpd12:16:462
24633991515,0cyclictest784-21snmpd11:04:562
24633991515,0cyclictest784-21snmpd09:33:052
24633991515,0cyclictest784-21snmpd08:50:402
24633991515,0cyclictest784-21snmpd08:02:002
24633991515,0cyclictest3870-21cat08:55:152
24633991515,0cyclictest21822-21kworker/2:1+events_freezable09:26:502
24633991515,0cyclictest21822-21kworker/2:1+events_freezable09:23:472
24633991414,0cyclictest784-21snmpd12:14:102
24638991313,0cyclictest67750irq/123-lan07:43:463
24633991313,0cyclictest6291-21kworker/2:2+events_freezable12:05:182
24633991313,0cyclictest21822-21kworker/2:1+events_freezable11:35:222
24633991313,0cyclictest21822-21kworker/2:1+events_freezable10:46:292
24633991313,0cyclictest21822-21kworker/2:1+events_freezable10:25:022
24633991313,0cyclictest21822-21kworker/2:1+events_freezable10:10:182
24633991313,0cyclictest21822-21kworker/2:1+events_freezable09:40:182
24633991312,1cyclictest21822-21kworker/2:1+events_freezable11:40:452
24633991312,1cyclictest21822-21kworker/2:1+events_freezable11:34:312
24633991312,1cyclictest21822-21kworker/2:1+events_freezable10:56:432
24638991212,0cyclictest67750irq/123-lan09:05:133
24633991212,0cyclictest6291-21kworker/2:2+events_freezable12:25:122
24633991212,0cyclictest21822-21kworker/2:1+events_freezable11:26:052
24633991212,0cyclictest21822-21kworker/2:1+events_freezable11:20:032
24633991212,0cyclictest21822-21kworker/2:1+events_freezable11:10:202
24633991212,0cyclictest21822-21kworker/2:1+events_freezable10:40:392
24633991212,0cyclictest21822-21kworker/2:1+events_freezable10:35:032
24633991212,0cyclictest21822-21kworker/2:1+events_freezable10:20:092
24633991212,0cyclictest21822-21kworker/2:1+events_freezable09:50:122
24633991212,0cyclictest21822-21kworker/2:1+events_freezable09:13:062
24633991212,0cyclictest21822-21kworker/2:1+events_freezable09:00:102
24633991212,0cyclictest21822-21kworker/2:1+events_freezable08:46:502
24633991212,0cyclictest21822-21kworker/2:1+events_freezable08:40:162
24633991212,0cyclictest21822-21kworker/2:1+events_freezable08:25:122
24633991212,0cyclictest21822-21kworker/2:1+events_freezable08:22:572
24633991212,0cyclictest21822-21kworker/2:1+events_freezable07:40:122
24633991212,0cyclictest21822-21kworker/2:1+events_freezable07:35:122
24633991212,0cyclictest21822-21kworker/2:1+events_freezable07:26:552
24633991212,0cyclictest21822-21kworker/2:1+events_freezable07:20:212
24633991211,1cyclictest21822-21kworker/2:1+events_freezable08:05:172
24633991211,1cyclictest21822-21kworker/2:1+events_freezable07:45:192
24633991111,0cyclictest21822-21kworker/2:1+events_freezable09:35:072
24633991111,0cyclictest21822-21kworker/2:1+events_freezable08:35:172
24633991111,0cyclictest21822-21kworker/2:1+events_freezable08:10:132
24633991111,0cyclictest21822-21kworker/2:1+events_freezable07:33:402
24633991111,0cyclictest21822-21kworker/2:1+events_freezable07:15:162
2463899109,1cyclictest67750irq/123-lan09:00:143
24633991010,0cyclictest21822-21kworker/2:1+events_freezable08:30:192
24633991010,0cyclictest21822-21kworker/2:1+events_freezable07:55:112
24633991010,0cyclictest21822-21kworker/2:1+events_freezable07:50:042
24633991010,0cyclictest21822-21kworker/2:1+events_freezable07:11:592
246299998,1cyclictest784-21snmpd12:03:391
246299998,1cyclictest784-21snmpd08:14:391
246299988,0cyclictest784-21snmpd09:43:501
246299988,0cyclictest782-21lldpd12:18:081
246299988,0cyclictest782-21lldpd09:51:101
246299987,1cyclictest784-21snmpd09:49:511
246299987,1cyclictest782-21lldpd11:48:021
246299987,1cyclictest507-21systemd-resolve11:33:551
246299987,1cyclictest2189-21ntp_kernel_pll_08:50:171
246299986,2cyclictest784-21snmpd11:53:361
246299986,2cyclictest784-21snmpd11:26:301
246299986,2cyclictest784-21snmpd09:35:301
246269988,0cyclictest784-21snmpd10:48:550
246269988,0cyclictest784-21snmpd08:27:210
246269988,0cyclictest784-21snmpd07:53:590
246269988,0cyclictest784-21snmpd07:28:130
246269987,1cyclictest784-21snmpd11:26:120
246269987,1cyclictest784-21snmpd11:16:440
246269986,2cyclictest784-21snmpd11:11:120
246269986,2cyclictest784-21snmpd08:31:570
246269986,2cyclictest20261-21cat11:05:150
246299977,0cyclictest782-21lldpd11:22:071
246299976,1cyclictest784-21snmpd10:11:421
246299976,1cyclictest784-21snmpd07:58:321
246299976,1cyclictest526-21avahi-daemon10:55:411
246299975,2cyclictest784-21snmpd12:14:221
246269977,0cyclictest784-21snmpd10:09:000
246269977,0cyclictest782-21lldpd10:23:430
246269977,0cyclictest782-21lldpd09:36:560
246269977,0cyclictest782-21lldpd07:58:320
246269977,0cyclictest782-21lldpd07:43:510
246269977,0cyclictest7213-21sh09:05:010
246269976,1cyclictest784-21snmpd11:38:510
246269976,1cyclictest782-21lldpd08:22:070
246269976,1cyclictest20171-21cpuspeed_turbos11:40:130
246269976,1cyclictest16776-21cpuspeed_turbos08:10:110
246299966,0cyclictest782-21lldpd12:09:291
246299966,0cyclictest782-21lldpd11:13:561
246299966,0cyclictest782-21lldpd10:43:061
246299965,1cyclictest782-21lldpd08:06:201
246299965,1cyclictest526-21avahi-daemon10:49:291
246299964,2cyclictest784-21snmpd11:06:151
246299963,2cyclictest29691-21ssh09:30:291
246299963,2cyclictest27340-21ssh12:21:491
246299963,2cyclictest27215-21ssh09:29:041
246299963,2cyclictest245-20systemd-journal10:05:231
246299962,3cyclictest19315-21grep09:20:141
246269966,0cyclictest784-21snmpd12:34:100
246269966,0cyclictest784-21snmpd10:44:070
246269966,0cyclictest784-21snmpd07:33:430
246269966,0cyclictest782-21lldpd10:55:030
246269966,0cyclictest574-21rs:main0
246269966,0cyclictest526-21avahi-daemon12:35:470
246269965,1cyclictest526-21avahi-daemon09:48:160
246269965,1cyclictest1974-21gltestperf11:20:130
246269963,3cyclictest784-21snmpd10:52:410
246269963,2cyclictest28049-21ssh10:04:580
246269963,2cyclictest12348-21ssh11:30:270
246269962,4cyclictest547-21NetworkManager10:29:390
246269962,4cyclictest547-21NetworkManager07:21:440
246269962,3cyclictest245-20systemd-journal09:53:010
246269962,3cyclictest18869-21ssh11:04:040
246299955,0cyclictest0-21swapper/111:00:171
246299953,2cyclictest784-21snmpd07:51:381
246299953,2cyclictest547-21NetworkManager10:25:571
246299953,2cyclictest547-21NetworkManager09:55:581
246299952,2cyclictest7724-21ssh10:50:521
246299952,2cyclictest7313-21ssh10:15:421
246299952,2cyclictest31562-21ssh11:16:301
246299952,2cyclictest27078-21ssh10:37:541
246299952,2cyclictest23800-21ssh10:00:111
246299952,2cyclictest22504-21ssh11:41:571
246299952,2cyclictest19971-21awk10:30:151
246299951,3cyclictest245-20systemd-journal09:16:211
246269955,0cyclictest526-21avahi-daemon08:44:070
246269954,1cyclictest784-21snmpd07:45:410
246269953,2cyclictest784-21snmpd10:32:160
246269953,2cyclictest784-21snmpd08:37:550
246269953,2cyclictest15085-21ntpq09:15:170
246269952,3cyclictest547-21NetworkManager11:46:130
246269952,2cyclictest7814-21gltestperf09:05:150
246269952,2cyclictest4898-21ssh09:40:060
246269952,2cyclictest4812-21seq08:55:400
246269952,2cyclictest3593-21wc07:35:210
246269952,2cyclictest24107-21apt-get10:35:150
246269951,4cyclictest547-21NetworkManager08:07:250
246269950,4cyclictest25660-21ntpq07:10:160
246299940,4cyclictest16206-21ntpq11:35:171
246299940,3cyclictest14145-21seq08:01:411
246269942,2cyclictest1855-21cat08:50:140
246269941,2cyclictest26917-21expr07:15:120
246269940,3cyclictest12848-21entropy08:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional