You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 01:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Sep 11, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8539910521049,2cyclictest570-21kworker/3:2+events09:26:293
8409910491048,1cyclictest9905-21kworker/0:2+events09:37:330
8539910481046,2cyclictest17115-21kworker/3:2+events10:20:443
8409910481045,2cyclictest8438-21kworker/0:1+events10:10:440
8539910471046,1cyclictest19794-21kworker/3:1+events09:56:073
8539910471045,2cyclictest21146-21turbostat11:04:563
8409910471046,1cyclictest14440-21kworker/0:1+events11:31:160
8539910461044,2cyclictest19794-21kworker/3:1+events11:09:283
8539910461044,1cyclictest19794-21kworker/3:1+events10:00:433
8539910461044,1cyclictest19794-21kworker/3:1+events09:23:493
8409910461045,1cyclictest3084-21kworker/0:2+events12:34:000
8409910451041,4cyclictest6832-21turbostat07:29:540
8539910441043,1cyclictest28228-21kworker/3:0+events10:32:333
8409910431042,1cyclictest9905-21kworker/0:2+events10:17:000
8539910421040,2cyclictest29540-21kworker/3:1+events08:25:193
8409910421039,3cyclictest7305-21turbostat08:49:540
8449910411039,2cyclictest25844-21turbostat12:19:551
8449910401038,2cyclictest30941-21kworker/1:0+events12:22:021
8499910391038,1cyclictest12637-21turbostat10:19:552
8449910381035,3cyclictest16566-21kworker/1:2+events10:58:321
8449910361032,4cyclictest21920-21turbostat09:54:561
8539910351034,1cyclictest19175-21kworker/3:2+events08:12:363
8499910311029,2cyclictest26804-21kworker/2:2+events08:19:372
8539910301028,2cyclictest11298-21kworker/3:0+events08:57:303
8539910281027,1cyclictest19175-21kworker/3:2+events08:00:223
8409910241023,1cyclictest3084-21kworker/0:2+events12:37:130
8409910241022,1cyclictest14440-21kworker/0:1+events11:27:020
8539910231022,1cyclictest11298-21kworker/3:0+events09:15:223
8409910231021,2cyclictest15445-21turbostat07:49:540
8449910221019,3cyclictest15665-21kworker/1:1+events07:12:351
8539910211020,1cyclictest885-21kworker/3:0+events11:17:223
8539910211020,1cyclictest11298-21kworker/3:0+events09:11:303
8449910191016,3cyclictest2690-21kworker/1:0+events07:16:501
8539910181017,1cyclictest28378-21kworker/3:1+events07:32:333
8499910171015,2cyclictest11007-21kworker/2:0+events10:52:012
8449910171014,3cyclictest4738-21kworker/1:1+events07:20:441
8449910161014,2cyclictest28717-21kworker/1:2+events07:26:491
8499910151014,1cyclictest31167-21kworker/2:2+events10:43:502
8499910111010,1cyclictest11007-21kworker/2:0+events12:01:062
8499910101009,1cyclictest31167-21kworker/2:2+events10:45:462
8539910071003,3cyclictest30364-21turbostat12:24:553
8539910061005,1cyclictest27316-21kworker/3:0+events08:24:473
8499910041003,1cyclictest3707-21kworker/2:1+events10:39:452
8409910041003,1cyclictest9905-21kworker/0:2+events11:42:330
8499910011000,1cyclictest11007-21kworker/2:0+events11:56:062
853991000999,1cyclictest19175-21kworker/3:2+events08:07:113
84999999998,1cyclictest27521-21kworker/2:0+events10:07:312
84999999998,1cyclictest21827-21kworker/2:1+events11:36:372
85399995994,1cyclictest885-21kworker/3:0+events11:12:103
84999995994,1cyclictest7838-21kworker/2:2+events12:05:432
85399991990,1cyclictest17115-21kworker/3:2+events10:27:133
84499989987,2cyclictest22010-21turbostat09:19:551
84099988988,0cyclictest8369-21kworker/0:1+events09:50:220
84099983982,1cyclictest9905-21kworker/0:2+events11:20:220
84099983982,1cyclictest9905-21kworker/0:2+events09:40:220
84099983982,1cyclictest4848-21kworker/0:1+events12:14:000
84099983982,1cyclictest25905-21kworker/0:0+events11:54:000
84099980979,1cyclictest17783-21kworker/0:1+events08:54:340
85399979978,1cyclictest28378-21kworker/3:1+events07:35:413
84099975974,1cyclictest4848-21kworker/0:1+events12:26:490
84099973972,1cyclictest9905-21kworker/0:2+events11:46:570
84099971968,2cyclictest27763-21kworker/0:0+events12:15:520
84099970969,1cyclictest8369-21kworker/0:1+events09:46:390
85399969966,3cyclictest12108-21turbostat10:54:553
84099964961,1cyclictest3170-21turbostat10:09:560
84499963960,3cyclictest9306-21turbostat08:54:551
85399962961,1cyclictest2898-21kworker/3:1+events08:42:543
84499962959,3cyclictest27550-21turbostat08:19:551
85399959958,1cyclictest28378-21kworker/3:1+events07:40:453
85399958957,1cyclictest5243-21kworker/3:0+events09:34:353
85399953952,1cyclictest2898-21kworker/3:1+events08:35:223
85399950949,1cyclictest11298-21kworker/3:0+events09:03:273
85399946945,1cyclictest19175-21kworker/3:2+events07:55:453
85399942941,1cyclictest11298-21kworker/3:0+events09:05:233
85399941940,1cyclictest28378-21kworker/3:1+events07:47:013
85399940939,1cyclictest2898-21kworker/3:1+events08:48:583
84099939936,3cyclictest17451-21turbostat07:54:540
85399937936,1cyclictest17120-21kworker/3:0+events07:51:283
85399936935,1cyclictest852-21kworker/3:2+events08:30:233
84999936934,2cyclictest3332-21turbostat09:34:552
84099933931,2cyclictest16630-21turbostat10:59:550
84499895891,4cyclictest2715-21turbostat11:54:541
84499894890,4cyclictest2987-21turbostat10:44:561
84099888885,3cyclictest31599-21turbostat08:29:540
84499885883,2cyclictest26295-21turbostat10:34:561
84099875874,1cyclictest13415-21turbostat07:44:550
84099867866,1cyclictest10874-21turbostat07:39:550
85399864862,2cyclictest16358-21turbostat12:09:553
84099696693,3cyclictest3270-21turbostat11:19:550
84099688687,1cyclictest21456-21turbostat11:39:540
84999679676,3cyclictest30968-21turbostat10:04:562
84099665663,2cyclictest3332-21turbostat09:34:550
85399654653,1cyclictest16630-21turbostat10:59:563
84099651649,2cyclictest16358-21turbostat12:09:550
84999627625,2cyclictest2715-21turbostat11:54:542
84999620617,3cyclictest26295-21turbostat10:34:562
84499605600,3cyclictest12108-21turbostat10:54:561
84099591588,3cyclictest30364-21turbostat12:24:550
84999575574,1cyclictest16933-21turbostat11:34:552
85399564563,1cyclictest6832-21turbostat07:29:543
84999542539,3cyclictest25524-21turbostat08:14:552
85399537535,2cyclictest12637-21turbostat10:19:553
85399531529,2cyclictest9306-21turbostat08:54:553
85399513512,1cyclictest11591-21turbostat12:39:553
85399510508,2cyclictest21920-21turbostat09:54:563
85399346343,3cyclictest27550-21turbostat08:19:553
840994141,0cyclictest30517-21fwupd09:23:540
844992019,1cyclictest67750irq/123-lan11:17:451
844992019,1cyclictest67750irq/123-lan09:43:041
844991918,1cyclictest67750irq/123-lan11:40:131
844991918,1cyclictest67750irq/123-lan09:30:141
849991818,0cyclictest784-21snmpd12:17:322
849991818,0cyclictest784-21snmpd11:20:032
849991818,0cyclictest784-21snmpd08:56:022
849991818,0cyclictest784-21snmpd07:33:372
849991818,0cyclictest784-21snmpd07:13:522
849991818,0cyclictest24220-21cat08:05:142
849991817,1cyclictest784-21snmpd08:36:282
844991818,0cyclictest67750irq/123-lan12:13:031
844991818,0cyclictest67750irq/123-lan11:24:481
844991818,0cyclictest67750irq/123-lan11:00:171
844991818,0cyclictest67750irq/123-lan09:20:231
844991817,1cyclictest67750irq/123-lan12:30:241
844991817,1cyclictest67750irq/123-lan12:01:531
844991817,1cyclictest67750irq/123-lan11:55:371
844991817,1cyclictest67750irq/123-lan11:38:511
844991817,1cyclictest67750irq/123-lan10:37:451
844991817,1cyclictest67750irq/123-lan10:22:591
844991817,1cyclictest67750irq/123-lan10:15:151
844991817,1cyclictest67750irq/123-lan10:00:111
844991817,1cyclictest67750irq/123-lan09:28:201
844991817,1cyclictest67750irq/123-lan07:55:221
844991816,2cyclictest67750irq/123-lan12:35:111
844991816,2cyclictest67750irq/123-lan11:48:111
844991816,2cyclictest67750irq/123-lan10:47:281
844991816,2cyclictest67750irq/123-lan09:57:261
844991816,2cyclictest67750irq/123-lan09:10:251
849991717,0cyclictest784-21snmpd12:35:052
849991717,0cyclictest784-21snmpd12:21:292
849991717,0cyclictest784-21snmpd11:48:492
849991717,0cyclictest784-21snmpd08:26:002
849991717,0cyclictest784-21snmpd08:20:242
849991717,0cyclictest784-21snmpd08:04:292
849991717,0cyclictest784-21snmpd07:47:142
849991717,0cyclictest784-21snmpd07:24:382
844991717,0cyclictest67750irq/123-lan10:13:491
844991716,1cyclictest67750irq/123-lan12:29:571
844991716,1cyclictest67750irq/123-lan11:10:101
844991716,1cyclictest67750irq/123-lan11:05:111
844991716,1cyclictest67750irq/123-lan10:26:321
844991716,1cyclictest67750irq/123-lan09:45:161
844991716,1cyclictest67750irq/123-lan08:45:141
844991716,1cyclictest67750irq/123-lan08:35:131
844991716,1cyclictest67750irq/123-lan08:10:211
844991716,1cyclictest67750irq/123-lan08:05:121
844991716,1cyclictest67750irq/123-lan07:40:201
844991715,2cyclictest67750irq/123-lan11:28:211
844991715,2cyclictest67750irq/123-lan09:35:151
844991714,3cyclictest67750irq/123-lan12:05:201
844991616,0cyclictest67750irq/123-lan10:06:421
844991615,1cyclictest67750irq/123-lan07:50:011
844991615,1cyclictest67750irq/123-lan07:45:131
844991615,1cyclictest67750irq/123-lan07:40:001
844991514,1cyclictest67750irq/123-lan11:31:431
844991414,0cyclictest67750irq/123-lan09:05:131
844991414,0cyclictest67750irq/123-lan08:40:171
844991414,0cyclictest67750irq/123-lan08:21:031
844991413,1cyclictest67750irq/123-lan08:25:121
844991413,1cyclictest67750irq/123-lan07:30:181
844991313,0cyclictest67750irq/123-lan08:30:131
844991111,0cyclictest67750irq/123-lan08:55:151
84999109,1cyclictest507-21systemd-resolve10:27:502
8539998,1cyclictest784-21snmpd09:37:113
8499998,1cyclictest782-21lldpd08:51:422
8539988,0cyclictest782-21lldpd10:41:243
8539988,0cyclictest782-21lldpd09:48:393
8539987,1cyclictest784-21snmpd12:14:113
8499988,0cyclictest782-21lldpd09:59:422
8499987,1cyclictest784-21snmpd11:10:292
8499987,1cyclictest784-21snmpd09:41:202
8499987,1cyclictest782-21lldpd07:56:252
8499986,2cyclictest784-21snmpd10:10:462
8499986,2cyclictest784-21snmpd08:48:042
8499986,2cyclictest762-21ntpd09:05:402
8499986,2cyclictest762-21ntpd09:00:592
8499986,2cyclictest762-21ntpd07:51:232
8499986,2cyclictest762-21ntpd07:40:352
8499986,2cyclictest762-21ntpd07:36:102
8499986,2cyclictest762-21ntpd07:15:112
8499984,3cyclictest13635-21ntp_states11:25:172
8409986,2cyclictest784-21snmpd11:07:000
8409986,2cyclictest784-21snmpd10:42:020
8539977,0cyclictest784-21snmpd12:27:193
8539977,0cyclictest784-21snmpd11:26:193
8539977,0cyclictest782-21lldpd07:11:093
8539976,1cyclictest784-21snmpd11:31:513
8539976,1cyclictest784-21snmpd10:14:193
8539976,1cyclictest784-21snmpd09:40:203
8499977,0cyclictest784-21snmpd11:04:182
8499977,0cyclictest782-21lldpd09:54:572
8499976,1cyclictest784-21snmpd11:43:492
8499976,1cyclictest784-21snmpd10:55:562
8499975,2cyclictest784-21snmpd12:30:052
8499975,2cyclictest784-21snmpd12:12:462
8499975,2cyclictest784-21snmpd09:23:562
8499974,3cyclictest547-21NetworkManager09:13:072
8449976,1cyclictest67750irq/123-lan08:00:161
8449975,2cyclictest784-21snmpd09:00:011
8409977,0cyclictest782-21lldpd08:30:540
8409977,0cyclictest782-21lldpd08:11:240
8409977,0cyclictest782-21lldpd07:22:540
8409976,1cyclictest784-21snmpd11:00:270
8409976,1cyclictest784-21snmpd08:08:080
8409976,1cyclictest762-21ntpd10:36:010
8409976,1cyclictest572-21in:imuxsock09:29:390
8409975,2cyclictest784-21snmpd07:31:310
8409973,3cyclictest245-20systemd-journal09:11:590
8539965,1cyclictest8307-21ntp_kernel_pll_12:30:223
8539964,2cyclictest784-21snmpd11:54:303
8539964,2cyclictest784-21snmpd11:20:303
8539962,3cyclictest8085-21df10:45:123
8539962,3cyclictest30519-21ssh11:44:583
8539960,3cyclictest129781ntpq12:00:163
8499966,0cyclictest782-21lldpd11:18:122
8499965,1cyclictest507-21systemd-resolve09:25:332
8499964,2cyclictest784-21snmpd12:25:202
8499963,2cyclictest19374-21ssh09:45:402
8409966,0cyclictest784-21snmpd08:15:220
8409966,0cyclictest784-21snmpd07:10:370
8409965,1cyclictest784-21snmpd09:07:100
8409965,1cyclictest784-21snmpd08:44:380
8409965,1cyclictest784-21snmpd07:18:080
8409965,1cyclictest782-21lldpd09:01:350
8409965,1cyclictest782-21lldpd08:01:530
8409965,1cyclictest21493-21turbostat08:00:000
8409964,2cyclictest762-21ntpd10:25:220
8409964,2cyclictest547-21NetworkManager09:58:480
8409963,3cyclictest28685-21ssh10:31:210
8409963,2cyclictest32580-21cups-browsed12:00:020
8409963,2cyclictest20106-21ssh10:22:100
8409962,3cyclictest8925-21grep11:55:200
8539954,1cyclictest784-21snmpd07:22:323
8539953,2cyclictest762-21ntpd11:55:543
8539952,2cyclictest3864-21gltestperf10:05:133
8539952,2cyclictest32491-21wc10:35:213
8539952,2cyclictest30869-21ssh11:45:093
8539952,2cyclictest22502-21cut11:35:163
8499954,1cyclictest421ktimers/209:35:162
8499953,2cyclictest547-21NetworkManager07:25:122
8499952,2cyclictest28285-21rm11:05:532
8499952,2cyclictest19554-21ssh10:21:142
8499951,3cyclictest24014-21ssh09:15:402
8409953,2cyclictest762-21ntpd10:50:220
8409953,2cyclictest762-21ntpd08:21:180
8409953,0cyclictest0-21swapper/008:57:350
8409952,3cyclictest9422-21ssh10:45:250
8409952,3cyclictest547-21NetworkManager09:16:410
8409952,2cyclictest5459-21cat08:40:000
8409952,2cyclictest245-20systemd-journal11:10:030
8409951,3cyclictest558-21ssh10:00:370
8539941,2cyclictest4439-21seq07:15:463
8539941,2cyclictest26185-21sort12:15:113
8499944,0cyclictest526-21avahi-daemon08:40:482
8499941,2cyclictest1650-21df_inode08:30:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional