You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 17:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Sep 18, 2026 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
284239910521049,2cyclictest2353-21kworker/2:2+events10:54:532
284239910521048,2cyclictest23593-21kworker/2:0+events09:32:452
284269910511050,1cyclictest6135-21kworker/3:1+events11:34:493
284239910511049,2cyclictest31987-21kworker/2:0+events11:27:222
284239910511049,2cyclictest17773-21kworker/2:1+events10:57:322
284239910501048,2cyclictest2555-21kworker/2:2+events12:24:422
284239910501048,2cyclictest2353-21kworker/2:2+events11:19:242
284239910501048,2cyclictest2353-21kworker/2:2+events10:48:592
284239910501048,2cyclictest17773-21kworker/2:1+events09:18:292
284139910501049,1cyclictest9943-21kworker/0:0+events07:51:270
284239910491047,2cyclictest2353-21kworker/2:2+events11:08:362
284239910461043,3cyclictest17773-21kworker/2:1+events09:28:402
284239910451043,2cyclictest17773-21kworker/2:1+events09:22:452
284239910451043,2cyclictest16069-21kworker/2:1+events11:10:222
284239910431040,2cyclictest31987-21kworker/2:0+events11:58:482
284239910421040,2cyclictest29085-21kworker/2:0+events10:42:562
284239910421040,2cyclictest11720-21kworker/2:0+events12:15:212
284269910391037,2cyclictest26159-21kworker/3:2+events10:27:443
284239910391038,1cyclictest28858-21kworker/2:1+events12:04:262
284239910361034,2cyclictest28858-21kworker/2:1+events12:10:442
284179910351033,2cyclictest29370-21kworker/1:0+events08:57:281
284239910341032,2cyclictest2555-21kworker/2:2+events12:07:312
284269910301029,1cyclictest28278-21kworker/3:0+events09:51:063
284269910301029,1cyclictest26159-21kworker/3:2+events10:08:043
284139910301029,1cyclictest10600-21kworker/0:2+events09:13:190
284239910281025,3cyclictest22804-21kworker/2:2+events10:37:432
284239910261024,2cyclictest2353-21kworker/2:2+events11:04:332
284179910221019,3cyclictest29370-21kworker/1:0+events12:28:161
284179910221019,3cyclictest19840-21turbostat09:59:561
284269910211019,2cyclictest16916-21kworker/3:1+events11:52:123
284269910211019,2cyclictest13574-21turbostat12:19:543
284269910201019,1cyclictest21898-21kworker/3:0+events11:38:003
284179910201018,2cyclictest29370-21kworker/1:0+events12:32:541
284139910201019,1cyclictest3709-21kworker/0:2+events07:49:230
284179910191014,3cyclictest29370-21kworker/1:0+events09:45:431
284179910181016,2cyclictest29370-21kworker/1:0+events12:35:431
284179910161014,2cyclictest7331-21kworker/1:2+events09:43:421
284179910151014,1cyclictest29370-21kworker/1:0+events08:51:041
284269910111007,4cyclictest18095-21turbostat10:34:563
284179910091007,2cyclictest29370-21kworker/1:0+events08:47:341
284269910021001,1cyclictest26159-21kworker/3:2+events10:19:413
2842699998997,1cyclictest15384-21kworker/3:1+events10:02:023
2842699998997,1cyclictest15384-21kworker/3:1+events10:02:013
2842399997995,2cyclictest32485-21turbostat08:44:562
2842699992991,1cyclictest26159-21kworker/3:2+events10:11:563
2842699992991,1cyclictest15384-21kworker/3:1+events09:58:503
2842699988987,1cyclictest16916-21kworker/3:1+events11:48:593
2841399988987,1cyclictest10593-21kworker/0:1+events07:19:020
2841399987986,1cyclictest9943-21kworker/0:0+events07:55:210
2841399985984,1cyclictest18124-21kworker/0:0+events08:35:220
2841399984983,1cyclictest24840-21kworker/0:0+events07:14:020
2841399984983,1cyclictest18124-21kworker/0:0+events08:07:360
2841399984983,1cyclictest10600-21kworker/0:2+events09:36:590
2842699982981,1cyclictest8562-21kworker/3:2+events09:04:363
2841399981981,0cyclictest3709-21kworker/0:2+events07:30:220
2841399980979,1cyclictest3709-21kworker/0:2+events08:03:590
2841399976975,1cyclictest18124-21kworker/0:0+events08:11:300
2841399976975,1cyclictest10600-21kworker/0:2+events09:07:100
2841399972971,1cyclictest26053-21kworker/0:2+events08:23:180
2841399972971,1cyclictest18124-21kworker/0:0+events08:15:220
2842699971968,3cyclictest12652-21turbostat09:14:563
2841399971970,1cyclictest18124-21kworker/0:0+events08:31:280
2842699970968,2cyclictest2311-21turbostat09:39:563
2841399970970,0cyclictest30160-21kworker/0:1+events08:40:230
2841399970970,0cyclictest10593-21kworker/0:1+events07:25:220
2841399970969,1cyclictest3709-21kworker/0:2+events07:40:210
2841399970969,1cyclictest10593-21kworker/0:1+events07:38:180
2841399965964,1cyclictest18124-21kworker/0:0+events08:25:210
2842699964962,2cyclictest8139-21turbostat07:44:543
2841399963961,2cyclictest10593-21kworker/0:1+events07:20:430
2842399944943,1cyclictest2353-21kworker/2:2+events11:22:312
2842699940938,2cyclictest17958-21turbostat12:24:553
2841399940938,2cyclictest11064-21turbostat09:49:550
2842699936934,2cyclictest30326-21turbostat09:34:563
2842399930928,2cyclictest30462-21turbostat08:39:562
2842699920919,1cyclictest16916-21kworker/3:1+events11:42:213
2841399920919,1cyclictest6576-21turbostat08:59:560
2842699919918,1cyclictest26159-21kworker/3:2+events10:21:303
2841399917914,3cyclictest4932-21turbostat10:19:550
2841799873870,3cyclictest23751-21turbostat11:54:551
2842399691689,2cyclictest23751-21turbostat11:54:552
2841399689687,2cyclictest8595-21turbostat09:04:560
2842399688685,3cyclictest12652-21turbostat09:14:562
2841799687685,2cyclictest32485-21turbostat08:44:561
2842699637634,3cyclictest11064-21turbostat09:49:563
2841799625621,4cyclictest2311-21turbostat09:39:561
2842699617615,2cyclictest6576-21turbostat08:59:563
2841799593590,3cyclictest17958-21turbostat12:24:551
2841399548547,1cyclictest30326-21turbostat09:34:560
2842399529525,2cyclictest18095-21turbostat10:34:552
2842699504503,1cyclictest1848-21turbostat11:29:553
28423993232,0cyclictest18107-21fwupd08:02:292
28417992019,1cyclictest67750irq/123-lan12:17:271
28417992019,1cyclictest67750irq/123-lan11:20:101
28417992019,1cyclictest67750irq/123-lan10:55:131
28417992017,3cyclictest67750irq/123-lan11:00:171
28417992017,2cyclictest67750irq/123-lan11:25:161
28417992016,3cyclictest67750irq/123-lan10:40:131
28417991919,0cyclictest67750irq/123-lan10:20:451
28417991918,1cyclictest67750irq/123-lan12:02:291
28417991918,1cyclictest67750irq/123-lan11:33:271
28417991918,1cyclictest67750irq/123-lan11:17:511
28417991917,1cyclictest67750irq/123-lan11:49:001
28417991916,2cyclictest67750irq/123-lan10:25:171
28417991818,0cyclictest67750irq/123-lan11:43:171
28417991818,0cyclictest67750irq/123-lan10:45:121
28417991818,0cyclictest67750irq/123-lan10:32:231
28417991818,0cyclictest67750irq/123-lan09:25:101
28417991818,0cyclictest67750irq/123-lan09:24:551
28417991817,1cyclictest67750irq/123-lan10:00:111
28417991817,1cyclictest67750irq/123-lan10:00:101
28417991817,1cyclictest67750irq/123-lan09:33:521
28417991816,1cyclictest67750irq/123-lan11:05:201
28417991816,1cyclictest67750irq/123-lan09:50:381
28417991717,0cyclictest67750irq/123-lan12:09:551
28417991717,0cyclictest67750irq/123-lan11:59:561
28417991717,0cyclictest67750irq/123-lan09:15:181
28417991716,1cyclictest67750irq/123-lan12:10:171
28417991716,1cyclictest67750irq/123-lan11:10:171
28417991716,1cyclictest67750irq/123-lan10:39:091
28417991716,1cyclictest67750irq/123-lan10:05:111
28417991716,1cyclictest67750irq/123-lan09:10:181
28417991716,1cyclictest67750irq/123-lan08:10:141
28417991716,1cyclictest67750irq/123-lan07:59:281
28417991716,1cyclictest67750irq/123-lan07:20:001
28417991715,2cyclictest67750irq/123-lan07:35:151
28417991616,0cyclictest67750irq/123-lan11:38:201
28417991616,0cyclictest67750irq/123-lan10:17:141
28417991616,0cyclictest67750irq/123-lan08:05:141
28417991615,1cyclictest67750irq/123-lan10:14:161
28417991615,1cyclictest67750irq/123-lan08:15:101
28417991614,2cyclictest67750irq/123-lan10:50:201
28417991515,0cyclictest67750irq/123-lan08:30:141
28417991515,0cyclictest67750irq/123-lan07:45:301
28417991515,0cyclictest67750irq/123-lan07:25:191
28417991515,0cyclictest67750irq/123-lan07:15:301
28417991515,0cyclictest67750irq/123-lan07:12:301
28417991514,1cyclictest67750irq/123-lan07:50:121
28417991514,1cyclictest67750irq/123-lan07:30:121
28417991413,1cyclictest67750irq/123-lan09:05:211
28417991413,1cyclictest67750irq/123-lan08:22:301
28417991313,0cyclictest67750irq/123-lan08:25:131
28417991312,1cyclictest67750irq/123-lan08:00:111
28417991212,0cyclictest67750irq/123-lan07:40:091
28417991210,2cyclictest67750irq/123-lan08:35:161
2842399109,1cyclictest526-21avahi-daemon11:30:582
28417991010,0cyclictest67750irq/123-lan09:00:121
28413991010,0cyclictest10600-21kworker/0:2+events_freezable11:44:470
28413991010,0cyclictest10600-21kworker/0:2+events_freezable09:57:060
284269998,1cyclictest784-21snmpd08:18:053
284239998,1cyclictest784-21snmpd08:59:432
284239998,1cyclictest782-21lldpd09:48:182
284139999,0cyclictest10600-21kworker/0:2+events_freezable11:52:010
284139998,1cyclictest784-21snmpd08:53:360
284269988,0cyclictest782-21lldpd12:31:503
284269988,0cyclictest782-21lldpd12:27:223
284269988,0cyclictest782-21lldpd10:55:183
284269988,0cyclictest782-21lldpd07:11:213
284269987,1cyclictest784-21snmpd07:24:333
284269987,1cyclictest782-21lldpd10:42:503
284269987,1cyclictest526-21avahi-daemon08:00:213
284269986,2cyclictest784-21snmpd10:36:193
284239988,0cyclictest782-21lldpd11:45:212
284239988,0cyclictest782-21lldpd07:15:372
284239987,1cyclictest784-21snmpd09:07:422
284239987,1cyclictest784-21snmpd07:11:162
284239987,1cyclictest526-21avahi-daemon08:21:132
284239987,1cyclictest507-21systemd-resolve09:54:022
284239986,2cyclictest784-21snmpd12:32:352
284239986,2cyclictest784-21snmpd11:40:082
284239986,2cyclictest784-21snmpd08:12:442
284239986,2cyclictest784-21snmpd07:37:442
284139988,0cyclictest784-21snmpd10:06:120
284139988,0cyclictest784-21snmpd09:51:110
284139988,0cyclictest782-21lldpd12:06:330
284139988,0cyclictest782-21lldpd10:58:380
284139988,0cyclictest507-21systemd-resolve11:29:220
284139988,0cyclictest10600-21kworker/0:2+events_freezable12:38:030
284139987,1cyclictest526-21avahi-daemon12:03:370
284139986,2cyclictest784-21snmpd12:10:220
284139986,2cyclictest784-21snmpd10:54:520
284139983,5cyclictest547-21NetworkManager11:57:360
284269977,0cyclictest784-21snmpd12:08:313
284269977,0cyclictest784-21snmpd11:20:473
284269977,0cyclictest784-21snmpd08:26:063
284269977,0cyclictest784-21snmpd08:24:483
284269977,0cyclictest784-21snmpd08:14:473
284269977,0cyclictest782-21lldpd11:05:583
284269976,1cyclictest784-21snmpd12:36:383
284269976,1cyclictest782-21lldpd09:43:263
284269976,1cyclictest526-21avahi-daemon09:26:113
284269976,1cyclictest4519-21fschecks_count07:30:123
284269976,1cyclictest22104-21needreboot11:10:153
284269976,1cyclictest12594-21cpuspeed_turbos07:50:123
284269975,2cyclictest784-21snmpd11:56:213
284269975,2cyclictest784-21snmpd08:38:423
284269973,3cyclictest1621-21ntp_states08:40:163
284239977,0cyclictest784-21snmpd08:51:272
284239977,0cyclictest784-21snmpd07:55:252
284239977,0cyclictest782-21lldpd09:57:532
284239977,0cyclictest782-21lldpd09:44:342
284239977,0cyclictest782-21lldpd09:00:572
284239977,0cyclictest782-21lldpd08:06:002
284239977,0cyclictest782-21lldpd07:22:362
284239976,1cyclictest1691-21ntp_kernel_err10:10:152
284239975,2cyclictest784-21snmpd11:39:422
284239973,3cyclictest17249-21ssh10:28:332
284139977,0cyclictest784-21snmpd12:31:350
284139977,0cyclictest784-21snmpd11:07:100
284139977,0cyclictest784-21snmpd09:22:440
284139977,0cyclictest782-21lldpd09:16:030
284139977,0cyclictest2313-21kworker/0:0+events_freezable09:25:160
284139977,0cyclictest10600-21kworker/0:2+events_freezable10:41:020
284139975,2cyclictest762-21ntpd11:03:250
284139975,2cyclictest762-21ntpd10:20:160
284269966,0cyclictest782-21lldpd12:13:073
284269966,0cyclictest782-21lldpd12:01:453
284269966,0cyclictest782-21lldpd11:04:113
284269965,1cyclictest784-21snmpd07:25:523
284269965,1cyclictest507-21systemd-resolve10:46:123
284269963,3cyclictest547-21NetworkManager11:17:043
284269963,2cyclictest23120-21wc09:20:203
284239965,1cyclictest526-21avahi-daemon10:15:192
284239965,1cyclictest24806-21fschecks_count10:00:122
284239965,1cyclictest24806-21fschecks_count10:00:112
284239965,1cyclictest12068-21gdbus07:48:332
284239964,2cyclictest784-21snmpd08:32:232
284239962,3cyclictest32313-21ntpq12:35:162
284239962,3cyclictest23979-21users08:15:202
284139966,0cyclictest782-21lldpd11:24:410
284139965,1cyclictest784-21snmpd09:40:170
284139965,1cyclictest526-21avahi-daemon10:39:090
284139965,1cyclictest507-21systemd-resolve12:26:010
284139964,2cyclictest784-21snmpd12:23:100
284139964,2cyclictest784-21snmpd11:37:120
284139962,3cyclictest26116-21fw_forwarded_lo11:15:140
284139962,3cyclictest23346-21ssh11:11:100
284139962,3cyclictest18215-21date10:30:010
284269954,1cyclictest784-21snmpd08:46:063
284269954,1cyclictest526-21avahi-daemon07:35:433
284269954,1cyclictest511ktimers/307:18:293
284269953,2cyclictest547-21NetworkManager09:16:243
284269952,2cyclictest245-20systemd-journal08:05:273
284269952,2cyclictest12115-21https07:48:333
284269951,3cyclictest4854-21ntp_states10:50:183
284269951,3cyclictest14809-21cut07:55:113
284239955,0cyclictest782-21lldpd07:44:412
284239954,1cyclictest526-21avahi-daemon12:28:132
284239954,1cyclictest526-21avahi-daemon08:26:212
284239954,1cyclictest1-21systemd08:48:542
284239952,2cyclictest4435-21ssh09:35:582
284239952,2cyclictest31802-21ssh10:07:532
284139953,2cyclictest21458-21sshd10:32:280
284139952,2cyclictest27971-21ssh10:03:520
284139952,2cyclictest27971-21ssh10:03:510
284139952,2cyclictest245-20systemd-journal11:30:280
284139952,2cyclictest21174-21ssh11:45:220
284139952,2cyclictest17062-21ssh12:18:270
284269944,0cyclictest784-21snmpd08:52:063
284269942,2cyclictest11453-21grep09:05:163
284269941,2cyclictest245-20systemd-journal08:30:083
284239942,2cyclictest4317-21https07:30:112
284239941,2cyclictest13068-21cat07:50:142
284239940,4cyclictest3005-21ntpq07:25:152
284239940,3cyclictest10431-21ntpq10:20:152
284139941,2cyclictest574-21rs:main0
284139940,4cyclictest1338-21hddtemp_smartct10:10:140
284139940,3cyclictest2971-21diskstats08:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional