You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 20:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Thu Aug 27, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
324419910531045,5cyclictest23997-21kworker/3:0+events10:32:323
324419910521049,3cyclictest22246-21kworker/3:2+events10:21:063
324419910511050,1cyclictest1336-21kworker/3:1+events08:31:273
324419910511049,2cyclictest8574-21kworker/3:2+events09:05:203
324419910511049,2cyclictest23997-21kworker/3:0+events11:06:163
324419910511049,2cyclictest18264-21kworker/3:2+events07:55:213
324419910511049,2cyclictest17710-21kworker/3:1+events09:22:193
324419910511049,2cyclictest1336-21kworker/3:1+events08:44:093
324419910511045,4cyclictest17710-21kworker/3:1+events09:15:533
324419910501048,2cyclictest8574-21kworker/3:2+events08:52:513
324419910501048,2cyclictest32287-21kworker/3:2+events07:26:543
324419910501048,2cyclictest32287-21kworker/3:2+events07:12:013
324419910501048,2cyclictest17710-21kworker/3:1+events09:53:263
324419910501047,3cyclictest27759-21kworker/3:2+events12:31:513
324419910491047,2cyclictest25995-21kworker/3:0+events07:46:393
324419910491047,2cyclictest23997-21kworker/3:0+events11:57:333
324419910491047,2cyclictest23997-21kworker/3:0+events10:50:543
324419910491047,2cyclictest22246-21kworker/3:2+events10:27:423
324419910491047,2cyclictest12833-21kworker/3:0+events10:19:463
324419910481046,2cyclictest27759-21kworker/3:2+events12:15:463
324419910481045,3cyclictest5387-21kworker/3:1+events10:49:103
324419910481045,3cyclictest25995-21kworker/3:0+events07:40:223
324419910481045,3cyclictest23997-21kworker/3:0+events11:00:223
324419910481045,3cyclictest23997-21kworker/3:0+events10:40:433
324419910481045,3cyclictest18264-21kworker/3:2+events08:35:443
324419910481044,3cyclictest27759-21kworker/3:2+events12:38:533
324289910481047,1cyclictest32073-21kworker/1:1+events08:04:361
324289910481047,1cyclictest20592-21kworker/1:0+events09:38:461
324419910471045,2cyclictest6535-21kworker/3:0+events08:49:183
324419910471044,3cyclictest22246-21kworker/3:2+events10:36:383
324419910461044,2cyclictest9023-21kworker/3:1+events07:50:213
324419910461043,3cyclictest27759-21kworker/3:2+events12:25:453
324419910461043,3cyclictest17710-21kworker/3:1+events09:14:123
324419910461042,4cyclictest9023-21kworker/3:1+events07:37:113
324419910461041,3cyclictest17720-21turbostat09:49:553
324419910441041,2cyclictest381-21kworker/3:0+events12:20:453
324289910421041,1cyclictest8659-21kworker/1:1+events10:13:231
324419910401037,3cyclictest9023-21kworker/3:1+events07:32:003
324289910401039,1cyclictest4641-21kworker/1:1+events11:22:221
324419910341031,3cyclictest20612-21turbostat08:04:553
324239910291028,1cyclictest23209-21kworker/0:0+events08:13:420
324289910281027,1cyclictest27577-21kworker/1:0+events10:08:211
324289910231022,1cyclictest20592-21kworker/1:0+events09:31:171
324239910231021,2cyclictest26322-21kworker/0:2+events12:06:050
324239910211020,1cyclictest26487-21kworker/0:1+events07:22:550
324289910201019,1cyclictest32050-21kworker/1:2+events09:29:221
324289910181017,1cyclictest15505-21kworker/1:2+events09:59:441
324289910171016,1cyclictest15505-21kworker/1:2+events11:30:231
324289910161015,1cyclictest11104-21kworker/1:1+events08:58:391
324289910151014,1cyclictest20530-21kworker/1:1+events11:44:021
324289910151014,1cyclictest20530-21kworker/1:1+events11:39:031
324289910151014,1cyclictest10667-21kworker/1:1+events09:48:561
324239910151014,1cyclictest26322-21kworker/0:2+events08:17:140
324419910131011,2cyclictest1978-21turbostat07:19:553
324369910131011,2cyclictest31155-21turbostat08:29:552
324289910121011,1cyclictest15505-21kworker/1:2+events11:49:311
324239910091008,1cyclictest26487-21kworker/0:1+events08:08:420
324239910081007,1cyclictest26487-21kworker/0:1+events07:18:080
324289910061005,1cyclictest27577-21kworker/1:0+events10:03:051
324239910051004,1cyclictest19172-21kworker/0:0+events12:11:050
324239910051004,1cyclictest18352-21kworker/0:1+events10:57:010
324289910041003,1cyclictest20592-21kworker/1:0+events09:00:451
324239910041003,1cyclictest26322-21kworker/0:2+events08:24:020
324289910031002,1cyclictest10667-21kworker/1:1+events09:44:191
32428991000998,2cyclictest15505-21kworker/1:2+events11:16:531
32428991000997,1cyclictest7178-21kworker/1:1+events11:52:221
32423991000999,1cyclictest30870-21kworker/0:1+events08:26:050
3242899999997,2cyclictest15630-21kworker/1:0+events11:28:281
3242399998996,2cyclictest18352-21kworker/0:1+events11:11:480
3242899995994,1cyclictest2045-21kworker/1:0+events12:01:071
3242399985984,1cyclictest16919-21turbostat09:14:550
3243699982979,3cyclictest14579-21turbostat07:49:552
3244199959956,3cyclictest4121-21turbostat11:19:553
3243699950948,2cyclictest764-21turbostat08:34:552
3244199946944,2cyclictest31479-21turbostat11:14:553
3244199936934,2cyclictest14002-21turbostat12:04:543
3243699922918,3cyclictest17690-21turbostat10:59:552
3244199917914,3cyclictest4376-21turbostat11:54:543
32428998940,892cyclictest22967-21fschecks_time11:00:131
3242899892889,3cyclictest4418-21turbostat07:24:551
3242399884883,1cyclictest12875-21turbostat09:04:550
3242899879877,2cyclictest6851-21turbostat08:49:551
3244199865862,2cyclictest13363-21turbostat11:29:553
3244199690689,1cyclictest4418-21turbostat07:24:553
3244199685683,2cyclictest12875-21turbostat09:04:553
3244199670667,3cyclictest23232-21turbostat12:14:543
3242899655654,1cyclictest31479-21turbostat11:14:551
3242399652651,1cyclictest32315-21turbostat07:14:550
3244199621619,2cyclictest31155-21turbostat08:29:553
3244199599598,1cyclictest8323-21turbostat10:14:553
3242399594590,4cyclictest26895-21turbostat11:09:550
3242899593587,5cyclictest9405-21turbostat11:59:541
3242399580577,3cyclictest13097-21turbostat10:54:550
3242899573572,1cyclictest8858-21turbostat08:54:551
3242899572570,2cyclictest27063-21turbostat09:24:551
3242899556552,2cyclictest22312-21turbostat09:54:551
3242399542540,2cyclictest20612-21turbostat08:04:550
3244199529525,4cyclictest17690-21turbostat10:59:553
3242399525524,1cyclictest14300-21turbostat12:39:540
3242899405402,3cyclictest18600-21turbostat07:59:551
3242399338338,0cyclictest14002-21turbostat12:04:550
32441992019,1cyclictest67750irq/123-lan11:40:183
32441991918,1cyclictest67750irq/123-lan11:35:153
32441991918,1cyclictest67750irq/123-lan11:20:183
32441991818,0cyclictest67750irq/123-lan09:40:183
32441991817,1cyclictest67750irq/123-lan11:33:313
32441991817,1cyclictest67750irq/123-lan09:55:203
32436991818,0cyclictest784-21snmpd12:20:032
32436991818,0cyclictest784-21snmpd07:57:302
32441991717,0cyclictest67750irq/123-lan12:08:343
32441991717,0cyclictest67750irq/123-lan10:00:193
32441991716,1cyclictest67750irq/123-lan11:47:013
32441991616,0cyclictest67750irq/123-lan10:09:233
32441991616,0cyclictest67750irq/123-lan09:35:133
32441991615,1cyclictest67750irq/123-lan09:25:223
32441991615,1cyclictest67750irq/123-lan08:55:213
32441991514,1cyclictest67750irq/123-lan09:30:163
32441991212,0cyclictest67750irq/123-lan08:10:143
3242899122,6cyclictest30942-21chrt08:22:351
32441991111,0cyclictest67750irq/123-lan08:05:523
32441991110,1cyclictest67750irq/123-lan08:15:183
3242899113,4cyclictest30125-21ssh12:16:081
3242899112,6cyclictest19628-21ssh10:55:331
3242899112,5cyclictest13168-21taskset10:15:061
3242899112,5cyclictest12520-21chrt07:39:551
3242399112,6cyclictest20292-21ssh11:31:140
3242899103,5cyclictest25779-21ntp_states08:10:151
3242899103,5cyclictest18274-21chrt07:51:011
3242899103,5cyclictest16147-21chrt10:52:251
3242899103,5cyclictest12554-21ssh12:32:051
3242899103,4cyclictest4506-21ssh12:24:451
3242899102,6cyclictest29251-21ssh10:31:401
3242899102,6cyclictest16295-21taskset07:46:231
3242899102,5cyclictest24499-21ld12:10:161
3242899102,5cyclictest23130-21chrt12:09:511
3242899102,5cyclictest19824-21taskset10:21:111
3242899102,5cyclictest16915-21diskmemload10:37:151
3242899102,4cyclictest245-20systemd-journal07:12:391
3242899102,3cyclictest8240-21taskset07:27:211
3242399107,2cyclictest782-21lldpd09:46:310
324289993,4cyclictest10168-21chrt07:31:151
324289993,2cyclictest5958-21ntpq08:40:171
324289992,5cyclictest8819-21ssh10:45:101
324289992,5cyclictest32146-21ntpq08:25:161
324289992,5cyclictest3018-21seq08:35:031
324289992,5cyclictest2759-21seq08:34:471
324289992,5cyclictest245-20systemd-journal08:05:581
324289992,5cyclictest18311-21chrt12:39:011
324289992,5cyclictest16882-21chrt09:09:421
324289992,4cyclictest791-21runrttasks08:17:561
324289992,4cyclictest6460-21ssh10:42:171
324289992,4cyclictest4188-21taskset07:17:161
324289992,4cyclictest24522-21ssh09:15:461
324289992,4cyclictest24028-21chrt10:25:351
324289992,4cyclictest16915-21diskmemload09:11:331
324289992,4cyclictest14310-21seq07:41:511
324289992,3cyclictest4893-21chrt12:25:001
324289992,3cyclictest28746-21ssh11:05:241
324239996,3cyclictest784-21snmpd09:42:000
324239992,5cyclictest24973-21ssh09:16:290
324239992,5cyclictest13222-21ssh11:58:420
324239992,4cyclictest1326-21ssh10:00:550
324239991,6cyclictest23528-21ntpq09:50:170
324239991,5cyclictest28512-21awk10:30:280
324239991,4cyclictest4099-21ssh11:49:330
324239991,4cyclictest17420-21ssh10:19:580
324239991,4cyclictest16915-21diskmemload11:50:320
324419987,1cyclictest67750irq/123-lan08:20:163
324369988,0cyclictest782-21lldpd12:19:432
324369988,0cyclictest782-21lldpd12:13:512
324369988,0cyclictest782-21lldpd10:36:252
324369988,0cyclictest782-21lldpd07:33:132
324369987,1cyclictest784-21snmpd10:50:562
324369987,1cyclictest784-21snmpd09:36:122
324369987,1cyclictest784-21snmpd09:23:352
324369987,1cyclictest784-21snmpd08:51:432
324369987,1cyclictest782-21lldpd07:21:572
324369986,2cyclictest784-21snmpd09:08:202
324369986,2cyclictest784-21snmpd08:58:492
324369986,2cyclictest784-21snmpd08:15:032
324369986,2cyclictest784-21snmpd08:06:482
324369986,2cyclictest762-21ntpd08:01:342
324239988,0cyclictest784-21snmpd09:35:510
324239988,0cyclictest782-21lldpd11:25:080
324239987,1cyclictest784-21snmpd08:55:580
324239987,1cyclictest782-21lldpd10:39:430
324239984,1cyclictest26279-21kworker/u16:2+rpciod10:09:250
324239983,3cyclictest7890-21timerwakeupswit07:25:210
324239982,4cyclictest20995-21ssh10:23:110
324239982,4cyclictest12259-21ssh10:48:370
324239982,2cyclictest13611-21ntpq07:40:160
324239981,5cyclictest25286-21ssh11:02:170
324239981,5cyclictest19164-21fw_conntrack07:55:130
324239981,5cyclictest15612-21ntpq07:45:170
324239981,5cyclictest1204-21df_inode08:30:110
324239981,4cyclictest791-21runrttasks12:21:000
324239981,4cyclictest7674-21ssh12:27:190
324239981,4cyclictest6819-21ssh11:16:510
324239981,4cyclictest11786-21sh10:13:090
324239981,3cyclictest29005-21sendmail_mailqu11:40:190
324239981,3cyclictest10879-21ntpq12:30:170
324239981,3cyclictest0-21swapper/012:15:190
324239980,5cyclictest0-21swapper/009:20:160
324369977,0cyclictest784-21snmpd09:53:572
324369977,0cyclictest784-21snmpd09:34:302
324369977,0cyclictest784-21snmpd07:52:122
324369977,0cyclictest782-21lldpd11:40:572
324369977,0cyclictest782-21lldpd09:26:342
324369976,1cyclictest784-21snmpd07:14:412
324369975,2cyclictest784-21snmpd10:06:132
324369975,2cyclictest784-21snmpd09:55:542
324369975,2cyclictest784-21snmpd07:16:552
324369975,1cyclictest784-21snmpd11:45:252
324369973,3cyclictest19702-21awk11:30:202
324369972,4cyclictest13778-21cut09:40:132
324239975,2cyclictest784-21snmpd08:40:010
324239972,3cyclictest0-21swapper/009:55:160
324239971,5cyclictest32680-21memory09:25:150
324239971,4cyclictest5026-21ntpq09:30:160
324239971,4cyclictest16915-21diskmemload10:25:000
324239971,3cyclictest9269-21df08:50:110
324239971,2cyclictest4559-21ntpq10:40:130
324239971,2cyclictest0-21swapper/008:35:170
324239970,5cyclictest10747-21apt-get07:35:110
324239970,3cyclictest26442-21runrttasks11:38:110
324239970,3cyclictest0-21swapper/011:20:340
324369966,0cyclictest784-21snmpd11:56:172
324369966,0cyclictest784-21snmpd11:54:412
324369966,0cyclictest784-21snmpd08:45:222
324369966,0cyclictest782-21lldpd11:26:062
324369966,0cyclictest22407-21/usr/sbin/munin10:25:202
324369965,1cyclictest784-21snmpd08:11:122
324369964,2cyclictest784-21snmpd10:14:342
324369964,2cyclictest784-21snmpd07:36:382
324369964,1cyclictest191rcu_preempt10:15:162
324369963,2cyclictest25523-21ssh11:36:372
324369963,1cyclictest10702-21runrttasks11:20:352
324369962,3cyclictest245-20systemd-journal08:37:352
324369962,3cyclictest21529-21ssh12:07:072
324369962,3cyclictest19945-21ssh10:21:242
324369962,3cyclictest19354-21ssh09:10:372
324369962,3cyclictest13735-21sed07:40:172
324369962,2cyclictest0-21swapper/208:22:352
324369961,1cyclictest0-21swapper/212:35:122
324369960,4cyclictest8067-21cron10:45:012
324239962,3cyclictest8901-21diskstats07:30:120
324239962,1cyclictest15342-21diskstats09:05:130
324239961,4cyclictest16861-21apt-get07:50:120
324239961,3cyclictest7913-21ntpq08:45:170
324369954,1cyclictest32482-21fschecks_count11:10:122
324369954,0cyclictest191rcu_preempt12:27:032
324369953,2cyclictest547-21NetworkManager10:30:022
324369953,0cyclictest191rcu_preempt12:30:162
324369953,0cyclictest191rcu_preempt07:25:142
324369952,2cyclictest8412-21dpkg10:45:002
324369952,2cyclictest6345-21ssh11:16:032
324369952,2cyclictest31747-21ssh10:00:012
324369952,2cyclictest14401-21ssh12:00:132
324369951,3cyclictest18800-21cut09:45:162
324369951,2cyclictest0-21swapper/211:05:022
324369950,4cyclictest23781-21pmu-power09:15:182
324369950,3cyclictest23590-21ssh11:00:182
324369950,2cyclictest43-21ksoftirqd/209:00:182
324369940,1cyclictest5804-21ld08:40:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional