You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 17:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed Sep 02, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293649910521050,2cyclictest24959-21kworker/2:1+events12:01:392
293539910511049,2cyclictest24974-21kworker/0:1+events11:17:300
293709910501048,2cyclictest10449-21kworker/3:0+events09:42:133
293649910501048,2cyclictest24959-21kworker/2:1+events11:48:192
293649910501047,3cyclictest19737-21kworker/2:0+events11:50:232
293539910501049,1cyclictest18652-21kworker/0:2+events11:56:480
293649910491048,1cyclictest19696-21kworker/2:2+events11:36:492
293649910491047,2cyclictest19737-21kworker/2:0+events11:43:162
293589910491046,3cyclictest1435-21turbostat10:44:551
293539910491047,2cyclictest6194-21kworker/0:1+events12:20:230
293649910481046,2cyclictest31398-21kworker/2:0+events09:56:052
293539910481047,1cyclictest24974-21kworker/0:1+events11:06:270
293589910471044,3cyclictest20021-21turbostat08:09:551
293539910471046,1cyclictest1747-21kworker/0:0+events10:25:230
293649910461044,2cyclictest16899-21kworker/2:0+events12:06:282
293649910461044,2cyclictest13570-21kworker/2:2+events09:06:342
293539910461045,1cyclictest28453-21kworker/0:1+events10:02:140
293539910461045,1cyclictest24974-21kworker/0:1+events11:28:310
293589910451043,2cyclictest22262-21kworker/1:0+events08:12:311
293539910451044,1cyclictest18472-21kworker/0:2+events09:20:220
293539910451043,2cyclictest24594-21kworker/0:0+events12:17:420
293539910441043,1cyclictest24001-21kworker/0:0+events09:29:550
293539910441043,1cyclictest2015-21kworker/0:0+events10:43:390
293649910431042,1cyclictest31398-21kworker/2:0+events09:52:322
293649910421040,2cyclictest13570-21kworker/2:2+events09:14:302
293649910411039,2cyclictest13570-21kworker/2:2+events09:17:342
293649910401038,2cyclictest31398-21kworker/2:0+events07:14:202
293709910351034,1cyclictest16950-21kworker/3:1+events10:21:493
293709910351033,2cyclictest15220-21turbostat11:34:553
293649910331030,3cyclictest1193-21turbostat10:09:542
293539910261024,2cyclictest24974-21kworker/0:1+events11:20:220
293539910251024,1cyclictest24974-21kworker/0:1+events11:11:510
293649910241022,2cyclictest8061-21kworker/2:1+events08:58:172
293589910231020,3cyclictest19607-21turbostat10:29:551
293589910171016,1cyclictest25091-21kworker/1:2+events10:51:521
293709910051004,1cyclictest29564-21kworker/3:1+events10:48:083
293709910051001,3cyclictest24040-21turbostat08:19:553
293589910021001,1cyclictest25091-21kworker/1:2+events11:03:581
2935899999998,1cyclictest11225-21kworker/1:0+events10:55:441
2935899998997,1cyclictest22262-21kworker/1:0+events08:16:051
2937099995994,1cyclictest10449-21kworker/3:0+events10:16:373
2937099992991,1cyclictest3983-21kworker/3:0+events12:11:393
2935399992991,1cyclictest2015-21kworker/0:0+events11:30:230
2936499990988,2cyclictest404-21turbostat09:34:552
2937099986983,3cyclictest1250-21turbostat11:54:563
2937099980979,1cyclictest19615-21kworker/3:1+events12:28:083
2937099977975,2cyclictest1742-21kworker/3:1+events07:29:503
2935399973972,1cyclictest18472-21kworker/0:2+events09:30:220
2937099971969,2cyclictest29221-21turbostat10:39:553
2935399969968,1cyclictest1479-21kworker/0:1+events08:53:490
2937099967965,2cyclictest19891-21turbostat11:04:543
2937099966965,1cyclictest24548-21kworker/3:0+events10:30:433
2937099966964,2cyclictest5820-21turbostat08:54:543
2935399966965,1cyclictest26321-21kworker/0:1+events08:31:060
2937099965963,2cyclictest16698-21kworker/3:1+events10:12:353
2935399964963,1cyclictest26321-21kworker/0:1+events08:27:140
2935399964963,1cyclictest26321-21kworker/0:1+events08:24:110
2935399963962,1cyclictest1479-21kworker/0:1+events08:41:070
2936499961960,1cyclictest8061-21kworker/2:1+events09:03:422
2935399961960,1cyclictest18472-21kworker/0:2+events08:39:490
2935399956955,1cyclictest28453-21kworker/0:1+events10:07:340
2935399954953,1cyclictest18472-21kworker/0:2+events08:47:340
2935399952949,3cyclictest31714-21turbostat07:19:540
2935399948946,2cyclictest11943-21turbostat07:49:550
2935399936934,2cyclictest1137-21turbostat12:29:560
2937099934932,2cyclictest1060-21kworker/3:2+events12:39:493
2936499929926,3cyclictest5824-21turbostat07:34:542
2937099923921,1cyclictest11645-21kworker/3:2+events09:35:223
2937099922919,3cyclictest18564-21turbostat09:19:553
2937099920919,1cyclictest1742-21kworker/3:1+events07:39:473
2937099917916,1cyclictest19615-21kworker/3:1+events12:32:583
2937099916915,1cyclictest10449-21kworker/3:0+events09:47:583
2935399916913,3cyclictest23911-21turbostat09:59:550
2937099915913,2cyclictest5872-21turbostat11:59:553
2937099913912,1cyclictest15735-21kworker/3:0+events07:52:553
2935399913911,2cyclictest15090-21turbostat12:09:560
2937099912911,1cyclictest11645-21kworker/3:2+events07:49:123
2937099911910,1cyclictest4225-21kworker/3:0+events07:44:333
2937099910909,1cyclictest1742-21kworker/3:1+events07:23:403
2937099909909,0cyclictest11645-21kworker/3:2+events08:04:063
2937099908907,1cyclictest4225-21kworker/3:0+events07:33:493
2937099906905,1cyclictest15735-21kworker/3:0+events07:56:503
2937099904903,1cyclictest15735-21kworker/3:0+events08:05:213
2936499880879,1cyclictest31398-21kworker/2:0+events07:15:322
2937099866864,2cyclictest29140-21turbostat11:14:553
2936499694692,1cyclictest5820-21turbostat08:54:542
2937099684683,1cyclictest19607-21turbostat10:29:543
2935399661658,3cyclictest14969-21turbostat10:24:550
2937099656655,1cyclictest31714-21turbostat07:19:553
2936499644641,3cyclictest5872-21turbostat11:59:552
2937099618616,2cyclictest15090-21turbostat12:09:563
2937099613611,2cyclictest1193-21turbostat10:09:543
2935899606604,2cyclictest6094-21turbostat10:49:541
2935399606603,3cyclictest24040-21turbostat08:19:540
2936499595592,3cyclictest14740-21turbostat09:49:542
2935399588587,1cyclictest1250-21turbostat11:54:560
2937099576573,3cyclictest28886-21turbostat12:24:563
2935399576573,2cyclictest29221-21turbostat10:39:550
2935399571569,2cyclictest19891-21turbostat11:04:550
2937099570569,1cyclictest404-21turbostat09:34:553
2936499564561,3cyclictest15220-21turbostat11:34:552
2935399533530,3cyclictest19687-21turbostat12:14:560
2935399523522,1cyclictest18564-21turbostat09:19:550
2937099510509,1cyclictest1435-21turbostat10:44:553
29370991918,1cyclictest67750irq/123-lan08:55:163
29370991818,0cyclictest67750irq/123-lan07:10:013
29370991817,1cyclictest67750irq/123-lan12:18:053
29370991817,1cyclictest67750irq/123-lan12:00:153
29370991817,1cyclictest67750irq/123-lan11:15:173
29370991817,1cyclictest67750irq/123-lan11:05:433
29370991817,1cyclictest67750irq/123-lan09:25:133
29370991817,1cyclictest67750irq/123-lan09:20:193
29358991818,0cyclictest784-21snmpd10:14:461
29358991818,0cyclictest784-21snmpd09:25:261
29370991717,0cyclictest67750irq/123-lan11:45:233
29370991717,0cyclictest67750irq/123-lan10:00:113
29370991717,0cyclictest67750irq/123-lan09:55:193
29370991716,1cyclictest67750irq/123-lan11:40:143
29370991716,1cyclictest67750irq/123-lan11:25:163
29370991716,1cyclictest67750irq/123-lan09:14:233
29370991616,0cyclictest67750irq/123-lan11:36:163
29370991616,0cyclictest67750irq/123-lan10:53:093
29370991616,0cyclictest67750irq/123-lan09:51:323
29370991615,1cyclictest67750irq/123-lan11:21:023
29370991615,1cyclictest67750irq/123-lan10:58:563
29370991615,1cyclictest67750irq/123-lan08:13:523
29370991515,0cyclictest67750irq/123-lan09:05:103
29370991515,0cyclictest67750irq/123-lan08:40:123
29370991515,0cyclictest67750irq/123-lan08:22:433
29370991514,1cyclictest67750irq/123-lan09:00:123
29370991514,1cyclictest67750irq/123-lan08:30:113
29370991514,1cyclictest67750irq/123-lan08:29:553
29370991312,1cyclictest67750irq/123-lan08:35:163
29370991211,1cyclictest67750irq/123-lan08:45:163
29364991111,0cyclictest31398-21kworker/2:0+events_freezable07:26:222
293649998,1cyclictest782-21lldpd10:11:402
293589998,1cyclictest784-21snmpd12:06:021
293589998,1cyclictest784-21snmpd11:20:321
293539998,1cyclictest784-21snmpd12:01:320
293539998,1cyclictest784-21snmpd07:54:080
293539998,1cyclictest782-21lldpd11:44:300
293649988,0cyclictest784-21snmpd12:35:112
293649988,0cyclictest784-21snmpd10:54:332
293649988,0cyclictest782-21lldpd10:23:162
293649988,0cyclictest782-21lldpd09:40:502
293649986,2cyclictest784-21snmpd11:07:002
293589988,0cyclictest784-21snmpd08:43:191
293589988,0cyclictest782-21lldpd11:52:321
293589988,0cyclictest782-21lldpd11:37:271
293589987,1cyclictest507-21systemd-resolve10:39:481
293589986,2cyclictest8520-21cat07:35:131
293589986,2cyclictest784-21snmpd10:17:311
293589986,2cyclictest784-21snmpd09:44:591
293589986,2cyclictest784-21snmpd08:46:531
293589986,2cyclictest762-21ntpd08:21:371
293589986,2cyclictest762-21ntpd08:00:361
293589986,2cyclictest762-21ntpd07:10:511
293589984,3cyclictest784-21snmpd11:31:251
293539988,0cyclictest784-21snmpd11:39:310
293539988,0cyclictest784-21snmpd10:19:550
293539988,0cyclictest784-21snmpd09:10:040
293539988,0cyclictest782-21lldpd08:01:300
293539987,1cyclictest526-21avahi-daemon10:45:410
293539986,2cyclictest784-21snmpd07:39:370
293649977,0cyclictest784-21snmpd08:16:192
293649977,0cyclictest782-21lldpd11:20:582
293649977,0cyclictest782-21lldpd10:36:312
293649977,0cyclictest782-21lldpd09:38:102
293649977,0cyclictest782-21lldpd08:45:112
293649977,0cyclictest782-21lldpd07:49:482
293649977,0cyclictest782-21lldpd07:41:562
293649976,1cyclictest784-21snmpd07:54:322
293649976,1cyclictest526-21avahi-daemon12:29:352
293649976,1cyclictest2347-21gltestperf07:20:142
293649975,2cyclictest784-21snmpd09:20:482
293649975,2cyclictest784-21snmpd08:34:092
293589977,0cyclictest784-21snmpd12:15:581
293589977,0cyclictest784-21snmpd07:17:551
293589977,0cyclictest782-21lldpd12:28:061
293589977,0cyclictest782-21lldpd12:21:001
293589977,0cyclictest782-21lldpd11:43:231
293589977,0cyclictest782-21lldpd11:25:011
293589977,0cyclictest782-21lldpd10:02:061
293589977,0cyclictest782-21lldpd09:18:111
293589977,0cyclictest782-21lldpd07:52:391
293589977,0cyclictest782-21lldpd07:26:381
293589976,1cyclictest782-21lldpd07:46:021
293589975,2cyclictest784-21snmpd11:46:011
293589975,2cyclictest784-21snmpd11:09:051
293589975,2cyclictest784-21snmpd09:21:511
293589975,2cyclictest784-21snmpd08:27:401
293589975,2cyclictest784-21snmpd07:56:351
293589975,2cyclictest2017-21cat10:05:141
293589973,3cyclictest9269-21ssh12:32:351
293589973,3cyclictest27493-21ssh10:32:081
293589973,3cyclictest20917-21ntp_states12:10:171
293589971,3cyclictest7542-21kworker/u16:3+xprtiod09:59:511
293539977,0cyclictest784-21snmpd07:42:470
293539976,1cyclictest784-21snmpd10:13:570
293539976,1cyclictest526-21avahi-daemon09:35:150
293539976,1cyclictest10716-21cron12:35:000
293539975,2cyclictest784-21snmpd08:12:380
293539975,2cyclictest20154-21cat09:50:140
293649966,0cyclictest784-21snmpd11:26:552
293649966,0cyclictest782-21lldpd11:03:442
293649966,0cyclictest782-21lldpd08:38:352
293649966,0cyclictest782-21lldpd08:05:002
293649966,0cyclictest782-21lldpd08:00:262
293649966,0cyclictest526-21avahi-daemon08:42:582
293649965,1cyclictest526-21avahi-daemon12:31:392
293649964,2cyclictest784-21snmpd12:24:412
293649964,2cyclictest784-21snmpd09:28:592
293649963,2cyclictest27903-21ssh10:32:502
293649963,2cyclictest245-20systemd-journal10:43:042
293649963,2cyclictest23383-21ssh12:13:322
293649962,3cyclictest27059-21ntpq08:20:162
293649962,3cyclictest245-20systemd-journal10:15:592
293649962,3cyclictest19928-21dpkg10:24:592
293589966,0cyclictest784-21snmpd11:12:031
293589966,0cyclictest784-21snmpd08:51:161
293589966,0cyclictest782-21lldpd09:42:141
293589966,0cyclictest782-21lldpd09:32:061
293589966,0cyclictest782-21lldpd08:55:251
293589965,1cyclictest507-21systemd-resolve07:43:291
293589964,2cyclictest784-21snmpd07:30:371
293589963,2cyclictest245-20systemd-journal11:56:251
293589962,2cyclictest12981-21sh12:36:031
293539965,1cyclictest784-21snmpd07:25:320
293539964,2cyclictest784-21snmpd10:31:460
293539964,2cyclictest784-21snmpd08:08:300
293539963,3cyclictest17430-21ssh09:46:490
293539963,2cyclictest245-20systemd-journal10:56:180
293539963,2cyclictest13173-21ssh12:36:240
293539962,4cyclictest547-21NetworkManager09:08:280
293539962,3cyclictest245-20systemd-journal11:45:120
293649955,0cyclictest507-21systemd-resolve07:57:072
293649955,0cyclictest22364-21cpuspeed_turbos08:10:112
293649954,1cyclictest526-21avahi-daemon10:00:172
293649953,2cyclictest784-21snmpd07:36:082
293649953,2cyclictest547-21NetworkManager12:15:082
293649952,2cyclictest9291-21ssh10:47:402
293649952,2cyclictest3055-21sh11:15:232
293649952,2cyclictest30101-21ssh11:10:162
293589955,0cyclictest0-21swapper/107:20:171
293589953,1cyclictest0-21swapper/111:15:171
293589953,0cyclictest191rcu_preempt09:35:031
293589953,0cyclictest191rcu_preempt08:37:161
293589952,2cyclictest23596-21sshd09:54:291
293589952,2cyclictest17826-21ssh10:22:021
293589952,2cyclictest10719-21ssh12:00:021
293539953,2cyclictest547-21NetworkManager10:51:080
293539952,3cyclictest3926-21sed07:25:000
293539952,2cyclictest30126-21df_inode07:10:110
293539952,2cyclictest16487-21cut07:55:130
293539950,4cyclictest10875-21ntpq09:00:170
293649944,0cyclictest29214-21ntpq08:25:192
293649943,1cyclictest526-21avahi-daemon10:55:122
293589943,1cyclictest31169-21ntpq08:30:161
293589942,2cyclictest12583-21cat09:05:141
293589941,2cyclictest10099-21find09:00:121
293589940,3cyclictest14851-21memory09:10:141
293539941,3cyclictest11289-21ntpq09:40:160
293539941,2cyclictest6629-21cat07:30:160
293539940,4cyclictest8795-21ntpq08:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional