You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-13 - 11:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sun Sep 13, 2026 00:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
261859910501049,1cyclictest27712-21kworker/3:2+events00:36:273
261809910501048,2cyclictest5602-21kworker/2:0+events23:19:412
261759910501047,3cyclictest32183-21turbostat19:29:541
261859910491048,1cyclictest15418-21kworker/3:1+events23:37:013
261859910491048,1cyclictest13517-21kworker/3:0+events21:34:123
261809910491047,2cyclictest26340-21kworker/2:0+events19:21:262
261859910461045,1cyclictest26013-21kworker/3:2+events19:56:053
261859910451043,2cyclictest26013-21kworker/3:2+events20:56:043
261709910421041,1cyclictest23923-21kworker/0:0+events23:52:580
261809910391038,1cyclictest26453-21kworker/2:1+events23:13:042
261709910361035,1cyclictest26636-21kworker/0:2+events23:46:270
261859910231021,2cyclictest10398-21kworker/3:2+events22:18:413
261709910221021,1cyclictest10536-21kworker/0:2+events00:28:450
261709910201019,1cyclictest26636-21kworker/0:2+events23:58:060
261759910111009,2cyclictest8793-21kworker/1:0+events22:41:271
261859910031001,2cyclictest31551-21kworker/3:2+events22:04:343
26170991003999,4cyclictest23614-21turbostat00:34:550
26185991001999,2cyclictest4002-21turbostat23:44:563
26185991000998,2cyclictest23910-21kworker/3:0+events22:05:233
2617599999998,1cyclictest22037-21kworker/1:1+events20:25:231
2617099997996,1cyclictest18913-21kworker/0:1+events00:01:520
2618599994992,2cyclictest23177-21turbostat22:29:553
2618599994990,2cyclictest6546-21turbostat22:44:553
2618599993991,2cyclictest15418-21kworker/3:1+events23:34:553
2617599992991,1cyclictest24687-21kworker/1:0+events21:42:531
2617599990988,2cyclictest18852-21turbostat21:54:551
2618599988986,2cyclictest23910-21kworker/3:0+events22:13:393
2618599988986,2cyclictest15418-21kworker/3:1+events23:20:453
2617099987986,1cyclictest23923-21kworker/0:0+events21:45:220
2617599986985,1cyclictest28842-21kworker/1:2+events22:36:511
2617599985983,2cyclictest14689-21kworker/1:1+events22:49:021
2618599983982,1cyclictest23910-21kworker/3:0+events21:58:273
2618599982981,1cyclictest23910-21kworker/3:0+events22:20:423
2617099982979,3cyclictest1790-21turbostat19:34:540
2618599977975,2cyclictest26013-21kworker/3:2+events21:28:283
2617599972971,1cyclictest28842-21kworker/1:2+events22:57:571
2618599970969,1cyclictest26013-21kworker/3:2+events20:40:233
2617599969968,1cyclictest16342-21kworker/1:2+events20:07:561
2618599967967,0cyclictest15418-21kworker/3:1+events23:28:183
2618599967967,0cyclictest15418-21kworker/3:1+events23:28:183
2617599967966,1cyclictest28842-21kworker/1:2+events22:54:041
2617599967966,1cyclictest18693-21kworker/1:0+events20:14:281
2617599967965,1cyclictest26619-21kworker/1:1+events23:03:491
2617599966965,1cyclictest28842-21kworker/1:2+events22:34:241
2617599966965,1cyclictest22037-21kworker/1:1+events20:19:031
2617599966965,1cyclictest16342-21kworker/1:2+events20:21:041
2617099964962,2cyclictest23923-21kworker/0:0+events21:53:290
2618599963962,1cyclictest308-21kworker/3:0+events21:04:243
2617599963962,1cyclictest32088-21kworker/1:2+events23:08:291
2618599962961,1cyclictest13517-21kworker/3:0+events21:24:243
2617099962959,3cyclictest2156-21turbostat20:54:550
2618599961961,0cyclictest308-21kworker/3:0+events21:05:223
2618599961959,2cyclictest26013-21kworker/3:2+events21:18:433
2617599961958,3cyclictest10368-21turbostat23:19:551
2618599959958,1cyclictest1770-21kworker/3:0+events19:37:353
2618599958957,1cyclictest26013-21kworker/3:2+events20:46:073
2618599958957,1cyclictest26013-21kworker/3:2+events19:45:423
2617599958957,1cyclictest24687-21kworker/1:0+events21:36:391
2618599955954,1cyclictest9501-21kworker/3:1+events20:01:493
2618599953952,1cyclictest9501-21kworker/3:1+events19:54:473
2618599953952,1cyclictest26013-21kworker/3:2+events19:30:233
2618599952951,1cyclictest26013-21kworker/3:2+events19:43:393
2618599952950,2cyclictest26013-21kworker/3:2+events21:12:343
2618599945943,1cyclictest308-21kworker/3:0+events20:50:203
2618599936933,3cyclictest19326-21turbostat23:59:563
2617099935933,2cyclictest29545-21turbostat22:04:550
2618599924922,2cyclictest13750-21turbostat21:49:553
2617099923921,2cyclictest26636-21kworker/0:2+events23:44:420
2617099909907,1cyclictest32539-21turbostat20:49:550
2617099905905,0cyclictest10536-21kworker/0:2+events00:18:420
2618599903901,2cyclictest8619-21turbostat21:44:553
2618599902900,2cyclictest32557-21turbostat23:09:543
2617099901900,1cyclictest4722-21kworker/0:1+events00:13:480
2617099900899,1cyclictest10536-21kworker/0:2+events00:21:050
2618099898897,1cyclictest26340-21kworker/2:0+events20:31:072
2617099897896,1cyclictest26636-21kworker/0:2+events00:05:520
2618099896895,1cyclictest12713-21kworker/2:1+events19:14:432
2618099894893,1cyclictest12713-21kworker/2:1+events19:16:142
2618099893893,0cyclictest26453-21kworker/2:1+events20:36:042
2618099892891,1cyclictest26340-21kworker/2:0+events19:25:212
2617099891888,3cyclictest28493-21turbostat20:39:550
2617599878876,2cyclictest8221-21turbostat21:09:551
2617599864862,2cyclictest25644-21turbostat21:29:551
2618099856853,3cyclictest5822-21turbostat19:44:552
2618599854853,1cyclictest24445-21turbostat20:29:553
2618599699695,4cyclictest28493-21turbostat20:39:543
2617599659658,1cyclictest14322-21turbostat20:04:551
2617599639637,2cyclictest30777-21turbostat21:34:551
2618599607606,1cyclictest23614-21turbostat00:34:553
2617099605603,2cyclictest8619-21turbostat21:44:550
2618099596594,2cyclictest32557-21turbostat23:09:542
2618599595593,1cyclictest32183-21turbostat19:29:543
2617599557555,2cyclictest23177-21turbostat22:29:551
2618099550547,3cyclictest24445-21turbostat20:29:552
2618599538534,4cyclictest18852-21turbostat21:54:543
2617099538533,3cyclictest30839-21turbostat23:39:560
2618599426424,2cyclictest10368-21turbostat23:19:553
26185991919,0cyclictest67750irq/123-lan00:24:083
26185991918,1cyclictest67750irq/123-lan22:45:183
26185991918,1cyclictest67750irq/123-lan00:27:013
26185991918,1cyclictest67750irq/123-lan00:09:283
26185991818,0cyclictest67750irq/123-lan22:32:353
26185991818,0cyclictest67750irq/123-lan00:16:083
26185991818,0cyclictest67750irq/123-lan00:00:153
26185991817,1cyclictest67750irq/123-lan23:11:533
26185991817,1cyclictest67750irq/123-lan23:02:463
26185991817,1cyclictest67750irq/123-lan22:58:043
26185991817,1cyclictest67750irq/123-lan22:35:183
26185991817,1cyclictest67750irq/123-lan20:05:133
26185991817,1cyclictest67750irq/123-lan00:10:213
26185991717,0cyclictest67750irq/123-lan20:17:273
26185991717,0cyclictest67750irq/123-lan20:10:153
26185991716,1cyclictest67750irq/123-lan23:52:053
26185991716,1cyclictest67750irq/123-lan21:35:203
26185991716,1cyclictest67750irq/123-lan19:21:513
26185991616,0cyclictest67750irq/123-lan23:45:173
26185991616,0cyclictest67750irq/123-lan22:50:323
26185991616,0cyclictest67750irq/123-lan19:13:293
26185991514,1cyclictest67750irq/123-lan20:20:173
26185991414,0cyclictest67750irq/123-lan19:15:163
26185991413,1cyclictest67750irq/123-lan19:09:593
26185991211,1cyclictest67750irq/123-lan20:30:223
261809998,1cyclictest526-21avahi-daemon00:20:482
261759998,1cyclictest784-21snmpd22:02:381
261759998,1cyclictest784-21snmpd20:57:381
261759998,1cyclictest784-21snmpd20:54:451
261759998,1cyclictest782-21lldpd19:14:161
261759998,1cyclictest526-21avahi-daemon00:36:141
261759998,1cyclictest507-21systemd-resolve21:20:161
261709998,1cyclictest784-21snmpd23:00:550
261709998,0cyclictest784-21snmpd22:29:330
261709996,3cyclictest784-21snmpd19:52:360
261809988,0cyclictest784-21snmpd22:26:482
261809988,0cyclictest784-21snmpd22:09:062
261809988,0cyclictest782-21lldpd23:30:142
261809988,0cyclictest782-21lldpd19:33:112
261809988,0cyclictest22589-21fwupd21:53:022
261809987,1cyclictest784-21snmpd20:08:002
261809986,2cyclictest784-21snmpd23:36:212
261809986,2cyclictest784-21snmpd00:36:342
261809985,3cyclictest784-21snmpd20:17:202
261759988,0cyclictest784-21snmpd23:31:351
261759988,0cyclictest782-21lldpd22:22:451
261759988,0cyclictest782-21lldpd22:17:111
261759988,0cyclictest782-21lldpd19:54:291
261759988,0cyclictest782-21lldpd19:48:161
261759987,1cyclictest784-21snmpd21:14:161
261759987,1cyclictest784-21snmpd20:33:561
261759987,1cyclictest784-21snmpd19:58:281
261759987,1cyclictest782-21lldpd21:00:401
261759987,1cyclictest782-21lldpd00:10:351
261759987,1cyclictest26192-21ntp_offset00:00:191
261759986,2cyclictest784-21snmpd21:47:291
261759986,2cyclictest784-21snmpd19:22:361
261759986,2cyclictest784-21snmpd00:16:271
261759986,2cyclictest762-21ntpd23:58:281
261759986,2cyclictest762-21ntpd23:51:531
261709988,0cyclictest784-21snmpd23:30:290
261709988,0cyclictest784-21snmpd23:13:460
261709988,0cyclictest784-21snmpd20:20:140
261709988,0cyclictest782-21lldpd23:17:160
261709988,0cyclictest782-21lldpd22:37:400
261709988,0cyclictest782-21lldpd22:23:310
261709987,1cyclictest9002-21ntp_kernel_pll_22:10:190
261709987,1cyclictest782-21lldpd19:29:200
261709986,2cyclictest784-21snmpd21:55:370
261709986,2cyclictest784-21snmpd21:33:230
261809977,0cyclictest784-21snmpd22:45:312
261809977,0cyclictest784-21snmpd21:55:262
261809977,0cyclictest784-21snmpd21:38:312
261809977,0cyclictest784-21snmpd00:07:282
261809977,0cyclictest782-21lldpd21:26:332
261809976,1cyclictest782-21lldpd20:00:462
261809976,1cyclictest572-21in:imuxsock00:00:002
261809976,1cyclictest526-21avahi-daemon22:33:582
261809976,1cyclictest507-21systemd-resolve21:05:132
261809975,2cyclictest784-21snmpd21:04:462
261759977,0cyclictest782-21lldpd21:55:521
261759976,1cyclictest784-21snmpd22:08:211
261759976,1cyclictest784-21snmpd00:05:401
261759976,1cyclictest526-21avahi-daemon23:36:001
261759976,1cyclictest526-21avahi-daemon21:18:511
261759976,1cyclictest2030-21/usr/sbin/munin19:30:171
261709977,0cyclictest784-21snmpd23:08:080
261709977,0cyclictest784-21snmpd22:41:100
261709977,0cyclictest782-21lldpd21:36:340
261709977,0cyclictest782-21lldpd21:14:360
261709977,0cyclictest782-21lldpd20:30:300
261709976,1cyclictest526-21avahi-daemon20:25:020
261709976,1cyclictest507-21systemd-resolve22:32:110
261709976,1cyclictest507-21systemd-resolve20:57:430
261709976,1cyclictest507-21systemd-resolve00:39:360
261709976,1cyclictest21169-21fschecks_count21:20:150
261709976,1cyclictest16634-21ntp_kernel_err23:20:140
261709975,2cyclictest784-21snmpd22:17:510
261709975,2cyclictest784-21snmpd20:17:260
261709975,1cyclictest13020-21cat19:55:170
261809966,0cyclictest784-21snmpd20:42:022
261809966,0cyclictest784-21snmpd00:26:402
261809966,0cyclictest782-21lldpd21:18:562
261809966,0cyclictest782-21lldpd00:19:372
261809965,1cyclictest762-21ntpd23:42:242
261809965,1cyclictest16060-21head23:50:232
261809964,2cyclictest784-21snmpd23:22:352
261809963,3cyclictest784-21snmpd19:39:332
261809963,2cyclictest27730-21ssh23:00:062
261809963,2cyclictest25901-21ssh22:57:512
261809963,2cyclictest23101-21ssh21:21:242
261809963,2cyclictest14905-21ssh21:14:212
261809963,2cyclictest13126-21ssh22:15:022
261809963,2cyclictest11697-21ssh23:46:252
261809962,3cyclictest872-21ssh21:31:172
261809962,3cyclictest3330-21df00:10:172
261809962,3cyclictest2976-21memory20:50:162
261809962,3cyclictest25995-21sh00:31:062
261809962,3cyclictest25769-21awk00:00:162
261809962,3cyclictest11057-21ssh22:44:092
261759966,0cyclictest526-21avahi-daemon20:35:591
261759965,1cyclictest784-21snmpd23:20:351
261759965,1cyclictest245-20systemd-journal23:25:191
261759965,1cyclictest245-20systemd-journal23:25:191
261759964,2cyclictest547-21NetworkManager00:32:561
261759963,3cyclictest547-21NetworkManager00:27:501
261759963,2cyclictest12955-21ssh23:48:131
261759962,3cyclictest7778-21seq19:44:121
261709966,0cyclictest784-21snmpd20:14:470
261709966,0cyclictest784-21snmpd19:15:270
261709966,0cyclictest782-21lldpd21:28:330
261709966,0cyclictest782-21lldpd21:19:150
261709966,0cyclictest782-21lldpd21:06:280
261709966,0cyclictest526-21avahi-daemon21:00:580
261709965,1cyclictest784-21snmpd19:35:000
261709965,1cyclictest784-21snmpd19:21:000
261709964,2cyclictest784-21snmpd22:55:370
261709964,2cyclictest784-21snmpd22:47:190
261709964,2cyclictest21417-21cat23:25:130
261709964,2cyclictest21417-21cat23:25:130
261709963,3cyclictest14773-21diskstats20:00:110
261809955,0cyclictest782-21lldpd22:02:352
261809955,0cyclictest782-21lldpd21:40:572
261809955,0cyclictest782-21lldpd19:45:502
261809954,1cyclictest21797-21ntpq23:25:162
261809954,1cyclictest21797-21ntpq23:25:152
261809953,2cyclictest547-21NetworkManager22:36:192
261809952,2cyclictest9901-21ssh22:10:442
261809952,2cyclictest20565-21ssh22:21:202
261809952,2cyclictest19540-21awk20:10:192
261809952,2cyclictest14365-21tune2fs21:45:142
261809952,2cyclictest10437-21dpkg19:50:002
261809951,3cyclictest18837-21cat22:50:262
261759955,0cyclictest782-21lldpd19:17:571
261759954,1cyclictest8972-21ntpq22:10:181
261759953,2cyclictest784-21snmpd20:46:301
261759953,2cyclictest762-21ntpd19:37:451
261759953,2cyclictest15322-21sshd00:20:271
261759952,2cyclictest6585-21ntp_states23:10:201
261759951,3cyclictest4673-21fw_forwarded_lo23:40:121
261709953,2cyclictest9814-21sshd19:49:280
261709953,2cyclictest784-21snmpd19:42:550
261709952,2cyclictest18107-21awk22:50:190
261709952,2cyclictest17735-21grep20:05:200
261709951,3cyclictest2924-21perl22:05:130
261709951,3cyclictest245-20systemd-journal20:40:220
261809943,1cyclictest4615-21fschecks_count20:55:132
261809942,2cyclictest22737-21grep20:20:132
261809940,4cyclictest12862-21perl19:55:162
261809940,3cyclictest1170-21ntpq20:45:192
261759941,2cyclictest31320-21cat20:40:111
261709940,4cyclictest0-21swapper/019:10:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional