You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 23:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Thu Sep 17, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
91209910451043,2cyclictest13882-21kworker/3:0+events08:53:593
91049910431042,1cyclictest14537-21kworker/0:0+events12:13:170
91049910411040,1cyclictest5015-21kworker/0:0+events12:38:380
91119910341033,1cyclictest10982-21kworker/1:0+events07:23:141
91049910311030,1cyclictest5015-21kworker/0:0+events12:23:070
91209910301029,1cyclictest23705-21kworker/3:2+events09:06:473
91049910291027,2cyclictest13082-21turbostat11:24:540
91209910271025,2cyclictest5157-21kworker/3:0+events08:20:223
91049910231022,1cyclictest31934-21kworker/0:2+events12:30:220
91209910221020,1cyclictest25754-21kworker/3:1+events09:10:213
91209910211020,1cyclictest354-21kworker/3:2+events10:46:063
91049910211020,1cyclictest21401-21kworker/0:1+events12:17:180
91209910191018,1cyclictest8897-21kworker/3:1+events07:55:213
91209910181017,1cyclictest28249-21kworker/3:1+events09:48:503
91209910181017,1cyclictest25236-21kworker/3:0+events07:51:163
91209910171016,1cyclictest7343-21kworker/3:0+events11:18:443
91209910171016,1cyclictest3635-21kworker/3:2+events12:00:233
91209910171016,1cyclictest25331-21kworker/3:1+events11:01:033
91209910161016,0cyclictest11909-21kworker/3:1+events11:27:443
91209910161015,1cyclictest12679-21kworker/3:0+events09:54:003
91209910151014,1cyclictest7343-21kworker/3:0+events11:23:473
91049910131012,1cyclictest14537-21kworker/0:0+events10:28:480
91209910111010,1cyclictest7343-21kworker/3:0+events11:37:223
91209910111010,1cyclictest354-21kworker/3:2+events10:23:463
91209910111010,1cyclictest30059-21kworker/3:2+events11:14:443
91209910101009,1cyclictest3090-21kworker/3:2+events08:17:223
91209910081006,1cyclictest25331-21kworker/3:1+events10:58:503
91209910071007,0cyclictest9510-21kworker/3:1+events08:27:233
91209910071006,1cyclictest8897-21kworker/3:1+events08:01:253
91209910061005,1cyclictest12679-21kworker/3:0+events09:36:503
91209910051005,0cyclictest354-21kworker/3:2+events10:41:053
91209910051004,1cyclictest16487-21kworker/3:1+events08:48:283
91209910041003,1cyclictest3090-21kworker/3:2+events08:14:253
91209910041003,1cyclictest25927-21kworker/3:1+events11:42:453
9120991002999,2cyclictest7343-21kworker/3:0+events11:32:193
9120991002999,2cyclictest13882-21kworker/3:0+events08:55:223
91209910021001,1cyclictest3090-21kworker/3:2+events08:40:213
91209910021001,1cyclictest25331-21kworker/3:1+events11:06:053
91209910011000,1cyclictest3635-21kworker/3:2+events11:46:043
91209910011000,1cyclictest25927-21kworker/3:1+events11:52:403
91209910011000,1cyclictest21638-21kworker/3:1+events09:00:233
9120991000999,1cyclictest354-21kworker/3:2+events10:51:593
9120991000999,1cyclictest12679-21kworker/3:0+events09:42:553
911199999998,1cyclictest10982-21kworker/1:0+events07:26:051
910499999998,1cyclictest14537-21kworker/0:0+events10:37:020
910499999995,2cyclictest31025-21kworker/0:0+events09:23:400
912099998997,1cyclictest12679-21kworker/3:0+events09:31:273
911199998997,1cyclictest16237-21turbostat12:04:541
911199996995,1cyclictest12127-21kworker/1:0+events08:36:291
912099995992,1cyclictest8897-21kworker/3:1+events08:06:383
911199994993,1cyclictest8883-21kworker/1:2+events07:32:081
912099992989,3cyclictest17114-21turbostat07:34:553
911199991990,1cyclictest8883-21kworker/1:2+events08:32:321
911199989988,1cyclictest10982-21kworker/1:0+events07:14:531
911199987986,1cyclictest8883-21kworker/1:2+events07:16:581
911699975971,4cyclictest3377-21turbostat08:19:552
911199967964,3cyclictest26294-21turbostat11:39:541
910499966965,1cyclictest14537-21kworker/0:0+events10:16:520
911699955953,2cyclictest19874-21turbostat10:19:552
910499951951,0cyclictest2255-21kworker/0:2+events10:02:500
910499948948,0cyclictest12527-21kworker/0:2+events11:56:270
910499946945,1cyclictest2220-21kworker/0:3+events09:15:220
910499946945,1cyclictest14537-21kworker/0:0+events10:34:430
910499945944,1cyclictest14537-21kworker/0:0+events10:08:390
910499943943,0cyclictest4421-21kworker/0:1+events09:58:490
910499938936,2cyclictest14537-21kworker/0:0+events10:10:210
910499936935,1cyclictest21401-21kworker/0:1+events12:06:280
910499934932,2cyclictest30679-21turbostat11:44:540
912099933928,4cyclictest664-21turbostat10:34:563
910499931930,1cyclictest31934-21kworker/0:2+events12:27:570
911699928927,1cyclictest7248-21kworker/2:1+events09:27:122
912099926924,2cyclictest15031-21turbostat12:39:543
910499924921,3cyclictest15936-21turbostat08:49:550
911699923922,1cyclictest17986-21kworker/2:0+events07:49:202
911199921918,3cyclictest5485-21turbostat10:39:551
911699913912,1cyclictest19573-21kworker/2:1+events07:37:122
911699911908,1cyclictest22956-21kworker/2:2+events07:42:092
910499893891,2cyclictest11890-21turbostat08:39:550
910499888885,3cyclictest7835-21turbostat09:29:550
911199882880,2cyclictest9868-21turbostat10:44:551
911199882880,2cyclictest7488-21turbostat11:54:541
911699876876,0cyclictest17986-21kworker/2:0+events09:24:452
911199875872,3cyclictest30321-21turbostat09:54:551
912099872869,3cyclictest6699-21turbostat10:04:553
910499693690,3cyclictest16237-21turbostat12:04:540
912099684683,1cyclictest5485-21turbostat10:39:553
912099681680,1cyclictest11890-21turbostat11:59:543
910499680678,2cyclictest24261-21turbostat10:24:550
910499679676,3cyclictest26033-21turbostat09:14:550
911699662660,2cyclictest17114-21turbostat07:34:552
912099594592,2cyclictest19874-21turbostat10:19:553
910499575573,2cyclictest7488-21turbostat11:54:540
910499567565,2cyclictest30321-21turbostat09:54:550
911199551549,2cyclictest7425-21turbostat08:29:561
912099534531,3cyclictest23240-21turbostat07:49:563
912099520518,2cyclictest11890-21turbostat08:39:553
912099513512,1cyclictest7835-21turbostat09:29:553
911199141141,0cyclictest0-21swapper/108:53:281
9104997878,0cyclictest0-21swapper/008:53:280
9111991918,1cyclictest67750irq/123-lan12:25:011
9111991918,1cyclictest67750irq/123-lan12:10:171
9111991918,1cyclictest67750irq/123-lan12:05:161
9111991818,0cyclictest67750irq/123-lan11:24:241
9111991818,0cyclictest67750irq/123-lan11:17:551
9111991818,0cyclictest67750irq/123-lan10:47:061
9111991818,0cyclictest67750irq/123-lan09:24:301
9111991818,0cyclictest67750irq/123-lan09:10:161
9111991817,1cyclictest67750irq/123-lan12:32:141
9111991817,1cyclictest67750irq/123-lan11:25:261
9111991817,1cyclictest67750irq/123-lan10:30:081
9111991817,1cyclictest67750irq/123-lan10:19:101
9111991817,1cyclictest67750irq/123-lan10:10:131
9111991817,1cyclictest67750irq/123-lan09:40:221
9111991817,1cyclictest67750irq/123-lan09:36:441
9111991817,1cyclictest67750irq/123-lan08:23:261
9111991717,0cyclictest784-21snmpd08:48:571
9111991717,0cyclictest67750irq/123-lan12:35:181
9111991717,0cyclictest67750irq/123-lan11:55:201
9111991717,0cyclictest67750irq/123-lan11:41:201
9111991717,0cyclictest67750irq/123-lan11:06:401
9111991717,0cyclictest67750irq/123-lan11:00:391
9111991717,0cyclictest67750irq/123-lan09:15:181
9111991717,0cyclictest67750irq/123-lan09:05:121
9111991717,0cyclictest67750irq/123-lan07:41:491
9111991716,1cyclictest67750irq/123-lan12:25:151
9111991716,1cyclictest67750irq/123-lan12:15:171
9111991716,1cyclictest67750irq/123-lan11:30:011
9111991716,1cyclictest67750irq/123-lan10:52:351
9111991716,1cyclictest67750irq/123-lan10:00:381
9111991716,1cyclictest67750irq/123-lan09:33:031
9111991616,0cyclictest67750irq/123-lan11:10:171
9111991616,0cyclictest67750irq/123-lan10:57:391
9111991616,0cyclictest67750irq/123-lan09:45:021
9111991616,0cyclictest67750irq/123-lan09:25:161
9111991616,0cyclictest67750irq/123-lan09:00:151
9111991616,0cyclictest67750irq/123-lan07:45:141
9111991615,1cyclictest67750irq/123-lan11:48:201
9111991615,1cyclictest67750irq/123-lan10:06:431
9111991615,1cyclictest67750irq/123-lan09:55:131
9111991615,1cyclictest67750irq/123-lan08:15:121
9111991515,0cyclictest67750irq/123-lan10:20:151
9111991515,0cyclictest67750irq/123-lan08:05:171
9111991514,1cyclictest67750irq/123-lan10:25:121
9111991514,1cyclictest67750irq/123-lan08:55:181
9111991514,1cyclictest67750irq/123-lan07:55:091
9111991414,0cyclictest784-21snmpd07:50:231
9111991414,0cyclictest67750irq/123-lan07:35:491
9111991413,1cyclictest67750irq/123-lan08:10:121
9111991313,0cyclictest784-21snmpd08:41:041
9111991312,1cyclictest67750irq/123-lan08:00:151
91209998,1cyclictest245-20systemd-journal10:29:143
91169998,1cyclictest784-21snmpd09:45:262
91049998,1cyclictest782-21lldpd08:32:430
91209987,1cyclictest784-21snmpd12:27:543
91209987,1cyclictest784-21snmpd09:56:113
91169988,0cyclictest784-21snmpd11:26:572
91169988,0cyclictest782-21lldpd10:58:212
91169988,0cyclictest782-21lldpd09:02:512
91169988,0cyclictest782-21lldpd07:24:502
91169987,1cyclictest784-21snmpd11:54:512
91169987,1cyclictest784-21snmpd08:52:212
91169987,1cyclictest784-21snmpd07:16:062
91169987,1cyclictest507-21systemd-resolve12:30:192
91169987,1cyclictest507-21systemd-resolve10:47:422
91169987,1cyclictest507-21systemd-resolve09:39:202
91169987,1cyclictest22773-21ntp_offset09:40:172
91169986,2cyclictest784-21snmpd10:03:382
91169986,2cyclictest784-21snmpd08:08:152
91169986,2cyclictest762-21ntpd10:54:012
91049988,0cyclictest784-21snmpd10:43:310
91049988,0cyclictest784-21snmpd08:29:460
91049988,0cyclictest782-21lldpd08:56:470
91049988,0cyclictest782-21lldpd08:24:370
91049988,0cyclictest782-21lldpd08:16:130
91049988,0cyclictest782-21lldpd07:38:260
91049987,1cyclictest782-21lldpd08:05:330
91049987,1cyclictest526-21avahi-daemon11:05:420
91049987,1cyclictest28178-21gltestperf11:00:120
91049986,2cyclictest784-21snmpd07:42:370
91049986,2cyclictest784-21snmpd07:18:070
91049984,3cyclictest23155-21ntp_states11:30:180
91209977,0cyclictest784-21snmpd07:11:183
91209976,1cyclictest784-21snmpd10:11:043
91209976,1cyclictest31164-21gltestperf09:15:143
91209973,2cyclictest8551-21kworker/u16:0+xprtiod12:32:083
91169977,0cyclictest784-21snmpd11:10:192
91169977,0cyclictest784-21snmpd10:37:182
91169977,0cyclictest784-21snmpd10:31:042
91169977,0cyclictest784-21snmpd10:28:242
91169977,0cyclictest782-21lldpd11:30:112
91169977,0cyclictest782-21lldpd09:55:312
91169977,0cyclictest782-21lldpd08:33:052
91169976,1cyclictest784-21snmpd11:24:292
91169976,1cyclictest784-21snmpd09:15:502
91169976,1cyclictest526-21avahi-daemon12:24:542
91169976,1cyclictest1916-21gltestperf08:10:142
91169975,2cyclictest784-21snmpd10:11:372
91169975,2cyclictest784-21snmpd09:09:162
91169975,2cyclictest13532-21cat09:30:122
91169973,3cyclictest27490-21ssh12:10:452
91049977,0cyclictest784-21snmpd11:35:200
91049977,0cyclictest784-21snmpd11:17:530
91049977,0cyclictest782-21lldpd09:44:380
91049977,0cyclictest782-21lldpd09:01:380
91049977,0cyclictest782-21lldpd07:14:320
91049976,1cyclictest784-21snmpd07:31:380
91049976,1cyclictest24703-21cat09:05:140
91049975,2cyclictest784-21snmpd07:27:310
91049972,5cyclictest547-21NetworkManager07:52:590
91209966,0cyclictest784-21snmpd07:35:043
91209965,0cyclictest191rcu_preempt10:06:133
91209964,2cyclictest784-21snmpd08:30:483
91209964,0cyclictest191rcu_preempt07:44:583
91209963,1cyclictest52-21ksoftirqd/307:15:123
91209963,0cyclictest191rcu_preempt07:20:123
91209962,3cyclictest31164-21sed12:15:193
91209962,2cyclictest52-21ksoftirqd/312:10:293
91209961,3cyclictest52-21ksoftirqd/307:25:153
91209961,3cyclictest0-21swapper/312:05:173
91209960,4cyclictest52-21ksoftirqd/309:20:123
91209960,3cyclictest2633-21cat12:20:143
91169966,0cyclictest784-21snmpd12:09:132
91169966,0cyclictest784-21snmpd11:19:262
91169966,0cyclictest784-21snmpd08:49:482
91169966,0cyclictest782-21lldpd08:44:202
91169966,0cyclictest245-20systemd-journal12:01:002
91169965,1cyclictest8185-21cpuspeed_turbos08:25:112
91169965,1cyclictest784-21snmpd08:38:002
91169965,1cyclictest784-21snmpd08:20:322
91169965,1cyclictest782-21lldpd11:46:252
91169965,1cyclictest534-21irqbalance11:40:212
91169965,1cyclictest27286-21needreboot11:35:142
91169964,2cyclictest784-21snmpd07:54:442
91169964,2cyclictest547-21NetworkManager10:24:132
91169963,3cyclictest21048-21ntpq08:55:162
91169963,2cyclictest26301-21ssh09:10:052
91169963,2cyclictest11824-21ssh10:40:342
91169962,3cyclictest2882-21ssh11:08:102
91169962,3cyclictest16685-21ntp_states12:35:172
91049966,0cyclictest784-21snmpd07:21:010
91049966,0cyclictest782-21lldpd09:47:040
91049966,0cyclictest526-21avahi-daemon08:02:370
91049965,1cyclictest526-21avahi-daemon10:54:330
91049964,2cyclictest784-21snmpd08:43:240
91049963,2cyclictest574-21rs:main0
91049963,2cyclictest245-20systemd-journal11:27:100
91049962,3cyclictest20630-21ssh09:38:270
91049962,3cyclictest13561-21irqstats09:30:130
91169953,2cyclictest7993-21unixbench_multi12:25:212
91169953,2cyclictest30583-21ssh09:50:052
91169952,2cyclictest574-21rs:main2
91169952,2cyclictest32453-21ssh12:16:482
91169952,2cyclictest245-20systemd-journal07:25:052
91169952,2cyclictest12570-21expr11:55:112
91169952,2cyclictest11805-21grep10:05:132
91049955,0cyclictest526-21avahi-daemon07:56:270
91049953,2cyclictest547-21NetworkManager11:47:460
91049952,2cyclictest24205-21ssh10:55:150
91049952,2cyclictest23670-21df_inode07:45:120
91049952,2cyclictest17031-21ssh10:46:590
91169941,2cyclictest29854-21fw_conntrack08:00:102
91169940,4cyclictest28391-21ntpq07:55:172
91169940,3cyclictest28684-21ntpq11:00:152
91049940,4cyclictest1913-21fw_forwarded_lo08:10:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional