You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 03:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri May 01, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
815623627,0sleep30-21swapper/318:54:353
815923524,0sleep10-21swapper/118:54:371
798723425,0sleep20-21swapper/218:52:382
205423423,0sleep00-21swapper/018:52:080
84289960,0cyclictest0-21swapper/221:32:472
84279965,0cyclictest24619-21tr21:07:121
339960,0migration/35900-21sh23:16:443
339960,0migration/326080-21kthreadcore00:12:153
339960,0migration/323363-21munin-node23:47:133
339960,0migration/322971-21sh21:06:503
149960,0migration/021340-21sh21:02:440
149960,0migration/014525-21sh21:19:580
84289955,0cyclictest0-21swapper/223:30:432
84289955,0cyclictest0-21swapper/222:47:312
84289955,0cyclictest0-21swapper/222:10:002
84279955,0cyclictest0-21swapper/122:44:451
84279955,0cyclictest0-21swapper/122:23:461
84279955,0cyclictest0-21swapper/121:44:401
84279950,0cyclictest0-21swapper/123:17:421
84279950,0cyclictest0-21swapper/122:37:391
84279950,0cyclictest0-21swapper/120:46:301
84279950,0cyclictest0-21swapper/100:22:481
84269954,0cyclictest12287-21sadc20:36:560
84269950,0cyclictest0-21swapper/023:18:520
84269950,0cyclictest0-21swapper/023:06:440
8215050,0irq/24-0000:00:577-21kthreadcore21:52:122
35150,0ktimersoftd/30-21swapper/321:58:173
339950,0migration/38564-21kthreadcore22:57:133
339950,0migration/37527-21fschecks_time20:57:083
339950,0migration/37386-21idleruntime-cro00:01:553
339950,0migration/36446-21runrttasks21:15:263
339950,0migration/35826-21aten_r1power_cu20:32:063
339950,0migration/33981-21kthreadcore21:52:133
339950,0migration/331787-21cpuspeed_turbos20:27:073
339950,0migration/331274-21aten_r1power_cu22:12:063
339950,0migration/326388-21kthreadcore23:07:123
339950,0migration/326175-21kthreadcore19:07:133
339950,0migration/325359-21taskset20:44:203
339950,0migration/325103-21irqrtprio19:57:153
339950,0migration/324677-21kthreadcore19:32:133
339950,0migration/317476-21kthreadcore00:07:113
339950,0migration/316348-21kthreadcore23:02:133
339950,0migration/31579-21kthreadcore22:32:143
339950,0migration/313283-21kthreadcore18:57:143
339950,0migration/31051-21kthreadcore00:17:133
29725050,0irq/27-eth0-tx-8637-21munin-node18:57:090
29725050,0irq/27-eth0-tx-7371-21munin-node00:22:102
29725050,0irq/27-eth0-tx-5999-21munin-node23:37:172
29725050,0irq/27-eth0-tx-5370-21ssh23:15:112
29725050,0irq/27-eth0-tx-3873-21munin-node19:42:140
29725050,0irq/27-eth0-tx-30561-21munin-node20:02:110
29725050,0irq/27-eth0-tx-24067-21df_abs21:27:072
29725050,0irq/27-eth0-tx-23641-21df_abs21:07:082
29725050,0irq/27-eth0-tx-20575-21unixbench_multi23:02:192
29725050,0irq/27-eth0-tx-10548-21munin-node19:47:150
29725050,0irq/27-eth0-tx-0-21swapper/223:33:052
29725050,0irq/27-eth0-tx-0-21swapper/223:20:292
29725050,0irq/27-eth0-tx-0-21swapper/222:52:222
29725050,0irq/27-eth0-tx-0-21swapper/221:02:192
29725050,0irq/27-eth0-tx-0-21swapper/020:57:130
29725050,0irq/27-eth0-tx-0-21swapper/019:06:590
29715050,0irq/26-eth0-rx-9247-21cat22:17:143
29715050,0irq/26-eth0-rx-7676-21cpuspeed_turbos21:37:083
29715050,0irq/26-eth0-rx-30960-21diskstats20:02:093
29715050,0irq/26-eth0-rx-22482-21sh22:26:063
29715050,0irq/26-eth0-rx-20764-21ssh23:43:593
29715050,0irq/26-eth0-rx-19588-21grep21:22:123
29715050,0irq/26-eth0-rx-17543-21cat19:02:133
29715050,0irq/26-eth0-rx-12907-21munin-node00:22:143
29715050,0irq/26-eth0-rx-1249-21irqrtprio20:52:133
29715050,0irq/26-eth0-rx-11690-21missed_timers23:17:143
29715050,0irq/26-eth0-rx-10198-21fschecks_time19:22:083
29715050,0irq/26-eth0-rx-0-21swapper/323:52:503
29715050,0irq/26-eth0-rx-0-21swapper/323:37:123
29715050,0irq/26-eth0-rx-0-21swapper/323:36:383
29715050,0irq/26-eth0-rx-0-21swapper/323:27:153
29715050,0irq/26-eth0-rx-0-21swapper/323:23:253
29715050,0irq/26-eth0-rx-0-21swapper/322:41:003
29715050,0irq/26-eth0-rx-0-21swapper/322:28:333
29715050,0irq/26-eth0-rx-0-21swapper/322:08:143
29715050,0irq/26-eth0-rx-0-21swapper/322:04:553
29715050,0irq/26-eth0-rx-0-21swapper/321:47:133
29715050,0irq/26-eth0-rx-0-21swapper/321:31:323
29715050,0irq/26-eth0-rx-0-21swapper/321:18:013
29715050,0irq/26-eth0-rx-0-21swapper/321:10:193
29715050,0irq/26-eth0-rx-0-21swapper/300:04:433
259950,0migration/29015-21kthreadcore21:57:132
259950,0migration/24582-21kthreadcore23:57:102
259950,0migration/222601-21sh21:45:092
259950,0migration/216640-21kthreadcore22:42:132
249950,0watchdog/231311-21ssh23:55:492
249950,0watchdog/223418-21if_err_eth123:07:102
249950,0watchdog/22109-21kthreadcore00:17:132
19150,0ktimersoftd/10-21swapper/122:59:241
179950,0migration/17647-21idleruntime20:57:091
179950,0migration/16014-21sh22:56:241
179950,0migration/15221-21pmu-power23:57:151
179950,0migration/123269-21taskset19:52:301
179950,0migration/118761-21taskset20:39:581
179950,0migration/11106-21irqcore20:52:131
169950,0watchdog/130320-21ssh21:49:141
149950,0migration/08802-21kthreadcore00:22:120
149950,0migration/07472-21kthreadcore19:17:130
149950,0migration/031029-21munin-node23:12:080
149950,0migration/030123-21kthreadcore19:12:130
149950,0migration/02996-21kthreadcore22:32:140
149950,0migration/02860-21kthreadcore20:27:120
149950,0migration/028218-21mdstat22:47:140
149950,0migration/02787-21rt-features19:37:160
149950,0migration/026516-21kthreadcore19:32:130
149950,0migration/026458-21fschecks_time20:47:100
149950,0migration/023520-21fschecks_count22:27:090
149950,0migration/022500-21taskset19:29:560
149950,0migration/021506-21taskset22:23:160
149950,0migration/021382-21sh22:43:420
149950,0migration/017086-21kthreadcore23:42:130
149950,0migration/016025-21idleruntime-cro19:26:560
149950,0migration/015569-21cpuspeed_turbos19:02:090
149950,0migration/014607-21kthreadcore20:37:130
149950,0migration/013713-21taskset22:18:470
149950,0migration/010979-21kthreadcore22:57:140
149950,0migration/010650-21kthreadcore21:37:130
84289943,0cyclictest3556-21lldpd20:57:052
84289943,0cyclictest3556-21lldpd20:17:062
84289943,0cyclictest3556-21lldpd19:40:362
84289943,0cyclictest3556-21lldpd19:27:352
84289943,0cyclictest3556-21lldpd19:07:042
84289943,0cyclictest3514-21snmpd20:35:422
84289943,0cyclictest32002-21awk22:32:112
84289943,0cyclictest25841-21awk20:22:092
84289943,0cyclictest24800-21awk19:57:142
84289943,0cyclictest18142-21awk19:52:102
84289943,0cyclictest17960-21sadc20:16:562
84289943,0cyclictest15141-21awk23:22:112
84279943,0cyclictest8547-21awk00:02:101
84279943,0cyclictest3750-21awk19:17:111
84279943,0cyclictest3556-21lldpd22:28:081
84279943,0cyclictest3556-21lldpd20:06:061
84279943,0cyclictest3556-21lldpd19:45:361
84279943,0cyclictest3514-21snmpd23:16:131
84279943,0cyclictest3514-21snmpd21:36:571
84279943,0cyclictest3514-21snmpd20:34:121
84279943,0cyclictest3514-21snmpd20:24:271
84279943,0cyclictest3514-21snmpd19:39:261
84279943,0cyclictest3514-21snmpd00:08:131
84279943,0cyclictest32560-21awk00:17:101
84279943,0cyclictest3241-21irqbalance23:42:141
84279943,0cyclictest31170-21awk23:32:111
84279943,0cyclictest24118-21awk22:07:101
84279943,0cyclictest22979-21sadc22:06:561
84279943,0cyclictest22920-21awk23:47:111
84279943,0cyclictest15111-21awk23:22:101
84279943,0cyclictest10566-21awk19:22:101
84269944,0cyclictest0-21swapper/021:14:570
84269943,0cyclictest7700-21awk22:37:100
84269943,0cyclictest6900-21awk23:37:120
84269943,0cyclictest3556-21lldpd23:52:380
84269943,0cyclictest3514-21snmpd21:56:430
84269943,0cyclictest3514-21snmpd21:22:270
84269943,0cyclictest32689-21awk21:32:100
84269943,0cyclictest32545-21awk00:17:100
84269943,0cyclictest31344-21sort22:52:110
84269943,0cyclictest26414-21tail21:07:130
84269943,0cyclictest20022-21awk20:42:110
84269943,0cyclictest16512-21awk00:07:090
84269943,0cyclictest13229-21kworker/0:123:28:210
84269943,0cyclictest13229-21kworker/0:123:08:110
84269943,0cyclictest13229-21kworker/0:122:15:170
84269940,0cyclictest0-21swapper/022:05:330
8215040,0irq/24-0000:00:24120-21diskstats00:12:112
339940,0migration/38738-21timerandwakeup19:17:193
339940,0migration/35277-21fschecks_count20:07:093
29725040,0irq/27-eth0-tx-6743-21ssh22:37:052
29725040,0irq/27-eth0-tx-0-21swapper/222:27:192
29725040,0irq/27-eth0-tx-0-21swapper/222:22:022
29725040,0irq/27-eth0-tx-0-21swapper/222:12:192
29725040,0irq/27-eth0-tx-0-21swapper/222:04:072
29725040,0irq/27-eth0-tx-0-21swapper/221:47:142
29725040,0irq/27-eth0-tx-0-21swapper/221:17:062
29725040,0irq/27-eth0-tx-0-21swapper/221:12:082
29725040,0irq/27-eth0-tx-0-21swapper/200:06:582
29725040,0irq/27-eth0-tx-0-21swapper/200:02:592
29725040,0irq/27-eth0-tx-0-21swapper/020:07:170
29725040,0irq/27-eth0-tx-0-21swapper/019:52:140
29715040,0irq/26-eth0-rx-21850-21sh21:42:583
29715040,0irq/26-eth0-rx-0-21swapper/322:52:113
29715040,0irq/26-eth0-rx-0-21swapper/322:47:293
29715040,0irq/26-eth0-rx-0-21swapper/322:42:593
29715040,0irq/26-eth0-rx-0-21swapper/321:33:293
29715040,0irq/26-eth0-rx-0-21swapper/320:41:423
29715040,0irq/26-eth0-rx-0-21swapper/319:52:073
29715040,0irq/26-eth0-rx-0-21swapper/319:42:083
259940,0migration/29494-21kthreadcore22:57:132
259940,0migration/29161-21latency19:42:142
259940,0migration/28248-21irqrtprio22:17:132
259940,0migration/223494-21fschecks_time19:32:102
259940,0migration/220656-21kthreadcore20:42:132
259940,0migration/217386-21kthreadcore21:22:122
259940,0migration/216564-21munin-node19:47:202
259940,0migration/215198-21munin-node19:22:152
259940,0migration/213554-21irqcore20:37:122
249940,0watchdog/28315-21munin-node19:17:152
249940,0watchdog/2539-21fschecks_count20:52:102
249940,0watchdog/214303-21python18:57:192
249940,0watchdog/213609-21ssh21:37:262
249940,0watchdog/20-21swapper/223:47:022
249940,0watchdog/20-21swapper/223:42:142
249940,0watchdog/20-21swapper/220:47:142
249940,0watchdog/20-21swapper/220:27:062
249940,0watchdog/20-21swapper/220:07:182
179940,0migration/132654-21kthreadcore22:32:131
179940,0migration/132141-21fschecks_time21:52:081
179940,0migration/128685-21kthreadcore21:27:141
179940,0migration/128305-21kthreadcore20:47:141
179940,0migration/126475-21kthreadcore00:12:151
179940,0migration/124366-21kthreadcore19:32:131
179940,0migration/122536-21cpuspeed_turbos23:27:091
179940,0migration/117885-21kthreadcore21:02:151
179940,0migration/117140-21kthreadcore19:02:131
179940,0migration/114479-21taskset22:00:341
179940,0migration/112892-21kthreadcore20:12:121
169940,0watchdog/1673-21kthreadcore21:12:141
169940,0watchdog/131875-21basename21:32:061
169940,0watchdog/131680-21cpu20:27:061
169940,0watchdog/118761-21tune2fs20:17:101
169940,0watchdog/112597-21kthreadcore21:17:141
169940,0watchdog/110315-21kthreadcore22:17:141
169940,0watchdog/10-21swapper/123:09:101
169940,0watchdog/10-21swapper/121:22:181
149940,0migration/02452-21kthreadcore20:52:140
149940,0migration/012513-21if_eth1.320:12:110
84289933,0cyclictest3556-21lldpd19:13:052
84289932,0cyclictest3828-21sendmail_mailst20:02:172
84289932,0cyclictest17224-21cut19:02:132
84279932,0cyclictest9544-21awk18:57:111
84279932,0cyclictest3556-21lldpd19:47:061
84279932,0cyclictest3514-21snmpd19:57:111
84279932,0cyclictest3241-21irqbalance23:37:041
84279932,0cyclictest29499-21awk19:12:111
84279932,0cyclictest2469-21grep22:12:121
84279932,0cyclictest20780-21kthreadcore19:27:141
84269933,0cyclictest6223-21kworker/0:021:26:570
84269933,0cyclictest6223-21kworker/0:020:22:060
84269933,0cyclictest6223-21kworker/0:020:17:120
84269933,0cyclictest6223-21kworker/0:019:57:080
84269933,0cyclictest13229-21kworker/0:123:46:590
84269933,0cyclictest13229-21kworker/0:123:32:290
84269933,0cyclictest13229-21kworker/0:123:22:130
84269933,0cyclictest13229-21kworker/0:121:47:030
84269933,0cyclictest13229-21kworker/0:121:42:090
84269933,0cyclictest13229-21kworker/0:100:01:570
84269932,0cyclictest29083-21cut00:12:160
84269932,0cyclictest29028-21sensors22:07:170
84269930,0cyclictest7908-21perl21:57:090
29715030,0irq/26-eth0-rx-0-21swapper/320:47:093
29715030,0irq/26-eth0-rx-0-21swapper/320:18:013
29715030,0irq/26-eth0-rx-0-21swapper/319:47:083
29715030,0irq/26-eth0-rx-0-21swapper/319:39:143
29715030,0irq/26-eth0-rx-0-21swapper/319:27:193
29715030,0irq/26-eth0-rx-0-21swapper/319:12:003
169930,0watchdog/10-21swapper/123:53:261
169930,0watchdog/10-21swapper/123:02:141
169930,0watchdog/10-21swapper/122:47:541
169930,0watchdog/10-21swapper/120:07:181
169930,0watchdog/10-21swapper/119:07:111
149930,0migration/05173-21sh23:57:140
329920,0watchdog/325352-21fschecks_count20:22:073
29715020,0irq/26-eth0-rx-0-21swapper/320:12:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional