You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 21:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Nov 28, 2025 12:46:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11965210994sleep80-21swapper/807:07:4010
11965210994sleep80-21swapper/807:07:4010
11880210794sleep10-21swapper/107:06:321
11880210794sleep10-21swapper/107:06:311
1217829791sleep70-21swapper/707:09:519
1217829791sleep70-21swapper/707:09:509
3066350950irq/52-eth0-rx-0-21swapper/507:06:037
3066350950irq/52-eth0-rx-0-21swapper/507:06:037
12250930irq/42-ahci0-21swapper/307:08:505
12250930irq/42-ahci0-21swapper/307:08:495
1195128880sleep90-21swapper/907:07:2911
1195128880sleep90-21swapper/907:07:2911
12250830irq/42-ahci0-21swapper/407:05:046
12250830irq/42-ahci0-21swapper/407:05:046
12250790irq/42-ahci0-21swapper/207:08:494
12250790irq/42-ahci0-21swapper/207:08:484
1187726758sleep110-21swapper/1107:06:303
1187726758sleep110-21swapper/1107:06:303
1206126653sleep60-21swapper/607:08:148
1206126653sleep60-21swapper/607:08:138
1206526462sleep100-21swapper/1007:08:182
1206526462sleep100-21swapper/1007:08:182
1197025955sleep00-21swapper/007:07:440
1197025955sleep00-21swapper/007:07:440
1229499340cyclictest0-21swapper/008:25:570
12343993316cyclictest831ksoftirqd/1008:30:092
12343993215cyclictest831ksoftirqd/1008:00:132
1229499310cyclictest0-21swapper/009:24:100
12343992322cyclictest0-21swapper/1010:08:052
12294992322cyclictest6837-1kworker/0:1H09:18:420
8799200watchdog/110-21swapper/1108:22:383
1234399203cyclictest831ksoftirqd/1011:41:072
1234399203cyclictest831ksoftirqd/1008:43:512
1234399192cyclictest831ksoftirqd/1012:20:242
1234399192cyclictest831ksoftirqd/1012:17:392
1234399192cyclictest831ksoftirqd/1011:59:322
1234399192cyclictest831ksoftirqd/1011:35:022
1234399192cyclictest831ksoftirqd/1011:20:282
1234399192cyclictest831ksoftirqd/1011:19:552
1234399192cyclictest831ksoftirqd/1010:10:022
1234399192cyclictest831ksoftirqd/1009:45:252
1234399192cyclictest831ksoftirqd/1009:35:192
1234399192cyclictest831ksoftirqd/1009:35:192
1234399192cyclictest831ksoftirqd/1009:30:292
1234399192cyclictest831ksoftirqd/1009:00:152
1234399192cyclictest831ksoftirqd/1008:59:012
1234399192cyclictest831ksoftirqd/1008:50:012
1234399192cyclictest831ksoftirqd/1008:48:172
1234399192cyclictest831ksoftirqd/1008:15:172
1234399192cyclictest831ksoftirqd/1008:06:032
1234399192cyclictest831ksoftirqd/1007:55:442
1234399192cyclictest831ksoftirqd/1007:35:152
1234399192cyclictest831ksoftirqd/1007:20:152
1234399192cyclictest831ksoftirqd/1007:20:152
1234399191cyclictest831ksoftirqd/1010:00:012
1234399191cyclictest831ksoftirqd/1010:00:002
12331991913cyclictest0-21swapper/608:59:548
12294991917cyclictest30865-21chrt07:30:330
12294991917cyclictest278452sleep007:26:210
901180ksoftirqd/110-21swapper/1107:27:193
1699180watchdog/00-21swapper/009:12:350
12343991817cyclictest831ksoftirqd/1010:35:102
12343991817cyclictest0-21swapper/1012:30:072
12343991817cyclictest0-21swapper/1012:10:082
12343991817cyclictest0-21swapper/1011:45:062
12343991817cyclictest0-21swapper/1011:30:152
12343991817cyclictest0-21swapper/1011:02:452
12343991817cyclictest0-21swapper/1010:55:052
12343991817cyclictest0-21swapper/1010:31:052
12343991817cyclictest0-21swapper/1007:40:102
12343991817cyclictest0-21swapper/1007:11:222
1234399181cyclictest831ksoftirqd/1012:35:392
1234399181cyclictest831ksoftirqd/1012:25:032
1234399181cyclictest831ksoftirqd/1012:25:032
1234399181cyclictest831ksoftirqd/1012:05:152
1234399181cyclictest831ksoftirqd/1012:00:132
1234399181cyclictest831ksoftirqd/1011:50:162
1234399181cyclictest831ksoftirqd/1011:25:292
1234399181cyclictest831ksoftirqd/1011:10:132
1234399181cyclictest831ksoftirqd/1011:05:252
1234399181cyclictest831ksoftirqd/1010:50:162
1234399181cyclictest831ksoftirqd/1010:45:242
1234399181cyclictest831ksoftirqd/1010:40:212
1234399181cyclictest831ksoftirqd/1010:25:262
1234399181cyclictest831ksoftirqd/1010:20:222
1234399181cyclictest831ksoftirqd/1010:15:182
1234399181cyclictest831ksoftirqd/1010:00:482
1234399181cyclictest831ksoftirqd/1010:00:482
1234399181cyclictest831ksoftirqd/1009:50:262
1234399181cyclictest831ksoftirqd/1009:40:232
1234399181cyclictest831ksoftirqd/1009:25:252
1234399181cyclictest831ksoftirqd/1009:20:202
1234399181cyclictest831ksoftirqd/1009:15:132
1234399181cyclictest831ksoftirqd/1009:10:262
1234399181cyclictest831ksoftirqd/1009:05:182
1234399181cyclictest831ksoftirqd/1008:35:122
1234399181cyclictest831ksoftirqd/1008:25:132
1234399181cyclictest831ksoftirqd/1008:20:142
1234399181cyclictest831ksoftirqd/1008:10:112
1234399181cyclictest831ksoftirqd/1007:50:152
1234399181cyclictest831ksoftirqd/1007:45:132
1234399181cyclictest831ksoftirqd/1007:15:062
1233699181cyclictest566-1kworker/9:2H09:51:2411
1233699181cyclictest0-21swapper/911:05:2511
1233699181cyclictest0-21swapper/910:50:1311
1233699181cyclictest0-21swapper/910:30:0111
1233699181cyclictest0-21swapper/908:10:3211
1233699181cyclictest0-21swapper/907:20:1311
1233699181cyclictest0-21swapper/907:20:1311
12334991816cyclictest14266-21perl11:35:1510
12334991816cyclictest13558-21perl10:05:1710
12294991816cyclictest242692sleep007:22:080
12294991816cyclictest242692sleep007:22:070
13450170irq/18-ehci_hcd0-21swapper/011:55:230
12343991716cyclictest0-21swapper/1007:30:042
12343991716cyclictest0-21swapper/1007:25:082
12336991715cyclictest3553-21chrt07:40:0611
12336991715cyclictest29532-21awk09:45:0111
12336991715cyclictest22168-21chrt09:33:4411
12336991715cyclictest12056-21taskset10:47:3111
1233699170cyclictest566-1kworker/9:2H07:31:4911
1233699170cyclictest0-21swapper/912:10:3011
1233699170cyclictest0-21swapper/911:45:1611
1233699170cyclictest0-21swapper/911:02:3811
1233699170cyclictest0-21swapper/907:10:5711
12334991715cyclictest9772-21snmp_easybox.os08:30:2210
12334991715cyclictest8537-21snmp_rack3slot907:45:1610
12334991715cyclictest30469-21snmp_rack3slot909:45:1410
12334991715cyclictest28700-21hddtemp_smartct11:10:1410
12334991715cyclictest26363-21snmp_rack3slot908:10:1110
12334991715cyclictest25564-21snmp_rack3slot907:25:1210
12334991715cyclictest25163-21snmp_rack3slot908:51:4910
12334991715cyclictest24879-21iostat10:20:1610
12334991715cyclictest23261-21snmp_rack3slot911:45:5110
12334991715cyclictest22935-21snmp_rack3slot911:01:1510
12334991715cyclictest19609-21snmp_rack3slot908:45:1410
12334991715cyclictest17357-21snmp_rack3slot910:10:1610
12334991715cyclictest16281-21df09:25:1310
12334991715cyclictest12781-21snmp_rack3slot912:16:1110
12331991716cyclictest3902-21qemu-kvm09:26:398
12331991716cyclictest3901-21qemu-kvm09:11:278
12331991715cyclictest3902-21qemu-kvm09:45:368
12331991715cyclictest3902-21qemu-kvm09:21:198
12331991715cyclictest3901-21qemu-kvm09:08:188
12310991715cyclictest2406-21snmpd07:51:044
1229499173cyclictest0-21swapper/010:08:270
12294991716cyclictest2392-21nscd07:15:150
1229499170cyclictest0-21swapper/009:27:220
1799160watchdog/10-21swapper/109:45:151
12334991614cyclictest9894-21df10:45:1410
12334991614cyclictest5055-21snmp_easybox.os09:55:1210
12334991614cyclictest5055-21snmp_easybox.os09:55:1210
12334991614cyclictest4204-21snmp_rack3slot909:51:2510
12334991614cyclictest3657-21snmp_rack3slot909:05:3710
12334991614cyclictest31931-21yum08:15:3310
12334991614cyclictest30807-21perl09:00:1510
12334991614cyclictest29409-21df07:30:1310
12334991614cyclictest28787-21snmp_rack3slot908:56:4910
12334991614cyclictest26952-21snmp_rack3slot911:51:3610
12334991614cyclictest21438-21snmp_rack3slot912:30:1510
12334991614cyclictest13075-21snmp_rack3slot909:20:1710
1233499160cyclictest0-21swapper/807:40:1610
1233399165cyclictest0-21swapper/710:25:019
12331991615cyclictest3901-21qemu-kvm09:16:128
12322991614cyclictest7691-21sensors10:40:246
12322991614cyclictest15782-21sensors12:20:266
1229499160cyclictest0-21swapper/010:27:170
714021514sleep110-21swapper/1108:29:283
12336991514cyclictest566-1kworker/9:2H11:35:1011
12336991514cyclictest0-21swapper/908:30:0011
12336991513cyclictest20019-21chrt12:25:5211
12336991513cyclictest20019-21chrt12:25:5211
12336991513cyclictest19201-21taskset10:55:3211
12334991513cyclictest24609-21snmp_rack3slot912:35:1410
12334991513cyclictest24136-21hddtemp_smartct09:35:1710
12334991513cyclictest24136-21hddtemp_smartct09:35:1610
12334991513cyclictest23017-21perl08:05:1410
12334991513cyclictest22221-21df_inode07:20:1410
12334991513cyclictest22221-21df_inode07:20:1310
12334991513cyclictest18584-21df_inode07:15:1810
1233499150cyclictest0-21swapper/812:01:2410
1233499150cyclictest0-21swapper/811:30:1810
1233499150cyclictest0-21swapper/808:25:0110
1233399155cyclictest0-21swapper/710:30:019
1233399154cyclictest0-21swapper/712:05:019
1233399154cyclictest0-21swapper/708:00:029
1233399150cyclictest0-21swapper/709:30:129
12331991514cyclictest3902-21qemu-kvm09:30:138
12322991513cyclictest5760-21sensors07:40:266
1232299150cyclictest0-21swapper/409:00:266
1231499150cyclictest0-21swapper/310:30:165
12310991513cyclictest2406-21snmpd08:02:494
1231099150cyclictest0-21swapper/209:35:164
1231099150cyclictest0-21swapper/209:35:154
12302991514cyclictest27712-21python08:10:251
12294991513cyclictest157542chrt07:12:550
3066350140irq/52-eth0-rx-0-21swapper/108:25:571
182050140irq/55-eth1-rx-0-21swapper/708:26:009
1233699144cyclictest0-21swapper/910:20:0211
1233699144cyclictest0-21swapper/908:40:0011
1233699143cyclictest0-21swapper/912:30:0111
1233699143cyclictest0-21swapper/912:05:0011
1233699143cyclictest0-21swapper/908:14:5911
12336991413cyclictest0-21swapper/912:35:1711
12336991413cyclictest0-21swapper/911:25:3011
12336991413cyclictest0-21swapper/910:25:2611
12336991413cyclictest0-21swapper/908:05:2911
12334991412cyclictest9320-21perl09:15:1610
12334991412cyclictest8051-21snmp_easybox.os11:25:2510
12334991412cyclictest2923-21perl10:35:1310
12334991412cyclictest19007-21memory12:25:1910
12334991412cyclictest19007-21memory12:25:1910
12334991412cyclictest16653-21snmp_rack3slot907:55:2310
12334991412cyclictest15853-21diskstats08:40:1310
1233499140cyclictest0-21swapper/812:08:0410
1233499140cyclictest0-21swapper/810:25:1310
1233499140cyclictest0-21swapper/807:38:3310
1233399144cyclictest0-21swapper/710:40:019
1233399143cyclictest0-21swapper/709:35:019
1233399143cyclictest0-21swapper/709:35:019
1233399143cyclictest0-21swapper/707:30:029
12331991413cyclictest3902-21qemu-kvm09:40:448
12331991413cyclictest15339-21qemu-kvm10:08:248
1232299140cyclictest0-21swapper/409:40:136
12310991413cyclictest31757-21turbostat07:35:004
12310991412cyclictest2406-21snmpd10:11:344
12310991412cyclictest2406-21snmpd09:32:344
1230299140cyclictest0-21swapper/109:45:011
12250140irq/42-ahci0-21swapper/208:26:094
31130ksoftirqd/00-21swapper/010:15:260
1233699133cyclictest0-21swapper/911:50:0111
1233699133cyclictest0-21swapper/911:35:0011
1233699133cyclictest0-21swapper/907:25:0111
12336991311cyclictest30366-21taskset11:13:3211
12336991311cyclictest21214-21taskset08:04:0211
1233499133cyclictest0-21swapper/811:18:0510
1233499133cyclictest0-21swapper/811:05:0110
1233499133cyclictest0-21swapper/810:51:3510
12334991311cyclictest21248-21iostat_ios10:15:1810
12334991311cyclictest14476-21munin-run08:40:0010
12334991311cyclictest14146-21hddtemp_smartct07:10:1610
1233499130cyclictest0-21swapper/810:00:1210
1233499130cyclictest0-21swapper/810:00:1110
1233499130cyclictest0-21swapper/808:20:4710
1233499130cyclictest0-21swapper/807:50:2310
1233399134cyclictest0-21swapper/709:04:599
1233399133cyclictest0-21swapper/710:54:599
1233399133cyclictest0-21swapper/708:25:019
1233399133cyclictest0-21swapper/707:52:509
1233399133cyclictest0-21swapper/707:46:339
1233399133cyclictest0-21swapper/707:43:199
1233399133cyclictest0-21swapper/707:25:049
1233199134cyclictest0-21swapper/610:35:188
1233199130cyclictest0-21swapper/608:05:018
1231499133cyclictest0-21swapper/308:45:175
1231099134cyclictest0-21swapper/210:20:154
1231099133cyclictest0-21swapper/211:09:594
1231099133cyclictest0-21swapper/209:20:194
1231099133cyclictest0-21swapper/208:55:164
1231099133cyclictest0-21swapper/207:15:234
12310991311cyclictest2406-21snmpd07:28:344
1229499138cyclictest0-21swapper/009:08:110
1229499133cyclictest0-21swapper/008:45:180
1229499133cyclictest0-21swapper/007:50:210
12294991312cyclictest3066350irq/52-eth0-rx-08:20:000
5999120watchdog/70-21swapper/709:46:079
31120ksoftirqd/00-21swapper/008:55:250
1233699124cyclictest0-21swapper/907:50:0211
1233699123cyclictest0-21swapper/912:15:0111
1233699123cyclictest0-21swapper/910:10:0211
1233699123cyclictest0-21swapper/910:00:0111
1233699123cyclictest0-21swapper/910:00:0111
1233699122cyclictest0-21swapper/911:22:3511
12336991210cyclictest18419-21iostat_ios11:40:2011
1233499120cyclictest0-21swapper/811:20:1910
1233499120cyclictest0-21swapper/810:55:1710
1233499120cyclictest0-21swapper/810:43:2910
1233399124cyclictest0-21swapper/711:00:019
1233399124cyclictest0-21swapper/709:25:019
1233399123cyclictest0-21swapper/711:05:019
1233399123cyclictest0-21swapper/710:23:349
1233399123cyclictest0-21swapper/708:35:009
1233399122cyclictest0-21swapper/712:19:249
1233399122cyclictest0-21swapper/711:14:249
1233399122cyclictest0-21swapper/710:13:139
1233399122cyclictest0-21swapper/708:16:389
1233399122cyclictest0-21swapper/707:35:209
1233199122cyclictest0-21swapper/608:38:218
1233199121cyclictest0-21swapper/608:21:488
12322991210cyclictest22262-21sensors11:00:276
1231499121cyclictest0-21swapper/309:04:075
1231099122cyclictest0-21swapper/211:45:264
12302991210cyclictest3066350irq/52-eth0-rx-09:32:391
1229499120cyclictest0-21swapper/008:05:230
901110ksoftirqd/110-21swapper/1108:08:183
621110ksoftirqd/70-21swapper/708:10:139
481110ksoftirqd/524832-21qemu-kvm08:08:187
341110ksoftirqd/30-21swapper/308:10:135
341110ksoftirqd/30-21swapper/308:08:185
31110ksoftirqd/00-21swapper/009:35:260
31110ksoftirqd/00-21swapper/009:35:250
31110ksoftirqd/00-21swapper/007:55:230
31110ksoftirqd/00-21swapper/007:40:160
271110ksoftirqd/20-21swapper/208:10:134
1234499119cyclictest0-21swapper/1110:45:143
1234499110cyclictest0-21swapper/1109:40:123
1233699119cyclictest548-21taskset09:47:5011
1233699119cyclictest17350-21taskset07:56:3211
1233699113cyclictest0-21swapper/911:19:0511
1233699111cyclictest0-21swapper/910:35:1911
1233699111cyclictest0-21swapper/910:15:2311
1233699111cyclictest0-21swapper/909:25:0111
1233699111cyclictest0-21swapper/909:23:5811
1233499119cyclictest29061-21hddtemp_smartct11:55:1510
1233499119cyclictest19562-21snmp_rack3slot909:30:1210
1233499113cyclictest0-21swapper/809:41:0510
1233499111cyclictest0-21swapper/812:10:1910
1233499111cyclictest0-21swapper/808:00:2410
1233499110cyclictest0-21swapper/811:41:1310
1233499110cyclictest0-21swapper/810:30:3810
1233499110cyclictest0-21swapper/809:13:3210
1233399113cyclictest0-21swapper/711:20:339
1233399113cyclictest0-21swapper/710:00:019
1233399113cyclictest0-21swapper/710:00:019
1233399113cyclictest0-21swapper/709:23:129
1233399113cyclictest0-21swapper/709:10:389
1233399113cyclictest0-21swapper/709:08:189
1233399113cyclictest0-21swapper/708:57:529
1233399113cyclictest0-21swapper/708:41:189
1233399113cyclictest0-21swapper/708:33:339
1233399113cyclictest0-21swapper/707:58:199
1233399113cyclictest0-21swapper/707:17:339
1233199115cyclictest0-21swapper/609:01:218
1233199113cyclictest0-21swapper/611:31:488
1233199113cyclictest0-21swapper/611:20:018
1233199113cyclictest0-21swapper/610:35:028
1233199113cyclictest0-21swapper/610:00:198
1233199113cyclictest0-21swapper/610:00:188
1233199111cyclictest0-21swapper/612:21:218
1233199110cyclictest0-21swapper/607:15:008
1232299119cyclictest3543-21sensors09:50:256
12322991110cyclictest51002sleep411:21:036
1231499113cyclictest0-21swapper/309:45:205
1231499113cyclictest0-21swapper/308:25:185
1231499113cyclictest0-21swapper/308:00:175
1231499111cyclictest0-21swapper/312:34:165
1231499111cyclictest0-21swapper/312:09:165
1231499111cyclictest0-21swapper/310:43:005
1231499111cyclictest0-21swapper/309:54:035
1231099113cyclictest0-21swapper/210:00:174
1231099113cyclictest0-21swapper/210:00:174
1231099113cyclictest0-21swapper/209:10:004
1231099111cyclictest0-21swapper/208:35:154
1231099110cyclictest0-21swapper/207:40:134
1230299113cyclictest0-21swapper/112:05:191
1230299113cyclictest0-21swapper/111:55:171
1230299113cyclictest0-21swapper/108:50:171
1230299112cyclictest0-21swapper/109:25:191
1230299112cyclictest0-21swapper/107:15:221
1230299111cyclictest0-21swapper/112:20:171
1230299110cyclictest0-21swapper/110:15:131
1229499113cyclictest0-21swapper/008:11:460
1229499110cyclictest0-21swapper/010:10:260
901100ksoftirqd/110-21swapper/1107:40:203
8999100migration/1124802-21timerwakeupswit08:50:293
8999100migration/1111086-21latency_hist08:35:003
881100rcuc/110-21swapper/1107:11:153
7599100migration/92998-21munin-node08:20:3011
6199100migration/78927-21runrttasks11:28:449
6199100migration/78444-21runrttasks10:42:559
551100ksoftirqd/624833-21qemu-kvm08:08:188
551100ksoftirqd/612050-21qemu-kvm07:40:168
551100ksoftirqd/60-21swapper/611:35:158
5499100migration/623125-21unixbench_multi11:45:318
481100ksoftirqd/50-21swapper/511:35:167
481100ksoftirqd/50-21swapper/508:45:227
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional