You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 16:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Dec 12, 2025 00:46:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20184210692sleep10-21swapper/119:06:331
30664501000irq/53-eth0-tx-0-21swapper/419:05:186
3066350990irq/52-eth0-rx-0-21swapper/719:09:199
3066350970irq/52-eth0-rx-0-21swapper/219:06:294
12250890irq/42-ahci0-21swapper/319:08:365
2023728273sleep90-21swapper/919:07:1711
3066350730irq/52-eth0-rx-0-21swapper/1119:05:193
2013727169sleep60-21swapper/619:06:028
2025926853sleep00-21swapper/019:07:320
2028026560sleep80-21swapper/819:07:5210
1950825955sleep100-21swapper/1019:05:302
1894525955sleep50-21swapper/519:05:257
20634993112cyclictest0-21swapper/1119:19:283
20634992928cyclictest0-21swapper/1119:11:123
2059299220cyclictest0-21swapper/020:08:230
20592992018cyclictest0-21swapper/022:08:290
2063299181cyclictest741rcuc/919:40:1911
2063299181cyclictest0-21swapper/922:10:0111
2063299181cyclictest0-21swapper/921:55:3511
2063299181cyclictest0-21swapper/921:10:0211
2063299181cyclictest0-21swapper/920:10:2711
2063299181cyclictest0-21swapper/900:35:0111
20631991816cyclictest9805-21perl20:20:1710
20631991816cyclictest797-21diskstats23:50:1410
20631991816cyclictest4796-21perl23:55:1810
20631991816cyclictest4505-21irqstats22:25:2310
20631991816cyclictest3797-21snmp_rack3slot920:55:2510
20631991816cyclictest32173-21iostat_ios20:50:2110
20631991816cyclictest31282-21irqstats19:20:2410
20631991816cyclictest30969-21snmp_rack3slot900:30:2810
20631991816cyclictest30112-21snmp_easybox.os20:05:1310
20631991816cyclictest29236-21snmp_rack3slot920:00:4810
20631991816cyclictest28320-21snmp_rack3slot921:30:1510
20631991816cyclictest28320-21snmp_rack3slot921:30:1510
20631991816cyclictest25178-21snmp_rack3slot922:10:1510
20631991816cyclictest24795-21snmp_easybox.os19:55:2510
20631991816cyclictest23636-21snmp_easybox.os23:35:2510
20631991816cyclictest17797-21diskstats22:00:1410
20631991816cyclictest17084-21snmp_rack3slot923:26:3910
20631991816cyclictest16834-21snmp_rack3slot919:45:1510
20631991816cyclictest16071-21snmp_easybox.os20:30:1210
20631991816cyclictest14375-21snmp_easybox.os20:25:2710
20629991816cyclictest667-21qemu-kvm20:20:158
20629991816cyclictest667-21qemu-kvm20:15:128
20629991816cyclictest667-21qemu-kvm20:08:338
20629991816cyclictest666-21qemu-kvm20:47:298
20629991816cyclictest666-21qemu-kvm20:10:148
2059399180cyclictest0-21swapper/119:30:151
20633991715cyclictest198932sleep1022:02:252
2063299171cyclictest0-21swapper/920:35:1911
2063299170cyclictest0-21swapper/921:43:5411
2063299170cyclictest0-21swapper/921:30:1211
2063299170cyclictest0-21swapper/921:30:1211
2063299170cyclictest0-21swapper/920:55:2911
20631991715cyclictest9952-21df21:05:1810
20631991715cyclictest8830-21snmp_rack3slot919:35:1310
20631991715cyclictest7625-21irqstats21:45:2210
20631991715cyclictest5706-21snmp_rack3slot920:15:1210
20631991715cyclictest4427-21perl23:10:1710
20631991715cyclictest3389-21snmp_easybox.os20:10:2410
20631991715cyclictest31674-21snmp_rack3slot923:47:1510
20631991715cyclictest301-21perl22:20:1510
20631991715cyclictest28064-21snmp_rack3slot922:15:1710
20631991715cyclictest27180-21snmp_easybox.os23:40:2410
20631991715cyclictest25599-21snmp_easybox.os19:15:1510
20631991715cyclictest22759-21diskstats00:20:1610
20631991715cyclictest22759-21diskstats00:20:1610
20631991715cyclictest22449-21hddtemp_smartct19:10:1810
20631991715cyclictest21921-21users19:50:3510
20631991715cyclictest21869-21df22:50:1610
20631991715cyclictest21265-21iostat_ios20:35:2310
20631991715cyclictest21151-21snmp_rack3slot900:16:5210
20631991715cyclictest21041-21snmp_rack3slot921:20:1710
20631991715cyclictest19450-21snmp_rack3slot923:30:2510
20631991715cyclictest18775-21snmp_rack3slot922:45:1510
20631991715cyclictest14682-21snmp_easybox.os00:10:1610
20631991715cyclictest14504-21perl21:55:2010
20631991715cyclictest14301-21snmp_rack3slot922:40:1310
20631991715cyclictest12229-21perl00:05:1710
20631991715cyclictest12229-21perl00:05:1710
20631991715cyclictest10263-21snmp_rack3slot900:02:1710
20629991716cyclictest667-21qemu-kvm20:35:178
20629991716cyclictest667-21qemu-kvm20:28:298
20629991715cyclictest666-21qemu-kvm20:42:118
20629991710cyclictest0-21swapper/621:20:018
20604991715cyclictest2406-21snmpd20:28:374
20633991615cyclictest750-1kworker/10:1H20:34:472
20633991615cyclictest31270-1kworker/10:2H19:46:112
20633991615cyclictest29862-1kworker/10:2H21:15:592
20633991615cyclictest0-21swapper/1023:52:432
20633991615cyclictest0-21swapper/1022:56:312
20633991615cyclictest0-21swapper/1022:30:252
20633991614cyclictest4589-21smartctl21:40:302
20633991614cyclictest15089-21python21:10:282
20633991614cyclictest11864-21python21:50:332
20632991615cyclictest9464-21ls20:20:1511
20632991615cyclictest761ksoftirqd/923:05:1511
20632991615cyclictest29089-21tune2fs22:15:2111
20632991615cyclictest0-21swapper/923:42:5911
20632991615cyclictest0-21swapper/919:20:1411
20632991614cyclictest27700-21chrt22:58:0511
20632991614cyclictest10976-21taskset00:05:0511
20632991614cyclictest10976-21taskset00:05:0511
20631991614cyclictest8658-21munin-run21:05:0010
20631991614cyclictest690-21snmp_easybox.os21:35:2210
20631991614cyclictest29968-21iostat_ios23:00:2310
20631991614cyclictest27706-21df20:45:1610
20631991614cyclictest27547-21snmp_rack3slot922:56:0210
20631991614cyclictest25599-21snmp_easybox.os00:25:1610
20631991614cyclictest24546-21perl20:40:1410
20631991614cyclictest2442-21snmp_rack3slot923:05:5110
20631991614cyclictest12523-21snmp_rack3slot921:51:4110
20622991615cyclictest30809-21timerandwakeup23:00:357
20622991615cyclictest20351-21qemu-kvm19:37:017
20622991614cyclictest20352-21qemu-kvm19:30:147
2061099168cyclictest13272-21turbostat22:40:005
20604991615cyclictest2406-21snmpd21:33:224
20604991615cyclictest2406-21snmpd21:33:224
20604991615cyclictest2406-21snmpd21:14:384
2059299160cyclictest0-21swapper/019:10:020
2063499155cyclictest0-21swapper/1119:45:003
20634991514cyclictest31635-21kworker/11:220:16:413
20634991513cyclictest27253-21chrt22:12:393
2063499150cyclictest0-21swapper/1119:40:523
20633991514cyclictest31270-1kworker/10:2H20:08:532
20633991514cyclictest31270-1kworker/10:2H19:10:062
20633991514cyclictest19398-1kworker/10:1H22:48:302
2063299155cyclictest0-21swapper/923:30:0111
2063299155cyclictest0-21swapper/923:25:0011
20632991514cyclictest761ksoftirqd/921:15:1711
20632991514cyclictest761ksoftirqd/920:00:3511
20632991514cyclictest24235-1kworker/9:2H20:41:1711
20632991514cyclictest0-21swapper/923:10:1711
20632991514cyclictest0-21swapper/922:20:1511
20632991514cyclictest0-21swapper/921:25:2411
20632991514cyclictest0-21swapper/921:25:2411
20632991514cyclictest0-21swapper/920:45:2611
20632991514cyclictest0-21swapper/900:36:4611
20631991513cyclictest7707-21munin-run19:35:0110
20631991513cyclictest23869-21snmp_easybox.os21:25:1310
20631991513cyclictest23869-21snmp_easybox.os21:25:1310
20631991513cyclictest16577-21snmp_easybox.os21:15:1410
20631991513cyclictest15997-21munin-run21:15:0110
2063099154cyclictest0-21swapper/719:15:019
20622991514cyclictest9884-21timerwakeupswit00:00:377
20622991514cyclictest21563-21cstates22:50:167
20622991514cyclictest20352-21qemu-kvm19:13:337
20622991514cyclictest18318-21cpuspeed00:15:157
20622991514cyclictest11163-21cpuspeed_turbos00:05:147
20622991514cyclictest11163-21cpuspeed_turbos00:05:147
20617991514cyclictest15999-21sensors22:40:276
2060499152cyclictest0-21swapper/222:47:094
20604991514cyclictest2406-21snmpd20:32:074
2059399150cyclictest0-21swapper/122:10:291
20592991514cyclictest2443-21lldpd20:27:310
13450150irq/18-ehci_hcd0-21swapper/019:15:010
2063499144cyclictest0-21swapper/1120:25:013
20633991413cyclictest750-1kworker/10:1H20:46:232
20633991413cyclictest750-1kworker/10:1H20:12:402
20633991413cyclictest310422sleep1022:19:402
2063299144cyclictest0-21swapper/919:10:0111
20632991413cyclictest761ksoftirqd/922:50:1611
20632991413cyclictest761ksoftirqd/920:10:0011
20632991413cyclictest761ksoftirqd/919:50:1711
20632991413cyclictest741rcuc/919:48:0811
20632991413cyclictest0-21swapper/923:52:5111
20632991413cyclictest0-21swapper/923:15:1211
20632991413cyclictest0-21swapper/921:50:3411
20632991413cyclictest0-21swapper/921:05:3111
20632991413cyclictest0-21swapper/919:29:2511
20632991413cyclictest0-21swapper/919:15:4811
20632991412cyclictest1243-21munin-run20:55:0111
20631991412cyclictest7381-21df_inode22:30:1710
20631991412cyclictest21757-21perl22:05:2010
20631991412cyclictest12586-21snmp_easybox.os23:20:2610
20631991412cyclictest11331-21snmp_rack3slot922:35:1610
2063099145cyclictest0-21swapper/719:56:029
2063099144cyclictest0-21swapper/723:35:019
2063099144cyclictest0-21swapper/722:55:009
2063099144cyclictest0-21swapper/719:25:029
2063099143cyclictest0-21swapper/720:10:009
2062999142cyclictest0-21swapper/622:12:588
2060499142cyclictest0-21swapper/222:24:524
20604991413cyclictest2406-21snmpd22:12:384
20604991412cyclictest2406-21snmpd21:38:084
2060499140cyclictest0-21swapper/221:50:284
2059399146cyclictest0-21swapper/122:47:411
2059399141cyclictest0-21swapper/100:10:341
2059399140cyclictest0-21swapper/123:00:131
8799130watchdog/110-21swapper/1121:37:393
5999130watchdog/70-21swapper/721:16:319
2499130watchdog/20-21swapper/220:19:594
2063499133cyclictest0-21swapper/1122:39:533
2063499133cyclictest0-21swapper/1122:00:013
2063499133cyclictest0-21swapper/1120:32:223
2063499133cyclictest0-21swapper/1119:54:003
2063499133cyclictest0-21swapper/1100:29:113
2063499133cyclictest0-21swapper/1100:05:013
2063399133cyclictest0-21swapper/1022:51:522
2063399133cyclictest0-21swapper/1020:19:232
20633991312cyclictest0-21swapper/1023:10:162
20633991311cyclictest24982sleep1000:35:302
20633991311cyclictest0-21swapper/1019:21:062
20632991312cyclictest761ksoftirqd/923:35:1811
20632991312cyclictest761ksoftirqd/922:45:0111
20632991312cyclictest761ksoftirqd/922:35:1411
20632991312cyclictest761ksoftirqd/922:15:0111
20632991312cyclictest761ksoftirqd/920:30:0111
20632991312cyclictest6794-21munin-node19:30:3011
20632991312cyclictest0-21swapper/923:45:0111
20632991312cyclictest0-21swapper/922:47:4811
20632991312cyclictest0-21swapper/921:49:3811
20632991312cyclictest0-21swapper/921:04:3111
20632991312cyclictest0-21swapper/919:59:5411
20632991312cyclictest0-21swapper/900:10:0211
2063299131cyclictest761ksoftirqd/922:00:1311
20631991311cyclictest3234-21yum00:35:3810
20631991311cyclictest2526-21irqstats19:25:2110
2063099134cyclictest0-21swapper/723:15:009
2063099133cyclictest0-21swapper/722:30:529
2063099133cyclictest0-21swapper/721:55:019
2063099130cyclictest0-21swapper/723:40:009
2062999135cyclictest20351-21qemu-kvm19:16:218
2062999133cyclictest23639-21qemu-kvm22:47:238
2062999133cyclictest0-21swapper/622:51:588
2062999133cyclictest0-21swapper/622:08:538
2062999132cyclictest0-21swapper/619:29:298
2061099133cyclictest0-21swapper/323:10:205
2060499135cyclictest0-21swapper/223:46:524
2060499135cyclictest0-21swapper/200:25:234
2060499134cyclictest0-21swapper/223:13:314
2060499134cyclictest0-21swapper/220:59:474
2060499133cyclictest0-21swapper/220:49:274
2060499133cyclictest0-21swapper/219:40:194
2060499133cyclictest0-21swapper/219:19:324
2060499131cyclictest0-21swapper/220:37:154
2060499131cyclictest0-21swapper/219:58:054
2059399136cyclictest0-21swapper/123:16:171
2059399136cyclictest0-21swapper/123:08:421
2059399133cyclictest2278-21idleruntime19:25:181
2059399133cyclictest0-21swapper/123:30:221
20593991312cyclictest3066350irq/52-eth0-rx-21:20:301
2059399131cyclictest0-21swapper/122:50:521
2059399131cyclictest0-21swapper/122:40:171
2059399131cyclictest0-21swapper/122:30:181
2059399131cyclictest0-21swapper/122:25:141
2059399131cyclictest0-21swapper/122:20:161
2059399131cyclictest0-21swapper/121:25:141
2059399131cyclictest0-21swapper/121:25:141
2059399131cyclictest0-21swapper/119:35:151
2059399131cyclictest0-21swapper/119:15:201
2059399130cyclictest0-21swapper/123:59:361
2059399130cyclictest0-21swapper/123:20:221
2059399130cyclictest0-21swapper/122:18:591
2059399130cyclictest0-21swapper/121:55:301
2059399130cyclictest0-21swapper/121:31:151
2059399130cyclictest0-21swapper/121:31:151
2059399130cyclictest0-21swapper/120:30:241
2059399130cyclictest0-21swapper/100:31:591
2059399130cyclictest0-21swapper/100:28:201
20592991312cyclictest623-21md0_raid122:27:230
14850130irq/18-uhci_hcd0-21swapper/019:45:260
3066350120irq/52-eth0-rx-0-21swapper/720:50:169
31120ksoftirqd/00-21swapper/023:30:330
2063499123cyclictest0-21swapper/1122:33:083
2063499123cyclictest0-21swapper/1121:15:013
2063499123cyclictest0-21swapper/1100:40:013
2063499122cyclictest0-21swapper/1122:04:363
20634991210cyclictest57702sleep1122:26:523
2063499120cyclictest0-21swapper/1120:08:403
2063399122cyclictest0-21swapper/1023:00:592
2063399122cyclictest0-21swapper/1021:06:472
2063399122cyclictest0-21swapper/1000:21:412
2063399122cyclictest0-21swapper/1000:21:412
20633991211cyclictest31270-1kworker/10:2H19:35:582
20633991211cyclictest31270-1kworker/10:2H19:25:272
20633991211cyclictest19398-1kworker/10:1H00:13:242
20633991211cyclictest0-21swapper/1020:43:162
2063399120cyclictest87132sleep1020:20:012
2063399120cyclictest74032sleep1019:30:572
2063399120cyclictest58272sleep1022:27:402
2063399120cyclictest46712sleep1020:55:542
2063399120cyclictest320182chrt00:31:292
2063399120cyclictest317152sleep1023:47:492
2063399120cyclictest315842sleep1022:20:032
2063399120cyclictest3066350irq/52-eth0-rx-23:25:092
2063399120cyclictest3066350irq/52-eth0-rx-21:35:112
2063399120cyclictest3066350irq/52-eth0-rx-21:00:262
2063399120cyclictest3066350irq/52-eth0-rx-00:25:292
2063399120cyclictest245792sleep1023:39:362
2063399120cyclictest234422chrt22:06:132
2063399120cyclictest225512sleep1020:37:042
2063399120cyclictest187262sleep1000:15:162
2063399120cyclictest166532chrt22:41:292
2063399120cyclictest151932sleep1020:26:032
2063399120cyclictest146262sleep1019:40:332
2063399120cyclictest133792sleep1023:20:452
2063399120cyclictest12250irq/42-ahci21:30:322
2063399120cyclictest12250irq/42-ahci21:30:322
2063399120cyclictest12250irq/42-ahci21:20:012
2063399120cyclictest12250irq/42-ahci20:50:332
2063399120cyclictest12250irq/42-ahci19:17:552
2063399120cyclictest12250irq/42-ahci00:05:062
2063399120cyclictest12250irq/42-ahci00:05:062
2063399120cyclictest101472sleep1022:35:052
20632991211cyclictest29718-21munin-node23:00:2011
20632991211cyclictest0-21swapper/923:24:3911
20632991211cyclictest0-21swapper/922:26:2511
20632991211cyclictest0-21swapper/921:38:3411
20632991211cyclictest0-21swapper/921:20:5011
20632991211cyclictest0-21swapper/920:25:0411
20632991211cyclictest0-21swapper/920:15:2511
20632991211cyclictest0-21swapper/919:36:1411
20632991211cyclictest0-21swapper/900:23:2411
20632991211cyclictest0-21swapper/900:23:2411
20632991211cyclictest0-21swapper/900:17:0711
20632991210cyclictest8144-21taskset22:30:2411
2063099124cyclictest0-21swapper/723:04:089
2063099124cyclictest0-21swapper/721:55:019
2063099123cyclictest0-21swapper/723:45:009
2063099123cyclictest0-21swapper/722:50:009
2063099123cyclictest0-21swapper/720:45:019
2063099122cyclictest0-21swapper/720:16:079
2063099121cyclictest0-21swapper/721:34:329
2063099121cyclictest0-21swapper/721:34:329
2062999124cyclictest23639-21qemu-kvm22:15:188
2062999124cyclictest0-21swapper/622:40:018
2062999122cyclictest0-21swapper/623:36:348
2062999122cyclictest0-21swapper/619:42:368
2062999122cyclictest0-21swapper/600:23:128
2062999122cyclictest0-21swapper/600:23:118
20629991211cyclictest667-21qemu-kvm20:31:418
2061799122cyclictest0-21swapper/420:10:186
2060499124cyclictest0-21swapper/223:32:234
2060499124cyclictest0-21swapper/220:00:514
2060499124cyclictest0-21swapper/200:15:224
2060499123cyclictest0-21swapper/220:09:334
2060499122cyclictest0-21swapper/200:01:534
20604991211cyclictest2406-21snmpd23:53:534
20604991211cyclictest2406-21snmpd20:43:074
2060499121cyclictest0-21swapper/219:11:234
2060499120cyclictest0-21swapper/223:25:264
2060499120cyclictest0-21swapper/222:09:294
2059399127cyclictest0-21swapper/119:45:071
2059399126cyclictest0-21swapper/119:50:131
2059399126cyclictest0-21swapper/100:15:391
2059399126cyclictest0-21swapper/100:06:501
2059399126cyclictest0-21swapper/100:06:501
2059399121cyclictest0-21swapper/123:45:501
2059399121cyclictest0-21swapper/123:40:201
2059399121cyclictest0-21swapper/123:35:131
2059399121cyclictest0-21swapper/123:10:211
2059399121cyclictest0-21swapper/122:55:211
2059399121cyclictest0-21swapper/122:06:411
2059399121cyclictest0-21swapper/121:45:131
2059399121cyclictest0-21swapper/121:40:171
2059399121cyclictest0-21swapper/121:15:171
2059399121cyclictest0-21swapper/121:10:131
2059399121cyclictest0-21swapper/121:05:171
2059399121cyclictest0-21swapper/121:00:251
2059399121cyclictest0-21swapper/120:55:221
2059399121cyclictest0-21swapper/120:50:171
2059399121cyclictest0-21swapper/120:40:161
2059399121cyclictest0-21swapper/120:25:171
2059399121cyclictest0-21swapper/120:20:151
2059399121cyclictest0-21swapper/120:15:141
2059399121cyclictest0-21swapper/120:10:131
2059399121cyclictest0-21swapper/120:05:161
2059399121cyclictest0-21swapper/120:00:361
2059399121cyclictest0-21swapper/119:55:281
2059399121cyclictest0-21swapper/119:40:131
2059399121cyclictest0-21swapper/119:10:131
2059399121cyclictest0-21swapper/100:20:261
2059399121cyclictest0-21swapper/100:20:261
2059399120cyclictest0-21swapper/123:29:421
2059399120cyclictest0-21swapper/122:35:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional