You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 10:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sun Dec 07, 2025 00:46:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16371210993sleep80-21swapper/819:06:1210
16396210793sleep20-21swapper/219:06:304
16523210492sleep60-21swapper/619:08:118
16354210290sleep50-21swapper/519:05:577
12250940irq/42-ahci0-21swapper/319:08:285
3066450900irq/53-eth0-tx-0-21swapper/119:05:161
1643128779sleep40-21swapper/419:06:566
12250830irq/42-ahci0-21swapper/719:08:389
129950780irq/18-parport00-21swapper/1119:05:283
1665227674sleep90-21swapper/919:09:1411
1372326858sleep100-21swapper/1019:05:142
1645526654sleep00-21swapper/019:07:160
16811993617cyclictest0-21swapper/022:21:570
1681199330cyclictest0-21swapper/021:11:510
16822992219cyclictest3066350irq/52-eth0-rx-21:11:581
16861991817cyclictest12250irq/42-ahci21:11:563
16861991816cyclictest0-21swapper/1119:21:263
1686199180cyclictest0-21swapper/1119:12:403
16860991817cyclictest25792-1kworker/10:1H22:41:442
16860991817cyclictest25792-1kworker/10:1H22:41:442
16860991816cyclictest25792-1kworker/10:1H20:05:542
1686099181cyclictest3066350irq/52-eth0-rx-23:40:242
1686099181cyclictest3066350irq/52-eth0-rx-22:30:142
1686099181cyclictest3066350irq/52-eth0-rx-21:21:052
1686099181cyclictest3066350irq/52-eth0-rx-20:50:302
1686099181cyclictest3066350irq/52-eth0-rx-19:45:272
1686099181cyclictest3066350irq/52-eth0-rx-19:45:272
1686099181cyclictest235842sleep1022:14:242
1686099181cyclictest161932chrt22:03:452
1686099181cyclictest12250irq/42-ahci22:47:322
1686099181cyclictest12250irq/42-ahci22:47:322
1686099181cyclictest12250irq/42-ahci00:10:552
1685999181cyclictest761ksoftirqd/921:05:3111
1685999181cyclictest761ksoftirqd/921:05:3111
1685999181cyclictest761ksoftirqd/921:00:1411
1685999181cyclictest761ksoftirqd/920:05:0111
1685999181cyclictest0-21swapper/920:29:0211
1685999181cyclictest0-21swapper/900:25:3211
16858991816cyclictest9207-21ntp_states00:05:2410
16858991816cyclictest8935-21diskstats19:40:1610
16858991816cyclictest8645-21yum21:50:3410
16858991816cyclictest6307-21snmp_rack3slot900:00:3710
16858991816cyclictest630-21df_inode23:55:1310
16858991816cyclictest32403-21snmp_rack3slot922:25:1810
16858991816cyclictest31560-21perl20:55:1710
16858991816cyclictest30887-21snmp_rack3slot920:10:1810
16858991816cyclictest27908-21iostat_ios20:05:1910
16858991816cyclictest24178-21snmp_rack3slot923:41:2410
16858991816cyclictest23763-21snmp_rack3slot922:56:1210
16858991816cyclictest21034-21snmp_rack3slot921:25:1510
16858991816cyclictest21010-21snmp_rack3slot919:55:2510
16858991816cyclictest19621-21snmp_rack3slot922:05:5010
16858991816cyclictest17901-21snmp_rack3slot923:35:1410
16858991816cyclictest16249-21memory00:15:2210
16858991816cyclictest15663-21ntp_states22:45:2410
16858991816cyclictest15663-21ntp_states22:45:2410
16858991816cyclictest14004-21diskstats22:00:1610
16858991816cyclictest13246-21snmp_rack3slot923:26:1210
16858991816cyclictest12799-21snmp_rack3slot919:45:1610
16858991816cyclictest12799-21snmp_rack3slot919:45:1610
16858991816cyclictest10826-21snmp_easybox.os00:10:1310
16849991816cyclictest19852-21qemu-kvm22:08:398
1681199182cyclictest0-21swapper/022:29:210
16811991817cyclictest12250irq/42-ahci19:15:290
16811991817cyclictest12250irq/42-ahci19:15:280
1686199170cyclictest0-21swapper/1120:50:263
16860991716cyclictest10797-21smartctl20:25:292
16860991716cyclictest0-21swapper/1000:00:072
1686099170cyclictest97022sleep1023:22:182
1686099170cyclictest91672sleep1022:35:492
1686099170cyclictest91672sleep1022:35:492
1686099170cyclictest84222sleep1021:08:152
1686099170cyclictest84222sleep1021:08:152
1686099170cyclictest831ksoftirqd/1019:55:182
1686099170cyclictest7682sleep1023:10:172
1686099170cyclictest72632sleep1019:36:052
1686099170cyclictest72632sleep1019:36:052
1686099170cyclictest58562sleep1021:50:082
1686099170cyclictest49352sleep1020:20:102
1686099170cyclictest46262sleep1021:01:502
1686099170cyclictest41302sleep1020:16:102
1686099170cyclictest36432sleep1019:31:172
1686099170cyclictest324252sleep1019:27:162
1686099170cyclictest317862chrt00:35:382
1686099170cyclictest313102sleep1023:09:292
1686099170cyclictest3066350irq/52-eth0-rx-23:50:242
1686099170cyclictest3066350irq/52-eth0-rx-22:50:322
1686099170cyclictest3066350irq/52-eth0-rx-22:50:322
1686099170cyclictest3066350irq/52-eth0-rx-22:15:152
1686099170cyclictest3066350irq/52-eth0-rx-22:05:152
1686099170cyclictest3066350irq/52-eth0-rx-21:40:242
1686099170cyclictest3066350irq/52-eth0-rx-21:10:142
1686099170cyclictest3066350irq/52-eth0-rx-20:55:142
1686099170cyclictest3066350irq/52-eth0-rx-19:40:202
1686099170cyclictest3066350irq/52-eth0-rx-19:15:072
1686099170cyclictest3066350irq/52-eth0-rx-19:15:072
1686099170cyclictest305852sleep1022:20:352
1686099170cyclictest282932sleep1000:32:262
1686099170cyclictest277452sleep1023:45:332
1686099170cyclictest26342sleep1023:55:342
1686099170cyclictest258822sleep1021:30:302
1686099170cyclictest249452sleep1020:45:252
1686099170cyclictest246862sleep1000:27:502
1686099170cyclictest245732chrt23:00:042
1686099170cyclictest241442chrt20:00:202
1686099170cyclictest237982chrt22:56:392
1686099170cyclictest228662chrt21:26:172
1686099170cyclictest211562sleep1000:24:132
1686099170cyclictest211242sleep1020:40:252
1686099170cyclictest186612sleep1020:35:352
1686099170cyclictest173152sleep1000:16:242
1686099170cyclictest168622chrt23:30:442
1686099170cyclictest1658350kworker/u24:221:45:102
1686099170cyclictest153552sleep1019:50:072
1686099170cyclictest153552sleep1019:50:072
1686099170cyclictest152102sleep1020:33:242
1686099170cyclictest133342sleep1023:27:192
1686099170cyclictest125412sleep1021:58:572
1686099170cyclictest12250irq/42-ahci23:36:182
1686099170cyclictest12250irq/42-ahci23:15:222
1686099170cyclictest12250irq/42-ahci22:28:092
1686099170cyclictest12250irq/42-ahci21:15:232
1686099170cyclictest12250irq/42-ahci20:10:042
1686099170cyclictest12250irq/42-ahci19:21:432
1686099170cyclictest12250irq/42-ahci19:10:292
1686099170cyclictest102652sleep1000:09:352
16859991715cyclictest16535-21snmp_rack3slot921:20:1211
1685999170cyclictest25952-21cpuspeed19:20:1211
1685999170cyclictest0-21swapper/923:05:0111
1685999170cyclictest0-21swapper/920:50:1711
1685999170cyclictest0-21swapper/920:35:1711
1685899175cyclictest0-21swapper/821:30:0010
16858991715cyclictest9948-21diskstats21:10:1610
16858991715cyclictest9692-21snmp_rack3slot921:55:1110
16858991715cyclictest9684-21snmp_rack3slot923:22:0210
16858991715cyclictest7572-21sensors_fan21:05:2710
16858991715cyclictest7572-21sensors_fan21:05:2710
16858991715cyclictest6766-21snmp_rack3slot922:35:1210
16858991715cyclictest6766-21snmp_rack3slot922:35:1210
16858991715cyclictest6175-21perl20:20:1610
16858991715cyclictest5973-21snmp_rack3slot923:16:0510
16858991715cyclictest572-21perl23:10:1510
16858991715cyclictest5546-21perl19:35:1610
16858991715cyclictest5546-21perl19:35:1510
16858991715cyclictest31797-21snmp_rack3slot900:35:4810
16858991715cyclictest31086-21snmp_rack3slot923:06:2510
16858991715cyclictest3091-21snmp_rack3slot921:45:1510
16858991715cyclictest30595-21snmp_rack3slot919:25:1610
16858991715cyclictest30179-21iostat23:50:1910
16858991715cyclictest30063-21users21:35:3110
16858991715cyclictest29640-21snmp_rack3slot920:51:2710
16858991715cyclictest28572-21df22:20:1410
16858991715cyclictest27519-21snmp_rack3slot923:02:1410
16858991715cyclictest27133-21snmp_rack3slot919:20:1510
16858991715cyclictest26207-21snmp_easybox.os22:15:2510
16858991715cyclictest23865-21perl20:00:1710
16858991715cyclictest23107-21snmp_rack3slot919:15:1810
16858991715cyclictest23107-21snmp_rack3slot919:15:1810
16858991715cyclictest2189-21snmp_rack3slot920:15:1510
16858991715cyclictest20952-21snmp_rack3slot900:21:2610
16858991715cyclictest2076-21hddtemp_smartct19:30:1710
16858991715cyclictest20180-21snmp_rack3slot922:51:5010
16858991715cyclictest20180-21snmp_rack3slot922:51:4910
16858991715cyclictest18272-21snmp_rack3slot919:52:0310
16858991715cyclictest18272-21snmp_rack3slot919:52:0310
16858991715cyclictest18090-21df19:10:1310
16858991715cyclictest16627-21df20:35:1310
16858991715cyclictest15633-21iostat23:30:1810
16858991715cyclictest14227-21snmp_easybox.os20:30:2610
16858991715cyclictest11136-21perl22:40:1610
16858991715cyclictest11136-21perl22:40:1610
16849991716cyclictest29342-21qemu-kvm20:17:108
16849991715cyclictest29343-21qemu-kvm20:47:028
1682299171cyclictest0-21swapper/120:35:251
1681199171cyclictest0-21swapper/023:00:220
1681199170cyclictest0-21swapper/020:08:280
1686199163cyclictest0-21swapper/1122:05:213
1686199162cyclictest0-21swapper/1119:59:503
1686199162cyclictest0-21swapper/1119:30:503
1686199160cyclictest0-21swapper/1123:30:153
1686199160cyclictest0-21swapper/1120:25:273
16859991615cyclictest0-21swapper/921:15:2011
16859991615cyclictest0-21swapper/920:15:2911
16858991614cyclictest3586-21diskstats22:30:1410
16858991614cyclictest32735-21memory21:40:2310
16858991614cyclictest26553-21iostat_ios23:45:1910
16858991614cyclictest2539-21diskstats21:00:1610
16858991614cyclictest24556-21snmp_rack3slot900:26:0410
16858991614cyclictest24311-21perl20:45:1810
16858991614cyclictest17247-21snmp_rack3slot921:20:1410
1685599167cyclictest0-21swapper/720:00:229
16846991615cyclictest25431-21cstates23:45:137
16846991615cyclictest19851-21qemu-kvm22:25:207
1683599163cyclictest0-21swapper/320:15:155
16835991614cyclictest0-21swapper/323:20:165
1682899160cyclictest0-21swapper/222:25:334
1682299161cyclictest0-21swapper/119:20:191
1682299160cyclictest0-21swapper/100:05:231
1681199161cyclictest0-21swapper/000:05:280
1686199158cyclictest0-21swapper/1121:50:163
1686199153cyclictest0-21swapper/1123:29:323
1686199153cyclictest0-21swapper/1122:45:523
1686199153cyclictest0-21swapper/1122:45:513
1686199153cyclictest0-21swapper/1119:15:093
1686199153cyclictest0-21swapper/1119:15:093
1686199152cyclictest0-21swapper/1121:56:583
1686199152cyclictest0-21swapper/1120:09:353
16861991513cyclictest42162chrt20:17:233
16859991514cyclictest9902-21turbostat23:25:0011
16859991514cyclictest0-21swapper/923:57:3811
16859991514cyclictest0-21swapper/923:45:1611
16859991514cyclictest0-21swapper/923:29:1811
16859991514cyclictest0-21swapper/920:21:0711
1685999151cyclictest761ksoftirqd/921:35:1211
1685999151cyclictest761ksoftirqd/919:15:0011
16858991513cyclictest28278-21snmp_rack3slot900:32:1610
1685599157cyclictest12250irq/42-ahci22:00:009
16855991513cyclictest0-21swapper/723:05:019
16846991514cyclictest8411-21qemu-kvm21:08:187
16846991514cyclictest8411-21qemu-kvm21:08:187
16846991514cyclictest32341-21cstates23:10:147
1684699150cyclictest0-21swapper/520:30:247
1684499150cyclictest0-21swapper/423:00:286
1684499150cyclictest0-21swapper/419:35:126
1684499150cyclictest0-21swapper/419:35:126
1684499150cyclictest0-21swapper/419:10:156
1684499150cyclictest0-21swapper/400:10:136
1683599152cyclictest0-21swapper/319:15:335
1683599152cyclictest0-21swapper/319:15:335
16835991513cyclictest0-21swapper/323:55:215
16835991513cyclictest0-21swapper/323:26:475
16835991513cyclictest0-21swapper/321:08:025
16835991513cyclictest0-21swapper/321:08:025
16835991513cyclictest0-21swapper/319:47:505
16835991513cyclictest0-21swapper/319:47:505
16835991513cyclictest0-21swapper/319:38:525
16835991513cyclictest0-21swapper/319:38:525
16835991513cyclictest0-21swapper/300:31:145
16835991513cyclictest0-21swapper/300:10:185
16835991512cyclictest0-21swapper/322:36:125
16835991512cyclictest0-21swapper/322:36:125
1683599151cyclictest0-21swapper/322:55:235
1683599151cyclictest0-21swapper/300:35:165
1683599150cyclictest0-21swapper/323:10:155
1683599150cyclictest0-21swapper/323:05:125
1682899150cyclictest0-21swapper/222:10:194
16822991514cyclictest29511-21python21:35:261
1682299150cyclictest0-21swapper/122:05:011
16811991514cyclictest0-21swapper/021:21:270
1681199150cyclictest0-21swapper/019:35:170
1681199150cyclictest0-21swapper/019:35:170
1686199143cyclictest0-21swapper/1121:24:113
1686199143cyclictest0-21swapper/1120:46:303
1686199142cyclictest0-21swapper/1121:46:363
1686199142cyclictest0-21swapper/1120:35:253
1686199142cyclictest0-21swapper/1100:04:033
1686199141cyclictest0-21swapper/1122:54:103
1686199141cyclictest0-21swapper/1122:54:103
1686199141cyclictest0-21swapper/1121:32:553
1686199141cyclictest0-21swapper/1121:01:153
1686199140cyclictest0-21swapper/1122:55:253
1686199140cyclictest0-21swapper/1120:20:313
1686199140cyclictest0-21swapper/1119:25:083
16859991413cyclictest761ksoftirqd/923:05:1511
16859991413cyclictest761ksoftirqd/919:45:1311
16859991413cyclictest761ksoftirqd/919:45:1311
16859991413cyclictest0-21swapper/923:13:4211
16859991413cyclictest0-21swapper/922:34:4211
16859991413cyclictest0-21swapper/921:45:1511
16859991413cyclictest0-21swapper/919:56:5511
16859991413cyclictest0-21swapper/900:31:4011
16858991412cyclictest20974-21snmp_rack3slot922:10:1610
16858991412cyclictest13940-21perl21:15:1610
1685599144cyclictest0-21swapper/719:45:019
1685599144cyclictest0-21swapper/719:45:019
1685599143cyclictest0-21swapper/721:35:009
1685599143cyclictest0-21swapper/719:10:019
1684999143cyclictest0-21swapper/621:15:018
16846991413cyclictest6326-21cstates21:50:147
1683599143cyclictest0-21swapper/322:20:005
16835991412cyclictest26337-21hwlatdetect23:45:175
16835991412cyclictest0-21swapper/323:38:535
16835991412cyclictest0-21swapper/323:31:495
16835991412cyclictest0-21swapper/322:00:565
16835991412cyclictest0-21swapper/321:57:405
16835991412cyclictest0-21swapper/321:45:535
16835991412cyclictest0-21swapper/321:35:315
16835991412cyclictest0-21swapper/321:25:175
16835991412cyclictest0-21swapper/319:56:545
16835991412cyclictest0-21swapper/319:50:255
16835991412cyclictest0-21swapper/319:50:255
1683599141cyclictest0-21swapper/323:52:385
1683599141cyclictest0-21swapper/323:15:325
1683599141cyclictest0-21swapper/322:25:095
1683599141cyclictest0-21swapper/321:16:135
1683599141cyclictest0-21swapper/321:10:575
1683599141cyclictest0-21swapper/320:55:205
1683599141cyclictest0-21swapper/320:45:145
1683599141cyclictest0-21swapper/320:20:515
1683599141cyclictest0-21swapper/300:25:195
1683599141cyclictest0-21swapper/300:22:195
1683599141cyclictest0-21swapper/300:05:165
1683599140cyclictest0-21swapper/319:30:155
1682899140cyclictest0-21swapper/222:15:144
16811991413cyclictest3066350irq/52-eth0-rx-20:10:340
31130ksoftirqd/00-21swapper/000:30:270
1799130watchdog/10-21swapper/119:40:061
1686199133cyclictest0-21swapper/1123:24:313
1686199133cyclictest0-21swapper/1122:40:523
1686199133cyclictest0-21swapper/1122:40:513
1686199133cyclictest0-21swapper/1120:03:223
1686199133cyclictest0-21swapper/1100:32:343
1686199133cyclictest0-21swapper/1100:29:173
1686199132cyclictest0-21swapper/1123:39:413
1686199132cyclictest0-21swapper/1121:08:273
1686199132cyclictest0-21swapper/1121:08:273
1686199131cyclictest0-21swapper/1123:16:513
1686199131cyclictest0-21swapper/1122:36:003
1686199131cyclictest0-21swapper/1122:36:003
1686199130cyclictest0-21swapper/1120:57:253
1686199130cyclictest0-21swapper/1119:47:393
1686199130cyclictest0-21swapper/1119:47:393
1685999134cyclictest0-21swapper/921:25:2011
16859991312cyclictest0-21swapper/923:52:4311
16859991312cyclictest0-21swapper/923:35:1811
16859991312cyclictest0-21swapper/923:34:5711
1685599133cyclictest0-21swapper/723:50:009
1685599133cyclictest0-21swapper/723:31:079
1685599133cyclictest0-21swapper/723:06:519
1685599133cyclictest0-21swapper/722:57:219
1685599133cyclictest0-21swapper/721:22:059
1685599133cyclictest0-21swapper/721:06:499
1685599133cyclictest0-21swapper/721:06:499
1685599133cyclictest0-21swapper/720:45:509
1685599133cyclictest0-21swapper/700:38:369
16849991312cyclictest19851-21qemu-kvm22:24:518
1684699133cyclictest0-21swapper/523:25:167
1684699133cyclictest0-21swapper/519:15:237
1684699133cyclictest0-21swapper/519:15:237
16846991311cyclictest8411-21qemu-kvm21:47:327
1684499133cyclictest0-21swapper/422:25:206
16844991311cyclictest4927-21sensors22:30:266
1683599132cyclictest0-21swapper/320:50:175
16835991311cyclictest10952-21timerandwakeup20:25:315
16835991311cyclictest0-21swapper/323:40:135
16835991311cyclictest0-21swapper/322:45:205
16835991311cyclictest0-21swapper/322:45:205
16835991311cyclictest0-21swapper/322:20:225
16835991311cyclictest0-21swapper/321:50:255
16835991311cyclictest0-21swapper/321:40:155
16835991311cyclictest0-21swapper/320:05:255
16835991311cyclictest0-21swapper/319:25:535
16835991311cyclictest0-21swapper/300:19:505
16835991311cyclictest0-21swapper/300:00:235
1683599131cyclictest0-21swapper/323:00:095
1683599131cyclictest0-21swapper/322:54:205
1683599131cyclictest0-21swapper/322:54:205
1683599131cyclictest0-21swapper/322:40:225
1683599131cyclictest0-21swapper/322:40:225
1683599131cyclictest0-21swapper/322:31:145
1683599131cyclictest0-21swapper/322:10:245
1683599131cyclictest0-21swapper/322:05:255
1683599131cyclictest0-21swapper/321:32:155
1683599131cyclictest0-21swapper/321:23:095
1683599131cyclictest0-21swapper/321:03:285
1683599131cyclictest0-21swapper/320:40:095
1683599131cyclictest0-21swapper/320:35:065
1683599131cyclictest0-21swapper/320:10:035
1683599131cyclictest0-21swapper/320:01:275
1683599131cyclictest0-21swapper/319:11:395
1682899133cyclictest0-21swapper/219:40:004
1682899133cyclictest0-21swapper/219:40:004
1682899130cyclictest0-21swapper/223:50:294
1682899130cyclictest0-21swapper/223:12:044
1682899130cyclictest0-21swapper/222:55:234
1682899130cyclictest0-21swapper/222:05:254
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional