You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 21:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Wed Dec 10, 2025 12:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30663501160irq/52-eth0-rx-0-21swapper/107:08:391
26060211092sleep00-21swapper/007:07:230
25960211097sleep90-21swapper/907:06:0811
26083210793sleep80-21swapper/807:07:4310
26016210793sleep20-21swapper/207:06:494
25957210492sleep60-21swapper/607:06:068
30663501020irq/52-eth0-rx-0-21swapper/407:05:026
12250880irq/42-ahci0-21swapper/707:08:329
12250760irq/42-ahci0-21swapper/307:08:525
3066350750irq/52-eth0-rx-0-21swapper/1007:08:192
2604127263sleep110-21swapper/1107:07:113
2603526859sleep50-21swapper/507:07:057
2645099310cyclictest0-21swapper/1109:28:133
26449993013cyclictest831ksoftirqd/1012:11:422
26418992711cyclictest30131-21munin-node10:10:260
2644999269cyclictest831ksoftirqd/1011:11:482
2644999269cyclictest831ksoftirqd/1009:00:072
2645099256cyclictest0-21swapper/1109:12:323
2645099249cyclictest295912sleep1110:09:543
26418992120cyclictest0-21swapper/007:19:090
2641899210cyclictest0-21swapper/008:20:450
2641899200cyclictest0-21swapper/008:55:280
26450991816cyclictest2441-21chrt07:18:343
26449991817cyclictest831ksoftirqd/1012:15:162
26449991817cyclictest831ksoftirqd/1010:00:202
26449991817cyclictest831ksoftirqd/1008:20:202
26449991817cyclictest23509-21latency08:30:212
26449991817cyclictest23509-21latency08:30:212
26449991817cyclictest0-21swapper/1007:45:102
26449991816cyclictest157222sleep1011:17:492
2644999181cyclictest831ksoftirqd/1012:35:262
2644999181cyclictest831ksoftirqd/1012:35:002
2644999181cyclictest831ksoftirqd/1011:55:222
2644999181cyclictest831ksoftirqd/1011:05:222
2644999181cyclictest831ksoftirqd/1009:25:282
2644999181cyclictest831ksoftirqd/1009:10:132
2644999181cyclictest831ksoftirqd/1007:55:142
2644999181cyclictest831ksoftirqd/1007:40:162
2644999181cyclictest831ksoftirqd/1007:30:202
2644999181cyclictest831ksoftirqd/1007:20:342
2644999181cyclictest831ksoftirqd/1007:15:182
2644999181cyclictest3066350irq/52-eth0-rx-08:00:212
2644899181cyclictest397-1kworker/9:2H10:27:4611
2644899181cyclictest397-1kworker/9:2H10:10:3711
2644899181cyclictest0-21swapper/911:50:0211
2644899181cyclictest0-21swapper/911:15:2011
2644899181cyclictest0-21swapper/910:50:1311
2644899181cyclictest0-21swapper/909:15:2911
2644899181cyclictest0-21swapper/909:05:2111
2644899181cyclictest0-21swapper/908:05:1211
26447991816cyclictest828-21snmp_easybox.os09:30:1210
26447991816cyclictest4904-21df_inode08:50:1410
26447991816cyclictest464-21iostat_ios12:25:1810
26447991816cyclictest31183-21snmp_rack3slot910:10:1710
26447991816cyclictest29782-21snmp_rack3slot910:51:3710
26447991816cyclictest27645-21perl10:05:1910
26447991816cyclictest26320-21df_inode08:35:1310
26447991816cyclictest25133-21yum09:15:4410
26447991816cyclictest20359-21perl09:55:1610
26447991816cyclictest1964-21snmp_rack3slot910:15:1510
26447991816cyclictest19560-21diskstats09:10:1310
26447991816cyclictest18540-21snmp_rack3slot911:20:2510
26447991816cyclictest17268-21memory09:50:2310
26447991816cyclictest14047-21snmp_easybox.os07:35:1310
26447991816cyclictest11951-21snmp_rack3slot911:10:5910
26431991816cyclictest2406-21snmpd07:59:044
26418991816cyclictest30018-21chrt07:15:000
2641899180cyclictest0-21swapper/010:08:450
2641899180cyclictest0-21swapper/009:35:240
26449991716cyclictest831ksoftirqd/1011:45:192
26449991716cyclictest831ksoftirqd/1011:05:012
26449991716cyclictest831ksoftirqd/1011:05:012
26449991716cyclictest831ksoftirqd/1010:40:012
26449991716cyclictest831ksoftirqd/1010:30:002
26449991716cyclictest831ksoftirqd/1009:40:132
26449991716cyclictest831ksoftirqd/1009:30:002
26449991716cyclictest831ksoftirqd/1008:10:142
26449991716cyclictest7629-21snmp_rack3slot907:25:152
26449991716cyclictest16250-21df09:50:142
26449991716cyclictest0-21swapper/1011:20:172
26449991716cyclictest0-21swapper/1008:45:202
2644999170cyclictest831ksoftirqd/1012:05:002
2644999170cyclictest831ksoftirqd/1011:50:142
2644999170cyclictest831ksoftirqd/1011:35:122
2644999170cyclictest831ksoftirqd/1010:50:252
2644999170cyclictest831ksoftirqd/1010:45:232
2644999170cyclictest831ksoftirqd/1010:25:302
2644999170cyclictest831ksoftirqd/1010:20:002
2644999170cyclictest831ksoftirqd/1009:55:142
2644999170cyclictest831ksoftirqd/1009:35:162
2644999170cyclictest831ksoftirqd/1008:50:212
2644999170cyclictest831ksoftirqd/1008:35:282
2644999170cyclictest831ksoftirqd/1008:15:012
2644999170cyclictest831ksoftirqd/1008:15:002
2644999170cyclictest831ksoftirqd/1007:50:152
2644999170cyclictest44392chrt08:05:152
2644999170cyclictest319882sleep1008:41:422
2644999170cyclictest307132sleep1012:23:332
2644999170cyclictest3066350irq/52-eth0-rx-10:10:332
2644999170cyclictest3066350irq/52-eth0-rx-10:05:252
2644999170cyclictest3066350irq/52-eth0-rx-09:20:292
2644999170cyclictest3066350irq/52-eth0-rx-08:57:052
2644999170cyclictest266122sleep1011:32:262
2644999170cyclictest209872chrt08:25:412
2644999170cyclictest19322sleep1012:28:562
2644999170cyclictest188532sleep1010:36:452
2644999170cyclictest169472sleep1007:37:132
2644999170cyclictest140332chrt09:45:262
2644999170cyclictest13562sleep1011:41:282
2644999170cyclictest12250irq/42-ahci12:00:012
2644999170cyclictest12250irq/42-ahci09:08:252
2644999170cyclictest12250irq/42-ahci07:10:422
2644999170cyclictest11222sleep1010:58:472
2644999170cyclictest11222sleep1010:58:462
26448991716cyclictest0-21swapper/912:30:2511
2644899170cyclictest761ksoftirqd/912:15:1511
2644899170cyclictest0-21swapper/910:35:1711
2644899170cyclictest0-21swapper/909:40:1511
2644899170cyclictest0-21swapper/908:22:2911
2644899170cyclictest0-21swapper/907:30:2111
26447991716cyclictest371-21snmp_rack3slot908:45:1510
26447991716cyclictest12162-21perl08:15:1810
26447991716cyclictest12162-21perl08:15:1710
26447991716cyclictest10595-21snmp_rack3slot908:57:1710
26447991715cyclictest8534-21snmp_rack3slot909:40:1310
26447991715cyclictest7109-21irqstats11:05:2110
26447991715cyclictest5918-21snmp_rack3slot909:35:1610
26447991715cyclictest566-21df08:00:1410
26447991715cyclictest5424-21snmp_rack3slot912:30:4910
26447991715cyclictest5226-21snmp_rack3slot910:20:1210
26447991715cyclictest4644-21snmp_rack3slot911:00:4810
26447991715cyclictest4644-21snmp_rack3slot911:00:4810
26447991715cyclictest3992-21diskstats07:20:1510
26447991715cyclictest32421-21snmp_rack3slot907:15:1710
26447991715cyclictest32157-21irqstats10:55:2210
26447991715cyclictest32157-21irqstats10:55:2110
26447991715cyclictest31808-21df_inode11:40:1410
26447991715cyclictest30712-21iostat08:40:2110
26447991715cyclictest29339-21ntp_states11:35:2510
26447991715cyclictest27582-21iostat09:20:1810
26447991715cyclictest23629-21memory08:30:2210
26447991715cyclictest23629-21memory08:30:2110
26447991715cyclictest22031-21irqstats12:10:1910
26447991715cyclictest18385-21iostat_ios12:05:1910
26447991715cyclictest18204-21snmp_easybox.os08:25:1210
26447991715cyclictest14608-21snmp_easybox.os08:20:1310
26447991715cyclictest13146-21snmp_easybox.os12:00:1410
26447991715cyclictest12134-21snmp_rack3slot909:45:1310
26445991716cyclictest26167-21qemu-kvm07:12:438
26444991716cyclictest29463-21qemu-kvm10:13:497
2643699171cyclictest0-21swapper/309:20:195
26431991715cyclictest2406-21snmpd12:12:194
2641899170cyclictest0-21swapper/008:47:310
2641899170cyclictest0-21swapper/007:45:260
26449991615cyclictest0-21swapper/1010:15:172
26449991615cyclictest0-21swapper/1009:15:102
26448991615cyclictest397-1kworker/9:2H09:10:4111
26448991615cyclictest0-21swapper/909:50:2011
26448991615cyclictest0-21swapper/908:11:5011
26448991615cyclictest0-21swapper/908:03:0211
26447991615cyclictest4423-21sensors_fan11:45:2510
26447991615cyclictest20217-21snmp_rack3slot911:25:1310
26447991614cyclictest6930-21snmp_rack3slot907:25:1310
26447991614cyclictest6332-21users08:05:3310
26447991614cyclictest30869-21perl09:25:1310
26447991614cyclictest29762-21snmp_easybox.os12:20:2310
26447991614cyclictest24290-21snmp_rack3slot910:45:1810
26447991614cyclictest23728-21snmp_easybox.os11:30:1110
26447991614cyclictest19482-21memory07:40:2110
26447991614cyclictest18014-21ntp_states10:35:2710
26447991614cyclictest11193-21snmp_rack3slot907:30:1710
2644699165cyclictest0-21swapper/707:25:219
26444991614cyclictest29463-21qemu-kvm10:40:157
2643699160cyclictest0-21swapper/307:10:005
26431991614cyclictest2406-21snmpd11:15:194
26431991614cyclictest2406-21snmpd10:35:194
26431991614cyclictest2406-21snmpd09:46:494
26431991614cyclictest2406-21snmpd08:14:484
2641899165cyclictest0-21swapper/008:10:260
26418991614cyclictest103172sleep007:30:010
2641899160cyclictest0-21swapper/012:30:540
2641899160cyclictest0-21swapper/011:49:540
2641899160cyclictest0-21swapper/011:34:500
2641899160cyclictest0-21swapper/010:51:390
2641899160cyclictest0-21swapper/010:35:390
2641899160cyclictest0-21swapper/010:30:260
2641899160cyclictest0-21swapper/010:18:210
2641899160cyclictest0-21swapper/009:55:040
2641899160cyclictest0-21swapper/008:30:240
2641899160cyclictest0-21swapper/008:30:240
2641899160cyclictest0-21swapper/008:25:260
2645099155cyclictest0-21swapper/1108:40:013
26450991513cyclictest5976-21chrt07:21:233
26449991514cyclictest0-21swapper/1011:25:172
26448991514cyclictest31831-21latency_hist08:00:0111
26448991514cyclictest0-21swapper/910:15:1411
26447991513cyclictest7843-21iostat_ios12:35:2010
26447991513cyclictest31458-21snmp_rack3slot907:56:2510
26447991513cyclictest27779-21snmp_rack3slot907:50:4910
26447991513cyclictest26781-21munin-node12:15:3110
26447991513cyclictest24766-21snmp_rack3slot910:00:2310
2644699156cyclictest0-21swapper/710:40:019
2644699153cyclictest0-21swapper/707:41:329
2641899158cyclictest96892sleep007:27:250
2641899158cyclictest0-21swapper/009:25:250
2641899156cyclictest0-21swapper/010:42:020
2641899156cyclictest0-21swapper/009:40:260
2641899156cyclictest0-21swapper/009:08:300
2641899150cyclictest0-21swapper/012:27:150
2641899150cyclictest0-21swapper/012:17:540
2641899150cyclictest0-21swapper/011:50:400
2641899150cyclictest0-21swapper/011:15:110
2641899150cyclictest0-21swapper/010:58:130
2641899150cyclictest0-21swapper/010:58:120
2641899150cyclictest0-21swapper/010:25:250
2641899150cyclictest0-21swapper/010:00:220
2641899150cyclictest0-21swapper/009:19:250
2641899150cyclictest0-21swapper/008:16:160
2641899150cyclictest0-21swapper/008:16:150
2641899150cyclictest0-21swapper/008:06:590
2641899150cyclictest0-21swapper/008:03:070
2641899150cyclictest0-21swapper/007:59:390
2641899150cyclictest0-21swapper/007:54:220
2641899150cyclictest0-21swapper/007:39:320
2641899150cyclictest0-21swapper/007:24:000
2645099144cyclictest0-21swapper/1110:50:003
26450991413cyclictest673-21jbd2/md1-809:20:433
26450991411cyclictest0-21swapper/1111:17:563
26448991413cyclictest16277-21munin-run12:05:0111
26448991413cyclictest0-21swapper/910:40:0111
26448991413cyclictest0-21swapper/907:15:3511
26447991412cyclictest12833-21snmp_easybox.os11:15:1210
26447991412cyclictest11513-21ntp_states11:55:2510
2644599145cyclictest0-21swapper/611:00:218
2644599145cyclictest0-21swapper/611:00:218
26444991412cyclictest29463-21qemu-kvm10:35:157
2641899148cyclictest0-21swapper/009:50:260
2641899146cyclictest0-21swapper/012:03:380
2641899146cyclictest0-21swapper/011:57:090
2641899146cyclictest0-21swapper/009:45:260
2641899146cyclictest0-21swapper/008:50:260
2641899146cyclictest0-21swapper/007:41:340
2641899141cyclictest0-21swapper/009:20:120
2641899141cyclictest0-21swapper/008:35:140
2641899140cyclictest0-21swapper/012:35:460
2641899140cyclictest0-21swapper/012:22:220
2641899140cyclictest0-21swapper/011:14:430
2641899140cyclictest0-21swapper/011:03:370
2641899140cyclictest0-21swapper/011:03:360
2641899140cyclictest0-21swapper/010:46:410
2641899140cyclictest0-21swapper/009:13:490
2641899140cyclictest0-21swapper/009:00:020
2645099134cyclictest0-21swapper/1111:10:023
2645099134cyclictest0-21swapper/1111:05:013
2645099134cyclictest0-21swapper/1108:05:003
2645099133cyclictest0-21swapper/1112:11:333
2645099133cyclictest0-21swapper/1112:02:333
2645099133cyclictest0-21swapper/1111:56:343
2645099133cyclictest0-21swapper/1111:45:193
2645099133cyclictest0-21swapper/1109:38:363
26450991312cyclictest3066350irq/52-eth0-rx-08:15:163
26450991312cyclictest3066350irq/52-eth0-rx-08:15:163
2645099130cyclictest0-21swapper/1108:08:413
26448991312cyclictest3066450irq/53-eth0-tx-08:50:2211
26448991312cyclictest3066350irq/52-eth0-rx-08:17:0211
26448991312cyclictest3066350irq/52-eth0-rx-08:17:0111
26448991312cyclictest24776-21if_eth110:45:2111
26448991312cyclictest0-21swapper/911:25:1611
26448991312cyclictest0-21swapper/911:20:2111
26448991312cyclictest0-21swapper/911:00:0211
26448991312cyclictest0-21swapper/911:00:0111
2644899130cyclictest0-21swapper/912:35:1611
26447991311cyclictest13602-21snmp_rack3slot910:30:1510
26447991311cyclictest13531-21sensors_volt09:00:2910
2644699134cyclictest0-21swapper/710:55:009
2644699133cyclictest0-21swapper/712:38:539
2644699133cyclictest0-21swapper/711:35:429
2644699133cyclictest0-21swapper/710:50:009
2644699133cyclictest0-21swapper/710:23:339
2644699133cyclictest0-21swapper/709:45:009
2644699133cyclictest0-21swapper/709:30:499
2644699133cyclictest0-21swapper/709:23:489
2644699133cyclictest0-21swapper/708:37:039
2644699133cyclictest0-21swapper/707:59:149
2644699133cyclictest0-21swapper/707:45:019
2644699133cyclictest0-21swapper/707:35:489
2644599133cyclictest0-21swapper/612:32:418
2644599133cyclictest0-21swapper/610:08:488
2644599133cyclictest0-21swapper/609:32:478
2644599133cyclictest0-21swapper/608:31:188
2644599133cyclictest0-21swapper/608:31:188
26444991312cyclictest4823-21python12:30:267
26444991312cyclictest4053-21python11:00:297
26444991312cyclictest4053-21python11:00:287
26444991312cyclictest31593-21fschecks_time07:15:157
26444991312cyclictest17192-21python09:05:257
26444991310cyclictest29463-21qemu-kvm10:08:417
2644399133cyclictest0-21swapper/411:05:186
2643699133cyclictest0-21swapper/311:35:195
2643199133cyclictest0-21swapper/209:30:174
2641899136cyclictest0-21swapper/011:23:460
2641899136cyclictest0-21swapper/008:40:540
2641899130cyclictest18815-21snmp_easybox.os12:05:240
2641899130cyclictest0-21swapper/011:41:410
2641899130cyclictest0-21swapper/011:25:000
2645099126cyclictest12250irq/42-ahci07:55:013
2645099124cyclictest0-21swapper/1112:25:533
2645099123cyclictest0-21swapper/1110:55:003
2645099123cyclictest0-21swapper/1110:55:003
2645099123cyclictest0-21swapper/1109:50:003
2645099123cyclictest0-21swapper/1109:05:013
2645099123cyclictest0-21swapper/1108:59:333
2645099122cyclictest0-21swapper/1111:29:203
2645099122cyclictest0-21swapper/1109:42:423
2645099122cyclictest0-21swapper/1107:46:153
2645099122cyclictest0-21swapper/1107:41:453
26450991211cyclictest298862sleep1107:13:093
2644899123cyclictest0-21swapper/909:35:0111
2644899122cyclictest0-21swapper/907:27:1311
26448991211cyclictest6219-21chrt07:24:4611
26448991211cyclictest26626-21chrt11:32:3711
26448991211cyclictest0-21swapper/912:05:3011
26448991211cyclictest0-21swapper/911:40:1211
26448991211cyclictest0-21swapper/911:10:1911
2644899120cyclictest0-21swapper/911:05:0111
2644899120cyclictest0-21swapper/911:05:0111
2644699124cyclictest0-21swapper/710:15:019
2644699123cyclictest0-21swapper/711:35:019
2644699123cyclictest0-21swapper/710:29:339
2644699123cyclictest0-21swapper/708:20:029
2644699123cyclictest0-21swapper/708:20:019
2644699122cyclictest0-21swapper/710:32:359
2644699122cyclictest0-21swapper/709:56:109
2644699122cyclictest0-21swapper/709:51:119
2644699122cyclictest0-21swapper/709:38:339
2644699122cyclictest0-21swapper/709:17:189
2644699122cyclictest0-21swapper/708:09:339
2644599129cyclictest0-21swapper/609:45:218
2644599124cyclictest2570-21awk07:19:598
2644599123cyclictest0-21swapper/611:05:198
2644599122cyclictest0-21swapper/612:03:368
2644599120cyclictest0-21swapper/610:35:018
2644599120cyclictest0-21swapper/607:25:448
2644399125cyclictest0-21swapper/407:25:216
2644399123cyclictest0-21swapper/410:00:176
26443991210cyclictest20899-21sensors09:10:286
26443991210cyclictest18594-21sensors11:20:256
2643699128cyclictest14951-21latency_hist09:50:015
2643699128cyclictest0-21swapper/312:30:025
2643699128cyclictest0-21swapper/312:25:115
2643699128cyclictest0-21swapper/312:15:155
2643699128cyclictest0-21swapper/312:05:305
2643699128cyclictest0-21swapper/311:50:345
2643699128cyclictest0-21swapper/310:45:265
2643699128cyclictest0-21swapper/310:40:275
2643699128cyclictest0-21swapper/310:36:495
2643699128cyclictest0-21swapper/310:20:235
2643699128cyclictest0-21swapper/309:37:435
2643699128cyclictest0-21swapper/308:55:225
2643699128cyclictest0-21swapper/308:50:175
2643699128cyclictest0-21swapper/308:45:235
2643699128cyclictest0-21swapper/308:30:185
2643699128cyclictest0-21swapper/308:30:185
2643699128cyclictest0-21swapper/307:59:315
2643699128cyclictest0-21swapper/307:35:215
2643699128cyclictest0-21swapper/307:32:505
2643699125cyclictest0-21swapper/308:20:215
2643699122cyclictest0-21swapper/310:30:185
2643699122cyclictest0-21swapper/310:10:155
2643699122cyclictest0-21swapper/307:21:005
2643699122cyclictest0-21swapper/307:15:235
2643699121cyclictest0-21swapper/312:10:195
2643699121cyclictest0-21swapper/308:25:295
26431991210cyclictest2406-21snmpd11:31:204
26431991210cyclictest2406-21snmpd11:23:484
2642499122cyclictest0-21swapper/109:25:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional