You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 19:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Mon Dec 08, 2025 12:46:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30664501150irq/53-eth0-tx-0-21swapper/307:05:285
28471210792sleep70-21swapper/707:08:059
122501050irq/42-ahci0-21swapper/107:08:261
30663501040irq/52-eth0-rx-0-21swapper/207:09:494
30664501000irq/53-eth0-tx-0-21swapper/807:09:5010
2837028573sleep00-21swapper/007:06:450
3066350680irq/52-eth0-rx-0-21swapper/407:06:006
3066350670irq/52-eth0-rx-0-21swapper/507:07:447
2853926761sleep90-21swapper/907:08:1811
2838226657sleep100-21swapper/1007:06:552
3066350650irq/52-eth0-rx-0-21swapper/1107:05:233
2548926353sleep60-21swapper/607:05:038
28812994324cyclictest0-21swapper/1109:11:493
28768994227cyclictest0-21swapper/009:12:420
2881299350cyclictest0-21swapper/1109:10:003
2881299330cyclictest0-21swapper/1107:26:373
2881299240cyclictest0-21swapper/1110:27:233
2876899227cyclictest2691-21runrttasks07:15:170
2881299210cyclictest0-21swapper/1107:15:083
2880999192cyclictest831ksoftirqd/1011:40:362
2880899192cyclictest0-21swapper/908:00:1411
2881299180cyclictest0-21swapper/1108:21:193
28809991817cyclictest831ksoftirqd/1011:25:012
28809991817cyclictest831ksoftirqd/1009:50:242
28809991817cyclictest831ksoftirqd/1008:40:112
28809991817cyclictest831ksoftirqd/1008:15:182
28809991817cyclictest0-21swapper/1011:03:292
2880999181cyclictest831ksoftirqd/1012:00:132
2880999181cyclictest831ksoftirqd/1011:45:332
2880999181cyclictest831ksoftirqd/1011:45:332
2880999181cyclictest831ksoftirqd/1011:05:132
2880999181cyclictest831ksoftirqd/1010:55:272
2880999181cyclictest831ksoftirqd/1010:15:012
2880999181cyclictest831ksoftirqd/1010:10:012
2880999181cyclictest831ksoftirqd/1009:55:012
2880999181cyclictest831ksoftirqd/1009:35:132
2880999181cyclictest831ksoftirqd/1009:25:022
2880999181cyclictest831ksoftirqd/1009:00:152
2880999181cyclictest831ksoftirqd/1007:50:322
2880999181cyclictest831ksoftirqd/1007:40:122
2880999181cyclictest831ksoftirqd/1007:15:182
2880999181cyclictest831ksoftirqd/1007:10:332
2880999181cyclictest14850irq/18-uhci_hcd11:10:282
2880999181cyclictest12250irq/42-ahci08:31:482
2880899181cyclictest244182sleep909:58:0111
2880899181cyclictest0-21swapper/912:35:2311
2880899181cyclictest0-21swapper/911:35:3111
2880899181cyclictest0-21swapper/908:45:2811
2880899181cyclictest0-21swapper/908:34:0311
2880899181cyclictest0-21swapper/907:30:1211
28807991816cyclictest9976-21snmp_rack3slot907:25:1610
28807991816cyclictest9513-21munin-run08:55:0110
28807991816cyclictest8619-21df11:05:1410
28807991816cyclictest8106-21snmp_rack3slot909:35:1610
28807991816cyclictest7148-21sensors_fan12:30:2710
28807991816cyclictest4118-21df_inode09:30:1310
28807991816cyclictest3623-21snmp_rack3slot908:45:1710
28807991816cyclictest3368-21snmp_rack3slot910:56:1310
28807991816cyclictest32102-21snmp_rack3slot910:51:2510
28807991816cyclictest31635-21iostat_ios12:20:2310
28807991816cyclictest29719-21snmp_easybox.os11:35:1310
28807991816cyclictest29226-21snmp_rack3slot912:16:0010
28807991816cyclictest26015-21snmp_easybox.os11:30:1310
28807991816cyclictest25607-21snmp_rack3slot912:11:2410
28807991816cyclictest25459-21df09:15:1710
28807991816cyclictest25459-21df09:15:1710
28807991816cyclictest25435-21snmp_rack3slot908:30:1710
28807991816cyclictest20021-21munin-run08:25:0010
28807991816cyclictest18201-21memory07:35:2210
28807991816cyclictest15632-21snmp_rack3slot912:00:1310
28807991816cyclictest13901-21snmp_easybox.os11:55:2610
28807991816cyclictest10999-21snmp_rack3slot911:50:4910
28807991816cyclictest10999-21snmp_rack3slot911:50:4910
28807991816cyclictest10870-21snmp_rack3slot908:10:1310
28807991816cyclictest10031-21snmp_easybox.os08:55:1210
28781991816cyclictest2406-21snmpd11:56:094
28768991816cyclictest32551-21munin-node08:30:130
28809991716cyclictest0-21swapper/1012:31:252
28809991716cyclictest0-21swapper/1010:05:312
28809991716cyclictest0-21swapper/1007:56:102
2880999171cyclictest831ksoftirqd/1008:25:012
2880999170cyclictest96022sleep1008:10:012
2880999170cyclictest91132chrt07:25:092
2880999170cyclictest87042sleep1008:05:362
2880999170cyclictest83382sleep1007:21:312
2880999170cyclictest831ksoftirqd/1011:30:202
2880999170cyclictest831ksoftirqd/1011:20:272
2880999170cyclictest831ksoftirqd/1011:15:282
2880999170cyclictest831ksoftirqd/1010:50:322
2880999170cyclictest831ksoftirqd/1010:40:292
2880999170cyclictest831ksoftirqd/1010:35:272
2880999170cyclictest831ksoftirqd/1009:30:202
2880999170cyclictest831ksoftirqd/1008:55:142
2880999170cyclictest831ksoftirqd/1007:45:292
2880999170cyclictest831ksoftirqd/1007:30:142
2880999170cyclictest73932sleep1010:20:042
2880999170cyclictest42362sleep1012:27:182
2880999170cyclictest316602sleep1011:35:242
2880999170cyclictest3066450irq/53-eth0-tx-09:10:162
2880999170cyclictest3066350irq/52-eth0-rx-12:20:402
2880999170cyclictest3066350irq/52-eth0-rx-11:50:292
2880999170cyclictest3066350irq/52-eth0-rx-11:50:292
2880999170cyclictest292032sleep1008:35:162
2880999170cyclictest283162sleep1009:20:102
2880999170cyclictest270542sleep1009:15:332
2880999170cyclictest270542sleep1009:15:322
2880999170cyclictest263882sleep1012:15:042
2880999170cyclictest256302sleep1012:11:402
2880999170cyclictest255812chrt10:45:072
2880999170cyclictest255672sleep1010:00:142
2880999170cyclictest212732sleep1012:05:282
2880999170cyclictest192852sleep1007:36:572
2880999170cyclictest177722sleep1008:20:142
2880999170cyclictest176712chrt10:33:182
2880999170cyclictest173382sleep1009:05:072
2880999170cyclictest146962sleep1011:56:392
2880999170cyclictest141672sleep1009:45:122
2880999170cyclictest138982sleep1010:26:292
2880999170cyclictest133402sleep1009:40:482
2880999170cyclictest12250irq/42-ahci12:35:052
2880999170cyclictest12250irq/42-ahci08:46:152
2880999170cyclictest12250irq/42-ahci08:00:162
2880899173cyclictest0-21swapper/911:50:2011
2880899173cyclictest0-21swapper/911:50:1911
2880899170cyclictest0-21swapper/912:05:2011
2880899170cyclictest0-21swapper/911:30:0111
2880899170cyclictest0-21swapper/909:10:1611
28807991715cyclictest8736-21snmp_rack3slot908:06:0210
28807991715cyclictest6250-21snmp_rack3slot907:20:1310
28807991715cyclictest6239-21snmp_easybox.os11:00:2710
28807991715cyclictest387-21snmp_easybox.os07:15:0010
28807991715cyclictest29912-21snmp_rack3slot907:10:1310
28807991715cyclictest29445-21snmp_rack3slot909:20:1610
28807991715cyclictest26237-21perl10:00:1610
28807991715cyclictest25237-21snmp_rack3slot911:26:3910
28807991715cyclictest2484-21iostat_ios11:40:2210
28807991715cyclictest24526-21snmp_rack3slot907:45:1310
28807991715cyclictest21909-21yum12:05:3510
28807991715cyclictest21809-21df09:10:1410
28807991715cyclictest20683-21snmp_rack3slot909:51:3710
28807991715cyclictest20184-21snmp_rack3slot909:06:2510
28807991715cyclictest19877-21perl11:20:1510
28807991715cyclictest19182-21diskstats10:35:1710
28807991715cyclictest17893-21snmp_rack3slot911:15:3510
28807991715cyclictest14814-21perl09:00:1810
28807991715cyclictest14375-21snmp_rack3slot911:12:0310
28807991715cyclictest1412-21snmp_rack3slot912:25:1210
28807991715cyclictest1368-21snmp_rack3slot907:56:2810
28807991715cyclictest11893-21snmp_rack3slot909:40:1710
28807991715cyclictest11748-21snmp_rack3slot910:25:1410
28805991716cyclictest31807-21qemu-kvm10:47:318
28805991716cyclictest31807-21qemu-kvm10:40:598
28805991716cyclictest31807-21qemu-kvm10:28:408
28805991715cyclictest31806-21qemu-kvm10:08:258
28801991715cyclictest24168-21python10:40:297
28781991715cyclictest2406-21snmpd11:52:404
28781991715cyclictest2406-21snmpd11:52:394
28781991715cyclictest2406-21snmpd08:01:084
2877299171cyclictest0-21swapper/107:15:181
28768991716cyclictest0-21swapper/009:16:450
28768991716cyclictest0-21swapper/009:16:450
2876899170cyclictest0-21swapper/008:21:240
2881299160cyclictest0-21swapper/1107:30:033
28808991615cyclictest0-21swapper/911:20:2811
28808991615cyclictest0-21swapper/909:00:2611
28808991614cyclictest32215-21taskset07:12:4511
28807991614cyclictest9813-21perl12:35:1710
28807991614cyclictest867-21snmp_rack3slot909:25:1710
28807991614cyclictest8619-21perl10:20:1510
28807991614cyclictest6585-21ntp_states11:45:2610
28807991614cyclictest6585-21ntp_states11:45:2510
28807991614cyclictest5021-21snmp_rack3slot910:15:1810
28807991614cyclictest28994-21perl08:35:1310
28807991614cyclictest27458-21snmp_easybox.os10:45:2610
28807991614cyclictest23535-21snmp_easybox.os09:55:2410
28807991614cyclictest21396-21diskstats08:25:1310
28807991614cyclictest20807-21df07:40:1310
28807991614cyclictest15031-21diskstats09:45:1410
28807991614cyclictest14809-21snmp_easybox.os07:30:2310
28807991614cyclictest1186-21perl10:10:1610
2880599163cyclictest0-21swapper/607:13:368
28805991615cyclictest31807-21qemu-kvm10:31:398
28805991615cyclictest31806-21qemu-kvm10:35:168
28781991614cyclictest2406-21snmpd08:19:434
28772991615cyclictest3066350irq/52-eth0-rx-08:58:441
2881299156cyclictest0-21swapper/1112:08:093
2881299150cyclictest0-21swapper/1110:23:433
2881299150cyclictest0-21swapper/1108:30:183
28809991514cyclictest0-21swapper/1008:50:182
2880899154cyclictest0-21swapper/908:10:0111
28808991514cyclictest17168-1kworker/9:2H09:21:2111
2880899151cyclictest0-21swapper/908:50:1611
28807991513cyclictest28088-21df07:50:1510
2880599152cyclictest0-21swapper/607:31:398
2880599152cyclictest0-21swapper/607:20:078
2880599151cyclictest0-21swapper/608:16:558
28801991514cyclictest9604-21idleruntime11:50:177
28801991514cyclictest9604-21idleruntime11:50:167
28794991513cyclictest22736-21sensors08:25:256
28794991513cyclictest11322-21sensors07:25:286
2878899150cyclictest0-21swapper/311:10:215
2878899150cyclictest0-21swapper/310:33:085
28781991513cyclictest2406-21snmpd09:47:084
28781991513cyclictest2406-21snmpd08:39:384
2881299146cyclictest0-21swapper/1112:04:123
2881299146cyclictest0-21swapper/1111:22:143
2881299146cyclictest0-21swapper/1110:55:413
2881299146cyclictest0-21swapper/1108:58:483
2881299146cyclictest0-21swapper/1108:53:283
2881299143cyclictest0-21swapper/1108:18:553
28812991413cyclictest28317-21chrt09:20:113
2881299140cyclictest0-21swapper/1112:33:353
2881299140cyclictest0-21swapper/1112:28:243
2881299140cyclictest0-21swapper/1112:21:573
2881299140cyclictest0-21swapper/1111:36:153
2881299140cyclictest0-21swapper/1111:06:213
2881299140cyclictest0-21swapper/1110:30:153
2881299140cyclictest0-21swapper/1110:19:323
2881299140cyclictest0-21swapper/1110:10:023
2881299140cyclictest0-21swapper/1110:03:193
2881299140cyclictest0-21swapper/1109:50:213
2881299140cyclictest0-21swapper/1109:45:583
2881299140cyclictest0-21swapper/1109:29:053
2881299140cyclictest0-21swapper/1109:19:493
2881299140cyclictest0-21swapper/1109:19:483
2881299140cyclictest0-21swapper/1108:26:353
2881299140cyclictest0-21swapper/1107:50:173
2881299140cyclictest0-21swapper/1107:23:043
2881299140cyclictest0-21swapper/1107:13:313
2880899144cyclictest0-21swapper/911:05:0111
28808991413cyclictest0-21swapper/912:10:1411
28808991413cyclictest0-21swapper/910:43:0911
28808991413cyclictest0-21swapper/909:30:4211
28808991412cyclictest19723-21chrt08:21:0111
28808991412cyclictest11577-21snmp_rack3slot909:40:1611
28807991412cyclictest5018-21users08:00:3410
28807991412cyclictest32450-21snmp_rack3slot908:40:1510
28807991412cyclictest16716-21ntp_states10:30:2410
2880699144cyclictest0-21swapper/710:50:019
2880599144cyclictest0-21swapper/608:30:018
2880599143cyclictest0-21swapper/608:11:188
2880599141cyclictest0-21swapper/607:44:538
28801991412cyclictest28216-21python11:30:307
28794991412cyclictest15874-21sensors09:00:316
2878899146cyclictest0-21swapper/308:53:395
2878899140cyclictest0-21swapper/308:59:355
2878899140cyclictest0-21swapper/308:30:115
2878899140cyclictest0-21swapper/308:22:465
2878899140cyclictest0-21swapper/307:18:365
2878199140cyclictest0-21swapper/209:10:134
2877299140cyclictest0-21swapper/111:15:101
14850140irq/18-uhci_hcd0-21swapper/010:55:250
2881299136cyclictest0-21swapper/1111:45:593
2881299136cyclictest0-21swapper/1111:45:593
2881299136cyclictest0-21swapper/1111:30:163
2881299136cyclictest0-21swapper/1108:04:443
2881299136cyclictest0-21swapper/1107:46:023
2881299136cyclictest0-21swapper/1107:35:423
2881299133cyclictest0-21swapper/1109:32:123
2881299132cyclictest0-21swapper/1111:53:463
2881299132cyclictest0-21swapper/1111:53:453
2881299131cyclictest0-21swapper/1111:25:193
2881299130cyclictest0-21swapper/1112:11:173
2881299130cyclictest0-21swapper/1110:54:093
2881299130cyclictest0-21swapper/1109:43:193
2881299130cyclictest0-21swapper/1108:46:003
2881299130cyclictest0-21swapper/1108:14:563
2880899134cyclictest0-21swapper/910:10:0111
2880899134cyclictest0-21swapper/909:00:0111
2880899133cyclictest0-21swapper/910:24:5911
2880899133cyclictest0-21swapper/909:15:0211
2880899133cyclictest0-21swapper/909:15:0111
28808991312cyclictest0-21swapper/912:00:1511
28808991312cyclictest0-21swapper/909:52:3611
28808991312cyclictest0-21swapper/907:25:2811
28808991311cyclictest19517-21munin-run07:39:5911
28807991311cyclictest31579-21snmp_rack3slot910:05:5110
2880599133cyclictest0-21swapper/612:35:398
2880599133cyclictest0-21swapper/611:24:388
2880599133cyclictest0-21swapper/609:54:088
2880599133cyclictest0-21swapper/608:51:088
2880599133cyclictest0-21swapper/608:04:108
2880599133cyclictest0-21swapper/607:15:078
2880599132cyclictest0-21swapper/611:00:098
2880199133cyclictest0-21swapper/510:00:197
28801991312cyclictest4957-21python08:45:287
2879499133cyclictest0-21swapper/410:55:186
2879499133cyclictest0-21swapper/410:05:196
2878899136cyclictest0-21swapper/311:09:365
2878899136cyclictest0-21swapper/310:52:475
2878899136cyclictest0-21swapper/308:38:275
2878899135cyclictest0-21swapper/311:18:465
2878899135cyclictest0-21swapper/309:14:575
2878899135cyclictest0-21swapper/308:25:335
2878899134cyclictest0-21swapper/310:55:085
2878899131cyclictest0-21swapper/310:25:145
2878899131cyclictest0-21swapper/308:15:105
2878899131cyclictest0-21swapper/308:07:155
2878899131cyclictest0-21swapper/307:45:125
2878899130cyclictest0-21swapper/312:18:375
2878899130cyclictest0-21swapper/311:41:015
2878899130cyclictest0-21swapper/311:32:385
2878899130cyclictest0-21swapper/311:20:195
2878899130cyclictest0-21swapper/311:00:085
2878899130cyclictest0-21swapper/310:23:095
2878899130cyclictest0-21swapper/310:13:155
2878899130cyclictest0-21swapper/310:02:085
2878899130cyclictest0-21swapper/309:57:285
2878899130cyclictest0-21swapper/309:45:455
2878899130cyclictest0-21swapper/309:43:075
2878899130cyclictest0-21swapper/309:36:315
2878899130cyclictest0-21swapper/309:34:405
2878899130cyclictest0-21swapper/309:24:365
2878899130cyclictest0-21swapper/308:47:135
2878899130cyclictest0-21swapper/308:43:035
2878899130cyclictest0-21swapper/308:13:405
2878899130cyclictest0-21swapper/308:03:075
2878899130cyclictest0-21swapper/307:54:455
2878899130cyclictest0-21swapper/307:30:235
2878899130cyclictest0-21swapper/307:21:255
2878899130cyclictest0-21swapper/307:11:315
28781991311cyclictest2406-21snmpd07:27:074
2877299133cyclictest0-21swapper/110:49:591
2877299133cyclictest0-21swapper/109:00:211
2877299133cyclictest0-21swapper/108:40:181
2877299130cyclictest0-21swapper/110:30:261
2876899134cyclictest0-21swapper/008:10:260
28768991312cyclictest2443-21lldpd10:22:130
31120ksoftirqd/00-21swapper/011:00:290
31120ksoftirqd/00-21swapper/010:05:280
31120ksoftirqd/00-21swapper/007:25:280
2881299123cyclictest0-21swapper/1109:35:413
2881299123cyclictest0-21swapper/1108:41:113
2881299123cyclictest0-21swapper/1108:35:543
2881299123cyclictest0-21swapper/1107:58:543
2881299122cyclictest0-21swapper/1112:37:553
2881299121cyclictest0-21swapper/1112:16:313
2881299121cyclictest0-21swapper/1111:40:223
2881299121cyclictest0-21swapper/1111:14:073
2881299121cyclictest0-21swapper/1110:45:253
2881299121cyclictest0-21swapper/1110:05:223
2881299120cyclictest0-21swapper/1110:43:223
2881299120cyclictest0-21swapper/1109:55:133
2881299120cyclictest0-21swapper/1108:06:323
2880899123cyclictest0-21swapper/910:35:0111
2880899123cyclictest0-21swapper/910:25:0111
2880899123cyclictest0-21swapper/908:00:0111
2880899122cyclictest31153-21perl12:20:1911
28808991211cyclictest17168-1kworker/9:2H07:49:2411
28808991211cyclictest0-21swapper/912:25:2411
28808991210cyclictest7432-21taskset11:46:4011
28808991210cyclictest7432-21taskset11:46:4011
28808991210cyclictest6555-21chrt10:15:3911
2880699123cyclictest0-21swapper/707:45:009
2880699123cyclictest0-21swapper/707:10:019
2880699122cyclictest0-21swapper/707:25:539
2880699121cyclictest0-21swapper/712:05:019
2880599123cyclictest0-21swapper/608:09:498
2880599122cyclictest0-21swapper/612:09:088
2880599122cyclictest0-21swapper/611:58:248
2880599122cyclictest0-21swapper/608:31:108
28805991211cyclictest31807-21qemu-kvm10:12:158
2880199122cyclictest0-21swapper/512:05:217
28801991211cyclictest5399-21latency_hist08:05:017
2879499124cyclictest0-21swapper/411:35:016
2879499122cyclictest0-21swapper/412:30:206
2879499122cyclictest0-21swapper/411:20:176
2878899127cyclictest0-21swapper/310:06:035
2878899126cyclictest0-21swapper/312:07:005
2878899125cyclictest0-21swapper/312:32:485
2878899125cyclictest0-21swapper/307:25:405
2878899124cyclictest0-21swapper/312:12:315
2878899124cyclictest0-21swapper/311:55:435
2878899122cyclictest0-21swapper/309:25:185
2878899121cyclictest0-21swapper/312:20:285
2878899121cyclictest0-21swapper/311:50:305
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional