You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 14:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Tue Dec 09, 2025 12:46:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122501130irq/42-ahci0-21swapper/107:09:221
22099210994sleep50-21swapper/507:06:587
22020210894sleep40-21swapper/407:05:576
22070210793sleep80-21swapper/807:06:3710
122501050irq/42-ahci0-21swapper/307:09:295
22135210190sleep100-21swapper/1007:07:272
3066450940irq/53-eth0-tx-0-21swapper/907:08:2611
12250920irq/42-ahci0-21swapper/207:08:214
3066350880irq/52-eth0-rx-0-21swapper/1107:05:063
2213828168sleep00-21swapper/007:07:280
3066350770irq/52-eth0-rx-0-21swapper/707:05:519
2199225955sleep60-21swapper/607:05:348
2252599500cyclictest0-21swapper/1107:10:243
22525992726cyclictest0-21swapper/1108:25:253
182050230irq/55-eth1-rx-0-21swapper/007:11:540
22525992120cyclictest32491-1kworker/11:2H09:17:273
2252599210cyclictest0-21swapper/1107:15:513
2252599190cyclictest0-21swapper/1110:08:423
2252399191cyclictest831ksoftirqd/1011:10:112
22523991817cyclictest831ksoftirqd/1007:40:262
22523991817cyclictest0-21swapper/1010:31:572
2252399181cyclictest831ksoftirqd/1011:45:142
2252399181cyclictest831ksoftirqd/1009:15:142
2252399181cyclictest831ksoftirqd/1008:00:272
2252399181cyclictest12250irq/42-ahci10:08:562
2252399181cyclictest12250irq/42-ahci09:40:012
2252399181cyclictest12250irq/42-ahci08:47:292
2252399181cyclictest12250irq/42-ahci07:14:462
2252399180cyclictest12250irq/42-ahci12:37:512
2252399180cyclictest12250irq/42-ahci12:37:512
22516991816cyclictest4193-21df_inode08:10:1511
22516991816cyclictest3968-21taskset10:21:0811
2251699181cyclictest0-21swapper/912:05:1311
2251699181cyclictest0-21swapper/909:05:1711
2251699180cyclictest0-21swapper/907:12:3411
22515991816cyclictest9296-21snmp_rack3slot911:15:1510
22515991816cyclictest7336-21df_inode07:30:1410
22515991816cyclictest7035-21snmp_easybox.os08:15:1110
22515991816cyclictest4076-21snmp_easybox.os11:50:2610
22515991816cyclictest27932-21snmp_easybox.os07:15:1510
22515991816cyclictest27544-21snmp_rack3slot907:56:3710
22515991816cyclictest2751-21snmp_easybox.os09:35:2310
22515991816cyclictest25763-21snmp_easybox.os09:25:1210
22515991816cyclictest22995-21snmp_easybox.os10:50:1310
22515991816cyclictest20516-21perl10:45:1510
22515991816cyclictest10624-21snmp_easybox.os08:20:1210
22515991816cyclictest10121-21snmp_easybox.os07:35:1310
22515991816cyclictest10121-21snmp_easybox.os07:35:1210
22492991816cyclictest2406-21snmpd08:16:474
22523991716cyclictest831ksoftirqd/1012:05:102
22523991716cyclictest0-21swapper/1011:25:282
2252399170cyclictest94022sleep1007:32:282
2252399170cyclictest91972sleep1012:00:112
2252399170cyclictest84372sleep1011:56:482
2252399170cyclictest831ksoftirqd/1012:10:012
2252399170cyclictest831ksoftirqd/1011:37:042
2252399170cyclictest831ksoftirqd/1011:20:202
2252399170cyclictest831ksoftirqd/1010:55:152
2252399170cyclictest831ksoftirqd/1009:40:222
2252399170cyclictest831ksoftirqd/1008:50:142
2252399170cyclictest831ksoftirqd/1008:40:262
2252399170cyclictest831ksoftirqd/1008:35:012
2252399170cyclictest831ksoftirqd/1007:35:142
2252399170cyclictest831ksoftirqd/1007:35:142
2252399170cyclictest65862sleep1008:56:142
2252399170cyclictest56432sleep1007:25:532
2252399170cyclictest56432sleep1007:25:522
2252399170cyclictest49382sleep1011:53:342
2252399170cyclictest4162sleep1010:19:012
2252399170cyclictest322442sleep1009:32:062
2252399170cyclictest315352sleep1007:20:042
2252399170cyclictest3066350irq/52-eth0-rx-11:06:102
2252399170cyclictest3066350irq/52-eth0-rx-11:00:222
2252399170cyclictest3066350irq/52-eth0-rx-10:40:182
2252399170cyclictest3066350irq/52-eth0-rx-10:20:132
2252399170cyclictest3066350irq/52-eth0-rx-10:10:202
2252399170cyclictest3066350irq/52-eth0-rx-09:00:372
2252399170cyclictest3066350irq/52-eth0-rx-07:50:232
2252399170cyclictest3066350irq/52-eth0-rx-07:45:132
2252399170cyclictest298282sleep1011:40:572
2252399170cyclictest275202sleep1007:56:192
2252399170cyclictest266992sleep1007:15:022
2252399170cyclictest265632sleep1012:20:392
2252399170cyclictest25012sleep1008:07:092
2252399170cyclictest233642sleep1009:20:162
2252399170cyclictest226252sleep1011:31:432
2252399170cyclictest221302sleep1010:45:502
2252399170cyclictest209812sleep1008:34:352
2252399170cyclictest182312sleep1009:58:562
2252399170cyclictest176252sleep1009:11:292
2252399170cyclictest170532sleep1008:25:362
2252399170cyclictest145142sleep1009:52:572
2252399170cyclictest141052sleep1009:08:152
2252399170cyclictest13822sleep1012:30:372
2252399170cyclictest134702sleep1008:21:232
2252399170cyclictest12250irq/42-ahci12:25:022
2252399170cyclictest12250irq/42-ahci12:25:012
2252399170cyclictest12250irq/42-ahci12:15:012
2252399170cyclictest12250irq/42-ahci12:15:002
2252399170cyclictest12250irq/42-ahci10:35:452
2252399170cyclictest12250irq/42-ahci09:45:442
2252399170cyclictest12250irq/42-ahci08:15:112
2252399170cyclictest116952sleep1011:16:292
2251699172cyclictest0-21swapper/909:40:1111
22516991715cyclictest4410-21chrt11:06:1611
22516991715cyclictest25887-21taskset10:52:0611
22516991715cyclictest21222-21taskset09:15:5511
2251699170cyclictest0-21swapper/910:50:0011
2251699170cyclictest0-21swapper/909:20:1211
22515991715cyclictest967-21yum11:45:3110
22515991715cyclictest9196-21snmp_rack3slot909:45:1910
22515991715cyclictest8443-21snmp_rack3slot911:56:5010
22515991715cyclictest31196-21snmp_rack3slot908:01:1510
22515991715cyclictest31054-21snmp_easybox.os12:30:1210
22515991715cyclictest30853-21snmp_rack3slot910:15:1410
22515991715cyclictest29816-21snmp_rack3slot909:30:1510
22515991715cyclictest29398-21yum10:55:3310
22515991715cyclictest2818-21snmp_rack3slot907:25:1510
22515991715cyclictest2818-21snmp_rack3slot907:25:1410
22515991715cyclictest27069-21snmp_rack3slot910:10:1710
22515991715cyclictest26608-21snmp_rack3slot912:21:1210
22515991715cyclictest24546-21snmp_rack3slot910:05:2510
22515991715cyclictest23160-21snmp_rack3slot907:10:1210
22515991715cyclictest1823-21df10:20:1410
22515991715cyclictest14886-21snmp_rack3slot912:05:2310
22515991715cyclictest14365-21snmp_rack3slot909:50:5910
22515991715cyclictest13207-21snmp_rack3slot909:05:2410
22515991715cyclictest10549-21munin-run09:04:5910
2251499174cyclictest0-21swapper/707:40:019
2251499174cyclictest0-21swapper/707:40:009
2251099170cyclictest0-21swapper/511:25:247
1699170watchdog/00-21swapper/007:26:030
1699170watchdog/00-21swapper/007:26:020
22523991615cyclictest31750-1kworker/10:1H10:00:472
22523991615cyclictest31750-1kworker/10:1H10:00:472
22523991615cyclictest25446-21timerandwakeup10:50:302
2251699162cyclictest0-21swapper/912:35:2511
2251699162cyclictest0-21swapper/912:35:2511
22516991615cyclictest0-21swapper/911:50:2711
22516991615cyclictest0-21swapper/911:44:0411
22516991615cyclictest0-21swapper/909:50:5511
22516991615cyclictest0-21swapper/908:20:0111
22515991614cyclictest7048-21yum09:40:3410
22515991614cyclictest5633-21diskstats10:25:1610
22515991614cyclictest3663-21hddtemp_smartct12:35:1510
22515991614cyclictest3663-21hddtemp_smartct12:35:1410
22515991614cyclictest27474-21snmp_easybox.os12:25:1310
22515991614cyclictest27474-21snmp_easybox.os12:25:1210
22515991614cyclictest23394-21snmp_easybox.os11:35:1210
22515991614cyclictest21330-21iostat_ios11:30:1910
22515991614cyclictest18299-21memory12:10:2810
22515991614cyclictest17447-21snmp_easybox.os07:45:1210
22515991614cyclictest16388-21irqstats09:10:2010
22515991614cyclictest16297-21snmp_rack3slot911:25:1310
22510991615cyclictest25536-21qemu-kvm10:16:467
22510991615cyclictest11414-21gltestperf07:35:177
22510991615cyclictest11414-21gltestperf07:35:167
2251099161cyclictest2635-21qemu-kvm08:08:277
2248399160cyclictest0-21swapper/110:50:191
2248399160cyclictest0-21swapper/109:00:001
2247699160cyclictest0-21swapper/009:45:280
2252599158cyclictest12250irq/42-ahci12:15:003
22525991513cyclictest42312chrt10:24:493
2251699155cyclictest0-21swapper/909:10:0211
2251699154cyclictest0-21swapper/909:45:0211
2251699154cyclictest0-21swapper/909:25:0011
2251699154cyclictest0-21swapper/907:20:0111
2251699152cyclictest0-21swapper/911:00:2211
22516991513cyclictest456-21taskset10:19:3311
22515991513cyclictest32176-21snmp_rack3slot908:05:1310
22515991513cyclictest30331-21snmp_easybox.os11:00:1410
22515991513cyclictest23866-21memory09:20:2210
22515991513cyclictest23206-21snmp_easybox.os07:50:2310
2251499154cyclictest0-21swapper/710:45:009
2251499154cyclictest0-21swapper/709:15:019
2251099150cyclictest0-21swapper/509:00:487
2251099150cyclictest0-21swapper/507:15:017
2251099150cyclictest0-21swapper/507:12:177
22504991513cyclictest13739-21sensors09:50:276
22497991513cyclictest2406-21snmpd10:03:325
22497991513cyclictest2406-21snmpd10:03:315
2249799150cyclictest0-21swapper/310:15:115
2249299152cyclictest0-21swapper/207:56:414
22492991514cyclictest2406-21snmpd10:08:034
22492991513cyclictest2406-21snmpd11:18:334
22483991514cyclictest3066350irq/52-eth0-rx-07:26:271
22483991514cyclictest3066350irq/52-eth0-rx-07:26:271
2248399150cyclictest0-21swapper/111:35:151
2248399150cyclictest0-21swapper/111:25:231
2248399150cyclictest0-21swapper/110:55:141
2248399150cyclictest0-21swapper/110:05:291
2248399150cyclictest0-21swapper/109:50:161
2248399150cyclictest0-21swapper/109:30:561
2248399150cyclictest0-21swapper/108:55:341
2248399150cyclictest0-21swapper/108:10:141
2248399150cyclictest0-21swapper/107:35:011
22476991511cyclictest0-21swapper/009:15:270
22525991413cyclictest12250irq/42-ahci09:09:103
2251699144cyclictest0-21swapper/910:28:1811
2251699143cyclictest0-21swapper/910:15:0211
22516991413cyclictest0-21swapper/908:00:1711
22516991413cyclictest0-21swapper/907:50:2311
22515991412cyclictest6655-21snmp_rack3slot908:57:0510
22515991412cyclictest6313-21perl11:10:1310
22515991412cyclictest4640-21snmp_rack3slot908:10:1610
22515991412cyclictest29596-21df08:45:1410
22515991412cyclictest18413-21snmp_rack3slot909:15:1110
2251499145cyclictest0-21swapper/709:14:589
2251499144cyclictest0-21swapper/712:00:019
2251499144cyclictest0-21swapper/711:00:009
2251499144cyclictest0-21swapper/708:40:009
22510991413cyclictest25147-21cstates07:55:147
2251099141cyclictest25536-21qemu-kvm10:20:137
2250499144cyclictest0-21swapper/411:55:226
2250499143cyclictest0-21swapper/411:25:246
2250499143cyclictest0-21swapper/409:04:336
22504991411cyclictest0-21swapper/410:06:506
2250499140cyclictest0-21swapper/410:39:546
2248399140cyclictest18175-21ppmdither09:58:121
2248399140cyclictest0-21swapper/112:35:401
2248399140cyclictest0-21swapper/112:35:391
2248399140cyclictest0-21swapper/112:21:201
2248399140cyclictest0-21swapper/112:00:081
2248399140cyclictest0-21swapper/111:46:021
2248399140cyclictest0-21swapper/111:41:341
2248399140cyclictest0-21swapper/111:30:191
2248399140cyclictest0-21swapper/111:03:321
2248399140cyclictest0-21swapper/110:41:001
2248399140cyclictest0-21swapper/110:39:541
2248399140cyclictest0-21swapper/110:30:021
2248399140cyclictest0-21swapper/110:15:381
2248399140cyclictest0-21swapper/110:12:481
2248399140cyclictest0-21swapper/110:01:141
2248399140cyclictest0-21swapper/110:01:131
2248399140cyclictest0-21swapper/109:47:051
2248399140cyclictest0-21swapper/109:40:321
2248399140cyclictest0-21swapper/109:35:201
2248399140cyclictest0-21swapper/109:27:291
2248399140cyclictest0-21swapper/109:21:471
2248399140cyclictest0-21swapper/109:07:041
2248399140cyclictest0-21swapper/108:45:231
2248399140cyclictest0-21swapper/108:40:111
2248399140cyclictest0-21swapper/108:35:301
2248399140cyclictest0-21swapper/108:30:111
2248399140cyclictest0-21swapper/108:25:251
2248399140cyclictest0-21swapper/108:22:221
2248399140cyclictest0-21swapper/108:15:011
2248399140cyclictest0-21swapper/108:08:541
2248399140cyclictest0-21swapper/108:00:041
2248399140cyclictest0-21swapper/107:56:511
2248399140cyclictest0-21swapper/107:47:251
2248399140cyclictest0-21swapper/107:10:211
2247699140cyclictest0-21swapper/009:30:280
2247699140cyclictest0-21swapper/009:25:260
2247699140cyclictest0-21swapper/007:15:140
2252599134cyclictest0-21swapper/1111:24:593
2252599133cyclictest0-21swapper/1110:38:323
2252599133cyclictest0-21swapper/1109:35:013
2251699134cyclictest0-21swapper/912:20:0211
2251699133cyclictest0-21swapper/908:40:4711
22516991312cyclictest0-21swapper/911:20:1611
22516991312cyclictest0-21swapper/907:40:0111
2251599133cyclictest0-21swapper/807:20:2410
22515991311cyclictest8475-21snmp_easybox.os10:30:1010
22515991311cyclictest29835-21snmp_rack3slot911:41:0210
22515991311cyclictest2934-21snmp_rack3slot908:51:0210
22515991311cyclictest27193-21snmp_easybox.os08:40:2310
22515991311cyclictest16773-21iostat09:55:1910
22515991311cyclictest12913-21diskstats10:35:1710
22515991311cyclictest12542-21snmp_easybox.os11:20:1410
2251499134cyclictest0-21swapper/710:30:019
2251499134cyclictest0-21swapper/708:50:019
2251499134cyclictest0-21swapper/708:20:029
2251499133cyclictest0-21swapper/712:31:039
2251499133cyclictest0-21swapper/710:45:019
2251499133cyclictest0-21swapper/709:55:019
22510991312cyclictest9309-21cstates11:15:147
22510991312cyclictest6969-21idleruntime11:55:187
2251099131cyclictest2635-21qemu-kvm08:37:397
2251099131cyclictest25536-21qemu-kvm10:30:137
2251099130cyclictest0-21swapper/507:31:377
2250499139cyclictest0-21swapper/408:30:116
2250499132cyclictest0-21swapper/410:15:396
2250499132cyclictest0-21swapper/409:35:126
2250499131cyclictest0-21swapper/410:50:196
2250499130cyclictest0-21swapper/412:35:406
2250499130cyclictest0-21swapper/412:35:396
2250499130cyclictest0-21swapper/412:29:056
2250499130cyclictest0-21swapper/412:29:046
2250499130cyclictest0-21swapper/412:20:026
2250499130cyclictest0-21swapper/411:46:026
2250499130cyclictest0-21swapper/409:25:076
2250499130cyclictest0-21swapper/408:55:346
2250499130cyclictest0-21swapper/408:25:006
2250499130cyclictest0-21swapper/408:00:046
2250499130cyclictest0-21swapper/407:10:046
2249299134cyclictest0-21swapper/209:35:204
2249299134cyclictest0-21swapper/207:32:284
22492991312cyclictest2406-21snmpd08:11:314
2248399130cyclictest0-21swapper/112:32:361
2248399130cyclictest0-21swapper/112:16:371
2248399130cyclictest0-21swapper/112:16:371
2248399130cyclictest0-21swapper/112:11:281
2248399130cyclictest0-21swapper/112:07:011
2248399130cyclictest0-21swapper/111:55:411
2248399130cyclictest0-21swapper/111:51:141
2248399130cyclictest0-21swapper/111:20:201
2248399130cyclictest0-21swapper/111:18:261
2248399130cyclictest0-21swapper/111:06:401
2248399130cyclictest0-21swapper/110:47:111
2248399130cyclictest0-21swapper/110:28:051
2248399130cyclictest0-21swapper/110:20:551
2248399130cyclictest0-21swapper/109:15:081
2248399130cyclictest0-21swapper/109:14:471
2248399130cyclictest0-21swapper/108:50:581
2248399130cyclictest0-21swapper/107:52:211
2248399130cyclictest0-21swapper/107:40:161
2248399130cyclictest0-21swapper/107:18:561
2247699130cyclictest0-21swapper/007:55:300
31120ksoftirqd/00-21swapper/009:50:260
2499120watchdog/231196-21snmp_rack3slot908:01:154
2252599124cyclictest0-21swapper/1109:44:023
2252599124cyclictest0-21swapper/1108:35:003
2252599123cyclictest0-21swapper/1112:25:023
2252599123cyclictest0-21swapper/1112:25:023
2252599123cyclictest0-21swapper/1109:30:003
2252599122cyclictest0-21swapper/1111:00:323
2252599122cyclictest0-21swapper/1107:32:013
22525991211cyclictest623-21md0_raid108:18:003
22525991210cyclictest24873-21chrt09:20:543
2252399122cyclictest0-21swapper/1009:26:162
2251699123cyclictest0-21swapper/907:46:3111
2251699122cyclictest0-21swapper/909:37:1711
2251699122cyclictest0-21swapper/908:33:1611
2251699122cyclictest0-21swapper/908:27:4711
2251699122cyclictest0-21swapper/907:28:4711
2251699122cyclictest0-21swapper/907:28:4611
22516991211cyclictest0-21swapper/912:25:2011
22516991211cyclictest0-21swapper/912:25:1911
2251699120cyclictest0-21swapper/910:39:5711
2251599125cyclictest0-21swapper/810:40:1810
22515991210cyclictest22989-21snmp_rack3slot912:16:2410
22515991210cyclictest22989-21snmp_rack3slot912:16:2410
22515991210cyclictest21901-21snmp_rack3slot908:35:1210
22515991210cyclictest21742-21snmp_rack3slot910:01:4910
22515991210cyclictest21742-21snmp_rack3slot910:01:4810
22515991210cyclictest15478-21snmp_rack3slot908:25:1310
22515991210cyclictest14918-21perl07:40:1610
2251499125cyclictest0-21swapper/709:23:199
2251499124cyclictest0-21swapper/711:20:019
2251499123cyclictest0-21swapper/711:05:019
2251499123cyclictest0-21swapper/709:35:009
2251499122cyclictest0-21swapper/711:10:179
2251499122cyclictest0-21swapper/710:05:189
2251499122cyclictest0-21swapper/708:01:559
22514991210cyclictest0-21swapper/711:09:559
2251499120cyclictest0-21swapper/711:30:009
2251099126cyclictest0-21swapper/507:46:267
2251099121cyclictest25530-21qemu-kvm10:44:427
2251099121cyclictest22239-21qemu-kvm07:25:567
2251099121cyclictest22239-21qemu-kvm07:25:567
2251099121cyclictest14089-21qemu-kvm09:24:467
2251099121cyclictest0-21swapper/511:45:117
2251099121cyclictest0-21swapper/510:05:287
2251099121cyclictest0-21swapper/509:40:147
2251099121cyclictest0-21swapper/508:30:137
2251099120cyclictest14094-21qemu-kvm09:39:097
2251099120cyclictest0-21swapper/512:35:057
2251099120cyclictest0-21swapper/512:35:057
2251099120cyclictest0-21swapper/512:15:277
2251099120cyclictest0-21swapper/512:15:277
2251099120cyclictest0-21swapper/511:35:217
2251099120cyclictest0-21swapper/511:20:177
2251099120cyclictest0-21swapper/511:07:117
2251099120cyclictest0-21swapper/510:45:287
2251099120cyclictest0-21swapper/510:25:227
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional