You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 05:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Jan 02, 2026 00:46:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3325210794sleep40-21swapper/419:06:416
12450950irq/42-ahci0-21swapper/319:07:105
2651150940irq/49-eth0-rx-0-21swapper/719:08:189
12450940irq/42-ahci0-21swapper/819:08:4610
2651250910irq/50-eth0-tx-0-21swapper/119:05:341
2651150900irq/49-eth0-rx-0-21swapper/219:05:314
349226753sleep00-21swapper/019:08:130
2651150670irq/49-eth0-rx-0-21swapper/919:05:1311
12450670irq/42-ahci0-21swapper/519:05:017
34026353sleep110-21swapper/1119:05:123
328025955sleep60-21swapper/619:06:068
326725853sleep100-21swapper/1019:05:592
3771992914cyclictest0-21swapper/1119:13:093
3729992914cyclictest0-21swapper/019:13:060
3729992013cyclictest0-21swapper/019:29:330
3729991912cyclictest20054-21chrt19:30:030
3729991912cyclictest20054-21chrt19:30:030
3770991817cyclictest0-21swapper/1021:38:492
377099181cyclictest15872sleep1019:49:032
377099181cyclictest12450irq/42-ahci00:08:552
376999181cyclictest761ksoftirqd/923:45:3111
376999181cyclictest0-21swapper/923:00:3211
376999181cyclictest0-21swapper/922:15:1611
376999181cyclictest0-21swapper/922:15:1611
376999181cyclictest0-21swapper/922:00:3011
376999181cyclictest0-21swapper/921:45:1611
376999181cyclictest0-21swapper/921:15:1611
376999181cyclictest0-21swapper/920:40:1611
376999181cyclictest0-21swapper/920:25:5811
376999181cyclictest0-21swapper/920:01:2511
376999181cyclictest0-21swapper/919:50:2111
376999181cyclictest0-21swapper/919:35:1711
376999181cyclictest0-21swapper/919:20:3811
376999181cyclictest0-21swapper/919:15:3111
376999181cyclictest0-21swapper/900:36:0211
376999181cyclictest0-21swapper/900:29:3711
376999181cyclictest0-21swapper/900:20:2811
376299180cyclictest0-21swapper/519:40:157
3749991816cyclictest897-21snmp_easybox.os23:30:125
3749991816cyclictest4408-21irqstats20:35:265
3749991816cyclictest2954-21snmp_rack3slot922:01:495
3749991816cyclictest27937-21snmp_rack3slot921:51:015
3749991816cyclictest22214-21snmp_easybox.os20:15:245
3749991816cyclictest13062-21iostat_ios23:00:195
3749991816cyclictest10705-21snmp_rack3slot922:56:515
3742991816cyclictest27491-21snmp_rack3slot921:06:254
3742991816cyclictest27491-21snmp_rack3slot921:06:254
3729991811cyclictest0-21swapper/022:20:260
3770991715cyclictest10489-21grep20:45:122
377099170cyclictest99832sleep1021:29:132
377099170cyclictest87252sleep1019:55:502
377099170cyclictest86142chrt20:40:322
377099170cyclictest80742sleep1000:24:452
377099170cyclictest74062chrt23:36:042
377099170cyclictest67942sleep1022:08:422
377099170cyclictest67942sleep1022:08:422
377099170cyclictest60962sleep1021:20:492
377099170cyclictest58762sleep1019:10:232
377099170cyclictest51212sleep1019:51:152
377099170cyclictest44122sleep1000:19:202
377099170cyclictest41922sleep1022:50:092
377099170cyclictest39282chrt23:33:042
377099170cyclictest324442chrt23:25:382
377099170cyclictest320792sleep1022:41:102
377099170cyclictest316932sleep1021:57:412
377099170cyclictest313282sleep1021:13:122
377099170cyclictest307352chrt20:26:552
377099170cyclictest300592sleep1000:10:072
377099170cyclictest288222sleep1023:20:382
377099170cyclictest284592sleep1022:36:212
377099170cyclictest28312sleep1022:00:412
377099170cyclictest279272sleep1021:50:522
377099170cyclictest274862sleep1021:06:242
377099170cyclictest274862sleep1021:06:242
377099170cyclictest270052sleep1020:20:432
377099170cyclictest265722sleep1019:36:372
377099170cyclictest2651150irq/49-eth0-rx-23:55:162
377099170cyclictest2651150irq/49-eth0-rx-23:05:262
377099170cyclictest2651150irq/49-eth0-rx-21:40:222
377099170cyclictest2651150irq/49-eth0-rx-20:15:172
377099170cyclictest2651150irq/49-eth0-rx-19:40:102
377099170cyclictest2651150irq/49-eth0-rx-00:35:182
377099170cyclictest250492sleep1022:34:332
377099170cyclictest250492sleep1022:34:322
377099170cyclictest228582sleep1019:30:372
377099170cyclictest228582sleep1019:30:362
377099170cyclictest227532chrt00:00:072
377099170cyclictest224562sleep1021:00:212
377099170cyclictest214572chrt21:45:042
377099170cyclictest20772sleep1020:33:422
377099170cyclictest20692sleep1022:45:232
377099170cyclictest200942sleep1020:55:352
377099170cyclictest197372sleep1020:10:522
377099170cyclictest192632sleep1019:26:122
377099170cyclictest191272sleep1023:10:142
377099170cyclictest185772sleep1023:54:432
377099170cyclictest183282sleep1022:25:082
377099170cyclictest175142sleep1022:20:552
377099170cyclictest159182sleep1020:50:342
377099170cyclictest144792sleep1023:03:122
377099170cyclictest139862chrt22:17:312
377099170cyclictest139862chrt22:17:312
377099170cyclictest134792chrt21:32:142
377099170cyclictest132232sleep1020:05:052
377099170cyclictest132042sleep1023:45:162
377099170cyclictest124832chrt20:01:522
377099170cyclictest12450irq/42-ahci23:15:192
377099170cyclictest12450irq/42-ahci21:15:012
377099170cyclictest12450irq/42-ahci19:21:022
377099170cyclictest122492sleep1000:30:102
377099170cyclictest119562sleep1019:15:462
377099170cyclictest114902sleep1000:26:462
377099170cyclictest106842sleep1022:56:352
377099170cyclictest104282sleep1023:40:282
377099170cyclictest103802sleep1022:12:542
376999170cyclictest741rcuc/922:40:2111
376999170cyclictest0-21swapper/922:55:2411
376999170cyclictest0-21swapper/922:45:3011
376999170cyclictest0-21swapper/921:35:2711
376999170cyclictest0-21swapper/921:10:1211
376999170cyclictest0-21swapper/920:58:1411
376999170cyclictest0-21swapper/920:30:3911
376999170cyclictest0-21swapper/920:22:2611
376999170cyclictest0-21swapper/920:05:1311
376999170cyclictest0-21swapper/919:34:3811
376999170cyclictest0-21swapper/919:34:3711
376999170cyclictest0-21swapper/900:15:2011
3766991716cyclictest3483-21qemu-kvm19:16:488
3749991715cyclictest7772-21snmp_rack3slot920:40:165
3749991715cyclictest7448-21munin-node19:15:005
3749991715cyclictest6980-21snmp_rack3slot922:50:385
3749991715cyclictest434-21snmp_rack3slot900:11:245
3749991715cyclictest3337-21snmp_easybox.os21:20:115
3749991715cyclictest32750-21snmp_rack3slot920:30:205
3749991715cyclictest30754-21snmp_easybox.os21:55:235
3749991715cyclictest27525-21snmp_rack3slot921:06:505
3749991715cyclictest27525-21snmp_rack3slot921:06:495
3749991715cyclictest25802-21iostat_ios20:20:225
3749991715cyclictest24181-21snmp_rack3slot923:15:255
3749991715cyclictest23781-21snmp_rack3slot921:00:525
3749991715cyclictest23766-21snmp_rack3slot919:35:125
3749991715cyclictest23612-21df_inode00:00:145
3749991715cyclictest20130-21snmp_rack3slot920:55:485
3749991715cyclictest19200-21snmp_rack3slot921:40:185
3749991715cyclictest18931-21snmp_rack3slot923:10:135
3749991715cyclictest18760-21snmp_rack3slot900:36:505
3749991715cyclictest16674-21perl23:50:125
3749991715cyclictest16137-21snmp_rack3slot920:07:145
3749991715cyclictest1479-21snmp_rack3slot900:15:125
3749991715cyclictest14730-21snmp_rack3slot923:46:505
3749991715cyclictest14656-21snmp_rack3slot921:35:145
3749991715cyclictest1463-21snmp_rack3slot922:45:155
3749991715cyclictest14300-21snmp_easybox.os00:30:255
3749991715cyclictest12383-21snmp_rack3slot920:01:015
3742991715cyclictest20715-21iostat_ios23:55:234
3742991715cyclictest18743-21snmp_rack3slot900:36:374
3742991715cyclictest12367-21snmp_rack3slot920:00:494
372999170cyclictest0-21swapper/022:30:280
372999170cyclictest0-21swapper/022:30:270
377199160cyclictest0-21swapper/1122:22:323
3769991615cyclictest2651150irq/49-eth0-rx-21:30:4811
3769991615cyclictest0-21swapper/923:55:1511
3769991615cyclictest0-21swapper/923:50:2611
3769991615cyclictest0-21swapper/923:35:1011
3769991615cyclictest0-21swapper/923:28:5211
3769991615cyclictest0-21swapper/923:20:2811
3769991615cyclictest0-21swapper/923:15:1811
3769991615cyclictest0-21swapper/923:12:1211
3769991615cyclictest0-21swapper/922:50:1611
3769991615cyclictest0-21swapper/922:33:3711
3769991615cyclictest0-21swapper/922:33:3711
3769991615cyclictest0-21swapper/922:20:3011
3769991615cyclictest0-21swapper/921:50:2411
3769991615cyclictest0-21swapper/921:41:1911
3769991615cyclictest0-21swapper/921:27:2011
3769991615cyclictest0-21swapper/921:20:5311
3769991615cyclictest0-21swapper/921:05:3711
3769991615cyclictest0-21swapper/921:05:3711
3769991615cyclictest0-21swapper/920:52:0111
3769991615cyclictest0-21swapper/920:10:2611
3769991615cyclictest0-21swapper/919:55:3411
3769991615cyclictest0-21swapper/900:05:3111
3769991615cyclictest0-21swapper/900:00:2611
376699166cyclictest0-21swapper/621:55:008
376699161cyclictest27673-21qemu-kvm21:30:108
375599160cyclictest0-21swapper/420:30:306
3749991614cyclictest8779-21snmp_rack3slot922:10:165
3749991614cyclictest8705-21snmp_rack3slot919:55:385
3749991614cyclictest7983-21snmp_rack3slot921:25:165
3749991614cyclictest375-21snmp_rack3slot921:15:135
3749991614cyclictest30103-21snmp_rack3slot922:40:145
3749991614cyclictest2290-21snmp_easybox.os19:50:135
3749991614cyclictest22342-21snmp_rack3slot921:45:175
3749991614cyclictest21034-21snmp_rack3slot919:30:155
3749991614cyclictest21034-21snmp_rack3slot919:30:155
3749991614cyclictest19070-21snmp_rack3slot922:25:145
3749991614cyclictest10752-21snmp_easybox.os00:25:245
3749991614cyclictest10114-21snmp_easybox.os20:45:125
3742991614cyclictest28865-21snmp_rack3slot923:21:134
3742991614cyclictest2265-21snmpd23:33:574
3742991614cyclictest2265-21snmpd21:02:264
3742991614cyclictest16550-21snmp_rack3slot920:51:244
374299160cyclictest0-21swapper/219:45:204
3732991615cyclictest27843-21chrt20:25:101
372999164cyclictest0-21swapper/000:05:180
372999162cyclictest0-21swapper/022:55:180
372999162cyclictest0-21swapper/020:22:340
3769991514cyclictest761ksoftirqd/920:15:1611
3769991514cyclictest741rcuc/900:30:1311
3769991514cyclictest0-21swapper/923:05:3111
3769991514cyclictest0-21swapper/922:35:1811
3769991514cyclictest0-21swapper/922:26:2211
3769991514cyclictest0-21swapper/922:10:2611
3769991514cyclictest0-21swapper/922:05:3111
3769991514cyclictest0-21swapper/922:05:3111
3769991514cyclictest0-21swapper/921:56:2311
3769991514cyclictest0-21swapper/921:01:4211
3769991514cyclictest0-21swapper/920:45:2311
3769991514cyclictest0-21swapper/919:27:0211
3769991514cyclictest0-21swapper/919:12:1711
376899150cyclictest0-21swapper/820:15:1310
376899150cyclictest0-21swapper/820:10:1510
376299153cyclictest0-21swapper/520:05:197
375599150cyclictest0-21swapper/420:30:006
3749991513cyclictest8736-21snmp_rack3slot919:15:155
3749991513cyclictest5442-21snmp_rack3slot900:20:145
3749991513cyclictest11824-21snmp_rack3slot921:30:145
3742991514cyclictest3510-21smbd19:30:404
3742991514cyclictest3510-21smbd19:30:404
3742991513cyclictest4097-21snmp_rack3slot921:20:124
3732991514cyclictest99432sleep121:28:391
3732991514cyclictest193832sleep119:27:511
3732991513cyclictest8096-21chrt00:25:001
372999152cyclictest0-21swapper/020:08:260
3729991514cyclictest2547-21runrttasks20:19:520
372999150cyclictest0-21swapper/020:45:370
6699140watchdog/80-21swapper/820:42:1110
3899140watchdog/40-21swapper/422:16:196
3899140watchdog/40-21swapper/422:16:196
3771991413cyclictest197512sleep1120:11:063
3769991413cyclictest761ksoftirqd/923:30:1311
3769991413cyclictest0-21swapper/923:44:0211
3769991413cyclictest0-21swapper/920:36:3411
3769991413cyclictest0-21swapper/919:45:2111
3769991413cyclictest0-21swapper/900:10:2311
376999140cyclictest761ksoftirqd/919:40:4211
376899144cyclictest0-21swapper/821:25:0110
376899143cyclictest0-21swapper/819:28:2610
376799145cyclictest0-21swapper/723:50:009
376799143cyclictest0-21swapper/720:05:209
3749991412cyclictest29222-21snmp_rack3slot921:10:155
3749991412cyclictest27215-21iostat_ios22:35:235
3749991412cyclictest26889-21diskstats23:20:145
3749991412cyclictest20715-21iostat_ios23:55:235
3749991412cyclictest17476-21snmp_rack3slot919:25:145
3749991412cyclictest11119-21snmp_easybox.os22:15:125
3749991412cyclictest11119-21snmp_easybox.os22:15:125
3742991412cyclictest9844-21snmp_rack3slot922:55:254
3742991412cyclictest6575-21iostat_ios00:20:214
3742991412cyclictest31647-21iostat_ios00:10:184
3742991412cyclictest28836-21snmp_rack3slot921:10:134
3742991412cyclictest2265-21snmpd21:34:414
3742991412cyclictest16705-21snmp_easybox.os22:20:234
3732991413cyclictest10210-21expr20:00:131
3729991412cyclictest12206-21chrt19:19:130
3771991312cyclictest31342-21chrt21:13:253
376899133cyclictest0-21swapper/822:17:3110
376899133cyclictest0-21swapper/822:17:3010
376899133cyclictest0-21swapper/821:49:1210
376899133cyclictest0-21swapper/821:40:2810
376899133cyclictest0-21swapper/821:35:4110
376899133cyclictest0-21swapper/820:37:2710
376899133cyclictest0-21swapper/820:28:2710
376899133cyclictest0-21swapper/819:55:3310
376899133cyclictest0-21swapper/819:13:2210
376899132cyclictest0-21swapper/820:50:2710
376799134cyclictest0-21swapper/719:15:019
376799134cyclictest0-21swapper/700:35:019
376799133cyclictest0-21swapper/723:44:399
376799133cyclictest0-21swapper/723:27:049
376799133cyclictest0-21swapper/723:18:339
376799133cyclictest0-21swapper/722:55:019
376799133cyclictest0-21swapper/722:49:029
376799133cyclictest0-21swapper/722:24:579
376799133cyclictest0-21swapper/722:18:429
376799133cyclictest0-21swapper/722:18:429
376799133cyclictest0-21swapper/722:14:019
376799133cyclictest0-21swapper/721:50:009
376799133cyclictest0-21swapper/721:20:589
376799133cyclictest0-21swapper/720:57:279
376799133cyclictest0-21swapper/720:41:279
376799133cyclictest0-21swapper/720:16:269
376799133cyclictest0-21swapper/719:29:259
376799133cyclictest0-21swapper/700:10:019
376699133cyclictest0-21swapper/623:32:588
376699133cyclictest0-21swapper/622:51:128
376699133cyclictest0-21swapper/620:07:568
376699133cyclictest0-21swapper/619:56:118
376699132cyclictest0-21swapper/622:04:568
376299132cyclictest0-21swapper/520:20:197
3749991311cyclictest29243-21snmp_rack3slot900:06:005
3749991311cyclictest28201-21diskstats19:40:145
3749991311cyclictest17151-21snmp_rack3slot920:10:125
3749991311cyclictest16504-21snmp_rack3slot920:50:485
374299133cyclictest0-21swapper/220:45:214
374299133cyclictest0-21swapper/200:00:204
3742991311cyclictest5825-21iostat_ios19:10:204
3742991311cyclictest30600-21snmp_rack3slot922:40:164
3742991311cyclictest27115-21snmp_easybox.os21:50:234
3742991311cyclictest2265-21snmpd23:26:584
3742991311cyclictest2265-21snmpd22:33:274
3742991311cyclictest2265-21snmpd22:33:274
3742991311cyclictest2265-21snmpd00:25:284
3742991311cyclictest18015-21snmp_rack3slot923:06:524
372999133cyclictest0-21swapper/023:00:180
372999132cyclictest0-21swapper/021:08:270
372999132cyclictest0-21swapper/021:08:260
31130ksoftirqd/00-21swapper/021:30:270
1699130watchdog/00-21swapper/021:04:270
4599120watchdog/50-21swapper/522:55:357
377099123cyclictest0-21swapper/1020:39:572
376899122cyclictest0-21swapper/822:40:3210
376899122cyclictest0-21swapper/822:05:2710
376899122cyclictest0-21swapper/822:05:2710
376799124cyclictest0-21swapper/723:30:019
376799124cyclictest0-21swapper/719:30:029
376799124cyclictest0-21swapper/719:30:029
376799123cyclictest0-21swapper/723:20:019
376799123cyclictest0-21swapper/723:02:329
376799123cyclictest0-21swapper/721:35:019
376799123cyclictest0-21swapper/719:17:119
376799122cyclictest0-21swapper/723:59:159
376799122cyclictest0-21swapper/723:09:029
376799122cyclictest0-21swapper/722:42:029
376799122cyclictest0-21swapper/722:30:019
376799122cyclictest0-21swapper/722:30:009
376799122cyclictest0-21swapper/722:02:299
376799122cyclictest0-21swapper/721:54:009
376799122cyclictest0-21swapper/720:50:589
376799122cyclictest0-21swapper/720:26:579
376799122cyclictest0-21swapper/720:21:569
376799122cyclictest0-21swapper/719:35:109
376799122cyclictest0-21swapper/719:21:249
376799122cyclictest0-21swapper/700:25:459
3767991210cyclictest0-21swapper/700:05:009
376699125cyclictest2192-21idleruntime-cro20:35:008
376699122cyclictest0-21swapper/623:45:038
376699122cyclictest0-21swapper/623:41:588
376699122cyclictest0-21swapper/622:58:588
376699122cyclictest0-21swapper/622:27:388
376699122cyclictest0-21swapper/621:05:038
376699122cyclictest0-21swapper/621:05:038
376699122cyclictest0-21swapper/621:04:418
376699122cyclictest0-21swapper/620:00:108
376699122cyclictest0-21swapper/600:28:438
376699122cyclictest0-21swapper/600:23:158
376699121cyclictest6748-21qemu-kvm22:15:138
376699121cyclictest6748-21qemu-kvm22:15:138
376699120cyclictest0-21swapper/621:40:018
376299122cyclictest0-21swapper/522:50:017
3749991210cyclictest29674-21snmp_rack3slot923:25:155
374299122cyclictest0-21swapper/223:50:164
374299122cyclictest0-21swapper/222:00:184
3742991210cyclictest785-21snmp_rack3slot921:15:154
3742991210cyclictest2382-21perl00:15:204
3742991210cyclictest2265-21snmpd21:26:274
3742991210cyclictest2265-21snmpd19:52:574
3742991210cyclictest1315-21snmp_rack3slot922:45:164
373299122cyclictest0-21swapper/123:10:181
373299122cyclictest0-21swapper/122:15:191
373299122cyclictest0-21swapper/122:15:181
3729991210cyclictest0-21swapper/019:40:380
6899110migration/813558-21gltestperf00:30:1610
4599110watchdog/50-21swapper/521:06:197
4599110watchdog/50-21swapper/521:06:197
377199119cyclictest9024-21df_abs23:40:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional