You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 23:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Sun Apr 05, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267812224209,11sleep10-21swapper/107:05:101
288412199183,12sleep00-21swapper/007:07:570
289672194179,11sleep30-21swapper/307:09:343
287702168151,12sleep20-21swapper/207:07:042
323662490,0sleep10-21swapper/110:48:131
302162440,0sleep30-21swapper/309:12:123
297542420,0sleep30-21swapper/312:22:163
220152140,0sleep10-21swapper/112:18:451
24892100,0sleep30-21swapper/310:33:423
291769981,4cyclictest7922-21munin-run10:05:010
291859971,5cyclictest0-21swapper/211:45:112
30016260,5sleep330044-21rm10:46:493
291859960,6cyclictest0-21swapper/208:55:122
10907260,0sleep10-21swapper/112:13:091
291899950,1cyclictest12441-21/usr/sbin/munin08:45:143
291859955,0cyclictest13042-21rm11:58:142
291859955,0cyclictest0-21swapper/212:18:282
291859951,2cyclictest0-21swapper/211:50:122
291859951,2cyclictest0-21swapper/210:55:112
291859950,5cyclictest2226-21apt-get12:25:012
291859950,5cyclictest0-21swapper/209:58:482
291859950,0cyclictest14366-21ssh11:10:412
291809952,2cyclictest0-21swapper/109:20:111
291809951,1cyclictest0-21swapper/111:05:101
291809950,5cyclictest0-21swapper/111:18:421
291809950,5cyclictest0-21swapper/111:00:051
291809950,5cyclictest0-21swapper/110:54:071
291809950,5cyclictest0-21swapper/108:20:171
291769955,0cyclictest18149-21swap12:00:190
291769950,4cyclictest29100-21diskstats11:50:140
291769950,4cyclictest0-21swapper/007:10:100
24692250,0sleep1201rcuc/111:31:571
19463250,0sleep00-21swapper/011:30:000
291899944,0cyclictest22972-21kworker/3:110:11:393
291899944,0cyclictest22972-21kworker/3:110:00:273
291899944,0cyclictest22972-21kworker/3:109:15:413
291899944,0cyclictest0-21swapper/310:50:543
291899943,1cyclictest7480-21diskstats10:20:123
291899942,2cyclictest3760-21grep07:20:163
291899941,1cyclictest0-21swapper/312:30:113
291899941,1cyclictest0-21swapper/310:40:133
291899940,4cyclictest8160-21apt-get11:40:113
291899940,4cyclictest32504-21apt-get08:20:123
291899940,4cyclictest25399-21ssh11:16:133
291899940,4cyclictest17224-21perl12:00:143
291899940,4cyclictest14913-21apt-get08:50:113
291899940,4cyclictest13373-21basename09:20:123
291899940,4cyclictest11640-21ssh12:13:353
291899940,4cyclictest0-21swapper/312:35:093
291899940,4cyclictest0-21swapper/311:54:153
291899940,4cyclictest0-21swapper/311:11:293
291899940,4cyclictest0-21swapper/311:00:163
291899940,4cyclictest0-21swapper/310:16:573
291899940,4cyclictest0-21swapper/310:06:263
291899940,4cyclictest0-21swapper/309:35:113
291899940,4cyclictest0-21swapper/309:30:113
291899940,4cyclictest0-21swapper/308:40:113
291899940,4cyclictest0-21swapper/308:00:113
291899940,4cyclictest0-21swapper/308:00:113
291899940,3cyclictest827-21/usr/sbin/munin11:20:143
291899940,3cyclictest5959-21ssh11:55:013
291899940,3cyclictest5683-21diskstats10:35:123
291899940,3cyclictest3270-21perl12:25:143
291899940,3cyclictest32059-21hddtemp_smartct07:15:003
291899940,3cyclictest2949-21ntp_states11:05:173
291899940,3cyclictest21936-21ssh09:40:113
291899940,3cyclictest20422-21egrep09:55:123
291899940,3cyclictest20085-21ssh10:25:513
291899940,3cyclictest19726-21date11:30:013
291899940,3cyclictest15608-21memory12:15:133
291899940,3cyclictest10350-21df11:25:113
291899940,2cyclictest0-21swapper/311:49:343
291899940,2cyclictest0-21swapper/311:39:113
291899940,1cyclictest7481-21/usr/sbin/munin08:35:143
291899940,1cyclictest25028-21ntp_states09:25:183
291899940,1cyclictest19674-21munin-run07:55:013
291859944,0cyclictest0-21swapper/210:20:202
291859944,0cyclictest0-21swapper/209:28:062
291859944,0cyclictest0-21swapper/208:15:282
291859943,1cyclictest0-21swapper/208:35:422
291859942,1cyclictest0-21swapper/208:45:112
291859941,3cyclictest2432-21cat09:30:152
291859941,2cyclictest0-21swapper/207:50:112
291859941,1cyclictest0-21swapper/208:50:112
291859940,4cyclictest15385-21users09:20:212
291859940,4cyclictest0-21swapper/212:24:152
291859940,4cyclictest0-21swapper/212:05:132
291859940,4cyclictest0-21swapper/212:00:122
291859940,4cyclictest0-21swapper/211:41:322
291859940,4cyclictest0-21swapper/211:05:112
291859940,4cyclictest0-21swapper/210:40:132
291859940,4cyclictest0-21swapper/210:38:172
291859940,4cyclictest0-21swapper/210:31:472
291859940,4cyclictest0-21swapper/210:25:302
291859940,4cyclictest0-21swapper/210:15:482
291859940,4cyclictest0-21swapper/210:10:062
291859940,4cyclictest0-21swapper/209:52:112
291859940,4cyclictest0-21swapper/209:41:402
291859940,4cyclictest0-21swapper/208:43:332
291859940,4cyclictest0-21swapper/208:30:102
291859940,4cyclictest0-21swapper/208:02:582
291859940,4cyclictest0-21swapper/208:02:582
291859940,4cyclictest0-21swapper/207:55:062
291859940,4cyclictest0-21swapper/207:40:132
291859940,4cyclictest0-21swapper/207:25:512
291859940,4cyclictest0-21swapper/207:12:032
291859940,3cyclictest6042-21ssh11:23:002
291859940,3cyclictest5531-21ssh10:50:222
291859940,3cyclictest4832-21latency_hist07:25:002
291859940,3cyclictest4417-21rm09:46:542
291859940,3cyclictest31954-21hwlatdetect07:15:012
291859940,3cyclictest31039-21fschecks_count11:35:162
291859940,3cyclictest29705-21apt-config08:15:002
291859940,3cyclictest26881-21ssh11:00:582
291859940,3cyclictest24616-21ssh11:31:542
291859940,3cyclictest24421-21ssh11:15:372
291859940,3cyclictest14150-21latency_hist12:15:002
291859940,3cyclictest13335-21perl12:30:142
291859940,3cyclictest12453-21sed07:40:012
291859940,3cyclictest11687-21/usr/sbin/munin09:35:182
291859940,3cyclictest10312-21ssh09:18:312
291859940,3cyclictest0-21swapper/210:05:112
291809944,0cyclictest0-21swapper/112:05:501
291809944,0cyclictest0-21swapper/110:25:101
291809944,0cyclictest0-21swapper/110:17:001
291809944,0cyclictest0-21swapper/110:06:321
291809944,0cyclictest0-21swapper/108:35:171
291809941,2cyclictest0-21swapper/112:35:101
291809941,2cyclictest0-21swapper/112:20:121
291809941,2cyclictest0-21swapper/111:35:131
291809941,2cyclictest0-21swapper/110:55:111
291809941,2cyclictest0-21swapper/110:30:131
291809941,2cyclictest0-21swapper/110:00:121
291809941,2cyclictest0-21swapper/109:50:111
291809941,2cyclictest0-21swapper/108:40:111
291809941,2cyclictest0-21swapper/108:05:131
291809941,2cyclictest0-21swapper/107:45:111
291809941,2cyclictest0-21swapper/107:10:111
291809941,1cyclictest0-21swapper/108:45:121
291809940,4cyclictest0-21swapper/111:43:171
291809940,4cyclictest0-21swapper/109:33:301
291769942,1cyclictest9570-21ssh11:40:160
291769942,1cyclictest205-21systemd-journal09:15:010
291769942,1cyclictest0-21swapper/009:59:550
291769941,3cyclictest4365-21sed07:20:210
291769941,3cyclictest0-21swapper/008:00:110
291769941,3cyclictest0-21swapper/008:00:100
291769941,2cyclictest0-21swapper/010:30:130
291769940,4cyclictest7869-21ssh10:35:440
291769940,4cyclictest32451-21python07:15:010
291769940,4cyclictest14698-21perf08:50:000
291769940,4cyclictest14144-21df_inode10:55:130
291769940,4cyclictest0-21swapper/012:36:110
291769940,4cyclictest0-21swapper/012:19:460
291769940,4cyclictest0-21swapper/011:59:520
291769940,4cyclictest0-21swapper/011:30:110
291769940,4cyclictest0-21swapper/011:20:090
291769940,4cyclictest0-21swapper/011:10:120
291769940,4cyclictest0-21swapper/010:45:030
291769940,4cyclictest0-21swapper/010:40:130
291769940,4cyclictest0-21swapper/010:26:170
291769940,4cyclictest0-21swapper/010:06:410
291769940,4cyclictest0-21swapper/009:40:120
291769940,4cyclictest0-21swapper/009:37:160
291769940,4cyclictest0-21swapper/009:10:130
291769940,4cyclictest0-21swapper/008:15:100
291769940,4cyclictest0-21swapper/007:53:410
291769940,3cyclictest5191-21hddtemp_smartct12:10:130
291769940,3cyclictest5011-21apt08:30:090
291769940,3cyclictest32486-21date08:20:010
291769940,3cyclictest32229-21apt-get09:45:120
291769940,3cyclictest28702-21users12:05:210
291769940,3cyclictest27276-21latency_hist08:10:000
291769940,3cyclictest24962-21memory11:00:160
291769940,3cyclictest24157-21df09:25:130
291769940,3cyclictest23972-21users11:15:200
291769940,3cyclictest2337-21hddtemp_smartct09:30:140
291769940,3cyclictest22590-21ssh10:11:290
291769940,3cyclictest20611-21perl09:00:130
291769940,3cyclictest1513-21/usr/sbin/munin11:05:120
291769940,3cyclictest12970-21cat07:40:130
291769940,3cyclictest10744-21perl07:35:130
291769940,3cyclictest0-21swapper/012:28:440
291769940,3cyclictest0-21swapper/010:50:100
291769940,3cyclictest0-21swapper/010:20:530
291769940,1cyclictest9721-21latency_hist08:39:590
291769940,1cyclictest7626-21cron11:40:010
291769940,1cyclictest4785-21latency_hist08:30:010
291769940,1cyclictest24597-21awk09:10:010
291769940,0cyclictest0-21swapper/011:46:380
22729240,0sleep10-21swapper/109:55:331
291899930,3cyclictest5584-21df07:25:133
291899930,3cyclictest32125-21ssh09:45:083
291899930,3cyclictest27326-21apt-get08:10:123
291899930,3cyclictest20730-21hddtemp_smartct07:55:153
291899930,3cyclictest13519-21ssh10:55:083
291899930,3cyclictest0-21swapper/312:05:063
291899930,3cyclictest0-21swapper/309:50:123
291899930,3cyclictest0-21swapper/309:05:093
291899930,3cyclictest0-21swapper/309:00:003
291899930,3cyclictest0-21swapper/308:55:063
291899930,3cyclictest0-21swapper/308:30:093
291899930,3cyclictest0-21swapper/308:25:113
291899930,3cyclictest0-21swapper/308:15:013
291899930,3cyclictest0-21swapper/308:05:053
291899930,3cyclictest0-21swapper/307:45:103
291899930,3cyclictest0-21swapper/307:40:133
291899930,3cyclictest0-21swapper/307:35:133
291899930,3cyclictest0-21swapper/307:30:123
291899930,3cyclictest0-21swapper/307:10:103
291859933,0cyclictest32504-21apt-get08:20:112
291859932,1cyclictest22447-21ssh12:35:022
291859931,2cyclictest24874-21ssh09:10:032
291859930,3cyclictest24857-21apt-get08:05:132
291859930,3cyclictest19872-21apt-get09:00:112
291859930,3cyclictest0-21swapper/211:25:082
291859930,3cyclictest0-21swapper/210:45:022
291859930,3cyclictest0-21swapper/210:00:112
291859930,3cyclictest0-21swapper/209:05:122
291859930,3cyclictest0-21swapper/208:25:112
291859930,3cyclictest0-21swapper/207:45:012
291859930,3cyclictest0-21swapper/207:30:012
291809931,2cyclictest0-21swapper/109:15:101
291809931,1cyclictest0-21swapper/111:55:111
291809931,1cyclictest0-21swapper/111:25:091
291809931,1cyclictest0-21swapper/111:20:101
291809931,1cyclictest0-21swapper/110:10:121
291809931,1cyclictest0-21swapper/109:35:121
291809931,1cyclictest0-21swapper/109:25:121
291809931,1cyclictest0-21swapper/109:10:131
291809930,3cyclictest0-21swapper/107:50:551
291809930,3cyclictest0-21swapper/107:42:551
291809930,3cyclictest0-21swapper/107:21:581
291809930,2cyclictest2007-21chrt07:15:551
291809930,2cyclictest0-21swapper/111:47:331
291809930,2cyclictest0-21swapper/111:10:111
291809930,1cyclictest0-21swapper/110:35:101
291809930,1cyclictest0-21swapper/108:55:111
291769932,1cyclictest9958-21ssh09:50:080
291769932,1cyclictest802-21snmpd08:50:020
291769932,1cyclictest802-21snmpd08:10:020
291769930,3cyclictest9974-21apt-get08:40:110
291769930,3cyclictest19939-21cut07:55:130
291769930,3cyclictest15254-21tr07:45:120
291769930,3cyclictest13136-21ssh09:20:050
291769930,3cyclictest12685-21ssh12:30:120
291769930,3cyclictest0-21swapper/012:20:090
291769930,3cyclictest0-21swapper/010:15:180
291769930,3cyclictest0-21swapper/008:55:110
291769930,3cyclictest0-21swapper/007:30:060
291769930,3cyclictest0-21swapper/007:25:120
291809922,0cyclictest0-21swapper/112:30:081
291809921,1cyclictest0-21swapper/110:40:121
291809921,1cyclictest0-21swapper/109:40:141
291809921,1cyclictest0-21swapper/109:00:111
291809921,1cyclictest0-21swapper/108:25:101
291809921,1cyclictest0-21swapper/108:15:021
291809921,1cyclictest0-21swapper/107:35:111
291809921,1cyclictest0-21swapper/107:25:121
291809920,1cyclictest22327-21chrt09:05:041
291809920,1cyclictest14899-21chrt08:50:021
291809920,1cyclictest0-21swapper/112:25:001
291809920,1cyclictest0-21swapper/111:59:591
291809920,1cyclictest0-21swapper/111:50:121
291809920,1cyclictest0-21swapper/110:20:011
291809920,1cyclictest0-21swapper/109:45:111
291809920,1cyclictest0-21swapper/108:10:131
291809920,1cyclictest0-21swapper/108:05:011
291809920,1cyclictest0-21swapper/108:05:001
291809920,1cyclictest0-21swapper/107:55:111
291809920,1cyclictest0-21swapper/107:30:111
291809910,1cyclictest0-21swapper/108:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional