You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 23:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Wed Sep 16, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1241921650,23sleep10-21swapper/107:04:331
1241921650,23sleep10-21swapper/107:04:331
137059911621,13cyclictest0-21swapper/007:09:100
137059911621,13cyclictest0-21swapper/007:09:100
137059910951,52cyclictest2657-21latency_hist11:19:100
137059910844,57cyclictest0-21swapper/012:34:090
137059910738,8cyclictest0-21swapper/008:44:390
137059910533,8cyclictest0-21swapper/010:49:410
137059910533,8cyclictest0-21swapper/010:49:410
1360521058,68sleep213620-21systemctl07:09:072
1360521058,68sleep213620-21systemctl07:09:072
137229910413,51cyclictest0-21swapper/310:29:253
137059910333,63cyclictest0-21swapper/010:34:380
137059910142,54cyclictest0-21swapper/011:54:070
137059910120,28cyclictest343-21runrttasks11:14:200
13705991004,24cyclictest8563-21/usr/sbin/munin08:29:360
13705991004,24cyclictest8563-21/usr/sbin/munin08:29:360
137059910036,15cyclictest526-21rs:main0
137059910020,25cyclictest30151-21/usr/sbin/munin09:24:280
13705999940,52cyclictest0-21swapper/008:24:390
13705999936,7cyclictest0-21swapper/009:50:070
13705999936,7cyclictest0-21swapper/009:50:070
13705999934,10cyclictest0-21swapper/007:44:370
1370599992,40cyclictest28048-21threads09:19:420
1370599992,40cyclictest28048-21threads09:19:420
1370599985,25cyclictest11674-21/usr/sbin/munin11:34:260
1370599985,25cyclictest11674-21/usr/sbin/munin11:34:260
1370599984,40cyclictest1870-21expr10:24:230
13705999833,8cyclictest0-21swapper/007:34:360
1370599982,37cyclictest18395-21ssh09:57:520
13718999748,44cyclictest518-21kworker/u17:1+events_unbound10:29:062
13713999754,36cyclictest0-21swapper/109:59:281
1370599974,25cyclictest9266-21/usr/sbin/munin12:24:260
13705999733,7cyclictest0-21swapper/011:29:410
13705999733,7cyclictest0-21swapper/010:19:220
1370599973,29cyclictest15266-21ntp_kernel_err11:39:330
1370599973,28cyclictest11038-21/usr/sbin/munin09:45:130
1370599973,28cyclictest11038-21/usr/sbin/munin09:45:130
13705999732,7cyclictest0-21swapper/012:04:050
1370599972,34cyclictest6162-21sh09:38:310
13705999720,23cyclictest17323-21modprobe07:19:060
13713999639,50cyclictest4427-21modprobe08:19:051
1370599964,29cyclictest15698-21sendmail_mailqu12:34:390
13705999618,22cyclictest31020-21sed10:19:090
13705999616,32cyclictest27905-21ssh11:07:100
1370599954,28cyclictest20588-21latency_hist11:49:090
1370599954,28cyclictest20588-21latency_hist11:49:090
13705999534,7cyclictest0-21swapper/009:39:330
13705999534,7cyclictest0-21swapper/009:39:330
1370599953,28cyclictest30720-21/usr/sbin/munin12:04:430
13705999524,24cyclictest20616-21diskmemload12:19:060
13718999474,12cyclictest365-21lldpd11:29:082
13718999453,32cyclictest0-21swapper/210:29:532
1370599944,31cyclictest24066-21/usr/sbin/munin11:54:280
1370599944,30cyclictest11127-21latency_hist08:39:090
13705999434,7cyclictest0-21swapper/010:31:290
13705999429,10cyclictest0-21swapper/010:59:050
1370599942,39cyclictest16121-21ssh10:47:450
1370599942,34cyclictest23400-21latency10:59:320
1370599942,31cyclictest19170-21acpi07:24:170
1370599942,31cyclictest19170-21acpi07:24:170
1370599942,25cyclictest6102-21/usr/sbin/munin11:24:290
13718999349,37cyclictest0-21swapper/208:34:392
13713999376,11cyclictest26315-21cron11:59:051
13713999354,31cyclictest0-21swapper/112:09:061
13713999352,32cyclictest0-21swapper/112:14:081
1370599933,39cyclictest27219-21rm10:12:230
1370599933,39cyclictest27219-21rm10:12:230
13718999252,31cyclictest0-21swapper/207:34:432
1370599924,33cyclictest28837-21acpi07:54:170
1370599923,30cyclictest831-21sh12:09:360
1370599923,28cyclictest24140-21/usr/sbin/munin09:14:590
1370599923,28cyclictest20609-21munin-plugin-st09:09:060
1370599922,33cyclictest30923-21needreboot07:59:340
1370599922,33cyclictest27723-21ntp_kernel_pll_07:49:310
1370599922,33cyclictest27723-21ntp_kernel_pll_07:49:310
13705999212,28cyclictest2007-21sshd09:30:150
13705999212,28cyclictest2007-21sshd09:30:150
13713999154,33cyclictest13696-21cyclictest07:29:281
1370599914,31cyclictest4715-21/usr/sbin/munin08:19:300
1370599913,38cyclictest8346-21ssh12:23:000
1370599913,38cyclictest8346-21ssh12:23:000
1370599913,25cyclictest29164-21apt-get11:09:380
13705999131,10cyclictest0-21swapper/007:41:230
1370599912,27cyclictest13869-21latency_hist10:44:100
1370599912,26cyclictest359-21snmpd07:29:170
13718999038,45cyclictest20616-21diskmemload10:05:222
13713999053,32cyclictest13696-21cyclictest12:20:441
13713999053,32cyclictest13696-21cyclictest12:20:441
13713999043,40cyclictest662-21cron10:24:061
13713999038,45cyclictest20218-21sh11:48:421
13713999038,45cyclictest20218-21sh11:48:421
1370599903,31cyclictest32177-21cstates08:04:230
1370599903,30cyclictest18523-21unixbench_singl07:19:420
13705999014,23cyclictest2594-21basename08:14:060
13722998913,42cyclictest0-21swapper/311:10:113
13718998935,48cyclictest0-21swapper/211:19:422
13713998939,43cyclictest24647-21mailstats07:39:391
1370599894,41cyclictest3336-21ntp_states11:19:360
1370599893,28cyclictest20280-21/usr/sbin/munin09:59:430
1370599892,32cyclictest14389-21/usr/sbin/munin08:49:310
13718998849,32cyclictest0-21swapper/210:14:282
13713998842,39cyclictest29557-21sh11:10:121
1370599885,29cyclictest343-21runrttasks08:14:160
13718998770,11cyclictest19350-21kworker/u17:2-rpciod10:59:422
13718998748,32cyclictest0-21swapper/212:14:382
1370599874,27cyclictest16001-21sort08:54:160
1370599874,27cyclictest16001-21sort08:54:160
1370599874,27cyclictest12534-21modprobe08:44:060
1370599874,26cyclictest22160-21/usr/sbin/munin10:04:370
13718998652,27cyclictest0-21swapper/210:19:162
13718998640,39cyclictest2585-21latency_hist08:14:102
1371899863,20cyclictest24540-21/usr/sbin/munin07:39:342
13713998656,20cyclictest343-21runrttasks08:44:301
13713998641,37cyclictest13635-21if_eth009:49:431
13713998641,37cyclictest13635-21if_eth009:49:431
1370599862,32cyclictest14144-21grep07:09:300
13713998545,33cyclictest0-21swapper/109:45:121
13713998545,33cyclictest0-21swapper/109:45:121
13713998536,43cyclictest343-21runrttasks10:53:191
13713998536,43cyclictest343-21runrttasks10:53:191
13713998536,41cyclictest0-21swapper/107:59:171
13713998527,48cyclictest0-21swapper/108:49:441
13718998461,8cyclictest181rcu_preempt09:11:512
13718998443,34cyclictest20616-21diskmemload10:47:242
1371899844,26cyclictest32756-21/usr/sbin/munin12:09:222
13718998439,37cyclictest0-21swapper/211:49:052
13718998439,37cyclictest0-21swapper/211:49:052
1371899843,31cyclictest15697-21sendmail_mailqu12:34:392
13718998430,46cyclictest0-21swapper/207:54:082
13718998430,46cyclictest0-21swapper/207:54:082
13718998425,48cyclictest0-21swapper/210:59:082
13713998454,22cyclictest2753-21latency_hist08:14:091
13713998441,36cyclictest23148-21timerandwakeup07:34:421
13713998437,41cyclictest16340-21sh10:48:221
13713998436,41cyclictest0-21swapper/109:15:041
13713998435,42cyclictest0-21swapper/110:09:051
13713998435,41cyclictest0-21swapper/112:24:381
13713998432,45cyclictest0-21swapper/110:59:301
1370599843,28cyclictest21086-21cstates09:09:230
13718998366,11cyclictest20190-21ssh09:59:422
13718998361,11cyclictest0-21swapper/212:24:092
13718998361,11cyclictest0-21swapper/212:24:092
13718998333,43cyclictest0-21swapper/210:39:402
13718998329,45cyclictest0-21swapper/212:29:492
13713998355,20cyclictest14268-21sh12:33:021
13713998330,28cyclictest4143-21grep12:14:431
13718998256,16cyclictest0-21swapper/208:54:092
1371899824,21cyclictest10127-21apt-get09:44:462
1371899824,21cyclictest10127-21apt-get09:44:462
13718998236,40cyclictest317-21dbus-daemon11:59:072
13718998234,42cyclictest0-21swapper/209:24:342
1371899823,43cyclictest20786-21apt-get07:29:182
1371899823,32cyclictest29217-21kernelversion07:54:322
13718998223,8cyclictest0-21swapper/212:25:432
13718998220,21cyclictest12051-21ssh11:34:322
13718998220,21cyclictest12051-21ssh11:34:322
13718998214,27cyclictest7380-21awk09:39:402
13718998214,27cyclictest7380-21awk09:39:402
13713998242,34cyclictest0-21swapper/111:39:161
13713998241,32cyclictest0-21swapper/112:34:221
13713998235,41cyclictest4078-21sh10:28:141
1371399822,72cyclictest10131-21wc08:34:401
1371399822,29cyclictest6028-21fschecks_time11:24:281
13713998218,22cyclictest14585-21date11:39:091
13713998218,22cyclictest14585-21date11:39:091
13713998215,7cyclictest0-21swapper/109:20:161
13713998215,7cyclictest0-21swapper/109:20:161
1372299812,46cyclictest0-21swapper/309:49:243
1372299812,46cyclictest0-21swapper/309:49:243
13718998136,38cyclictest0-21swapper/211:29:322
1371899813,27cyclictest9288-21latency_hist08:34:092
1371899813,27cyclictest9288-21latency_hist08:34:092
13718998132,42cyclictest29383-21latency_hist12:04:072
1371399813,27cyclictest30444-21fschecks_time09:24:281
13718998054,16cyclictest0-21swapper/210:49:382
13718998054,16cyclictest0-21swapper/210:49:382
13718998033,40cyclictest0-21swapper/211:10:342
1371899803,25cyclictest26911-21munin-run09:19:072
1371899803,24cyclictest20740-21latency_hist07:29:092
13718998032,41cyclictest0-21swapper/208:59:292
13718998028,44cyclictest0-21swapper/208:44:282
13718998026,46cyclictest9033-21unixbench_singl10:34:442
13718998018,22cyclictest26129-21diskstats11:04:272
1371399803,26cyclictest16377-21ssh09:54:261
13713998031,42cyclictest20616-21diskmemload11:50:441
13713998031,41cyclictest0-21swapper/110:14:231
13713998026,48cyclictest0-21swapper/107:24:181
13713998026,48cyclictest0-21swapper/107:24:181
1371899795,14cyclictest0-21swapper/207:14:302
13718997935,37cyclictest0-21swapper/211:14:452
13718997935,37cyclictest0-21swapper/211:14:452
1371899793,33cyclictest14567-21sh09:50:312
1371899793,33cyclictest14567-21sh09:50:312
1371899793,27cyclictest3248-21cpu08:15:592
1371899793,27cyclictest25247-21ssh10:09:222
1371899793,27cyclictest25247-21ssh10:09:222
1371899793,26cyclictest19161-21/usr/sbin/munin07:24:412
13713997936,36cyclictest0-21swapper/108:09:061
13713997934,39cyclictest0-21swapper/110:34:081
1371399793,25cyclictest3515-21swap11:19:411
13713997929,42cyclictest0-21swapper/109:39:301
13713997929,42cyclictest0-21swapper/109:39:301
1371399792,32cyclictest28922-21latency_hist11:09:091
13718997857,13cyclictest200-21systemd-journal11:50:152
13718997854,16cyclictest27775-21ntp_kernel_pll_09:19:352
13718997854,16cyclictest27775-21ntp_kernel_pll_09:19:352
13718997837,35cyclictest0-21swapper/207:09:412
1371899783,26cyclictest25626-21sshd07:44:162
13718997832,38cyclictest0-21swapper/209:29:412
13718997832,38cyclictest0-21swapper/209:29:412
13718997830,41cyclictest0-21swapper/211:39:422
13718997823,46cyclictest0-21swapper/208:39:302
1371899782,21cyclictest30474-21apt-get07:59:182
1371399784,27cyclictest343-21runrttasks08:54:261
1371399784,27cyclictest343-21runrttasks08:54:261
13713997834,36cyclictest0-21swapper/108:39:431
1371399783,25cyclictest26269-21/usr/sbin/munin10:09:441
1371399783,25cyclictest26269-21/usr/sbin/munin10:09:441
1371399783,20cyclictest7940-21apt-get08:29:191
1371399783,20cyclictest7940-21apt-get08:29:191
13713997827,43cyclictest0-21swapper/108:19:421
13713997825,45cyclictest0-21swapper/111:14:291
13713997825,45cyclictest0-21swapper/111:14:291
13713997824,45cyclictest0-21swapper/109:09:391
1371399782,25cyclictest26982-21fschecks_time11:59:261
13713997822,50cyclictest0-21swapper/110:54:341
1371399782,22cyclictest18174-21runrttasks07:19:381
13713997822,10cyclictest13544-21sh10:43:561
1371399782,18cyclictest6339-21apt-get08:24:181
13713997819,21cyclictest1156-21kernelversion09:29:331
13713997819,21cyclictest1156-21kernelversion09:29:331
13713997817,22cyclictest29818-21users07:54:441
13718997735,35cyclictest0-21swapper/209:34:242
1371899773,28cyclictest19986-21wc09:04:402
13718997720,8cyclictest0-21swapper/212:04:292
13713997727,42cyclictest0-21swapper/109:34:431
1371399772,29cyclictest17198-21sshd07:18:161
1371899764,29cyclictest1076-21latency_hist08:09:082
1371899762,28cyclictest6346-21taskset08:24:202
13718997615,22cyclictest17446-21sh09:55:112
1371399763,29cyclictest11173-21ssh11:33:341
1371399762,24cyclictest17845-21/usr/sbin/munin08:59:271
13713997619,8cyclictest0-21swapper/110:38:541
1371899753,22cyclictest17912-21/usr/sbin/munin07:19:292
1371399753,22cyclictest14385-21/usr/sbin/munin07:09:361
13713997515,22cyclictest27240-21cpu07:49:201
13713997515,22cyclictest27240-21cpu07:49:201
13718997424,43cyclictest0-21swapper/208:54:232
13718997424,43cyclictest0-21swapper/208:54:232
13718997419,21cyclictest4982-21tune2fs08:19:292
1371399742,22cyclictest25908-21/usr/sbin/munin07:44:281
1371399742,20cyclictest19250-21sshd09:04:151
13722997310,46cyclictest0-21swapper/309:44:253
13722997310,46cyclictest0-21swapper/309:44:253
13722996512,31cyclictest0-21swapper/309:14:433
1372299623,43cyclictest24003-21taskset11:54:273
1372299613,39cyclictest26986-21chrt11:04:433
1372299604,38cyclictest14272-21chrt10:44:293
1372299593,41cyclictest25408-21taskset11:03:343
1372299593,39cyclictest9735-21chrt08:34:293
1372299592,42cyclictest25480-21taskset10:09:283
1372299592,42cyclictest25480-21taskset10:09:283
1372299592,42cyclictest13671-21chrt12:31:193
1372299589,35cyclictest0-21swapper/310:59:053
1372299584,36cyclictest0-21swapper/308:15:593
1372299583,37cyclictest29127-21taskset12:03:353
1372299572,38cyclictest21721-21taskset09:09:403
1372299553,38cyclictest6053-21taskset12:19:113
1372299553,38cyclictest6053-21taskset12:19:113
1372299553,38cyclictest17769-21taskset11:44:223
1372299553,38cyclictest17769-21taskset11:44:223
1372299553,36cyclictest31964-21chrt09:26:393
1372299553,35cyclictest4689-21chrt10:29:093
13722995514,26cyclictest14417-21taskset08:49:233
1372299543,37cyclictest10963-21chrt10:39:183
1372299543,36cyclictest30965-21chrt10:19:083
1372299543,36cyclictest16639-21taskset07:14:423
1372299543,35cyclictest17109-21chrt10:49:233
1372299543,35cyclictest17109-21chrt10:49:233
1372299542,35cyclictest29211-21chrt07:54:323
1372299533,39cyclictest3292-21chrt11:19:353
1372299533,37cyclictest8031-21chrt09:40:173
1372299533,37cyclictest8031-21chrt09:40:173
1372299533,37cyclictest2603-21chrt12:13:363
1372299533,34cyclictest8171-21taskset10:34:283
1372299533,34cyclictest3525-21chrt09:34:093
1372299533,34cyclictest3525-21chrt09:34:093
1372299532,38cyclictest24498-21taskset07:39:333
1372299532,34cyclictest16024-21taskset08:54:213
1372299532,34cyclictest16024-21taskset08:54:213
13722995316,23cyclictest1622-21taskset11:16:593
13722995316,23cyclictest1622-21taskset11:16:593
13722995313,28cyclictest31366-21chrt10:19:243
1372299524,32cyclictest23882-21taskset07:39:093
1372299523,36cyclictest18991-21chrt09:04:053
1372299523,36cyclictest11513-21taskset08:39:313
1372299523,33cyclictest18400-21taskset07:19:413
13722995233,10cyclictest55842sleep308:19:433
1372299522,38cyclictest5703-21taskset12:18:593
1372299522,36cyclictest8244-21chrt08:29:273
1372299522,36cyclictest8244-21chrt08:29:273
1372299522,36cyclictest5237-21taskset09:35:553
1372299522,35cyclictest16350-21chrt09:54:243
1372299522,34cyclictest19422-21taskset09:59:273
1372299522,33cyclictest29587-21chrt12:04:123
13722995212,26cyclictest19608-21taskset09:04:303
1372299513,35cyclictest9750-21chrt11:29:443
1372299513,33cyclictest15250-21chrt07:14:063
1372299512,36cyclictest1189-21taskset08:09:103
1372299512,35cyclictest9259-21chrt12:24:263
13722995116,22cyclictest21077-21taskset11:49:293
1372299503,34cyclictest15694-21chrt12:34:393
1372299503,31cyclictest28884-21taskset09:21:243
1372299503,31cyclictest28884-21taskset09:21:243
1372299502,35cyclictest30922-21chrt07:59:343
13722995017,22cyclictest13743-21taskset11:37:213
13722995017,22cyclictest13743-21taskset11:37:213
13722995017,20cyclictest19149-21taskset07:24:103
13722995017,20cyclictest19149-21taskset07:24:103
13722995015,22cyclictest16637-21chrt11:42:033
1372299483,33cyclictest2689-21taskset08:14:083
1372299483,32cyclictest22838-21taskset10:04:373
1372299482,33cyclictest27099-21chrt07:49:093
1372299482,33cyclictest13059-21taskset08:44:293
13722994817,20cyclictest5711-21chrt11:24:163
13722994813,22cyclictest7343-21chrt08:24:573
13722994711,24cyclictest28347-21taskset07:51:243
13722994711,24cyclictest28347-21taskset07:51:243
1372299462,33cyclictest21188-21chrt07:29:333
122462469,21sleep30-21swapper/307:04:243
122462469,21sleep30-21swapper/307:04:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional