You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 09:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Jun 28, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1353221319,55sleep213555-21irqstats18:53:412
146859911630,44cyclictest0-21swapper/020:23:230
146859911630,44cyclictest0-21swapper/020:23:230
146859911597,10cyclictest3441-21runrttasks23:08:300
146859911446,57cyclictest0-21swapper/019:04:400
14685991143,69cyclictest19858-21/usr/sbin/munin21:48:430
14685991113,67cyclictest2983-21runrttasks21:18:470
14685991113,67cyclictest2983-21runrttasks21:18:470
14685991103,58cyclictest21020-21modprobe23:38:090
14696991094,35cyclictest31399-21apt-get19:48:362
146859910723,65cyclictest0-21swapper/023:53:380
146859910723,65cyclictest0-21swapper/023:53:380
14685991063,71cyclictest18829-21sendmail-msp20:48:100
146969910557,41cyclictest352-21runrttasks22:34:042
146859910531,56cyclictest0-21swapper/022:23:280
146859910520,61cyclictest19098-21rm21:46:580
14696991043,40cyclictest10988-21grep00:13:482
14685991043,70cyclictest12963-21rm21:36:310
14685991043,70cyclictest12963-21rm21:36:310
146859910415,58cyclictest7830-21date21:28:140
146859910328,45cyclictest0-21swapper/023:29:020
14685991032,52cyclictest0-21swapper/021:53:480
14685991024,89cyclictest14686-21cat18:58:150
14685991023,64cyclictest22324-21grep23:38:460
146859910235,60cyclictest0-21swapper/019:28:120
146969910151,43cyclictest30225-21fschecks_count19:43:322
14685991013,75cyclictest21974-21/usr/sbin/munin19:18:350
14685991013,69cyclictest352-21runrttasks21:07:150
14685991013,69cyclictest352-21runrttasks21:07:150
14685991013,65cyclictest28177-21ls19:38:100
146859910122,53cyclictest0-21swapper/022:43:460
146859910118,52cyclictest0-21swapper/023:48:170
146969910048,44cyclictest0-21swapper/223:43:472
146969910048,44cyclictest0-21swapper/223:43:472
146969910032,13cyclictest0-21swapper/221:13:122
14685991003,57cyclictest2113-21modprobe22:13:100
14685991003,57cyclictest2113-21modprobe22:13:100
146859910016,67cyclictest17357-21sh00:24:520
146859910016,52cyclictest7637-21sh22:22:000
146859910016,52cyclictest7637-21sh22:22:000
1468999993,74cyclictest27694-21sh23:48:431
1468599997,54cyclictest0-21swapper/021:58:310
1468599997,54cyclictest0-21swapper/021:58:310
14685999938,55cyclictest0-21swapper/019:48:110
1468599993,68cyclictest6568-21taskset23:13:310
1468599993,63cyclictest26298-21latency_hist22:53:130
1468599993,58cyclictest9920-21ssh21:31:210
1468599993,55cyclictest26603-21unin-run19:33:110
1468599992,61cyclictest9651-21fschecks_time23:18:320
1468599992,61cyclictest9651-21fschecks_time23:18:320
14685999924,58cyclictest0-21swapper/000:03:260
14685999924,58cyclictest0-21swapper/000:03:260
14696999834,13cyclictest0-21swapper/223:08:152
14696999834,12cyclictest0-21swapper/223:13:122
14696999831,12cyclictest0-21swapper/200:23:402
14696999817,29cyclictest25617-21cat19:28:372
1468599983,89cyclictest0-21swapper/022:58:210
1468599983,89cyclictest0-21swapper/022:58:210
1468599983,62cyclictest1460-21uname23:58:370
1468599983,60cyclictest0-21swapper/023:43:440
1468599983,60cyclictest0-21swapper/023:43:440
14685999814,66cyclictest20494-21date20:53:120
1469699974,34cyclictest14101-21fschecks_count21:38:322
1469699972,38cyclictest5210-21grep20:03:462
1468599973,55cyclictest9809-21latency_hist00:13:120
1469699964,36cyclictest22863-21/usr/sbin/munin21:53:322
14696999635,13cyclictest0-21swapper/221:28:282
1469699963,38cyclictest9026-21modprobe23:18:092
1469699963,35cyclictest22650-21latency_hist21:53:122
1468599964,57cyclictest0-21swapper/021:41:520
1468599963,62cyclictest17626-21apt-get22:38:240
14685999631,55cyclictest0-21swapper/020:18:320
1469699953,39cyclictest2374-21systemd-journal22:06:152
1469699953,38cyclictest28324-21grep23:49:232
1469699953,36cyclictest1863-21/usr/sbin/munin21:18:432
1469699953,36cyclictest1863-21/usr/sbin/munin21:18:432
1469699953,35cyclictest14972-21mailstats20:34:402
14685999537,51cyclictest0-21swapper/019:13:130
1468599953,62cyclictest12737-21taskset23:23:350
14685999533,53cyclictest0-21swapper/022:35:120
14685999530,58cyclictest0-21swapper/022:03:250
1468599952,49cyclictest0-21swapper/021:15:500
1469699947,38cyclictest352-21runrttasks19:09:042
1469699943,40cyclictest32134-21fschecks_count22:08:322
1469699943,40cyclictest32134-21fschecks_count22:08:322
1469699943,38cyclictest7547-21cpu20:13:262
1469699943,37cyclictest23456-21latency_hist22:48:132
1469699943,26cyclictest352-21runrttasks22:02:302
1469699943,26cyclictest352-21runrttasks22:02:302
1469699942,36cyclictest12579-21fschecks_count20:28:322
1468599948,51cyclictest0-21swapper/023:08:120
1468599943,57cyclictest12011-21ntp_states22:28:400
1468599943,56cyclictest13434-21memory00:18:380
1468599943,53cyclictest12638-21perl20:28:330
1468599943,52cyclictest0-21swapper/019:03:140
1468599943,52cyclictest0-21swapper/019:03:140
1468599942,62cyclictest29004-21sh21:08:420
1468599942,57cyclictest21731-21awk19:18:100
1468599942,55cyclictest22891-21ssh20:58:380
14685999416,47cyclictest10989-21tail00:13:480
1469699934,36cyclictest352-21runrttasks23:23:172
1469699933,37cyclictest6190-21fschecks_time20:08:352
1469699933,35cyclictest23608-21/usr/sbin/munin22:48:492
14685999329,54cyclictest0-21swapper/020:13:320
14685999329,53cyclictest0-21swapper/019:53:320
1468599924,80cyclictest31913-21apt-get19:48:360
1468599923,63cyclictest0-21swapper/020:03:140
14685999223,63cyclictest15350irq/295-2188000.ethernet22:53:420
14685999214,53cyclictest31831-21kworker/u17:3+xprtiod22:14:150
1469699914,39cyclictest5639-21grep22:18:302
1469699914,39cyclictest5639-21grep22:18:302
1469699913,29cyclictest18318-21/usr/sbin/munin23:33:462
14696999132,13cyclictest0-21swapper/219:53:282
1468599912,52cyclictest0-21swapper/020:08:490
1385029120,44sleep30-21swapper/318:53:543
1469699904,36cyclictest32375-21ssh23:55:562
1469699904,36cyclictest32375-21ssh23:55:562
1468999905,67cyclictest3447-21ssh23:08:311
1468599902,56cyclictest21047-21taskset20:53:360
1469699893,33cyclictest10184-21cat23:18:452
1469699893,33cyclictest10184-21cat23:18:452
1468599893,51cyclictest14198-21seq20:33:170
1468599884,50cyclictest16097-21perl20:38:300
1468599884,50cyclictest16097-21perl20:38:300
14696998734,10cyclictest0-21swapper/200:05:322
14696998734,10cyclictest0-21swapper/200:05:322
14689998768,12cyclictest1833-21ssh23:58:461
14689998758,19cyclictest20600-21latency_hist20:53:131
139692877,55sleep114030-21timerandwakeup18:53:561
1468599863,51cyclictest54302chrt20:05:420
14689998562,13cyclictest14676-21cyclictest21:03:441
14689998562,13cyclictest14676-21cyclictest21:03:441
1469699843,34cyclictest352-21runrttasks19:36:172
14689998358,15cyclictest2374-21systemd-journal00:27:091
14689998354,17cyclictest25799-21latency_hist21:58:141
1469699823,30cyclictest19070-21/usr/sbin/munin20:48:422
14689998260,16cyclictest11169-21fschecks_time21:33:321
14689998260,16cyclictest11169-21fschecks_time21:33:321
14689998259,14cyclictest23415-21diskmemload20:58:481
1469699815,47cyclictest26455-21ssh21:03:512
1469699815,47cyclictest26455-21ssh21:03:512
14696998117,54cyclictest17626-21apt-get22:38:262
14689998060,13cyclictest0-21swapper/100:13:361
14689998053,18cyclictest6724-21ssh00:08:121
14689998053,18cyclictest6724-21ssh00:08:121
1469699793,36cyclictest4891-21apt-get21:23:232
14689997956,17cyclictest22228-21timerandwakeup23:38:451
14689997954,19cyclictest15025-21sendmail23:28:091
14689997946,11cyclictest181rcu_preempt22:05:531
14685997925,48cyclictest0-21swapper/019:38:310
14689997853,12cyclictest181rcu_preempt23:36:571
1470499768,33cyclictest0-21swapper/319:48:363
1470499762,29cyclictest15588-21chrt23:28:313
14696997659,11cyclictest22053-21diskmemload21:38:112
14696997659,11cyclictest22053-21diskmemload21:38:112
14689997655,15cyclictest799-21sh21:16:031
14689997650,10cyclictest181rcu_preempt21:58:261
14689997650,10cyclictest181rcu_preempt21:58:261
14689997647,11cyclictest181rcu_preempt19:28:141
14689997614,44cyclictest31-21ksoftirqd/120:18:261
14689997614,38cyclictest2027-21sed19:53:471
1470499752,29cyclictest10922-21chrt21:33:253
1470499752,29cyclictest10922-21chrt21:33:253
14696997534,11cyclictest181rcu_preempt00:08:462
14689997559,10cyclictest7585-21sendmail21:28:101
14689997553,15cyclictest18793-21cpu19:08:271
14689997553,14cyclictest2718-21switchtime21:18:441
14689997553,14cyclictest2718-21switchtime21:18:441
14689997548,9cyclictest181rcu_preempt19:03:121
14689997548,9cyclictest181rcu_preempt19:03:121
1470499743,36cyclictest29451-21chrt23:51:013
1470499742,32cyclictest32210-21chrt23:55:263
1470499742,32cyclictest32210-21chrt23:55:263
14696997458,11cyclictest14676-21cyclictest21:43:352
14696997454,14cyclictest21140-21threads19:13:462
14689997449,9cyclictest181rcu_preempt22:33:251
14689997449,8cyclictest181rcu_preempt23:31:221
14689997440,8cyclictest181rcu_preempt21:28:331
14689997437,10cyclictest181rcu_preempt22:23:471
14689997436,22cyclictest0-21swapper/122:33:141
1470499733,34cyclictest19003-21taskset21:46:423
1470499733,29cyclictest9427-21chrt23:18:263
1470499733,29cyclictest9427-21chrt23:18:263
1470499733,29cyclictest20063-21taskset21:48:283
1470499732,32cyclictest3547-21chrt21:20:203
1470499732,32cyclictest3547-21chrt21:20:203
1470499732,31cyclictest6164-21chrt21:24:173
14689997358,11cyclictest58-21kcompactd020:00:551
14689997357,10cyclictest17808-21kernelversion20:43:351
14689997354,13cyclictest1012-21ssh23:03:451
1468999733,47cyclictest25185-21timerandwakeup23:43:451
1468999733,47cyclictest25185-21timerandwakeup23:43:451
1470499723,28cyclictest27684-21chrt21:07:153
1470499723,28cyclictest27684-21chrt21:07:153
14696997256,10cyclictest25243-21latency_hist21:03:132
14689997247,9cyclictest181rcu_preempt22:53:461
14689997246,8cyclictest181rcu_preempt19:38:311
14696997155,9cyclictest24952-21kworker/u19:219:28:102
14696997134,12cyclictest0-21swapper/223:38:262
1469699713,35cyclictest32402-21latency_hist23:03:132
1469699713,35cyclictest32402-21latency_hist23:03:132
14696997114,9cyclictest181rcu_preempt22:23:252
14689997149,16cyclictest14676-21cyclictest23:21:151
14689997149,16cyclictest14676-21cyclictest23:21:151
14689997147,9cyclictest181rcu_preempt22:13:401
14689997141,22cyclictest24488-21threads22:48:461
14689997133,14cyclictest30325-21tune2fs19:43:331
14689997131,12cyclictest181rcu_preempt00:18:481
1470499703,32cyclictest7988-21chrt00:08:483
1470499703,31cyclictest16140-21chrt00:23:313
14696997052,12cyclictest5076-21latency_hist22:18:122
14696997049,15cyclictest22782-21timerandwakeup19:18:432
14689997050,12cyclictest17209-21systemd-run20:43:101
14689997050,12cyclictest17209-21systemd-run20:43:101
14689997048,15cyclictest19916-21cpu21:48:261
14689997048,14cyclictest0-21swapper/100:08:451
14689997044,9cyclictest181rcu_preempt20:08:251
14689997044,11cyclictest181rcu_preempt22:42:391
1468999703,23cyclictest17134-21apt-get19:03:381
1470499693,32cyclictest16556-21chrt21:43:103
1470499692,25cyclictest2368-21chrt23:59:283
1469699694,44cyclictest18020-21munin-run23:33:102
1469699693,37cyclictest16033-21grep20:38:292
1469699693,37cyclictest16033-21grep20:38:292
1469699693,36cyclictest22053-21diskmemload22:54:202
1469699692,36cyclictest1356-21fschecks_time23:58:342
14689996955,10cyclictest14676-21cyclictest19:18:441
14689996953,10cyclictest22053-21diskmemload23:16:061
14689996947,9cyclictest181rcu_preempt22:10:271
14689996947,9cyclictest181rcu_preempt22:10:271
14689996944,9cyclictest181rcu_preempt20:53:251
1468999694,44cyclictest13042-21mailstats20:28:441
1468999693,33cyclictest21893-21sort19:18:131
14689996933,14cyclictest181rcu_preempt22:47:351
14689996926,37cyclictest301ktimers/121:47:461
1470499683,29cyclictest8262-21taskset22:23:133
1470499683,29cyclictest8262-21taskset22:23:133
1470499683,29cyclictest20015-21chrt20:48:473
14696996834,13cyclictest181rcu_preempt19:43:132
14689996844,8cyclictest181rcu_preempt19:34:251
14689996843,9cyclictest181rcu_preempt22:23:131
14689996843,9cyclictest181rcu_preempt22:23:131
14689996843,8cyclictest181rcu_preempt21:38:471
1468999683,37cyclictest32669-21switchtime19:49:091
14696996751,11cyclictest21442-21kworker/u18:0-rpciod22:28:392
14696996749,11cyclictest0-21swapper/200:23:092
14696996745,12cyclictest0-21swapper/220:23:452
14696996745,12cyclictest0-21swapper/220:23:452
14696996742,18cyclictest352-21runrttasks19:58:372
14689996745,14cyclictest0-21swapper/122:58:481
14689996745,14cyclictest0-21swapper/122:58:481
14689996742,9cyclictest181rcu_preempt21:13:141
14689996732,8cyclictest181rcu_preempt23:54:531
14689996732,8cyclictest181rcu_preempt23:54:531
1470499662,31cyclictest26458-21chrt22:53:133
14696996637,10cyclictest181rcu_preempt21:13:412
14696996636,7cyclictest181rcu_preempt19:08:132
1469699663,29cyclictest9393-21fschecks_time20:18:322
14696996627,31cyclictest16260-21dpkg19:03:122
14696996627,31cyclictest16260-21dpkg19:03:122
14696996611,13cyclictest181rcu_preempt20:53:432
14689996641,12cyclictest0-21swapper/120:34:391
14704996511,13cyclictest0-21swapper/320:08:133
14689996542,8cyclictest181rcu_preempt19:28:351
14689996532,8cyclictest181rcu_preempt20:03:341
1468999653,26cyclictest7921-21latency20:13:351
1470499643,39cyclictest0-21swapper/323:08:283
14696996447,11cyclictest277-21dbus-daemon20:48:102
1470499622,23cyclictest22866-21chrt22:47:013
14689996238,8cyclictest181rcu_preempt20:23:401
14689996238,8cyclictest181rcu_preempt20:23:401
1470499606,23cyclictest0-21swapper/320:33:413
1470499602,32cyclictest17643-21taskset22:38:253
1470499598,15cyclictest0-21swapper/322:23:273
14704995712,34cyclictest0-21swapper/323:48:133
14704995712,34cyclictest0-21swapper/323:48:133
258792560,9sleep30-21swapper/321:58:213
258792560,9sleep30-21swapper/321:58:213
1470499553,36cyclictest917-21kworker/3:1+events19:03:253
1470499543,38cyclictest32466-21taskset22:08:393
1470499543,38cyclictest32466-21taskset22:08:393
1470499543,33cyclictest27409-21chrt19:33:413
1470499542,36cyclictest22928-21taskset20:58:393
1470499534,36cyclictest20522-21chrt19:13:283
1470499532,39cyclictest31451-21taskset22:07:583
1470499532,37cyclictest24802-21chrt21:56:063
1470499523,34cyclictest8296-21chrt21:28:353
1470499522,36cyclictest27798-21chrt22:54:023
1470499514,35cyclictest13641-21chrt00:18:453
1470499513,36cyclictest29919-21chrt19:43:133
1470499513,35cyclictest7716-21chrt20:13:313
1470499513,35cyclictest32690-21chrt23:03:263
1470499513,35cyclictest23875-21taskset19:23:333
1470499513,35cyclictest20167-21taskset19:13:123
1470499513,35cyclictest19932-21taskset23:35:123
1470499512,35cyclictest6628-21chrt23:13:323
1470499504,35cyclictest16085-21taskset20:38:303
1470499504,35cyclictest16085-21taskset20:38:303
1470499504,33cyclictest22769-21taskset19:18:433
1470499503,36cyclictest10784-21chrt00:13:463
1470499503,33cyclictest4254-21chrt00:03:333
1470499503,33cyclictest4254-21chrt00:03:333
1470499502,36cyclictest22134-21taskset23:38:443
1470499493,35cyclictest30643-21chrt21:12:053
1470499492,36cyclictest13099-21chrt22:30:273
1470499492,35cyclictest14604-21chrt23:27:053
1470499484,33cyclictest15117-21chrt18:58:343
1470499484,33cyclictest15117-21chrt18:58:343
1470499483,34cyclictest16124-21chrt22:35:333
1470499483,33cyclictest29550-21taskset22:58:163
1470499483,33cyclictest29550-21taskset22:58:163
1470499483,33cyclictest2727-21chrt22:13:333
1470499483,33cyclictest1749-21chrt21:18:133
1470499483,32cyclictest31452-21taskset19:48:113
1470499483,32cyclictest20843-21chrt20:53:293
1470499482,32cyclictest2482-21taskset19:58:123
1470499472,32cyclictest13188-21taskset20:28:463
1470499463,32cyclictest9940-21chrt20:18:463
1470499462,29cyclictest6277-21chrt20:08:373
1470499452,31cyclictest25731-21chrt19:28:393
1470499424,27cyclictest2684-21chrt19:58:203
1470499413,27cyclictest17458-21taskset20:43:243
1470499403,25cyclictest10718-21taskset20:23:153
1470499403,25cyclictest10718-21taskset20:23:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional