You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 14:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Jul 18, 2026 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27304216514,104sleep026940-21/usr/sbin/munin18:53:180
27304216514,104sleep026940-21/usr/sbin/munin18:53:180
2783321550,20sleep10-21swapper/118:53:341
2783321550,20sleep10-21swapper/118:53:341
284449912134,23cyclictest0-21swapper/000:21:520
284549911995,17cyclictest22869-21fschecks_time23:17:092
284549911995,17cyclictest22869-21fschecks_time23:17:092
28444991193,52cyclictest22582-21ntp_kernel_pll_22:22:150
28444991164,34cyclictest30411-21chrt23:29:240
28444991164,34cyclictest30411-21chrt23:29:240
28444991123,36cyclictest2249-21/usr/sbin/munin23:37:160
28444991123,36cyclictest2249-21/usr/sbin/munin23:37:160
28444991122,53cyclictest28004-21runrttasks21:37:170
284489911043,50cyclictest28432-21cyclictest21:44:581
28444991102,44cyclictest21048-21latency_hist21:26:510
28444991102,44cyclictest21048-21latency_hist21:26:510
284449910950,13cyclictest28432-21cyclictest22:16:250
284449910950,13cyclictest28432-21cyclictest22:16:250
28444991094,30cyclictest13288-21latency_hist23:01:500
28444991092,30cyclictest13576-21/usr/sbin/munin23:02:240
28444991083,37cyclictest7263-21latency_hist22:51:510
28444991083,37cyclictest7263-21latency_hist22:51:510
28444991073,49cyclictest12353-21grep23:53:230
28444991073,29cyclictest4938-21timerandwakeup21:52:220
28444991073,28cyclictest5730-21ssh23:42:140
284449910523,33cyclictest31850-21ssh23:32:020
28444991044,36cyclictest16632-21ssh00:00:480
28444991044,33cyclictest352-21runrttasks19:02:120
28444991043,37cyclictest352-21runrttasks19:01:510
28444991043,37cyclictest352-21runrttasks19:01:510
28444991043,33cyclictest352-21runrttasks21:08:580
28444991014,45cyclictest21452-21fschecks_count21:27:090
28454999769,19cyclictest5108-21latency_hist23:41:512
28454999769,19cyclictest5108-21latency_hist23:41:512
28454999370,13cyclictest0-21swapper/223:51:492
28454999327,29cyclictest30642-21ssh21:42:082
28448999227,26cyclictest3405-21seq19:17:131
2802229228,44sleep30-21swapper/318:53:383
2802229228,44sleep30-21swapper/318:53:383
28454999166,14cyclictest0-21swapper/222:57:182
28454999073,11cyclictest22112-21ssh22:22:032
2844499908,25cyclictest0-21swapper/020:57:360
2844499908,25cyclictest0-21swapper/020:57:360
28454998926,23cyclictest18265-21seq23:08:572
28454998926,23cyclictest18265-21seq23:08:572
28448998920,31cyclictest18934-21munin-run20:06:481
28448998920,31cyclictest18934-21munin-run20:06:481
28444998964,10cyclictest181rcu_preempt22:09:230
28454998825,26cyclictest12214-21seq19:43:502
28448998870,11cyclictest8080-21latency_hist23:46:511
28448998763,12cyclictest0-21swapper/119:56:571
28444998768,12cyclictest2374-21systemd-journal21:04:290
28448998627,26cyclictest29039-21seq20:37:081
28454998543,30cyclictest31808-21kworker/u19:0+nfsiod22:11:342
28454998524,23cyclictest4599-21latency_hist19:21:522
28444998551,26cyclictest0-21swapper/023:22:110
28454998455,18cyclictest0-21swapper/221:12:262
28448998463,12cyclictest0-21swapper/120:12:101
28448998463,12cyclictest0-21swapper/120:12:101
28448998426,18cyclictest12962-21seq23:53:451
28448998425,22cyclictest10497-21seq21:07:551
28448998423,22cyclictest2324-21seq20:53:041
28454998349,9cyclictest181rcu_preempt22:37:052
28454998325,28cyclictest3937-21seq22:45:582
28454998321,23cyclictest352-21runrttasks20:59:192
28454998321,23cyclictest352-21runrttasks20:59:192
2844899837,53cyclictest8182-21ssh23:46:561
28448998342,26cyclictest15215-21apt-get21:17:041
2844899833,33cyclictest7050-21find21:02:241
28448998326,26cyclictest18568-21seq00:02:541
28448998323,23cyclictest13928-21seq19:49:451
28454998254,18cyclictest0-21swapper/222:32:132
28454998216,24cyclictest0-21swapper/222:14:442
28454998216,24cyclictest0-21swapper/222:14:442
28448998243,32cyclictest23442-21kworker/u18:1+nfsiod21:30:401
28454998163,9cyclictest0-21swapper/221:17:212
28454998159,12cyclictest0-21swapper/219:47:212
28454998119,28cyclictest0-21swapper/221:23:392
28454998119,28cyclictest0-21swapper/221:23:392
28448998160,12cyclictest0-21swapper/100:07:251
2844899814,56cyclictest3194-21apt-get20:57:031
2844899814,56cyclictest3194-21apt-get20:57:031
28448998126,24cyclictest26978-21seq22:29:481
28448998123,23cyclictest31814-21seq19:04:291
28444998160,13cyclictest2638-21diskmemload00:14:200
28444998160,13cyclictest2638-21diskmemload00:14:200
28454998031,20cyclictest297-21systemd-logind22:31:492
28454998026,25cyclictest2287-21seq21:47:512
28454998024,23cyclictest9152-21seq22:53:442
28448998064,8cyclictest0-21swapper/122:16:511
28448998064,8cyclictest0-21swapper/122:16:511
28448998029,13cyclictest181rcu_preempt23:37:221
28448998029,13cyclictest181rcu_preempt23:37:221
28448998026,18cyclictest1307-21seq23:35:001
28448998025,19cyclictest25548-21seq00:15:511
28448998025,19cyclictest25548-21seq00:15:511
28448998022,23cyclictest9177-21seq22:53:481
28444998055,18cyclictest20965-21sh00:07:210
97032790,10sleep10-21swapper/122:01:471
28454997957,12cyclictest0-21swapper/220:21:502
28454997924,25cyclictest9621-21seq22:01:382
28454997920,21cyclictest18645-21seq20:03:302
28454997920,21cyclictest18645-21seq20:03:302
28448997959,11cyclictest0-21swapper/120:47:221
28448997959,11cyclictest0-21swapper/120:47:221
28448997955,13cyclictest0-21swapper/119:52:131
28448997932,34cyclictest4663-21apt-get19:21:581
28448997926,40cyclictest0-21swapper/118:57:001
28448997926,40cyclictest0-21swapper/118:57:001
28448997925,19cyclictest6659-21seq21:56:431
28444997962,11cyclictest19612-21ntp_offset22:17:160
28444997954,18cyclictest544-21cron19:26:480
2844499793,33cyclictest10867-21cron23:51:470
2844499792,44cyclictest12503-21fschecks_time21:12:110
2846199783,30cyclictest14938-21chrt19:52:193
28454997863,8cyclictest0-21swapper/222:02:072
28454997863,8cyclictest0-21swapper/222:02:072
28454997853,17cyclictest28851-21latency_hist00:21:502
28454997836,31cyclictest19219-21apt-get20:07:032
28454997836,31cyclictest19219-21apt-get20:07:032
28454997821,27cyclictest352-21runrttasks21:02:322
28448997859,9cyclictest0-21swapper/123:57:221
28448997856,15cyclictest28432-21cyclictest23:31:511
28448997856,15cyclictest28432-21cyclictest23:31:511
28448997832,36cyclictest0-21swapper/122:17:021
28448997826,22cyclictest980-21seq19:09:191
28448997818,27cyclictest30711-21unixbench_multi00:23:271
2844499784,40cyclictest19330-21unin-run23:11:490
2844499784,40cyclictest19330-21unin-run23:11:490
2844499783,42cyclictest20807-21/usr/sbin/munin20:12:220
2844499783,42cyclictest20807-21/usr/sbin/munin20:12:220
2844499782,66cyclictest12700-21sendmail22:06:480
2844499782,66cyclictest12700-21sendmail22:06:480
2766527826,28sleep20-21swapper/218:53:322
2766527826,28sleep20-21swapper/218:53:322
2846199773,31cyclictest11314-21chrt19:42:113
28454997761,11cyclictest28432-21cyclictest21:07:252
28454997759,10cyclictest28432-21cyclictest19:37:212
28454997759,10cyclictest28432-21cyclictest19:37:212
28454997754,17cyclictest16263-21ssh23:06:472
28454997725,22cyclictest31215-21seq23:31:392
28454997725,22cyclictest31215-21seq23:31:392
28448997759,10cyclictest1253-21modprobe22:41:471
28448997750,18cyclictest13202-21sh23:01:361
28448997725,23cyclictest7458-21seq19:29:361
28448997725,23cyclictest7458-21seq19:29:361
28448997725,22cyclictest19185-21seq23:11:321
28448997725,22cyclictest19185-21seq23:11:321
28448997725,21cyclictest20260-21seq20:08:081
28448997725,21cyclictest20260-21seq20:08:081
2844499775,60cyclictest25040-21ssh22:27:000
28444997753,17cyclictest17283-21ssh00:01:580
28454997643,23cyclictest30660-21apt-get19:02:032
28454997636,33cyclictest19034-21ssh22:17:022
28448997650,18cyclictest28253-21modprobe23:26:471
28448997631,32cyclictest12737-21idleruntime-cro22:06:481
28448997631,32cyclictest12737-21idleruntime-cro22:06:481
28448997627,41cyclictest19755-21ssh23:12:061
28448997624,22cyclictest25074-21seq20:23:071
28444997652,7cyclictest181rcu_preempt20:21:500
2844499763,54cyclictest24451-21apt-get21:32:240
2844499763,40cyclictest1559-21sort22:42:000
28454997555,10cyclictest0-21swapper/221:52:122
28454997533,34cyclictest0-21swapper/220:26:592
28454997522,21cyclictest31596-21seq20:43:572
28454997517,25cyclictest0-21swapper/220:33:232
28448997555,13cyclictest30691-21cron22:36:471
28448997526,38cyclictest8664-21awk19:32:231
28448997526,38cyclictest8664-21awk19:32:231
28444997548,17cyclictest0-21swapper/022:41:490
28444997544,13cyclictest28432-21cyclictest23:14:290
28444997537,28cyclictest9572-21ls19:37:040
28444997537,28cyclictest9572-21ls19:37:040
2844499753,40cyclictest10310-21munin-run22:56:470
2844499753,35cyclictest16238-21fschecks_time19:57:090
2846199743,29cyclictest4434-21chrt20:58:213
2846199743,29cyclictest4434-21chrt20:58:213
2846199743,26cyclictest10024-21chrt22:02:013
2846199743,26cyclictest10024-21chrt22:02:013
2846199742,34cyclictest3068-21chrt21:50:013
28448997454,14cyclictest14472-21threads23:02:251
28448997454,13cyclictest26834-21kworker/u17:2+flush-179:020:42:241
28444997438,31cyclictest0-21swapper/022:01:500
2846199732,30cyclictest3488-21chrt22:44:433
28454997351,13cyclictest0-21swapper/221:27:162
28454997348,17cyclictest1943-21latency_hist23:36:502
28448997356,7cyclictest0-21swapper/123:17:041
28448997356,7cyclictest0-21swapper/123:17:041
28448997354,10cyclictest0-21swapper/122:47:241
28448997354,10cyclictest0-21swapper/122:47:241
28448997325,41cyclictest12863-21ntpq21:12:201
28448997325,36cyclictest9865-21kernelversion19:37:131
28448997325,36cyclictest9865-21kernelversion19:37:131
28448997313,23cyclictest15736-21systemd-run22:11:481
28444997357,10cyclictest7645-21latency_hist19:31:470
28444997357,10cyclictest7645-21latency_hist19:31:470
28444997353,14cyclictest58-21kcompactd019:07:070
28444997353,12cyclictest25341-21ssh23:21:500
28444997353,12cyclictest25341-21ssh23:21:500
28444997343,10cyclictest181rcu_preempt19:42:020
28444997342,22cyclictest30752-21grep20:42:110
2844499733,33cyclictest3087-21sort20:56:520
2846199722,30cyclictest9838-21chrt23:48:543
28454997255,13cyclictest28432-21cyclictest23:15:122
28454997248,16cyclictest0-21swapper/221:37:172
28454997226,31cyclictest0-21swapper/218:57:002
28454997226,31cyclictest0-21swapper/218:57:002
28454997222,19cyclictest5665-21seq19:22:362
28454997222,19cyclictest352-21runrttasks23:22:272
28454997220,21cyclictest0-21swapper/220:25:462
28454997219,13cyclictest0-21swapper/220:41:502
28454997218,21cyclictest0-21swapper/220:55:142
28448997220,21cyclictest352-21runrttasks22:23:271
2844499725,58cyclictest28242-21fschecks_count22:32:090
2844499723,34cyclictest352-21runrttasks21:20:180
28444997230,9cyclictest181rcu_preempt20:07:030
28444997230,9cyclictest181rcu_preempt20:07:030
2846199712,30cyclictest25974-21taskset22:27:243
28454997144,21cyclictest2638-21diskmemload00:12:142
28454997144,21cyclictest2638-21diskmemload00:12:142
28454997133,25cyclictest7908-21apt-get19:32:042
28454997133,25cyclictest7908-21apt-get19:32:042
28454997122,26cyclictest352-21runrttasks21:35:472
2844899715,57cyclictest27684-21grep20:32:141
28448997149,12cyclictest0-21swapper/121:37:121
28448997133,33cyclictest0-21swapper/121:47:041
28444997150,12cyclictest0-21swapper/020:02:100
28444997150,12cyclictest0-21swapper/020:02:100
28444997135,27cyclictest0-21swapper/019:53:170
2844499713,30cyclictest1020-21apt-get21:46:590
28454997051,12cyclictest28432-21cyclictest23:57:212
28454997050,13cyclictest19676-21snmpd00:24:082
28454997025,38cyclictest14791-21latency19:52:132
28454997018,25cyclictest352-21runrttasks19:10:532
28454997010,26cyclictest0-21swapper/222:47:202
28454997010,26cyclictest0-21swapper/222:47:202
28448997033,29cyclictest24451-21apt-get21:32:351
28448997021,20cyclictest352-21runrttasks00:18:591
2844499705,34cyclictest352-21runrttasks19:47:070
28444997047,15cyclictest0-21swapper/019:36:500
28444997047,15cyclictest0-21swapper/019:36:500
2844499703,51cyclictest30546-21sort21:42:050
28444997014,25cyclictest1431-21find19:11:570
2846199693,32cyclictest27783-21chrt21:37:123
2846199693,30cyclictest27229-21chrt23:23:563
28454996948,12cyclictest0-21swapper/219:27:192
28454996948,12cyclictest0-21swapper/219:27:192
2844499698,23cyclictest30297-21ntp_states00:23:200
2846199684,32cyclictest20618-21chrt00:07:103
2846199684,25cyclictest7731-21chrt19:31:503
2846199684,25cyclictest7731-21chrt19:31:503
28454996835,24cyclictest1447-21apt-get19:11:582
28454996827,35cyclictest7430-21ssh23:45:342
2844499684,42cyclictest352-21runrttasks19:17:590
2844499683,45cyclictest27255-21/usr/sbin/munin20:32:160
2844499683,43cyclictest29134-21tune2fs20:37:110
2846199672,31cyclictest25659-21chrt21:33:113
28448996751,9cyclictest0-21swapper/122:42:091
28448996749,12cyclictest18179-21/usr/sbin/munin21:22:081
28448996749,12cyclictest18179-21/usr/sbin/munin21:22:081
2844499674,49cyclictest32109-21/usr/sbin/munin20:47:080
2844499674,49cyclictest32109-21/usr/sbin/munin20:47:080
2844499673,43cyclictest27145-21latency_hist20:31:510
2845499663,41cyclictest20807-21/usr/sbin/munin20:12:112
2845499663,41cyclictest20807-21/usr/sbin/munin20:12:112
28454996615,27cyclictest0-21swapper/220:47:102
28454996615,27cyclictest0-21swapper/220:47:102
28448996630,31cyclictest0-21swapper/119:11:581
28448996624,19cyclictest12146-21seq19:42:571
28448996619,21cyclictest0-21swapper/120:29:141
2844499664,41cyclictest24217-21fschecks_count20:22:100
28454996547,9cyclictest0-21swapper/200:07:222
28454996524,32cyclictest352-21runrttasks23:52:192
28448996536,20cyclictest22428-21apt-get20:16:581
28454996430,24cyclictest17304-21apt-get00:01:592
28454996324,34cyclictest0-21swapper/219:57:022
28461996216,14cyclictest0-21swapper/323:37:153
28461996216,14cyclictest0-21swapper/323:37:153
28461996018,11cyclictest0-21swapper/323:36:483
2846199596,40cyclictest25880-21chrt00:16:473
2846199596,40cyclictest25880-21chrt00:16:473
2846199595,37cyclictest2974-21taskset19:16:513
2846199593,42cyclictest12195-21taskset23:53:203
2846199563,40cyclictest25144-21taskset23:21:293
2846199563,40cyclictest25144-21taskset23:21:293
2846199563,38cyclictest26433-21chrt20:27:233
2846199554,35cyclictest19923-21taskset00:06:463
2846199553,40cyclictest30013-21chrt00:23:133
2846199553,37cyclictest8809-21chrt22:52:463
2846199553,37cyclictest31144-21taskset22:37:053
2846199552,39cyclictest19323-21chrt22:17:103
2846199543,38cyclictest22454-21chrt23:16:503
2846199543,38cyclictest18374-21chrt20:02:243
2846199543,38cyclictest18374-21chrt20:02:243
2846199543,36cyclictest23355-21chrt20:17:233
2846199543,36cyclictest16260-21taskset19:57:093
2846199543,35cyclictest30634-21chrt21:42:073
2846199542,36cyclictest30574-21chrt22:36:283
2846199542,36cyclictest19242-21chrt21:22:243
2846199542,36cyclictest19242-21chrt21:22:243
2846199533,37cyclictest27253-21taskset00:17:243
2846199533,37cyclictest20982-21taskset20:12:083
2846199533,37cyclictest20982-21taskset20:12:083
2846199533,36cyclictest6352-21taskset21:02:063
2846199533,36cyclictest21740-21taskset21:27:153
2846199533,35cyclictest6435-21chrt21:56:053
2846199533,35cyclictest29123-21taskset18:57:153
2846199533,35cyclictest29123-21taskset18:57:153
2846199533,33cyclictest5432-21chrt22:47:233
2846199533,33cyclictest5432-21chrt22:47:233
2846199533,33cyclictest32455-21taskset19:07:073
2846199532,39cyclictest5502-21chrt23:42:093
2846199532,36cyclictest22287-21chrt22:22:093
2846199532,35cyclictest4646-21chrt19:21:583
2846199532,35cyclictest16792-21chrt23:07:053
2846199532,35cyclictest16792-21chrt23:07:053
2846199524,36cyclictest1976-21chrt20:52:223
2846199523,36cyclictest15893-21chrt22:11:513
2846199523,35cyclictest14485-21taskset23:57:053
2846199523,34cyclictest7011-21chrt21:56:593
2846199523,34cyclictest14228-21taskset19:51:513
2846199523,33cyclictest13333-21chrt21:12:273
2846199522,33cyclictest24617-21chrt20:22:213
2846199513,35cyclictest10974-21taskset19:41:503
2846199513,35cyclictest10974-21taskset19:41:503
2846199513,34cyclictest27900-21chrt20:32:213
2846199512,37cyclictest13242-21chrt23:01:423
2846199512,34cyclictest30446-21chrt19:01:573
2846199512,34cyclictest13607-21chrt23:01:583
2846199503,33cyclictest585-21chrt20:47:243
2846199503,33cyclictest585-21chrt20:47:243
2846199502,36cyclictest10686-21taskset21:08:263
2846199492,36cyclictest15456-21chrt21:17:103
2846199492,35cyclictest19968-21chrt20:07:223
2846199492,35cyclictest19968-21chrt20:07:223
2846199492,34cyclictest17457-21chrt22:13:213
2846199492,34cyclictest17457-21chrt22:13:213
2846199492,32cyclictest29156-21taskset20:37:113
2846199473,32cyclictest8642-21chrt19:32:233
2846199473,32cyclictest8642-21chrt19:32:233
2846199473,29cyclictest31701-21chrt20:45:173
2846199462,32cyclictest28812-21chrt23:27:083
2846199462,32cyclictest28812-21chrt23:27:083
2846199433,27cyclictest3552-21chrt19:17:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional