You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 13:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon May 18, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305609912844,12cyclictest0-21swapper/022:05:570
305609912437,21cyclictest0-21swapper/019:31:010
305609912354,18cyclictest31925-21latency20:41:230
30560991153,31cyclictest20604-21apt.systemd.dai23:13:410
30560991123,32cyclictest2385-21cat23:36:350
1118221090,13sleep1291rcuc/122:04:451
30560991086,45cyclictest19312-21munin-run00:05:570
30560991086,45cyclictest19312-21munin-run00:05:570
114721030,5sleep20-21swapper/220:46:242
1088921020,7sleep210895-21sed22:56:362
200582960,6sleep3451rcuc/320:06:153
30560999263,21cyclictest3489-21latency_hist19:16:000
30560999164,20cyclictest14936-21latency_hist19:50:590
30560999164,20cyclictest14936-21latency_hist19:50:590
30577998969,12cyclictest13982-21ssh23:56:202
30568998970,13cyclictest32719-21fschecks_count19:06:091
30560998963,20cyclictest29756-21cron22:36:020
3056099883,65cyclictest6488-21latency_hist22:50:560
3056899872,54cyclictest30326-21apt-get22:36:191
30560998658,19cyclictest32238-21latency_hist19:06:000
30560998658,19cyclictest32238-21latency_hist19:06:000
3056099864,74cyclictest10328-21date23:51:000
3056099864,74cyclictest10328-21date23:51:000
3057799854,48cyclictest13095-21fschecks_time23:01:212
291772857,54sleep229187-21cstates18:56:182
291772857,54sleep229187-21cstates18:56:182
30577998461,16cyclictest1566-21systemd-run00:30:582
3056099848,60cyclictest5272-21diskmemload23:31:170
30577998367,11cyclictest30547-21cyclictest21:41:202
30577998367,11cyclictest30547-21cyclictest21:41:202
30577998323,24cyclictest28548-21diskmemload22:32:312
30568998341,33cyclictest1-21systemd23:51:001
30568998341,33cyclictest1-21systemd23:51:001
30560998360,16cyclictest30547-21cyclictest21:31:320
30560998360,16cyclictest30547-21cyclictest21:31:320
30560998347,13cyclictest181rcu_preempt20:51:090
2996128311,34sleep10-21swapper/118:56:461
2996128311,34sleep10-21swapper/118:56:461
30577998213,27cyclictest27396-21seq00:19:052
30577998159,16cyclictest30409-21latency_hist23:31:012
30577998150,22cyclictest27177-21sh21:36:322
30568998162,13cyclictest7088-21cpuspeed19:26:141
30568998158,17cyclictest2016-21munin-run20:50:571
30568998153,20cyclictest26894-21latency_hist22:31:001
3056899813,71cyclictest25045-21apt-get20:21:141
3056899812,47cyclictest12177-21apt-get22:06:151
30560998160,14cyclictest14400-21awk23:56:310
30560998147,12cyclictest181rcu_preempt22:06:290
30560998139,15cyclictest181rcu_preempt19:11:000
3058499807,47cyclictest0-21swapper/319:21:253
3057799804,59cyclictest15125-21sshd19:51:082
30577998016,27cyclictest27720-21seq20:27:352
30577998016,27cyclictest27720-21seq20:27:352
30560998053,19cyclictest29821-21sh22:35:580
3056099803,43cyclictest352-21runrttasks22:27:060
2967328011,39sleep30-21swapper/318:56:403
2967328011,39sleep30-21swapper/318:56:403
30568997962,11cyclictest23299-21runrttasks22:24:351
30568997946,12cyclictest181rcu_preempt21:58:011
3056099793,38cyclictest352-21runrttasks22:42:350
3056099793,38cyclictest352-21runrttasks22:42:350
30577997817,24cyclictest30961-21seq20:37:272
30577997816,24cyclictest22652-21seq20:12:282
30577997816,24cyclictest15759-21seq21:16:532
30568997857,14cyclictest13751-21fschecks_time19:46:201
30568997857,14cyclictest13751-21fschecks_time19:46:201
30568997854,18cyclictest16312-21sh00:00:571
30560997854,15cyclictest7240-21ssh23:45:590
30560997854,15cyclictest7240-21ssh23:45:590
30584997727,25cyclictest0-21swapper/323:51:593
30577997760,11cyclictest31454-21ssh23:32:022
30577997716,29cyclictest352-21runrttasks23:16:282
30577997716,26cyclictest8855-21seq22:54:102
30568997754,17cyclictest277-21dbus-daemon21:00:591
30560997754,13cyclictest28264-21ssh00:21:000
30560997754,13cyclictest0-21swapper/021:16:120
30560997740,29cyclictest15180-21sshd20:16:070
3056099773,39cyclictest10639-21switchtime22:56:330
30577997656,14cyclictest32725-21fschecks_count19:06:092
30568997658,12cyclictest6351-21sh21:01:321
30568997658,12cyclictest6351-21sh21:01:321
30568997650,16cyclictest9512-21timerwakeupswit19:31:341
30568997647,8cyclictest181rcu_preempt00:14:501
30568997646,23cyclictest31406-21latency_hist20:41:001
30568997640,10cyclictest12309-21ssh23:53:001
3056899762,26cyclictest31-21ksoftirqd/120:55:491
3056099767,37cyclictest32442-21/usr/sbin/munin21:46:360
30560997655,14cyclictest25697-21ssh23:21:330
30560997647,22cyclictest21339-21sh22:21:190
30560997646,22cyclictest31285-21ssh21:43:350
30560997646,22cyclictest31285-21ssh21:43:350
3056099763,58cyclictest1274-21kworker/u19:0+ext4-rsv-conversion19:21:250
3056099763,36cyclictest20406-21latency_hist21:26:010
3056099763,36cyclictest20406-21latency_hist21:26:010
30577997553,15cyclictest2581-21sh23:36:372
30577997552,16cyclictest3222-21sh21:51:202
30577997551,18cyclictest27540-21latency_hist23:26:002
30577997517,29cyclictest4957-21seq22:46:402
30577997517,23cyclictest3027-21seq19:12:302
30568997552,15cyclictest352-21runrttasks23:11:011
30568997550,16cyclictest14786-21diskmemload23:04:081
30568997533,11cyclictest181rcu_preempt20:26:201
30568997533,11cyclictest181rcu_preempt20:26:201
30568997529,27cyclictest5272-21diskmemload23:16:341
3056899752,37cyclictest17842-21sh22:15:571
30560997545,12cyclictest25329-21acpi00:16:250
3056099754,35cyclictest5963-21/usr/sbin/munin21:56:160
30577997459,9cyclictest8306-21switchtime23:46:312
30577997459,9cyclictest8306-21switchtime23:46:312
30577997451,15cyclictest30547-21cyclictest23:10:272
3056899746,23cyclictest31-21ksoftirqd/121:15:241
30568997456,10cyclictest0-21swapper/119:51:331
3056899742,31cyclictest31-21ksoftirqd/100:22:011
30560997459,9cyclictest19720-21rm00:06:140
30560997439,23cyclictest19713-21kworker/u18:2+flush-179:020:21:410
30560997438,13cyclictest181rcu_preempt21:15:320
3056099743,43cyclictest10650-21ssh23:51:040
3056099743,35cyclictest17843-21latency_hist22:16:010
3056099742,46cyclictest13223-21ls19:45:570
30560997410,27cyclictest15-21ksoftirqd/021:10:130
30560997410,27cyclictest15-21ksoftirqd/021:10:130
30577997358,9cyclictest8949-21idleruntime21:06:252
30577997358,9cyclictest8949-21idleruntime21:06:252
30577997352,15cyclictest30547-21cyclictest20:56:002
3057799733,48cyclictest21002-21latency_hist22:20:592
30568997352,12cyclictest0-21swapper/119:36:351
3056899733,28cyclictest9933-21cstates22:56:151
30560997352,13cyclictest21770-21/usr/sbin/munin23:16:250
30577997253,13cyclictest20749-21fschecks_count21:26:212
3057799724,48cyclictest32346-21sort20:41:332
30577997239,9cyclictest181rcu_preempt23:11:202
30568997251,14cyclictest1778-21latency_hist00:31:011
30568997250,15cyclictest19690-21munin-run20:05:571
30568997247,17cyclictest22462-21kworker/u17:1-nfsiod23:07:481
30560997250,12cyclictest0-21swapper/019:40:560
30560997249,16cyclictest26610-21cpuspeed21:36:150
3057799713,46cyclictest23604-21timerwakeupswit00:11:342
30577997125,41cyclictest0-21swapper/219:41:142
30568997147,13cyclictest0-21swapper/123:26:331
3056899712,48cyclictest23191-21grep21:30:571
30560997136,10cyclictest181rcu_preempt23:26:080
30560997111,31cyclictest21341-21sendmail-msp20:10:570
30577997057,9cyclictest30547-21cyclictest21:46:342
3057799702,44cyclictest10131-21latency_hist19:36:002
30568997048,15cyclictest17313-21proc_pri00:01:301
30568997048,15cyclictest17313-21proc_pri00:01:301
30568997027,28cyclictest31-21ksoftirqd/122:33:521
3056899702,39cyclictest4796-21fschecks_time23:41:211
3056899702,39cyclictest4796-21fschecks_time23:41:211
3056099703,54cyclictest352-21runrttasks00:26:030
3056099703,53cyclictest5372-21latency_hist21:01:000
3056099703,51cyclictest23183-21awk21:30:570
3056099703,35cyclictest19244-21unixbench_singl22:16:350
30560997018,27cyclictest29061-21timerandwakeup20:31:330
30560997018,27cyclictest29061-21timerandwakeup20:31:330
30560997010,29cyclictest4916-21munin-run19:20:570
30577996954,10cyclictest6546-21ntp_kernel_err21:56:262
30577996949,12cyclictest0-21swapper/220:25:572
3057799694,43cyclictest21120-21/usr/sbin/munin22:21:222
3057799694,42cyclictest5909-21fschecks_time21:01:212
3057799694,42cyclictest5909-21fschecks_time21:01:212
3057799693,43cyclictest547-21idleruntime-cro22:40:572
30577996932,25cyclictest32064-21modprobe19:05:572
30577996932,25cyclictest32064-21modprobe19:05:572
30577996915,23cyclictest17949-21seq19:59:282
30568996954,10cyclictest352-21runrttasks00:19:501
30568996947,15cyclictest26248-21latency_hist21:35:591
30568996947,15cyclictest26248-21latency_hist21:35:591
30560996953,9cyclictest29174-21ssh00:21:330
30577996852,11cyclictest13619-21kworker/u18:2-writeback00:05:592
30577996852,11cyclictest13619-21kworker/u18:2-writeback00:05:592
3057799683,45cyclictest21112-21sh00:07:402
30577996813,28cyclictest13870-21grep19:46:232
30577996813,28cyclictest13870-21grep19:46:232
30568996850,11cyclictest0-21swapper/121:36:151
30568996847,8cyclictest181rcu_preempt21:41:251
30568996847,8cyclictest181rcu_preempt21:41:251
30568996847,7cyclictest181rcu_preempt00:06:241
30568996846,14cyclictest5753-21fschecks_time19:22:131
30568996839,19cyclictest2192-21fschecks_time19:11:201
3056899683,56cyclictest24786-21ssh23:21:111
3056899683,36cyclictest5350-21cmp19:21:011
3056899682,33cyclictest19755-21ssh22:17:581
3056899681,34cyclictest31-21ksoftirqd/123:33:311
30560996845,15cyclictest16836-21cstates19:56:160
30560996823,32cyclictest15994-21fschecks_count23:06:190
30577996749,13cyclictest24244-21mailstats21:31:312
30577996749,13cyclictest24244-21mailstats21:31:312
30577996741,18cyclictest24602-21unin-run20:20:592
30577996716,45cyclictest10694-21apt-get23:52:162
30568996743,13cyclictest0-21swapper/119:41:201
3056899673,28cyclictest31-21ksoftirqd/123:39:181
3056899672,35cyclictest31-21ksoftirqd/121:55:371
30568996717,18cyclictest301ktimers/119:01:271
30568996717,18cyclictest301ktimers/119:01:271
3056899671,26cyclictest22447-21/usr/sbin/munin20:11:351
30568996711,31cyclictest31-21ksoftirqd/120:00:091
30577996649,13cyclictest26164-21kworker/u17:3+events_unbound00:25:562
30577996644,12cyclictest0-21swapper/220:56:352
3057799664,40cyclictest10016-21grep22:01:362
30577996641,15cyclictest0-21swapper/222:06:542
3056899664,52cyclictest3835-21ssh22:46:091
30568996640,18cyclictest0-21swapper/121:51:081
30568996640,16cyclictest0-21swapper/120:16:311
30568996637,20cyclictest21287-21cron20:10:571
30568996624,13cyclictest0-21swapper/121:21:191
30568996624,13cyclictest0-21swapper/121:21:191
3056899662,25cyclictest31-21ksoftirqd/122:52:231
30560996641,18cyclictest9570-21latency_hist22:55:590
30560996639,10cyclictest181rcu_preempt23:01:090
3056099663,51cyclictest960-21idleruntime20:46:190
3056099663,49cyclictest3372-21fschecks_time21:51:300
30577996552,9cyclictest30547-21cyclictest22:26:192
3057799654,39cyclictest17620-21ssh21:21:142
3057799654,39cyclictest17620-21ssh21:21:142
3057799653,41cyclictest352-21runrttasks19:20:222
30577996514,25cyclictest0-21swapper/221:11:132
3056899657,8cyclictest181rcu_preempt20:31:321
3056899657,8cyclictest181rcu_preempt20:31:321
30568996548,12cyclictest30547-21cyclictest21:10:531
30568996548,12cyclictest30547-21cyclictest21:10:531
30568996522,27cyclictest31-21ksoftirqd/120:41:431
3056099653,37cyclictest31377-21latency_hist20:40:590
3056099653,24cyclictest6593-21unixbench_multi21:01:350
3056099653,24cyclictest6593-21unixbench_multi21:01:350
2906326520,24sleep00-21swapper/018:56:080
2906326520,24sleep00-21swapper/018:56:080
3057799644,33cyclictest352-21runrttasks19:28:552
3057799643,38cyclictest21433-21latency_hist20:11:002
30577996416,27cyclictest11580-21seq19:40:452
3056899643,42cyclictest15373-21switchtime21:16:321
30560996446,12cyclictest22318-21switchtime20:11:340
3056099643,40cyclictest26831-21grep20:26:190
3056099643,40cyclictest26831-21grep20:26:190
301282640,7sleep30-21swapper/323:30:133
3058499633,39cyclictest2142-21chrt19:11:203
30577996348,10cyclictest25068-21kworker/u18:1-rpciod22:11:102
3057799632,47cyclictest28534-21fschecks_time20:31:202
3057799632,47cyclictest28534-21fschecks_time20:31:202
30577996318,20cyclictest2882-21seq22:44:132
30577996318,20cyclictest2882-21seq22:44:132
3056899636,25cyclictest31-21ksoftirqd/122:41:361
3056899636,25cyclictest31-21ksoftirqd/122:41:361
3056099633,28cyclictest8642-21/usr/sbin/munin19:31:090
3057799625,36cyclictest352-21runrttasks19:23:242
3057799624,38cyclictest4461-21/usr/sbin/munin23:41:332
3057799624,38cyclictest4461-21/usr/sbin/munin23:41:332
3056099624,38cyclictest352-21runrttasks19:55:200
30560996241,13cyclictest0-21swapper/020:01:330
3058499607,37cyclictest0-21swapper/322:06:173
3057799603,36cyclictest352-21runrttasks20:05:502
30584995922,28cyclictest0-21swapper/320:21:483
3058499583,41cyclictest8665-21taskset21:06:183
3058499583,41cyclictest8665-21taskset21:06:183
3058499582,45cyclictest16108-21taskset00:00:223
3058499575,36cyclictest26530-21taskset21:36:133
3058499575,34cyclictest19660-21chrt00:06:143
3058499562,42cyclictest31875-21chrt20:41:233
3058499554,38cyclictest26884-21chrt20:26:203
3058499554,38cyclictest26884-21chrt20:26:203
3058499553,35cyclictest31494-21taskset00:26:143
3058499553,33cyclictest31001-21chrt23:31:113
3058499552,39cyclictest3579-21taskset21:51:343
3058499552,35cyclictest14535-21chrt21:16:073
3058499543,37cyclictest18325-21taskset22:16:153
3058499542,40cyclictest7065-21chrt23:45:463
3058499542,40cyclictest7065-21chrt23:45:463
3058499533,37cyclictest11102-21chrt22:04:313
3058499533,36cyclictest2547-21taskset21:50:403
3058499533,35cyclictest8780-21chrt23:47:123
3058499533,35cyclictest8780-21chrt23:47:123
3058499533,35cyclictest27733-21chrt22:31:273
3058499532,38cyclictest29825-21chrt20:36:003
3058499532,38cyclictest29825-21chrt20:36:003
30584995310,31cyclictest0-21swapper/322:36:193
3058499523,39cyclictest25880-21taskset22:28:273
3058499523,33cyclictest20693-21chrt21:26:163
30584995229,13cyclictest0-21swapper/319:36:353
30584995217,25cyclictest0-21swapper/322:00:573
3058499514,33cyclictest3150-21chrt23:38:083
3058499513,39cyclictest19573-21chrt23:11:333
3058499503,35cyclictest546-21chrt19:06:223
3058499503,35cyclictest24964-21taskset20:21:013
3058499503,34cyclictest917-21kworker/3:1+events21:42:023
3058499503,34cyclictest917-21kworker/3:1+events21:42:023
3058499503,34cyclictest26975-21chrt23:24:423
3058499503,33cyclictest15810-21chrt22:11:293
3058499502,38cyclictest4207-21taskset19:16:303
3058499502,35cyclictest12857-21taskset23:01:153
3058499502,34cyclictest17753-21chrt23:09:053
3058499493,37cyclictest18198-21chrt21:21:303
3058499493,37cyclictest18198-21chrt21:21:303
3058499493,37cyclictest16090-21taskset19:51:333
3058499493,34cyclictest8256-21chrt21:05:573
3058499493,34cyclictest8256-21chrt21:05:573
3058499493,34cyclictest23923-21chrt00:12:053
3058499493,34cyclictest12006-21chrt22:59:413
3058499492,38cyclictest7103-21chrt19:26:143
3058499492,32cyclictest23938-21taskset23:19:313
3058499483,35cyclictest1291-21chrt20:46:293
3058499483,33cyclictest23538-21taskset21:31:113
3058499483,33cyclictest23538-21taskset21:31:113
3058499483,32cyclictest21857-21chrt20:11:223
3058499482,34cyclictest7023-21chrt22:51:183
3058499482,34cyclictest30912-21taskset00:25:413
3058499482,33cyclictest26582-21chrt00:17:473
3058499482,33cyclictest2110-21taskset22:42:013
3058499482,33cyclictest2110-21taskset22:42:013
3058499473,34cyclictest12327-21chrt21:11:333
3058499472,35cyclictest3283-21chrt20:51:353
3058499472,31cyclictest13854-21chrt19:46:233
3058499472,31cyclictest13854-21chrt19:46:233
3058499462,32cyclictest4117-21chrt22:46:193
3058499462,30cyclictest30664-21chrt20:36:333
3058499443,31cyclictest21772-21taskset22:21:303
3058499442,29cyclictest17926-21chrt00:02:043
3058499442,29cyclictest17926-21chrt00:02:043
3058499442,26cyclictest4199-21chrt20:56:213
3058499423,29cyclictest9418-21taskset19:31:333
30584994226,11cyclictest451rcuc/319:41:143
3058499412,27cyclictest16759-21chrt19:56:153
3058499392,24cyclictest18989-21chrt20:01:303
3058499382,24cyclictest30743-21taskset19:01:113
3058499382,24cyclictest30743-21taskset19:01:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional