You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 14:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Thu Jun 04, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3856991153,91cyclictest18367-21expr22:26:011
3864991102,83cyclictest18881-21apt-get00:15:032
341121087,81sleep00-21swapper/018:56:070
3844991035,59cyclictest15-21ksoftirqd/021:28:270
385699993,73cyclictest16303-21modprobe00:10:131
3872999716,52cyclictest0-21swapper/300:15:063
385699958,79cyclictest9918-21kworker/u17:1+ext4-rsv-conversion22:15:191
3856999450,39cyclictest3832-21cyclictest23:10:201
385699936,43cyclictest8704-21munin-plugin-st19:19:481
3856999349,38cyclictest12381-21sh21:22:121
3856999349,38cyclictest12381-21sh21:22:121
385699933,37cyclictest13206-21latency_hist19:39:521
385699933,37cyclictest13206-21latency_hist19:39:521
385699933,33cyclictest23153-21fschecks_time21:40:111
384499935,54cyclictest15-21ksoftirqd/021:41:130
3864999257,12cyclictest181rcu_preempt22:30:102
385699923,32cyclictest5688-21fschecks_time19:04:551
385699914,30cyclictest18937-21unixbench_singl20:00:211
385699914,30cyclictest18937-21unixbench_singl20:00:211
385699913,34cyclictest18717-21cut23:20:091
385699913,34cyclictest18717-21cut23:20:091
385699913,33cyclictest30424-21netstat22:45:141
385699913,33cyclictest30424-21netstat22:45:141
385699913,33cyclictest16749-21ssh21:30:041
385699912,32cyclictest22426-21ssh00:20:001
384499914,50cyclictest15-21ksoftirqd/021:15:570
3856999040,42cyclictest0-21swapper/100:09:521
3856999040,42cyclictest0-21swapper/100:09:521
385699903,33cyclictest22937-21fschecks_count20:20:061
385699903,33cyclictest22937-21fschecks_count20:20:061
385699903,30cyclictest20212-21latency00:16:091
385699902,36cyclictest1547-21ntpq23:45:151
385699902,32cyclictest17081-21modprobe19:54:481
385699893,32cyclictest8915-21rm21:15:511
385699893,32cyclictest2410-21latency_hist21:04:511
385699893,31cyclictest29905-21tail21:50:261
3844998974,9cyclictest19912-21ssh21:35:060
3844998965,15cyclictest277-21dbus-daemon00:14:490
3844998916,44cyclictest15-21ksoftirqd/020:20:110
3844998916,44cyclictest15-21ksoftirqd/020:20:110
79322880,7sleep30-21swapper/323:55:243
387299883,50cyclictest0-21swapper/322:15:033
3864998856,10cyclictest181rcu_preempt19:20:132
386499883,52cyclictest39-21ksoftirqd/223:56:372
3856998835,48cyclictest0-21swapper/121:45:181
3856998835,47cyclictest352-21runrttasks22:42:291
385699883,35cyclictest4251-21sort23:50:081
385699882,33cyclictest9410-21/usr/sbin/munin23:05:211
385699882,33cyclictest9410-21/usr/sbin/munin23:05:211
387299872,42cyclictest0-21swapper/320:10:373
3856998770,13cyclictest19896-21kworker/u17:2+events_unbound20:10:041
385699873,32cyclictest27723-21fschecks_time20:40:061
385699873,31cyclictest10477-21latency_hist19:24:531
385699873,30cyclictest7061-21cpuspeed23:55:041
385699872,32cyclictest25189-21runrttasks20:29:511
385699872,32cyclictest25189-21runrttasks20:29:511
385699872,31cyclictest5000-21sort21:10:081
385699872,31cyclictest5000-21sort21:10:081
3856998723,11cyclictest0-21swapper/120:50:321
3856998718,10cyclictest0-21swapper/120:34:501
3864998628,20cyclictest0-21swapper/223:28:232
385699864,26cyclictest13882-21grep19:40:091
385699864,26cyclictest13882-21grep19:40:091
3856998634,44cyclictest0-21swapper/119:59:511
385699863,34cyclictest11026-21grep00:00:241
385699863,31cyclictest22498-21grep23:25:251
385699863,30cyclictest25449-21grep23:30:241
385699863,30cyclictest12181-21grep19:30:211
385699863,30cyclictest11137-21munin-run22:14:481
385699862,32cyclictest4580-21latency_hist21:09:521
239028621,39sleep30-21swapper/318:55:083
385699854,30cyclictest30465-21grep23:40:031
385699852,31cyclictest4199-21sendmail_mailtr22:55:201
385699852,31cyclictest4199-21sendmail_mailtr22:55:201
3856998515,23cyclictest7371-21grep19:10:171
3856998510,28cyclictest28188-21sendmail_mailtr23:35:211
3844998556,19cyclictest13368-21latency_hist19:39:520
3844998556,19cyclictest13368-21latency_hist19:39:520
384499855,54cyclictest15-21ksoftirqd/021:44:550
3844998525,31cyclictest15-21ksoftirqd/019:20:340
25472856,53sleep20-21swapper/218:55:152
387299845,39cyclictest0-21swapper/322:25:033
3864998463,15cyclictest31798-21latency_hist21:54:512
385699844,26cyclictest6423-21/usr/sbin/munin23:00:151
385699843,71cyclictest20085-21wc21:35:201
385699843,34cyclictest20280-21latency_hist20:09:511
385699843,34cyclictest20280-21latency_hist20:09:511
385699843,31cyclictest5747-21ssh22:05:111
385699843,31cyclictest26669-21taskset22:39:501
385699843,30cyclictest15425-21/usr/sbin/munin23:15:181
385699843,27cyclictest2396-21/usr/sbin/munin22:00:171
385699842,35cyclictest3117-21modprobe22:54:471
384499844,52cyclictest15-21ksoftirqd/019:08:170
384499842,47cyclictest15-21ksoftirqd/019:58:400
3864998363,14cyclictest32586-21netstat21:00:132
3864998362,16cyclictest17165-21latency_hist19:54:502
3864998350,12cyclictest181rcu_preempt22:29:172
385699834,32cyclictest29562-21latency_hist20:49:501
385699834,32cyclictest21205-21fschecks_time22:30:101
385699834,27cyclictest5467-21latency_hist19:04:511
385699833,29cyclictest27278-21latency_hist20:39:501
3856998329,48cyclictest0-21swapper/100:29:511
385699832,32cyclictest2170-21latency_hist21:59:501
385699832,32cyclictest2170-21latency_hist21:59:501
3844998360,15cyclictest2374-21systemd-journal00:03:150
384499833,53cyclictest15-21ksoftirqd/023:26:260
384499833,49cyclictest15-21ksoftirqd/022:28:220
384499833,38cyclictest15-21ksoftirqd/023:35:250
3864998219,28cyclictest10930-21modprobe19:29:482
385699824,37cyclictest352-21runrttasks20:16:481
385699824,31cyclictest11013-21latency_hist19:29:501
3856998228,43cyclictest0-21swapper/120:59:511
384499828,55cyclictest11748-21taskset22:15:090
3844998260,14cyclictest23660-21kworker/u17:0+xprtiod23:30:160
384499823,48cyclictest15-21ksoftirqd/023:54:190
385699813,28cyclictest13620-21/usr/sbin/munin21:25:081
3844998157,16cyclictest30555-21processes22:45:190
3844998157,16cyclictest30555-21processes22:45:190
3844998135,16cyclictest181rcu_preempt22:08:580
3844998113,47cyclictest15-21ksoftirqd/023:43:040
3864998061,13cyclictest32021-21ssh23:41:482
3864998056,18cyclictest14378-21mailstats21:25:222
3864998041,21cyclictest0-21swapper/221:08:202
3864998029,15cyclictest0-21swapper/220:49:512
385699803,30cyclictest17346-21latency_hist22:24:531
385699803,30cyclictest17346-21latency_hist22:24:531
384499804,43cyclictest15-21ksoftirqd/019:44:570
384499802,51cyclictest15-21ksoftirqd/000:24:300
385699794,31cyclictest15450-21latency_hist19:49:501
384499797,49cyclictest15-21ksoftirqd/023:21:270
384499797,49cyclictest15-21ksoftirqd/023:21:270
3844997956,15cyclictest31743-21diskmemload21:32:550
384499795,50cyclictest15-21ksoftirqd/021:00:150
384499795,38cyclictest15-21ksoftirqd/022:14:260
3844997945,13cyclictest181rcu_preempt23:07:550
3844997945,13cyclictest181rcu_preempt23:07:550
3844997940,8cyclictest181rcu_preempt22:42:060
3844997940,16cyclictest181rcu_preempt00:06:150
3844997940,16cyclictest181rcu_preempt00:06:150
3844997929,29cyclictest15-21ksoftirqd/019:00:050
3872997812,40cyclictest0-21swapper/300:10:483
3864997858,13cyclictest3947-21/usr/sbin/munin23:50:192
90722770,5sleep30-21swapper/323:04:423
3864997760,11cyclictest31743-21diskmemload22:44:512
3864997757,14cyclictest12441-21/usr/sbin/munin23:10:032
3864997755,16cyclictest8164-21latency_hist19:14:512
3864997755,15cyclictest352-21runrttasks21:15:232
3864997751,16cyclictest0-21swapper/222:05:252
3864997745,13cyclictest181rcu_preempt19:40:182
3864997745,13cyclictest181rcu_preempt19:40:182
3864997725,13cyclictest19242-21latency_hist00:14:522
3864997724,12cyclictest181rcu_preempt20:04:522
3864997724,12cyclictest181rcu_preempt20:04:522
384499776,48cyclictest15-21ksoftirqd/021:55:210
384499776,48cyclictest15-21ksoftirqd/021:55:210
384499776,41cyclictest15-21ksoftirqd/022:31:540
384499773,46cyclictest15-21ksoftirqd/020:30:180
384499773,39cyclictest15-21ksoftirqd/022:57:200
384499773,39cyclictest15-21ksoftirqd/022:57:200
3844997719,30cyclictest11587-21timerwakeupswit21:20:240
3844997719,30cyclictest11587-21timerwakeupswit21:20:240
374127712,42sleep13760-21unin-run18:59:511
3864997646,21cyclictest31716-21cron20:59:482
3864997639,19cyclictest9460-21kworker/u19:2+nfsiod23:19:512
386499763,37cyclictest14369-21awk22:19:482
384499765,40cyclictest15-21ksoftirqd/022:04:080
384499764,43cyclictest15-21ksoftirqd/019:19:330
384499764,36cyclictest15-21ksoftirqd/023:56:170
3864997556,13cyclictest11094-21latency21:20:132
3864997556,13cyclictest11094-21latency21:20:132
3864997555,12cyclictest5321-21sh22:04:512
386499753,43cyclictest19993-21sh21:35:192
386499751,29cyclictest30069-21df_inode22:45:062
386499751,29cyclictest30069-21df_inode22:45:062
384499756,41cyclictest15-21ksoftirqd/023:10:310
3844997560,10cyclictest3832-21cyclictest22:54:270
384499754,36cyclictest20050-21apt-config20:09:490
384499754,36cyclictest20050-21apt-config20:09:490
3844997517,48cyclictest15-21ksoftirqd/023:02:460
3864997462,7cyclictest0-21swapper/221:44:552
3864997452,15cyclictest19225-21ssh21:34:342
3864997443,9cyclictest181rcu_preempt19:57:182
3864997438,9cyclictest181rcu_preempt22:24:002
3864997438,9cyclictest181rcu_preempt22:24:002
386499742,35cyclictest27654-21fschecks_count23:35:082
3864997417,19cyclictest13204-21grep00:05:102
3864997417,19cyclictest13204-21grep00:05:102
3844997456,11cyclictest297-21systemd-logind20:14:480
3844997446,20cyclictest18212-21latency_hist23:19:500
3844997445,20cyclictest28817-21modprobe20:44:480
3844997423,22cyclictest15-21ksoftirqd/022:24:180
3844997423,22cyclictest15-21ksoftirqd/022:24:180
3864997351,8cyclictest39-21ksoftirqd/223:08:532
3864997351,8cyclictest39-21ksoftirqd/223:08:532
3864997351,16cyclictest22586-21latency_hist20:19:502
3864997350,8cyclictest181rcu_preempt23:45:162
3864997349,18cyclictest25148-21latency_hist00:24:492
3864997333,30cyclictest12562-21modprobe19:34:482
3864997332,13cyclictest181rcu_preempt00:00:472
384499734,46cyclictest15-21ksoftirqd/021:07:410
3844997334,12cyclictest181rcu_preempt22:38:050
384499733,38cyclictest15-21ksoftirqd/020:50:560
384499732,48cyclictest15-21ksoftirqd/019:40:010
384499732,48cyclictest15-21ksoftirqd/019:40:010
384499732,37cyclictest15-21ksoftirqd/019:50:180
3864997251,15cyclictest25109-21proc_pri23:30:202
3864997249,17cyclictest9199-21latency_hist23:04:502
3864997246,9cyclictest181rcu_preempt21:59:262
3864997246,9cyclictest181rcu_preempt21:59:262
3844997251,13cyclictest2374-21systemd-journal21:52:280
384499723,47cyclictest15-21ksoftirqd/020:26:580
384499723,47cyclictest15-21ksoftirqd/020:26:580
384499723,41cyclictest15-21ksoftirqd/019:11:530
3844997213,36cyclictest15-21ksoftirqd/023:45:030
3864997130,13cyclictest181rcu_preempt20:28:532
3864997130,13cyclictest181rcu_preempt20:28:532
384499717,37cyclictest15-21ksoftirqd/020:49:420
384499715,42cyclictest15-21ksoftirqd/020:59:110
3864997045,10cyclictest181rcu_preempt20:40:162
3864997042,11cyclictest181rcu_preempt20:10:372
3864997038,7cyclictest181rcu_preempt19:07:172
386499703,32cyclictest25447-21cpu00:25:032
3844997028,8cyclictest181rcu_preempt19:30:060
3844997027,22cyclictest15-21ksoftirqd/000:16:110
387299697,25cyclictest0-21swapper/323:49:493
3864996953,9cyclictest181rcu_preempt20:30:072
3864996951,11cyclictest0-21swapper/223:24:502
3864996951,11cyclictest0-21swapper/223:24:502
3864996927,11cyclictest0-21swapper/220:50:092
3864996923,14cyclictest181rcu_preempt19:00:112
3864996922,12cyclictest181rcu_preempt22:14:092
384499695,36cyclictest15-21ksoftirqd/000:24:580
3844996919,32cyclictest5170-21ssh21:10:120
3844996919,32cyclictest5170-21ssh21:10:120
3864996848,13cyclictest0-21swapper/222:55:212
3864996848,13cyclictest0-21swapper/222:55:212
386499683,52cyclictest22872-21ssh21:40:012
3864996818,11cyclictest181rcu_preempt21:14:492
3864996818,11cyclictest181rcu_preempt21:14:492
384499683,43cyclictest15-21ksoftirqd/020:17:520
3844996830,27cyclictest19319-21modprobe20:04:480
3844996830,27cyclictest19319-21modprobe20:04:480
3864996715,15cyclictest181rcu_preempt20:39:502
3864996650,11cyclictest3832-21cyclictest20:08:302
3864996650,11cyclictest3832-21cyclictest20:08:302
3864996645,10cyclictest0-21swapper/220:24:502
3864996645,10cyclictest0-21swapper/220:24:502
384499666,43cyclictest15-21ksoftirqd/019:26:580
99842650,5sleep30-21swapper/323:05:153
99842650,5sleep30-21swapper/323:05:153
3864996542,15cyclictest0-21swapper/219:19:512
3864996536,9cyclictest181rcu_preempt22:51:332
3864996533,12cyclictest181rcu_preempt22:38:182
384499653,31cyclictest352-21runrttasks20:37:360
3864996424,12cyclictest0-21swapper/219:49:502
387299633,37cyclictest917-21kworker/3:1+events20:04:483
387299633,37cyclictest917-21kworker/3:1+events20:04:483
386499618,22cyclictest13411-21latency_hist19:39:522
386499618,22cyclictest13411-21latency_hist19:39:522
387299593,42cyclictest31598-21taskset22:47:083
387299593,42cyclictest31598-21taskset22:47:083
387299583,38cyclictest25367-21chrt21:44:223
387299573,37cyclictest6093-21taskset23:53:133
387299573,33cyclictest8286-21chrt21:15:193
387299563,36cyclictest1108-21chrt22:50:203
387299563,36cyclictest10668-21taskset21:20:013
387299563,36cyclictest10668-21taskset21:20:013
387299562,37cyclictest29896-21taskset20:50:033
387299552,34cyclictest19656-21taskset20:06:013
387299552,34cyclictest19656-21taskset20:06:013
3872995510,31cyclictest0-21swapper/321:35:213
387299542,35cyclictest4102-21chrt22:55:183
387299542,35cyclictest4102-21chrt22:55:183
387299542,35cyclictest18441-21taskset23:19:583
387299542,35cyclictest18441-21taskset23:19:583
387299542,34cyclictest30630-21chrt23:40:083
387299533,39cyclictest22613-21chrt00:20:083
387299533,36cyclictest25883-21chrt21:45:033
387299533,35cyclictest12133-21taskset00:03:223
387299533,31cyclictest32296-21chrt21:00:073
387299532,36cyclictest7145-21chrt22:07:083
387299523,37cyclictest15058-21taskset00:08:123
387299523,37cyclictest15058-21taskset00:08:123
387299523,33cyclictest6671-21chrt21:12:563
387299523,33cyclictest6671-21chrt21:12:563
387299523,33cyclictest24369-21taskset22:35:133
387299522,36cyclictest14394-21taskset23:12:453
387299522,35cyclictest28962-21chrt23:36:353
387299513,33cyclictest6681-21chrt19:09:523
387299513,33cyclictest16600-21chrt21:29:553
387299512,37cyclictest14839-21chrt21:25:413
387299512,36cyclictest26885-21taskset22:39:593
387299512,36cyclictest22126-21chrt23:25:213
387299512,36cyclictest13879-21chrt19:40:093
387299512,36cyclictest13879-21chrt19:40:093
387299503,35cyclictest15897-21chrt23:15:123
387299503,34cyclictest22528-21chrt20:19:503
387299502,34cyclictest10400-21chrt22:12:473
387299493,34cyclictest28249-21chrt20:40:193
387299493,32cyclictest21186-21chrt22:30:103
387299493,31cyclictest23715-21chrt20:20:223
387299493,31cyclictest23715-21chrt20:20:223
387299492,30cyclictest4028-21chrt22:01:493
387299484,32cyclictest3784-21chrt21:08:183
387299483,34cyclictest31829-21chrt20:59:513
387299483,31cyclictest17254-21chrt19:54:513
387299482,35cyclictest16208-21chrt22:21:393
387299482,35cyclictest16208-21chrt22:21:393
387299482,34cyclictest27335-21chrt00:27:463
387299474,26cyclictest2180-21chrt21:59:503
387299474,26cyclictest2180-21chrt21:59:503
387299473,33cyclictest7310-21chrt19:10:163
387299464,30cyclictest9310-21taskset19:20:093
387299463,30cyclictest10947-21chrt19:29:483
387299462,31cyclictest4343-21chrt19:00:123
387299457,25cyclictest29102-21taskset21:50:103
387299452,28cyclictest13226-21taskset19:39:493
387299452,28cyclictest13226-21taskset19:39:493
387299443,30cyclictest26706-21chrt23:33:403
387299434,25cyclictest26417-21chrt20:32:463
387299433,28cyclictest27086-21taskset20:38:123
387299422,27cyclictest8929-21taskset19:19:523
387299412,29cyclictest17470-21taskset19:56:453
387299403,25cyclictest11284-21chrt19:30:013
387299403,23cyclictest29593-21chrt20:49:503
387299393,26cyclictest24831-21taskset20:28:203
387299393,26cyclictest24831-21taskset20:28:203
387299393,26cyclictest15176-21taskset19:46:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional