You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 11:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Jun 27, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15244212413,78sleep014679-21/usr/sbin/munin18:53:540
15244212413,78sleep014679-21/usr/sbin/munin18:53:540
16016211111,69sleep116064-21modprobe18:58:151
16016211111,69sleep116064-21modprobe18:58:151
16185991073,63cyclictest20032-21apt-get19:08:251
16065210511,62sleep216074-21systemd-run18:58:162
16065210511,62sleep216074-21systemd-run18:58:162
1618599914,8cyclictest0-21swapper/119:03:311
1618599904,8cyclictest0-21swapper/122:28:241
16185998946,36cyclictest0-21swapper/123:28:131
16181998944,29cyclictest15246-21apt-get20:33:250
16181998944,29cyclictest15246-21apt-get20:33:250
1618599883,48cyclictest4367-21apt-get23:08:241
1618599883,38cyclictest5554-21cpu20:03:301
16181998836,42cyclictest20524-21/usr/sbin/munin23:33:440
1618599874,8cyclictest0-21swapper/121:03:271
1618599864,39cyclictest18679-21/usr/sbin/munin22:38:421
1618599863,7cyclictest0-21swapper/100:08:251
16181998638,9cyclictest5317-21kworker/u19:0-events_unbound22:37:510
16185998544,33cyclictest0-21swapper/119:48:171
1618599854,35cyclictest21665-21/usr/sbin/munin22:43:331
1618599853,38cyclictest25791-21/usr/sbin/munin23:43:411
1618599853,38cyclictest25791-21/usr/sbin/munin23:43:411
16181998570,9cyclictest0-21swapper/019:08:490
16181998547,28cyclictest32640-21apt-get21:13:270
16181998526,24cyclictest9346-21rm00:08:550
16181998525,26cyclictest23305-21diskmemload21:23:440
157492850,8sleep30-21swapper/322:33:303
16193998468,10cyclictest1-21systemd20:53:162
16193998468,10cyclictest1-21systemd20:53:162
16193998464,13cyclictest2374-21systemd-journal23:37:152
1618599844,8cyclictest0-21swapper/123:18:281
1618599844,8cyclictest0-21swapper/123:18:281
1618599843,34cyclictest498-21ssh23:01:401
1618599843,34cyclictest12585-21grep20:23:471
1618599842,35cyclictest1570-21ls22:08:491
16181998435,19cyclictest30498-21/usr/sbin/munin22:03:350
16181998435,19cyclictest30498-21/usr/sbin/munin22:03:350
16181998430,24cyclictest30896-21sh22:58:280
1618599834,11cyclictest181rcu_preempt22:13:291
1618599833,41cyclictest17039-21taskset23:28:421
1618599833,41cyclictest17039-21taskset23:28:421
1618599833,34cyclictest30333-21/usr/sbin/munin22:03:301
1618599833,34cyclictest30333-21/usr/sbin/munin22:03:301
1618599832,38cyclictest30158-21rm21:08:401
1618599832,38cyclictest30158-21rm21:08:401
1618599832,35cyclictest6009-21latency_hist21:23:171
16181998353,23cyclictest0-21swapper/021:58:330
16181998350,25cyclictest0-21swapper/023:58:260
16181998334,42cyclictest19351-21ssh22:38:450
16181998311,55cyclictest11422-21apt-get00:13:340
16193998258,13cyclictest0-21swapper/223:53:162
1618599826,9cyclictest0-21swapper/119:48:261
1618599824,35cyclictest27173-21/usr/sbin/munin21:58:461
1618599824,33cyclictest27891-21/usr/sbin/munin22:53:241
16185998243,31cyclictest0-21swapper/121:03:151
1618599823,38cyclictest25822-21ssh22:49:391
1618599823,38cyclictest11399-21/usr/sbin/munin00:14:491
1618599823,37cyclictest24183-21/usr/sbin/munin21:53:311
1618599823,37cyclictest24183-21/usr/sbin/munin21:53:311
1618599823,34cyclictest6206-21grep21:23:311
1618599823,34cyclictest352-21runrttasks23:43:151
1618599822,39cyclictest16806-21grep22:33:521
1618599822,38cyclictest5216-21/usr/sbin/munin00:03:421
1618599822,35cyclictest31980-21sshd23:53:361
1618599822,33cyclictest11386-21taskset20:18:551
16181998233,16cyclictest6341-21/usr/sbin/munin00:03:530
16181998231,19cyclictest0-21swapper/021:19:170
1619399816,55cyclictest10868-21apt-get00:13:282
1618599814,9cyclictest0-21swapper/119:28:281
1618599814,8cyclictest0-21swapper/119:58:291
1618599814,35cyclictest9895-21processes21:28:471
1618599814,35cyclictest9895-21processes21:28:471
1618599814,34cyclictest9683-21/usr/sbin/munin22:23:331
1618599814,34cyclictest9683-21/usr/sbin/munin22:23:331
1618599814,33cyclictest15143-21/usr/sbin/munin21:38:301
1618599813,9cyclictest0-21swapper/100:18:261
1618599813,36cyclictest786-21ntp_offset21:13:451
1618599813,34cyclictest21964-21taskset23:36:361
1618599813,34cyclictest10424-21latency_hist23:18:181
1618599813,34cyclictest10424-21latency_hist23:18:181
1618599813,33cyclictest6700-21/usr/sbin/munin22:18:361
1618599813,33cyclictest6700-21/usr/sbin/munin22:18:361
16181998158,16cyclictest17060-21fschecks_count20:38:350
16193998057,15cyclictest2374-21systemd-journal21:24:162
1618599805,7cyclictest0-21swapper/120:28:271
1618599805,7cyclictest0-21swapper/120:28:271
1618599803,36cyclictest23036-21apt-key19:18:161
1618599803,35cyclictest20643-21fschecks_count20:49:331
1618599803,35cyclictest20643-21fschecks_count20:49:331
1618599803,34cyclictest12757-21runrttasks21:33:431
1618599803,33cyclictest3175-21timerandwakeup23:58:501
1618599803,33cyclictest22535-21ps20:53:461
1618599803,18cyclictest21199-21apt-get21:48:251
16181998060,9cyclictest12008-21apt-get20:23:270
16181998035,14cyclictest0-21swapper/019:43:370
16181998029,40cyclictest3649-21ssh23:07:100
16181998027,22cyclictest15189-21sh23:24:570
16181998026,22cyclictest14836-21ssh22:31:410
1619399799,54cyclictest7919-21diskmemload23:14:252
1619399799,54cyclictest7919-21diskmemload23:14:252
16193997950,20cyclictest24358-21cron22:48:132
1618599794,34cyclictest1346-21/usr/sbin/munin23:03:451
1618599793,36cyclictest29840-21grep23:48:511
1618599793,36cyclictest23477-21apt-get19:18:281
1618599793,36cyclictest20012-21basename00:28:141
1618599793,36cyclictest18660-21fschecks_count20:43:351
1618599793,36cyclictest18660-21fschecks_count20:43:351
1618599793,33cyclictest18451-21uniq21:43:371
1618599792,37cyclictest2489-21diskstats19:53:341
1618599792,36cyclictest17707-21idleruntime-cro19:03:141
16181997955,15cyclictest17433-21runrttasks00:23:300
16181997935,39cyclictest0-21swapper/021:03:260
16181997932,40cyclictest9893-21runrttasks21:28:470
16181997932,40cyclictest9893-21runrttasks21:28:470
16181997925,24cyclictest12487-21rm23:21:200
16181997925,24cyclictest12487-21rm23:21:200
1619799783,36cyclictest23307-21chrt20:58:143
16193997861,12cyclictest16171-21cyclictest22:38:492
16193997860,13cyclictest11941-21latency_hist21:33:172
16193997860,13cyclictest11941-21latency_hist21:33:172
16193997854,15cyclictest26982-21latency_hist21:58:172
16193997854,15cyclictest26982-21latency_hist21:58:172
1618599784,33cyclictest25129-21cpu19:23:311
1618599783,35cyclictest16215-21grep20:33:501
1618599783,35cyclictest16215-21grep20:33:501
1618599783,33cyclictest7410-21grep20:08:351
1618599782,24cyclictest30227-21/usr/sbin/munin19:38:371
1487227813,38sleep30-21swapper/318:53:403
1487227813,38sleep30-21swapper/318:53:403
1619399778,55cyclictest13702-21apt-get23:23:342
16193997757,9cyclictest0-21swapper/221:43:502
16193997757,10cyclictest0-21swapper/219:38:162
16193997757,10cyclictest0-21swapper/219:38:162
16193997753,11cyclictest0-21swapper/219:53:182
1618599773,8cyclictest0-21swapper/120:38:271
16185997722,48cyclictest0-21swapper/119:38:141
16185997722,48cyclictest0-21swapper/119:38:141
16181997758,11cyclictest18394-21apt-get19:03:300
16181997758,10cyclictest0-21swapper/022:23:350
16181997758,10cyclictest0-21swapper/022:23:350
16181997728,38cyclictest7186-21/usr/sbin/munin20:08:240
1618199772,58cyclictest8097-21/usr/sbin/munin23:14:310
1618199772,58cyclictest8097-21/usr/sbin/munin23:14:310
1619799763,33cyclictest2190-21chrt23:58:183
1619799762,34cyclictest24786-21chrt21:53:433
1619799762,34cyclictest24786-21chrt21:53:433
1619799762,31cyclictest13297-21taskset23:23:163
1619799762,31cyclictest13297-21taskset23:23:163
16193997656,12cyclictest0-21swapper/219:56:162
16193997652,12cyclictest0-21swapper/219:58:362
16193997627,38cyclictest11741-21latency_hist20:23:142
1618599763,33cyclictest9290-21ntp_kernel_pll_20:13:421
16181997655,15cyclictest17815-21latency_hist19:03:170
16181997649,20cyclictest8794-21apt-get20:13:270
16181997644,24cyclictest23477-21apt-get19:19:220
16181997624,25cyclictest21543-21kworker/u17:0+rpciod21:41:050
1619799754,26cyclictest14097-21chrt23:24:053
16193997560,10cyclictest16171-21cyclictest18:58:392
16193997556,13cyclictest28517-40mandb23:48:152
16193997556,13cyclictest28517-40mandb23:48:152
16193997554,11cyclictest0-21swapper/219:48:172
16193997554,10cyclictest0-21swapper/220:38:172
16193997554,10cyclictest0-21swapper/220:38:172
16193997552,13cyclictest0-21swapper/219:28:582
16181997559,10cyclictest734-21apt-get22:08:290
16181997555,11cyclictest0-21swapper/021:33:380
16181997527,40cyclictest21510-21grep21:48:370
16181997524,42cyclictest24942-21ssh22:48:250
16181997524,23cyclictest23305-21diskmemload21:54:430
16181997524,23cyclictest23305-21diskmemload21:54:430
1619799744,34cyclictest1402-21taskset23:03:303
1619799742,35cyclictest11579-21chrt22:26:013
1619799742,35cyclictest11579-21chrt22:26:013
1619399745,58cyclictest27553-21timerwakeupswit21:03:512
16181997457,7cyclictest0-21swapper/020:49:370
16181997457,7cyclictest0-21swapper/020:49:370
16181997456,9cyclictest18180-21apt-get21:43:260
16181997453,14cyclictest3941-21apt-get19:58:290
16181997426,38cyclictest15712-21ssh00:19:330
16181997424,22cyclictest2313-21/usr/sbin/munin19:53:340
16181997420,19cyclictest23305-21diskmemload22:20:330
16181997420,19cyclictest23305-21diskmemload22:20:330
16193997356,11cyclictest28028-21ssh22:53:312
16181997353,8cyclictest0-21swapper/021:08:370
16181997353,8cyclictest0-21swapper/021:08:370
16181997341,18cyclictest25091-21apt-get19:23:260
16181997334,28cyclictest16366-21apt-get23:28:270
16181997334,28cyclictest16366-21apt-get23:28:270
16181997328,34cyclictest6444-21munin-run22:18:150
16181997327,21cyclictest28458-21cron23:48:140
16181997327,21cyclictest28458-21cron23:48:140
1619799722,28cyclictest6949-21chrt22:18:353
1619799722,28cyclictest6949-21chrt22:18:353
16193997257,8cyclictest0-21swapper/220:43:362
16193997257,8cyclictest0-21swapper/220:43:362
16193997256,10cyclictest11430-21timerandwakeup23:18:492
16193997256,10cyclictest11430-21timerandwakeup23:18:492
16193997253,12cyclictest18379-21latency_hist20:43:172
16193997252,10cyclictest0-21swapper/220:33:172
16193997252,10cyclictest0-21swapper/220:33:172
16193997249,12cyclictest0-21swapper/221:53:182
16193997221,21cyclictest0-21swapper/200:07:432
16181997257,8cyclictest0-21swapper/020:58:510
16181997256,8cyclictest26723-21apt-get19:28:300
16181997254,9cyclictest13641-21apt-get20:28:270
16181997254,9cyclictest13641-21apt-get20:28:270
16181997243,20cyclictest22858-21apt-get23:38:290
16181997229,19cyclictest24850-21apt-key22:48:180
16181997224,21cyclictest29191-21if_eth023:48:380
16181997217,34cyclictest352-21runrttasks22:53:400
1619799712,30cyclictest13434-21chrt00:16:293
1619799712,28cyclictest7426-21chrt23:13:183
16193997152,12cyclictest23328-21latency_hist19:18:192
16193997147,16cyclictest14494-21ssh00:18:312
16193997147,11cyclictest0-21swapper/219:08:182
16193997144,19cyclictest24818-21sh19:23:142
16181997142,20cyclictest21637-21apt-get19:13:290
16181997141,22cyclictest11739-21sh20:23:140
1619799704,24cyclictest25521-21chrt23:43:143
1619799703,29cyclictest16271-21chrt21:38:523
1619799703,28cyclictest27241-21chrt21:03:453
1619799702,28cyclictest2471-21chrt23:58:343
16193997051,12cyclictest0-21swapper/220:53:252
16193997049,13cyclictest2374-21systemd-journal22:37:162
16193997048,16cyclictest29680-21cpu21:08:302
16193997048,16cyclictest29680-21cpu21:08:302
16193997039,22cyclictest21366-21cron19:13:152
16181997046,13cyclictest28327-21apt-get19:33:300
16181997046,13cyclictest28327-21apt-get19:33:300
1619799693,30cyclictest24285-21chrt20:58:473
16193996954,8cyclictest0-21swapper/200:03:162
16193996954,11cyclictest2-21kthreadd23:00:202
16193996951,11cyclictest0-21swapper/223:29:302
16193996951,11cyclictest0-21swapper/223:29:302
16193996950,13cyclictest0-21swapper/200:08:372
16193996946,18cyclictest1682-21fschecks_time23:03:362
16193996946,12cyclictest0-21swapper/223:13:172
16181996942,19cyclictest31775-21apt-get23:53:260
16197996855,7cyclictest0-21swapper/319:18:303
1619799684,28cyclictest7453-21chrt20:08:363
1619799683,51cyclictest25077-21chrt22:48:463
1619799683,27cyclictest8523-21chrt00:08:353
1619799683,24cyclictest9856-21chrt23:17:163
1619799683,24cyclictest9856-21chrt23:17:163
1619799683,19cyclictest243572sleep322:48:133
1619799682,34cyclictest10867-21chrt21:30:293
1619799682,34cyclictest10867-21chrt21:30:293
1619799682,24cyclictest28177-21chrt23:47:273
1619799682,24cyclictest28177-21chrt23:47:273
1618199683,26cyclictest4345-21/usr/sbin/munin23:08:370
16181996826,34cyclictest1072-21kernelversion19:48:390
1619799672,24cyclictest29706-21chrt22:02:513
16193996752,9cyclictest0-21swapper/222:23:352
16193996752,9cyclictest0-21swapper/222:23:352
16193996751,10cyclictest13025-21fschecks_time22:28:352
16181996747,12cyclictest297-21systemd-logind20:08:150
16181996725,17cyclictest23301-21munin-run20:58:140
1619799663,30cyclictest21383-21taskset19:13:153
1619799663,25cyclictest15420-21chrt22:33:143
1619799662,23cyclictest30913-21chrt19:38:513
16193996650,10cyclictest297-21systemd-logind20:18:152
16193996648,12cyclictest298-21in:imuxsock22:53:152
16193996647,9cyclictest0-21swapper/221:13:512
16193996646,14cyclictest0-21swapper/220:58:522
16193996645,13cyclictest0-21swapper/221:18:302
16193996645,10cyclictest0-21swapper/222:20:542
16193996645,10cyclictest0-21swapper/222:20:542
16193996644,14cyclictest0-21swapper/222:03:472
16193996644,14cyclictest0-21swapper/222:03:472
16193996643,12cyclictest0-21swapper/223:53:452
16193996641,18cyclictest1-21systemd22:16:192
16193996622,33cyclictest19595-21sshd00:27:122
16193996620,24cyclictest1701-21kworker/u17:3-rpciod22:10:032
16181996633,24cyclictest19828-21awk20:48:140
16181996633,24cyclictest19828-21awk20:48:140
1619799659,15cyclictest0-21swapper/319:18:173
1619799653,26cyclictest32152-21chrt21:12:493
1619799653,26cyclictest32152-21chrt21:12:493
1619799653,26cyclictest22612-21taskset23:38:163
1619799653,24cyclictest20818-21chrt22:41:413
1619799652,26cyclictest18929-21chrt19:03:473
16193996546,10cyclictest0-21swapper/219:38:362
16193996545,10cyclictest0-21swapper/220:08:162
16193996542,15cyclictest25711-21sh23:43:172
1619799643,26cyclictest3187-21chrt21:18:293
1619799643,25cyclictest17498-21taskset00:23:313
1619799642,26cyclictest3907-21chrt22:13:323
16197996413,24cyclictest22428-21taskset21:49:133
16193996449,8cyclictest0-21swapper/219:23:432
301872630,7sleep30-21swapper/323:49:383
1619799637,15cyclictest0-21swapper/320:08:173
1619799633,25cyclictest13699-21chrt21:35:033
1619799633,24cyclictest20114-21taskset20:48:173
1619799633,24cyclictest20114-21taskset20:48:173
1619799633,22cyclictest16457-21chrt00:21:403
16193996346,10cyclictest0-21swapper/221:33:312
16193996343,15cyclictest0-21swapper/221:38:482
16193996342,15cyclictest27282-21cpuspeed21:58:322
16181996328,25cyclictest29934-21apt19:38:250
16197996210,15cyclictest0-21swapper/322:03:273
16197996210,15cyclictest0-21swapper/322:03:273
16197996210,14cyclictest0-21swapper/300:03:383
16193996243,9cyclictest0-21swapper/220:23:312
16193996243,9cyclictest0-21swapper/220:13:142
1619799619,14cyclictest0-21swapper/320:03:183
1619799613,41cyclictest483-21chrt21:13:383
1619799613,22cyclictest29683-21chrt19:38:143
1619799613,22cyclictest29683-21chrt19:38:143
1619799613,22cyclictest21291-21chrt20:49:473
1619799613,22cyclictest21291-21chrt20:49:473
1619799612,24cyclictest26918-21chrt19:28:383
1619799609,14cyclictest0-21swapper/322:58:483
16197996012,12cyclictest0-21swapper/319:53:353
16197996011,12cyclictest0-21swapper/323:31:123
16197996011,12cyclictest0-21swapper/323:31:123
1619799593,23cyclictest2418-21taskset22:10:283
16197995911,13cyclictest0-21swapper/322:53:463
16197995910,14cyclictest0-21swapper/320:18:533
1619799584,38cyclictest25283-21chrt19:23:363
16197995811,12cyclictest0-21swapper/320:28:013
16197995710,14cyclictest0-21swapper/321:23:323
16197995710,13cyclictest0-21swapper/320:38:303
1619799562,24cyclictest17521-21taskset19:01:123
1619799554,39cyclictest20433-21chrt21:47:063
16197995510,13cyclictest0-21swapper/319:48:513
1619799533,34cyclictest31642-21chrt19:43:333
1619799533,33cyclictest13885-21chrt20:28:373
1619799533,33cyclictest13885-21chrt20:28:373
1619799502,33cyclictest15353-21taskset20:33:313
1619799502,33cyclictest15353-21taskset20:33:313
1619799414,28cyclictest9126-21chrt20:13:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional