You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 11:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jun 12, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3837991203,42cyclictest9531-21apt-get19:14:270
3837991203,42cyclictest9531-21apt-get19:14:270
3837991113,33cyclictest17854-21fschecks_time21:10:490
3837991113,26cyclictest3102-21ls23:29:180
38379911125,17cyclictest0-21swapper/023:14:180
3837991105,42cyclictest9739-21/usr/sbin/munin22:46:240
3837991103,37cyclictest3542-21unixbench_multi21:39:520
3837991102,29cyclictest23342-21grep19:54:520
3837991102,29cyclictest23342-21grep19:54:520
3837991093,31cyclictest4352-21unixbench_multi23:29:540
38379910830,11cyclictest0-21swapper/019:34:180
3837991082,29cyclictest31275-21mailstats00:15:520
3837991082,29cyclictest31275-21mailstats00:15:520
38379910744,55cyclictest7382-21cron19:09:360
38379910744,55cyclictest7382-21cron19:09:360
3837991073,31cyclictest24099-21sh21:19:530
3837991073,31cyclictest24099-21sh21:19:530
38379910634,8cyclictest0-21swapper/021:04:470
3837991062,36cyclictest5349-21apt19:04:150
38379910620,23cyclictest26000-21/usr/sbin/munin21:24:380
38429910529,38cyclictest0-21swapper/120:54:161
38379910536,8cyclictest0-21swapper/019:05:020
38379910433,12cyclictest0-21swapper/023:54:490
38379910433,12cyclictest0-21swapper/023:54:490
3837991043,24cyclictest6722-21/usr/sbin/munin22:39:530
38379910351,46cyclictest7649-21ssh21:47:500
3837991033,45cyclictest19178-21/usr/sbin/munin19:44:430
38379910333,15cyclictest2706-21latency_hist22:34:190
38379910333,15cyclictest2706-21latency_hist22:34:190
38379910327,11cyclictest0-21swapper/023:04:500
38379910326,11cyclictest0-21swapper/023:19:320
38379910324,23cyclictest20548-21cpu22:09:310
3837991032,38cyclictest20608-21latency_hist23:04:190
3837991032,35cyclictest5981-21latency_hist20:44:180
3837991032,34cyclictest11397-21fschecks_time19:19:370
38379910316,30cyclictest31960-21/usr/sbin/munin21:34:410
3837991023,38cyclictest29055-21modprobe22:24:150
3837991023,32cyclictest8007-21fschecks_time20:49:370
3837991023,32cyclictest6503-21fschecks_count23:34:370
3837991023,32cyclictest18039-21ssh23:54:190
38379910226,10cyclictest0-21swapper/019:34:510
38379910218,29cyclictest17666-21latency_hist22:59:190
38479910114,48cyclictest386-21ssh23:24:352
3837991014,33cyclictest32687-21ps20:24:480
3837991014,33cyclictest32687-21ps20:24:480
38379910136,8cyclictest0-21swapper/021:59:400
3837991013,41cyclictest10046-21switchtime23:39:500
3837991013,41cyclictest10046-21switchtime23:39:500
38379910133,60cyclictest0-21swapper/021:49:340
3837991013,35cyclictest29732-21grep21:29:500
3837991013,34cyclictest29483-21latency_hist23:19:190
3837991013,34cyclictest29483-21latency_hist23:19:190
38379910130,8cyclictest0-21swapper/022:49:490
38379910125,10cyclictest0-21swapper/000:04:410
3837991004,29cyclictest13007-21fschecks_time19:24:380
3837991003,33cyclictest20225-21cstates21:14:330
38379910029,10cyclictest0-21swapper/021:54:340
3837991002,32cyclictest17575-21/usr/sbin/munin19:39:400
3837991002,26cyclictest25360-21seq22:17:100
383799995,30cyclictest644-21/usr/sbin/munin00:19:410
383799993,38cyclictest2374-21systemd-journal22:09:150
383799993,38cyclictest11017-21/usr/sbin/munin20:59:510
383799993,36cyclictest30769-21fschecks_time20:19:380
383799993,34cyclictest22381-21latency_hist19:54:190
383799993,34cyclictest22381-21latency_hist19:54:190
383799992,34cyclictest30230-21cron20:19:160
383799992,32cyclictest29640-21fschecks_time22:24:380
3842999829,39cyclictest6141-21latency_hist23:34:191
383799985,34cyclictest24237-21fschecks_count19:59:360
383799983,35cyclictest3786-21timerwakeupswit22:34:530
383799983,34cyclictest26970-21/usr/sbin/munin00:09:490
383799983,30cyclictest1833-21chrt20:29:460
383799983,30cyclictest1833-21chrt20:29:460
383799983,27cyclictest352-21runrttasks23:47:050
3837999829,9cyclictest0-21swapper/023:59:520
3837999829,11cyclictest0-21swapper/020:04:510
3842999777,13cyclictest15672-21kworker/u17:0-rpciod22:34:501
3842999734,54cyclictest0-21swapper/121:19:531
3842999734,54cyclictest0-21swapper/121:19:531
383799973,38cyclictest9378-21cpu20:54:300
383799973,33cyclictest3819-21ssh00:24:350
383799972,39cyclictest7097-21grep20:45:090
3842999625,35cyclictest0-21swapper/121:04:341
383799953,35cyclictest352-21runrttasks20:34:410
383799943,32cyclictest27546-21fschecks_time20:09:370
3842999249,37cyclictest15112-21sh21:59:481
3842999246,36cyclictest0-21swapper/121:44:381
32902927,55sleep23380-21sed18:56:142
32902927,55sleep23380-21sed18:56:142
3842999153,23cyclictest297-21systemd-logind00:29:161
383799892,26cyclictest3903-21latency_hist18:59:200
383799892,26cyclictest3903-21latency_hist18:59:200
3847998865,16cyclictest7606-21sh23:35:322
384299883,68cyclictest30161-21apt-get00:14:301
384299883,68cyclictest30161-21apt-get00:14:301
3847998764,16cyclictest10725-21diskmemload23:14:182
3847998760,19cyclictest24415-21kernelversion19:59:402
3847998744,8cyclictest181rcu_preempt19:34:322
3842998760,18cyclictest29618-21latency_hist00:14:181
3842998732,49cyclictest0-21swapper/121:35:591
3847998670,10cyclictest25719-21modprobe21:24:162
3847998670,10cyclictest25719-21modprobe21:24:162
3847998645,29cyclictest18926-21modprobe19:44:162
24262867,55sleep12427-21cpu18:55:231
24262867,55sleep12427-21cpu18:55:231
3847998557,20cyclictest17101-21sh22:04:142
3842998556,19cyclictest2834-21latency_hist20:34:191
3842998556,19cyclictest2834-21latency_hist20:34:191
384299853,68cyclictest0-21swapper/100:19:271
3847998463,15cyclictest3825-21cyclictest21:04:182
3842998441,36cyclictest0-21swapper/119:14:471
3842998441,36cyclictest0-21swapper/119:14:471
3842998421,32cyclictest12603-21kernelversion23:44:411
384299837,43cyclictest0-21swapper/119:04:401
3842998258,16cyclictest11085-21ntpd23:53:081
384299822,62cyclictest0-21swapper/119:44:281
3842998219,34cyclictest0-21swapper/121:39:351
3847998156,15cyclictest3825-21cyclictest19:49:192
3842998140,33cyclictest0-21swapper/119:34:491
3842998139,35cyclictest0-21swapper/121:10:531
3847998062,12cyclictest19676-21snmpd00:17:192
3847998062,12cyclictest19676-21snmpd00:17:192
3847998060,14cyclictest30380-21mailstats23:19:492
3847998058,15cyclictest3825-21cyclictest22:18:412
384799803,41cyclictest32494-21memory21:34:402
3842998056,17cyclictest3825-21cyclictest22:05:571
384299803,47cyclictest29543-21latency_hist23:19:191
384299803,47cyclictest29543-21latency_hist23:19:191
384299794,66cyclictest26022-21apt-get21:24:271
3847997856,14cyclictest720-21switchtime22:29:532
3847997856,14cyclictest720-21switchtime22:29:532
3847997829,20cyclictest0-21swapper/223:54:342
3847997829,20cyclictest0-21swapper/223:54:342
384299783,63cyclictest6282-21apt-get23:34:271
3842997835,36cyclictest0-21swapper/119:19:511
3842997825,43cyclictest0-21swapper/119:31:521
3847997745,8cyclictest181rcu_preempt20:29:282
3847997745,8cyclictest181rcu_preempt20:29:282
3847997732,14cyclictest181rcu_preempt21:10:242
384299773,60cyclictest0-21swapper/121:49:291
3842997727,41cyclictest0-21swapper/122:39:501
3847997654,16cyclictest27054-21unixbench_multi21:24:532
384299763,43cyclictest9472-21sort19:14:201
384299763,43cyclictest9472-21sort19:14:201
3842997634,35cyclictest13856-21latency_hist21:04:181
3847997552,15cyclictest3825-21cyclictest00:04:262
3847997547,19cyclictest27923-21timerwakeupswit00:09:512
3842997551,15cyclictest26700-21fschecks_time22:19:381
384299754,57cyclictest27222-21latency_hist20:09:191
385499742,23cyclictest29285-21chrt21:29:383
384799749,33cyclictest9270-21/usr/sbin/munin19:14:182
384799749,33cyclictest9270-21/usr/sbin/munin19:14:182
3847997437,13cyclictest22331-21latency_hist19:54:182
3847997437,13cyclictest22331-21latency_hist19:54:182
3847997427,34cyclictest20777-21taskset22:09:372
384299743,65cyclictest0-21swapper/121:14:291
384299743,61cyclictest23697-21ssh22:14:411
384299743,60cyclictest0-21swapper/118:59:301
3842997434,35cyclictest0-21swapper/123:54:381
3842997434,35cyclictest0-21swapper/123:54:381
385499733,30cyclictest2427-21chrt23:27:423
385499732,32cyclictest7856-21taskset19:09:203
3847997347,9cyclictest181rcu_preempt23:59:292
3847997319,11cyclictest181rcu_preempt23:44:392
3842997350,17cyclictest12108-21fschecks_count22:49:371
384299733,61cyclictest23991-21/usr/sbin/munin00:04:341
384299733,55cyclictest0-21swapper/122:09:281
384299732,61cyclictest30000-21ssh22:24:481
384299732,57cyclictest326-21apt-get23:24:371
385499722,34cyclictest4746-21chrt20:39:373
384799728,34cyclictest39-21ksoftirqd/219:34:182
3847997258,10cyclictest3825-21cyclictest22:22:572
3847997252,14cyclictest14318-21latency_hist21:59:192
3847997252,13cyclictest18243-21idleruntime22:05:432
384799723,39cyclictest9312-21latency_hist20:54:192
3847997230,23cyclictest31998-21modprobe22:29:162
384299723,58cyclictest0-21swapper/120:34:281
384299723,57cyclictest8978-21apt-get22:44:331
384299723,56cyclictest21067-21apt-get23:59:261
384299722,47cyclictest1232-21ls20:29:191
384299722,47cyclictest1232-21ls20:29:191
385499713,28cyclictest11201-21chrt20:59:343
3847997153,13cyclictest39-21ksoftirqd/200:28:592
3847997153,11cyclictest0-21swapper/221:49:512
3847997152,13cyclictest28999-21/usr/sbin/munin21:29:482
3847997146,10cyclictest181rcu_preempt22:54:322
384799713,44cyclictest29857-21unixbench_singl20:14:512
3847997113,32cyclictest31058-21kworker/u18:1+flush-179:021:41:372
3842997141,21cyclictest0-21swapper/119:24:411
3842997132,30cyclictest0-21swapper/120:39:311
166782710,8sleep10-21swapper/122:57:001
385499703,29cyclictest24753-21chrt20:00:003
385499703,28cyclictest19303-21taskset19:44:323
384799704,41cyclictest10437-21grep19:14:512
384799704,41cyclictest10437-21grep19:14:512
3847997042,11cyclictest181rcu_preempt22:47:342
3847997039,23cyclictest7457-21modprobe20:49:152
384299707,52cyclictest0-21swapper/120:14:191
384299703,54cyclictest0-21swapper/120:19:271
384299703,40cyclictest21010-21fschecks_count19:49:371
384299703,40cyclictest21010-21fschecks_count19:49:371
3842997030,33cyclictest0-21swapper/123:04:151
3842997026,36cyclictest0-21swapper/121:33:421
384299702,62cyclictest0-21swapper/120:44:301
384299702,60cyclictest0-21swapper/123:39:291
384299702,60cyclictest0-21swapper/123:39:291
385499692,26cyclictest5419-21chrt19:04:183
385499692,25cyclictest31370-21chrt00:15:533
385499692,25cyclictest31370-21chrt00:15:533
3847996951,9cyclictest0-21swapper/221:47:052
3847996947,9cyclictest181rcu_preempt20:26:132
3847996947,9cyclictest181rcu_preempt20:26:132
3847996947,15cyclictest26175-21ntp_offset20:04:442
3847996945,16cyclictest23323-21ssh23:09:082
384799694,44cyclictest4869-21uname20:39:402
3847996942,11cyclictest181rcu_preempt22:59:412
3847996933,11cyclictest181rcu_preempt19:19:312
384299693,57cyclictest10821-21sort20:59:191
384299693,44cyclictest11469-21/usr/sbin/munin21:54:371
3842996927,37cyclictest0-21swapper/123:04:381
3842996924,38cyclictest0-21swapper/123:19:341
385499683,23cyclictest28092-21chrt00:09:543
385499683,20cyclictest32168-21chrt21:34:333
3847996855,9cyclictest3825-21cyclictest23:39:332
3847996855,9cyclictest3825-21cyclictest23:39:332
3847996854,10cyclictest3825-21cyclictest20:34:502
384799684,43cyclictest27491-21grep23:14:502
384799684,43cyclictest27491-21grep23:14:502
3847996834,11cyclictest181rcu_preempt23:53:552
3847996822,34cyclictest14754-21latency_hist22:54:192
384299683,47cyclictest352-21runrttasks20:19:001
385499673,20cyclictest9290-21chrt20:54:193
385499672,25cyclictest15988-21chrt19:34:283
3847996745,11cyclictest0-21swapper/219:24:482
3847996744,15cyclictest16733-21munin-plugin-st21:09:192
3847996744,13cyclictest0-21swapper/219:09:202
384299674,56cyclictest0-21swapper/119:39:321
3842996743,19cyclictest3825-21cyclictest22:29:401
3842996743,19cyclictest3825-21cyclictest22:29:401
385499663,26cyclictest3391-21chrt20:34:433
385499663,24cyclictest14195-21chrt21:59:183
385499662,28cyclictest20328-21taskset22:09:193
385499662,25cyclictest11583-21chrt19:19:423
385499662,23cyclictest23429-21chrt22:14:213
3847996650,8cyclictest0-21swapper/220:09:412
3847996639,11cyclictest352-21runrttasks22:42:452
384799663,36cyclictest20330-21fschecks_count21:14:382
384799663,35cyclictest30720-21fschecks_count20:19:372
3847996631,11cyclictest181rcu_preempt22:34:532
3847996629,11cyclictest181rcu_preempt23:31:552
3842996649,11cyclictest5601-21munin-node23:09:451
385499653,26cyclictest30597-21chrt22:25:163
385499652,25cyclictest15033-21taskset22:54:353
385499652,24cyclictest32397-21chrt20:24:383
385499652,24cyclictest32397-21chrt20:24:383
3847996545,13cyclictest39-21ksoftirqd/219:00:302
384299653,51cyclictest23428-21/usr/sbin/munin19:54:541
384299653,51cyclictest23428-21/usr/sbin/munin19:54:541
384299652,57cyclictest0-21swapper/119:59:311
27922657,32sleep30-21swapper/318:55:583
27922657,32sleep30-21swapper/318:55:583
385499643,24cyclictest28435-21chrt21:28:363
385499643,24cyclictest2037-21chrt22:32:543
385499643,24cyclictest2037-21chrt22:32:543
385499643,24cyclictest16890-21chrt21:09:193
385499643,23cyclictest23102-21chrt23:08:293
385499643,22cyclictest22614-21taskset00:01:103
385499643,19cyclictest20203-21chrt23:03:393
385499642,26cyclictest29821-21chrt23:19:353
385499642,23cyclictest3723-21chrt23:29:413
384799644,45cyclictest9614-21fschecks_time20:54:352
384799643,34cyclictest352-21runrttasks19:55:372
384799643,34cyclictest352-21runrttasks19:55:372
384799643,33cyclictest1814-21ssh00:20:002
385499632,22cyclictest10722-21chrt19:17:313
385499632,22cyclictest10722-21chrt19:17:313
385499629,12cyclictest0-21swapper/322:24:193
385499619,13cyclictest0-21swapper/321:19:193
385499609,14cyclictest0-21swapper/300:19:373
385499603,25cyclictest16270-21chrt22:01:533
385499577,30cyclictest0-21swapper/321:09:353
385499572,23cyclictest12890-21chrt23:44:493
385499563,39cyclictest8221-21taskset21:49:163
385499558,14cyclictest0-21swapper/322:44:193
385499553,38cyclictest24384-21chrt00:04:393
385499543,37cyclictest29513-21chrt23:19:193
385499543,37cyclictest29513-21chrt23:19:193
385499542,39cyclictest11596-21chrt22:49:163
385499542,37cyclictest22521-21chrt19:54:333
385499542,37cyclictest22521-21chrt19:54:333
385499533,38cyclictest7425-21taskset23:35:003
385499532,35cyclictest4600-21taskset21:42:393
385499523,35cyclictest15704-21chrt19:34:163
385499523,34cyclictest3807-21chrt22:34:533
385499522,34cyclictest23172-21chrt21:19:323
385499522,34cyclictest23172-21chrt21:19:323
385499517,32cyclictest0-21swapper/319:09:423
385499517,32cyclictest0-21swapper/319:09:423
385499513,36cyclictest31483-21chrt20:19:523
385499512,35cyclictest14686-21chrt22:54:183
385499512,33cyclictest25045-21chrt23:10:323
385499504,34cyclictest25872-21chrt20:04:373
385499503,33cyclictest3848-21chrt00:24:373
385499502,35cyclictest29787-21chrt20:14:503
385499493,33cyclictest21158-21chrt22:09:473
385499492,35cyclictest8583-21chrt21:49:333
385499492,34cyclictest15184-21chrt23:49:313
385499492,31cyclictest10548-21taskset23:40:313
385499492,31cyclictest10548-21taskset23:40:313
385499483,32cyclictest13248-21chrt19:24:443
385499473,33cyclictest18482-21chrt19:39:513
385499473,33cyclictest1430-21chrt20:29:323
385499473,33cyclictest1430-21chrt20:29:323
385499473,32cyclictest19792-21chrt23:56:323
385499473,32cyclictest19792-21chrt23:56:323
385499453,32cyclictest7016-21chrt20:45:083
385499442,30cyclictest10761-21taskset20:59:173
385499422,28cyclictest21370-21taskset19:49:473
385499422,28cyclictest21370-21taskset19:49:473
385499392,28cyclictest27456-21chrt20:09:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional