You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 05:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Apr 10, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1199214310,88sleep01261-21fschecks_time18:59:510
1199214310,88sleep01261-21fschecks_time18:59:510
137721367,86sleep11456-21latency18:59:561
137721367,86sleep11456-21latency18:59:561
103221307,15sleep20-21swapper/218:59:412
103221307,15sleep20-21swapper/218:59:412
24519911645,40cyclictest21786-21sh22:16:372
24319911359,47cyclictest2952-21systemd-journal23:54:420
24319911359,47cyclictest2952-21systemd-journal23:54:420
24319911357,9cyclictest20915-21ssh23:09:050
24319911357,9cyclictest20915-21ssh23:09:050
24319911352,16cyclictest24486-21tune2fs00:09:480
24319911352,16cyclictest24486-21tune2fs00:09:480
2431991114,43cyclictest12644-21cat21:08:320
2431991094,31cyclictest1354-21kworker/u17:3+rpciod22:13:330
24319910939,14cyclictest9301-21switchtime23:44:050
24319910738,11cyclictest0-21swapper/020:19:060
2431991063,41cyclictest5660-21awk20:49:030
2431991063,40cyclictest23377-21latency_hist00:08:330
24319910553,42cyclictest13490-21cron22:03:290
24319910553,42cyclictest13490-21cron22:03:290
2431991054,41cyclictest3214-21latency_hist20:43:320
2431991044,39cyclictest352-21runrttasks21:56:320
2431991033,40cyclictest26949-21xargs23:19:050
2431991033,33cyclictest24872-21/usr/sbin/munin21:29:020
2431991033,33cyclictest24872-21/usr/sbin/munin21:29:020
2431991023,46cyclictest352-21runrttasks23:41:470
2431991013,43cyclictest31694-21switchtime20:29:040
2431991013,40cyclictest29364-21fschecks_time23:23:510
2431991003,39cyclictest2964-21kernelversion19:03:540
2431991003,39cyclictest2964-21kernelversion19:03:540
243199983,41cyclictest21255-21/usr/sbin/munin19:59:070
243199983,41cyclictest21255-21/usr/sbin/munin19:59:070
243199943,35cyclictest23450-21proc_pri22:19:030
243199943,35cyclictest23450-21proc_pri22:19:030
2443999371,16cyclictest2410-21cyclictest20:48:461
2451999274,12cyclictest28348-21ssh21:33:562
2443999246,38cyclictest0-21swapper/123:53:451
2443999246,38cyclictest0-21swapper/123:53:451
2443999045,38cyclictest8395-21fschecks_time19:18:521
2443999028,52cyclictest0-21swapper/123:13:511
2443998938,45cyclictest0-21swapper/119:49:061
2431998971,11cyclictest14367-21systemd-run19:38:310
2431998971,11cyclictest14367-21systemd-run19:38:310
243199894,37cyclictest544-21cron23:18:280
243199893,32cyclictest24470-21/usr/sbin/munin20:08:560
2451998849,32cyclictest0-21swapper/221:03:532
245199882,75cyclictest0-21swapper/220:08:432
2451998768,10cyclictest0-21swapper/223:11:422
2451998768,10cyclictest0-21swapper/223:11:422
2451998746,36cyclictest0-21swapper/219:04:032
2451998746,36cyclictest0-21swapper/219:04:032
244399875,77cyclictest0-21swapper/121:38:421
244399875,77cyclictest0-21swapper/121:38:421
245199863,74cyclictest0-21swapper/220:58:412
244399864,69cyclictest0-21swapper/120:38:431
244399863,70cyclictest0-21swapper/119:53:451
244399863,70cyclictest0-21swapper/119:53:451
244399863,33cyclictest17223-21cut22:08:561
244399862,69cyclictest8125-21ssh21:54:271
2451998562,13cyclictest0-21swapper/220:48:522
2451998536,43cyclictest0-21swapper/222:48:532
245199852,75cyclictest0-21swapper/219:18:412
2443998569,9cyclictest0-21swapper/100:23:571
244399853,71cyclictest18921-21apt-get21:18:411
244399853,71cyclictest18921-21apt-get21:18:411
244399853,36cyclictest14504-21/usr/sbin/munin22:04:021
244399852,34cyclictest17788-21taskset19:48:301
2451998441,35cyclictest0-21swapper/221:55:092
2451998428,47cyclictest0-21swapper/200:28:382
2443998465,11cyclictest0-21swapper/122:48:521
2443998463,11cyclictest0-21swapper/120:43:471
2443998439,36cyclictest0-21swapper/123:38:331
244399843,73cyclictest0-21swapper/120:58:411
244399843,50cyclictest13873-21munin-run22:58:301
2443998430,41cyclictest0-21swapper/123:25:011
244399842,36cyclictest13856-21timerwakeupswit21:09:081
245199833,76cyclictest0-21swapper/222:58:422
245199833,75cyclictest0-21swapper/222:23:422
245199833,70cyclictest0-21swapper/219:23:462
245199833,70cyclictest0-21swapper/219:23:462
245199833,56cyclictest14163-21apt-get23:53:532
245199833,56cyclictest14163-21apt-get23:53:532
2443998352,23cyclictest23518-21kworker/u18:3+nfsiod00:13:591
244399833,37cyclictest29550-21/usr/sbin/munin20:23:501
244399833,37cyclictest29550-21/usr/sbin/munin20:23:501
244399832,38cyclictest32021-21apt-get23:28:401
2431998365,12cyclictest2883-21rm23:33:530
2431998356,19cyclictest1636-21apt21:44:000
2451998262,15cyclictest11998-21switchtime22:54:042
2451998261,14cyclictest0-21swapper/221:16:582
2451998237,40cyclictest0-21swapper/221:08:572
245199823,73cyclictest0-21swapper/219:53:422
245199823,73cyclictest0-21swapper/219:53:422
2443998263,8cyclictest0-21swapper/119:23:561
2443998263,8cyclictest0-21swapper/119:23:561
244399823,8cyclictest0-21swapper/119:14:311
244399823,34cyclictest28770-21/usr/sbin/munin20:19:091
244399822,38cyclictest19676-21snmpd21:23:501
244399822,36cyclictest20070-21ssh23:08:341
244399822,36cyclictest20070-21ssh23:08:341
244399822,33cyclictest1788-21ssh21:44:041
2431998260,15cyclictest1266-21latency_hist21:43:320
2431998260,15cyclictest1266-21latency_hist21:43:320
2451998144,31cyclictest6486-21apt-key19:13:342
245199812,75cyclictest0-21swapper/220:53:452
2443998136,39cyclictest0-21swapper/121:53:311
244399813,35cyclictest11500-21/usr/sbin/munin19:28:501
244399813,32cyclictest4892-21sh22:43:281
244399812,36cyclictest9929-21apt-get21:03:431
2431998164,11cyclictest8294-21entropy19:18:500
2451998065,11cyclictest2410-21cyclictest19:40:002
245199803,67cyclictest0-21swapper/220:18:472
245199803,66cyclictest0-21swapper/220:03:422
245199803,66cyclictest0-21swapper/220:03:422
2451998036,36cyclictest0-21swapper/223:48:562
245199802,73cyclictest0-21swapper/200:23:452
245199802,67cyclictest0-21swapper/223:43:462
2443998059,13cyclictest8398-21latency_hist23:43:331
244399803,68cyclictest0-21swapper/120:08:461
244399803,40cyclictest20399-21munin-run00:03:291
244399803,31cyclictest29340-21ssh22:29:001
244399803,31cyclictest29340-21ssh22:29:001
244399802,6cyclictest0-21swapper/121:28:441
244399802,6cyclictest0-21swapper/121:28:441
244399802,35cyclictest21606-21/usr/sbin/munin19:58:511
244399802,35cyclictest21606-21/usr/sbin/munin19:58:511
244399802,33cyclictest14820-21apt-get19:38:551
147728025,35sleep30-21swapper/318:59:583
147728025,35sleep30-21swapper/318:59:583
245199793,68cyclictest22788-21runrttasks22:18:422
245199793,68cyclictest22788-21runrttasks22:18:422
245199793,66cyclictest5199-21/usr/sbin/munin21:49:002
2451997933,41cyclictest0-21swapper/222:28:562
2451997933,41cyclictest0-21swapper/222:28:562
245199792,68cyclictest0-21swapper/219:58:382
245199792,68cyclictest0-21swapper/219:58:382
2443997937,34cyclictest0-21swapper/122:34:021
244399793,29cyclictest19794-21/usr/sbin/munin22:13:501
244399792,36cyclictest18397-21rm23:04:301
244399792,36cyclictest18397-21rm23:04:301
244399792,36cyclictest14698-21/usr/sbin/munin22:58:561
244399792,31cyclictest22990-21rm00:07:251
244399792,31cyclictest13704-21ls19:34:031
244399792,31cyclictest13704-21ls19:34:031
244399792,29cyclictest11466-21ssh21:59:011
244399792,29cyclictest11466-21ssh21:59:011
2443997920,51cyclictest26568-21grep23:18:561
245199783,68cyclictest0-21swapper/200:18:412
245199783,63cyclictest0-21swapper/220:28:432
2451997836,34cyclictest0-21swapper/219:53:332
2451997836,29cyclictest0-21swapper/223:03:442
2451997836,29cyclictest0-21swapper/223:03:442
2451997832,40cyclictest0-21swapper/223:18:532
245199782,70cyclictest0-21swapper/219:43:412
244399783,70cyclictest0-21swapper/100:18:411
244399782,35cyclictest26413-21/usr/sbin/munin20:13:521
244399782,33cyclictest15995-21grep21:13:471
244399782,32cyclictest8120-21sed20:58:321
244399782,32cyclictest24411-21taskset22:20:371
244399782,32cyclictest24411-21taskset22:20:371
244399782,31cyclictest25426-21runrttasks00:10:171
244399782,31cyclictest25426-21runrttasks00:10:171
2431997862,9cyclictest27281-21ssh00:13:550
245199773,65cyclictest0-21swapper/220:43:452
2451997735,34cyclictest0-21swapper/221:21:172
2451997735,34cyclictest0-21swapper/221:21:172
245199772,66cyclictest29045-21apt-get23:23:402
244399775,61cyclictest5265-21ssh22:43:451
244399775,61cyclictest5265-21ssh22:43:451
2443997749,20cyclictest3926-21kworker/u17:3+events_unbound19:08:291
2443997749,20cyclictest3926-21kworker/u17:3+events_unbound19:08:291
244399773,33cyclictest32558-21date20:33:331
2443997733,37cyclictest0-21swapper/100:33:301
244399772,35cyclictest27983-21grep21:33:461
244399772,31cyclictest27576-21ssh22:26:101
244399772,30cyclictest8752-21ssh23:43:521
244399772,29cyclictest11762-21cut23:48:511
2451997654,9cyclictest0-21swapper/220:13:402
2451997654,8cyclictest181rcu_preempt23:15:472
245199763,64cyclictest0-21swapper/223:28:452
245199763,63cyclictest0-21swapper/221:23:432
245199763,63cyclictest0-21swapper/219:33:432
245199763,63cyclictest0-21swapper/219:33:432
245199762,57cyclictest1946-21/usr/sbin/munin20:38:512
244399762,63cyclictest22882-21apt-get20:03:391
244399762,63cyclictest22882-21apt-get20:03:391
244399762,32cyclictest4408-21fschecks_count19:08:391
2451997559,9cyclictest0-21swapper/220:34:012
2451997550,13cyclictest0-21swapper/222:43:472
2451997550,13cyclictest0-21swapper/222:43:472
245199753,62cyclictest0-21swapper/222:08:432
2451997535,32cyclictest0-21swapper/223:34:062
2451997534,33cyclictest0-21swapper/223:39:092
2451997531,37cyclictest0-21swapper/222:03:492
2451997529,38cyclictest0-21swapper/223:58:552
244399752,33cyclictest1185-21seq20:34:221
2431997559,12cyclictest2410-21cyclictest22:32:390
2431997559,12cyclictest2410-21cyclictest22:32:390
2431997555,13cyclictest2410-21cyclictest21:13:310
2431997551,17cyclictest24303-21latency_hist20:08:320
2431997551,17cyclictest24303-21latency_hist20:08:320
2431997517,30cyclictest352-21runrttasks22:53:370
245599742,54cyclictest6531-21chrt19:13:453
245199744,65cyclictest0-21swapper/221:28:412
245199744,65cyclictest0-21swapper/221:28:412
245199744,33cyclictest27752-21sort00:14:062
245199743,61cyclictest1637-21apt-get21:43:572
2451997433,33cyclictest0-21swapper/220:23:552
2451997433,33cyclictest0-21swapper/220:23:552
2431997456,13cyclictest2410-21cyclictest23:30:260
2431997456,11cyclictest22348-21ssh22:18:120
2431997452,16cyclictest8445-21fschecks_count22:48:500
2431997451,16cyclictest7987-21latency_hist19:18:330
2451997355,10cyclictest0-21swapper/221:38:562
2451997355,10cyclictest0-21swapper/221:38:562
2451997335,33cyclictest0-21swapper/222:33:402
2431997353,14cyclictest16476-21latency_hist22:08:320
2431997352,14cyclictest5081-21ssh00:31:060
2431997352,14cyclictest18388-21diskmemload23:59:010
2451997254,11cyclictest0-21swapper/222:38:492
245199722,61cyclictest10838-21apt-get21:58:412
245199722,61cyclictest10838-21apt-get21:58:412
2431997256,10cyclictest181rcu_preempt00:23:420
245199714,56cyclictest20713-21apt-get00:03:402
245199713,59cyclictest0-21swapper/219:28:412
245199712,57cyclictest6748-21/usr/sbin/munin19:14:362
2431997153,12cyclictest6057-21systemd-run19:13:310
243199713,52cyclictest17337-21df_inode23:03:480
243199713,52cyclictest17337-21df_inode23:03:480
2431997135,29cyclictest0-21swapper/022:39:000
2451997027,36cyclictest0-21swapper/200:13:052
2451997027,36cyclictest0-21swapper/200:13:052
2431997046,18cyclictest30718-21timerandwakeup00:19:050
243199704,38cyclictest19195-21fschecks_time21:18:520
243199704,38cyclictest19195-21fschecks_time21:18:520
2431997035,27cyclictest0-21swapper/021:34:040
243199703,38cyclictest15113-21timerwakeupswit22:59:050
243199703,35cyclictest9715-21latency_hist21:03:330
243199694,39cyclictest1515-21latency_hist20:38:330
2431996850,11cyclictest2952-21systemd-journal22:28:290
2431996849,12cyclictest1-21systemd21:49:420
243199683,39cyclictest18260-21fschecks_time19:48:520
243199674,32cyclictest6618-21/usr/sbin/munin20:53:520
2431996737,21cyclictest24634-21ls21:28:310
2431996648,12cyclictest31704-21/usr/sbin/munin22:34:020
245599653,49cyclictest11467-21taskset19:28:473
245599653,47cyclictest3340-21taskset21:45:483
2431996549,11cyclictest0-21swapper/023:53:290
243199654,51cyclictest8028-21taskset22:48:320
243199654,51cyclictest8028-21taskset22:48:320
243199654,46cyclictest16687-21fschecks_time19:43:510
243199654,31cyclictest19647-21/usr/sbin/munin19:53:520
243199654,31cyclictest19647-21/usr/sbin/munin19:53:520
243199653,35cyclictest16527-21ntp_kernel_pll_21:14:000
245599643,46cyclictest17682-21chrt23:58:363
245599642,48cyclictest29568-21taskset00:18:303
245599642,47cyclictest3737-21taskset19:05:553
245599642,47cyclictest3737-21taskset19:05:553
2431996448,11cyclictest58-21kcompactd020:13:540
2431996446,12cyclictest0-21swapper/019:33:310
243199644,34cyclictest3380-21/usr/sbin/munin20:44:020
245599633,48cyclictest15059-21taskset23:54:353
245599633,48cyclictest15059-21taskset23:54:353
245599633,47cyclictest23005-21chrt00:07:283
245599633,47cyclictest19104-21taskset21:18:493
245599633,47cyclictest19104-21taskset21:18:493
245599632,49cyclictest31427-21chrt21:38:593
245599632,49cyclictest31427-21chrt21:38:593
245599632,47cyclictest18873-21chrt23:05:523
245599632,47cyclictest18873-21chrt23:05:523
243199632,44cyclictest29374-21/usr/sbin/munin20:24:010
243199632,44cyclictest29374-21/usr/sbin/munin20:24:010
245599623,47cyclictest25106-21chrt22:22:363
245599623,47cyclictest25106-21chrt22:22:363
245599623,47cyclictest21280-21chrt19:58:403
245599623,47cyclictest21280-21chrt19:58:403
245599623,46cyclictest8532-21chrt23:43:453
245599623,46cyclictest27921-21chrt21:33:443
245599622,47cyclictest3684-21chrt00:28:523
245599622,47cyclictest19836-21chrt22:13:443
245599622,46cyclictest8275-21chrt19:18:473
245599622,46cyclictest11392-21taskset22:53:483
245599622,43cyclictest27711-21chrt22:26:333
243199625,27cyclictest14313-21apt-get19:38:430
2431996228,25cyclictest11061-21cron19:28:300
2431996228,25cyclictest11061-21cron19:28:300
245599613,46cyclictest1498-21chrt23:31:293
245599613,45cyclictest7269-21taskset22:46:473
245599613,45cyclictest7269-21taskset22:46:473
245599613,45cyclictest25075-21chrt23:16:343
245599612,47cyclictest18893-21taskset22:11:543
245599612,46cyclictest7497-21chrt23:41:343
245599612,46cyclictest12542-21chrt22:00:483
245599612,46cyclictest12542-21chrt22:00:483
245599603,45cyclictest9518-21chrt22:49:433
245599603,45cyclictest31930-21chrt22:33:503
245599603,45cyclictest13592-21chrt21:09:043
245599603,45cyclictest10062-21taskset21:03:493
245599603,44cyclictest893-21chrt00:23:573
245599603,44cyclictest6008-21chrt20:49:193
245599603,44cyclictest3756-21chrt22:40:153
245599603,44cyclictest2789-21chrt20:39:153
245599603,44cyclictest21421-21chrt23:09:413
245599603,44cyclictest21421-21chrt23:09:413
245599603,44cyclictest12981-21chrt19:33:413
245599603,44cyclictest12981-21chrt19:33:413
245599603,43cyclictest14346-21chrt22:58:473
245599602,46cyclictest4180-21chrt23:35:343
245599602,46cyclictest10281-21chrt19:24:023
245599602,46cyclictest10281-21chrt19:24:023
245599602,45cyclictest24406-21chrt20:08:333
245599602,45cyclictest24406-21chrt20:08:333
245599593,44cyclictest25444-21chrt00:10:203
245599593,44cyclictest25444-21chrt00:10:203
245599593,43cyclictest9691-21chrt21:56:103
245599593,43cyclictest15511-21chrt22:05:463
245599592,45cyclictest31374-21chrt00:20:213
245599592,45cyclictest28299-21chrt23:22:173
245599592,45cyclictest21928-21chrt21:23:433
245599592,45cyclictest13753-21chrt23:52:243
245599592,44cyclictest17542-21chrt21:15:323
245599592,44cyclictest1446-21taskset20:37:453
245599583,44cyclictest24827-21chrt21:28:333
245599583,44cyclictest24827-21chrt21:28:333
245599583,43cyclictest7833-21chrt20:56:443
245599583,43cyclictest14890-21chrt19:39:333
245599583,42cyclictest4826-21chrt21:48:523
245599583,42cyclictest19213-21taskset19:51:403
245599582,44cyclictest5711-21chrt19:10:083
245599582,44cyclictest32130-21chrt20:31:003
245599582,44cyclictest19977-21chrt19:53:543
245599582,44cyclictest19977-21chrt19:53:543
245599582,43cyclictest27280-21chrt20:16:143
245599573,42cyclictest9504-21chrt21:02:353
245599573,42cyclictest29227-21chrt23:23:473
245599572,43cyclictest30659-21taskset20:27:443
245599572,43cyclictest30659-21taskset20:27:443
245599572,43cyclictest29821-21chrt22:29:083
245599572,43cyclictest29821-21chrt22:29:083
245599572,43cyclictest27933-21chrt20:18:493
245599572,42cyclictest17549-21chrt19:45:533
245599563,42cyclictest4157-21chrt20:44:053
245599552,41cyclictest24498-21chrt20:08:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional