You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 19:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Thu Sep 10, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2185524440,15sleep221856-21timerwakeupswit07:05:162
224929913659,9cyclictest0-21swapper/008:29:330
225009912059,54cyclictest13480-21fschecks_count09:34:491
224929911946,15cyclictest23557-21latency_hist10:44:320
225009911862,48cyclictest0-21swapper/110:49:591
225009911758,8cyclictest0-21swapper/112:09:501
224929911751,8cyclictest0-21swapper/011:14:580
224929911746,11cyclictest0-21swapper/011:39:390
22492991163,52cyclictest30524-21mailstats10:55:020
225009910852,12cyclictest0-21swapper/111:20:521
225009910556,43cyclictest21819-21ssh11:34:491
225009910082,12cyclictest8149-21kworker/u17:1-rpciod11:24:571
21526210010,61sleep021000-21/usr/sbin/munin07:05:060
22500999977,12cyclictest0-21swapper/107:29:341
22492999777,15cyclictest31143-21fschecks_time11:49:520
22492999741,42cyclictest317-21dbus-daemon12:39:310
22500999540,10cyclictest181rcu_preempt08:00:131
22492999571,15cyclictest6844-21unin-run07:59:320
22492999569,18cyclictest20311-21fschecks_time12:25:340
22492999333,21cyclictest0-21swapper/011:35:120
22500999169,13cyclictest0-21swapper/109:04:331
22500999068,11cyclictest0-21swapper/109:54:591
22500999068,11cyclictest0-21swapper/109:54:591
2250099903,67cyclictest17201-21apt-get08:29:521
2250099903,67cyclictest17201-21apt-get08:29:521
2250099902,63cyclictest5421-21apt-get10:14:571
22492998866,12cyclictest0-21swapper/010:24:330
22492998866,12cyclictest0-21swapper/010:24:330
22492998860,8cyclictest181rcu_preempt09:50:040
22500998759,20cyclictest20452-21sh11:32:231
22492998768,13cyclictest6252-21latency_hist11:09:330
22492998766,14cyclictest26219-21unixbench_singl08:55:060
22506998660,20cyclictest21225-21latency_hist11:34:342
22500998662,13cyclictest0-21swapper/107:09:341
22492998624,50cyclictest25422-21/usr/sbin/munin09:54:520
22492998624,50cyclictest25422-21/usr/sbin/munin09:54:520
22506998565,13cyclictest6951-21sh10:16:242
22492998564,14cyclictest19760-21kernelversion09:44:550
22492998541,11cyclictest181rcu_preempt12:19:400
22492998541,11cyclictest181rcu_preempt12:19:400
22506998445,26cyclictest25469-21grep08:54:512
22500998467,10cyclictest0-21swapper/111:04:551
22500998437,33cyclictest24012-21apt07:14:301
22500998437,33cyclictest24012-21apt07:14:301
22492998459,16cyclictest181rcu_preempt08:30:000
22492998459,16cyclictest181rcu_preempt08:30:000
22492998456,8cyclictest181rcu_preempt12:33:230
22492998452,11cyclictest181rcu_preempt10:29:550
22492998452,11cyclictest181rcu_preempt10:29:550
22506998354,20cyclictest30113-21diskmemload12:22:292
22506998354,20cyclictest30113-21diskmemload12:22:292
22500998359,12cyclictest0-21swapper/112:24:291
22500998359,12cyclictest0-21swapper/112:24:291
22492998362,10cyclictest0-21swapper/008:59:530
22506998210,61cyclictest7284-21apt-get07:59:542
22500998261,11cyclictest0-21swapper/108:19:511
22492998262,13cyclictest22480-21cyclictest09:29:320
22500998161,11cyclictest0-21swapper/111:54:491
22500998161,11cyclictest0-21swapper/111:54:491
22500998161,11cyclictest0-21swapper/108:04:561
22492998156,15cyclictest0-21swapper/008:20:030
2251299803,37cyclictest9536-21taskset10:20:083
2251299803,37cyclictest9536-21taskset10:20:083
2250699809,62cyclictest583-21apt-get07:39:522
22500998063,11cyclictest317-21dbus-daemon11:49:311
22500998062,11cyclictest0-21swapper/110:34:481
22500998059,12cyclictest0-21swapper/112:24:511
22500998058,12cyclictest0-21swapper/108:39:291
22500998058,12cyclictest0-21swapper/108:39:291
22492998061,9cyclictest0-21swapper/012:05:040
22492998061,9cyclictest0-21swapper/012:05:040
22506997964,11cyclictest22480-21cyclictest11:35:132
22506997954,17cyclictest10785-21fschecks_time12:09:512
22506997950,22cyclictest15961-21idleruntime-cro09:39:292
22506997942,27cyclictest6921-21kworker/u19:2+nfsiod10:19:392
22506997942,27cyclictest6921-21kworker/u19:2+nfsiod10:19:392
22500997963,9cyclictest0-21swapper/110:05:061
22500997958,11cyclictest0-21swapper/108:25:021
22500997957,15cyclictest200-21systemd-journal09:44:321
22500997924,35cyclictest31420-21cat09:10:091
22492997964,10cyclictest22480-21cyclictest10:50:070
22492997961,9cyclictest0-21swapper/008:14:330
22492997959,10cyclictest0-21swapper/007:34:500
22492997957,10cyclictest0-21swapper/011:10:050
22492997956,15cyclictest200-21systemd-journal08:15:060
22492997956,15cyclictest200-21systemd-journal08:15:060
22492997955,12cyclictest0-21swapper/007:24:540
2250699787,64cyclictest7292-21kworker/u18:0+ext4-rsv-conversion08:29:552
2250699787,64cyclictest7292-21kworker/u18:0+ext4-rsv-conversion08:29:552
22506997863,9cyclictest25447-21modprobe12:34:292
22506997855,16cyclictest22480-21cyclictest08:49:322
22500997861,9cyclictest0-21swapper/108:49:581
22500997857,13cyclictest0-21swapper/107:54:511
22500997843,9cyclictest181rcu_preempt08:14:441
22500997843,9cyclictest181rcu_preempt08:14:441
22492997863,11cyclictest22480-21cyclictest08:00:010
22492997861,11cyclictest28690-21xargs11:45:050
22492997856,12cyclictest0-21swapper/010:45:080
22492997849,17cyclictest22480-21cyclictest09:12:450
22492997838,13cyclictest181rcu_preempt12:02:170
2250699773,48cyclictest22365-21/usr/sbin/munin09:50:032
22506997727,15cyclictest0-21swapper/210:54:332
22506997717,19cyclictest314-21latency_hist07:39:332
22500997758,10cyclictest0-21swapper/111:40:011
22500997749,20cyclictest31103-21latency_hist07:34:341
22492997760,11cyclictest0-21swapper/007:29:530
22492997755,11cyclictest0-21swapper/008:44:460
22492997754,12cyclictest0-21swapper/008:09:320
22492997750,20cyclictest6484-21switchtime10:15:550
22492997749,19cyclictest18345-21latency_hist11:29:330
22492997717,35cyclictest0-21swapper/007:50:050
22506997652,17cyclictest1-21systemd10:36:582
22500997660,8cyclictest0-21swapper/109:44:401
22500997655,10cyclictest0-21swapper/112:34:521
22500997649,18cyclictest17278-21apt-key10:34:321
22500997649,18cyclictest17278-21apt-key10:34:321
22500997635,10cyclictest181rcu_preempt12:04:431
22500997635,10cyclictest181rcu_preempt12:04:431
22492997659,10cyclictest0-21swapper/008:44:320
22492997652,18cyclictest16278-21/usr/sbin/munin09:40:040
22506997557,13cyclictest16195-21latency_hist12:19:322
22506997552,14cyclictest21456-21sh10:40:042
22506997540,26cyclictest30097-21modprobe09:09:302
2250699752,51cyclictest6755-21fschecks_time11:09:552
22500997560,9cyclictest2333-21df_inode10:09:481
22500997560,9cyclictest2333-21df_inode10:09:481
22500997560,8cyclictest0-21swapper/110:47:051
22500997559,9cyclictest0-21swapper/109:24:471
22500997558,9cyclictest0-21swapper/108:10:061
22492997553,15cyclictest200-21systemd-journal08:35:490
22492997553,15cyclictest200-21systemd-journal08:35:490
22492997547,22cyclictest0-21swapper/010:00:080
22506997459,10cyclictest12293-21switchtime10:25:042
22500997459,8cyclictest0-21swapper/111:59:541
22500997456,9cyclictest0-21swapper/108:44:561
22500997455,8cyclictest181rcu_preempt11:50:161
22500997452,12cyclictest0-21swapper/107:50:061
22500997442,8cyclictest181rcu_preempt11:11:581
22492997457,11cyclictest326-21systemd-logind09:24:310
22492997454,10cyclictest0-21swapper/007:15:070
22492997452,13cyclictest0-21swapper/012:14:320
22492997439,25cyclictest0-21swapper/010:09:330
22492997424,9cyclictest181rcu_preempt10:35:140
2250699736,47cyclictest12401-21latency_hist11:19:342
2250699736,45cyclictest25419-21ntp_states11:39:592
22506997352,16cyclictest0-21swapper/207:59:332
22506997350,13cyclictest0-21swapper/209:20:062
2250699733,49cyclictest31284-21cat10:04:322
22500997354,11cyclictest0-21swapper/107:39:341
22500997327,9cyclictest181rcu_preempt08:54:421
22492997357,10cyclictest0-21swapper/011:30:090
22492997352,15cyclictest797-21kernelversion10:59:550
22492997316,39cyclictest22373-21kworker/u19:0+flush-179:007:39:550
2250699725,50cyclictest25774-21ssh12:34:422
22506997228,30cyclictest23645-21grep07:10:072
22506997228,30cyclictest23645-21grep07:10:072
2250699722,38cyclictest13478-21modprobe08:19:302
2250699722,38cyclictest13478-21modprobe08:19:302
22500997258,7cyclictest0-21swapper/111:14:551
22500997256,8cyclictest0-21swapper/110:20:041
22500997256,8cyclictest0-21swapper/110:20:041
22500997251,15cyclictest662-21cron09:34:301
22500997249,7cyclictest181rcu_preempt12:15:341
22500997249,15cyclictest22480-21cyclictest09:51:531
22492997252,11cyclictest0-21swapper/009:34:530
22492997250,13cyclictest0-21swapper/007:20:070
22492997242,22cyclictest0-21swapper/012:17:250
22506997154,10cyclictest317-21dbus-daemon11:59:302
22506997154,10cyclictest317-21dbus-daemon11:59:302
22500997156,7cyclictest0-21swapper/110:59:511
22500997152,9cyclictest0-21swapper/112:30:021
22492997151,14cyclictest1-21systemd09:08:490
2251299703,46cyclictest19940-21taskset12:25:123
22506997053,11cyclictest9903-21ssh09:29:312
22506997042,20cyclictest30113-21diskmemload09:40:032
22500997055,8cyclictest0-21swapper/110:39:591
22500997046,8cyclictest181rcu_preempt10:25:101
2250099704,39cyclictest3140-21unixbench_singl07:45:071
22492997046,13cyclictest0-21swapper/011:54:480
22492997046,13cyclictest0-21swapper/011:54:480
2251299695,43cyclictest21806-21chrt11:34:473
22506996945,13cyclictest0-21swapper/207:45:042
2250699694,46cyclictest31455-21unixbench_multi09:10:092
2250699693,51cyclictest7739-21fschecks_time12:04:522
2250699693,51cyclictest7739-21fschecks_time12:04:522
2250699693,31cyclictest0-21swapper/207:49:512
22506996921,30cyclictest3531-21cstates11:04:462
22506996919,39cyclictest3239-21latency_hist11:04:332
22500996950,10cyclictest0-21swapper/109:19:511
22492996950,10cyclictest0-21swapper/007:44:470
22492996932,8cyclictest0-21swapper/010:28:120
22506996849,13cyclictest19751-21kernelversion09:44:552
2250699684,41cyclictest343-21runrttasks09:02:552
2250699684,35cyclictest17418-21latency_hist10:34:332
2250699684,35cyclictest17418-21latency_hist10:34:332
2250699683,43cyclictest343-21runrttasks08:09:492
2250699683,42cyclictest343-21runrttasks12:25:372
2250699683,26cyclictest23740-21/usr/sbin/munin10:45:072
22506996821,33cyclictest2803-21proc_pri10:10:012
22506996821,33cyclictest2803-21proc_pri10:10:012
22506996818,12cyclictest0-21swapper/211:28:392
22506996815,12cyclictest0-21swapper/209:34:322
22506996815,11cyclictest0-21swapper/209:54:562
22506996815,11cyclictest0-21swapper/209:54:562
22500996853,8cyclictest0-21swapper/109:59:541
2250099685,36cyclictest583-21apt-get07:39:451
22500996851,8cyclictest0-21swapper/109:05:551
22500996821,22cyclictest20819-21kernelversion08:39:561
2249299684,51cyclictest997-21ssh09:14:380
22506996751,11cyclictest358-21ntpd08:25:002
22506996749,12cyclictest28156-21fschecks_count07:24:502
22506996745,14cyclictest1-21systemd07:32:492
22506996744,17cyclictest1832-21sh10:09:302
2250699673,44cyclictest14475-21switchtime08:20:032
2250699673,41cyclictest343-21runrttasks08:40:042
22506996718,37cyclictest1-21systemd08:54:312
22506996712,21cyclictest9820-21tail08:05:102
22500996748,13cyclictest326-21systemd-logind10:59:311
22500996727,29cyclictest25230-21ntp_kernel_pll_07:15:011
22492996747,7cyclictest181rcu_preempt09:31:360
22492996744,7cyclictest181rcu_preempt11:19:570
22492996743,8cyclictest181rcu_preempt07:14:340
22492996743,8cyclictest181rcu_preempt07:14:340
22492996740,8cyclictest181rcu_preempt10:09:400
22492996740,8cyclictest181rcu_preempt10:09:400
22506996644,12cyclictest0-21swapper/209:15:202
2250699662,48cyclictest27326-21grep07:20:072
2250699662,47cyclictest20361-21latency_hist08:39:332
2250699662,47cyclictest20361-21latency_hist08:39:332
22500996650,7cyclictest0-21swapper/109:15:041
22500996617,8cyclictest181rcu_preempt07:24:321
22506996548,13cyclictest22480-21cyclictest11:46:072
22506996545,14cyclictest200-21systemd-journal11:24:292
22492996544,15cyclictest662-21cron08:54:300
22506996443,14cyclictest359-21snmpd07:14:542
22506996439,13cyclictest0-21swapper/211:50:082
2251299633,38cyclictest73232sleep308:00:033
2251299625,19cyclictest0-21swapper/310:14:573
2250699622,45cyclictest5350-21grep12:00:062
2250699613,33cyclictest343-21runrttasks10:58:212
2240725910,24sleep30-21swapper/307:09:343
22512995710,35cyclictest0-21swapper/309:04:463
2251299563,40cyclictest5827-21taskset11:08:443
2251299553,39cyclictest23781-21taskset08:49:483
2251299553,35cyclictest26804-21chrt07:19:583
2251299553,33cyclictest17588-21taskset12:20:073
2251299553,33cyclictest17588-21taskset12:20:073
2251299552,32cyclictest901-21kworker/3:1+events11:59:493
2251299543,36cyclictest30847-21taskset10:55:063
2251299543,36cyclictest12709-21chrt11:19:513
2251299543,36cyclictest12148-21taskset10:25:023
2251299543,35cyclictest17214-21chrt08:29:483
2251299543,35cyclictest17214-21chrt08:29:483
2251299543,34cyclictest3985-21taskset09:19:343
2251299543,34cyclictest20525-21chrt11:32:363
2251299542,40cyclictest29936-21chrt10:00:593
2251299542,36cyclictest24708-21taskset07:14:433
2251299538,28cyclictest19244-21chrt09:44:343
2251299534,34cyclictest23541-21chrt10:44:323
2251299533,38cyclictest31476-21taskset09:10:093
2251299533,34cyclictest31724-21chrt07:35:003
2251299533,33cyclictest27505-21chrt10:50:033
2251299532,36cyclictest725-21chrt10:59:523
2251299532,35cyclictest26694-21chrt08:59:323
2251299524,32cyclictest24914-21chrt11:39:453
2251299524,29cyclictest2071-21chrt10:09:343
2251299523,33cyclictest16175-21chrt11:25:023
2251299523,32cyclictest30000-21chrt11:48:043
2251299523,32cyclictest25641-21chrt12:34:333
2251299522,36cyclictest21947-21taskset09:49:113
2251299522,34cyclictest10287-21chrt12:09:333
2251299522,34cyclictest10287-21chrt12:09:333
2251299522,33cyclictest28661-21chrt09:04:343
2251299513,35cyclictest19994-21chrt10:38:243
2251299513,33cyclictest3553-21chrt07:49:303
2251299513,33cyclictest26096-21taskset12:34:533
2251299513,31cyclictest3047-21chrt11:56:363
2251299513,31cyclictest3047-21chrt11:56:363
2251299512,34cyclictest7204-21chrt11:10:063
2251299503,34cyclictest15286-21chrt08:24:333
2251299503,33cyclictest6691-21chrt09:24:073
2251299503,33cyclictest22144-21chrt08:44:463
2251299503,30cyclictest4787-21chrt07:50:073
2251299502,36cyclictest7213-21chrt07:59:343
2251299502,36cyclictest4601-21chrt10:13:473
2251299502,36cyclictest4601-21chrt10:13:473
2251299494,34cyclictest1472-21chrt07:40:473
2251299493,33cyclictest21433-21taskset08:40:083
2251299493,30cyclictest10508-21chrt12:09:453
22512994832,8cyclictest102202sleep311:15:053
2251299482,33cyclictest22913-21chrt09:49:573
2251299482,31cyclictest26014-21chrt10:48:173
2251299482,30cyclictest13520-21chrt12:14:433
2251299473,33cyclictest28411-21taskset07:24:563
2251299473,32cyclictest23124-21taskset07:09:573
2251299473,32cyclictest23124-21taskset07:09:573
2251299473,29cyclictest10939-21chrt09:30:033
2251299472,30cyclictest32084-21chrt11:50:323
2251299453,30cyclictest14786-21chrt10:29:533
2251299453,30cyclictest14786-21chrt10:29:533
2251299434,28cyclictest15458-21chrt09:38:093
2251299432,25cyclictest18818-21chrt08:34:423
2251299432,25cyclictest18818-21chrt08:34:423
2251299423,27cyclictest8918-21chrt08:04:493
2251299422,28cyclictest8468-21chrt09:25:413
2251299422,26cyclictest12696-21chrt08:15:013
2251299422,26cyclictest12696-21chrt08:15:013
2251299413,27cyclictest10514-21chrt08:09:433
2251299412,28cyclictest26997-21taskset09:56:213
2251299412,28cyclictest26997-21taskset09:56:213
2251299403,27cyclictest16785-21taskset08:29:313
2251299382,27cyclictest30827-21taskset07:33:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional