You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 15:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Wed Aug 05, 2026 00:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127069910615,81cyclictest20316-21kworker/u17:1+ext4-rsv-conversion22:00:512
127069910615,81cyclictest20316-21kworker/u17:1+ext4-rsv-conversion22:00:512
12699991062,95cyclictest26642-21apt-get21:06:570
127049910389,8cyclictest0-21swapper/121:05:511
127069910213,78cyclictest18209-21apt-get20:50:482
12699999772,16cyclictest15183-21latency_hist21:40:370
12699999772,16cyclictest15183-21latency_hist21:40:370
12706999450,16cyclictest181rcu_preempt20:55:502
1270499942,68cyclictest11504-21apt-get20:30:511
12706999364,19cyclictest17460-21sshd20:21:382
12704999373,14cyclictest21235-21switchtime20:56:111
12704999356,14cyclictest7174-21sh21:26:101
12704999356,14cyclictest7174-21sh21:26:101
1177929313,57sleep011813-21wc18:51:160
1177929313,57sleep011813-21wc18:51:160
1270499923,76cyclictest6415-21apt-get20:15:491
1270499923,76cyclictest6415-21apt-get20:15:491
1270499922,65cyclictest29308-21apt-get21:10:491
1270499922,65cyclictest29308-21apt-get21:10:491
12706999163,21cyclictest13876-21cstates00:20:552
1254229112,53sleep212549-21modprobe18:55:342
1254229112,53sleep212549-21modprobe18:55:342
12706999044,11cyclictest181rcu_preempt20:40:372
12699998970,13cyclictest3323-21latency_hist20:05:380
12699998970,13cyclictest3323-21latency_hist20:05:380
113882898,57sleep111390-21entropy18:51:011
113882898,57sleep111390-21entropy18:51:011
12706998860,21cyclictest10018-21sh00:14:262
12706998860,21cyclictest10018-21sh00:14:262
1269999882,65cyclictest29308-21apt-get21:10:530
1269999882,65cyclictest29308-21apt-get21:10:530
1269999873,37cyclictest3804-21ls22:15:370
1269999873,37cyclictest3804-21ls22:15:370
12706998661,18cyclictest18346-21fschecks_count19:10:572
12706998645,11cyclictest181rcu_preempt00:07:082
1270699859,67cyclictest29846-21apt-get21:10:532
1270699859,67cyclictest29846-21apt-get21:10:532
12706998555,11cyclictest181rcu_preempt23:15:452
12706998555,11cyclictest181rcu_preempt23:15:452
12706998545,15cyclictest20070-21diskmemload23:15:372
1270699852,51cyclictest12604-21munin-plugin-st22:30:332
12704998365,11cyclictest2374-21systemd-journal22:27:381
12699998363,14cyclictest20070-21diskmemload21:26:010
12699998363,14cyclictest20070-21diskmemload21:26:010
12706998258,16cyclictest26075-21latency_hist21:05:392
12706998258,16cyclictest26075-21latency_hist21:05:392
12704998259,15cyclictest28168-21ssh23:50:531
12704998127,22cyclictest21356-21taskset21:50:481
12704998127,22cyclictest21356-21taskset21:50:481
12704998127,21cyclictest3999-21ssh23:10:361
12704998127,21cyclictest3999-21ssh23:10:361
12699998158,16cyclictest29367-21latency_hist19:45:370
12706998041,13cyclictest181rcu_preempt22:36:072
12704998024,21cyclictest14751-21rm23:27:261
12699998064,10cyclictest19374-21rm21:46:140
12699998057,14cyclictest24186-21latency_hist21:55:380
12699998057,14cyclictest24186-21latency_hist21:55:380
12706997956,16cyclictest4603-21apt-key00:05:392
1270699794,55cyclictest12631-21ssh21:35:482
1270699794,55cyclictest12631-21ssh21:35:482
1270699793,33cyclictest13536-21awk18:56:082
12704997961,12cyclictest277-21dbus-daemon22:15:351
12704997961,12cyclictest277-21dbus-daemon22:15:351
12704997960,12cyclictest27308-21latency_hist22:00:381
12704997939,12cyclictest181rcu_preempt22:56:011
12704997935,35cyclictest0-21swapper/119:00:521
12704997921,25cyclictest0-21swapper/123:49:111
12699997963,10cyclictest17752-21unixbench_multi20:46:110
1269999794,30cyclictest352-21runrttasks22:21:190
12699997913,42cyclictest23924-21unixbench_multi19:26:130
12699997913,42cyclictest23924-21unixbench_multi19:26:130
12714997844,24cyclictest15238-21taskset20:40:533
12706997856,16cyclictest300-21rs:main2
12706997847,9cyclictest181rcu_preempt20:25:522
12706997847,9cyclictest181rcu_preempt20:25:522
12706997845,11cyclictest181rcu_preempt21:40:462
12706997845,10cyclictest181rcu_preempt21:25:512
12706997845,10cyclictest181rcu_preempt21:25:512
12704997862,11cyclictest1-21systemd22:19:221
12704997857,12cyclictest24888-21diskmemload22:50:521
12704997857,12cyclictest24888-21diskmemload22:50:521
12704997830,37cyclictest12599-21apt-get21:35:511
12704997830,37cyclictest12599-21apt-get21:35:511
12704997829,18cyclictest12271-21ssh23:23:541
12704997825,25cyclictest20070-21diskmemload21:40:451
12704997822,24cyclictest0-21swapper/100:19:111
12704997815,29cyclictest0-21swapper/100:05:531
12706997757,14cyclictest30790-21sh23:00:512
12706997757,14cyclictest29612-21sh19:45:542
12706997748,8cyclictest181rcu_preempt19:50:462
12706997745,9cyclictest181rcu_preempt22:41:102
12706997740,13cyclictest39-21ksoftirqd/222:49:072
12706997734,10cyclictest181rcu_preempt23:26:122
12704997756,13cyclictest12689-21cyclictest00:04:451
12704997731,36cyclictest387-21apt-get21:15:471
12704997726,23cyclictest15760-21taskset00:23:491
12704997725,20cyclictest9574-21seq20:21:591
12699997752,18cyclictest3239-21latency_hist21:20:370
12699997749,21cyclictest24619-21fschecks_time21:55:580
1270699765,52cyclictest1710-21latency_hist20:00:372
12706997645,13cyclictest2341-21ssh21:18:352
1270699763,27cyclictest12224-21latency_hist21:35:372
12704997634,34cyclictest0-21swapper/122:35:501
12704997633,31cyclictest0-21swapper/123:35:491
12704997633,31cyclictest0-21swapper/123:35:491
12704997620,21cyclictest0-21swapper/120:29:341
12704997620,21cyclictest0-21swapper/120:29:341
12699997659,11cyclictest15136-21sh00:22:040
1270699754,48cyclictest9589-21kworker/u18:2+flush-179:021:05:492
12704997554,14cyclictest22191-21sh23:40:511
12704997553,14cyclictest4048-21processes20:06:051
12704997553,14cyclictest4048-21processes20:06:051
12704997525,22cyclictest17783-21taskset19:09:181
12699997533,31cyclictest0-21swapper/021:33:530
12714997428,28cyclictest0-21swapper/320:16:363
12714997428,28cyclictest0-21swapper/320:16:363
12706997452,10cyclictest58-21kcompactd021:56:352
12706997451,16cyclictest18598-21latency_hist20:50:382
12706997424,11cyclictest181rcu_preempt19:40:512
12706997415,15cyclictest39-21ksoftirqd/219:35:472
12706997415,15cyclictest39-21ksoftirqd/219:35:472
12704997456,11cyclictest277-21dbus-daemon20:15:351
12704997455,13cyclictest20066-21sh20:55:341
12704997455,10cyclictest915-21sh22:10:371
12704997446,21cyclictest32680-21apt-get19:55:501
12704997440,23cyclictest21380-21apt-get19:20:461
12704997428,37cyclictest10236-21find21:31:081
12699997459,10cyclictest14147-21ntp_offset20:36:050
12699997457,11cyclictest5528-21rm22:17:280
12699997456,12cyclictest10550-21latency_hist00:15:370
12699997456,12cyclictest10550-21latency_hist00:15:370
12699997451,8cyclictest11607-21kworker/u17:1+xprtiod22:55:290
12699997451,8cyclictest11607-21kworker/u17:1+xprtiod22:55:290
12714997339,22cyclictest24647-21chrt22:50:363
12706997351,8cyclictest181rcu_preempt19:25:392
12706997351,8cyclictest181rcu_preempt19:25:392
12706997347,19cyclictest14577-21cut19:00:412
12704997346,19cyclictest940-21cron23:05:331
12704997324,23cyclictest18387-21taskset23:34:191
12704997320,23cyclictest19044-21df22:40:541
12699997355,12cyclictest30832-21true19:50:350
12699997351,16cyclictest6586-21latency_hist20:15:360
1269999733,37cyclictest25406-21fschecks_time23:45:560
12699997324,25cyclictest0-21swapper/022:04:010
12699997324,25cyclictest0-21swapper/022:04:010
12699997314,29cyclictest22759-21sendmail-msp19:25:350
1270699723,36cyclictest24163-21latency_hist21:55:382
1270699723,36cyclictest24163-21latency_hist21:55:382
12704997250,15cyclictest15775-21latency_hist22:35:371
12704997227,36cyclictest26082-21munin-run21:05:351
12704997227,36cyclictest26082-21munin-run21:05:351
12704997225,20cyclictest24060-21taskset19:27:001
12704997225,20cyclictest24060-21taskset19:27:001
12704997222,18cyclictest4259-21ssh23:10:431
12704997221,22cyclictest20070-21diskmemload22:22:101
12704997220,41cyclictest6922-21latency_hist23:15:371
12704997220,41cyclictest6922-21latency_hist23:15:371
12704997215,29cyclictest10471-21munin-run00:15:351
12704997215,29cyclictest10471-21munin-run00:15:351
1269999725,30cyclictest17121-21/usr/sbin/munin19:06:090
12699997250,15cyclictest9942-21sh23:20:370
12699997250,15cyclictest9942-21sh23:20:370
1269999723,33cyclictest6074-21awk21:25:340
12704997125,18cyclictest20070-21diskmemload22:04:501
12704997125,18cyclictest20070-21diskmemload22:04:501
12704997123,19cyclictest24145-21sh22:49:341
12699997149,16cyclictest30261-21ssh23:54:110
12699997146,18cyclictest25059-21latency_hist23:45:380
1269999714,45cyclictest14222-21latency_hist19:00:370
12699997140,11cyclictest181rcu_preempt21:01:070
12699997140,11cyclictest181rcu_preempt21:01:070
1269999713,30cyclictest3530-21sort20:05:490
1269999713,30cyclictest3530-21sort20:05:490
12714997036,20cyclictest30841-21chrt22:06:013
12706997046,13cyclictest0-21swapper/220:20:372
12706997046,13cyclictest0-21swapper/220:20:372
1270699702,27cyclictest6403-21modprobe20:15:342
12699997055,9cyclictest21900-21ssh20:57:200
12699997053,11cyclictest31418-21sh23:01:080
12699997047,14cyclictest0-21swapper/023:35:560
12699997047,14cyclictest0-21swapper/023:35:560
12699997045,17cyclictest11544-21switchtime00:16:090
12699997034,16cyclictest181rcu_preempt22:41:000
1271499699,39cyclictest0-21swapper/321:05:573
12714996935,22cyclictest13425-21chrt23:25:563
12714996930,26cyclictest11415-21taskset22:27:133
12706996950,10cyclictest28551-21ssh23:51:032
12706996932,10cyclictest181rcu_preempt20:40:592
12706996928,13cyclictest181rcu_preempt23:25:242
1270699692,29cyclictest25818-21/usr/sbin/munin23:46:082
12704996956,9cyclictest12689-21cyclictest19:17:361
12704996938,23cyclictest3388-21apt-get21:20:471
12704996934,26cyclictest0-21swapper/120:45:481
12704996927,33cyclictest3168-21modprobe20:05:351
12704996927,33cyclictest3168-21modprobe20:05:351
1269999696,37cyclictest4813-21apt-get00:05:460
12699996949,15cyclictest12689-21cyclictest22:40:360
12699996949,14cyclictest5866-21ssh23:12:350
1269999694,54cyclictest9967-21ssh22:25:470
1269999694,34cyclictest20070-21diskmemload23:57:390
1269999693,53cyclictest15944-21latency_hist23:30:360
1269999693,35cyclictest13606-21wc22:31:080
1269999693,24cyclictest27765-21rm22:55:420
12699996927,32cyclictest15743-21ntp_kernel_pll_20:41:050
12699996911,48cyclictest11999-21apt-get20:30:510
12714996834,22cyclictest27316-21chrt23:49:153
12714996833,20cyclictest10459-21chrt00:15:343
12714996833,20cyclictest10459-21chrt00:15:343
12714996832,23cyclictest5003-21taskset00:06:183
12714996829,26cyclictest22917-21taskset21:52:353
12714996829,26cyclictest22917-21taskset21:52:353
12706996852,12cyclictest58-21kcompactd022:06:372
1270699683,24cyclictest4422-21sed20:06:092
1270699683,24cyclictest4422-21sed20:06:092
12706996824,14cyclictest181rcu_preempt23:35:362
1270699682,35cyclictest18980-21ntp_states21:46:072
12706996817,23cyclictest13044-21cpuspeed22:30:522
12704996845,15cyclictest16566-21kworker/u18:020:45:341
12704996841,13cyclictest0-21swapper/119:51:101
12704996836,21cyclictest26223-21apt-get19:35:471
12704996836,21cyclictest26223-21apt-get19:35:471
1269999687,24cyclictest3237-21ssh00:02:450
12699996847,14cyclictest352-21runrttasks23:05:500
12699996847,14cyclictest352-21runrttasks23:05:500
1269999684,38cyclictest12879-21munin-run23:25:340
1269999684,32cyclictest10119-21latency_hist20:25:380
1269999682,33cyclictest18923-21fschecks_count20:51:200
12699996810,16cyclictest17985-21ssh23:33:100
12714996736,21cyclictest9895-21chrt20:25:343
12714996734,22cyclictest25425-21chrt22:51:053
12714996734,22cyclictest25425-21chrt22:51:053
12714996734,21cyclictest20749-21chrt19:16:123
12714996732,23cyclictest23222-21taskset23:41:123
12714996732,22cyclictest17832-21chrt23:32:453
12714996732,21cyclictest2806-21chrt20:01:123
12714996732,21cyclictest2806-21chrt20:01:123
12714996731,23cyclictest671-21chrt23:04:473
12714996731,21cyclictest29749-21chrt23:52:443
12706996747,15cyclictest11221-21sh00:16:012
12704996736,22cyclictest29462-21apt-get19:45:471
1270499673,43cyclictest14557-21unixbench_singl20:36:131
12704996731,29cyclictest25968-21idleruntime-cro19:35:341
12704996731,29cyclictest25968-21idleruntime-cro19:35:341
12704996730,27cyclictest28804-21users19:41:121
1269999679,49cyclictest6916-21apt-get20:15:550
1269999679,49cyclictest6916-21apt-get20:15:550
12699996736,25cyclictest0-21swapper/022:06:060
1269999673,26cyclictest15-21ksoftirqd/021:40:590
12714996635,20cyclictest25781-21chrt21:57:173
12714996634,20cyclictest4013-21chrt22:15:503
12714996634,18cyclictest21496-21chrt22:45:343
12714996633,20cyclictest14319-21chrt19:00:373
12714996632,22cyclictest23812-21chrt19:26:133
12714996632,22cyclictest23812-21chrt19:26:133
12714996632,22cyclictest17276-21chrt22:36:583
12714996632,21cyclictest23410-21chrt21:00:503
12714996632,21cyclictest23410-21chrt21:00:503
12714996631,22cyclictest9105-21chrt23:18:223
12714996631,22cyclictest9105-21chrt23:18:223
12714996630,25cyclictest29870-21taskset21:10:473
12714996630,25cyclictest29870-21taskset21:10:473
12714996627,27cyclictest3495-21taskset23:09:173
12714996627,27cyclictest3495-21taskset23:09:173
1270699665,40cyclictest16805-21fschecks_time19:05:592
12706996649,10cyclictest0-21swapper/222:15:342
12706996649,10cyclictest0-21swapper/222:15:342
12706996647,14cyclictest9589-21kworker/u18:2+events_unbound21:25:342
12706996647,13cyclictest352-21runrttasks19:31:032
12706996647,13cyclictest352-21runrttasks19:31:032
12706996634,9cyclictest181rcu_preempt23:06:012
12706996634,9cyclictest181rcu_preempt23:06:012
12706996634,10cyclictest181rcu_preempt23:41:142
1270699662,29cyclictest25362-21ssh22:51:042
1270699662,29cyclictest25362-21ssh22:51:042
12706996619,15cyclictest181rcu_preempt19:25:372
12704996642,12cyclictest0-21swapper/123:55:511
1269999663,29cyclictest24693-21ls22:50:370
12714996534,20cyclictest29659-21chrt22:58:233
12714996533,20cyclictest6261-21chrt20:13:483
12714996533,20cyclictest4790-21chrt23:11:003
12714996533,20cyclictest10029-21chrt21:31:053
12714996532,21cyclictest17312-21chrt19:06:123
12714996532,21cyclictest11497-21chrt23:21:423
12714996531,23cyclictest17983-21chrt20:47:493
12714996531,21cyclictest32170-21taskset23:56:123
12714996531,19cyclictest2496-21chrt00:01:113
12714996529,22cyclictest12226-21chrt00:17:173
12706996525,30cyclictest1876-21cpu20:00:512
12706996525,30cyclictest1876-21cpu20:00:512
1270699652,23cyclictest31556-21latency23:56:002
12704996530,29cyclictest0-21swapper/121:45:491
12704996530,26cyclictest12881-21apt-get18:55:461
12704996529,26cyclictest18168-21apt-get19:10:471
1269999655,26cyclictest15-21ksoftirqd/020:28:480
1269999655,26cyclictest15-21ksoftirqd/020:28:480
1269999653,50cyclictest26204-21/usr/sbin/munin19:36:000
1269999653,50cyclictest26204-21/usr/sbin/munin19:36:000
1269999653,29cyclictest14699-21kernelversion19:00:420
12714996433,20cyclictest12817-21chrt20:31:263
12714996432,22cyclictest6584-21chrt21:25:553
12714996432,22cyclictest6584-21chrt21:25:553
12714996432,20cyclictest5982-21chrt21:25:263
12714996432,20cyclictest13769-21chrt20:35:553
12714996431,21cyclictest8330-21chrt22:21:583
12714996431,20cyclictest2669-21chrt22:12:463
12714996431,20cyclictest2669-21chrt22:12:463
12714996431,20cyclictest10381-21chrt20:25:593
12714996431,20cyclictest10381-21chrt20:25:593
12714996430,21cyclictest389-21chrt21:15:463
12714996430,21cyclictest21957-21chrt20:57:303
12714996427,25cyclictest29582-21taskset22:03:583
12714996427,25cyclictest29582-21taskset22:03:583
12706996446,12cyclictest30442-21idleruntime-cro23:00:342
1270699644,40cyclictest20144-21kernelversion19:16:002
1270699643,41cyclictest352-21runrttasks23:38:512
1270699643,41cyclictest352-21runrttasks23:38:512
1270699643,32cyclictest11504-21apt-get20:30:482
1269999643,51cyclictest352-21runrttasks19:15:590
1269999643,27cyclictest15-21ksoftirqd/019:59:500
12714996332,19cyclictest4140-21chrt20:06:063
12714996332,19cyclictest4140-21chrt20:06:063
12714996331,20cyclictest22574-21chrt19:23:543
12714996330,21cyclictest756-21chrt19:56:063
1270699632,41cyclictest4108-21cstates22:15:522
12714996232,20cyclictest28427-21chrt19:41:073
12714996232,19cyclictest14387-21chrt00:21:103
12714996231,21cyclictest12553-21chrt21:35:393
12714996231,21cyclictest12553-21chrt21:35:393
12714996231,20cyclictest32513-21chrt19:55:373
12714996231,20cyclictest18734-21chrt20:50:573
12714996231,20cyclictest14971-21taskset19:00:533
12714996230,20cyclictest15126-21chrt22:34:193
12714996229,21cyclictest19257-21chrt19:12:363
12714996229,21cyclictest15377-21chrt21:40:473
1269999623,41cyclictest18435-21fschecks_time19:10:580
12699996222,30cyclictest32481-21latency_hist19:55:370
12714996130,20cyclictest25721-21chrt19:32:453
12714996130,20cyclictest25721-21chrt19:32:453
12714996128,23cyclictest21014-21taskset23:38:203
12714996128,23cyclictest21014-21taskset23:38:203
12714996128,21cyclictest27415-21chrt19:38:523
12714996128,21cyclictest27415-21chrt19:38:523
12714996128,21cyclictest19695-21taskset21:46:513
1269999613,40cyclictest24598-21/usr/sbin/munin19:30:590
1269999613,40cyclictest24598-21/usr/sbin/munin19:30:590
12714996028,22cyclictest29467-21chrt19:45:493
124292535,33sleep30-21swapper/318:54:053
124292535,33sleep30-21swapper/318:54:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional