You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 11:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Jul 22, 2026 00:44:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9871213010,34sleep30-21swapper/318:52:503
10602211110,68sleep010614-21true18:56:340
10713991103,63cyclictest10482-21apt-get22:31:522
1038721066,16sleep10-21swapper/118:54:181
10713991023,42cyclictest22499-21/usr/sbin/munin22:51:492
10713991023,42cyclictest22499-21/usr/sbin/munin22:51:492
1071399998,28cyclictest1944-21apt-get23:11:542
10713999756,35cyclictest9023-21apt-get21:36:472
210902960,7sleep2381ktimers/219:26:492
10713999644,46cyclictest26439-21kworker/u17:1-xprtiod21:26:352
10713999630,13cyclictest0-21swapper/220:36:492
1071399953,68cyclictest352-21runrttasks22:06:492
94332949,60sleep29439-21/usr/sbin/munin18:52:242
10713999430,57cyclictest0-21swapper/219:11:552
10713999427,16cyclictest0-21swapper/219:57:002
10697999458,17cyclictest181rcu_preempt23:39:280
10713999343,42cyclictest0-21swapper/221:11:312
1071399933,40cyclictest15089-21ntp_offset19:07:002
1071399933,36cyclictest13693-21sh21:42:152
1071399933,33cyclictest9810-21fschecks_time20:31:552
1071399933,30cyclictest7229-21grep20:22:062
1071399923,59cyclictest18240-21ssh20:57:122
10713999229,19cyclictest0-21swapper/223:11:352
10713999224,9cyclictest0-21swapper/221:47:102
10713999224,9cyclictest0-21swapper/221:47:102
10713999118,29cyclictest4669-21cat22:21:572
10697999156,30cyclictest22659-21/usr/sbin/munin23:47:080
10713999048,18cyclictest28865-21ssh23:02:042
10713999042,43cyclictest10688-21cyclictest18:56:582
1071399903,35cyclictest16001-21/usr/sbin/munin20:52:112
1071399903,33cyclictest28983-21latency_hist19:51:352
1071399903,32cyclictest13019-21fschecks_time20:41:552
1071399903,32cyclictest13019-21fschecks_time20:41:552
10713999032,9cyclictest0-21swapper/222:12:082
1071399893,41cyclictest29995-21cstates21:16:492
1071399893,34cyclictest3524-21ssh21:26:502
1071399893,28cyclictest29075-21/usr/sbin/munin19:52:042
1071399893,28cyclictest25195-21ps22:02:052
10713998930,11cyclictest0-21swapper/223:57:072
1071399892,34cyclictest22805-21ls23:46:492
1071399892,30cyclictest21143-21fschecks_count21:01:542
10703998966,15cyclictest15541-21/usr/sbin/munin21:47:081
10703998966,15cyclictest15541-21/usr/sbin/munin21:47:081
1071399883,36cyclictest20243-21timerwakeupswit19:22:082
1071399883,32cyclictest4169-21latency_hist22:21:352
1071399883,28cyclictest26097-21tune2fs19:41:552
1071399883,24cyclictest14592-21fschecks_count20:46:542
10713998825,12cyclictest0-21swapper/200:17:062
1071399882,29cyclictest25138-21unixbench_multi19:37:062
1071399882,29cyclictest25138-21unixbench_multi19:37:062
1071399882,28cyclictest31837-21fschecks_time00:01:552
10703998872,11cyclictest5740-21ssh21:30:431
10697998865,16cyclictest0-21swapper/023:51:490
1071399873,33cyclictest16529-21cstates22:41:502
1071399873,30cyclictest10127-21grep22:31:342
1071399873,29cyclictest13686-21grep00:26:342
1071399872,34cyclictest5115-21grep20:16:572
10713998723,16cyclictest0-21swapper/221:32:082
10713998641,37cyclictest0-21swapper/223:52:082
1071399863,35cyclictest22013-21munin-run22:51:312
1071399863,31cyclictest2284-21fschecks_count00:06:522
1071399863,31cyclictest19678-21/usr/sbin/munin23:41:482
1071399863,29cyclictest14033-21fschecks_count23:31:542
1071399863,26cyclictest3368-21fschecks_time20:11:562
1071399863,25cyclictest22389-21wc21:57:072
1071399863,25cyclictest22389-21wc21:57:072
10713998629,12cyclictest0-21swapper/219:01:392
10713998624,11cyclictest0-21swapper/219:31:562
10703998665,15cyclictest4593-21fschecks_time22:21:561
10703998660,18cyclictest1-21systemd22:49:421
10697998642,12cyclictest10688-21cyclictest20:02:030
10697998642,12cyclictest10688-21cyclictest20:02:030
1071399854,27cyclictest13993-21ntp_kernel_err22:36:592
1071399853,38cyclictest1689-21fschecks_count20:06:542
1071399853,38cyclictest1689-21fschecks_count20:06:542
1071399853,35cyclictest9957-21ssh23:25:032
1071399853,33cyclictest10816-21/usr/sbin/munin23:26:492
1071399853,33cyclictest10816-21/usr/sbin/munin23:26:492
1071399853,31cyclictest5958-21timerwakeupswit00:12:092
1071399853,31cyclictest17785-21unixbench_multi23:37:092
1071399853,30cyclictest7927-21/usr/sbin/munin20:26:512
1071399853,30cyclictest5402-21latency23:16:572
1071399852,28cyclictest18197-21latency19:16:572
10697998566,14cyclictest3703-21fschecks_time21:26:560
1071399843,31cyclictest19576-21grep21:52:122
1071399842,38cyclictest29379-21rm21:16:052
1071399842,36cyclictest26627-21ssh22:57:522
10703998465,13cyclictest2157-21switchtime22:17:091
1071399833,33cyclictest585-21switchtime20:02:082
1071399833,33cyclictest585-21switchtime20:02:082
10697998356,18cyclictest20452-21unixbench_singl22:47:120
10697998243,12cyclictest20450-21kworker/u18:1-nfsiod22:13:250
10697998241,11cyclictest58-21kcompactd022:17:060
10697998239,29cyclictest22402-21kworker/u19:2-nfsiod21:35:060
1070399813,51cyclictest17929-21apt-get20:57:021
10697998164,12cyclictest20278-21unixbench_multi19:22:080
10703998067,9cyclictest5513-21kworker/u19:1-events_unbound23:17:061
10703998065,9cyclictest973-21kworker/u18:122:16:311
10703998063,11cyclictest300-21rs:main1
10703998055,18cyclictest17670-21apt-key20:56:351
10703998049,11cyclictest181rcu_preempt21:21:271
10697998049,22cyclictest58-21kcompactd022:31:520
10697998047,11cyclictest15739-21kworker/u17:1-xprtiod21:51:350
10697998047,11cyclictest15739-21kworker/u17:1-xprtiod21:51:350
10703997965,10cyclictest10688-21cyclictest00:06:411
10703997963,11cyclictest28520-21fschecks_time23:01:561
10697997958,15cyclictest24093-21sh22:54:040
10697997958,15cyclictest24093-21sh22:54:040
10703997857,9cyclictest0-21swapper/123:31:351
10703997857,9cyclictest0-21swapper/123:31:351
10703997857,15cyclictest10397-21fschecks_time21:38:271
10703997856,15cyclictest10688-21cyclictest23:11:341
10703997850,22cyclictest10688-21cyclictest23:42:071
10697997857,15cyclictest29744-21latency_hist21:16:350
10697997838,11cyclictest25084-21kworker/u18:0-events_unbound19:57:010
10703997763,10cyclictest10688-21cyclictest21:22:181
10703997756,8cyclictest0-21swapper/119:56:551
10703997738,9cyclictest0-21swapper/120:11:351
10697997762,8cyclictest0-21swapper/023:17:100
10697997761,10cyclictest6476-21fschecks_count20:21:510
10703997662,9cyclictest6660-21ssh00:13:461
10703997657,8cyclictest0-21swapper/120:16:341
10703997657,13cyclictest9937-21latency_hist22:31:351
10703997656,11cyclictest0-21swapper/122:46:351
10703997623,10cyclictest0-21swapper/123:50:511
10697997661,9cyclictest28875-21timerandwakeup22:07:450
10697997658,11cyclictest1-21systemd19:41:330
10697997658,11cyclictest1-21systemd19:41:330
10697997657,13cyclictest11085-21ntpd23:07:000
10697997647,14cyclictest17867-21ssh20:56:380
10697997641,11cyclictest10688-21cyclictest21:42:350
10697997632,9cyclictest12030-21vmstat23:27:240
10697997632,9cyclictest12030-21vmstat23:27:240
10703997555,14cyclictest15154-21threads20:47:071
10703997551,17cyclictest10789-21latency_hist00:21:341
10697997560,10cyclictest18727-21unixbench_singl19:17:090
10703997461,9cyclictest10688-21cyclictest21:31:541
10703997454,10cyclictest0-21swapper/121:11:341
10703997452,7cyclictest181rcu_preempt22:10:151
10697997457,8cyclictest0-21swapper/021:04:050
10697997454,10cyclictest0-21swapper/019:27:010
10703997355,13cyclictest16076-21latency_hist22:41:351
10703997350,7cyclictest181rcu_preempt20:22:431
10703997346,19cyclictest20721-21modprobe19:26:321
10703997313,12cyclictest181rcu_preempt00:06:341
10697997360,8cyclictest21478-21kworker/u17:1+rpciod22:57:520
10697997346,20cyclictest8291-21kworker/u17:2+nfsiod21:38:240
10697997328,13cyclictest181rcu_preempt20:46:470
10703997253,9cyclictest0-21swapper/119:41:341
10703997253,9cyclictest0-21swapper/119:41:341
10703997252,14cyclictest21775-21ssh21:56:541
10703997252,14cyclictest21775-21ssh21:56:541
10697997258,7cyclictest0-21swapper/000:17:070
10697997257,10cyclictest1-21systemd23:46:330
10697997256,9cyclictest0-21swapper/022:42:100
10697997256,7cyclictest0-21swapper/023:32:020
10697997256,10cyclictest18776-21forks21:51:560
10697997254,13cyclictest28559-21/usr/sbin/munin23:56:590
10697997236,9cyclictest181rcu_preempt23:12:280
10703997157,8cyclictest0-21swapper/120:06:571
10703997157,7cyclictest0-21swapper/120:27:021
10703997155,8cyclictest0-21swapper/118:57:081
10703997145,18cyclictest23969-21sh19:36:321
10703997145,15cyclictest0-21swapper/122:01:571
10697997157,10cyclictest10688-21cyclictest22:26:530
10697997156,10cyclictest17367-21diskmemload00:03:350
10697997148,16cyclictest9737-21fschecks_count20:31:540
10697997137,8cyclictest181rcu_preempt00:15:060
10697997135,9cyclictest26674-21latency_hist21:11:340
10703997056,8cyclictest0-21swapper/119:17:081
10703997056,10cyclictest5513-21kworker/u19:1-rpciod21:12:111
10703997052,8cyclictest0-21swapper/119:01:571
10703997046,8cyclictest181rcu_preempt23:23:491
10697997043,20cyclictest2019-21kworker/u17:4+nfsiod23:25:030
10697997042,19cyclictest11919-21xargs20:37:070
10697997019,9cyclictest181rcu_preempt20:42:080
10697997019,9cyclictest181rcu_preempt20:42:080
10703996954,8cyclictest0-21swapper/122:36:341
10703996954,10cyclictest10688-21cyclictest23:51:561
10703996950,7cyclictest181rcu_preempt23:56:581
10703996950,7cyclictest181rcu_preempt23:33:521
10703996944,19cyclictest21208-21fschecks_time21:01:541
10703996943,18cyclictest1-21systemd19:15:411
10703996935,27cyclictest26557-21kworker/u18:0+nfsiod21:52:171
10697996952,11cyclictest277-21dbus-daemon19:11:330
10697996949,8cyclictest181rcu_preempt22:25:300
10697996947,15cyclictest10688-21cyclictest22:39:380
10697996940,21cyclictest11342-21latency00:21:570
10697996932,9cyclictest30849-21ssh21:17:090
10703996852,10cyclictest21194-21fschecks_count19:26:541
10703996851,8cyclictest0-21swapper/100:21:521
10697996848,14cyclictest28821-21sh19:51:320
10703996749,13cyclictest3158-21unixbench_singl23:12:301
10703996747,9cyclictest0-21swapper/120:41:541
10703996747,9cyclictest0-21swapper/120:41:541
10697996750,11cyclictest22594-21head21:57:090
10697996750,11cyclictest22594-21head21:57:090
1069799674,34cyclictest28442-21df_inode23:01:530
10697996741,20cyclictest21576-21kworker/u17:0+nfsiod00:08:470
1069799673,35cyclictest27223-21tr19:46:310
1069799673,23cyclictest7945-21apt-get20:26:460
10697996731,11cyclictest181rcu_preempt21:21:480
10703996651,9cyclictest22625-21fschecks_time22:51:541
10703996651,9cyclictest22625-21fschecks_time22:51:541
10703996650,9cyclictest13181-21ntp_states21:42:031
10703996646,8cyclictest181rcu_preempt20:16:431
10703996627,9cyclictest181rcu_preempt23:37:081
10697996644,16cyclictest17485-21ssh20:56:340
10697996633,11cyclictest58-21kcompactd019:01:410
10703996552,9cyclictest10688-21cyclictest19:42:131
10703996548,12cyclictest10688-21cyclictest20:41:201
10703996547,13cyclictest27488-21cpu19:46:481
10697996540,19cyclictest23072-21kworker/u17:2+nfsiod22:02:110
10697996530,10cyclictest0-21swapper/018:57:000
10697996447,10cyclictest181rcu_preempt19:16:340
10697996445,13cyclictest23968-21sh19:36:320
10697996431,9cyclictest181rcu_preempt19:52:050
10703996344,8cyclictest0-21swapper/119:52:051
10703996342,14cyclictest298-21in:imuxsock19:11:321
10703996224,8cyclictest181rcu_preempt20:02:101
10703996224,8cyclictest181rcu_preempt20:02:101
10697996216,24cyclictest3299-21grep20:11:550
10703996045,8cyclictest0-21swapper/120:32:011
1069799604,28cyclictest4876-21fschecks_count20:16:530
1069799602,42cyclictest2828-21latency_hist20:11:340
1069799602,42cyclictest2828-21latency_hist20:11:340
1072199573,34cyclictest917-21kworker/3:1+events20:36:463
1072199552,41cyclictest26636-21taskset23:52:093
1072199543,38cyclictest28501-21taskset21:13:373
287982530,8sleep30-21swapper/322:07:443
1072199523,40cyclictest1251-21taskset00:05:143
1072199522,37cyclictest25187-21taskset19:37:073
1072199522,37cyclictest25187-21taskset19:37:073
1072199513,35cyclictest12603-21chrt19:01:423
1072199512,37cyclictest23388-21chrt19:32:083
1072199512,37cyclictest12675-21taskset00:24:063
1072199504,36cyclictest21238-21taskset19:26:543
1072199503,37cyclictest23405-21chrt21:06:073
1072199503,36cyclictest31116-21taskset21:17:343
1072199503,36cyclictest22283-21chrt22:51:383
1072199503,36cyclictest22283-21chrt22:51:383
1072199502,37cyclictest6168-21chrt20:21:343
1072199502,37cyclictest25543-21chrt22:02:093
1072199496,32cyclictest26136-21taskset21:10:213
1072199494,33cyclictest30608-21taskset19:56:353
1072199494,32cyclictest10304-21taskset20:32:073
1072199493,37cyclictest3841-21chrt22:21:143
1072199493,34cyclictest10285-21chrt22:31:353
1072199493,33cyclictest5163-21taskset00:11:503
1072199493,33cyclictest21340-21taskset23:43:423
1072199493,33cyclictest12539-21taskset21:41:423
1072199492,38cyclictest29570-21taskset23:57:073
1072199492,34cyclictest8193-21chrt20:26:573
1072199484,34cyclictest8123-21chrt23:21:533
1072199484,34cyclictest20191-21chrt21:53:423
1072199483,35cyclictest7655-21chrt21:32:423
1072199483,35cyclictest31851-21taskset22:12:103
1072199483,34cyclictest1849-21chrt23:11:363
1072199483,33cyclictest19379-21chrt22:46:433
1072199483,29cyclictest917-21kworker/3:1+events22:56:413
1072199482,36cyclictest5456-21taskset21:29:543
1072199473,35cyclictest3689-21taskset00:08:423
1072199473,35cyclictest12320-21chrt21:41:343
1072199473,31cyclictest15771-21taskset20:51:323
1072199473,31cyclictest14767-21taskset19:06:533
1072199472,35cyclictest18308-21taskset20:57:233
1072199472,35cyclictest12465-21chrt22:34:403
1072199472,33cyclictest19317-21chrt19:21:353
1072199472,32cyclictest19256-21chrt22:46:353
1072199472,32cyclictest1409-21chrt20:06:353
1072199472,32cyclictest1409-21chrt20:06:353
1072199463,34cyclictest2559-21chrt21:25:123
1072199463,33cyclictest7413-21chrt23:21:123
1072199463,33cyclictest2413-21taskset20:07:083
1072199463,33cyclictest2413-21taskset20:07:083
1072199463,33cyclictest17275-21chrt20:55:413
1072199463,32cyclictest6332-21chrt20:21:463
1072199462,35cyclictest17072-21chrt21:48:193
1072199462,35cyclictest17072-21chrt21:48:193
1072199462,34cyclictest3314-21chrt23:12:533
1072199462,34cyclictest26430-21chrt19:42:093
1072199462,34cyclictest19705-21chrt19:21:563
1072199462,34cyclictest18714-21chrt23:39:363
1072199453,33cyclictest16911-21chrt19:12:073
1072199453,28cyclictest4436-21taskset22:21:513
1072199452,33cyclictest9874-21chrt00:19:323
1072199452,33cyclictest13578-21chrt23:31:343
1072199452,33cyclictest13578-21chrt23:31:343
1072199443,31cyclictest24202-21taskset22:01:323
1072199443,31cyclictest24202-21taskset22:01:323
1072199442,33cyclictest23227-21chrt23:47:023
1072199442,33cyclictest11813-21taskset18:57:083
1072199433,31cyclictest28457-21chrt23:01:553
1072199433,31cyclictest15909-21chrt22:41:043
1072199433,30cyclictest14422-21taskset23:32:023
1072199423,30cyclictest27632-21chrt19:46:513
1072199413,28cyclictest13848-21taskset20:43:213
1072199413,28cyclictest13848-21taskset20:43:213
1072199412,30cyclictest31920-21taskset20:00:113
1072199412,28cyclictest3110-21taskset20:11:503
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional