You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 21:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Apr 28, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22234991088,83cyclictest5757-21apt-get11:57:341
222349910855,48cyclictest22219-21cyclictest08:57:521
22241991056,58cyclictest39-21ksoftirqd/210:57:302
22234999939,10cyclictest0-21swapper/111:02:251
2223499992,35cyclictest17183-21unixbench_multi08:22:511
22234999730,12cyclictest0-21swapper/111:52:401
2223499972,38cyclictest20244-21tune2fs11:27:391
2223499964,35cyclictest32452-21latency_hist07:32:191
2223499964,35cyclictest32452-21latency_hist07:32:191
2223499963,37cyclictest4034-21grep07:42:521
2223499962,42cyclictest31112-21/usr/sbin/munin10:52:481
22234999533,12cyclictest0-21swapper/111:17:191
22234999529,12cyclictest0-21swapper/110:32:511
22234999529,12cyclictest0-21swapper/110:32:511
2066429556,16sleep2371rcuc/206:57:212
2223499944,39cyclictest24965-21kernelversion09:47:401
2223499943,37cyclictest14732-21cstates08:17:331
2223499943,33cyclictest27555-21latency_hist07:17:181
22234999433,12cyclictest0-21swapper/110:27:181
22234999429,12cyclictest0-21swapper/112:12:191
2223499942,40cyclictest18242-21latency_hist09:37:191
2223499942,36cyclictest24234-21modprobe09:47:151
2223499933,37cyclictest21677-21/usr/sbin/munin12:22:511
2223499933,34cyclictest30308-21latency_hist09:57:171
2223499933,34cyclictest30308-21latency_hist09:57:171
22234999330,11cyclictest0-21swapper/108:27:331
22234999330,11cyclictest0-21swapper/108:27:331
2223499932,39cyclictest13393-21latency08:12:411
22241999269,15cyclictest58-21kcompactd011:34:092
22234999236,10cyclictest0-21swapper/107:52:191
2223499923,39cyclictest9660-21latency_hist08:02:181
2223499923,39cyclictest9660-21latency_hist08:02:181
2223499923,35cyclictest6123-21date09:17:181
2223499923,35cyclictest6123-21date09:17:181
2223499923,35cyclictest13016-21/usr/sbin/munin09:27:491
22234999167,15cyclictest9760-21kernelversion09:22:431
22234999144,40cyclictest0-21swapper/112:04:331
2223499913,33cyclictest1464-21latency_hist07:37:171
22234999121,22cyclictest12224-21cat08:07:511
2223499903,36cyclictest4966-21awk10:07:501
2223499903,36cyclictest4966-21awk10:07:501
2223499903,35cyclictest28281-21grep07:17:481
2223499902,40cyclictest20407-21unixbench_multi08:32:501
2223499893,43cyclictest352-21runrttasks09:11:501
2223499893,37cyclictest26221-21fschecks_count11:37:361
2223499893,37cyclictest26221-21fschecks_count11:37:361
2223499892,35cyclictest23357-21latency08:42:431
22241998862,9cyclictest17474-21ssh11:22:432
2223499884,39cyclictest12788-21modprobe10:22:151
2223499884,36cyclictest22402-21fschecks_time10:37:381
2223499884,35cyclictest25484-21proc_pri08:48:561
22234998834,15cyclictest352-21runrttasks11:35:171
2223499883,36cyclictest28931-21/usr/sbin/munin11:42:311
22229998871,11cyclictest2374-21systemd-journal12:17:160
22229998865,16cyclictest32491-21latency_hist09:07:180
22229998865,16cyclictest32491-21latency_hist09:07:180
22229998854,17cyclictest19139-21ssh12:18:360
22229998854,17cyclictest19139-21ssh12:18:360
22241998768,12cyclictest298-21in:imuxsock10:17:332
2223499874,35cyclictest352-21runrttasks08:38:591
2223499874,33cyclictest17751-21/usr/sbin/munin12:17:381
2223499874,33cyclictest17751-21/usr/sbin/munin12:17:381
2223499873,34cyclictest943-21latency_hist10:02:181
2223499863,39cyclictest26458-21cpu08:52:311
2223499863,39cyclictest26458-21cpu08:52:311
2223499853,35cyclictest32218-21fschecks_count11:47:371
2223499853,35cyclictest32218-21fschecks_count11:47:371
2223499853,35cyclictest25105-21/usr/sbin/munin10:42:261
2223499853,35cyclictest25105-21/usr/sbin/munin10:42:261
2223499853,34cyclictest23901-21cstates12:27:331
2223499853,32cyclictest11499-21ssh11:12:441
22229998565,12cyclictest21542-21sh09:42:260
22229998563,15cyclictest22219-21cyclictest09:38:160
22229998554,13cyclictest1-21systemd09:27:170
2222999854,69cyclictest25156-21ssh10:42:310
2222999854,69cyclictest25156-21ssh10:42:310
22241998360,8cyclictest181rcu_preempt08:42:332
22241998335,25cyclictest22932-21kworker/u18:2-ext4-rsv-conversion11:07:502
2223499833,35cyclictest13906-21/usr/sbin/munin11:17:421
22241998263,13cyclictest16185-21latency_hist08:22:192
22241998256,9cyclictest181rcu_preempt08:27:162
2223499823,38cyclictest25980-21latency_hist07:12:191
22229998263,13cyclictest298-21in:imuxsock10:57:150
22229998259,16cyclictest22219-21cyclictest10:03:420
22241998164,8cyclictest181rcu_preempt10:32:182
22241998157,10cyclictest181rcu_preempt10:25:152
22229998158,15cyclictest29411-21diskmemload11:03:280
2222999813,53cyclictest15-21ksoftirqd/008:23:070
2222999811,24cyclictest25957-21ssh11:37:250
2222999811,24cyclictest25957-21ssh11:37:250
2224199802,67cyclictest21546-21apt-get09:42:402
2207828015,42sleep30-21swapper/307:02:163
22241997962,11cyclictest365-21ntpd09:02:332
22241997962,11cyclictest365-21ntpd09:02:332
22241997960,13cyclictest300-21rs:main2
22241997960,13cyclictest300-21rs:main2
22241997959,14cyclictest13361-21sh11:16:342
22241997959,14cyclictest13361-21sh11:16:342
22241997941,12cyclictest181rcu_preempt07:47:452
22241997936,8cyclictest0-21swapper/211:03:512
2223499793,34cyclictest7892-21apt07:57:151
2222999795,50cyclictest15-21ksoftirqd/008:44:560
2222999794,45cyclictest15-21ksoftirqd/010:34:550
2222999794,45cyclictest15-21ksoftirqd/010:34:550
2209927912,42sleep022115-21munin-run07:02:170
22241997862,9cyclictest12717-21munin-plugin-st08:12:152
22241997840,25cyclictest28401-21grep07:17:502
22229997857,15cyclictest12528-21ssh12:07:470
22229997857,12cyclictest843-21threads07:32:500
22229997829,24cyclictest5757-21apt-get11:58:170
22241997733,12cyclictest0-21swapper/211:52:512
22241997718,22cyclictest22334-21unixbench_singl08:38:182
2222999776,41cyclictest15-21ksoftirqd/007:50:220
22229997758,14cyclictest22932-21kworker/u18:2+events_unbound09:52:160
22241997663,9cyclictest22219-21cyclictest07:12:182
22241997653,9cyclictest181rcu_preempt09:52:492
22241997653,9cyclictest181rcu_preempt09:52:492
22241997651,10cyclictest181rcu_preempt12:03:322
22241997632,13cyclictest0-21swapper/212:22:152
22241997632,13cyclictest0-21swapper/212:22:152
22234997658,12cyclictest2545-21timerwakeupswit07:37:511
22234997652,16cyclictest1-21systemd07:06:341
2223499763,22cyclictest8585-21ssh11:07:501
22229997660,11cyclictest22219-21cyclictest11:34:440
22229997654,16cyclictest5018-21ssh09:14:330
22229997654,16cyclictest5018-21ssh09:14:330
22229997623,13cyclictest6543-21apt-get07:52:270
150542760,7sleep215056-21fschecks_time12:12:372
22241997552,8cyclictest181rcu_preempt10:47:282
22241997552,8cyclictest181rcu_preempt08:52:302
22241997552,8cyclictest181rcu_preempt08:52:302
22241997548,11cyclictest181rcu_preempt12:30:312
22241997536,12cyclictest0-21swapper/209:31:192
22241997533,16cyclictest181rcu_preempt08:57:242
22241997518,20cyclictest39-21ksoftirqd/209:23:512
22229997553,16cyclictest16612-21idleruntime-cro11:22:150
22229997551,13cyclictest0-21swapper/011:02:160
2222999754,37cyclictest31167-21ntp_kernel_pll_09:57:460
2222999753,35cyclictest25174-21fschecks_time08:48:470
22229997530,24cyclictest0-21swapper/009:07:380
22241997461,9cyclictest22219-21cyclictest12:10:242
22241997452,8cyclictest181rcu_preempt07:22:312
22241997452,7cyclictest181rcu_preempt08:02:292
22241997452,7cyclictest181rcu_preempt08:02:292
2222999746,45cyclictest15-21ksoftirqd/008:54:500
2222999746,45cyclictest15-21ksoftirqd/008:54:500
22229997459,11cyclictest22219-21cyclictest08:42:160
2222999744,37cyclictest15-21ksoftirqd/010:50:330
22229997424,8cyclictest161ktimers/007:42:530
2222999742,37cyclictest10995-21ls10:17:500
2222999742,27cyclictest15-21ksoftirqd/011:23:310
22229997415,14cyclictest9049-21grep12:02:360
22241997358,10cyclictest22219-21cyclictest10:57:182
22241997357,11cyclictest22219-21cyclictest08:49:382
22241997352,15cyclictest1149-21cpu10:02:322
22241997351,7cyclictest181rcu_preempt07:02:342
22241997349,9cyclictest181rcu_preempt11:47:302
22241997349,9cyclictest181rcu_preempt11:47:302
22241997349,9cyclictest181rcu_preempt11:30:452
22241997339,8cyclictest181rcu_preempt11:45:112
22241997337,9cyclictest0-21swapper/211:40:372
22241997337,9cyclictest0-21swapper/211:40:372
22241997326,11cyclictest0-21swapper/211:57:322
2222999735,52cyclictest18586-21sshd08:27:500
2222999735,52cyclictest18586-21sshd08:27:500
22229997355,11cyclictest29411-21diskmemload11:12:210
22229997355,11cyclictest29411-21diskmemload11:12:210
2222999734,26cyclictest15-21ksoftirqd/010:11:570
2222999734,26cyclictest15-21ksoftirqd/010:11:570
22229997342,24cyclictest0-21swapper/011:09:200
2222999732,30cyclictest15-21ksoftirqd/009:54:390
2222999732,30cyclictest15-21ksoftirqd/009:54:390
22241997256,11cyclictest22219-21cyclictest09:12:312
22241997256,11cyclictest22219-21cyclictest09:12:312
22241997239,12cyclictest0-21swapper/209:32:382
22241997237,9cyclictest26903-21ssh10:44:472
22241997237,9cyclictest26903-21ssh10:44:472
22241997236,9cyclictest0-21swapper/208:32:182
22241997236,9cyclictest0-21swapper/208:32:182
22241997235,12cyclictest0-21swapper/209:52:182
22241997228,9cyclictest181rcu_preempt09:37:262
2222999725,35cyclictest15-21ksoftirqd/011:46:480
22229997250,16cyclictest23259-21ssh10:37:580
22229997240,8cyclictest0-21swapper/009:32:180
2222999723,54cyclictest24698-21tune2fs07:07:400
2222999723,32cyclictest15-21ksoftirqd/012:29:400
2222999723,29cyclictest15-21ksoftirqd/009:35:230
2103827210,31sleep10-21swapper/106:57:451
22241997155,10cyclictest14732-21switchtime11:17:492
22241997146,8cyclictest181rcu_preempt12:22:512
22241997146,8cyclictest181rcu_preempt09:07:322
22241997142,22cyclictest3756-21kworker/u19:1+nfsiod10:32:392
22241997142,22cyclictest3756-21kworker/u19:1+nfsiod10:32:392
2222999718,43cyclictest15-21ksoftirqd/010:27:450
2222999715,45cyclictest15-21ksoftirqd/007:24:590
22229997144,19cyclictest352-21runrttasks10:22:400
2222999713,34cyclictest2276-21latency_hist11:52:170
2222999713,34cyclictest2276-21latency_hist11:52:170
2222999713,25cyclictest15-21ksoftirqd/011:54:160
2224199709,27cyclictest6740-21ssh09:17:402
22234997028,13cyclictest181rcu_preempt10:57:271
22229997049,13cyclictest22219-21cyclictest11:27:230
2222999704,44cyclictest15-21ksoftirqd/009:01:240
2222999703,48cyclictest20844-21latency_hist08:37:190
22229997023,30cyclictest7585-21latency10:12:400
22229997019,34cyclictest15-21ksoftirqd/007:16:410
22229997010,26cyclictest15-21ksoftirqd/008:17:270
2224199695,35cyclictest26350-21sshd07:12:382
22241996935,11cyclictest0-21swapper/207:42:542
22241996919,26cyclictest39-21ksoftirqd/208:32:502
22234996951,13cyclictest352-21runrttasks10:27:541
22234996942,8cyclictest181rcu_preempt07:22:501
2222999699,21cyclictest1987-21idleruntime07:37:390
2222999695,39cyclictest15-21ksoftirqd/008:14:000
2222999693,41cyclictest15-21ksoftirqd/009:20:360
22241996845,8cyclictest181rcu_preempt09:57:322
22241996841,8cyclictest181rcu_preempt08:12:272
22241996831,8cyclictest0-21swapper/207:57:512
22241996831,8cyclictest0-21swapper/207:57:512
22234996846,16cyclictest29235-21sh10:47:561
22229996850,11cyclictest18425-21kworker/u17:3+rpciod12:22:210
2222999684,42cyclictest15-21ksoftirqd/008:08:520
22229996815,39cyclictest9048-21grep07:57:520
22229996815,39cyclictest9048-21grep07:57:520
2223499674,44cyclictest1869-21mailstats10:02:501
22234996719,39cyclictest12607-21rm12:07:481
22229996718,24cyclictest0-21swapper/008:02:510
22229996718,24cyclictest0-21swapper/008:02:510
2224199665,51cyclictest22123-21apt-get10:37:272
22241996645,15cyclictest1090-21kworker/u18:1-writeback10:12:412
22241996641,9cyclictest181rcu_preempt07:42:182
22234996641,18cyclictest19615-21latency_hist11:27:171
2223499663,30cyclictest6730-21cut09:17:401
2222999667,37cyclictest0-21swapper/007:27:320
2222999667,37cyclictest0-21swapper/007:27:320
2222999663,45cyclictest23364-21unixbench_singl07:02:550
2222999663,33cyclictest28638-21grep07:17:520
22241996540,19cyclictest32277-21idleruntime-cro07:32:162
22241996540,19cyclictest32277-21idleruntime-cro07:32:162
2223499642,43cyclictest21366-21cat09:42:191
22241996342,8cyclictest181rcu_preempt07:52:292
22241996326,11cyclictest0-21swapper/207:32:442
2223499634,38cyclictest29703-21/usr/sbin/munin09:02:421
2223499634,38cyclictest29703-21/usr/sbin/munin09:02:421
2223499624,34cyclictest7435-21fschecks_time10:12:361
22234996215,7cyclictest181rcu_preempt08:02:471
22234996215,7cyclictest181rcu_preempt08:02:471
147312610,4sleep30-21swapper/312:12:213
2224799562,40cyclictest9401-21chrt09:22:333
2224799553,39cyclictest21435-21taskset09:42:203
2224799553,39cyclictest18333-21taskset10:31:013
2224799552,40cyclictest23618-21taskset08:42:503
2224799543,38cyclictest8493-21taskset11:07:463
2224799543,35cyclictest6124-21chrt09:17:183
2224799543,35cyclictest6124-21chrt09:17:183
2224799543,35cyclictest24420-21chrt09:47:193
22247995433,11cyclictest451rcuc/307:57:273
22247995433,11cyclictest451rcuc/307:57:273
2224799532,38cyclictest26290-21chrt08:52:183
2224799523,40cyclictest7194-21chrt11:06:123
2224799523,38cyclictest24427-21chrt10:41:143
2224799523,36cyclictest4628-21taskset11:02:183
2224799522,41cyclictest17934-21taskset12:17:323
2224799522,41cyclictest17934-21taskset12:17:323
22247995135,9cyclictest19342chrt09:09:243
2224799513,39cyclictest26325-21taskset10:43:093
2224799513,39cyclictest26325-21taskset10:43:093
2224799513,38cyclictest1439-21chrt10:02:393
2224799513,37cyclictest32433-21taskset07:32:193
2224799513,37cyclictest32433-21taskset07:32:193
2224799513,37cyclictest1951-21chrt07:37:383
2224799513,35cyclictest30071-21taskset07:22:523
2224799512,38cyclictest17025-21taskset09:34:333
2224799512,37cyclictest9899-21chrt08:02:323
2224799512,37cyclictest9899-21chrt08:02:323
2224799512,35cyclictest28834-21chrt11:42:193
2224799512,35cyclictest28834-21chrt11:42:193
2224799503,36cyclictest30112-21chrt10:50:223
2224799503,35cyclictest917-21kworker/3:1+events10:20:523
2224799502,34cyclictest22522-21chrt11:32:013
2224799502,33cyclictest14597-21chrt10:23:553
2224799494,35cyclictest31789-21chrt09:58:133
2224799494,34cyclictest31983-21chrt10:52:503
2224799493,36cyclictest7732-21chrt12:00:183
2224799493,36cyclictest20867-21chrt08:37:153
2224799493,35cyclictest16530-21chrt08:22:373
2224799493,30cyclictest26008-21chrt07:12:193
2224799492,34cyclictest27808-21chrt09:52:383
2224799492,34cyclictest27808-21chrt09:52:383
2224799483,36cyclictest27793-21taskset07:17:333
2224799483,34cyclictest14966-21chrt09:32:143
2224799483,32cyclictest16682-21taskset11:22:173
2224799482,37cyclictest11941-21chrt08:07:473
2224799482,36cyclictest7274-21chrt09:17:513
2224799482,36cyclictest11886-21chrt11:12:533
2224799482,36cyclictest11886-21chrt11:12:533
2224799482,35cyclictest21671-21chrt08:38:043
2224799482,33cyclictest24935-21chrt11:35:183
2224799475,33cyclictest17243-21taskset11:22:373
2224799473,35cyclictest7443-21chrt10:12:363
2224799473,35cyclictest5460-21taskset10:08:353
2224799473,35cyclictest5460-21taskset10:08:353
2224799473,34cyclictest4704-21chrt07:47:183
2224799473,34cyclictest26248-21chrt09:49:343
2224799473,32cyclictest31267-21chrt09:04:053
2224799473,32cyclictest31267-21chrt09:04:053
2224799473,31cyclictest6599-21taskset07:52:323
2224799473,31cyclictest29034-21chrt08:57:533
2224799473,29cyclictest23932-21taskset12:27:333
2224799473,28cyclictest4906-21chrt07:47:263
2224799472,32cyclictest21197-21taskset10:35:353
2224799472,32cyclictest21197-21taskset10:35:353
2224799463,34cyclictest27469-21taskset08:53:153
2224799463,34cyclictest27469-21taskset08:53:153
2224799463,33cyclictest23288-21chrt12:26:483
2224799463,16cyclictest0-21swapper/311:52:153
2224799463,16cyclictest0-21swapper/311:52:153
2224799462,34cyclictest19308-21chrt08:32:173
2224799462,34cyclictest19308-21chrt08:32:173
2224799462,32cyclictest12071-21chrt12:07:353
2224799454,32cyclictest9371-21taskset12:02:453
2224799443,31cyclictest5479-21taskset11:57:183
2224799443,30cyclictest30132-21chrt11:43:043
2224799442,32cyclictest15172-21chrt08:17:473
2224799442,31cyclictest12984-21taskset08:12:253
2224799423,30cyclictest32592-21taskset07:32:313
2224799413,26cyclictest22587-21taskset07:02:393
2224799402,29cyclictest27468-21chrt07:17:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional