You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 20:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jun 12, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136721186,15sleep00-21swapper/006:55:380
17929910488,10cyclictest14991-21switchtime11:49:480
17929910488,10cyclictest14991-21switchtime11:49:480
17989910247,48cyclictest15633-21cpuspeed10:04:301
1541821020,2sleep2371rcuc/210:04:172
179899983,36cyclictest8116-21timerwakeupswit07:14:531
179899983,36cyclictest8116-21timerwakeupswit07:14:531
1798999740,48cyclictest0-21swapper/110:49:431
1798999740,48cyclictest0-21swapper/110:49:431
179899973,29cyclictest23151-21rm12:04:281
1798999522,12cyclictest0-21swapper/108:24:481
1798999425,9cyclictest0-21swapper/111:49:461
1798999425,9cyclictest0-21swapper/111:49:461
179899933,31cyclictest3554-21munin-node07:04:211
179899933,31cyclictest3554-21munin-node07:04:211
1798999321,28cyclictest16456-21cpu10:59:291
1792999356,12cyclictest12119-21runrttasks07:29:280
179899923,36cyclictest19928-21basename07:54:141
179899923,29cyclictest11062-21wc07:24:491
1798999232,8cyclictest0-21swapper/107:49:171
179899922,34cyclictest16137-21latency_hist10:59:151
1798999143,41cyclictest8411-21processes10:45:421
1798999140,43cyclictest0-21swapper/110:14:471
179899913,34cyclictest880-21ssh12:19:481
179899913,33cyclictest27073-21rm09:29:301
179899913,33cyclictest20804-21sendmail_mailqu07:54:481
179899913,32cyclictest25806-21timerandwakeup08:09:491
179899913,32cyclictest13293-21taskset09:05:181
1798999132,11cyclictest0-21swapper/107:34:391
1798999132,10cyclictest0-21swapper/110:24:351
179899912,37cyclictest5006-21switchtime10:39:491
179899912,37cyclictest5006-21switchtime10:39:491
179899909,66cyclictest24452-21kworker/u19:0+ext4-rsv-conversion08:39:451
179899903,36cyclictest30920-21ls09:34:491
179899903,36cyclictest30920-21ls09:34:491
179899903,33cyclictest5128-21/usr/sbin/munin11:34:351
179899903,31cyclictest15285-21fschecks_count09:09:351
179899903,31cyclictest15285-21fschecks_count09:09:351
1798999031,10cyclictest0-21swapper/111:59:501
1798999031,10cyclictest0-21swapper/111:59:501
1798999028,16cyclictest0-21swapper/111:44:341
179899902,32cyclictest6426-21grep07:09:491
179899902,32cyclictest6426-21grep07:09:491
179899902,31cyclictest24859-21grep08:09:161
179899902,30cyclictest1954-21/usr/sbin/munin06:59:481
1798998941,39cyclictest18818-21kworker/u17:3-writeback11:19:341
1798998941,39cyclictest18818-21kworker/u17:3-writeback11:19:341
179899893,36cyclictest30514-21/usr/sbin/munin10:29:481
179899893,36cyclictest30514-21/usr/sbin/munin10:29:481
179899893,33cyclictest3100-21forks12:24:331
179899893,33cyclictest3100-21forks12:24:331
179899893,33cyclictest2014-21timerwakeupswit10:34:501
179899893,30cyclictest29672-21latency_hist08:24:151
179899893,30cyclictest29672-21latency_hist08:24:151
1798998929,9cyclictest0-21swapper/109:24:461
179899892,39cyclictest3700-21ssh09:44:311
179899892,37cyclictest17179-21cpu11:54:291
179899892,35cyclictest9205-21grep11:39:521
179899892,35cyclictest9205-21grep11:39:521
179899892,33cyclictest32098-21cat12:19:161
1798998863,10cyclictest0-21swapper/111:14:451
179899883,33cyclictest10367-21latency_hist07:24:161
179899883,33cyclictest10367-21latency_hist07:24:161
179899883,31cyclictest26371-21/usr/sbin/munin12:10:421
179899883,31cyclictest2000-21idleruntime-cro08:39:131
179899883,29cyclictest32284-21ssh11:24:461
179899882,33cyclictest2876-21ssh11:29:471
179899882,31cyclictest11716-21latency_hist09:04:171
179899882,31cyclictest11716-21latency_hist09:04:171
179899882,30cyclictest18029-21apt-get09:14:251
179899873,31cyclictest31908-21latency08:29:401
179899873,30cyclictest24509-21/usr/sbin/munin10:19:391
179899873,30cyclictest24509-21/usr/sbin/munin10:19:391
179899872,31cyclictest6714-21head08:49:511
179899872,31cyclictest6714-21head08:49:511
1798998723,16cyclictest0-21swapper/108:14:481
1798998723,16cyclictest0-21swapper/108:14:481
179899864,29cyclictest23179-21latency_hist08:04:161
179899863,36cyclictest10066-21ssh09:54:411
179899863,31cyclictest21283-21rm09:19:361
1798998629,8cyclictest0-21swapper/109:59:421
179899862,36cyclictest6521-21/usr/sbin/munin09:49:371
179899862,33cyclictest22383-21/usr/sbin/munin11:09:541
179899862,31cyclictest5049-21grep08:44:501
1792998637,14cyclictest11330-21kworker/u18:0+events_unbound09:59:130
1792998627,27cyclictest15-21ksoftirqd/009:59:290
1801998565,14cyclictest18306-21sh09:14:372
179899853,34cyclictest8116-21taskset08:54:491
1792998546,7cyclictest181rcu_preempt09:43:230
1792998546,7cyclictest181rcu_preempt09:43:230
179899843,34cyclictest12555-21latency07:29:411
179899843,31cyclictest18856-21grep10:09:351
1798998428,8cyclictest0-21swapper/111:06:231
1798998428,8cyclictest0-21swapper/111:06:231
179899842,35cyclictest854-21ssh09:39:401
179899842,35cyclictest854-21ssh09:39:401
179899842,34cyclictest15307-21/usr/sbin/munin07:39:361
13412836,61sleep10-21swapper/106:55:191
1801998260,15cyclictest1781-21cyclictest12:29:162
1801998260,15cyclictest1781-21cyclictest12:29:162
1792998240,16cyclictest0-21swapper/011:00:250
1801998163,13cyclictest8711-21diskmemload11:04:452
1801998163,13cyclictest8711-21diskmemload11:04:452
1792998165,12cyclictest19963-21kworker/u18:1+events_unbound10:29:130
1792998156,19cyclictest21019-21ssh11:06:210
1792998156,19cyclictest21019-21ssh11:06:210
1792998059,15cyclictest1413-21timerandwakeup08:34:490
1792998041,32cyclictest0-21swapper/010:24:160
1792998041,32cyclictest0-21swapper/010:24:160
1792998041,10cyclictest3257-21kworker/u19:2-rpciod10:16:120
1801997962,11cyclictest3402-21latency_hist09:44:172
1801997962,11cyclictest3402-21latency_hist09:44:172
1801997959,11cyclictest12053-21taskset09:04:282
1801997953,10cyclictest14126-21/usr/sbin/munin11:49:322
1801997953,10cyclictest14126-21/usr/sbin/munin11:49:322
1792997963,10cyclictest21857-21cpuspeed07:59:320
1792997946,7cyclictest181rcu_preempt12:06:070
1801997863,8cyclictest0-21swapper/208:14:482
1801997863,8cyclictest0-21swapper/208:14:482
1801997862,11cyclictest8711-21diskmemload10:35:212
1801997862,11cyclictest6103-21kernelversion08:49:402
1801997862,11cyclictest6103-21kernelversion08:49:402
1801997860,9cyclictest0-21swapper/210:49:342
1801997860,9cyclictest0-21swapper/210:49:342
1801997853,17cyclictest2374-21systemd-journal09:51:332
1792997864,8cyclictest13799-21kworker/u17:011:49:120
1792997859,13cyclictest14713-21latency_hist09:09:170
1792997852,20cyclictest6751-21ssh09:49:350
1792997846,9cyclictest0-21swapper/009:04:010
1792997846,9cyclictest0-21swapper/009:04:010
1792997845,14cyclictest58-21kcompactd011:16:380
1792997838,13cyclictest0-21swapper/008:14:590
1792997838,13cyclictest0-21swapper/008:14:590
1801997764,9cyclictest1781-21cyclictest09:30:262
1801997760,12cyclictest1781-21cyclictest10:57:562
1792997764,7cyclictest0-21swapper/010:45:050
1792997761,10cyclictest13979-21ntp_offset10:54:400
1792997748,8cyclictest181rcu_preempt12:09:330
1792997746,22cyclictest3894-21cat07:04:240
1792997746,22cyclictest3894-21cat07:04:240
1792997736,14cyclictest0-21swapper/010:09:470
1801997659,12cyclictest23928-21swap12:04:492
1801997656,10cyclictest0-21swapper/210:29:302
1801997656,10cyclictest0-21swapper/210:29:302
179299765,34cyclictest15-21ksoftirqd/007:14:320
179299765,34cyclictest15-21ksoftirqd/007:14:320
1792997639,8cyclictest181rcu_preempt07:44:280
1801997560,10cyclictest1781-21cyclictest07:34:312
1801997559,9cyclictest0-21swapper/212:19:172
1801997558,11cyclictest2374-21systemd-journal09:10:342
1801997558,11cyclictest2374-21systemd-journal09:10:342
1801997558,10cyclictest32668-21cron09:39:132
1801997558,10cyclictest32668-21cron09:39:132
1801997556,7cyclictest181rcu_preempt10:39:522
1801997556,7cyclictest181rcu_preempt10:39:522
1801997554,7cyclictest181rcu_preempt11:17:292
1801997553,12cyclictest0-21swapper/207:19:162
1801997553,12cyclictest0-21swapper/207:19:162
1801997553,11cyclictest0-21swapper/209:24:342
1801997537,26cyclictest4171-21ls08:44:292
1792997560,10cyclictest5508-21kworker/u19:1-rpciod09:11:170
1792997560,10cyclictest5508-21kworker/u19:1-rpciod09:11:170
1792997559,10cyclictest2721-21ntp_kernel_err11:29:420
1792997558,11cyclictest0-21swapper/009:44:500
1792997542,12cyclictest181rcu_preempt08:45:390
1792997539,10cyclictest181rcu_preempt10:43:550
1792997539,10cyclictest181rcu_preempt10:43:550
1801997459,9cyclictest15483-21df_inode07:39:342
1801997457,12cyclictest8083-21sh11:39:172
1801997457,12cyclictest8083-21sh11:39:172
1801997454,11cyclictest0-21swapper/206:59:352
1801997454,10cyclictest0-21swapper/211:29:172
1801997449,17cyclictest11106-21/usr/sbin/munin11:44:452
1801997443,11cyclictest181rcu_preempt09:47:062
180199742,29cyclictest39-21ksoftirqd/208:09:292
1801997412,24cyclictest39-21ksoftirqd/212:02:032
1801997412,24cyclictest39-21ksoftirqd/212:02:032
1792997458,11cyclictest3116-21ssh12:24:330
1792997458,11cyclictest3116-21ssh12:24:330
1792997455,13cyclictest297-21systemd-logind07:04:180
1792997453,16cyclictest18886-21ssh11:56:370
1801997356,9cyclictest0-21swapper/207:54:172
1801997343,22cyclictest21511-21modprobe07:59:142
1792997349,10cyclictest181rcu_preempt10:49:190
1792997349,10cyclictest181rcu_preempt10:49:190
179299734,33cyclictest16829-21latency_hist07:44:170
1792997341,13cyclictest31409-21timerandwakeup10:29:490
1792997341,13cyclictest31409-21timerandwakeup10:29:490
1792997339,8cyclictest181rcu_preempt09:26:530
1801997256,8cyclictest0-21swapper/212:09:182
1801997255,11cyclictest1781-21cyclictest10:09:302
1801997253,14cyclictest9671-21cstates09:54:312
1801997253,13cyclictest24368-21unixbench_singl08:04:502
1801997253,10cyclictest0-21swapper/208:59:362
1801997253,10cyclictest0-21swapper/208:59:362
1792997255,11cyclictest11085-21ntpd11:19:450
1792997255,11cyclictest11085-21ntpd11:19:450
1792997253,13cyclictest19676-21snmpd07:39:130
1792997252,14cyclictest20704-21idleruntime-cro09:19:130
1792997246,8cyclictest181rcu_preempt12:02:370
1792997246,8cyclictest181rcu_preempt12:02:370
1792997239,10cyclictest181rcu_preempt08:31:060
1792997237,10cyclictest58-21kcompactd011:36:040
1792997236,8cyclictest181rcu_preempt08:53:020
1792997236,8cyclictest181rcu_preempt08:53:020
1792997231,8cyclictest181rcu_preempt11:24:300
1801997157,8cyclictest17811-21diskmemload11:00:452
1801997157,8cyclictest0-21swapper/207:34:162
1801997156,8cyclictest0-21swapper/208:34:162
1801997154,11cyclictest277-21dbus-daemon10:49:152
1801997151,13cyclictest297-21systemd-logind08:39:142
1801997148,16cyclictest297-21systemd-logind08:44:142
180199714,31cyclictest39-21ksoftirqd/207:04:222
180199714,31cyclictest39-21ksoftirqd/207:04:222
1792997136,24cyclictest2502-21kworker/u17:3+nfsiod10:37:090
179299713,31cyclictest15-21ksoftirqd/010:04:280
179299712,35cyclictest27332-21fschecks_time09:29:360
1792997122,34cyclictest21641-21latency_hist07:59:170
327202702,59sleep032740-21latency_hist09:39:160
327202702,59sleep032740-21latency_hist09:39:160
1801997049,14cyclictest5024-21latency_hist11:34:172
1801997046,8cyclictest181rcu_preempt11:09:512
179299707,47cyclictest1-21systemd08:44:140
1792997035,16cyclictest181rcu_preempt12:15:120
1792997030,9cyclictest181rcu_preempt11:14:150
89482690,7sleep30-21swapper/311:39:493
89482690,7sleep30-21swapper/311:39:493
1801996956,7cyclictest0-21swapper/208:59:172
1792996941,10cyclictest58-21kcompactd012:23:310
1792996941,10cyclictest181rcu_preempt11:44:030
1792996941,10cyclictest181rcu_preempt11:44:030
1792996941,10cyclictest1781-21cyclictest07:13:270
1792996941,10cyclictest1781-21cyclictest07:13:270
179299693,35cyclictest28235-21/usr/sbin/munin08:19:460
179299693,35cyclictest28235-21/usr/sbin/munin08:19:460
1801996854,9cyclictest7940-21kworker/u17:0-rpciod10:14:482
1801996848,14cyclictest18278-21cron07:49:142
1801996846,7cyclictest181rcu_preempt11:34:492
1801996844,8cyclictest181rcu_preempt11:23:322
1801996844,8cyclictest181rcu_preempt11:23:322
1801996831,14cyclictest181rcu_preempt08:19:332
1801996831,14cyclictest181rcu_preempt08:19:332
1801996828,12cyclictest181rcu_preempt10:24:032
1801996828,12cyclictest181rcu_preempt10:24:032
1792996835,9cyclictest58-21kcompactd009:20:370
1801996754,7cyclictest0-21swapper/212:23:112
1801996753,8cyclictest0-21swapper/207:59:382
1801996652,8cyclictest21221-21ssh09:19:352
1801996632,14cyclictest17626-21cat11:54:382
1792996637,14cyclictest181rcu_preempt08:55:050
1792996635,12cyclictest181rcu_preempt08:04:480
1801996551,8cyclictest0-21swapper/208:24:352
1801996540,9cyclictest181rcu_preempt07:24:162
1801996540,9cyclictest181rcu_preempt07:24:162
180699644,43cyclictest12119-21taskset07:29:283
1801996450,8cyclictest0-21swapper/207:29:162
1801996449,8cyclictest0-21swapper/210:29:172
1801996442,15cyclictest0-21swapper/210:04:392
179299643,46cyclictest19908-21modprobe07:54:140
168726413,29sleep20-21swapper/206:59:152
1792996338,10cyclictest181rcu_preempt07:28:170
1792996332,13cyclictest181rcu_preempt08:09:530
1792996245,10cyclictest0-21swapper/008:24:290
179299622,44cyclictest352-21runrttasks07:20:110
179299622,44cyclictest352-21runrttasks07:20:110
180699602,41cyclictest19335-21chrt11:57:533
180199603,29cyclictest39-21ksoftirqd/207:09:292
180199603,29cyclictest39-21ksoftirqd/207:09:292
180699594,37cyclictest5655-21chrt08:49:173
180699593,42cyclictest26884-21taskset11:15:173
180699584,43cyclictest19076-21taskset11:04:143
180699583,43cyclictest12300-21taskset09:59:163
180699573,41cyclictest10233-21taskset09:00:073
180699573,41cyclictest10233-21taskset09:00:073
180699563,37cyclictest8049-21chrt11:39:173
180699554,38cyclictest5156-21taskset12:28:043
180699554,38cyclictest5156-21taskset12:28:043
3274925414,24sleep30-21swapper/306:54:233
180699544,37cyclictest7002-21chrt07:14:133
180699544,37cyclictest7002-21chrt07:14:133
180699544,37cyclictest19919-21taskset07:54:143
180699543,37cyclictest4233-21chrt07:04:383
180699543,37cyclictest4233-21chrt07:04:383
180699543,36cyclictest27368-21chrt12:10:423
180699543,36cyclictest23104-21chrt10:16:063
180699535,38cyclictest13263-21taskset11:47:443
180699534,38cyclictest811-21chrt08:34:353
180699534,33cyclictest12537-21chrt09:59:243
180699534,32cyclictest0-21swapper/310:45:033
180699533,38cyclictest979-21chrt10:34:173
180699533,38cyclictest979-21chrt10:34:173
180699533,38cyclictest1130-21chrt10:34:303
180699533,37cyclictest29362-21chrt11:19:473
180699533,37cyclictest29362-21chrt11:19:473
180699532,41cyclictest30180-21chrt12:14:473
180699524,32cyclictest22735-21chrt11:09:373
180699523,39cyclictest4497-21chrt10:39:373
180699523,39cyclictest4497-21chrt10:39:373
180699523,39cyclictest26497-21chrt09:28:443
180699523,37cyclictest14295-21taskset07:34:463
180699523,36cyclictest14740-21taskset11:49:423
180699523,36cyclictest14740-21taskset11:49:423
180699523,34cyclictest7474-21chrt08:54:323
180699523,34cyclictest3502-21chrt09:44:203
180699522,37cyclictest32093-21chrt09:37:363
180699522,37cyclictest32093-21chrt09:37:363
180699514,34cyclictest13676-21taskset10:54:333
180699514,33cyclictest21215-21chrt11:06:533
180699514,33cyclictest21215-21chrt11:06:533
180699513,35cyclictest15803-21chrt09:09:473
180699513,35cyclictest15803-21chrt09:09:473
180699513,32cyclictest23680-21chrt12:04:423
180699512,36cyclictest28629-21taskset09:31:153
180699504,36cyclictest27041-21chrt08:14:393
180699504,36cyclictest27041-21chrt08:14:393
180699504,35cyclictest718-21taskset11:26:113
180699504,31cyclictest15432-21chrt07:39:323
180699503,37cyclictest27323-21chrt10:24:163
180699503,37cyclictest27323-21chrt10:24:163
180699503,34cyclictest1193-21taskset12:20:223
180699503,33cyclictest8884-21chrt07:19:323
180699503,33cyclictest8884-21chrt07:19:323
180699503,33cyclictest22316-21chrt12:02:513
180699503,33cyclictest22316-21chrt12:02:513
180699502,35cyclictest3246-21chrt07:03:323
180699502,34cyclictest21573-21chrt07:59:163
180699493,34cyclictest30217-21chrt08:24:393
180699493,33cyclictest15972-21chrt10:04:393
180699493,31cyclictest19786-21chrt10:10:103
180699492,33cyclictest18229-21chrt09:14:343
180699484,35cyclictest1268-21chrt09:39:513
180699484,35cyclictest1268-21chrt09:39:513
180699483,31cyclictest8654-21chrt07:19:153
180699483,31cyclictest8654-21chrt07:19:153
180699483,31cyclictest7155-21chrt08:54:153
180699483,31cyclictest7155-21chrt08:54:153
180699482,34cyclictest13176-21chrt09:04:573
1806994633,8cyclictest451rcuc/310:24:263
180699463,30cyclictest25191-21taskset08:09:323
180699453,29cyclictest20967-21taskset09:19:203
180699452,28cyclictest2475-21chrt11:29:363
180699444,28cyclictest23142-21chrt08:04:143
180699443,30cyclictest23772-21chrt08:04:393
180699434,30cyclictest29627-21chrt08:24:143
180699434,30cyclictest29627-21chrt08:24:143
180699433,30cyclictest10431-21taskset10:49:303
180699433,30cyclictest10431-21taskset10:49:303
180699423,30cyclictest17379-21taskset07:44:383
180699423,26cyclictest11468-21chrt07:24:543
180699414,27cyclictest3712-21taskset08:42:413
180699412,30cyclictest7650-21chrt09:49:523
180699403,28cyclictest31501-21chrt08:29:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional