You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 14:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun Jul 26, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269121297,15sleep00-21swapper/018:54:570
2943991113,29cyclictest352-21runrttasks21:19:470
2943991095,29cyclictest3614-21/usr/sbin/munin20:36:480
2943991094,32cyclictest28405-21sh21:26:280
29439910656,45cyclictest1644-21kworker/u17:1+xprtiod21:41:130
2943991054,25cyclictest352-21runrttasks00:15:190
2943991054,25cyclictest352-21runrttasks00:15:190
2943991052,35cyclictest5552-21latency19:01:430
2943991043,96cyclictest0-21swapper/023:11:300
2943991034,28cyclictest28920-21latency_hist22:21:170
2943991022,26cyclictest4563-21fschecks_time00:22:250
2943991014,38cyclictest6352-21ntp_states22:36:450
2943991013,46cyclictest7364-21head23:31:530
2943991013,36cyclictest16882-21grep19:36:360
29439910044,49cyclictest0-21swapper/018:56:500
29439910040,53cyclictest0-21swapper/021:22:430
29439910038,54cyclictest0-21swapper/022:41:540
29439910036,59cyclictest0-21swapper/020:21:420
2943991002,31cyclictest13526-21cat21:01:420
2943991002,31cyclictest13526-21cat21:01:420
294399994,33cyclictest15538-21apt-get23:46:540
294399994,33cyclictest15538-21apt-get23:46:540
294399994,29cyclictest30050-21modprobe00:11:140
294399993,48cyclictest20795-21sed22:06:450
294399993,30cyclictest25906-21systemctl22:16:160
294399993,23cyclictest16592-21apt-get21:06:570
2943999842,49cyclictest0-21swapper/022:51:170
2943999839,52cyclictest161ktimers/022:51:330
2943999839,52cyclictest161ktimers/022:51:330
294399983,39cyclictest12280-21grep21:51:550
294399983,37cyclictest1737-21modprobe20:31:150
294399983,30cyclictest24749-21/usr/sbin/munin20:01:330
294399983,30cyclictest24749-21/usr/sbin/munin20:01:330
2943999821,7cyclictest0-21swapper/022:26:350
192329812,59sleep21924-21memory18:51:492
2958999757,33cyclictest5738-21ntp_kernel_pll_20:41:452
2958999757,33cyclictest5738-21ntp_kernel_pll_20:41:452
2958999738,44cyclictest7888-21kworker/u17:0-rpciod00:09:302
294399974,21cyclictest14117-21ssh23:43:590
294399974,21cyclictest14117-21ssh23:43:590
294399973,34cyclictest352-21runrttasks21:56:470
294399973,34cyclictest352-21runrttasks21:56:470
294399973,33cyclictest5833-21ntp_kernel_err21:42:020
294399973,33cyclictest5833-21ntp_kernel_err21:42:020
294399972,32cyclictest10087-21rm20:56:190
294399964,35cyclictest17431-21fschecks_count22:01:390
294399964,33cyclictest19883-21latency_hist19:46:190
294399964,31cyclictest352-21runrttasks00:03:500
294399963,37cyclictest556-21grep23:21:390
294399963,34cyclictest11856-21/usr/sbin/munin19:21:270
294399963,34cyclictest11856-21/usr/sbin/munin19:21:270
294399963,33cyclictest5915-21cut20:41:500
294399963,33cyclictest5915-21cut20:41:500
294399963,32cyclictest30171-21/usr/sbin/munin22:21:520
294399963,29cyclictest22208-21mailstats23:56:480
294399963,25cyclictest21125-21/usr/sbin/munin23:01:410
294399963,25cyclictest21125-21/usr/sbin/munin23:01:410
294399963,14cyclictest29714-21apt-get23:16:290
294399962,21cyclictest8632-21/usr/sbin/munin19:12:490
2958999533,31cyclictest0-21swapper/219:07:202
294999952,58cyclictest8650-21apt-get19:11:431
294399954,34cyclictest31379-21sort21:31:270
294399954,32cyclictest19930-21/usr/sbin/munin19:46:440
294399954,31cyclictest7726-21grep20:46:520
294399953,33cyclictest15000-21latency_hist19:31:180
294399953,33cyclictest15000-21latency_hist19:31:180
294399953,30cyclictest21543-21/usr/sbin/munin19:51:340
2943999532,55cyclictest0-21swapper/020:01:190
294399952,36cyclictest26831-21sort20:06:420
294399952,22cyclictest21487-21ssh21:14:400
2943999517,28cyclictest10030-21rm23:36:490
2958999415,38cyclictest0-21swapper/200:11:422
2958999415,38cyclictest0-21swapper/200:11:422
2949999469,15cyclictest352-21runrttasks22:46:361
294399945,33cyclictest27997-21/usr/sbin/munin20:11:370
294399943,38cyclictest9248-21timerandwakeup20:51:510
294399943,38cyclictest9248-21timerandwakeup20:51:510
294399943,34cyclictest352-21runrttasks19:20:490
294399943,33cyclictest352-21runrttasks20:32:220
294399943,32cyclictest23951-21fschecks_count23:06:370
294399943,32cyclictest17927-21ssh22:56:360
294399943,30cyclictest18489-21/usr/sbin/munin23:51:510
294399938,28cyclictest9837-21diskmemload22:31:400
294399935,28cyclictest3539-21fschecks_count23:26:370
294399935,28cyclictest3539-21fschecks_count23:26:370
294399933,34cyclictest15087-21/usr/sbin/munin19:31:460
294399933,34cyclictest15087-21/usr/sbin/munin19:31:460
294399933,32cyclictest8175-21/usr/sbin/munin21:46:390
294399933,29cyclictest29902-21grep20:16:390
294399933,27cyclictest7428-21wc19:06:490
294399933,25cyclictest869-21/usr/sbin/munin00:16:380
2963999212,46cyclictest5221-21chrt21:41:353
2963999212,46cyclictest5221-21chrt21:41:353
2958999238,10cyclictest0-21swapper/218:56:382
295899913,78cyclictest0-21swapper/219:56:322
2958999052,33cyclictest2934-21cyclictest22:59:232
2949999023,22cyclictest10113-21seq21:49:101
2958998943,39cyclictest0-21swapper/200:21:142
2958998940,42cyclictest30395-21processes23:16:492
295899887,42cyclictest0-21swapper/220:14:232
2958998843,36cyclictest3353-21modprobe20:36:152
295899883,76cyclictest0-21swapper/200:01:302
2958998748,32cyclictest13469-21sh21:01:412
2958998748,32cyclictest13469-21sh21:01:412
295899874,73cyclictest0-21swapper/220:46:322
2949998763,15cyclictest18205-21/usr/sbin/munin23:51:161
2949998763,15cyclictest18205-21/usr/sbin/munin23:51:161
295899864,71cyclictest0-21swapper/222:41:262
295899863,73cyclictest0-21swapper/221:36:322
2958998563,16cyclictest297-21systemd-logind20:06:162
2958998563,16cyclictest297-21systemd-logind20:06:162
2958998537,24cyclictest14933-21kworker/u17:2-nfsiod00:25:252
294999857,67cyclictest17104-21memory21:07:131
2949998564,15cyclictest803-21sendmail-mta23:35:141
2949998524,24cyclictest1578-21seq23:22:301
295899844,73cyclictest0-21swapper/220:26:292
2958998436,39cyclictest0-21swapper/223:56:512
2949998446,12cyclictest30611-21ssh00:11:381
2949998446,12cyclictest30611-21ssh00:11:381
2958998344,31cyclictest0-21swapper/222:31:382
294999836,60cyclictest4095-21apt-get00:21:451
2958998241,34cyclictest0-21swapper/220:56:392
2958998239,36cyclictest4719-21munin-node22:07:282
295899823,70cyclictest0-21swapper/222:01:282
2949998255,19cyclictest1-21systemd23:39:351
2949998219,23cyclictest0-21swapper/121:29:441
260728231,14sleep1181rcu_preempt18:53:521
2958998140,32cyclictest0-21swapper/221:41:252
2958998140,32cyclictest0-21swapper/221:41:252
295899813,67cyclictest0-21swapper/222:21:272
2958998135,38cyclictest14138-21sendmail_mailst19:27:032
2958998135,38cyclictest14138-21sendmail_mailst19:27:032
295899812,67cyclictest0-21swapper/222:36:282
2949998156,18cyclictest9837-21diskmemload22:14:101
294999803,59cyclictest11867-21apt-get19:21:291
294999803,59cyclictest11867-21apt-get19:21:291
2949998023,19cyclictest27996-21seq22:18:521
2949998022,27cyclictest3467-21/usr/sbin/munin22:31:501
2949998020,24cyclictest5584-21runrttasks20:41:421
2949998020,24cyclictest5584-21runrttasks20:41:421
295899794,65cyclictest0-21swapper/219:41:322
2958997941,33cyclictest2934-21cyclictest22:16:372
295899793,64cyclictest22396-21apt-get21:16:282
295899792,72cyclictest0-21swapper/219:46:332
295899791,40cyclictest14599-21kernelversion21:56:412
295899791,40cyclictest14599-21kernelversion21:56:412
2949997914,27cyclictest0-21swapper/123:56:481
2958997858,14cyclictest2934-21cyclictest23:56:182
295899783,46cyclictest352-21runrttasks19:23:412
295899783,46cyclictest352-21runrttasks19:23:412
2958997833,37cyclictest0-21swapper/223:16:172
2958997828,40cyclictest0-21swapper/223:31:182
2958997828,40cyclictest0-21swapper/223:31:182
2949997859,13cyclictest2374-21systemd-journal21:41:161
2949997822,22cyclictest9588-21seq20:53:241
2949997822,22cyclictest9588-21seq20:53:241
2963997717,35cyclictest0-21swapper/321:06:423
295899774,68cyclictest0-21swapper/221:11:362
295899774,59cyclictest9276-21apt-get23:36:272
295899773,65cyclictest0-21swapper/222:51:312
295899773,65cyclictest0-21swapper/222:51:312
2958997735,32cyclictest0-21swapper/222:49:252
2958997727,40cyclictest277-21dbus-daemon23:41:492
2958997727,40cyclictest277-21dbus-daemon23:41:492
295899772,70cyclictest0-21swapper/222:11:292
295899772,64cyclictest0-21swapper/221:51:292
295899772,48cyclictest8650-21apt-get19:11:312
2949997761,11cyclictest2934-21cyclictest00:06:441
2949997752,17cyclictest26553-21ssh23:11:181
2949997723,24cyclictest20903-21seq23:55:371
295899763,67cyclictest0-21swapper/223:06:302
2958997628,41cyclictest0-21swapper/219:31:532
2958997628,41cyclictest0-21swapper/219:31:532
2949997632,33cyclictest30202-21wc20:16:491
2949997621,29cyclictest14233-21diskmemload23:44:191
2949997621,29cyclictest14233-21diskmemload23:44:191
2949997616,22cyclictest32241-21cat21:31:511
2958997531,37cyclictest0-21swapper/220:06:452
2958997523,43cyclictest0-21swapper/220:36:272
2958997512,56cyclictest3078-21rm23:26:172
2949997557,12cyclictest2374-21systemd-journal19:08:341
294999752,41cyclictest17413-21ls22:56:151
294999752,41cyclictest17413-21ls22:56:151
2949997521,24cyclictest7219-21seq22:37:571
2958997434,33cyclictest0-21swapper/222:26:492
2949997450,17cyclictest32617-21latency_hist23:21:191
2949997447,17cyclictest3317-21cpu23:26:321
2949997447,17cyclictest3317-21cpu23:26:321
2949997425,18cyclictest11911-21seq20:58:431
294999742,42cyclictest25096-21kworker/u19:2+ext4-rsv-conversion21:41:371
294999742,42cyclictest25096-21kworker/u19:2+ext4-rsv-conversion21:41:371
2949997421,21cyclictest29293-21seq20:15:371
2958997347,20cyclictest31373-21/usr/sbin/munin21:31:402
295899734,64cyclictest0-21swapper/219:16:312
295899733,60cyclictest25380-21apt-get21:21:282
2958997331,35cyclictest0-21swapper/221:11:202
295899732,65cyclictest296262chrt20:16:282
2958997320,44cyclictest6024-21ls19:01:542
2949997346,19cyclictest3826-21apt-key00:21:191
2949997346,15cyclictest28625-21kworker/u17:3-rpciod23:16:191
2949997338,24cyclictest0-21swapper/122:01:541
2949997312,25cyclictest5167-21apt-get19:01:331
295899723,62cyclictest0-21swapper/223:01:322
295899723,62cyclictest0-21swapper/223:01:322
295899723,61cyclictest16921-21taskset19:36:372
295899723,61cyclictest10450-21runrttasks21:50:072
295899723,59cyclictest32662-21sed20:26:182
2949997256,10cyclictest13137-21/usr/sbin/munin21:01:551
2949997256,10cyclictest13137-21/usr/sbin/munin21:01:551
2949997255,11cyclictest24854-21kworker/u17:2-rpciod22:21:391
2949997252,14cyclictest25286-21latency_hist21:21:191
2949997234,26cyclictest400-21apt-get20:26:321
2949997226,33cyclictest17723-21apt22:56:261
2949997217,21cyclictest0-21swapper/121:59:561
2949997217,21cyclictest0-21swapper/121:59:561
2958997136,29cyclictest14933-21kworker/u17:2-nfsiod23:46:392
2958997136,29cyclictest14933-21kworker/u17:2-nfsiod23:46:392
295899713,53cyclictest28738-21ssh21:26:392
295899713,52cyclictest9876-21ssh20:56:172
295899713,52cyclictest9876-21ssh20:56:172
2949997158,9cyclictest2934-21cyclictest19:21:191
2949997136,28cyclictest32232-21ssh22:26:311
2958997027,36cyclictest9837-21diskmemload23:31:432
2958997018,44cyclictest0-21swapper/219:51:422
2949997025,32cyclictest18041-21modprobe19:41:151
2949997013,23cyclictest0-21swapper/121:52:471
2949997010,28cyclictest24868-21cstates20:01:341
2949997010,28cyclictest24868-21cstates20:01:341
2963996915,32cyclictest0-21swapper/323:46:353
2963996915,32cyclictest0-21swapper/323:46:353
2949996950,13cyclictest9301-21ntp_kernel_pll_22:41:431
2949996946,16cyclictest2934-21cyclictest20:26:191
2949996942,18cyclictest352-21runrttasks21:11:381
2949996851,9cyclictest19949-21apt-get19:46:331
2949996745,16cyclictest25903-21sh21:21:441
2949996734,22cyclictest21561-21apt-get19:51:281
2949996730,27cyclictest2013-21apt-get20:31:321
2949996729,30cyclictest0-21swapper/119:41:291
2949996723,23cyclictest26871-21seq00:05:421
296399666,44cyclictest4167-21chrt00:21:383
2949996633,25cyclictest3632-21apt-get20:36:281
2949996625,36cyclictest0-21swapper/119:26:421
2949996625,36cyclictest0-21swapper/119:26:421
2949996542,15cyclictest27956-21latency_hist20:11:191
2949996538,18cyclictest24697-21latency_hist20:01:191
2949996525,33cyclictest20833-21ssh22:06:481
296399643,40cyclictest0-21swapper/319:11:303
2949996436,21cyclictest0-21swapper/118:56:511
2949996317,33cyclictest16449-21cut19:36:171
2949996317,33cyclictest16449-21cut19:36:171
2963996212,32cyclictest0-21swapper/323:46:183
2963996212,32cyclictest0-21swapper/323:46:183
2949996225,30cyclictest23576-21latency_hist23:06:181
2949996225,30cyclictest23576-21latency_hist23:06:181
294999612,41cyclictest6916-21grep20:46:331
296399583,38cyclictest20106-21taskset22:06:193
296399573,38cyclictest19661-21chrt21:11:433
296399563,41cyclictest2956-21chrt20:31:523
296399563,39cyclictest27499-21taskset21:24:453
296399562,39cyclictest11818-21chrt22:46:313
296399562,36cyclictest8622-21chrt21:46:413
181025621,20sleep30-21swapper/318:51:463
296399553,40cyclictest1748-21chrt20:31:153
296399553,37cyclictest11997-21chrt21:51:523
296399552,39cyclictest5574-21taskset22:36:183
296399544,36cyclictest14958-21chrt22:51:373
296399544,36cyclictest14958-21chrt22:51:373
296399544,35cyclictest27962-21chrt20:11:193
296399543,39cyclictest7078-21chrt19:06:383
296399543,38cyclictest4466-21chrt19:01:153
296399542,39cyclictest6410-21taskset23:31:333
296399542,39cyclictest1837-21chrt23:23:143
296399533,39cyclictest5886-21chrt19:01:523
296399533,37cyclictest22789-21chrt22:11:013
2963995331,15cyclictest451rcuc/320:46:363
296399532,40cyclictest30100-21taskset00:11:173
296399532,36cyclictest2745-21taskset00:19:033
296399523,37cyclictest4454-21chrt21:40:493
296399523,36cyclictest31798-21chrt23:19:383
296399513,35cyclictest21693-21taskset19:51:343
296399513,34cyclictest23889-21chrt23:06:333
296399512,40cyclictest31389-21chrt22:24:593
296399512,36cyclictest14231-21chrt19:27:043
296399512,36cyclictest14231-21chrt19:27:043
296399512,35cyclictest10003-21taskset20:56:193
296399512,35cyclictest10003-21taskset20:56:193
296399503,33cyclictest5837-21chrt23:30:563
296399503,33cyclictest5837-21chrt23:30:563
2963995029,14cyclictest451rcuc/300:14:463
2963995029,14cyclictest451rcuc/300:14:463
296399502,38cyclictest5577-21chrt20:41:413
296399502,38cyclictest5577-21chrt20:41:413
296399502,36cyclictest23335-21taskset23:06:083
296399502,36cyclictest23335-21taskset23:06:083
296399494,34cyclictest10519-21chrt20:56:393
296399494,32cyclictest3764-21chrt20:36:343
296399494,32cyclictest15040-21chrt21:04:053
296399494,32cyclictest15040-21chrt21:04:053
296399493,35cyclictest11950-21chrt19:21:333
296399493,35cyclictest11950-21chrt19:21:333
296399493,33cyclictest7940-21chrt22:39:583
296399492,35cyclictest21377-21chrt19:51:183
296399492,34cyclictest10739-21chrt19:16:433
296399484,33cyclictest30170-21chrt21:28:463
296399483,33cyclictest26144-21taskset00:03:393
296399483,31cyclictest18329-21taskset22:56:443
2963994833,10cyclictest451rcuc/320:16:303
296399482,36cyclictest23465-21chrt22:11:383
296399482,33cyclictest1578-21taskset22:28:563
2963994734,8cyclictest451rcuc/323:56:183
2963994734,8cyclictest451rcuc/322:17:433
296399473,29cyclictest31197-21chrt20:21:193
2963994731,9cyclictest451rcuc/323:13:093
296399472,31cyclictest16460-21chrt19:36:153
296399472,31cyclictest16460-21chrt19:36:153
296399464,30cyclictest17348-21taskset19:36:483
296399463,30cyclictest10598-21chrt23:37:293
296399462,35cyclictest894-21chrt21:34:173
296399462,30cyclictest16893-21chrt22:01:163
296399462,30cyclictest16893-21chrt22:01:163
255262463,7sleep30-21swapper/320:01:523
255262463,7sleep30-21swapper/320:01:523
296399453,30cyclictest23980-21chrt21:18:163
296399452,31cyclictest9880-21chrt22:42:013
296399452,31cyclictest28300-21taskset20:11:393
296399434,28cyclictest22315-21chrt23:56:503
296399403,26cyclictest18661-21taskset19:41:423
2963994028,8cyclictest451rcuc/319:56:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional