You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 02:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Wed Sep 09, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22797216914,106sleep222855-21fschecks_time07:05:002
24225999974,14cyclictest0-21swapper/207:34:372
238322996,75sleep00-21swapper/007:08:040
24225999876,16cyclictest28294-21apt-key07:19:372
24225999875,16cyclictest24171-21cyclictest12:15:262
24225999875,16cyclictest24171-21cyclictest12:15:262
24180999775,15cyclictest24171-21cyclictest08:59:570
24180999775,15cyclictest24171-21cyclictest08:59:570
24225999644,38cyclictest12753-21sh12:10:172
24225999570,14cyclictest0-21swapper/209:25:232
24225999556,15cyclictest30270-21ssh11:45:052
24225999556,15cyclictest30270-21ssh11:45:052
24180999570,17cyclictest23526-21latency_hist08:44:360
2418099953,72cyclictest8883-21ssh09:24:520
24180999456,13cyclictest181rcu_preempt09:10:050
24180999456,13cyclictest181rcu_preempt09:10:050
24180999456,10cyclictest181rcu_preempt07:19:590
24202999272,13cyclictest15215-21munin-plugin-st12:14:331
2418099923,63cyclictest26882-21cpu07:15:280
24180999170,8cyclictest181rcu_preempt12:30:020
24180999169,15cyclictest24171-21cyclictest12:05:110
24180999169,15cyclictest24171-21cyclictest12:05:110
24225998971,10cyclictest0-21swapper/211:34:572
24225998971,10cyclictest0-21swapper/211:34:572
24225998965,17cyclictest24171-21cyclictest11:55:072
24225998965,14cyclictest0-21swapper/208:40:082
24180998940,11cyclictest181rcu_preempt12:12:240
24225998866,12cyclictest0-21swapper/208:59:382
24225998863,16cyclictest31532-21diskmemload10:43:202
24202998861,20cyclictest30725-21latency_hist12:39:361
24202998825,29cyclictest9055-21seq11:10:061
24180998856,12cyclictest181rcu_preempt11:42:390
24180998848,29cyclictest0-21swapper/010:19:550
24180998848,29cyclictest0-21swapper/010:19:550
24202998724,28cyclictest6030-21seq11:05:041
24202998724,28cyclictest6030-21seq11:05:041
24180998765,16cyclictest26899-21latency_hist09:54:380
24180998765,16cyclictest26899-21latency_hist09:54:380
24180998763,18cyclictest5329-21latency_hist09:19:360
24225998670,9cyclictest0-21swapper/209:24:372
24202998628,45cyclictest0-21swapper/112:04:481
24202998628,45cyclictest0-21swapper/112:04:481
24202998620,29cyclictest27256-21runrttasks11:40:061
24180998664,14cyclictest14646-21munin-run09:34:340
2418099863,61cyclictest24532-21runrttasks07:09:550
24225998555,9cyclictest9706-21ssh10:18:492
24225998545,19cyclictest181rcu_preempt09:48:402
24202998565,13cyclictest3073-21ssh11:54:361
24180998565,11cyclictest0-21swapper/011:56:200
24180998564,14cyclictest31532-21diskmemload11:25:060
24180998564,14cyclictest31532-21diskmemload11:25:060
24180998549,15cyclictest181rcu_preempt11:32:010
24225998462,12cyclictest0-21swapper/212:34:372
24225998462,12cyclictest0-21swapper/210:30:112
24202998466,10cyclictest0-21swapper/110:34:471
24202998418,28cyclictest0-21swapper/110:30:061
24202998410,26cyclictest0-21swapper/112:00:061
24180998463,8cyclictest181rcu_preempt11:39:210
24180998463,8cyclictest181rcu_preempt11:39:210
24225998365,14cyclictest24171-21cyclictest09:55:402
24225998362,12cyclictest24171-21cyclictest09:14:492
24225998330,9cyclictest181rcu_preempt07:44:562
2420299837,35cyclictest0-21swapper/111:31:181
24202998367,9cyclictest0-21swapper/108:44:351
24180998364,12cyclictest0-21swapper/010:45:100
24180998359,14cyclictest31532-21diskmemload10:15:030
24180998355,7cyclictest181rcu_preempt10:32:480
2308228317,36sleep10-21swapper/107:05:071
24225998261,11cyclictest0-21swapper/210:59:582
24202998221,29cyclictest16024-21head09:35:111
24180998262,13cyclictest0-21swapper/008:29:360
24180998261,10cyclictest0-21swapper/007:44:560
24225998152,8cyclictest181rcu_preempt07:39:352
24225998152,8cyclictest181rcu_preempt07:39:352
24225998150,9cyclictest11936-21ssh12:09:222
24225998150,9cyclictest11936-21ssh12:09:222
24225998146,14cyclictest10054-21ssh11:11:382
24225998139,18cyclictest11773-21kworker/u17:2+xprtiod09:10:222
24225998139,18cyclictest11773-21kworker/u17:2+xprtiod09:10:222
24225998127,11cyclictest181rcu_preempt07:14:382
24202998160,14cyclictest343-21runrttasks07:10:211
24202998159,14cyclictest15297-21kworker/u17:0-ext4-rsv-conversion10:29:371
24202998158,17cyclictest2315-21latency_hist09:14:371
24202998158,17cyclictest2315-21latency_hist09:14:371
2420299813,68cyclictest8993-21ssh09:25:091
24202998119,20cyclictest31532-21diskmemload09:20:281
24180998163,12cyclictest526-21rs:main0
24180998163,12cyclictest526-21rs:main0
24180998160,14cyclictest30663-21kernelversion07:24:590
24180998156,13cyclictest0-21swapper/008:49:560
24225998060,14cyclictest200-21systemd-journal10:08:012
24202998060,13cyclictest16523-21kworker/u17:2-rpciod10:39:581
2420299803,62cyclictest26832-21runrttasks07:15:071
24202998022,22cyclictest30196-21ntp_kernel_err11:45:021
24202998022,22cyclictest30196-21ntp_kernel_err11:45:021
24180998064,11cyclictest200-21systemd-journal12:03:010
24180998048,8cyclictest181rcu_preempt11:46:290
24180998048,8cyclictest181rcu_preempt11:46:290
24180998039,10cyclictest0-21swapper/009:35:370
24180998038,12cyclictest181rcu_preempt09:59:040
24225997961,11cyclictest0-21swapper/212:25:112
24225997960,12cyclictest0-21swapper/211:09:212
24225997960,12cyclictest0-21swapper/211:09:212
24225997958,16cyclictest25764-21kworker/u19:2+nfsiod11:50:132
24225997940,10cyclictest181rcu_preempt08:25:002
24225997937,12cyclictest181rcu_preempt07:24:482
24225997937,10cyclictest0-21swapper/211:21:562
2420299798,29cyclictest0-21swapper/110:10:051
2420299798,29cyclictest0-21swapper/110:10:051
24180997963,10cyclictest31532-21diskmemload10:05:100
24180997958,11cyclictest0-21swapper/009:45:110
2418099794,59cyclictest25226-21kworker/u18:0+ext4-rsv-conversion10:35:030
24180997945,15cyclictest181rcu_preempt07:40:070
24180997944,10cyclictest181rcu_preempt09:43:070
24180997941,24cyclictest181rcu_preempt10:25:000
2424099782,45cyclictest28712-21chrt07:20:063
24225997847,10cyclictest181rcu_preempt11:32:042
24225997842,14cyclictest181rcu_preempt10:00:012
24202997851,20cyclictest32576-21switchtime10:55:081
24202997851,20cyclictest32576-21switchtime10:55:081
24202997820,25cyclictest31877-21seq10:00:481
24202997817,24cyclictest27950-21ssh09:55:271
24180997863,9cyclictest32336-21ntp_kernel_err10:55:010
24180997863,9cyclictest32336-21ntp_kernel_err10:55:010
24180997858,8cyclictest181rcu_preempt11:07:470
24180997858,8cyclictest181rcu_preempt11:07:470
24202997751,20cyclictest3241-21sh11:00:101
24202997718,27cyclictest9032-21ssh10:17:001
24180997756,7cyclictest181rcu_preempt08:35:040
24180997753,13cyclictest0-21swapper/010:59:550
24180997751,13cyclictest181rcu_preempt08:04:360
24180997751,13cyclictest181rcu_preempt08:04:360
24180997743,13cyclictest24171-21cyclictest11:20:000
24180997739,28cyclictest0-21swapper/011:14:450
24180997739,12cyclictest0-21swapper/007:34:370
24225997655,10cyclictest0-21swapper/210:58:212
24225997655,10cyclictest0-21swapper/210:58:212
24202997627,33cyclictest0-21swapper/112:19:441
24202997614,27cyclictest0-21swapper/108:50:101
24202997613,28cyclictest0-21swapper/107:34:591
24202997613,28cyclictest0-21swapper/107:34:591
24180997656,8cyclictest181rcu_preempt07:55:110
24180997650,7cyclictest181rcu_preempt11:50:080
24180997649,7cyclictest181rcu_preempt09:59:590
24180997647,7cyclictest181rcu_preempt08:30:090
24180997645,12cyclictest181rcu_preempt12:15:130
24180997645,12cyclictest181rcu_preempt12:15:130
24180997638,8cyclictest181rcu_preempt08:54:440
24225997550,9cyclictest181rcu_preempt08:19:482
2422599752,33cyclictest39-21ksoftirqd/209:49:512
2422599752,33cyclictest39-21ksoftirqd/209:49:512
24202997552,18cyclictest24171-21cyclictest09:07:361
24202997523,34cyclictest11020-21grep10:20:061
24202997523,34cyclictest11020-21grep10:20:061
24202997523,23cyclictest12232-21seq09:29:561
24202997519,25cyclictest24571-21modprobe12:29:341
24202997518,20cyclictest29864-21runrttasks07:22:421
24202997516,34cyclictest343-21runrttasks08:57:061
24202997514,32cyclictest1833-21processes10:05:061
24180997554,8cyclictest181rcu_preempt08:04:560
24180997552,12cyclictest0-21swapper/010:50:020
24180997542,11cyclictest181rcu_preempt07:50:110
24180997538,12cyclictest181rcu_preempt10:40:090
24225997459,8cyclictest0-21swapper/209:40:092
24225997457,7cyclictest0-21swapper/210:19:562
24225997457,7cyclictest0-21swapper/210:19:562
24225997454,10cyclictest0-21swapper/208:59:592
24225997454,10cyclictest0-21swapper/208:59:592
24225997443,13cyclictest181rcu_preempt08:19:362
24225997433,8cyclictest181rcu_preempt11:25:012
24225997433,8cyclictest181rcu_preempt11:25:012
24225997430,8cyclictest181rcu_preempt10:10:412
24225997430,8cyclictest181rcu_preempt10:10:412
2422599742,52cyclictest13740-21kworker/u18:2+ext4-rsv-conversion07:20:142
24225997425,12cyclictest181rcu_preempt10:37:122
2420299748,29cyclictest0-21swapper/109:44:451
24202997454,13cyclictest2671-21/usr/sbin/munin07:40:031
24202997413,25cyclictest0-21swapper/109:49:591
24202997413,25cyclictest0-21swapper/109:49:591
24180997447,6cyclictest181rcu_preempt12:26:480
24180997441,11cyclictest181rcu_preempt12:39:200
24180997435,11cyclictest181rcu_preempt10:14:210
24180997435,11cyclictest181rcu_preempt10:14:210
24225997358,8cyclictest0-21swapper/211:14:522
24225997357,8cyclictest0-21swapper/209:34:542
24225997353,9cyclictest0-21swapper/208:09:342
24225997326,8cyclictest0-21swapper/212:20:062
2420299739,23cyclictest26125-21ssh12:30:341
24202997354,14cyclictest24171-21cyclictest09:17:071
24202997353,12cyclictest58-21kcompactd012:15:281
24202997353,12cyclictest58-21kcompactd012:15:281
24202997347,18cyclictest343-21runrttasks11:57:111
2420299733,46cyclictest16997-21latency_hist08:24:341
24202997310,26cyclictest0-21swapper/111:36:171
24202997310,26cyclictest0-21swapper/111:36:171
24180997348,8cyclictest181rcu_preempt09:23:030
24180997342,8cyclictest181rcu_preempt12:19:390
2404827318,35sleep30-21swapper/307:09:383
24225997257,8cyclictest0-21swapper/210:24:532
24225997257,10cyclictest200-21systemd-journal07:54:012
24225997255,9cyclictest0-21swapper/211:44:342
24225997251,10cyclictest0-21swapper/210:48:462
24225997236,10cyclictest21949-21kworker/u18:2-nfsiod12:03:562
24225997232,9cyclictest181rcu_preempt09:31:122
24225997225,17cyclictest29061-21fschecks_time10:49:562
24202997211,28cyclictest0-21swapper/110:44:481
24180997233,16cyclictest181rcu_preempt09:05:090
24225997131,10cyclictest181rcu_preempt08:09:532
24202997149,12cyclictest0-21swapper/108:15:101
2420299714,41cyclictest29076-21ntp_kernel_pll_09:00:031
2420299714,41cyclictest29076-21ntp_kernel_pll_09:00:031
24202997114,26cyclictest31895-21apt-get07:29:471
24202997110,31cyclictest19029-21sed09:40:111
24180997152,7cyclictest181rcu_preempt11:14:060
24180997152,14cyclictest13700-21idleruntime-cro08:14:340
24180997144,21cyclictest0-21swapper/008:20:060
24180997131,12cyclictest181rcu_preempt08:14:560
2422599707,40cyclictest317-21dbus-daemon08:39:342
24225997049,10cyclictest0-21swapper/207:54:562
24225997040,10cyclictest181rcu_preempt09:09:012
24202997049,11cyclictest0-21swapper/108:04:341
24202997049,11cyclictest0-21swapper/108:04:341
24202997012,23cyclictest14278-21date11:19:371
24225996953,7cyclictest0-21swapper/208:00:092
24225996953,7cyclictest0-21swapper/208:00:092
24225996942,18cyclictest0-21swapper/212:39:372
2422599693,46cyclictest4149-21cat07:44:372
24202996927,19cyclictest0-21swapper/108:34:451
24202996914,43cyclictest31549-21ssh10:54:361
24202996914,28cyclictest12256-21latency_hist08:09:371
2420299683,32cyclictest15201-21processes11:20:051
24202996828,27cyclictest5900-21apt-get07:49:471
24202996826,37cyclictest0-21swapper/111:24:481
24202996826,37cyclictest0-21swapper/111:24:481
24202996817,22cyclictest24904-21seq08:47:471
24180996851,12cyclictest0-21swapper/008:44:560
2420299673,33cyclictest8294-21timerandwakeup07:55:091
24202996719,25cyclictest19017-21runrttasks08:29:531
24240996621,31cyclictest0-21swapper/307:15:283
2422599663,45cyclictest343-21runrttasks08:31:312
2422599663,42cyclictest24148-21latency08:45:002
24202996547,10cyclictest4567-21fschecks_time07:44:571
24225996412,28cyclictest26231-21sed08:50:102
24202996431,12cyclictest181rcu_preempt07:29:381
24202996415,34cyclictest0-21swapper/108:09:491
24240996211,30cyclictest0-21swapper/309:24:503
24202996226,30cyclictest0-21swapper/108:24:441
2424099584,38cyclictest19749-21chrt10:35:033
2424099573,38cyclictest2437-21chrt07:39:343
2424099573,38cyclictest2437-21chrt07:39:343
2424099543,39cyclictest16937-21chrt08:24:013
2424099543,39cyclictest12124-21taskset08:09:353
2424099534,39cyclictest14714-21chrt12:13:153
2424099533,40cyclictest12817-21chrt08:10:033
2424099533,37cyclictest901-21kworker/3:1+events10:58:433
2424099533,37cyclictest901-21kworker/3:1+events10:58:433
2424099526,34cyclictest31806-21taskset09:09:413
2424099526,34cyclictest31806-21taskset09:09:413
2424099523,38cyclictest18962-21chrt10:34:103
2424099523,35cyclictest27920-21chrt08:55:113
2424099523,33cyclictest20382-21taskset08:34:383
2424099522,35cyclictest27939-21taskset12:34:473
2424099514,37cyclictest30253-21chrt10:51:173
2424099513,38cyclictest6122-21chrt09:20:033
2424099513,36cyclictest8371-21chrt10:15:143
2424099513,36cyclictest3657-21chrt09:15:253
2424099513,36cyclictest20996-21chrt11:30:003
2424099513,35cyclictest6536-21chrt11:59:553
2424099513,35cyclictest26944-21taskset12:32:493
2424099512,34cyclictest20180-21taskset12:20:533
2424099512,26cyclictest901-21kworker/3:1+events10:19:443
2424099512,26cyclictest901-21kworker/3:1+events10:19:443
2424099505,36cyclictest21146-21taskset09:44:503
2424099503,36cyclictest901-21kworker/3:1+events12:24:593
2424099503,35cyclictest30854-21chrt11:45:283
2424099503,35cyclictest30854-21chrt11:45:283
2424099503,34cyclictest31102-21chrt10:00:023
2424099503,33cyclictest26210-21chrt10:45:003
2424099502,37cyclictest15449-21chrt10:27:463
2424099494,32cyclictest1152-21chrt10:04:443
2424099493,35cyclictest4185-21chrt11:02:073
2424099492,35cyclictest29093-21chrt09:56:383
2424099492,34cyclictest1252-21taskset11:50:103
2424099492,33cyclictest14176-21taskset11:19:343
2424099484,35cyclictest901-21kworker/3:1+events11:22:023
2424099484,32cyclictest9815-21chrt08:00:073
2424099484,32cyclictest9815-21chrt08:00:073
2424099483,33cyclictest4412-21chrt10:09:553
2424099483,33cyclictest4412-21chrt10:09:553
2424099483,30cyclictest17627-21chrt12:17:163
2424099483,30cyclictest17627-21chrt12:17:163
2424099483,28cyclictest14823-21taskset09:34:373
2424099482,38cyclictest901-21kworker/3:1+events12:05:203
2424099482,38cyclictest901-21kworker/3:1+events12:05:203
2424099482,33cyclictest10330-21chrt11:12:243
2424099473,31cyclictest14451-21chrt08:15:023
2424099464,30cyclictest27381-21chrt09:54:393
2424099463,34cyclictest18401-21chrt11:25:093
2424099463,34cyclictest18401-21chrt11:25:093
2424099463,31cyclictest22864-21chrt10:39:533
24240994623,13cyclictest88822chrt07:59:353
2424099458,24cyclictest0-21swapper/307:09:553
2424099453,31cyclictest29270-21taskset11:44:273
2424099452,34cyclictest820-21taskset07:34:363
2424099444,27cyclictest28571-21taskset08:59:493
2424099444,27cyclictest28571-21taskset08:59:493
2424099443,31cyclictest24687-21taskset09:50:013
2424099443,30cyclictest3272-21chrt11:54:483
2424099433,30cyclictest2842-21taskset07:39:543
2424099433,30cyclictest20983-21taskset08:35:023
2424099433,28cyclictest5903-21taskset07:49:473
2424099433,28cyclictest18281-21taskset09:39:563
2424099433,27cyclictest16744-21chrt09:37:003
2424099424,30cyclictest25419-21chrt11:37:133
2424099424,30cyclictest25419-21chrt11:37:133
2424099423,28cyclictest4739-21taskset07:45:013
2424099423,27cyclictest7395-21taskset11:07:383
2424099423,27cyclictest7395-21taskset11:07:383
2424099412,29cyclictest31676-21taskset09:09:373
2424099412,26cyclictest31804-21chrt07:29:383
2424099403,26cyclictest25332-21taskset08:49:483
2424099402,26cyclictest17603-21taskset08:24:583
2424099393,27cyclictest24625-21taskset08:45:113
2424099392,27cyclictest23250-21taskset08:42:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional