You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 04:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Fri Sep 18, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
226049912164,50cyclictest28230-21apt-key21:04:022
225839911125,9cyclictest0-21swapper/019:54:010
22583991103,32cyclictest17138-21latency_hist22:34:030
22583991103,32cyclictest17138-21latency_hist22:34:030
22583991084,27cyclictest13263-21/usr/sbin/munin00:14:180
22583991084,27cyclictest13263-21/usr/sbin/munin00:14:180
225839910827,11cyclictest0-21swapper/020:59:010
571321060,7sleep10-21swapper/119:55:081
22583991063,31cyclictest7039-21/usr/sbin/munin00:04:250
22583991062,34cyclictest18319-21unixbench_multi22:34:380
225839910433,8cyclictest0-21swapper/000:24:220
225839910432,8cyclictest0-21swapper/022:24:190
22583991043,27cyclictest28041-21sh21:59:010
22583991034,32cyclictest15072-21/usr/sbin/munin23:24:210
225839910338,57cyclictest0-21swapper/020:09:280
22583991033,32cyclictest26998-21/usr/sbin/munin22:49:310
22583991033,32cyclictest26998-21/usr/sbin/munin22:49:310
22583991033,31cyclictest31232-21timerwakeupswit21:09:370
22583991032,36cyclictest28434-21cat19:24:260
225839910323,11cyclictest0-21swapper/019:14:280
225839910323,11cyclictest0-21swapper/019:14:280
225839910229,12cyclictest0-21swapper/023:09:200
22583991014,37cyclictest343-21runrttasks21:59:310
22583991014,37cyclictest343-21runrttasks21:59:310
225839910140,54cyclictest0-21swapper/021:14:270
22583991013,22cyclictest22718-21/usr/sbin/munin00:29:260
22583991012,39cyclictest20809-21munin-plugin-st23:33:590
22583991012,39cyclictest20809-21munin-plugin-st23:33:590
225839910123,12cyclictest0-21swapper/020:19:310
225839910115,22cyclictest14650irq/292-2188000.ethernet23:39:220
2237521015,14sleep20-21swapper/219:08:162
22583991004,30cyclictest343-21runrttasks20:04:240
22583991004,30cyclictest343-21runrttasks20:04:240
22583991003,40cyclictest7126-21/usr/sbin/munin19:59:260
22583991003,40cyclictest7126-21/usr/sbin/munin19:59:260
225839910028,10cyclictest0-21swapper/020:59:560
225839910026,12cyclictest0-21swapper/023:04:350
225839910023,10cyclictest0-21swapper/020:39:210
22583991002,26cyclictest23110-21/usr/sbin/munin21:49:350
22583991002,26cyclictest23110-21/usr/sbin/munin21:49:350
22583999933,7cyclictest0-21swapper/021:44:330
2258399993,36cyclictest343-21runrttasks22:44:310
2258399993,30cyclictest5182-21fschecks_count22:14:220
2258399993,25cyclictest30607-21/usr/sbin/munin23:49:200
2258399993,24cyclictest26153-21timerwakeupswit00:34:360
22583999927,11cyclictest0-21swapper/000:19:360
22583999926,7cyclictest0-21swapper/023:45:340
2258399992,39cyclictest29959-21modprobe21:09:000
2258399992,34cyclictest9899-21/usr/sbin/munin21:29:150
2258399992,25cyclictest12371-21fschecks_time23:19:220
2258399992,25cyclictest12371-21fschecks_time23:19:220
2258399984,30cyclictest9596-21/usr/sbin/munin23:14:270
22583999833,8cyclictest0-21swapper/020:24:340
22583999833,8cyclictest0-21swapper/020:24:340
2258399983,33cyclictest12763-21grep20:14:350
22583999826,8cyclictest0-21swapper/021:44:020
2258399982,32cyclictest21795-21rm23:34:310
2258399974,34cyclictest1353-21if_err_eth023:54:230
2258399974,34cyclictest1353-21if_err_eth023:54:230
2258399973,37cyclictest22572-21cyclictest19:09:040
2258399973,36cyclictest23014-21idleruntime-cro20:49:000
2258399973,32cyclictest343-21runrttasks22:57:140
2258399973,32cyclictest2488-21awk22:09:280
2258399973,32cyclictest12917-21/usr/sbin/munin21:34:250
2258399973,31cyclictest5035-21sh21:19:410
2258399973,30cyclictest32209-21sh22:04:350
2258399973,29cyclictest6727-21latency_hist00:04:020
2258399972,31cyclictest3519-21cat19:49:030
22583999721,12cyclictest0-21swapper/019:39:350
2258399963,36cyclictest26703-21fschecks_time19:19:230
2258399963,32cyclictest22188-21sh22:41:430
2258399963,32cyclictest22188-21sh22:41:430
2258399963,25cyclictest32505-21/usr/sbin/munin22:59:170
2258399962,31cyclictest7974-21sh22:19:040
2258399962,27cyclictest10345-21fschecks_count00:09:240
22583999534,54cyclictest0-21swapper/019:55:580
2258399953,37cyclictest32022-21cat19:34:340
2258399953,33cyclictest29861-21fschecks_count19:29:210
2258399953,31cyclictest23382-21wc19:09:320
2258399953,29cyclictest16804-21/usr/sbin/munin20:29:350
2258399953,29cyclictest16804-21/usr/sbin/munin20:29:350
22604999469,19cyclictest14907-21latency_hist23:24:012
22604999469,19cyclictest14907-21latency_hist23:24:012
2258399943,32cyclictest7203-21fschecks_time21:24:210
2258399943,32cyclictest18924-21ntp_kernel_pll_20:34:290
2258399934,35cyclictest343-21runrttasks20:53:420
22604999075,10cyclictest6927-21kworker/u17:0-xprtiod21:44:002
2259499908,54cyclictest25274-21apt-get21:54:351
22594999062,21cyclictest1-21systemd23:04:011
22604998869,13cyclictest26065-21modprobe22:48:592
22594998735,9cyclictest0-21swapper/121:19:121
22604998662,16cyclictest10557-21latency00:09:282
2259499863,57cyclictest26866-21apt-get23:44:141
22594998360,14cyclictest200-21systemd-journal21:33:421
22604998261,12cyclictest2589-21ntpq19:44:302
22594998256,19cyclictest14201-21latency_hist22:29:041
2260499817,61cyclictest25274-21apt-get21:54:262
22604998162,13cyclictest13425-21sh00:14:232
22604998162,13cyclictest13425-21sh00:14:232
2260499813,44cyclictest24871-21/usr/sbin/munin20:54:162
22594998161,13cyclictest343-21runrttasks22:09:031
22594998156,17cyclictest22553-21ssh22:42:421
22594998156,17cyclictest22553-21ssh22:42:421
22604998049,12cyclictest181rcu_preempt19:49:352
22594998062,10cyclictest25033-21apt-key21:54:051
22594997957,14cyclictest200-21systemd-journal21:26:531
22594997953,16cyclictest1858-21timerandwakeup23:54:361
22594997953,16cyclictest1858-21timerandwakeup23:54:361
22604997858,14cyclictest24723-21latency_hist21:54:032
22604997858,14cyclictest24723-21latency_hist21:54:032
22604997856,14cyclictest200-21systemd-journal21:29:412
2260499784,51cyclictest14472-21ssh22:29:412
2260499784,51cyclictest14472-21ssh22:29:412
2260499783,37cyclictest11744-21systemctl23:18:592
22594997859,13cyclictest18524-21kernelversion23:29:261
22594997859,13cyclictest18524-21kernelversion23:29:261
2259499782,59cyclictest26231-21apt-get20:59:141
22594997822,17cyclictest0-21swapper/121:44:371
22594997811,27cyclictest0-21swapper/119:39:321
2243227828,31sleep122436-21cron19:09:001
22604997761,9cyclictest3577-21ls21:19:002
22604997760,10cyclictest200-21systemd-journal00:19:422
2260499773,49cyclictest3840-21date23:59:032
2260499773,49cyclictest3840-21date23:59:032
22594997755,16cyclictest22572-21cyclictest21:08:171
22594997753,16cyclictest25664-21latency00:34:261
2260499763,29cyclictest18060-21ssh22:34:352
22594997655,12cyclictest14249-21ssh23:22:341
22594997655,12cyclictest14249-21ssh23:22:341
22594997652,17cyclictest17340-21cpu22:34:181
22594997652,16cyclictest11741-21munin-run23:19:001
22594997650,15cyclictest32124-21sendmail22:58:591
22604997552,15cyclictest524-21in:imuxsock20:25:412
22604997552,15cyclictest524-21in:imuxsock20:25:412
22594997518,19cyclictest0-21swapper/121:49:311
150472750,7sleep30-21swapper/322:30:463
150472750,7sleep30-21swapper/322:30:463
22604997449,17cyclictest22572-21cyclictest21:44:502
2259499745,36cyclictest15631-21grep20:24:251
2259499745,36cyclictest15631-21grep20:24:251
22594997452,14cyclictest200-21systemd-journal22:51:411
22594997452,14cyclictest200-21systemd-journal22:51:411
22594997450,12cyclictest15972-21munin-node21:39:111
22594997449,19cyclictest2215-21fschecks_time22:09:211
22604997360,9cyclictest22572-21cyclictest22:40:022
22604997360,9cyclictest22572-21cyclictest22:40:022
22604997353,7cyclictest181rcu_preempt19:39:032
22604997352,14cyclictest22572-21cyclictest19:14:002
22604997348,14cyclictest0-21swapper/223:04:332
2260499733,35cyclictest2246-21ssh22:09:232
22594997353,14cyclictest343-21runrttasks22:19:321
22594997346,18cyclictest28638-21fschecks_time21:59:231
22594997346,18cyclictest28638-21fschecks_time21:59:231
22604997256,10cyclictest7144-21apt-get19:59:122
22604997256,10cyclictest7144-21apt-get19:59:122
22604997250,16cyclictest524-21in:imuxsock19:18:412
22604997250,16cyclictest524-21in:imuxsock19:18:412
22604997240,9cyclictest181rcu_preempt20:38:592
2260499722,32cyclictest7277-21ssh00:04:232
2259499727,34cyclictest21927-21cut20:44:231
22594997248,15cyclictest343-21runrttasks00:04:271
2259499724,44cyclictest19445-21fschecks_time00:24:221
22604997156,8cyclictest0-21swapper/221:34:212
22604997152,13cyclictest2737-21latency_hist23:04:012
22604997151,12cyclictest0-21swapper/222:19:212
22604997138,9cyclictest0-21swapper/220:34:012
22604997138,9cyclictest0-21swapper/220:34:012
22604997137,9cyclictest181rcu_preempt23:09:122
22604997125,10cyclictest181rcu_preempt19:55:032
22594997151,14cyclictest22572-21cyclictest19:14:091
22594997151,14cyclictest22572-21cyclictest19:14:091
22594997146,19cyclictest13520-21kernelversion00:14:251
22594997146,19cyclictest13520-21kernelversion00:14:251
22594997117,14cyclictest0-21swapper/121:34:151
73202700,7sleep10-21swapper/122:17:591
22604997054,10cyclictest3137-21kworker/u17:0-rpciod22:29:002
22604997048,12cyclictest0-21swapper/223:29:372
22604997048,12cyclictest0-21swapper/223:29:372
22604997041,10cyclictest181rcu_preempt00:27:492
2259499705,28cyclictest3656-21proc_pri23:04:311
22594997048,15cyclictest662-21cron23:28:591
2259499703,47cyclictest24462-21fschecks_time23:39:221
2259499703,46cyclictest22217-21vmstat23:34:371
2259499703,45cyclictest902-21latency_hist23:54:031
22604996952,10cyclictest0-21swapper/221:21:052
22604996945,9cyclictest0-21swapper/200:33:202
22604996936,12cyclictest181rcu_preempt20:14:352
22594996953,9cyclictest0-21swapper/119:49:321
22594996948,12cyclictest22572-21cyclictest22:34:031
22594996948,12cyclictest22572-21cyclictest22:34:031
22594996932,23cyclictest0-21swapper/120:24:031
2259499692,44cyclictest23187-21latency19:09:251
22604996848,15cyclictest30407-21/usr/sbin/munin23:49:292
22604996846,12cyclictest0-21swapper/200:03:592
22604996842,14cyclictest0-21swapper/219:29:272
2260499683,36cyclictest5218-21fschecks_time22:14:222
22604996825,20cyclictest11831-21latency_hist20:14:022
22594996847,13cyclictest1560-21processes21:14:321
22594996844,17cyclictest4173-21cstates23:59:211
22594996844,14cyclictest0-21swapper/120:39:221
2259499683,50cyclictest10981-21wc20:09:321
2260499673,43cyclictest9186-21latency20:04:262
2260499673,43cyclictest9186-21latency20:04:262
22594996750,11cyclictest1-21systemd20:38:291
2259499674,45cyclictest23928-21ntp_kernel_pll_22:44:291
2259499673,48cyclictest7968-21ssh23:11:591
22594996720,12cyclictest26446-21apt-get19:19:121
22594996713,14cyclictest0-21swapper/100:29:271
22604996644,8cyclictest181rcu_preempt22:02:042
22604996644,8cyclictest181rcu_preempt22:02:042
22604996644,16cyclictest30803-21sh22:55:292
2260499664,36cyclictest26503-21cstates22:49:182
2260499664,36cyclictest26503-21cstates22:49:182
22604996641,9cyclictest181rcu_preempt00:35:382
22604996641,15cyclictest0-21swapper/219:39:332
22604996616,15cyclictest20298-21fschecks_time20:39:232
22594996647,14cyclictest12774-21idleruntime-cro00:13:591
22594996641,14cyclictest0-21swapper/120:34:021
22594996641,14cyclictest0-21swapper/120:34:021
2259499663,41cyclictest8770-21cpu20:04:171
2259499663,41cyclictest8770-21cpu20:04:171
22594996619,9cyclictest0-21swapper/120:59:031
22604996549,9cyclictest0-21swapper/223:45:192
22604996546,11cyclictest32693-21ssh22:05:182
22604996540,9cyclictest24020-21grep23:39:022
2260499653,43cyclictest343-21runrttasks20:46:102
2259499653,40cyclictest24821-21latency_hist20:54:031
2259499652,44cyclictest16265-21runrttasks00:19:181
2259499652,42cyclictest13322-21latency_hist20:19:031
22604996444,15cyclictest17789-21idleruntime-cro23:28:592
2260499644,37cyclictest28427-21kernelversion19:24:262
22604996442,13cyclictest0-21swapper/219:19:372
2260499642,41cyclictest343-21runrttasks21:25:472
2260499642,33cyclictest29961-21apt21:09:002
2259499643,41cyclictest29835-21fschecks_count19:29:211
22611996344,12cyclictest0-21swapper/321:29:003
22604996348,10cyclictest23801-21cron23:39:032
22604996347,11cyclictest359-21snmpd21:11:192
2260499634,31cyclictest14495-21unixbench_multi20:19:352
2260499633,38cyclictest23977-21switchtime20:49:342
22594996342,10cyclictest0-21swapper/121:09:271
2259499633,41cyclictest31497-21fschecks_time19:34:221
2259499632,42cyclictest28033-21/usr/sbin/munin19:24:341
22594996310,36cyclictest8498-21apt20:03:591
22594996310,36cyclictest8498-21apt20:03:591
2261199623,42cyclictest18776-21taskset21:44:023
2259499623,39cyclictest3597-21latency_hist19:49:031
2261199613,42cyclictest4849-21taskset23:59:403
2261199603,39cyclictest31312-21chrt21:09:373
22611996013,34cyclictest0-21swapper/323:44:463
2261199592,35cyclictest20686-21chrt23:33:423
2261199592,35cyclictest20686-21chrt23:33:423
2261199583,39cyclictest23197-21taskset22:44:033
2261199583,39cyclictest23197-21taskset22:44:033
2261199583,38cyclictest10560-21chrt00:09:283
2261199574,36cyclictest24301-21chrt19:14:033
2261199563,37cyclictest901-21kworker/3:1+events20:42:413
222792565,33sleep30-21swapper/319:06:583
2261199554,35cyclictest25962-21chrt23:41:323
2261199553,40cyclictest18850-21chrt00:23:593
2261199553,39cyclictest2031-21taskset23:02:143
2261199552,37cyclictest901-21kworker/3:1+events22:54:133
2261199543,38cyclictest13540-21taskset20:19:033
2261199542,39cyclictest31908-21taskset19:34:333
2261199534,39cyclictest9286-21taskset20:04:293
2261199534,39cyclictest9286-21taskset20:04:293
2261199534,37cyclictest26675-21chrt20:59:043
2261199534,35cyclictest1815-21taskset19:44:003
2261199533,41cyclictest876-21chrt22:07:033
2261199533,36cyclictest13414-21chrt00:14:223
2261199533,36cyclictest13414-21chrt00:14:223
2261199533,33cyclictest7170-21taskset00:04:183
2261199524,36cyclictest16943-21taskset23:26:413
2261199524,34cyclictest901-21kworker/3:1+events22:12:273
2261199524,33cyclictest901-21kworker/3:1+events22:00:483
2261199524,33cyclictest901-21kworker/3:1+events22:00:483
2261199523,35cyclictest25754-21taskset00:34:283
2261199523,35cyclictest24695-21chrt19:14:123
2261199523,35cyclictest24695-21chrt19:14:123
2261199523,35cyclictest11704-21taskset21:31:303
2261199523,34cyclictest27159-21chrt19:19:343
2261199523,32cyclictest22117-21chrt00:29:053
2261199522,36cyclictest28559-21chrt22:52:383
2261199522,36cyclictest28559-21chrt22:52:383
2261199515,31cyclictest901-21kworker/3:1+events00:24:203
2261199514,37cyclictest5854-21taskset23:09:033
2261199514,35cyclictest10933-21chrt20:09:323
2261199514,33cyclictest26911-21chrt20:59:413
2261199504,36cyclictest5684-21taskset21:21:293
2261199504,34cyclictest15933-21taskset20:24:343
2261199504,34cyclictest15933-21taskset20:24:343
2261199503,34cyclictest1999-21chrt23:54:373
2261199503,34cyclictest1999-21chrt23:54:373
2261199502,34cyclictest17799-21chrt20:29:363
2261199502,34cyclictest17799-21chrt20:29:363
2261199496,31cyclictest13718-21taskset23:21:063
2261199496,31cyclictest13718-21taskset23:21:063
2261199494,33cyclictest32386-21taskset23:52:023
2261199493,37cyclictest19342-21chrt21:44:223
2261199493,35cyclictest1426-21chrt21:14:283
2261199493,31cyclictest11466-21chrt23:18:183
2261199492,34cyclictest7368-21chrt23:10:203
2261199492,34cyclictest18489-21taskset22:34:513
2261199485,32cyclictest29643-21chrt19:29:103
2261199484,34cyclictest22356-21chrt20:44:343
2261199484,30cyclictest0-21swapper/321:54:263
2261199483,36cyclictest24499-21taskset22:44:443
2261199483,34cyclictest7925-21chrt22:19:033
2261199483,33cyclictest13450-21chrt21:34:263
2261199483,31cyclictest29252-21chrt21:04:473
2261199482,36cyclictest5936-21chrt19:55:473
2261199474,33cyclictest22947-21taskset23:36:383
2261199473,33cyclictest8562-21chrt22:19:273
2261199473,30cyclictest28366-21chrt19:24:243
2261199473,29cyclictest901-21kworker/3:1+events19:59:123
2261199473,29cyclictest901-21kworker/3:1+events19:59:123
2261199465,27cyclictest19810-21chrt20:38:593
22611994629,11cyclictest231582sleep321:49:423
22611994629,11cyclictest231582sleep321:49:423
2261199462,34cyclictest4534-21chrt19:49:353
2261199462,33cyclictest11684-21chrt22:24:303
2261199442,31cyclictest3035-21chrt19:44:373
2261199422,28cyclictest23624-21taskset20:49:243
2261199403,27cyclictest14629-21taskset20:20:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional