You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 23:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Mar 21, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23033991253,39cyclictest7781-21ssh09:20:450
230339912157,57cyclictest4040-21apt-key09:14:520
23033991174,51cyclictest6562-21latency_hist11:59:490
23033991174,51cyclictest6562-21latency_hist11:59:490
230339911641,19cyclictest26979-21latency_hist11:39:510
23033991153,53cyclictest21669-21cat12:24:490
23033991153,53cyclictest21669-21cat12:24:490
23033991134,48cyclictest27313-21ssh11:40:020
23033991134,48cyclictest27313-21ssh11:40:020
23033991133,49cyclictest0-21swapper/010:43:480
23033991133,28cyclictest18183-21grep10:30:220
23033991123,30cyclictest13298-21grep12:10:130
23033991122,33cyclictest23194-21/usr/sbin/munin07:05:090
23033991122,33cyclictest23194-21/usr/sbin/munin07:05:090
230339910942,15cyclictest9545-21tune2fs11:10:090
230339910942,15cyclictest9545-21tune2fs11:10:090
23033991083,41cyclictest32418-21apt-key10:54:510
23033991083,26cyclictest22361-21runrttasks12:25:320
23033991074,49cyclictest4661-21cstates09:15:470
23033991074,49cyclictest4661-21cstates09:15:470
23033991074,38cyclictest16993-21latency_hist10:29:490
23033991073,44cyclictest23170-21timerandwakeup08:40:240
23033991073,43cyclictest12593-21fschecks_time11:15:090
23033991072,33cyclictest30613-21idleruntime11:45:100
23033991064,42cyclictest19808-21switchtime08:30:220
23033991064,42cyclictest19808-21switchtime08:30:220
230339910635,12cyclictest0-21swapper/010:56:000
23033991063,37cyclictest352-21runrttasks11:03:000
23033991063,37cyclictest352-21runrttasks11:03:000
23033991035,37cyclictest22977-21fschecks_count09:45:090
23033991034,37cyclictest25120-21cstates12:30:040
23033991034,36cyclictest19340-21unixbench_singl11:25:230
23033991034,36cyclictest19340-21unixbench_singl11:25:230
23033991033,42cyclictest27271-21latency07:15:120
23033991033,38cyclictest28107-21grep08:55:220
23033991033,18cyclictest29840-21munin-plugin-st07:24:480
23033991025,34cyclictest13902-21apt-key08:14:500
23033991024,39cyclictest15337-21cpu11:20:040
23033991023,40cyclictest352-21runrttasks10:22:070
23033991014,22cyclictest19382-21grep09:39:500
23033991014,22cyclictest19382-21grep09:39:500
23033991013,37cyclictest21007-21fschecks_time08:35:100
23033991013,37cyclictest21007-21fschecks_time08:35:100
23033991004,44cyclictest26483-21unixbench_multi08:50:230
23033991004,41cyclictest8804-21/usr/sbin/munin10:15:160
23033991004,41cyclictest8804-21/usr/sbin/munin10:15:160
23033991004,38cyclictest352-21runrttasks11:29:550
2303399995,49cyclictest25748-21ssh09:50:050
2303399994,36cyclictest30337-21latency_hist09:04:510
2303399994,34cyclictest352-21runrttasks12:02:020
2303399993,35cyclictest900-21latency_hist07:34:490
2303399992,29cyclictest4082-21latency_hist07:44:480
2303399983,40cyclictest2056-21grep07:35:500
2303399983,39cyclictest352-21runrttasks11:08:040
218432948,57sleep221892-21if_eth007:00:162
218432948,57sleep221892-21if_eth007:00:162
23053999270,14cyclictest200-21systemd-journal09:39:472
23053999270,14cyclictest200-21systemd-journal09:39:472
2305399917,66cyclictest20639-21ssh10:35:202
23053999170,12cyclictest0-21swapper/209:59:492
23042999168,11cyclictest0-21swapper/109:16:061
23042999168,11cyclictest0-21swapper/109:16:061
23042999167,13cyclictest0-21swapper/108:25:081
23053998966,11cyclictest0-21swapper/207:50:092
23042998967,13cyclictest0-21swapper/110:00:201
23053998760,17cyclictest0-21swapper/211:35:082
23042998757,22cyclictest15686-21latency_hist08:19:501
23042998716,33cyclictest352-21runrttasks12:17:361
23053998667,9cyclictest0-21swapper/212:29:492
23053998666,11cyclictest0-21swapper/208:40:112
23042998664,12cyclictest0-21swapper/107:35:421
2303399864,37cyclictest11950irq/279-mmc208:15:020
23053998565,10cyclictest0-21swapper/207:24:502
23053998519,30cyclictest352-21runrttasks12:00:182
23053998467,12cyclictest30170-21diskmemload11:14:142
23053998467,12cyclictest30170-21diskmemload11:14:142
23053998437,24cyclictest0-21swapper/211:24:512
23053998425,30cyclictest3495-21ssh11:00:072
23053998425,30cyclictest3495-21ssh11:00:072
23042998461,12cyclictest0-21swapper/108:05:151
23042998420,25cyclictest13514-21seq10:23:371
23042998418,29cyclictest23521-21seq12:26:321
23033998435,39cyclictest15879-21/usr/sbin/munin08:20:090
23053998316,28cyclictest352-21runrttasks10:45:462
23053998257,17cyclictest0-21swapper/208:30:142
23053998257,17cyclictest0-21swapper/208:30:142
23053998223,28cyclictest9103-21seq09:21:482
23053998217,26cyclictest0-21swapper/211:55:142
23053998217,26cyclictest0-21swapper/211:55:142
23042998260,12cyclictest0-21swapper/107:55:101
23042998260,12cyclictest0-21swapper/107:55:101
23042998259,13cyclictest0-21swapper/111:24:491
2305399816,55cyclictest32749-21apt-get10:55:052
23053998159,12cyclictest0-21swapper/210:40:192
23053998159,12cyclictest0-21swapper/208:20:242
23053998136,32cyclictest8920-21modprobe07:59:472
23053998136,32cyclictest8920-21modprobe07:59:472
23042998158,13cyclictest0-21swapper/107:44:511
2305999802,31cyclictest12307-21chrt11:14:583
23053998054,20cyclictest14937-21sh10:25:202
23053998019,25cyclictest0-21swapper/211:52:282
23042998064,10cyclictest29177-21latency_hist10:49:511
23042998063,9cyclictest0-21swapper/108:00:041
23042998053,19cyclictest352-21runrttasks12:10:111
23042998018,25cyclictest18825-21runrttasks10:31:431
2305999793,31cyclictest19221-21chrt08:30:063
2305999793,31cyclictest19221-21chrt08:30:063
23053997962,10cyclictest0-21swapper/207:35:502
23053997960,11cyclictest18369-21cpuspeed11:25:022
23053997960,11cyclictest18369-21cpuspeed11:25:022
23053997958,14cyclictest18474-21latency_hist12:19:512
23053997954,17cyclictest0-21swapper/208:45:092
23053997919,23cyclictest4383-21seq09:15:152
23053997919,23cyclictest4383-21seq09:15:152
23033997959,14cyclictest29280-21ssh10:49:500
2305999782,31cyclictest31094-21chrt11:45:223
23053997855,13cyclictest0-21swapper/207:44:502
23053997820,27cyclictest31348-21seq07:28:472
23053997818,22cyclictest27334-21seq12:33:532
23042997861,11cyclictest23182-21cron10:39:481
23042997859,9cyclictest0-21swapper/108:55:031
23042997859,12cyclictest0-21swapper/111:50:231
23042997855,14cyclictest31786-21apt-config07:29:511
23042997850,20cyclictest0-21swapper/112:30:081
23042997827,44cyclictest0-21swapper/112:19:581
23042997827,44cyclictest0-21swapper/112:19:581
2304299782,56cyclictest313-21ssh10:55:031
23042997821,27cyclictest7794-21seq09:20:471
23042997819,20cyclictest19117-21seq09:39:391
23042997819,20cyclictest19117-21seq09:39:391
23042997818,24cyclictest5485-21seq11:56:581
23042997818,24cyclictest5485-21seq11:56:581
23042997818,20cyclictest32088-21seq09:06:481
23033997856,16cyclictest21577-21timerwakeupswit10:35:470
23033997850,22cyclictest7785-21fschecks_count07:55:100
23033997850,22cyclictest7785-21fschecks_count07:55:100
23053997718,28cyclictest11667-21seq09:25:372
23042997757,14cyclictest22173-21timerandwakeup11:30:231
23042997752,16cyclictest352-21runrttasks11:24:561
23042997752,16cyclictest352-21runrttasks11:24:561
2305999762,37cyclictest7572-21taskset10:13:473
23053997662,8cyclictest0-21swapper/209:05:112
23053997652,13cyclictest0-21swapper/210:20:112
23053997652,12cyclictest0-21swapper/208:55:082
23053997630,32cyclictest12405-21apt-get08:09:592
23053997618,27cyclictest352-21runrttasks10:03:352
23042997620,25cyclictest29527-21ssh10:50:031
23033997659,12cyclictest23021-21cyclictest09:30:200
23033997655,14cyclictest30468-21ssh09:04:570
2303399764,39cyclictest7323-21sendmail07:54:480
2303399763,65cyclictest3755-21kworker/u19:1+ext4-rsv-conversion09:40:530
2303399763,65cyclictest3755-21kworker/u19:1+ext4-rsv-conversion09:40:530
2305999752,31cyclictest29854-21taskset11:44:333
2305999752,31cyclictest29854-21taskset11:44:333
23042997555,13cyclictest0-21swapper/107:45:151
23042997515,25cyclictest19959-21seq09:40:371
23042997515,25cyclictest19959-21seq09:40:371
23033997550,17cyclictest12644-21latency_hist12:09:500
23033997545,21cyclictest31436-21modprobe07:29:480
23053997453,10cyclictest0-21swapper/210:34:522
23042997453,14cyclictest23021-21cyclictest10:28:371
23042997418,24cyclictest27301-21seq09:51:481
23042997417,20cyclictest2292-21seq09:10:541
2303399744,36cyclictest1554-21cut11:50:220
2305999734,32cyclictest17890-21chrt11:24:353
2305999732,28cyclictest17625-21taskset08:25:033
23053997361,6cyclictest0-21swapper/212:09:562
23053997358,8cyclictest0-21swapper/209:45:192
23053997354,9cyclictest0-21swapper/208:35:212
23053997354,9cyclictest0-21swapper/208:35:212
23053997354,10cyclictest0-21swapper/210:05:202
23053997354,10cyclictest0-21swapper/210:05:202
23053997317,24cyclictest21457-21apt-get12:24:462
23053997317,24cyclictest21457-21apt-get12:24:462
23053997317,22cyclictest14235-21seq11:17:432
23042997357,10cyclictest17925-21kworker/u19:2-rpciod09:55:141
23042997356,8cyclictest0-21swapper/112:05:111
23042997351,12cyclictest0-21swapper/108:10:141
23042997350,15cyclictest200-21systemd-journal11:13:411
23042997350,15cyclictest200-21systemd-journal11:13:411
23042997348,13cyclictest0-21swapper/108:50:091
2304299733,37cyclictest3371-21cpu11:00:031
2304299733,37cyclictest3371-21cpu11:00:031
23033997357,10cyclictest30401-21ssh09:57:000
23033997350,15cyclictest32397-21processes10:00:200
2303399734,37cyclictest11393-21timerandwakeup09:25:240
2305999723,30cyclictest17921-21chrt12:18:163
23053997252,13cyclictest23021-21cyclictest11:41:502
23053997252,13cyclictest23021-21cyclictest11:41:502
23053997252,10cyclictest0-21swapper/210:10:092
23053997250,12cyclictest0-21swapper/210:15:102
23053997250,12cyclictest0-21swapper/210:15:102
23053997234,19cyclictest373-21lldpd11:33:542
23042997253,9cyclictest0-21swapper/111:35:221
23042997218,19cyclictest24770-21seq10:40:511
23053997150,13cyclictest0-21swapper/207:44:592
23042997150,11cyclictest0-21swapper/110:15:141
23042997150,11cyclictest0-21swapper/110:15:141
23042997148,17cyclictest15715-21sh09:33:361
23033997151,13cyclictest5238-21/usr/sbin/munin10:10:160
23033997139,8cyclictest181rcu_preempt08:24:570
2303399713,35cyclictest4327-21/usr/sbin/munin07:45:070
2305999703,29cyclictest17517-21chrt10:30:083
23053997050,10cyclictest0-21swapper/211:45:082
23053997050,10cyclictest0-21swapper/209:50:122
23053997046,13cyclictest0-21swapper/209:44:512
23053997046,13cyclictest0-21swapper/209:44:512
23042997053,10cyclictest0-21swapper/108:35:241
23042997053,10cyclictest0-21swapper/108:35:241
23042997051,8cyclictest0-21swapper/109:25:251
23042997050,14cyclictest297-21systemd-logind08:24:481
23042997047,13cyclictest0-21swapper/108:44:491
23042997023,11cyclictest181rcu_preempt11:45:081
23042997020,21cyclictest8553-21ssh12:02:121
23033997047,16cyclictest16123-21cut12:15:110
23033997044,18cyclictest25464-21latency_hist08:49:500
23033997040,22cyclictest2634-21if_eth010:05:100
23033997040,22cyclictest2634-21if_eth010:05:100
2303399703,32cyclictest25423-21fschecks_count07:10:110
2305999696,51cyclictest480-21taskset10:55:293
2305999693,29cyclictest10792-21taskset11:11:343
2305999693,29cyclictest10792-21taskset11:11:343
23059996913,18cyclictest0-21swapper/310:43:483
23053996954,10cyclictest352-21runrttasks07:10:152
2305399694,45cyclictest23476-21fschecks_time07:05:102
2305399694,45cyclictest23476-21fschecks_time07:05:102
23053996920,35cyclictest30049-21sh10:50:172
23042996954,9cyclictest0-21swapper/107:50:201
23042996929,35cyclictest0-21swapper/107:10:011
23042996921,37cyclictest23570-21switchtime09:45:221
23053996849,13cyclictest0-21swapper/209:04:502
23053996814,24cyclictest870-21sendmail07:34:482
23042996824,34cyclictest24726-21cat08:45:231
23042996813,21cyclictest352-21runrttasks10:14:211
23042996813,21cyclictest28798-21runrttasks11:41:341
23042996813,21cyclictest28798-21runrttasks11:41:341
23053996747,9cyclictest0-21swapper/207:15:152
23053996727,35cyclictest0-21swapper/208:24:572
23053996724,33cyclictest0-21swapper/208:05:222
23042996752,9cyclictest0-21swapper/111:09:471
23042996724,34cyclictest0-21swapper/108:30:041
23042996724,34cyclictest0-21swapper/108:30:041
2303399673,46cyclictest10093-21unixbench_multi08:00:230
219052678,41sleep021938-21kernelversion07:00:180
219052678,41sleep021938-21kernelversion07:00:180
2305399664,51cyclictest9832-21ssh12:05:032
2305399664,40cyclictest3890-21apt-config09:14:502
23053996640,20cyclictest26930-21kworker/u19:108:54:472
23053996622,29cyclictest0-21swapper/209:30:152
23042996648,9cyclictest0-21swapper/110:05:181
23042996648,9cyclictest0-21swapper/110:05:181
23042996647,13cyclictest24601-21latency_hist07:09:491
23042996647,13cyclictest24601-21latency_hist07:09:491
23042996614,29cyclictest12705-21irqstats11:15:121
23053996527,27cyclictest14337-21apt-get08:15:342
23053996449,8cyclictest0-21swapper/211:06:472
23053996435,20cyclictest9460-21fschecks_time08:00:102
23042996444,12cyclictest0-21swapper/107:15:231
23042996342,15cyclictest0-21swapper/107:04:521
23042996342,15cyclictest0-21swapper/107:04:521
2303399632,45cyclictest11743-21unixbench_singl08:05:230
2305999627,43cyclictest22053-21chrt12:25:053
2305999623,34cyclictest917-21kworker/3:1+events08:55:093
23042996247,8cyclictest0-21swapper/107:20:201
23042996245,8cyclictest0-21swapper/107:30:581
23042996033,19cyclictest30150-21modprobe09:04:471
2305999586,39cyclictest0-21swapper/309:40:203
2305999586,39cyclictest0-21swapper/309:40:203
2305999583,41cyclictest11603-21taskset10:20:123
2305999573,40cyclictest9493-21taskset12:04:463
2305999573,39cyclictest4728-21chrt07:45:143
2305999573,38cyclictest26423-21chrt08:50:233
2305999567,19cyclictest0-21swapper/309:20:203
2305999567,17cyclictest0-21swapper/309:15:173
2305999567,17cyclictest0-21swapper/309:15:173
2305999563,39cyclictest11176-21chrt10:19:513
2305999563,39cyclictest11176-21chrt10:19:513
2305999563,38cyclictest3373-21chrt11:00:033
2305999563,38cyclictest3373-21chrt11:00:033
2305999563,38cyclictest26579-21chrt09:50:253
2305999563,36cyclictest6923-21taskset07:50:253
2305999563,36cyclictest15995-21taskset08:20:053
2305999563,35cyclictest29138-21taskset09:00:113
2305999553,39cyclictest13210-21taskset08:10:213
2305999544,37cyclictest31559-21chrt10:53:063
2305999543,38cyclictest13443-21chrt12:10:183
2305999543,36cyclictest15667-21chrt09:33:263
2305999542,37cyclictest903-21chrt11:50:043
2305999533,35cyclictest23320-21taskset11:33:023
2305999533,34cyclictest3100-21chrt09:13:073
2305999533,30cyclictest9289-21chrt08:00:053
2169825313,24sleep30-21swapper/307:00:093
2169825313,24sleep30-21swapper/307:00:093
2305999523,36cyclictest11959-21chrt12:08:233
2305999523,36cyclictest11364-21chrt09:25:243
2305999523,35cyclictest1755-21chrt07:35:473
2305999523,33cyclictest25145-21chrt12:30:043
2305999523,33cyclictest19764-21taskset11:26:253
2305999523,33cyclictest19764-21taskset11:26:253
2305999523,32cyclictest24584-21taskset08:45:203
2305999522,38cyclictest28416-21chrt07:19:513
2305999522,35cyclictest4898-21chrt10:09:423
2305999522,35cyclictest4898-21chrt10:09:423
2305999522,34cyclictest22667-21chrt09:44:533
23059995211,34cyclictest0-21swapper/308:15:023
2305999513,35cyclictest21843-21chrt10:36:043
2305999512,36cyclictest22462-21chrt08:40:063
2305999512,35cyclictest7101-21chrt11:05:223
2305999512,35cyclictest25616-21chrt07:10:153
2305999503,35cyclictest30713-21chrt09:05:093
2305999503,35cyclictest1570-21chrt10:03:463
2305999503,31cyclictest24748-21chrt07:09:513
2305999503,31cyclictest24748-21chrt07:09:513
2305999502,37cyclictest30369-21chrt09:56:543
2305999502,35cyclictest915-21taskset07:34:503
2305999502,33cyclictest2814-21chrt07:40:043
2305999502,32cyclictest24583-21chrt11:35:083
2305999492,33cyclictest17119-21chrt09:35:173
2305999492,33cyclictest17119-21chrt09:35:173
2305999483,33cyclictest30176-21chrt07:25:053
2305999482,34cyclictest28819-21chrt07:20:113
2305999474,28cyclictest22186-21chrt08:39:503
2305999474,28cyclictest22186-21chrt08:39:503
2305999473,33cyclictest18815-21chrt12:20:023
2305999473,33cyclictest18815-21chrt12:20:023
2305999473,33cyclictest15472-21chrt10:25:433
2305999472,31cyclictest29281-21chrt10:49:503
2305999453,33cyclictest11304-21taskset08:05:153
2305999443,28cyclictest4758-21chrt11:55:233
2305999443,28cyclictest4758-21chrt11:55:233
2305999442,31cyclictest7580-21chrt07:54:583
2305999442,31cyclictest7580-21chrt07:54:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional