You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 01:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Wed Dec 31, 2025 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
234629912646,59cyclictest23454-21cyclictest12:02:580
234629912646,59cyclictest23454-21cyclictest12:02:580
234629911939,50cyclictest20138-21ssh09:44:490
2198421186,17sleep10-21swapper/107:04:301
2198421186,17sleep10-21swapper/107:04:301
234629911443,64cyclictest0-21swapper/010:54:420
234629911426,51cyclictest0-21swapper/009:34:470
234629911426,51cyclictest0-21swapper/009:34:470
23462991123,66cyclictest17198-21apt-get10:34:450
23462991123,66cyclictest17198-21apt-get10:34:450
23467991107,73cyclictest17747-21apt-get10:34:481
23467991107,73cyclictest17747-21apt-get10:34:481
23471991073,63cyclictest346-21runrttasks10:49:472
23462991063,61cyclictest28918-21ls12:39:260
23462991053,93cyclictest0-21swapper/007:44:320
23462991053,92cyclictest0-21swapper/012:14:350
3194921040,8sleep20-21swapper/210:57:442
23462991032,63cyclictest4357-21ssh10:12:250
23462991022,63cyclictest1353-21seq10:07:290
23462991014,90cyclictest0-21swapper/012:04:380
23462991013,57cyclictest26713-21seq11:41:390
23462991013,57cyclictest26713-21seq11:41:390
23462991012,60cyclictest11649-21ssh11:17:010
23462999944,49cyclictest26221-21latency08:54:510
2346299993,59cyclictest21841-21seq12:27:090
2346299993,59cyclictest21841-21seq12:27:090
23471999869,18cyclictest0-21swapper/208:49:262
2347199984,57cyclictest346-21runrttasks07:27:152
2346799983,68cyclictest32565-21apt-get10:59:371
2346299983,83cyclictest15890-21apt-get08:24:400
2346299982,58cyclictest31948-21ssh09:10:180
2346299973,84cyclictest24196-21apt-get08:49:370
2346299973,64cyclictest346-21runrttasks08:43:270
2346299972,80cyclictest0-21swapper/012:10:010
2346299972,59cyclictest10558-21ssh09:29:410
2346299972,57cyclictest7234-21seq07:55:540
23471999622,40cyclictest22773-21sh10:42:282
23462999680,9cyclictest17359-21apt-config10:34:260
2346299963,63cyclictest25424-21idleruntime-cro09:54:230
2346299963,63cyclictest25424-21idleruntime-cro09:54:230
2346299963,54cyclictest346-21runrttasks11:00:500
2346299962,56cyclictest25926-21df09:54:430
2347199953,79cyclictest0-21swapper/208:24:402
23471999528,30cyclictest0-21swapper/212:29:582
2346299955,85cyclictest0-21swapper/007:09:270
2346299955,85cyclictest0-21swapper/007:09:270
2346299953,82cyclictest4566-21apt-get07:49:390
23462999537,52cyclictest0-21swapper/010:44:580
23462999537,52cyclictest0-21swapper/010:44:580
2346299953,53cyclictest363-21snmpd11:19:560
2346299952,63cyclictest17326-21seq11:25:550
2347199943,45cyclictest12476-21latency_hist08:14:262
2346299948,51cyclictest0-21swapper/010:53:530
23462999447,41cyclictest358-21ntpd09:24:550
2346299943,83cyclictest0-21swapper/008:34:360
2346299943,57cyclictest0-21swapper/008:14:330
2346299942,61cyclictest4223-21cut09:19:260
23467999367,16cyclictest7813-21kworker/u19:0+events_unbound12:14:221
2346299934,52cyclictest0-21swapper/011:33:530
2346299934,52cyclictest0-21swapper/011:33:530
2346299934,51cyclictest19808-21cat12:24:260
23462999337,48cyclictest0-21swapper/008:31:040
2346299933,73cyclictest30560-21apt-get07:29:410
23462999322,52cyclictest346-21runrttasks08:08:250
2347199923,52cyclictest13769-21seq08:16:432
2346299923,72cyclictest0-21swapper/011:48:280
2346299922,85cyclictest0-21swapper/011:04:380
2346299922,61cyclictest9365-21seq11:14:070
2346299922,58cyclictest346-21runrttasks08:03:560
2347199912,59cyclictest26883-21seq07:17:232
23467999168,14cyclictest27053-21sh07:19:231
2346299913,66cyclictest5591-21diskstats10:14:430
2346299913,54cyclictest0-21swapper/011:56:180
2346299913,54cyclictest0-21swapper/010:00:020
2346299912,60cyclictest9754-21seq10:20:340
2346299912,60cyclictest24552-21seq11:39:080
2346299912,51cyclictest0-21swapper/010:40:190
23467999025,31cyclictest31-21ksoftirqd/108:52:021
23462999075,8cyclictest0-21swapper/011:50:000
2346299903,77cyclictest5961-21ssh09:21:160
2346299903,76cyclictest0-21swapper/009:39:390
2346299903,54cyclictest987-21seq07:38:410
23462999033,50cyclictest0-21swapper/007:09:590
23462999033,50cyclictest0-21swapper/007:09:590
23471998926,31cyclictest0-21swapper/210:02:072
2346299895,47cyclictest0-21swapper/012:29:510
2346299894,50cyclictest0-21swapper/007:15:040
2346299893,79cyclictest0-21swapper/007:24:400
2346299892,53cyclictest30338-21seq09:08:500
2346299892,53cyclictest30338-21seq09:08:500
2347199882,51cyclictest30285-21seq09:08:092
2347199882,51cyclictest30285-21seq09:08:092
2346299886,45cyclictest0-21swapper/008:45:500
2346299883,51cyclictest2481-21runrttasks07:41:490
2346299882,61cyclictest346-21runrttasks07:19:510
2346299882,50cyclictest11909-21sed08:09:580
23471998768,9cyclictest0-21swapper/210:29:252
23467998723,33cyclictest31-21ksoftirqd/108:38:581
2346299873,79cyclictest0-21swapper/010:24:350
23471998670,7cyclictest0-21swapper/209:49:252
23471998638,39cyclictest0-21swapper/212:19:592
2347199863,48cyclictest7467-21seq07:58:582
2346799864,54cyclictest31-21ksoftirqd/108:54:491
2346299862,51cyclictest15494-21seq08:22:550
23462998622,38cyclictest0-21swapper/009:00:140
23471998532,30cyclictest0-21swapper/212:18:002
2347199852,54cyclictest3375-21ssh11:04:172
2347199852,51cyclictest6833-21seq10:15:562
23467998541,13cyclictest4949-21diskstats11:59:421
23467998541,13cyclictest4949-21diskstats11:59:421
225602859,47sleep222575-21open_inodes07:05:042
225602859,47sleep222575-21open_inodes07:05:042
23471998464,11cyclictest0-21swapper/208:59:462
2347199843,71cyclictest0-21swapper/208:34:362
23471998436,40cyclictest0-21swapper/209:19:572
2346799846,41cyclictest31-21ksoftirqd/110:45:171
2346799846,41cyclictest31-21ksoftirqd/110:45:171
23467998461,9cyclictest181rcu_preempt09:04:571
23467998461,9cyclictest181rcu_preempt09:04:571
23467998459,15cyclictest26536-21kworker/u17:0-xprtiod10:15:051
23467998426,25cyclictest31-21ksoftirqd/107:21:161
23471998363,14cyclictest23454-21cyclictest08:05:002
23471998353,21cyclictest392-21cron09:19:232
23471998337,31cyclictest29116-21head11:45:002
2347199832,48cyclictest0-21swapper/210:04:352
23471998319,35cyclictest19350-21sh10:36:232
23471998319,35cyclictest19350-21sh10:36:232
2346799835,44cyclictest31-21ksoftirqd/109:47:561
23471998242,35cyclictest23454-21cyclictest10:47:502
23471998242,35cyclictest23454-21cyclictest10:47:502
23471998239,36cyclictest0-21swapper/211:20:032
2347199823,72cyclictest10531-21ssh09:29:402
2347199823,49cyclictest346-21runrttasks08:21:372
2347199823,42cyclictest346-21runrttasks07:38:572
2347199822,51cyclictest346-21runrttasks10:10:512
23471998218,35cyclictest2936-21sh11:55:232
2346799828,42cyclictest31-21ksoftirqd/111:17:241
23467998247,17cyclictest181rcu_preempt07:51:461
23467998227,29cyclictest31-21ksoftirqd/111:58:531
2347199814,66cyclictest0-21swapper/207:44:322
2347199813,73cyclictest0-21swapper/211:34:352
23471998123,37cyclictest8977-21diskmemload12:05:162
23467998164,11cyclictest201-21systemd-journal09:29:451
23467998164,10cyclictest30143-21fschecks_count10:54:481
23467998124,24cyclictest31-21ksoftirqd/108:04:041
23471998066,8cyclictest0-21swapper/207:29:592
23471998061,9cyclictest0-21swapper/208:44:262
23471998038,36cyclictest0-21swapper/210:34:262
23471998037,36cyclictest0-21swapper/207:19:582
23471998029,30cyclictest0-21swapper/209:55:472
2347199802,44cyclictest346-21runrttasks08:51:412
2347199802,43cyclictest346-21runrttasks08:02:302
23467998027,23cyclictest31-21ksoftirqd/109:01:331
23467998023,23cyclictest31-21ksoftirqd/111:41:351
23467998023,23cyclictest31-21ksoftirqd/111:41:351
23471997965,8cyclictest0-21swapper/208:30:492
23471997965,8cyclictest0-21swapper/207:09:502
23471997965,8cyclictest0-21swapper/207:09:502
23471997958,11cyclictest0-21swapper/209:34:482
23471997958,11cyclictest0-21swapper/209:34:482
2347199793,45cyclictest19485-21ntp_kernel_err11:29:532
2347199793,45cyclictest19485-21ntp_kernel_err11:29:532
23467997964,11cyclictest23454-21cyclictest10:19:561
23467997944,11cyclictest181rcu_preempt11:19:521
23467997934,8cyclictest0-21swapper/110:09:251
23467997923,17cyclictest0-21swapper/107:57:521
2278227930,34sleep30-21swapper/307:05:093
2278227930,34sleep30-21swapper/307:05:093
23471997837,35cyclictest0-21swapper/211:59:562
23471997837,35cyclictest0-21swapper/211:59:562
2347199783,70cyclictest0-21swapper/210:19:342
2347199783,63cyclictest0-21swapper/207:49:392
23471997836,35cyclictest0-21swapper/211:24:592
2346799788,45cyclictest31-21ksoftirqd/112:23:371
23467997853,9cyclictest181rcu_preempt09:19:401
23467997853,10cyclictest181rcu_preempt09:10:331
23467997852,9cyclictest181rcu_preempt11:24:581
23467997834,8cyclictest181rcu_preempt10:28:151
2346799783,41cyclictest31-21ksoftirqd/108:28:541
23467997815,33cyclictest31-21ksoftirqd/108:11:491
23471997735,35cyclictest0-21swapper/211:10:022
23471997733,38cyclictest0-21swapper/209:51:322
23471997733,38cyclictest0-21swapper/209:51:322
23467997754,8cyclictest181rcu_preempt10:39:491
23467997714,29cyclictest31-21ksoftirqd/111:50:301
2347699763,39cyclictest0-21swapper/310:35:133
2347699763,39cyclictest0-21swapper/310:35:133
23471997660,9cyclictest0-21swapper/211:40:002
23471997660,9cyclictest0-21swapper/211:40:002
2347199763,67cyclictest0-21swapper/211:14:352
2347199763,39cyclictest0-21swapper/209:12:122
2347199762,68cyclictest0-21swapper/211:04:382
2347199762,63cyclictest0-21swapper/207:39:352
2347199762,50cyclictest18868-21seq09:43:102
2346799766,43cyclictest31-21ksoftirqd/109:50:391
2346799766,43cyclictest31-21ksoftirqd/109:50:391
23467997656,14cyclictest9485-21cpuspeed08:04:411
23467997654,9cyclictest181rcu_preempt09:59:321
2346799763,44cyclictest346-21runrttasks12:05:301
23467997613,47cyclictest14631-21/usr/sbin/munin09:35:011
23467997613,47cyclictest14631-21/usr/sbin/munin09:35:011
23471997519,50cyclictest381ktimers/212:34:412
2346799758,33cyclictest31-21ksoftirqd/110:50:361
23467997552,9cyclictest181rcu_preempt09:54:481
23467997552,16cyclictest171-21jbd2/mmcblk2p2-811:30:511
23467997552,16cyclictest171-21jbd2/mmcblk2p2-811:30:511
2346799753,39cyclictest31-21ksoftirqd/109:25:471
23467997530,31cyclictest13408-21wc08:14:591
23476997417,33cyclictest0-21swapper/311:00:513
2347199743,41cyclictest346-21runrttasks11:50:142
2346799745,39cyclictest31-21ksoftirqd/107:10:391
2346799745,39cyclictest31-21ksoftirqd/107:10:391
23467997453,15cyclictest3212-21switchtime10:10:001
23467997451,8cyclictest181rcu_preempt07:44:261
2346799742,42cyclictest31-21ksoftirqd/108:32:301
23467997422,24cyclictest31-21ksoftirqd/107:47:151
2346799737,37cyclictest31-21ksoftirqd/111:48:191
2346799737,36cyclictest31-21ksoftirqd/110:29:521
23467997356,10cyclictest171-21jbd2/mmcblk2p2-808:39:571
2346799734,41cyclictest31-21ksoftirqd/112:15:591
23467997340,10cyclictest181rcu_preempt12:27:111
23467997340,10cyclictest181rcu_preempt12:27:111
23467997334,22cyclictest16895-21sshd09:39:461
2346799732,39cyclictest31-21ksoftirqd/109:15:341
190227316,10sleep30-21swapper/309:14:533
23471997234,32cyclictest0-21swapper/209:24:552
23467997223,21cyclictest0-21swapper/107:29:461
23467997216,31cyclictest31-21ksoftirqd/112:39:051
23471997131,32cyclictest0-21swapper/212:25:012
23471997131,32cyclictest0-21swapper/212:25:012
23471997128,34cyclictest0-21swapper/212:11:112
23471997116,44cyclictest26956-21seq08:57:042
23467997135,8cyclictest181rcu_preempt08:49:131
23467997134,8cyclictest181rcu_preempt11:04:431
23467997125,16cyclictest0-21swapper/112:29:531
23467997122,22cyclictest31-21ksoftirqd/107:38:121
23467997044,8cyclictest181rcu_preempt11:38:041
2346799702,51cyclictest15184-21tail08:19:581
2346799702,42cyclictest31-21ksoftirqd/107:26:411
23467996948,7cyclictest181rcu_preempt11:12:241
2347699664,40cyclictest906-21kworker/3:1+events11:49:543
23476996316,28cyclictest0-21swapper/308:30:113
2347699623,37cyclictest906-21kworker/3:1+events11:29:443
2347699623,37cyclictest906-21kworker/3:1+events11:29:443
2347699623,37cyclictest906-21kworker/3:1+events08:49:393
2347699606,41cyclictest1198-21taskset10:07:033
2347699595,35cyclictest2178-21chrt07:39:573
2347699594,38cyclictest906-21kworker/3:1+events09:33:133
2347699594,37cyclictest8122-21taskset10:19:233
2347699593,41cyclictest29915-21taskset11:47:053
188392590,5sleep30-21swapper/311:29:263
2347699574,36cyclictest906-21kworker/3:1+events08:34:573
2347699572,41cyclictest13846-21chrt12:14:363
2347699564,36cyclictest23193-21chrt09:49:493
2347699564,36cyclictest23193-21chrt09:49:493
2347699564,36cyclictest14079-21chrt08:19:253
2347699563,37cyclictest5109-21chrt11:59:453
2347699563,37cyclictest5109-21chrt11:59:453
2347699562,40cyclictest21451-21taskset08:39:503
2347699562,36cyclictest4739-21taskset09:19:473
2347699562,36cyclictest23482-21taskset08:45:003
2347699553,43cyclictest24714-21taskset11:39:233
2347699552,38cyclictest6295-21chrt07:54:393
2347699544,33cyclictest30454-21taskset09:09:253
2347699544,33cyclictest30454-21taskset09:09:253
2347699543,39cyclictest21639-21chrt10:39:583
2347699543,37cyclictest8183-21chrt12:04:483
2347699543,36cyclictest11283-21chrt10:24:253
2347699543,35cyclictest4673-21chrt07:49:413
2347699543,35cyclictest10859-21chrt08:09:253
2347699543,34cyclictest13104-21chrt11:19:463
2347699542,40cyclictest17104-21taskset10:34:103
2347699542,38cyclictest12046-21taskset12:10:233
2347699542,34cyclictest13821-21chrt09:34:463
2347699542,34cyclictest13821-21chrt09:34:463
2347699542,31cyclictest906-21kworker/3:1+events11:39:363
2347699542,31cyclictest906-21kworker/3:1+events11:39:363
23476995414,27cyclictest4562-21chrt11:04:583
2347699535,34cyclictest20577-21chrt09:44:593
2347699534,34cyclictest32383-21taskset09:11:283
2347699533,38cyclictest26401-21chrt07:14:593
2347699533,37cyclictest17693-21taskset09:40:013
2347699533,36cyclictest32741-21taskset07:34:553
2347699533,34cyclictest30897-21chrt07:29:493
2347699532,37cyclictest11296-21chrt11:16:053
2347699532,36cyclictest3175-21taskset10:09:593
2347699532,35cyclictest11532-21taskset08:09:503
2347699532,34cyclictest8053-21chrt07:59:463
2347699523,36cyclictest26023-21chrt09:54:473
2347699522,39cyclictest19918-21taskset12:24:333
2347699522,39cyclictest19918-21taskset12:24:333
2347699513,35cyclictest1881-21chrt11:54:433
2347699513,35cyclictest17359-21chrt08:29:253
2347699513,33cyclictest27770-21chrt10:49:593
2347699513,32cyclictest27602-21chrt07:19:453
2347699512,39cyclictest27108-21taskset12:35:033
2347699512,35cyclictest32588-21taskset10:59:233
2347699512,33cyclictest26571-21taskset08:55:003
2347699505,31cyclictest7528-21chrt09:24:413
2347699503,35cyclictest17019-21taskset12:19:393
2347699503,33cyclictest23066-21chrt12:29:403
2347699502,34cyclictest27868-21chrt08:59:503
2347699493,34cyclictest25741-21chrt10:47:193
2347699493,34cyclictest25741-21chrt10:47:193
23476994925,14cyclictest451rcuc/307:44:323
2347699492,34cyclictest9682-21chrt11:14:273
2347699492,33cyclictest15639-21chrt08:24:233
2347699492,33cyclictest13599-21chrt10:27:543
2347699472,32cyclictest29294-21chrt09:59:503
2347699406,26cyclictest23757-21taskset07:09:403
2347699406,26cyclictest23757-21taskset07:09:403
2347699373,25cyclictest29101-21chrt07:24:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional