You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 01:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Mar 30, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22113991233,90cyclictest4842-21apt-get10:09:261
22113991213,91cyclictest15616-21ssh12:14:351
22113991213,91cyclictest15616-21ssh12:14:351
22113991114,72cyclictest18754-21apt-get12:19:291
221059911152,12cyclictest11188-21kworker/u17:3+xprtiod12:08:000
22120991064,42cyclictest21973-21apt-get12:24:262
22113991066,87cyclictest9871-21kworker/u19:0+flush-179:009:24:331
2168321047,16sleep20-21swapper/207:00:402
2168321047,16sleep20-21swapper/207:00:402
22113991033,90cyclictest2041-21apt-get07:39:271
2614421000,7sleep30-21swapper/310:44:353
2614421000,7sleep30-21swapper/310:44:353
221209910037,9cyclictest0-21swapper/211:29:312
221209910037,9cyclictest0-21swapper/211:29:312
22113991004,66cyclictest3324-21apt-get11:54:261
22120999934,11cyclictest0-21swapper/208:19:442
22120999731,12cyclictest0-21swapper/210:39:442
22120999629,12cyclictest0-21swapper/210:13:512
22120999528,12cyclictest0-21swapper/212:20:152
22113999512,73cyclictest19079-21apt-get09:39:271
22113999512,73cyclictest19079-21apt-get09:39:271
22120999436,8cyclictest0-21swapper/207:54:152
22120999431,11cyclictest0-21swapper/209:29:302
22120999343,41cyclictest0-21swapper/210:19:402
22120999335,50cyclictest0-21swapper/208:54:432
2212099932,33cyclictest9098-21latency_hist12:04:142
22120999235,8cyclictest0-21swapper/208:54:152
2212099923,36cyclictest907-21idleruntime09:09:352
2212099923,35cyclictest6964-21irqstats09:19:372
22120999232,12cyclictest0-21swapper/208:09:342
22120999226,12cyclictest0-21swapper/209:37:002
2212099922,35cyclictest1641-21apt-key07:39:132
2212099922,35cyclictest1641-21apt-key07:39:132
2211399928,74cyclictest31018-21apt-get07:29:271
2211399928,64cyclictest5497-21apt-get07:49:301
22120999171,14cyclictest18599-21latency_hist12:19:152
22120999171,14cyclictest18599-21latency_hist12:19:152
2212099913,38cyclictest20056-21forks10:34:322
2212099913,32cyclictest13188-21ssh12:09:472
22120999126,10cyclictest0-21swapper/210:29:452
2212099912,32cyclictest658-21grep11:50:332
2212099912,31cyclictest24833-21latency_hist09:49:132
2211399913,66cyclictest21432-21apt-get12:24:261
22120999037,13cyclictest25686-21sh09:49:432
22120999035,8cyclictest0-21swapper/212:29:382
2212099903,33cyclictest3229-21cat10:59:462
2212099903,29cyclictest18611-21grep08:29:332
22120999025,11cyclictest0-21swapper/211:59:142
2212099893,34cyclictest24888-21latency_hist08:49:132
2212099893,34cyclictest24888-21latency_hist08:49:132
2212099893,31cyclictest2678-21grep10:04:492
2212099893,31cyclictest11387-21ssh11:14:232
2212099893,31cyclictest11387-21ssh11:14:232
2212099893,31cyclictest10811-21grep09:25:082
2212099892,32cyclictest25222-21grep07:09:502
22113998959,19cyclictest14976-21latency_hist08:19:141
2212099884,33cyclictest352-21runrttasks10:15:482
2212099883,34cyclictest10039-21mailstats12:04:462
2212099883,33cyclictest29564-21latency07:24:372
2212099883,32cyclictest23106-21timerwakeupswit07:04:472
2212099883,29cyclictest3901-21fschecks_time07:44:342
2212099883,29cyclictest3901-21fschecks_time07:44:342
22120998827,10cyclictest0-21swapper/208:59:462
2212099882,35cyclictest4184-21ntp_offset09:14:412
2212099882,35cyclictest4184-21ntp_offset09:14:412
2212099882,34cyclictest11760-21latency_hist08:09:132
2212099882,34cyclictest11760-21latency_hist08:09:132
2212099882,33cyclictest31245-21sh11:47:092
2212099882,33cyclictest26685-21switchtime07:14:472
2212099882,31cyclictest28371-21fschecks_time09:54:332
2212099874,33cyclictest17605-21timerandwakeup08:24:482
2212099873,34cyclictest8100-21cat11:09:142
22120998727,10cyclictest0-21swapper/210:24:362
22120998724,12cyclictest0-21swapper/207:40:412
2212099872,36cyclictest9320-21ps07:59:442
2211399872,54cyclictest31986-21apt-get11:49:281
2121328712,45sleep121260-21find06:59:541
2121328712,45sleep121260-21find06:59:541
2212099864,32cyclictest20307-21fschecks_time08:34:332
2212099863,38cyclictest352-21runrttasks08:42:562
2212099863,38cyclictest352-21runrttasks08:42:562
2212099863,36cyclictest352-21runrttasks07:20:112
2212099863,36cyclictest352-21runrttasks07:20:112
2212099863,35cyclictest32596-21latency_hist07:34:152
2212099863,35cyclictest19980-21netstat09:40:392
2212099863,35cyclictest19980-21netstat09:40:392
2212099863,35cyclictest14341-21/usr/sbin/munin11:19:452
2212099863,34cyclictest331-21latency_hist09:09:142
2212099863,32cyclictest26066-21latency_hist11:39:132
2212099862,33cyclictest26435-21ssh10:44:412
2212099862,33cyclictest26435-21ssh10:44:412
2212099862,32cyclictest7405-21fschecks_time07:54:342
2211399863,42cyclictest21928-21modprobe08:39:511
2211399863,42cyclictest21928-21modprobe08:39:511
22124998511,49cyclictest15617-21chrt12:14:353
22124998511,49cyclictest15617-21chrt12:14:353
2212099853,31cyclictest17318-21/usr/sbin/munin11:24:342
2212099853,31cyclictest13782-21fschecks_count08:14:342
22113998566,12cyclictest29311-21/usr/sbin/munin11:44:511
22105998564,14cyclictest22093-21cyclictest10:58:040
2210599853,62cyclictest14963-21apt-get12:14:280
2210599853,62cyclictest14963-21apt-get12:14:280
22105998512,55cyclictest4253-21/usr/sbin/munin11:55:450
2212099844,35cyclictest8577-21ssh11:09:352
2212099843,35cyclictest29552-21awk10:49:452
2212099843,32cyclictest352-21runrttasks09:59:412
22105998460,15cyclictest29707-21diskmemload10:32:320
2212099823,33cyclictest32212-21cat10:54:342
22105998259,15cyclictest29707-21diskmemload11:29:490
22105998259,15cyclictest29707-21diskmemload11:29:490
22105998249,13cyclictest22093-21cyclictest09:56:370
208972829,49sleep020931-21idleruntime06:59:400
208972829,49sleep020931-21idleruntime06:59:400
2212099814,29cyclictest26323-21/usr/sbin/munin11:39:312
2212499803,42cyclictest0-21swapper/312:24:283
22113998052,19cyclictest5023-21sh07:49:131
22113998052,19cyclictest5023-21sh07:49:131
2210599804,54cyclictest22038-21ssh12:24:320
22124997915,39cyclictest0-21swapper/309:24:333
22113997965,10cyclictest22093-21cyclictest09:09:451
22113997959,15cyclictest22093-21cyclictest11:34:481
22113997954,15cyclictest16789-21/usr/sbin/munin08:24:291
22105997955,16cyclictest29794-21latency_hist09:04:140
22105997856,15cyclictest22093-21cyclictest09:26:120
22105997849,9cyclictest181rcu_preempt11:59:280
22113997758,13cyclictest22093-21cyclictest09:04:181
22113997751,17cyclictest0-21swapper/111:27:431
22105997757,14cyclictest26008-21idleruntime-cro11:39:110
22105997757,12cyclictest277-21dbus-daemon09:39:130
22105997744,11cyclictest181rcu_preempt08:09:270
22105997737,30cyclictest0-21swapper/011:39:400
22105997731,23cyclictest27652-21rm10:46:470
22105997731,23cyclictest27652-21rm10:46:470
22124997611,42cyclictest0-21swapper/312:19:253
22105997659,12cyclictest5184-21fschecks_count10:09:510
22105997653,16cyclictest3019-21apt-key11:54:150
22105997639,13cyclictest17012-21fschecks_count08:24:340
22113997559,10cyclictest21094-21mailstats11:29:461
22113997559,10cyclictest21094-21mailstats11:29:461
22113997554,14cyclictest2155-21ssh10:59:131
2211399753,48cyclictest352-21runrttasks11:18:221
2211399753,48cyclictest352-21runrttasks11:18:221
22105997553,16cyclictest297-21systemd-logind09:09:120
22105997544,8cyclictest181rcu_preempt11:04:230
2210599754,40cyclictest8497-21cstates11:09:310
2098527516,35sleep30-21swapper/306:59:433
2098527516,35sleep30-21swapper/306:59:433
2211399743,52cyclictest20988-21head08:34:471
2211399742,51cyclictest24975-21latency_hist08:49:141
2211399742,51cyclictest24975-21latency_hist08:49:141
22113997417,21cyclictest29707-21diskmemload10:49:341
22105997450,15cyclictest2984-21ssh09:13:310
22105997444,12cyclictest181rcu_preempt07:24:230
22124997323,37cyclictest0-21swapper/309:39:353
22124997323,37cyclictest0-21swapper/309:39:353
22113997358,10cyclictest28316-21fschecks_count09:54:321
22113997354,13cyclictest352-21runrttasks10:44:461
22113997354,13cyclictest352-21runrttasks10:44:461
22113997345,18cyclictest0-21swapper/109:39:141
22113997337,10cyclictest181rcu_preempt10:39:331
22105997356,12cyclictest15675-21sh11:20:240
2210599735,55cyclictest352-21runrttasks07:39:380
22105997351,13cyclictest0-21swapper/010:09:120
22105997348,15cyclictest27667-21cstates07:19:280
22105997348,15cyclictest27667-21cstates07:19:280
22105997346,7cyclictest181rcu_preempt09:39:320
22105997346,7cyclictest181rcu_preempt09:39:320
2210599734,57cyclictest12797-21ssh09:29:250
22105997329,14cyclictest11825-21ssh11:14:360
22105997329,14cyclictest11825-21ssh11:14:360
22113997251,12cyclictest0-21swapper/111:59:351
2211399724,46cyclictest27403-21latency_hist07:19:151
22113997233,10cyclictest181rcu_preempt08:19:321
2210599725,53cyclictest17630-21fschecks_time11:24:320
22105997253,13cyclictest15279-21apt-key12:14:160
2210599724,35cyclictest6543-21/usr/sbin/munin09:19:340
2210599723,33cyclictest8167-21grep10:14:330
2212499712,26cyclictest31031-21chrt07:29:303
22113997133,30cyclictest25048-21cpu12:29:281
22105997146,17cyclictest24031-21ssh10:40:020
2210599714,45cyclictest1774-21cp07:39:150
2210599714,45cyclictest1774-21cp07:39:150
2210599714,39cyclictest352-21runrttasks10:25:330
2210599714,35cyclictest352-21runrttasks11:03:150
22105997139,23cyclictest11680-21modprobe08:09:110
22105997139,23cyclictest11680-21modprobe08:09:110
22105997137,13cyclictest181rcu_preempt09:47:330
22113997026,35cyclictest0-21swapper/109:29:221
22105997054,10cyclictest31673-21ntp_offset09:59:410
2210599704,55cyclictest352-21runrttasks10:39:080
2210599703,53cyclictest19345-21unixbench_singl08:29:480
22105997034,29cyclictest11188-21kworker/u17:3+nfsiod12:29:390
22124996914,44cyclictest0-21swapper/311:54:293
22113996950,13cyclictest27731-21latency_hist09:54:141
2211399692,48cyclictest6742-21df09:19:311
22113996916,37cyclictest25287-21grep07:09:501
22124996813,35cyclictest0-21swapper/311:49:363
22113996851,11cyclictest297-21systemd-logind08:14:121
2211399683,40cyclictest352-21runrttasks09:16:311
2211399683,40cyclictest352-21runrttasks09:16:311
22105996852,10cyclictest297-21systemd-logind07:54:130
2210599684,54cyclictest352-21runrttasks11:48:470
22105996843,7cyclictest181rcu_preempt12:19:530
22105996828,12cyclictest0-21swapper/010:24:140
22105996823,33cyclictest352-21runrttasks08:48:080
22105996823,33cyclictest352-21runrttasks08:48:080
22105996819,34cyclictest10250-21latency_hist08:04:150
22113996752,8cyclictest0-21swapper/108:54:111
22113996746,15cyclictest300-21rs:main1
22113996746,13cyclictest0-21swapper/109:45:011
2211399674,49cyclictest13692-21latency_hist10:24:141
2211399674,43cyclictest5135-21ssh11:04:141
22113996742,16cyclictest0-21swapper/110:09:161
2210599673,36cyclictest4989-21latency_hist07:49:150
2210599673,36cyclictest4989-21latency_hist07:49:150
22105996730,29cyclictest0-21swapper/009:14:450
22105996730,29cyclictest0-21swapper/009:14:450
22113996648,12cyclictest1-21systemd10:33:001
22113996647,14cyclictest9887-21sh10:17:251
2211399664,42cyclictest12144-21ssh12:09:151
2211399663,45cyclictest27633-21cpuspeed07:19:271
2211399663,45cyclictest27633-21cpuspeed07:19:271
22113996627,27cyclictest7745-21find07:54:441
22113996614,26cyclictest22674-21ssh10:39:141
2210599663,53cyclictest26129-21ssh09:49:500
2210599663,45cyclictest26578-21latency_hist08:54:140
22105996634,23cyclictest30968-21ssh10:52:410
22105996621,34cyclictest8069-21unixbench_singl07:54:470
22113996546,10cyclictest10442-21kworker/u17:1-xprtiod09:59:291
22113996540,13cyclictest0-21swapper/107:09:151
2211399653,48cyclictest7142-21ssh11:06:411
22105996540,8cyclictest181rcu_preempt08:19:370
2210599653,36cyclictest20626-21processes08:34:430
2212499642,39cyclictest0-21swapper/307:39:273
22113996448,10cyclictest277-21dbus-daemon08:59:131
2211399644,34cyclictest14891-21netstat11:19:381
22113996439,17cyclictest0-21swapper/108:29:461
22113996438,14cyclictest26955-21kworker/u17:3-nfsiod10:29:151
2211399643,41cyclictest8669-21fschecks_time11:09:361
22113996426,32cyclictest0-21swapper/112:09:341
2211399642,45cyclictest29399-21fschecks_time07:24:331
22105996419,32cyclictest26915-21fschecks_count08:54:320
2211399633,44cyclictest401-21fschecks_count07:34:341
2211399633,44cyclictest401-21fschecks_count07:34:341
2210599634,46cyclictest24844-21ntp_offset07:09:420
2210599633,26cyclictest31014-21apt07:29:230
2210599632,41cyclictest26216-21fschecks_time07:14:350
22105996320,29cyclictest14175-21grep08:14:450
22124996211,24cyclictest0-21swapper/310:09:263
22113996246,10cyclictest29826-21ssh09:04:151
2211399623,34cyclictest9436-21switchtime07:59:461
2210599622,30cyclictest22267-21/usr/sbin/munin07:04:390
2212499617,30cyclictest0-21swapper/307:49:303
2211399613,36cyclictest10328-21/usr/sbin/munin08:04:291
2211399613,36cyclictest10328-21/usr/sbin/munin08:04:291
22124996017,28cyclictest0-21swapper/308:39:363
22124996017,28cyclictest0-21swapper/308:39:363
2212499593,36cyclictest25860-21chrt07:14:153
2212499592,40cyclictest24970-21chrt09:49:153
22105995939,11cyclictest0-21swapper/008:40:580
22105995939,11cyclictest0-21swapper/008:40:580
2212499563,34cyclictest14494-21taskset11:19:273
2212499553,38cyclictest30167-21taskset10:50:263
2212499552,38cyclictest29883-21chrt09:04:153
2212499544,37cyclictest25334-21chrt10:43:413
2212499543,38cyclictest31654-21chrt09:59:403
2212499543,35cyclictest6388-21taskset11:04:483
2212499543,34cyclictest2419-21taskset10:59:253
2212499533,40cyclictest29898-21taskset09:56:493
2212499533,39cyclictest420-21taskset10:54:483
2212499533,38cyclictest30559-21taskset09:04:403
2212499532,37cyclictest19607-21taskset10:34:133
2212499532,36cyclictest8628-21chrt07:59:153
2212499525,35cyclictest4339-21chrt10:09:133
2212499523,35cyclictest881-21chrt09:09:343
2212499523,34cyclictest9271-21taskset12:04:213
2212499523,33cyclictest6437-21chrt09:19:153
2212499523,33cyclictest6437-21chrt09:19:153
2212499522,36cyclictest13395-21chrt09:29:413
2212499522,34cyclictest10980-21chrt11:14:043
2212499522,33cyclictest21388-21chrt11:29:493
2212499522,33cyclictest21388-21chrt11:29:493
2212499512,38cyclictest11008-21taskset08:04:463
2212499512,38cyclictest11008-21taskset08:04:463
2212499512,36cyclictest23789-21chrt08:44:353
2212499512,36cyclictest23789-21chrt08:44:353
2212499512,32cyclictest12398-21chrt12:09:283
2212499503,37cyclictest9372-21chrt10:15:583
2212499503,35cyclictest23138-21chrt07:04:483
2212499503,32cyclictest24968-21chrt12:29:223
2212499502,37cyclictest12932-21chrt08:09:483
2212499502,36cyclictest25936-21chrt11:39:003
2212499502,36cyclictest13974-21chrt10:24:293
2212499502,34cyclictest15477-21taskset08:19:323
2212499493,33cyclictest26872-21chrt11:39:413
2212499493,31cyclictest11352-21chrt11:14:213
2212499493,31cyclictest11352-21chrt11:14:213
2212499492,34cyclictest19079-21taskset08:29:453
2212499484,35cyclictest16536-21chrt09:34:443
2212499483,36cyclictest6346-21taskset11:59:273
2212499483,30cyclictest25274-21taskset08:49:333
2212499483,30cyclictest19429-21chrt11:27:343
2212499482,31cyclictest20619-21chrt08:34:433
2212499473,33cyclictest13574-21chrt10:24:123
2212499473,31cyclictest7109-21chrt09:19:403
2212499473,31cyclictest27268-21chrt08:54:403
2212499463,34cyclictest1691-21chrt07:39:143
2212499463,34cyclictest1691-21chrt07:39:143
2212499463,29cyclictest26416-21taskset07:14:403
2212499462,31cyclictest21861-21chrt10:37:213
2212499462,30cyclictest26814-21chrt09:51:383
2212499453,32cyclictest14020-21chrt08:14:383
2212499452,30cyclictest31283-21chrt11:47:153
2212499442,32cyclictest17011-21taskset08:24:343
2212499442,31cyclictest5246-21taskset07:49:153
2212499442,31cyclictest5246-21taskset07:49:153
22124994412,20cyclictest28060-21chrt07:19:383
22124994412,20cyclictest28060-21chrt07:19:383
2212499428,24cyclictest9624-21taskset07:59:483
2212499418,24cyclictest30648-21taskset07:29:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional