You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 01:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun May 24, 2026 12:58:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44699974120,633cyclictest12070-21diskmemload10:30:104
44689973555,677cyclictest0-21swapper/310:27:033
4468996919,84cyclictest0-21swapper/309:42:583
44689967479,592cyclictest0-21swapper/309:14:423
44669966064,380cyclictest0-21swapper/111:58:301
44729965920,423cyclictest0-21swapper/710:24:317
44699965522,382cyclictest0-21swapper/411:21:244
44699965522,382cyclictest0-21swapper/411:21:234
44689965319,2cyclictest0-21swapper/310:17:223
44689965319,2cyclictest0-21swapper/310:17:223
4470996384,383cyclictest0-21swapper/511:21:245
4470996384,383cyclictest0-21swapper/511:21:235
44679962267,169cyclictest0-21swapper/209:39:312
44699962168,380cyclictest0-21swapper/411:32:464
44699961722,381cyclictest0-21swapper/410:01:584
44709961321,3cyclictest0-21swapper/510:17:225
44709961321,3cyclictest0-21swapper/510:17:215
447099613103,507cyclictest0-21swapper/511:56:525
44679961157,380cyclictest0-21swapper/210:26:182
44709960918,380cyclictest0-21swapper/512:12:255
44659960812,380cyclictest0-21swapper/011:04:360
44689960715,341cyclictest0-21swapper/311:21:243
44689960715,341cyclictest0-21swapper/311:21:233
44689960053,501cyclictest0-21swapper/310:20:403
4467995963,384cyclictest0-21swapper/210:17:222
4467995963,384cyclictest0-21swapper/210:17:222
44699959541,380cyclictest0-21swapper/409:17:064
4472995940,84cyclictest0-21swapper/710:16:457
4472995940,84cyclictest0-21swapper/710:16:447
4472995940,84cyclictest0-21swapper/710:05:297
447099594124,254cyclictest0-21swapper/509:54:045
4470995940,84cyclictest0-21swapper/509:16:015
44719959342,126cyclictest0-21swapper/611:55:496
4467995930,84cyclictest0-21swapper/209:16:012
446799592122,126cyclictest6917-21sh11:55:452
44669959079,171cyclictest121rcu_preempt09:52:591
44669958880,84cyclictest0-21swapper/110:21:091
4465995870,36cyclictest0-21swapper/012:00:450
446599586120,211cyclictest0-21swapper/010:03:320
44679958227,127cyclictest12070-21diskmemload10:10:242
44689958130,84cyclictest0-21swapper/311:58:443
446699581155,208cyclictest9959-21ssh11:02:131
44659958128,295cyclictest0-21swapper/009:55:190
44719958068,381cyclictest0-21swapper/610:04:106
446999578152,337cyclictest12836-21rm10:09:184
44659957766,380cyclictest0-21swapper/012:49:350
446599576446,50cyclictest101ktimersoftd/011:21:290
446599576446,50cyclictest101ktimersoftd/011:21:290
44729957521,296cyclictest0-21swapper/710:10:157
44709957526,546cyclictest0-21swapper/511:45:535
44669957526,383cyclictest0-21swapper/110:17:221
44669957526,383cyclictest0-21swapper/110:17:221
446599575153,256cyclictest6076-1kworker/u17:110:28:150
44669957221,84cyclictest0-21swapper/111:39:381
44689957122,465cyclictest0-21swapper/311:03:373
44669956919,347cyclictest0-21swapper/110:04:591
44659956920,127cyclictest0-21swapper/011:58:340
44709956618,546cyclictest0-21swapper/511:38:035
44699956555,507cyclictest0-21swapper/409:43:444
44709956215,379cyclictest0-21swapper/510:01:555
446599559134,208cyclictest0-21swapper/010:23:460
4472995520,84cyclictest0-21swapper/712:49:417
4471995510,85cyclictest23569-21ssh09:16:016
4469995501,380cyclictest121rcu_preempt11:55:344
446699550209,126cyclictest121rcu_preempt10:29:071
446599548121,338cyclictest0-21swapper/011:47:230
44669954678,465cyclictest121rcu_preempt09:14:321
44659954636,507cyclictest0-21swapper/009:43:450
44699954476,338cyclictest0-21swapper/412:00:104
44689954273,211cyclictest0-21swapper/309:54:593
44659954274,465cyclictest0-21swapper/012:11:050
44719954177,219cyclictest0-21swapper/609:15:036
44709954169,380cyclictest4463-21cyclictest10:05:465
44689954130,508cyclictest0-21swapper/310:04:393
446999540111,381cyclictest0-21swapper/411:03:344
44679953729,126cyclictest0-21swapper/210:24:342
44689953668,465cyclictest0-21swapper/311:46:433
44729953523,84cyclictest0-21swapper/709:44:587
44709953323,126cyclictest0-21swapper/511:50:175
44719953165,211cyclictest0-21swapper/610:24:306
44709953024,337cyclictest31592-21ssh10:20:215
44689953021,423cyclictest0-21swapper/312:15:023
44699952921,302cyclictest0-21swapper/412:14:164
44659952960,297cyclictest0-21swapper/010:17:020
44659952960,297cyclictest0-21swapper/010:17:010
44689952719,254cyclictest0-21swapper/311:36:503
44699952615,338cyclictest0-21swapper/412:48:334
44699952519,2cyclictest0-21swapper/410:17:224
44699952519,2cyclictest0-21swapper/410:17:224
44709952315,126cyclictest0-21swapper/509:43:455
44689952361,331cyclictest0-21swapper/311:32:193
44699952112,505cyclictest0-21swapper/409:38:264
44699952013,86cyclictest30143-21grep10:20:124
4470995198,211cyclictest57-21ksoftirqd/512:49:315
447199518474,42cyclictest631rcuc/611:31:556
4465995189,84cyclictest0-21swapper/009:15:130
44709951593,256cyclictest21716-21nscd10:26:165
4466995154,380cyclictest25-21ksoftirqd/109:44:421
4465995156,126cyclictest1553-21runrttasks11:36:390
44679951486,90cyclictest33-21ksoftirqd/210:06:182
4471995130,84cyclictest0-21swapper/612:47:496
4467995124,126cyclictest0-21swapper/212:49:562
4466995122,211cyclictest25-21ksoftirqd/110:07:561
4472995090,84cyclictest0-21swapper/711:21:457
4472995090,84cyclictest0-21swapper/711:21:457
4472995090,84cyclictest0-21swapper/710:00:577
4471995090,84cyclictest0-21swapper/609:53:256
4470995090,84cyclictest0-21swapper/509:37:565
4467995090,168cyclictest0-21swapper/209:53:242
44669950983,211cyclictest15535-21ssh10:10:261
4471995081,256cyclictest28199-21ssh10:17:216
4471995081,256cyclictest28199-21ssh10:17:216
44729950578,211cyclictest721ktimersoftd/709:14:157
44719950541,256cyclictest0-21swapper/611:21:246
44719950541,256cyclictest0-21swapper/611:21:236
447199505123,84cyclictest0-21swapper/611:38:406
44709950479,168cyclictest57-21ksoftirqd/510:35:335
44689950440,380cyclictest0-21swapper/310:08:003
44659950440,261cyclictest0-21swapper/009:20:120
446799503248,253cyclictest12476-21kworker/u16:210:01:502
447299502372,42cyclictest2293-21ssh12:14:507
44699950233,344cyclictest0-21swapper/409:51:174
44669950137,253cyclictest0-21swapper/109:39:421
447199500159,338cyclictest5441-21awk10:25:356
44699950031,338cyclictest121rcu_preempt11:36:254
44659950073,211cyclictest9-21ksoftirqd/009:14:480
44709949934,296cyclictest0-21swapper/510:10:075
44689949930,466cyclictest0-21swapper/311:05:193
446699499456,41cyclictest231rcuc/112:11:511
44689949871,211cyclictest0-21swapper/312:47:223
44729949732,253cyclictest0-21swapper/709:55:037
447199497411,4cyclictest631rcuc/612:15:136
44709949627,466cyclictest0-21swapper/511:40:115
446999496113,380cyclictest0-21swapper/410:10:094
44679949674,84cyclictest0-21swapper/211:39:562
44689949527,465cyclictest0-21swapper/310:10:033
446899495115,84cyclictest0-21swapper/309:38:453
44669949572,211cyclictest4463-21cyclictest11:31:501
44659949527,338cyclictest0-21swapper/009:38:540
446799494113,84cyclictest704-21nscd09:40:172
446799494109,126cyclictest0-21swapper/212:14:312
447099493152,126cyclictest121rcu_preempt12:00:285
44699949367,253cyclictest24280-21kworker/u16:310:27:174
447299492107,211cyclictest73-21ksoftirqd/711:34:047
44719949228,261cyclictest0-21swapper/612:00:426
44729949169,84cyclictest0-21swapper/710:27:497
44709949124,84cyclictest0-21swapper/511:32:255
447299490193,84cyclictest9394-21cron12:00:017
44719948967,84cyclictest0-21swapper/609:40:176
44679948823,261cyclictest0-21swapper/210:35:312
447199487104,380cyclictest0-21swapper/610:10:096
446999486144,126cyclictest121rcu_preempt07:58:304
44729948419,2cyclictest704-21nscd11:03:557
44679948314,211cyclictest33-21ksoftirqd/211:03:422
446799482101,83cyclictest0-21swapper/209:13:432
44669948212,381cyclictest0-21swapper/109:18:181
446599478223,253cyclictest101ktimersoftd/011:40:050
44679947755,84cyclictest0-21swapper/212:15:122
44689947410,84cyclictest0-21swapper/309:15:323
4465994739,218cyclictest0-21swapper/009:51:170
4467994690,381cyclictest0-21swapper/211:31:562
4467994683,3cyclictest0-21swapper/209:45:122
4469994660,126cyclictest26993-21/usr/sbin/munin09:20:124
44729946543,211cyclictest73-21ksoftirqd/709:38:137
447299465171,41cyclictest121rcu_preempt09:53:437
4470994651,298cyclictest0-21swapper/511:03:385
44669946581,211cyclictest25-21ksoftirqd/111:05:061
44669946539,211cyclictest0-21swapper/112:48:441
44729946483,297cyclictest0-21swapper/711:39:557
44699946441,259cyclictest0-21swapper/409:11:424
446599464207,84cyclictest0-21swapper/010:05:150
44689946280,126cyclictest0-21swapper/309:20:033
447199461118,340cyclictest32505-21taskset09:39:006
44709946180,84cyclictest0-21swapper/507:59:265
44669946178,211cyclictest0-21swapper/111:45:531
44659946134,338cyclictest0-21swapper/010:10:230
446599461122,84cyclictest0-21swapper/009:45:200
446599461121,338cyclictest0-21swapper/011:33:240
447199460120,338cyclictest0-21swapper/610:05:136
44709946033,211cyclictest57-21ksoftirqd/510:30:075
44689946038,256cyclictest0-21swapper/309:55:253
44719945936,84cyclictest0-21swapper/612:10:496
44669945974,211cyclictest25-21ksoftirqd/107:59:261
447299458120,169cyclictest0-21swapper/712:20:237
44719945878,84cyclictest0-21swapper/611:02:256
44679945878,84cyclictest0-21swapper/211:46:042
44679945874,126cyclictest0-21swapper/209:20:032
446699458159,126cyclictest121rcu_preempt11:21:291
446699458159,126cyclictest121rcu_preempt11:21:291
44659945836,296cyclictest15282-21ssh12:20:230
446599458120,84cyclictest121rcu_preempt07:59:120
44729945634,257cyclictest0-21swapper/709:45:157
447299455114,338cyclictest1551-21snmpd09:20:187
44689945532,302cyclictest0-21swapper/307:58:203
44719945432,255cyclictest0-21swapper/607:57:336
446999454115,84cyclictest0-21swapper/411:05:174
446799453114,84cyclictest22063-21diskmemload12:40:182
446799453114,84cyclictest0-21swapper/209:55:182
44719945267,254cyclictest0-21swapper/611:45:316
44709945130,2cyclictest0-21swapper/509:13:505
446799451112,84cyclictest698-21ptp4l07:59:272
446899450412,36cyclictest391rcuc/310:30:133
44729944967,84cyclictest0-21swapper/707:59:327
447299449195,84cyclictest721ktimersoftd/712:00:327
447299449108,338cyclictest20671-21/usr/sbin/munin09:15:197
447199449110,84cyclictest0-21swapper/609:55:176
44709944926,255cyclictest0-21swapper/509:20:185
44699944927,2cyclictest0-21swapper/411:46:074
446999448107,338cyclictest7455-21sh09:45:044
446799448147,126cyclictest121rcu_preempt11:21:472
446799448147,126cyclictest121rcu_preempt11:21:472
447299447107,338cyclictest0-21swapper/711:46:357
44709944764,84cyclictest0-21swapper/511:05:035
446999443102,338cyclictest0-21swapper/409:55:214
446799439101,84cyclictest0-21swapper/210:30:132
44709943815,257cyclictest0-21swapper/512:15:125
44699943596,84cyclictest0-21swapper/410:35:334
4470994308,3cyclictest0-21swapper/509:45:135
4468994297,84cyclictest24489-21ntp_states12:25:213
4472994253,84cyclictest0-21swapper/712:15:127
4468994233,39cyclictest0-21swapper/309:45:133
44669942385,127cyclictest25-21ksoftirqd/109:55:131
4466994231,2cyclictest0-21swapper/109:45:151
447199422165,127cyclictest121rcu_preempt11:05:026
44669942183,84cyclictest0-21swapper/112:40:171
44659942181,338cyclictest0-21swapper/010:30:130
44669942082,83cyclictest0-21swapper/110:35:311
44689941979,338cyclictest0-21swapper/312:00:443
44669941980,84cyclictest0-21swapper/111:40:101
44669941979,84cyclictest24280-21kworker/u16:309:20:081
44669941880,84cyclictest0-21swapper/110:30:121
44719941778,84cyclictest0-21swapper/611:50:176
44709941778,84cyclictest0-21swapper/512:40:175
44729941637,2cyclictest0-21swapper/712:25:227
44689941637,126cyclictest0-21swapper/312:40:183
44669941577,84cyclictest0-21swapper/111:50:171
44669941574,210cyclictest12083-21sed12:00:411
44679941429,211cyclictest33-21ksoftirqd/211:05:182
447299413114,126cyclictest121rcu_preempt11:05:187
44719941374,84cyclictest24489-21ntp_states12:25:236
44669941273,84cyclictest0-21swapper/112:15:141
44719941171,84cyclictest0-21swapper/609:45:186
44709941132,4cyclictest24309-21apt-get09:55:175
44699941171,337cyclictest0-21swapper/411:40:064
44689941170,338cyclictest0-21swapper/311:40:033
44689941169,339cyclictest0-21swapper/311:50:173
44669941072,84cyclictest0-21swapper/112:25:221
446799409110,126cyclictest0-21swapper/211:40:012
44659940865,211cyclictest3504-21df12:15:170
44729940768,83cyclictest0-21swapper/711:50:177
44719940768,84cyclictest0-21swapper/609:20:136
44689940766,338cyclictest0-21swapper/310:35:303
44719940667,84cyclictest0-21swapper/612:40:186
44709940667,84cyclictest0-21swapper/512:25:225
44689940663,127cyclictest121rcu_preempt12:35:263
44669940667,84cyclictest0-21swapper/112:20:251
44729940465,84cyclictest0-21swapper/710:30:127
44699940463,338cyclictest0-21swapper/412:20:254
44659940465,336cyclictest0-21swapper/012:25:200
44709940263,84cyclictest0-21swapper/512:20:255
44659940261,212cyclictest0-21swapper/011:05:250
44679940120,169cyclictest33-21ksoftirqd/212:00:372
44679939455,84cyclictest0-21swapper/211:50:172
44659939352,338cyclictest0-21swapper/011:50:180
44729938445,84cyclictest0-21swapper/711:40:027
44659938240,168cyclictest121rcu_preempt12:40:180
44699937841,253cyclictest0-21swapper/412:25:224
44699937639,253cyclictest0-21swapper/412:15:124
44689937638,254cyclictest0-21swapper/312:20:253
44729937478,211cyclictest0-21swapper/712:40:267
44699937434,338cyclictest0-21swapper/411:50:174
446599373119,84cyclictest21907-21rm10:35:330
44719937174,84cyclictest0-21swapper/610:30:116
447299369116,126cyclictest21852-21ssh10:35:267
447199369114,253cyclictest0-21swapper/611:40:096
44669936831,49cyclictest0-21swapper/112:30:221
44699936527,255cyclictest481ktimersoftd/412:30:224
44689936122,172cyclictest0-21swapper/312:15:123
44679936060,126cyclictest0-21swapper/212:25:232
44679935716,126cyclictest15313-21sh12:20:262
44699934143,84cyclictest3385-21kworker/u16:012:40:264
44689933780,254cyclictest0-21swapper/312:30:223
44719933682,84cyclictest21902-21sh10:35:316
44709933641,211cyclictest2555-21ls12:30:225
44679933478,253cyclictest0-21swapper/212:30:222
44719933174,254cyclictest0-21swapper/612:30:226
447199331158,84cyclictest121rcu_preempt12:20:256
44699932126,212cyclictest0-21swapper/412:35:264
44659931924,86cyclictest0-21swapper/012:30:220
44659931924,211cyclictest0-21swapper/012:35:260
44719931762,84cyclictest0-21swapper/612:35:256
44729931317,85cyclictest0-21swapper/712:35:257
44709931319,210cyclictest12915-21ssh12:35:255
44669931015,211cyclictest0-21swapper/112:35:251
44729930591,126cyclictest0-21swapper/712:30:227
44679929335,86cyclictest0-21swapper/212:35:252
550521450,2sleep4446999cyclictest08:55:234
148629245,24sleep50-21swapper/507:05:135
384428554,27sleep10-21swapper/107:07:161
378228555,27sleep30-21swapper/307:06:223
383228352,27sleep70-21swapper/707:07:067
381828353,27sleep20-21swapper/207:06:532
374728348,31sleep60-21swapper/607:05:536
387728150,28sleep40-21swapper/407:07:444
379827948,27sleep00-21swapper/007:06:350
121642760,1sleep30-21swapper/310:47:103
4466995320,4cyclictest19781-21ssh11:25:201
4470994710,31cyclictest19014-21df_abs11:25:165
4469994638,5cyclictest18185-21sh11:25:074
4467994537,4cyclictest18715-21expr11:25:132
4471994310,22cyclictest65-21ksoftirqd/611:26:146
446899382,32cyclictest0-21swapper/311:25:063
447299362,30cyclictest0-21swapper/711:25:167
4465993530,3cyclictest0-21swapper/011:25:030
4470993027,3cyclictest0-21swapper/508:34:275
4468992910,18cyclictest0-21swapper/308:23:473
4465992927,1cyclictest0-21swapper/007:14:060
4472992810,18cyclictest0-21swapper/708:13:297
4472992810,18cyclictest0-21swapper/707:20:517
4472992810,0cyclictest0-21swapper/708:44:377
4472992810,0cyclictest0-21swapper/707:38:357
4470992825,3cyclictest0-21swapper/508:13:075
4468992810,18cyclictest0-21swapper/308:12:583
4467992810,18cyclictest0-21swapper/208:24:032
4466992810,18cyclictest0-21swapper/108:44:461
4465992810,18cyclictest0-21swapper/007:47:280
4472992727,0cyclictest0-21swapper/708:58:197
4472992727,0cyclictest0-21swapper/708:34:097
4472992710,17cyclictest0-21swapper/708:45:037
4472992710,17cyclictest0-21swapper/707:47:287
4472992710,17cyclictest0-21swapper/707:13:387
4472992710,0cyclictest0-21swapper/707:28:247
4471992727,0cyclictest0-21swapper/607:14:036
4471992710,17cyclictest0-21swapper/608:44:376
4471992710,17cyclictest0-21swapper/607:47:286
4471992710,17cyclictest0-21swapper/607:21:056
4470992727,0cyclictest0-21swapper/507:38:085
4470992710,17cyclictest0-21swapper/507:47:275
4470992710,0cyclictest0-21swapper/508:58:215
4470992710,0cyclictest0-21swapper/508:44:395
4470992710,0cyclictest0-21swapper/508:23:485
4470992710,0cyclictest0-21swapper/507:28:495
4470992710,0cyclictest0-21swapper/507:20:595
4470992710,0cyclictest0-21swapper/507:13:445
4469992710,17cyclictest0-21swapper/408:44:424
4469992710,17cyclictest0-21swapper/407:47:224
4469992710,17cyclictest0-21swapper/407:38:334
4469992710,17cyclictest0-21swapper/407:28:344
4469992710,17cyclictest0-21swapper/407:13:404
4469992710,0cyclictest0-21swapper/408:34:124
4468992727,0cyclictest0-21swapper/308:45:043
4468992727,0cyclictest0-21swapper/307:20:593
4468992710,17cyclictest0-21swapper/308:34:163
4468992710,17cyclictest0-21swapper/307:47:203
4468992710,0cyclictest0-21swapper/308:44:333
4468992710,0cyclictest0-21swapper/307:38:243
4468992710,0cyclictest0-21swapper/307:13:383
4467992710,17cyclictest0-21swapper/208:44:422
4467992710,17cyclictest0-21swapper/208:12:592
4467992710,17cyclictest0-21swapper/207:47:262
4467992710,17cyclictest0-21swapper/207:28:362
4467992710,17cyclictest0-21swapper/207:13:522
4467992710,0cyclictest0-21swapper/208:34:162
4467992710,0cyclictest0-21swapper/207:38:032
4466992727,0cyclictest0-21swapper/108:23:561
4466992727,0cyclictest0-21swapper/108:12:581
4466992727,0cyclictest0-21swapper/107:21:281
4466992710,17cyclictest0-21swapper/108:58:261
4466992710,17cyclictest0-21swapper/108:45:031
4466992710,17cyclictest0-21swapper/108:34:151
4466992710,17cyclictest0-21swapper/107:28:581
4466992710,0cyclictest0-21swapper/107:47:261
4466992710,0cyclictest0-21swapper/107:38:161
4465992726,1cyclictest0-21swapper/008:12:570
4465992710,17cyclictest0-21swapper/008:45:040
4465992710,0cyclictest0-21swapper/008:58:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional