You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 20:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat May 30, 2026 12:56:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
69579969819,676cyclictest0-21swapper/111:08:311
6957996730,3cyclictest0-21swapper/110:56:571
69579965112,466cyclictest0-21swapper/112:03:481
69579965112,466cyclictest0-21swapper/112:03:481
6957996381,634cyclictest0-21swapper/110:10:021
6957996350,41cyclictest0-21swapper/111:46:011
695999632122,295cyclictest0-21swapper/309:13:283
69579962269,550cyclictest0-21swapper/111:16:421
6961995940,84cyclictest0-21swapper/511:48:095
6960995930,84cyclictest0-21swapper/411:50:414
6960995930,84cyclictest0-21swapper/410:35:024
6958995930,84cyclictest0-21swapper/210:35:012
6957995930,41cyclictest0-21swapper/111:27:421
6957995930,41cyclictest0-21swapper/111:27:411
6957995930,41cyclictest0-21swapper/110:32:171
69589959136,338cyclictest0-21swapper/212:07:052
69589959035,338cyclictest0-21swapper/212:01:172
69589959035,338cyclictest0-21swapper/212:01:172
69589958834,126cyclictest0-21swapper/212:21:382
69619958734,84cyclictest0-21swapper/512:03:245
69619958734,84cyclictest0-21swapper/512:03:245
69569958532,380cyclictest0-21swapper/012:28:020
696199580111,466cyclictest0-21swapper/512:06:295
69579958070,507cyclictest21211-21cpuspeed_turbos11:10:141
69579957925,465cyclictest0-21swapper/112:08:141
69579957623,296cyclictest0-21swapper/111:56:221
69569957264,84cyclictest0-21swapper/011:28:190
69569957264,84cyclictest0-21swapper/011:28:180
695899569311,86cyclictest0-21swapper/211:58:232
69579956920,127cyclictest0-21swapper/111:39:071
69619956814,338cyclictest0-21swapper/511:09:255
69579956515,166cyclictest5008-21ssh10:10:151
69589956152,253cyclictest6954-21cyclictest11:27:392
69589956152,253cyclictest6954-21cyclictest11:27:392
6957995541,550cyclictest0-21swapper/109:14:591
695899552126,252cyclictest0-21swapper/211:16:432
69569955242,126cyclictest121rcu_preempt11:36:570
6957995510,42cyclictest0-21swapper/108:20:051
6957995510,41cyclictest0-21swapper/109:38:211
6957995510,41cyclictest0-21swapper/109:38:211
696399549292,84cyclictest0-21swapper/712:27:067
696399549126,126cyclictest73-21ksoftirqd/711:15:447
695899547165,43cyclictest15774-21diskmemload11:10:052
6959995450,120cyclictest0-21swapper/311:50:413
69579954581,295cyclictest121rcu_preempt11:20:181
69579954535,507cyclictest0-21swapper/112:22:281
69579954534,381cyclictest0-21swapper/112:25:371
69619954235,296cyclictest6476-21ssh11:39:265
69599954235,168cyclictest0-21swapper/311:20:263
69589954235,84cyclictest0-21swapper/211:40:152
695999541287,84cyclictest401ktimersoftd/312:26:043
69579954131,507cyclictest0-21swapper/112:40:211
69589953871,253cyclictest0-21swapper/212:26:362
695799536109,84cyclictest121rcu_preempt09:00:021
69619953526,253cyclictest31550-1kworker/u17:212:35:545
695999535151,253cyclictest17666-1kworker/u17:111:07:453
69609953371,378cyclictest0-21swapper/411:17:054
696399531486,42cyclictest711rcuc/711:29:027
696399531486,42cyclictest711rcuc/711:29:017
69589953023,291cyclictest0-21swapper/211:09:582
69619952859,211cyclictest57-21ksoftirqd/512:22:015
69599952862,126cyclictest121rcu_preempt09:40:073
695899528104,211cyclictest0-21swapper/211:36:052
69599952660,211cyclictest0-21swapper/311:28:333
69599952660,211cyclictest0-21swapper/311:28:333
69609952566,456cyclictest0-21swapper/412:07:144
69599952396,296cyclictest0-21swapper/311:46:123
69629952157,84cyclictest17145-21ssh12:08:356
69619952110,84cyclictest0-21swapper/512:28:155
695999521264,254cyclictest401ktimersoftd/311:16:403
69569951850,295cyclictest0-21swapper/012:01:300
69569951850,295cyclictest0-21swapper/012:01:300
69569951751,126cyclictest0-21swapper/011:15:570
69609951610,84cyclictest0-21swapper/410:57:534
69629951347,211cyclictest0-21swapper/611:16:396
696299511341,168cyclictest0-21swapper/608:58:166
6962995090,84cyclictest0-21swapper/611:48:106
696199509125,126cyclictest121rcu_preempt11:59:175
6961995090,84cyclictest0-21swapper/511:50:335
6960995090,84cyclictest0-21swapper/411:47:414
6958995090,84cyclictest21518-21ssh11:48:102
6960995084,288cyclictest0-21swapper/412:27:104
6957995080,41cyclictest0-21swapper/108:19:571
696199507167,338cyclictest57-21ksoftirqd/508:58:165
69599950780,211cyclictest0-21swapper/311:58:183
695699507423,3cyclictest101ktimersoftd/009:39:400
695699507423,3cyclictest101ktimersoftd/009:39:390
695699506421,3cyclictest101ktimersoftd/011:56:000
69639950540,3cyclictest0-21swapper/712:00:297
69639950540,3cyclictest0-21swapper/712:00:297
69609950582,168cyclictest0-21swapper/409:13:444
69609950439,126cyclictest121rcu_preempt12:03:214
69609950439,126cyclictest121rcu_preempt12:03:214
696299503165,211cyclictest0-21swapper/611:09:246
69609950277,422cyclictest0-21swapper/411:38:064
696399501117,381cyclictest73-21ksoftirqd/712:06:307
69589950136,84cyclictest121rcu_preempt09:40:002
695699501418,3cyclictest101ktimersoftd/012:06:280
69639949975,338cyclictest0-21swapper/711:56:317
69609949975,84cyclictest0-21swapper/411:56:304
69609949930,253cyclictest49-21ksoftirqd/409:15:134
69569949931,295cyclictest6954-21cyclictest11:50:360
695699498114,211cyclictest9194-21python11:20:240
69609949772,417cyclictest0-21swapper/411:28:344
69609949772,417cyclictest0-21swapper/411:28:344
695699497414,3cyclictest101ktimersoftd/012:21:200
695699497117,253cyclictest121rcu_preempt09:12:330
69619949673,126cyclictest57-21ksoftirqd/510:32:325
69569949669,211cyclictest0-21swapper/011:09:080
69579949568,211cyclictest21102-21basename12:10:191
696299494114,296cyclictest0-21swapper/612:03:226
696299494114,296cyclictest0-21swapper/612:03:226
696299493408,83cyclictest631rcuc/609:39:276
696299493408,83cyclictest631rcuc/609:39:266
69609949369,84cyclictest0-21swapper/408:59:224
69639949228,126cyclictest0-21swapper/708:58:577
69599949223,296cyclictest0-21swapper/309:39:263
69599949223,296cyclictest0-21swapper/309:39:263
695999492192,127cyclictest121rcu_preempt12:07:233
69639949167,127cyclictest0-21swapper/712:21:387
696299491447,42cyclictest641ktimersoftd/611:55:466
69599949072,122cyclictest15774-21diskmemload11:36:583
69589948722,125cyclictest0-21swapper/210:09:592
696299484108,373cyclictest22112-21ssh11:28:416
696299484108,373cyclictest22112-21ssh11:28:406
69579948416,126cyclictest24828-21taskset09:15:061
69599948318,169cyclictest0-21swapper/312:04:223
69599948318,169cyclictest0-21swapper/312:04:223
695899483149,84cyclictest0-21swapper/210:57:502
69569948312,128cyclictest0-21swapper/011:10:030
69619948299,380cyclictest0-21swapper/509:39:045
69619948299,380cyclictest0-21swapper/509:39:035
69569948112,338cyclictest0-21swapper/009:15:130
69639948015,59cyclictest0-21swapper/710:58:027
695899480185,42cyclictest0-21swapper/209:12:512
69579948011,253cyclictest698-21ptp4l12:35:481
695799474136,84cyclictest0-21swapper/112:30:141
6956994739,126cyclictest0-21swapper/010:34:520
6958994711,84cyclictest0-21swapper/210:10:142
6956994711,211cyclictest0-21swapper/011:47:330
69599946987,85cyclictest17434-1kworker/u17:110:32:433
6961994681,43cyclictest0-21swapper/509:15:235
6959994670,84cyclictest0-21swapper/312:20:533
6962994660,126cyclictest4919-21ssh11:36:576
6960994660,84cyclictest0-21swapper/412:20:544
696399464123,338cyclictest0-21swapper/711:45:337
696399464122,339cyclictest0-21swapper/711:39:277
69609946482,126cyclictest0-21swapper/412:30:174
695899464123,338cyclictest9591-21chrt09:00:012
6956994641,2cyclictest0-21swapper/010:09:340
69629946384,216cyclictest121rcu_preempt12:27:566
69589946340,3cyclictest21605-21ssh12:10:242
69639946239,3cyclictest0-21swapper/711:50:397
696399462122,338cyclictest6954-21cyclictest10:10:057
69569946139,256cyclictest0-21swapper/012:10:190
69639946076,127cyclictest73-21ksoftirqd/710:32:577
69639946037,3cyclictest0-21swapper/712:35:267
696299460120,338cyclictest0-21swapper/609:12:506
696099460202,84cyclictest49-21ksoftirqd/411:09:164
69599946077,260cyclictest121rcu_preempt08:19:053
696199459119,338cyclictest0-21swapper/510:08:575
695899459118,338cyclictest700-21polkitd12:40:212
69569945937,338cyclictest0-21swapper/010:10:130
696199458117,338cyclictest21242-21ssh11:10:155
69629945735,3cyclictest0-21swapper/611:10:086
69609945734,126cyclictest0-21swapper/411:40:154
696299456116,337cyclictest0-21swapper/610:34:086
69609945633,209cyclictest49-21ksoftirqd/409:39:254
69609945633,209cyclictest49-21ksoftirqd/409:39:244
695899456116,337cyclictest0-21swapper/209:15:232
695999455114,126cyclictest121rcu_preempt11:10:133
69639945330,256cyclictest0-21swapper/709:15:047
696299453112,338cyclictest10859-21ssh12:21:256
69619945328,211cyclictest0-21swapper/510:58:005
69619945326,211cyclictest57-21ksoftirqd/511:29:435
69619945326,211cyclictest57-21ksoftirqd/511:29:435
69599945330,256cyclictest0-21swapper/312:35:273
69639945230,257cyclictest0-21swapper/709:14:067
696199451110,338cyclictest5089-21cpuspeed_turbos10:10:165
69639945029,3cyclictest1651-21ntpd11:10:017
69639945027,256cyclictest0-21swapper/711:09:287
69619945070,126cyclictest57-21ksoftirqd/511:17:225
69609945066,253cyclictest0-21swapper/409:40:074
69599945071,290cyclictest0-21swapper/310:57:493
695899450108,170cyclictest121rcu_preempt11:20:182
69579945069,126cyclictest0-21swapper/107:28:011
69569945070,296cyclictest0-21swapper/010:35:080
69599944922,84cyclictest0-21swapper/309:15:083
69639944821,211cyclictest73-21ksoftirqd/710:09:207
696299448107,338cyclictest0-21swapper/608:18:376
696199448115,122cyclictest121rcu_preempt12:30:175
69629944725,255cyclictest0-21swapper/612:35:276
69629944624,3cyclictest0-21swapper/610:09:156
695899446105,127cyclictest33-21ksoftirqd/210:35:142
69639944523,2cyclictest0-21swapper/709:40:007
69639944523,2cyclictest0-21swapper/709:39:597
69589944520,91cyclictest704-21nscd08:20:002
69569944522,256cyclictest0-21swapper/008:20:160
69629944420,256cyclictest0-21swapper/611:50:336
696199444104,338cyclictest1553-21runrttasks08:18:125
69619944320,3cyclictest0-21swapper/509:14:515
69609944362,84cyclictest0-21swapper/408:20:164
69599944321,2cyclictest0-21swapper/310:10:293
69579944321,256cyclictest0-21swapper/111:40:161
69599944157,211cyclictest0-21swapper/308:58:103
69569943913,2cyclictest0-21swapper/012:35:360
69619943816,3cyclictest0-21swapper/512:10:195
695899438182,254cyclictest321ktimersoftd/209:39:022
69599943596,84cyclictest641-21dbus-daemon12:40:213
69609943453,257cyclictest6708-21proc_pri10:10:284
69629943311,256cyclictest0-21swapper/610:10:066
6956994326,126cyclictest11887-21ssh12:40:210
69609943051,84cyclictest1551-21snmpd12:10:274
6960994298,255cyclictest0-21swapper/412:35:274
695899426127,126cyclictest33-21ksoftirqd/212:30:172
69639942483,338cyclictest0-21swapper/708:18:357
6958994241,3cyclictest0-21swapper/208:20:172
69619942382,168cyclictest57-21ksoftirqd/508:20:135
6961994231,84cyclictest0-21swapper/511:30:135
69599942381,211cyclictest0-21swapper/310:09:093
69619942281,338cyclictest0-21swapper/511:20:175
69569942282,338cyclictest0-21swapper/012:30:300
69629942180,338cyclictest0-21swapper/608:20:096
69609942083,3cyclictest6954-21cyclictest10:09:294
69589942040,3cyclictest0-21swapper/211:50:252
6957994200,2cyclictest0-21swapper/111:30:131
69639941978,338cyclictest0-21swapper/711:20:247
69609941981,84cyclictest0-21swapper/408:18:334
69569941980,337cyclictest0-21swapper/008:18:320
695699418379,3cyclictest101ktimersoftd/011:40:140
69569941834,210cyclictest0-21swapper/010:57:320
69599941778,84cyclictest0-21swapper/312:10:173
695999416121,171cyclictest0-21swapper/308:20:233
69609941475,84cyclictest0-21swapper/411:10:164
696099413248,77cyclictest0-21swapper/412:40:214
69579941334,295cyclictest1553-21runrttasks10:35:141
69579941330,126cyclictest0-21swapper/109:40:081
69569941373,337cyclictest0-21swapper/009:00:030
69609941232,42cyclictest0-21swapper/410:35:154
69589941232,2cyclictest0-21swapper/212:35:322
696399411199,84cyclictest721ktimersoftd/710:35:157
69589941170,338cyclictest0-21swapper/209:40:062
695999410112,125cyclictest121rcu_preempt12:30:293
69579941026,295cyclictest27122-21ssh11:50:361
69629940972,171cyclictest24820-21ssh09:15:046
69629940970,84cyclictest0-21swapper/610:58:086
69609940971,84cyclictest0-21swapper/411:20:174
69599940970,84cyclictest0-21swapper/311:40:143
69589940929,2cyclictest0-21swapper/209:00:102
69629940826,84cyclictest0-21swapper/612:10:246
69639940728,255cyclictest0-21swapper/712:30:287
69639940665,338cyclictest1979-1kworker/7:1H11:40:157
69629940667,85cyclictest0-21swapper/611:20:256
696299404236,47cyclictest0-21swapper/612:30:206
69569940324,213cyclictest0-21swapper/009:00:100
69619940261,338cyclictest0-21swapper/511:40:135
69609940264,84cyclictest0-21swapper/411:30:064
69599940161,84cyclictest0-21swapper/310:35:083
69629939860,84cyclictest0-21swapper/611:30:066
69579939756,338cyclictest0-21swapper/109:00:081
69569939755,211cyclictest0-21swapper/011:30:130
696199395313,80cyclictest561ktimersoftd/509:00:115
6963993856,84cyclictest0-21swapper/712:10:257
69639937839,42cyclictest0-21swapper/708:20:047
69629937741,3cyclictest0-21swapper/609:40:066
69639937638,83cyclictest0-21swapper/712:40:277
69589937334,84cyclictest0-21swapper/211:30:062
69569937334,337cyclictest0-21swapper/009:40:010
69639937132,83cyclictest0-21swapper/711:30:067
69619937134,42cyclictest0-21swapper/510:35:115
696199370114,253cyclictest707-21gdbus12:40:225
69639936930,84cyclictest0-21swapper/709:40:077
696099366195,83cyclictest0-21swapper/409:00:114
69629936425,84cyclictest0-21swapper/612:40:276
69629936364,126cyclictest0-21swapper/607:28:016
69619936324,84cyclictest0-21swapper/509:40:065
69599935618,214cyclictest0-21swapper/311:30:133
69629935560,211cyclictest6954-21cyclictest10:35:146
69629935458,210cyclictest0-21swapper/611:40:156
69599935255,169cyclictest0-21swapper/307:28:013
6963993401,84cyclictest0-21swapper/709:00:107
6962993381,46cyclictest0-21swapper/609:00:086
69609932831,127cyclictest0-21swapper/407:28:024
69619932731,84cyclictest0-21swapper/507:28:015
69599932671,253cyclictest0-21swapper/309:00:103
69639931217,85cyclictest0-21swapper/707:28:017
6958993036,84cyclictest0-21swapper/207:28:022
69569929037,171cyclictest0-21swapper/007:27:510
635728655,28sleep60-21swapper/607:07:346
648328353,27sleep30-21swapper/307:09:253
647228351,28sleep10-21swapper/107:09:141
624528346,34sleep70-21swapper/707:05:597
648428048,28sleep40-21swapper/407:09:254
646728049,27sleep50-21swapper/507:09:095
625628050,27sleep00-21swapper/007:06:080
646427947,28sleep20-21swapper/207:09:072
191792720,0sleep70-21swapper/710:00:147
271042710,0sleep00-21swapper/007:40:120
292032580,2sleep3695999cyclictest09:32:563
695999448,22cyclictest20900-21df_inode07:30:153
652923633,1sleep00-21swapper/007:10:010
6962993512,4cyclictest131rcu_sched07:30:166
696099345,18cyclictest49-21ksoftirqd/407:30:194
6956993325,5cyclictest21744-21ntpq07:30:240
6958993123,5cyclictest21096-21grep07:30:162
6961993022,5cyclictest21610-21cat07:30:215
695799301,27cyclictest0-21swapper/107:30:091
6963992922,4cyclictest21408-21irqstats07:30:207
6963992810,18cyclictest0-21swapper/708:00:017
6962992810,17cyclictest0-21swapper/607:45:396
6962992810,17cyclictest0-21swapper/607:45:396
6961992810,17cyclictest0-21swapper/507:45:205
6961992810,17cyclictest0-21swapper/507:45:205
6959992810,0cyclictest0-21swapper/307:45:163
6959992810,0cyclictest0-21swapper/307:45:153
6959992810,0cyclictest0-21swapper/307:13:213
6958992827,0cyclictest0-21swapper/208:00:012
6958992810,18cyclictest0-21swapper/207:59:442
6957992810,0cyclictest0-21swapper/107:13:301
6963992727,0cyclictest0-21swapper/707:59:577
6963992727,0cyclictest0-21swapper/707:13:327
6963992710,17cyclictest0-21swapper/708:42:167
6963992710,0cyclictest0-21swapper/707:46:017
6963992710,0cyclictest0-21swapper/707:46:017
6962992710,17cyclictest0-21swapper/608:42:166
6962992710,17cyclictest0-21swapper/607:59:316
6961992710,17cyclictest0-21swapper/507:13:185
6961992710,0cyclictest0-21swapper/508:42:095
6960992710,17cyclictest0-21swapper/407:59:384
6960992710,17cyclictest0-21swapper/407:45:524
6960992710,17cyclictest0-21swapper/407:45:514
6960992710,17cyclictest0-21swapper/407:13:204
6960992710,0cyclictest0-21swapper/408:42:154
6959992710,17cyclictest0-21swapper/307:59:353
6959992710,0cyclictest0-21swapper/308:42:103
6958992710,0cyclictest0-21swapper/207:45:152
6958992710,0cyclictest0-21swapper/207:45:142
6957992727,0cyclictest0-21swapper/108:42:151
6957992727,0cyclictest0-21swapper/107:59:411
6957992710,0cyclictest0-21swapper/107:45:391
6957992710,0cyclictest0-21swapper/107:45:381
6956992727,0cyclictest0-21swapper/007:45:160
6956992727,0cyclictest0-21swapper/007:45:160
6956992710,17cyclictest0-21swapper/008:42:100
6956992710,17cyclictest0-21swapper/007:59:370
122612270,0sleep00-21swapper/011:03:510
6962992626,0cyclictest0-21swapper/607:13:286
6961992626,0cyclictest0-21swapper/508:00:015
204992250,1sleep10-21swapper/110:50:251
6958992424,0cyclictest0-21swapper/207:13:262
102542240,0sleep30-21swapper/310:45:213
6959992315,5cyclictest41-21ksoftirqd/309:10:013
6959992312,7cyclictest41-21ksoftirqd/309:45:173
6959992214,1cyclictest121rcu_preempt09:25:123
6959992212,7cyclictest41-21ksoftirqd/310:28:483
6959992210,7cyclictest0-21swapper/308:25:133
6960992118,2cyclictest27354-21perf10:55:004
6959992113,5cyclictest41-21ksoftirqd/308:50:153
6959992112,6cyclictest41-21ksoftirqd/311:00:123
6959992112,6cyclictest41-21ksoftirqd/310:40:243
6959992112,6cyclictest41-21ksoftirqd/309:20:503
6959992112,6cyclictest41-21ksoftirqd/308:45:163
6959992112,5cyclictest131rcu_sched07:15:013
6959992111,7cyclictest41-21ksoftirqd/309:50:213
6959992111,6cyclictest41-21ksoftirqd/312:15:173
6959992111,6cyclictest41-21ksoftirqd/310:20:143
6959992111,6cyclictest41-21ksoftirqd/310:00:163
6959992111,6cyclictest41-21ksoftirqd/309:55:013
6959992111,6cyclictest41-21ksoftirqd/308:30:223
695699214,8cyclictest0-21swapper/010:25:010
6959992012,5cyclictest41-21ksoftirqd/310:50:183
6959992012,5cyclictest41-21ksoftirqd/307:20:163
6959992011,5cyclictest41-21ksoftirqd/308:38:053
6959992011,5cyclictest41-21ksoftirqd/308:38:053
6959992011,5cyclictest121rcu_preempt08:05:233
6959992011,2cyclictest121rcu_preempt08:05:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional