You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 14:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Jul 17, 2026 12:57:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225619975980,676cyclictest0-21swapper/411:45:544
225579975836,212cyclictest0-21swapper/010:56:370
2256199715120,84cyclictest5900-21ssh09:15:074
225629969112,42cyclictest0-21swapper/508:42:435
2255999679125,381cyclictest0-21swapper/209:42:432
2256299669114,296cyclictest23004-21ssh11:26:285
225609966975,378cyclictest0-21swapper/312:18:233
225609966975,378cyclictest0-21swapper/312:18:233
225629966671,592cyclictest0-21swapper/511:59:015
2255899661195,338cyclictest121rcu_preempt11:44:311
225629965862,380cyclictest0-21swapper/511:45:245
225629965820,169cyclictest6217-21diskmemload12:38:245
225629965256,593cyclictest32666-21ssh10:04:225
22558996371,211cyclictest0-21swapper/112:48:041
225579963687,338cyclictest0-21swapper/011:20:270
2256099634335,127cyclictest22555-21cyclictest08:55:503
2256099634335,127cyclictest22555-21cyclictest08:55:503
2256099629119,127cyclictest0-21swapper/311:17:313
225599962471,380cyclictest0-21swapper/209:19:562
2256099619150,297cyclictest18841-1kworker/u17:110:02:363
2256299618279,337cyclictest25553-1kworker/u17:110:54:105
225579961827,339cyclictest0-21swapper/011:30:340
225619961159,549cyclictest0-21swapper/409:18:014
225619961118,85cyclictest0-21swapper/409:42:444
225579961121,41cyclictest121rcu_preempt11:43:360
225589960610,465cyclictest0-21swapper/110:55:281
225589960312,3cyclictest0-21swapper/112:36:291
22558996016,84cyclictest0-21swapper/111:00:231
2256199597257,338cyclictest64450irq/122-eth012:27:124
22561995961,42cyclictest0-21swapper/412:47:174
2256499595256,84cyclictest27046-21grep11:30:227
22560995940,84cyclictest0-21swapper/310:58:373
22559995930,84cyclictest0-21swapper/212:15:252
22559995930,84cyclictest0-21swapper/212:15:252
22558995930,84cyclictest0-21swapper/111:59:011
2256099590124,211cyclictest0-21swapper/311:32:093
22558995900,81cyclictest0-21swapper/111:45:541
225629958977,509cyclictest0-21swapper/511:32:185
2255999588542,44cyclictest311rcuc/210:57:062
225599958834,380cyclictest0-21swapper/211:47:292
2256499587121,126cyclictest7055-21ssh12:39:357
225629958735,549cyclictest0-21swapper/512:12:195
225579958533,338cyclictest0-21swapper/011:45:480
225629958372,507cyclictest30132-21diskmemload09:42:445
225599958069,380cyclictest0-21swapper/207:25:152
2256399578238,338cyclictest25553-1kworker/u17:110:53:096
225589957523,126cyclictest0-21swapper/109:15:201
225579957362,380cyclictest0-21swapper/012:48:440
2256099572103,339cyclictest0-21swapper/310:13:533
225589956416,252cyclictest0-21swapper/111:30:111
225589955852,126cyclictest121rcu_preempt10:42:591
225579955746,126cyclictest0-21swapper/010:14:250
2256199556130,423cyclictest0-21swapper/411:42:344
225579955648,84cyclictest121rcu_preempt07:21:470
22563995510,84cyclictest0-21swapper/610:58:376
2256099551124,211cyclictest0-21swapper/310:43:443
225599955182,296cyclictest121rcu_preempt11:30:362
225639954938,428cyclictest0-21swapper/611:41:316
225619954981,380cyclictest0-21swapper/412:40:194
225619954841,423cyclictest0-21swapper/410:54:334
225599954878,211cyclictest33-21ksoftirqd/210:53:452
225629954737,507cyclictest0-21swapper/512:26:465
225589954779,211cyclictest0-21swapper/108:17:551
225619954635,507cyclictest0-21swapper/412:00:154
225629954577,211cyclictest0-21swapper/508:17:315
225599954580,300cyclictest721-21nscd10:11:502
225619954333,507cyclictest0-21swapper/407:25:034
2256199543289,84cyclictest30132-21diskmemload10:59:404
225599954332,84cyclictest0-21swapper/211:42:472
225629954231,508cyclictest0-21swapper/511:19:005
2255999542332,41cyclictest0-21swapper/208:17:022
225579954135,338cyclictest0-21swapper/010:51:540
225619954030,507cyclictest24616-21nscd11:29:324
2255799540117,86cyclictest0-21swapper/012:38:030
225589953931,126cyclictest0-21swapper/112:19:411
225589953931,126cyclictest0-21swapper/112:19:411
225619953824,126cyclictest0-21swapper/410:15:004
2255999538370,41cyclictest0-21swapper/211:17:212
225589953831,84cyclictest0-21swapper/109:15:111
225589953771,126cyclictest30132-21diskmemload10:02:351
2255799537197,338cyclictest8190-21kworker/u16:111:28:080
2256499536109,296cyclictest0-21swapper/711:17:317
225639953625,380cyclictest0-21swapper/608:42:046
225629953626,507cyclictest1784-21tr12:15:215
225629953626,507cyclictest1784-21tr12:15:215
225599953667,211cyclictest33-21ksoftirqd/210:04:042
225589953629,84cyclictest0-21swapper/110:13:531
225579953567,337cyclictest0-21swapper/009:11:470
2256199532104,253cyclictest0-21swapper/412:38:024
2256499529486,41cyclictest711rcuc/711:35:167
225629952961,338cyclictest121rcu_preempt09:19:155
225579952964,126cyclictest121rcu_preempt11:57:140
225579952917,338cyclictest0-21swapper/010:43:360
225599952820,84cyclictest0-21swapper/208:59:262
225599952820,84cyclictest0-21swapper/208:59:262
225599952516,84cyclictest0-21swapper/212:26:392
225599952355,338cyclictest0-21swapper/211:29:522
225639952216,338cyclictest0-21swapper/608:59:336
225639952216,338cyclictest0-21swapper/608:59:326
2256299522439,3cyclictest551rcuc/510:59:215
225579952211,381cyclictest0-21swapper/010:15:140
225619951817,161cyclictest0-21swapper/411:35:084
225579951711,7cyclictest0-21swapper/010:03:480
2255999514431,3cyclictest311rcuc/212:00:062
225639951145,126cyclictest1651-21ntpd11:26:286
22564995090,84cyclictest0-21swapper/710:59:137
225639950981,126cyclictest65-21ksoftirqd/609:15:066
22562995090,84cyclictest0-21swapper/508:59:065
22562995090,84cyclictest0-21swapper/508:59:065
225599950941,211cyclictest33-21ksoftirqd/209:13:272
22559995090,83cyclictest0-21swapper/212:39:372
22563995081,341cyclictest0-21swapper/611:30:546
2256399508124,296cyclictest0-21swapper/612:13:186
2255999508336,83cyclictest0-21swapper/211:58:532
225599950740,3cyclictest3505-21cpuspeed_turbos11:00:122
225589950641,256cyclictest0-21swapper/111:20:301
2255799506123,126cyclictest29147-21expr09:45:170
225619950535,380cyclictest1553-21runrttasks12:20:394
225599950578,211cyclictest8851-21ntp_states12:20:282
225639950480,211cyclictest0-21swapper/611:19:586
225619950439,302cyclictest0-21swapper/411:58:524
2256099504120,296cyclictest0-21swapper/312:39:523
225579950238,218cyclictest0-21swapper/009:19:430
225639950132,296cyclictest0-21swapper/608:17:326
225619950178,169cyclictest0-21swapper/410:15:104
225619950132,466cyclictest0-21swapper/411:30:224
225639950034,85cyclictest0-21swapper/610:44:086
2255799500244,253cyclictest30132-21diskmemload12:26:370
225629949934,380cyclictest0-21swapper/509:14:235
225629949931,84cyclictest0-21swapper/507:23:505
225609949977,84cyclictest0-21swapper/312:27:323
225589949977,84cyclictest0-21swapper/112:27:311
225639949875,126cyclictest0-21swapper/612:15:106
225639949875,126cyclictest0-21swapper/612:15:106
225579949829,338cyclictest0-21swapper/012:12:430
225599949773,84cyclictest121rcu_preempt12:14:552
225589949731,126cyclictest0-21swapper/111:28:101
2256299496117,295cyclictest0-21swapper/511:20:245
225619949681,203cyclictest0-21swapper/407:20:514
225619949674,338cyclictest0-21swapper/412:17:554
225619949674,338cyclictest0-21swapper/412:17:554
225649949530,168cyclictest0-21swapper/710:02:357
2256499495111,296cyclictest4677-21kworker/u16:011:44:537
225579949531,219cyclictest0-21swapper/012:15:320
225579949531,219cyclictest0-21swapper/012:15:310
225609949426,211cyclictest0-21swapper/311:57:513
2256499493108,338cyclictest0-21swapper/711:27:007
225579949371,84cyclictest0-21swapper/011:35:190
2256499492154,171cyclictest721ktimersoftd/709:13:247
2256399492237,253cyclictest641ktimersoftd/611:46:296
2256199492112,211cyclictest0-21swapper/410:45:004
225589949068,80cyclictest0-21swapper/110:53:111
225639948923,211cyclictest0-21swapper/610:45:116
2256199489109,296cyclictest0-21swapper/411:20:244
2256299488104,338cyclictest0-21swapper/512:49:565
2256399487106,84cyclictest1551-21snmpd11:00:216
225589948764,85cyclictest30358-21runrttasks12:11:511
225649948660,211cyclictest18447-21ssh10:14:267
2256499486145,339cyclictest22555-21cyclictest11:58:067
225589948621,253cyclictest0-21swapper/112:20:031
225609948523,288cyclictest0-21swapper/312:46:593
225649948260,84cyclictest11088-21ssh11:20:287
225589948117,293cyclictest0-21swapper/112:00:261
225579948016,44cyclictest0-21swapper/008:19:550
225649947752,84cyclictest0-21swapper/712:48:467
225639947712,381cyclictest22555-21cyclictest12:48:216
225629947794,295cyclictest0-21swapper/512:40:145
22557994779,380cyclictest0-21swapper/009:44:270
22562994768,42cyclictest0-21swapper/511:50:085
22562994768,42cyclictest0-21swapper/511:50:085
225609947610,212cyclictest0-21swapper/310:53:093
225649947412,288cyclictest0-21swapper/711:47:027
225589947452,84cyclictest0-21swapper/108:43:241
225649947190,126cyclictest0-21swapper/709:43:017
22563994691,298cyclictest0-21swapper/611:58:046
22561994691,338cyclictest0-21swapper/410:02:224
22557994691,380cyclictest0-21swapper/008:59:300
22557994691,380cyclictest0-21swapper/008:59:290
22560994683,256cyclictest0-21swapper/311:20:293
22561994670,41cyclictest0-21swapper/412:12:454
2256499465124,338cyclictest0-21swapper/711:00:127
225609946583,126cyclictest0-21swapper/312:40:033
2256099465124,338cyclictest0-21swapper/312:00:343
2256499464122,339cyclictest0-21swapper/708:59:267
2256499464122,339cyclictest0-21swapper/708:59:267
2256099464338,42cyclictest391rcuc/312:20:413
2256099464125,336cyclictest0-21swapper/311:00:033
2256099464123,338cyclictest10879-21ssh09:18:153
2256399463123,338cyclictest0-21swapper/610:00:326
225629946341,177cyclictest0-21swapper/511:42:195
2256499462120,339cyclictest0-21swapper/712:14:407
225579946282,84cyclictest0-21swapper/011:18:480
225649946139,85cyclictest0-21swapper/708:42:087
225639946177,168cyclictest12730-21ssh09:20:046
2256399461122,84cyclictest0-21swapper/609:19:006
225609946138,257cyclictest0-21swapper/307:21:463
225599946138,85cyclictest0-21swapper/212:46:162
225639946038,2cyclictest0-21swapper/607:21:456
2256399460120,338cyclictest0-21swapper/612:38:416
2256399460119,339cyclictest8715-21ssh12:20:256
225609946034,299cyclictest0-21swapper/312:14:053
225579946034,253cyclictest0-21swapper/009:00:240
2256499459117,296cyclictest0-21swapper/710:44:307
225629945934,422cyclictest0-21swapper/512:20:245
225619945938,83cyclictest121rcu_preempt08:58:244
225619945938,83cyclictest121rcu_preempt08:58:234
225619945936,256cyclictest0-21swapper/409:45:054
225609945978,84cyclictest0-21swapper/309:13:443
2256099459415,42cyclictest391rcuc/309:00:233
2256099459118,338cyclictest0-21swapper/311:45:163
2256099459116,340cyclictest0-21swapper/311:29:323
225599945975,168cyclictest0-21swapper/210:42:442
225589945976,380cyclictest0-21swapper/110:15:241
225639945837,255cyclictest0-21swapper/611:50:046
225639945837,255cyclictest0-21swapper/611:50:046
225629945832,84cyclictest0-21swapper/510:12:265
2256199458119,84cyclictest0-21swapper/411:19:244
2256099458117,338cyclictest0-21swapper/309:43:043
2256499457199,126cyclictest121rcu_preempt09:17:257
2256499457116,338cyclictest3646-21ssh12:16:157
2256499457116,338cyclictest3646-21ssh12:16:157
225639945735,256cyclictest0-21swapper/612:27:426
2256399457118,84cyclictest0-21swapper/611:20:246
225599945735,3cyclictest0-21swapper/211:35:082
225589945784,248cyclictest0-21swapper/111:19:451
225649945675,85cyclictest0-21swapper/712:27:317
225629945676,84cyclictest0-21swapper/510:44:025
225629945634,343cyclictest32616-21gltestperf11:35:165
225599945633,254cyclictest0-21swapper/207:24:272
225589945572,211cyclictest0-21swapper/109:43:281
2256499454117,170cyclictest0-21swapper/711:50:047
2256499454117,170cyclictest0-21swapper/711:50:047
225579945432,338cyclictest12519-21cstates10:45:140
2256499453113,338cyclictest0-21swapper/708:19:467
225629945331,255cyclictest0-21swapper/511:00:215
225579945373,214cyclictest7074-21ssh12:00:150
225639945276,121cyclictest0-21swapper/609:00:116
2255899452238,126cyclictest22102-21cpu11:50:121
2255899452238,126cyclictest22102-21cpu11:50:121
225649945129,257cyclictest0-21swapper/712:20:087
2256399451111,338cyclictest0-21swapper/612:00:256
2256299451108,340cyclictest28675-21ssh09:45:055
225619945125,126cyclictest0-21swapper/408:45:054
2256499450109,338cyclictest0-21swapper/709:00:227
225599945028,2cyclictest0-21swapper/210:15:092
2256099449106,340cyclictest0-21swapper/311:41:473
225579944926,300cyclictest0-21swapper/011:50:050
225579944926,300cyclictest0-21swapper/011:50:050
225619944725,255cyclictest4540-21/usr/sbin/munin11:00:214
225579944723,292cyclictest0-21swapper/011:00:040
225589944624,42cyclictest0-21swapper/107:24:521
2256099445401,42cyclictest391rcuc/311:35:033
225579944523,36cyclictest0-21swapper/008:42:090
225579944521,126cyclictest0-21swapper/007:25:140
2256499444105,84cyclictest0-21swapper/707:24:167
225639944465,84cyclictest0-21swapper/611:35:196
225639944460,296cyclictest0-21swapper/610:12:446
2256299442101,338cyclictest0-21swapper/510:15:205
225619944220,86cyclictest12873-21apt-get09:20:124
2256099442186,253cyclictest401ktimersoftd/310:45:113
225579944018,177cyclictest0-21swapper/009:20:120
225639943796,338cyclictest0-21swapper/612:40:326
225579943613,258cyclictest0-21swapper/012:40:070
225599943412,256cyclictest0-21swapper/208:44:462
225589943415,123cyclictest24536-21munin-node09:00:101
225649943295,82cyclictest0-21swapper/710:54:537
22557994325,169cyclictest0-21swapper/012:20:200
22562994282,168cyclictest0-21swapper/507:25:145
22561994281,211cyclictest49-21ksoftirqd/409:00:154
22558994275,2cyclictest0-21swapper/109:45:181
225619942383,84cyclictest0-21swapper/411:50:074
225619942383,84cyclictest0-21swapper/411:50:074
225619942382,338cyclictest0-21swapper/410:45:114
225639942282,337cyclictest0-21swapper/609:45:136
225649942183,84cyclictest0-21swapper/712:40:237
225629942141,296cyclictest0-21swapper/512:00:035
225629942140,292cyclictest0-21swapper/509:00:115
225589942182,84cyclictest0-21swapper/110:45:131
225649942077,169cyclictest73-21ksoftirqd/710:45:137
2255999420120,127cyclictest0-21swapper/212:40:022
225649941980,85cyclictest1553-21runrttasks09:20:127
225629941978,338cyclictest0-21swapper/510:45:135
225639941735,127cyclictest0-21swapper/609:42:546
225579941737,296cyclictest0-21swapper/008:45:060
225609941677,84cyclictest0-21swapper/308:17:293
225639941577,84cyclictest0-21swapper/610:15:116
225639941575,338cyclictest0-21swapper/607:25:056
225599941574,338cyclictest0-21swapper/211:50:042
225599941574,338cyclictest0-21swapper/211:50:042
2255899415159,126cyclictest121rcu_preempt09:00:011
225589941430,219cyclictest0-21swapper/109:20:041
2256099413114,297cyclictest0-21swapper/310:15:243
225589941274,84cyclictest0-21swapper/108:59:311
225599941170,338cyclictest10971-21missed_timers11:20:242
225629941069,338cyclictest0-21swapper/509:20:115
225609941028,85cyclictest0-21swapper/311:50:183
225609941028,85cyclictest0-21swapper/311:50:183
225639940968,338cyclictest1651-21ntpd08:45:106
225639940767,338cyclictest0-21swapper/610:05:076
225589940770,83cyclictest0-21swapper/111:35:201
225619940665,338cyclictest0-21swapper/408:42:094
225649940465,84cyclictest0-21swapper/710:15:037
225649940465,84cyclictest0-21swapper/709:45:147
225589940058,126cyclictest121rcu_preempt12:40:121
225619939958,338cyclictest0-21swapper/408:18:204
225599939919,3cyclictest0-21swapper/209:00:232
225599939716,256cyclictest121rcu_preempt09:45:182
225609939118,253cyclictest0-21swapper/309:20:133
225649938647,84cyclictest0-21swapper/712:00:247
225589938546,84cyclictest0-21swapper/110:05:061
2256099384127,84cyclictest121rcu_preempt08:44:363
225629938381,211cyclictest57-21ksoftirqd/510:05:075
225619938140,338cyclictest0-21swapper/410:05:074
225609937940,84cyclictest0-21swapper/309:45:043
225599937940,84cyclictest0-21swapper/208:45:062
225599937234,3cyclictest0-21swapper/210:45:082
225649937174,211cyclictest0-21swapper/710:05:097
225609937174,84cyclictest0-21swapper/307:25:153
225599937133,257cyclictest1352-21ssh10:05:092
225599937031,84cyclictest0-21swapper/209:20:042
225589936873,211cyclictest0-21swapper/107:25:151
225649936727,85cyclictest0-21swapper/707:25:147
225609936165,212cyclictest0-21swapper/310:05:083
225579935013,253cyclictest0-21swapper/010:05:070
2256099340129,130cyclictest22555-21cyclictest08:45:053
225629933680,253cyclictest0-21swapper/508:45:105
225589932975,84cyclictest0-21swapper/108:45:061
225649928028,84cyclictest0-21swapper/708:45:047
201612106100,4sleep40-21swapper/407:05:144
2184329345,26sleep00-21swapper/007:05:590
2198628750,8sleep30-21swapper/307:08:033
2183928655,27sleep50-21swapper/507:05:555
2203228554,27sleep10-21swapper/107:08:401
2208628351,28sleep70-21swapper/707:09:277
2197628353,27sleep20-21swapper/207:07:542
174322830,0sleep20-21swapper/212:05:162
2185828149,28sleep60-21swapper/607:06:126
25112760,0sleep70-21swapper/708:20:237
292342740,1sleep60-21swapper/612:32:326
22557993424,7cyclictest0-21swapper/010:36:570
22563993310,0cyclictest0-21swapper/607:53:536
22563993210,21cyclictest0-21swapper/608:08:046
22563993210,0cyclictest0-21swapper/608:33:566
22563993026,3cyclictest0-21swapper/608:27:226
22563993025,5cyclictest0-21swapper/607:46:026
22563993024,5cyclictest0-21swapper/610:36:566
22564992910,19cyclictest0-21swapper/707:13:537
22558992910,18cyclictest0-21swapper/107:46:351
22557992926,2cyclictest0-21swapper/008:08:090
22557992910,19cyclictest0-21swapper/008:27:170
22564992827,1cyclictest0-21swapper/707:53:597
22564992810,18cyclictest0-21swapper/707:46:277
22564992810,0cyclictest0-21swapper/710:27:477
22563992810,17cyclictest0-21swapper/610:27:186
22563992810,17cyclictest0-21swapper/607:33:556
22562992810,18cyclictest0-21swapper/507:13:275
22562992810,17cyclictest0-21swapper/510:37:055
22560992810,18cyclictest0-21swapper/310:36:363
22560992810,18cyclictest0-21swapper/310:27:133
22560992810,18cyclictest0-21swapper/307:41:053
22560992810,0cyclictest0-21swapper/308:08:063
22559992810,0cyclictest0-21swapper/207:13:462
22557992810,18cyclictest0-21swapper/008:33:590
22557992810,17cyclictest0-21swapper/010:27:420
22557992810,17cyclictest0-21swapper/008:02:210
22557992810,17cyclictest0-21swapper/008:02:210
22557992810,17cyclictest0-21swapper/007:53:400
22564992727,0cyclictest0-21swapper/708:01:537
22564992727,0cyclictest0-21swapper/708:01:537
22564992710,17cyclictest0-21swapper/710:36:187
22564992710,17cyclictest0-21swapper/708:34:147
22564992710,17cyclictest0-21swapper/708:27:127
22564992710,17cyclictest0-21swapper/707:40:537
22564992710,0cyclictest0-21swapper/708:08:077
22564992710,0cyclictest0-21swapper/707:34:107
22563992727,0cyclictest0-21swapper/607:13:346
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional