You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 21:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue May 05, 2026 12:57:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
43309979733,761cyclictest0-21swapper/112:35:071
43309973152,84cyclictest0-21swapper/112:24:441
432999674124,126cyclictest0-21swapper/010:23:340
43309965962,380cyclictest0-21swapper/110:02:481
43309965522,85cyclictest25-21ksoftirqd/112:04:021
4331996351,2cyclictest0-21swapper/212:32:382
43339963240,382cyclictest0-21swapper/412:32:374
43329962328,379cyclictest0-21swapper/312:41:163
43309962375,460cyclictest27332-21sh11:58:351
43349960918,382cyclictest0-21swapper/512:32:375
4330996049,380cyclictest0-21swapper/111:43:521
4332995950,85cyclictest0-21swapper/310:01:053
4333995940,84cyclictest0-21swapper/410:01:054
4334995930,84cyclictest0-21swapper/510:51:175
43309958674,380cyclictest121rcu_preempt11:19:291
433199585114,296cyclictest29769-21chrt12:19:072
43369958433,340cyclictest0-21swapper/710:49:547
43369958433,340cyclictest0-21swapper/710:49:537
43299958231,135cyclictest10834-21ssh10:53:020
43309957968,338cyclictest0-21swapper/109:59:321
433199573191,84cyclictest14185-1kworker/u17:111:42:402
433399571106,84cyclictest121rcu_preempt11:00:364
433099571103,380cyclictest0-21swapper/110:53:061
433099568102,127cyclictest0-21swapper/111:20:091
43309956613,550cyclictest0-21swapper/112:18:111
43309956613,550cyclictest0-21swapper/111:31:391
433699564227,170cyclictest12318-21diskmemload11:57:047
43309956011,207cyclictest32752-21cstates11:25:181
4330995577,126cyclictest0-21swapper/112:05:021
4330995553,549cyclictest0-21swapper/111:45:291
433099554170,127cyclictest25-21ksoftirqd/111:05:171
4333995501,127cyclictest0-21swapper/412:21:024
433599545115,126cyclictest0-21swapper/612:24:266
43349954539,43cyclictest20550-21ssh10:23:565
43329954476,465cyclictest0-21swapper/312:00:153
43319954375,465cyclictest0-21swapper/208:13:462
43309954376,253cyclictest0-21swapper/111:02:171
43309954333,507cyclictest0-21swapper/107:43:081
43309954333,507cyclictest0-21swapper/107:43:081
432999542285,84cyclictest0-21swapper/011:34:530
43369954130,338cyclictest0-21swapper/712:34:457
43359953932,168cyclictest0-21swapper/610:53:166
43329953931,215cyclictest41-21ksoftirqd/309:59:553
43309953931,425cyclictest0-21swapper/112:31:161
43309953871,254cyclictest121rcu_preempt07:45:221
43319953771,126cyclictest121rcu_preempt12:42:212
43349953527,126cyclictest0-21swapper/511:20:425
432999535110,127cyclictest1551-21snmpd11:59:520
433699534192,126cyclictest0-21swapper/711:20:547
43339953466,295cyclictest0-21swapper/411:24:004
43339953466,253cyclictest0-21swapper/410:55:034
43299953427,256cyclictest0-21swapper/012:32:370
43329952617,127cyclictest0-21swapper/311:19:393
433599524185,84cyclictest12318-21diskmemload12:18:146
43349952110,466cyclictest0-21swapper/512:04:225
43339952055,126cyclictest0-21swapper/409:59:324
43299951791,253cyclictest9-21ksoftirqd/011:20:290
43299951446,84cyclictest121rcu_preempt10:25:240
43299951446,84cyclictest121rcu_preempt10:25:240
4331995131,338cyclictest0-21swapper/212:03:022
4332995101,50cyclictest121rcu_preempt12:20:103
433299510125,127cyclictest41-21ksoftirqd/311:34:283
4335995090,84cyclictest0-21swapper/611:58:416
4335995090,84cyclictest0-21swapper/610:01:056
4332995091,3cyclictest0-21swapper/312:32:373
4332995090,84cyclictest0-21swapper/311:58:413
4329995090,84cyclictest0-21swapper/011:04:010
4334995080,84cyclictest13642-21ssh10:01:055
4333995080,84cyclictest0-21swapper/411:58:414
43309950840,465cyclictest0-21swapper/108:42:481
43339950681,422cyclictest0-21swapper/412:19:344
432999505419,84cyclictest111rcuc/011:05:040
43369950439,296cyclictest0-21swapper/711:33:177
43309950437,250cyclictest0-21swapper/112:41:501
43349950380,84cyclictest121rcu_preempt11:58:275
433399503420,3cyclictest471rcuc/412:04:034
43349949934,297cyclictest0-21swapper/511:25:135
433499499157,339cyclictest1452-1kworker/u17:112:05:155
43299949935,43cyclictest121rcu_preempt10:02:350
43319949828,254cyclictest0-21swapper/211:32:292
433699496236,84cyclictest0-21swapper/712:21:087
433599496154,127cyclictest121rcu_preempt12:00:436
43369949531,296cyclictest0-21swapper/711:25:137
43359949224,3cyclictest0-21swapper/611:31:196
43299949228,8cyclictest0-21swapper/009:59:060
43319949121,422cyclictest121rcu_preempt11:57:202
43319948925,298cyclictest0-21swapper/211:00:502
433399488107,126cyclictest0-21swapper/412:42:434
43319948860,169cyclictest33-21ksoftirqd/210:01:242
43299948867,255cyclictest4327-21cyclictest12:03:140
43339948664,84cyclictest0-21swapper/412:05:174
433199486230,126cyclictest0-21swapper/211:25:142
432999486102,126cyclictest1368-21runrttasks11:25:370
433599484401,3cyclictest631rcuc/607:44:046
433599484401,3cyclictest631rcuc/607:44:046
43329948397,211cyclictest0-21swapper/311:45:243
43339948218,296cyclictest0-21swapper/411:25:134
43369947915,380cyclictest0-21swapper/712:03:367
43339947958,84cyclictest0-21swapper/411:43:334
43299947995,253cyclictest121rcu_preempt07:43:170
43299947995,253cyclictest121rcu_preempt07:43:170
433299476313,37cyclictest391rcuc/310:23:473
43309947654,338cyclictest0-21swapper/110:49:591
43309947654,338cyclictest0-21swapper/110:49:591
43299947548,253cyclictest1651-21ntpd12:20:100
4330994746,465cyclictest0-21swapper/110:24:581
43299947351,84cyclictest0-21swapper/012:05:170
43319947043,211cyclictest0-21swapper/208:44:042
4329994696,289cyclictest0-21swapper/012:19:400
4332994683,3cyclictest0-21swapper/311:22:583
43299946818,3cyclictest0-21swapper/012:25:080
4336994670,126cyclictest13339-21sh10:00:367
4334994671,84cyclictest0-21swapper/511:05:035
433699466125,338cyclictest0-21swapper/711:18:337
433299466379,84cyclictest391rcuc/311:01:423
4332994661,298cyclictest0-21swapper/311:25:133
43309946641,258cyclictest0-21swapper/110:25:181
43309946641,258cyclictest0-21swapper/110:25:181
43319946580,211cyclictest33-21ksoftirqd/212:05:072
43369946441,256cyclictest0-21swapper/710:50:097
43339946442,2cyclictest0-21swapper/411:34:494
43329946488,292cyclictest0-21swapper/310:50:583
433099464127,168cyclictest16437-21cat11:35:131
43359946341,2cyclictest0-21swapper/612:31:576
43359946341,2cyclictest0-21swapper/611:24:376
43349946378,169cyclictest57-21ksoftirqd/512:24:505
433299463123,338cyclictest0-21swapper/308:14:503
432999463207,126cyclictest121rcu_preempt08:13:510
43359946278,211cyclictest0-21swapper/610:24:096
433399462122,337cyclictest0-21swapper/410:50:324
43319946239,299cyclictest0-21swapper/210:52:192
43299946239,168cyclictest0-21swapper/011:45:130
43359946181,296cyclictest3499-21fschecks_count12:05:166
433299461416,42cyclictest391rcuc/311:44:363
43319946135,211cyclictest0-21swapper/212:23:272
43299946139,255cyclictest0-21swapper/012:41:360
433699460119,339cyclictest0-21swapper/711:42:397
43299946033,211cyclictest0-21swapper/012:35:050
43349945938,255cyclictest0-21swapper/507:44:035
43349945938,255cyclictest0-21swapper/507:44:035
43339945978,84cyclictest0-21swapper/410:24:414
43319945937,256cyclictest0-21swapper/211:20:172
4330994591,120cyclictest0-21swapper/108:15:001
43369945836,256cyclictest0-21swapper/712:44:387
43359945835,3cyclictest0-21swapper/611:44:096
43349945877,208cyclictest0-21swapper/512:42:535
433499458115,169cyclictest32335-21ssh11:44:055
433299458118,337cyclictest0-21swapper/310:25:183
433299458118,337cyclictest0-21swapper/310:25:183
4330994581,291cyclictest0-21swapper/110:55:051
43369945734,256cyclictest1551-21snmpd08:43:117
43359945734,3cyclictest0-21swapper/608:43:516
43329945735,3cyclictest0-21swapper/312:19:553
43359945634,2cyclictest0-21swapper/609:58:156
433299456114,127cyclictest41-21ksoftirqd/307:44:303
433299456114,127cyclictest41-21ksoftirqd/307:44:293
433699455115,338cyclictest0-21swapper/711:04:077
43369945428,253cyclictest0-21swapper/711:05:037
433599454112,339cyclictest0-21swapper/611:19:276
43349945331,2cyclictest0-21swapper/511:34:555
43329945331,3cyclictest0-21swapper/308:41:373
433299453112,338cyclictest0-21swapper/312:25:123
43319945329,208cyclictest0-21swapper/209:58:112
433599452110,126cyclictest65-21ksoftirqd/610:49:356
433599452110,126cyclictest65-21ksoftirqd/610:49:356
43349945229,257cyclictest28269-21diskmemload12:17:255
43299945129,84cyclictest0-21swapper/011:35:120
43329945026,127cyclictest0-21swapper/311:05:033
433599449107,339cyclictest5124-21sh12:43:366
433699448107,338cyclictest22687-21ssh10:25:187
433699448107,338cyclictest22687-21ssh10:25:187
43339944827,255cyclictest0-21swapper/407:44:504
43339944827,255cyclictest0-21swapper/407:44:504
43309944822,423cyclictest0-21swapper/108:45:111
433299447148,129cyclictest121rcu_preempt10:49:383
433299447148,129cyclictest121rcu_preempt10:49:383
43369944624,83cyclictest0-21swapper/710:23:397
43319944523,256cyclictest1553-21runrttasks10:49:282
43319944523,256cyclictest1553-21runrttasks10:49:282
43349944417,84cyclictest0-21swapper/511:18:365
43359944321,256cyclictest0-21swapper/611:02:136
433399443145,85cyclictest121rcu_preempt11:17:454
43319944321,256cyclictest0-21swapper/207:44:212
43319944321,256cyclictest0-21swapper/207:44:212
433099443103,338cyclictest4781-21ssh12:25:131
43299944364,212cyclictest20334-21nscd10:49:230
43299944364,212cyclictest20334-21nscd10:49:230
43369944220,4cyclictest0-21swapper/711:45:137
43369944018,3cyclictest0-21swapper/712:20:017
43349944018,256cyclictest0-21swapper/510:55:055
43319944061,168cyclictest33-21ksoftirqd/210:55:112
43349943857,126cyclictest1551-21snmpd11:04:375
43369943715,3cyclictest0-21swapper/707:44:217
43369943715,3cyclictest0-21swapper/707:44:217
43319943553,127cyclictest0-21swapper/211:19:382
4335994349,256cyclictest16288-21rm11:35:066
43349943210,3cyclictest0-21swapper/508:42:435
43299943052,247cyclictest0-21swapper/011:19:150
4333994253,42cyclictest0-21swapper/412:35:234
4332994253,256cyclictest0-21swapper/310:55:053
4334994241,256cyclictest0-21swapper/508:14:315
4329994242,2cyclictest0-21swapper/011:43:300
43319942380,127cyclictest33-21ksoftirqd/212:35:032
4329994231,2cyclictest0-21swapper/010:55:050
43339942282,337cyclictest0-21swapper/408:45:114
4333994223,41cyclictest121rcu_preempt10:25:244
4333994223,41cyclictest121rcu_preempt10:25:244
43319942181,338cyclictest0-21swapper/210:25:352
43319942181,338cyclictest0-21swapper/210:25:352
43319942181,338cyclictest0-21swapper/210:24:092
43319942181,338cyclictest0-21swapper/207:45:142
43319942179,339cyclictest0-21swapper/211:35:112
43359941979,338cyclictest0-21swapper/611:25:296
43359941880,126cyclictest65-21ksoftirqd/608:13:266
43339941840,2cyclictest0-21swapper/410:49:284
43339941840,2cyclictest0-21swapper/410:49:284
43319941838,296cyclictest0-21swapper/211:45:022
43299941879,84cyclictest0-21swapper/008:42:560
43359941675,338cyclictest0-21swapper/611:45:256
43339941675,338cyclictest0-21swapper/408:14:394
43319941675,338cyclictest0-21swapper/208:45:112
43299941632,84cyclictest0-21swapper/007:45:090
43339941574,338cyclictest4771-21apt12:25:124
43319941535,296cyclictest0-21swapper/212:25:112
43369941474,338cyclictest0-21swapper/709:59:157
43359941473,338cyclictest0-21swapper/610:25:116
43359941473,338cyclictest0-21swapper/610:25:116
43349941474,337cyclictest0-21swapper/510:49:125
43349941474,337cyclictest0-21swapper/510:49:125
43349941372,338cyclictest0-21swapper/511:35:125
43349941271,338cyclictest0-21swapper/509:58:565
43359941069,338cyclictest0-21swapper/611:05:116
43369940966,127cyclictest121rcu_preempt07:45:147
43349940968,338cyclictest0-21swapper/508:45:115
43339940929,212cyclictest0-21swapper/408:43:384
43349940665,126cyclictest0-21swapper/510:25:185
43349940665,126cyclictest0-21swapper/510:25:185
43369940361,126cyclictest121rcu_preempt08:14:447
43339940359,253cyclictest0-21swapper/411:35:114
43359940163,172cyclictest4327-21cyclictest07:45:246
43309940160,338cyclictest0-21swapper/108:15:081
43369940059,338cyclictest0-21swapper/712:25:127
43329939958,338cyclictest0-21swapper/312:35:223
43349939752,126cyclictest0-21swapper/512:25:075
43369939653,126cyclictest73-21ksoftirqd/712:35:137
43329939558,334cyclictest0-21swapper/311:35:113
4335993949,211cyclictest65-21ksoftirqd/612:35:236
43339939498,84cyclictest0-21swapper/411:45:114
43329939251,338cyclictest0-21swapper/307:45:223
433499386129,126cyclictest121rcu_preempt07:45:225
43349938283,296cyclictest0-21swapper/512:35:145
4335993811,3cyclictest0-21swapper/612:25:086
43359937740,2cyclictest0-21swapper/610:55:056
43319937739,171cyclictest0-21swapper/208:15:092
43369937534,338cyclictest0-21swapper/710:55:117
43319937533,339cyclictest31220-21taskset11:05:172
43359937437,2cyclictest0-21swapper/608:15:096
43339937437,3cyclictest0-21swapper/408:15:094
43339937335,3cyclictest0-21swapper/407:45:184
43369936928,338cyclictest0-21swapper/712:05:077
43349936932,2cyclictest0-21swapper/511:45:355
433699365107,84cyclictest16365-21ssh11:35:117
43349935517,3cyclictest0-21swapper/508:15:095
43329935454,127cyclictest41-21ksoftirqd/312:05:073
43329933578,126cyclictest121rcu_preempt08:45:013
433299335252,3cyclictest391rcuc/308:15:103
433599334250,3cyclictest631rcuc/608:45:116
433399334120,84cyclictest121rcu_preempt11:05:194
43369933134,42cyclictest0-21swapper/708:15:097
43299932470,84cyclictest299552chrt08:45:110
43299931359,84cyclictest0-21swapper/008:15:100
43369929037,172cyclictest0-21swapper/708:45:117
2037210095,2sleep00-21swapper/007:05:150
357629290,1sleep30-21swapper/307:05:263
357828544,36sleep40-21swapper/407:05:274
382728353,27sleep70-21swapper/707:08:597
388928149,28sleep20-21swapper/207:09:502
370128149,28sleep60-21swapper/607:07:146
367327949,27sleep50-21swapper/507:06:485
364027948,27sleep10-21swapper/107:06:201
248152770,0sleep10-21swapper/109:48:081
218702720,0sleep50-21swapper/510:06:365
4330993010,19cyclictest0-21swapper/109:33:011
4332992910,19cyclictest0-21swapper/309:32:273
4330992926,2cyclictest0-21swapper/108:39:421
4330992910,2cyclictest0-21swapper/109:04:001
93902280,0sleep60-21swapper/610:17:586
4336992810,18cyclictest0-21swapper/708:31:367
4335992810,18cyclictest0-21swapper/607:13:446
4332992810,18cyclictest0-21swapper/309:17:303
4332992810,18cyclictest0-21swapper/307:22:533
4332992810,0cyclictest0-21swapper/309:49:013
4332992810,0cyclictest0-21swapper/308:31:523
4331992810,18cyclictest0-21swapper/209:18:152
4330992810,18cyclictest0-21swapper/107:13:481
4329992810,18cyclictest0-21swapper/009:49:290
4336992727,0cyclictest0-21swapper/709:17:357
4336992727,0cyclictest0-21swapper/709:03:437
4336992727,0cyclictest0-21swapper/707:22:557
4336992710,17cyclictest0-21swapper/709:49:147
4336992710,0cyclictest0-21swapper/709:32:177
4336992710,0cyclictest0-21swapper/707:31:397
4335992710,17cyclictest0-21swapper/609:49:006
4335992710,17cyclictest0-21swapper/609:17:306
4335992710,17cyclictest0-21swapper/609:03:276
4335992710,17cyclictest0-21swapper/608:31:546
4335992710,17cyclictest0-21swapper/608:01:276
4335992710,17cyclictest0-21swapper/607:31:426
4335992710,17cyclictest0-21swapper/607:22:546
4335992710,0cyclictest0-21swapper/609:32:226
4334992727,0cyclictest0-21swapper/509:49:005
4334992727,0cyclictest0-21swapper/508:01:285
4334992727,0cyclictest0-21swapper/507:13:405
4334992710,17cyclictest0-21swapper/509:03:265
4334992710,17cyclictest0-21swapper/508:39:405
4334992710,17cyclictest0-21swapper/507:31:555
4334992710,0cyclictest0-21swapper/509:32:195
4334992710,0cyclictest0-21swapper/509:17:445
4334992710,0cyclictest0-21swapper/508:31:385
4334992710,0cyclictest0-21swapper/507:22:535
4333992727,0cyclictest0-21swapper/409:49:094
4333992710,17cyclictest0-21swapper/407:22:504
4333992710,17cyclictest0-21swapper/407:13:524
4333992710,0cyclictest0-21swapper/409:32:254
4333992710,0cyclictest0-21swapper/409:17:264
4333992710,0cyclictest0-21swapper/408:31:534
4332992727,0cyclictest0-21swapper/308:01:323
4332992727,0cyclictest0-21swapper/307:13:423
4332992710,0cyclictest0-21swapper/309:03:273
4332992710,0cyclictest0-21swapper/308:39:453
4332992710,0cyclictest0-21swapper/307:31:463
4331992710,17cyclictest0-21swapper/209:49:002
4331992710,17cyclictest0-21swapper/209:32:172
4331992710,17cyclictest0-21swapper/209:03:532
4331992710,17cyclictest0-21swapper/208:31:422
4331992710,17cyclictest0-21swapper/208:01:332
4331992710,17cyclictest0-21swapper/207:31:422
4331992710,17cyclictest0-21swapper/207:23:112
4330992710,17cyclictest0-21swapper/108:31:321
4330992710,0cyclictest0-21swapper/109:17:311
4330992710,0cyclictest0-21swapper/108:01:381
4330992710,0cyclictest0-21swapper/107:31:411
4330992710,0cyclictest0-21swapper/107:22:541
4329992727,0cyclictest0-21swapper/008:01:370
4329992710,17cyclictest0-21swapper/009:32:170
4329992710,17cyclictest0-21swapper/009:17:270
4329992710,17cyclictest0-21swapper/009:03:320
4329992710,17cyclictest0-21swapper/008:39:450
4329992710,17cyclictest0-21swapper/008:31:350
4329992710,17cyclictest0-21swapper/007:31:510
4329992710,17cyclictest0-21swapper/007:22:440
4336992626,0cyclictest0-21swapper/708:39:447
4336992626,0cyclictest0-21swapper/708:02:027
4333992626,0cyclictest0-21swapper/407:32:164
4333992610,0cyclictest0-21swapper/408:39:424
4331992626,0cyclictest0-21swapper/208:39:432
4329992626,0cyclictest0-21swapper/007:13:410
4335992525,0cyclictest0-21swapper/608:39:406
4333992525,0cyclictest0-21swapper/409:03:224
4331992525,0cyclictest0-21swapper/207:13:452
86602220,0sleep50-21swapper/510:34:555
4333992222,0cyclictest0-21swapper/408:01:274
4336992121,0cyclictest0-21swapper/707:14:137
433099219,11cyclictest13834-21grep09:25:241
433099207,11cyclictest13190-21sh09:42:161
433099200,11cyclictest7378-21rm10:16:371
433099198,10cyclictest5876-21dpkg08:05:121
433099198,10cyclictest32749-21df09:35:131
4330991910,8cyclictest19075-21ssh11:54:101
152972190,1sleep40-21swapper/409:10:234
128882190,1sleep20-21swapper/209:25:182
433099188,9cyclictest28431-21ssh09:50:121
155272180,0sleep50-21swapper/510:37:435
8802170,0sleep10-21swapper/110:14:011
433099178,8cyclictest5148-21cat08:55:171
433099178,8cyclictest25561-21rm10:09:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional