You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 01:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Apr 01, 2026 12:56:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8719991423,126cyclictest0-21swapper/510:48:005
87199778268,84cyclictest561ktimersoftd/512:12:055
8669974060,84cyclictest0-21swapper/411:35:464
8719969717,677cyclictest0-21swapper/510:39:295
8719969717,634cyclictest0-21swapper/509:19:205
8669969758,380cyclictest0-21swapper/412:01:224
8719969515,677cyclictest0-21swapper/511:19:035
84199687601,84cyclictest111rcuc/012:26:410
8719967681,84cyclictest0-21swapper/510:25:435
8559967579,380cyclictest0-21swapper/211:31:442
8719967074,593cyclictest0-21swapper/512:34:325
8619967074,465cyclictest0-21swapper/312:10:093
84999668115,126cyclictest0-21swapper/112:06:411
87899666113,380cyclictest0-21swapper/611:29:596
8719966427,380cyclictest121rcu_preempt10:50:115
84999663108,296cyclictest25-21ksoftirqd/108:05:031
84999663108,296cyclictest25-21ksoftirqd/108:05:031
84999663108,296cyclictest25-21ksoftirqd/108:05:021
8719966270,82cyclictest704-21nscd12:23:395
8719966225,634cyclictest0-21swapper/512:01:595
8719966123,550cyclictest21436-21ssh11:34:235
87199660151,507cyclictest0-21swapper/511:27:545
8789965319,127cyclictest0-21swapper/609:38:426
8719964912,634cyclictest0-21swapper/512:43:155
878996488,381cyclictest28514-21ssh12:21:336
86699633165,337cyclictest121rcu_preempt11:30:224
8839963177,382cyclictest0-21swapper/712:27:367
8839962975,295cyclictest0-21swapper/709:16:047
87199629245,337cyclictest721-21nscd07:30:055
8839962879,126cyclictest0-21swapper/709:37:417
8619962675,127cyclictest0-21swapper/312:05:423
86199623112,508cyclictest725-21nscd09:37:013
85599623115,465cyclictest721-21nscd10:26:032
8789962268,380cyclictest0-21swapper/609:19:266
8619962225,338cyclictest0-21swapper/312:25:373
8839962070,126cyclictest0-21swapper/712:17:167
87899618108,84cyclictest0-21swapper/611:39:016
8419961828,7cyclictest0-21swapper/012:00:460
8499961623,126cyclictest121rcu_preempt10:36:541
8619961561,381cyclictest0-21swapper/307:30:043
8419961260,295cyclictest0-21swapper/008:05:160
84199608139,295cyclictest0-21swapper/012:22:560
8499960714,126cyclictest0-21swapper/112:21:061
84199607266,126cyclictest0-21swapper/012:43:520
8419960552,380cyclictest0-21swapper/007:44:360
86699603263,338cyclictest64450irq/122-eth011:59:524
8719960249,422cyclictest121rcu_preempt12:35:265
8559959843,296cyclictest0-21swapper/211:36:052
8789959688,126cyclictest0-21swapper/612:25:036
8419959689,126cyclictest698-21ptp4l09:18:390
8719959238,466cyclictest121rcu_preempt12:25:175
8719959237,381cyclictest22255-21sh12:16:265
85599592125,212cyclictest0-21swapper/212:41:412
8839959081,128cyclictest0-21swapper/711:27:547
8619959036,381cyclictest0-21swapper/311:29:083
87899589123,126cyclictest0-21swapper/612:12:046
8719958835,126cyclictest0-21swapper/511:36:025
8619958880,127cyclictest18531-21ssh11:30:523
85599588123,211cyclictest0-21swapper/212:25:242
85599587119,466cyclictest0-21swapper/211:28:212
8789958636,297cyclictest0-21swapper/610:28:006
8619958432,127cyclictest0-21swapper/311:59:053
8499958475,127cyclictest0-21swapper/109:14:221
8839958374,126cyclictest0-21swapper/711:35:077
87899583368,84cyclictest18714-21ssh11:31:096
8419958274,211cyclictest9469-21rm12:06:070
8559958128,380cyclictest0-21swapper/212:33:432
8719957868,296cyclictest0-21swapper/509:34:325
84199578110,465cyclictest0-21swapper/012:15:290
86199577112,254cyclictest0-21swapper/310:47:593
86199576110,126cyclictest0-21swapper/307:42:283
85599576110,126cyclictest0-21swapper/212:15:362
8499957628,83cyclictest0-21swapper/112:03:061
84999573448,41cyclictest241ktimersoftd/111:58:441
84999571102,254cyclictest1553-21runrttasks12:20:071
8419957123,42cyclictest0-21swapper/011:34:130
8719956916,550cyclictest0-21swapper/512:07:125
8789956857,338cyclictest121rcu_preempt10:47:266
8619956655,508cyclictest0-21swapper/312:17:493
84999566523,41cyclictest241ktimersoftd/109:34:421
8419956310,84cyclictest0-21swapper/011:29:460
8619955947,211cyclictest41-21ksoftirqd/312:22:543
841995598,126cyclictest0-21swapper/010:40:070
841995589,126cyclictest0-21swapper/009:37:460
84199557514,41cyclictest111rcuc/011:36:190
8419955749,126cyclictest0-21swapper/008:03:390
8419955749,126cyclictest0-21swapper/008:03:390
8419955749,126cyclictest0-21swapper/008:03:390
8419955749,126cyclictest0-21swapper/008:03:390
883995565,126cyclictest0-21swapper/712:14:147
8789955648,126cyclictest0-21swapper/611:58:266
8789955646,380cyclictest0-21swapper/612:05:066
855995551,338cyclictest0-21swapper/211:49:132
871995541,550cyclictest0-21swapper/507:42:465
86699554131,211cyclictest691-21missed_timers12:25:354
849995545,376cyclictest0-21swapper/110:48:151
8559955344,127cyclictest0-21swapper/211:50:132
8839955183,253cyclictest0-21swapper/712:33:037
86199551336,126cyclictest0-21swapper/309:16:063
8619955082,465cyclictest0-21swapper/311:49:453
8669954882,127cyclictest0-21swapper/410:24:334
86699548121,168cyclictest49-21ksoftirqd/412:11:504
8669954783,126cyclictest121rcu_preempt10:25:214
85599546119,296cyclictest0-21swapper/212:05:092
86199545117,296cyclictest22409-21runrttasks10:23:503
85599545118,296cyclictest0-21swapper/209:36:082
8719954480,211cyclictest832-21cyclictest09:39:065
86199544118,131cyclictest41-21ksoftirqd/312:02:253
85599544121,338cyclictest0-21swapper/210:40:092
8559954376,253cyclictest0-21swapper/211:58:202
8719954232,507cyclictest0-21swapper/511:47:265
8499954274,295cyclictest0-21swapper/112:31:041
8719954131,126cyclictest0-21swapper/510:40:035
85599541285,254cyclictest321ktimersoftd/212:24:152
8419954034,84cyclictest0-21swapper/011:49:560
8499953975,296cyclictest0-21swapper/107:28:481
8419953873,125cyclictest121rcu_preempt11:58:540
8619953771,211cyclictest0-21swapper/310:37:303
8419953731,126cyclictest0-21swapper/012:14:420
8499953672,84cyclictest0-21swapper/110:26:051
8839953569,126cyclictest0-21swapper/711:56:567
86199535108,295cyclictest0-21swapper/310:28:073
8499953469,126cyclictest0-21swapper/109:35:451
86699533193,338cyclictest64450irq/122-eth011:20:124
8499953365,211cyclictest0-21swapper/111:35:351
8839953266,126cyclictest0-21swapper/709:20:047
8669953267,211cyclictest0-21swapper/412:43:144
8669953064,126cyclictest121rcu_preempt12:15:294
86699530444,84cyclictest471rcuc/410:36:424
8619953018,127cyclictest0-21swapper/311:36:393
8499953064,211cyclictest0-21swapper/112:27:231
8789952922,84cyclictest0-21swapper/608:04:056
8789952922,84cyclictest0-21swapper/608:04:046
8789952922,84cyclictest0-21swapper/608:04:046
8789952922,84cyclictest0-21swapper/608:04:046
87899527187,338cyclictest2846-21kworker/u16:212:30:586
86699527229,126cyclictest27376-21taskset12:20:344
86699527186,252cyclictest0-21swapper/412:30:394
85599527447,78cyclictest321ktimersoftd/212:11:512
8499952758,296cyclictest0-21swapper/111:34:371
8839952660,296cyclictest0-21swapper/710:27:137
87899525103,338cyclictest0-21swapper/610:36:546
8669952559,126cyclictest0-21swapper/411:49:234
8559952557,258cyclictest121rcu_preempt08:05:222
8559952517,126cyclictest0-21swapper/212:01:072
8669952464,457cyclictest0-21swapper/412:35:184
8499952215,338cyclictest0-21swapper/111:49:281
8499952214,84cyclictest0-21swapper/111:27:531
8719952153,211cyclictest0-21swapper/510:23:455
8559952157,126cyclictest1215-21ssh10:49:262
85599521266,253cyclictest321ktimersoftd/210:37:302
8839951953,126cyclictest0-21swapper/712:20:347
866995197,509cyclictest0-21swapper/411:28:224
855995189,127cyclictest0-21swapper/209:15:012
849995179,126cyclictest0-21swapper/112:35:031
8839951245,85cyclictest0-21swapper/708:05:167
871995121,127cyclictest0-21swapper/511:20:135
849995126,126cyclictest0-21swapper/109:18:111
8789951144,127cyclictest0-21swapper/609:20:036
8419951185,253cyclictest121rcu_preempt10:39:320
883995100,84cyclictest0-21swapper/711:31:587
883995090,84cyclictest0-21swapper/712:03:467
883995090,84cyclictest0-21swapper/707:42:017
878995090,84cyclictest22012-21ssh10:23:266
849995090,84cyclictest0-21swapper/112:12:051
841995090,81cyclictest0-21swapper/012:32:460
866995080,84cyclictest0-21swapper/409:38:454
866995080,168cyclictest0-21swapper/407:28:014
8619950881,126cyclictest0-21swapper/312:32:293
8839950738,211cyclictest0-21swapper/712:35:227
86699507166,338cyclictest21390-21cat09:15:194
855995071,295cyclictest0-21swapper/209:20:062
85599506121,126cyclictest0-21swapper/212:35:042
8419950680,211cyclictest9-21ksoftirqd/012:35:240
84999505122,380cyclictest30868-21fschecks_count11:20:181
8789950235,84cyclictest121rcu_preempt11:48:136
86199501201,127cyclictest0-21swapper/312:42:233
84199501116,126cyclictest1585-21sshd11:50:120
8789950074,211cyclictest24029-21ssh12:19:066
87899500117,381cyclictest22096-21runrttasks07:42:016
8719950032,465cyclictest0-21swapper/511:58:495
8499950031,84cyclictest0-21swapper/110:40:071
8789949976,84cyclictest0-21swapper/607:29:506
8719949829,466cyclictest0-21swapper/509:40:185
8669949872,423cyclictest0-21swapper/411:19:544
8419949832,211cyclictest0-21swapper/010:22:580
8789949670,423cyclictest0-21swapper/612:35:316
8719949631,297cyclictest0-21swapper/511:50:145
8839949571,211cyclictest0-21swapper/712:05:507
8719949468,211cyclictest0-21swapper/509:20:065
8419949336,288cyclictest0-21swapper/009:14:330
8669949266,423cyclictest0-21swapper/411:50:134
86199492236,254cyclictest401ktimersoftd/311:20:043
87899491276,85cyclictest0-21swapper/611:50:106
87899491150,126cyclictest65-21ksoftirqd/608:05:166
8839949068,84cyclictest0-21swapper/710:39:407
84999490106,253cyclictest0-21swapper/108:03:391
8839948865,211cyclictest0-21swapper/710:25:027
8789948866,126cyclictest0-21swapper/612:43:576
8499948824,84cyclictest0-21swapper/111:19:431
8789948719,465cyclictest3706-21kworker/u16:012:03:326
85599485185,126cyclictest33-21ksoftirqd/207:30:052
8499948561,126cyclictest25-21ksoftirqd/107:43:411
8559948418,84cyclictest0-21swapper/207:43:442
88399483142,338cyclictest27858-1kworker/u17:212:43:317
8559948260,256cyclictest29377-21ssh11:19:552
8419948218,84cyclictest0-21swapper/010:25:580
8499947852,211cyclictest0-21swapper/112:43:371
85599477351,43cyclictest321ktimersoftd/207:27:432
86699476139,211cyclictest0-21swapper/410:48:504
8669947612,84cyclictest0-21swapper/412:05:454
8559947489,211cyclictest33-21ksoftirqd/210:23:502
8619947249,338cyclictest0-21swapper/310:40:123
84999467126,126cyclictest25-21ksoftirqd/110:50:111
8559946682,211cyclictest0-21swapper/209:14:222
8419946685,84cyclictest121rcu_preempt11:40:040
8419946639,338cyclictest19829-21cron11:19:550
8839946584,211cyclictest0-21swapper/710:48:007
86199465208,126cyclictest121rcu_preempt11:40:133
86199465124,338cyclictest0-21swapper/312:35:293
86199465124,338cyclictest0-21swapper/307:29:163
8669946480,211cyclictest0-21swapper/409:40:174
87899462121,339cyclictest0-21swapper/610:40:216
84999462123,336cyclictest14548-21ssh11:50:051
86699461418,41cyclictest471rcuc/410:40:224
8619946034,423cyclictest0-21swapper/310:50:113
86199460118,339cyclictest0-21swapper/308:04:153
86199460118,339cyclictest0-21swapper/308:04:153
86199460118,339cyclictest0-21swapper/308:04:153
86199460118,339cyclictest0-21swapper/308:04:153
84999460205,211cyclictest0-21swapper/110:30:071
85599458118,338cyclictest0-21swapper/208:05:022
85599458118,338cyclictest0-21swapper/208:05:022
85599458118,338cyclictest0-21swapper/208:05:012
84999458117,338cyclictest0-21swapper/108:05:221
8839945731,211cyclictest73-21ksoftirqd/711:46:327
8839945532,84cyclictest0-21swapper/711:19:227
8499945574,84cyclictest0-21swapper/110:23:441
88399453409,42cyclictest711rcuc/711:20:207
87899453205,79cyclictest641ktimersoftd/611:40:146
85599452110,339cyclictest0-21swapper/207:45:022
8839945128,84cyclictest0-21swapper/711:50:047
87899451111,338cyclictest0-21swapper/609:40:166
85599450109,339cyclictest0-21swapper/209:40:202
8419945024,127cyclictest0-21swapper/010:49:130
86199449109,338cyclictest0-21swapper/309:40:203
84199449192,84cyclictest0-21swapper/009:34:450
87899448107,338cyclictest0-21swapper/607:45:036
85599447107,338cyclictest0-21swapper/208:04:402
86699446282,41cyclictest0-21swapper/409:34:424
8619944623,2cyclictest0-21swapper/308:05:233
8499944365,258cyclictest0-21swapper/107:45:161
8839944119,258cyclictest0-21swapper/708:05:017
8839944119,258cyclictest0-21swapper/708:05:017
8839944119,258cyclictest0-21swapper/708:05:017
8669944116,84cyclictest0-21swapper/408:05:124
86199441100,339cyclictest0-21swapper/309:34:193
8419944160,126cyclictest0-21swapper/007:30:030
86699440100,337cyclictest0-21swapper/410:30:074
8559943854,126cyclictest33-21ksoftirqd/210:30:012
8669943615,337cyclictest0-21swapper/411:40:134
871994349,422cyclictest0-21swapper/511:40:125
84199434271,79cyclictest101ktimersoftd/009:40:170
85599431346,82cyclictest311rcuc/211:40:142
883994309,123cyclictest0-21swapper/707:28:017
8789943089,126cyclictest0-21swapper/609:34:546
849994305,210cyclictest25-21ksoftirqd/111:40:021
8789942986,126cyclictest65-21ksoftirqd/611:19:456
8669942483,338cyclictest0-21swapper/407:45:054
8789942382,338cyclictest0-21swapper/609:14:236
8719942383,338cyclictest0-21swapper/508:04:415
8719942383,338cyclictest0-21swapper/508:04:415
8719942383,338cyclictest0-21swapper/508:04:405
8719942383,338cyclictest0-21swapper/508:04:405
8719942382,338cyclictest0-21swapper/509:14:525
866994231,84cyclictest0-21swapper/409:14:344
8839942283,84cyclictest0-21swapper/710:50:087
8839942283,84cyclictest0-21swapper/710:40:107
8789942282,338cyclictest0-21swapper/611:20:156
8669942282,338cyclictest0-21swapper/407:42:464
8559942282,338cyclictest0-21swapper/210:50:112
8499942283,84cyclictest0-21swapper/107:30:051
8419942282,338cyclictest0-21swapper/007:28:210
8719942181,338cyclictest0-21swapper/507:29:015
8619942180,338cyclictest0-21swapper/311:18:563
85599421123,296cyclictest0-21swapper/209:33:512
8789942079,339cyclictest0-21swapper/610:50:116
8669942041,295cyclictest0-21swapper/407:30:064
8419942040,168cyclictest0-21swapper/011:20:170
8839941980,84cyclictest0-21swapper/710:30:067
8839941980,84cyclictest0-21swapper/708:05:017
8789941978,126cyclictest28724-1kworker/u17:010:30:016
8719941978,338cyclictest0-21swapper/508:05:155
8839941831,338cyclictest0-21swapper/709:33:427
87199417118,126cyclictest0-21swapper/510:30:115
8619941777,338cyclictest0-21swapper/311:50:123
8499941779,83cyclictest0-21swapper/109:40:191
8839941677,84cyclictest0-21swapper/711:40:117
8719941676,338cyclictest0-21swapper/507:45:245
8419941674,211cyclictest9-21ksoftirqd/007:45:050
8839941434,84cyclictest0-21swapper/707:45:147
8619941472,339cyclictest0-21swapper/307:45:053
8669941374,337cyclictest0-21swapper/408:05:034
8669941374,337cyclictest0-21swapper/408:05:034
8559941372,338cyclictest0-21swapper/211:20:092
8839941273,84cyclictest0-21swapper/709:14:447
8839941172,84cyclictest0-21swapper/709:40:067
8669941172,337cyclictest64450irq/122-eth010:50:114
8669941070,338cyclictest0-21swapper/408:04:514
8669941070,338cyclictest0-21swapper/408:04:504
84199410111,126cyclictest9-21ksoftirqd/009:20:060
8619940924,254cyclictest0-21swapper/309:20:053
8419940969,337cyclictest0-21swapper/010:30:090
8499940769,83cyclictest0-21swapper/109:20:061
8619940565,338cyclictest0-21swapper/310:30:103
8419940364,84cyclictest0-21swapper/010:50:090
8669940118,127cyclictest49-21ksoftirqd/409:20:114
8619939212,296cyclictest0-21swapper/309:14:443
8789938847,338cyclictest0-21swapper/607:30:056
8839936525,84cyclictest0-21swapper/707:30:137
3178829995,2sleep30-21swapper/307:05:193
3086029995,2sleep60-21swapper/607:05:146
3264329248,40sleep50-21swapper/507:06:275
35628656,27sleep20-21swapper/207:08:552
40928350,29sleep70-21swapper/707:09:407
234792830,0sleep70-21swapper/710:07:537
3030828277,2sleep40-21swapper/407:05:134
245792820,0sleep10-21swapper/111:00:211
3276228150,27sleep10-21swapper/107:08:061
3269627846,28sleep00-21swapper/007:07:090
96902690,0sleep20-21swapper/209:26:572
146592690,0sleep10-21swapper/110:03:461
136962680,0sleep10-21swapper/111:10:551
871993110,17cyclictest0-21swapper/509:04:265
871992910,19cyclictest0-21swapper/508:33:275
861992910,19cyclictest0-21swapper/307:14:053
855992928,0cyclictest0-21swapper/208:33:082
883992810,18cyclictest0-21swapper/709:56:127
883992810,18cyclictest0-21swapper/707:57:047
883992810,18cyclictest0-21swapper/707:14:027
883992810,0cyclictest0-21swapper/710:16:507
871992810,17cyclictest0-21swapper/510:16:355
871992810,0cyclictest0-21swapper/507:14:205
861992810,18cyclictest0-21swapper/311:06:523
861992810,18cyclictest0-21swapper/310:16:313
861992810,18cyclictest0-21swapper/308:56:153
861992810,18cyclictest0-21swapper/308:24:213
861992810,18cyclictest0-21swapper/307:57:113
861992810,18cyclictest0-21swapper/307:39:513
861992810,0cyclictest0-21swapper/310:06:373
855992827,0cyclictest0-21swapper/208:48:032
855992827,0cyclictest0-21swapper/208:48:022
855992810,0cyclictest0-21swapper/209:56:092
855992810,0cyclictest0-21swapper/207:14:222
849992810,18cyclictest0-21swapper/108:48:151
849992810,18cyclictest0-21swapper/108:48:141
849992810,18cyclictest0-21swapper/108:16:571
849992810,17cyclictest0-21swapper/111:07:051
841992810,18cyclictest0-21swapper/010:16:540
841992810,18cyclictest0-21swapper/008:24:400
883992727,0cyclictest0-21swapper/708:39:287
883992727,0cyclictest0-21swapper/707:19:107
883992710,17cyclictest0-21swapper/711:06:597
883992710,17cyclictest0-21swapper/709:05:017
883992710,17cyclictest0-21swapper/709:04:237
883992710,17cyclictest0-21swapper/708:47:377
883992710,17cyclictest0-21swapper/708:47:367
883992710,17cyclictest0-21swapper/708:32:547
883992710,0cyclictest0-21swapper/708:55:457
883992710,0cyclictest0-21swapper/708:24:267
883992710,0cyclictest0-21swapper/708:17:257
883992710,0cyclictest0-21swapper/707:39:497
878992727,0cyclictest0-21swapper/608:39:466
878992727,0cyclictest0-21swapper/607:14:146
878992710,17cyclictest0-21swapper/610:06:386
878992710,17cyclictest0-21swapper/609:56:166
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional