You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-21 - 02:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Sep 21, 2026 00:54:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30854997231,211cyclictest0-21swapper/022:51:430
30855996760,42cyclictest0-21swapper/121:37:291
308559967278,591cyclictest0-21swapper/122:18:581
3086099664240,84cyclictest21707-1kworker/u17:223:28:446
308559966427,634cyclictest0-21swapper/123:27:191
3085499664111,342cyclictest121rcu_preempt23:09:560
3085799659104,254cyclictest41-21ksoftirqd/322:17:023
30855996361,42cyclictest0-21swapper/121:42:181
30855996360,42cyclictest0-21swapper/123:20:171
30855996350,41cyclictest0-21swapper/123:58:331
30855996350,41cyclictest0-21swapper/123:08:051
308559963382,380cyclictest0-21swapper/121:52:031
308589963241,339cyclictest0-21swapper/422:16:544
30855996310,79cyclictest0-21swapper/123:15:531
308569962773,126cyclictest10722-21kworker/u16:121:39:092
308559961924,592cyclictest241ktimersoftd/123:50:491
308559961823,465cyclictest0-21swapper/100:28:441
3085999615319,84cyclictest0-21swapper/522:34:405
308549961466,126cyclictest0-21swapper/022:17:540
3085999613272,338cyclictest704-21nscd21:43:425
3085899611105,126cyclictest0-21swapper/423:26:264
308579960812,127cyclictest121rcu_preempt21:50:483
30855996038,592cyclictest0-21swapper/100:07:391
308579959743,339cyclictest0-21swapper/321:33:473
308579959583,381cyclictest0-21swapper/322:03:553
308579959583,381cyclictest0-21swapper/322:03:553
308579959541,126cyclictest121rcu_preempt23:40:413
30855995951,41cyclictest0-21swapper/123:40:511
30855995940,42cyclictest0-21swapper/120:52:331
30855995940,41cyclictest11162-21ssh22:05:211
30855995940,41cyclictest0-21swapper/122:31:011
30861995931,382cyclictest0-21swapper/723:01:087
30858995931,84cyclictest0-21swapper/421:42:034
30858995931,126cyclictest0-21swapper/400:00:234
30855995930,41cyclictest0-21swapper/100:15:091
308579958877,84cyclictest121rcu_preempt22:54:483
3085799587116,211cyclictest0-21swapper/323:32:173
3085999585118,253cyclictest0-21swapper/523:26:385
308559958334,469cyclictest0-21swapper/121:55:141
308559958334,469cyclictest0-21swapper/121:55:141
3085799582113,254cyclictest121rcu_preempt21:39:163
308569958128,253cyclictest0-21swapper/223:18:552
308609958071,85cyclictest0-21swapper/621:36:546
3085899576192,253cyclictest0-21swapper/421:30:084
308609957017,380cyclictest0-21swapper/623:09:396
308559956916,42cyclictest0-21swapper/122:37:581
308549956962,338cyclictest0-21swapper/022:25:560
308579956817,126cyclictest0-21swapper/323:07:263
3085499568190,259cyclictest29284-21kworker/u16:323:44:400
308559956613,550cyclictest0-21swapper/122:45:151
308549956699,465cyclictest0-21swapper/022:02:050
308549956699,465cyclictest0-21swapper/022:02:050
3086199565224,338cyclictest15850irq/123-ahci[0000:28:507
308589956597,465cyclictest0-21swapper/422:02:054
308589956597,465cyclictest0-21swapper/422:02:054
3085799565482,3cyclictest391rcuc/322:39:123
308609956413,84cyclictest0-21swapper/622:02:186
308609956413,84cyclictest0-21swapper/622:02:186
308609956395,465cyclictest0-21swapper/621:40:476
308569956213,383cyclictest0-21swapper/223:01:082
3085999561475,84cyclictest551rcuc/523:40:565
308569956112,338cyclictest0-21swapper/223:33:332
308569955910,126cyclictest0-21swapper/222:17:022
30859995566,126cyclictest0-21swapper/523:09:235
308589955544,380cyclictest0-21swapper/422:30:454
30855995531,41cyclictest0-21swapper/122:02:061
30855995531,41cyclictest0-21swapper/122:02:061
3085899551294,84cyclictest0-21swapper/422:54:024
30858995511,85cyclictest0-21swapper/423:40:544
30855995510,41cyclictest0-21swapper/123:02:251
30855995510,41cyclictest0-21swapper/122:51:491
30855995510,41cyclictest0-21swapper/122:28:011
308549955183,211cyclictest1651-21ntpd21:35:040
30854995501,84cyclictest0-21swapper/020:53:530
30861995490,2cyclictest0-21swapper/722:17:257
308589954982,126cyclictest0-21swapper/423:33:174
308589954981,295cyclictest0-21swapper/400:25:324
308569954983,126cyclictest0-21swapper/222:52:152
308619954879,466cyclictest0-21swapper/722:02:057
308619954879,466cyclictest0-21swapper/722:02:057
3085899548121,296cyclictest0-21swapper/421:39:424
308569954883,42cyclictest121rcu_preempt21:50:382
308609954781,126cyclictest0-21swapper/622:54:206
3085499547206,338cyclictest13319-21nscd21:50:530
3085499547117,211cyclictest0-21swapper/023:03:220
308599954680,211cyclictest0-21swapper/522:53:295
308599954438,298cyclictest0-21swapper/522:38:065
308569954437,340cyclictest694-21irqbalance23:08:182
308599954376,126cyclictest0-21swapper/500:39:565
308579954273,261cyclictest0-21swapper/323:29:423
308569954231,380cyclictest0-21swapper/200:06:402
308589954076,84cyclictest0-21swapper/422:40:074
308579953931,127cyclictest0-21swapper/322:05:053
308569953826,127cyclictest0-21swapper/223:27:372
3085699538113,423cyclictest0-21swapper/221:40:472
308599953771,211cyclictest0-21swapper/523:19:145
308589953628,84cyclictest121rcu_preempt23:06:214
3085799535325,41cyclictest0-21swapper/323:03:233
3085499535109,423cyclictest0-21swapper/021:40:470
308609953321,126cyclictest0-21swapper/622:38:376
308589953322,87cyclictest0-21swapper/400:39:114
308619953263,253cyclictest31129-21taskset22:35:107
308569952859,338cyclictest0-21swapper/223:42:552
308549952863,126cyclictest0-21swapper/000:06:400
308579952761,126cyclictest0-21swapper/322:32:353
3085799526103,126cyclictest0-21swapper/300:06:413
3085999525186,127cyclictest0-21swapper/523:51:015
3085899524267,254cyclictest64450irq/122-eth023:20:254
308579952314,126cyclictest0-21swapper/323:35:133
308559952212,41cyclictest0-21swapper/120:03:501
308549952296,339cyclictest23871-21timerandwakeup00:00:230
308549952111,338cyclictest0-21swapper/023:32:160
30856995199,126cyclictest0-21swapper/221:30:082
308589951811,84cyclictest0-21swapper/422:28:334
3086199515258,254cyclictest721ktimersoftd/721:33:597
3085499515131,253cyclictest0-21swapper/022:05:260
30857995114,296cyclictest41-21ksoftirqd/320:03:153
30854995115,126cyclictest121rcu_preempt23:28:280
308619950983,338cyclictest0-21swapper/722:31:537
30859995092,169cyclictest0-21swapper/521:55:005
3085599508208,90cyclictest121rcu_preempt20:05:171
30855995080,41cyclictest0-21swapper/120:55:131
308589950781,211cyclictest29565-21chrt20:53:384
3085899504249,253cyclictest481ktimersoftd/423:19:144
3085799503246,84cyclictest0-21swapper/322:28:573
308589950280,219cyclictest64450irq/122-eth023:01:084
3085699502160,339cyclictest20006-1kworker/u17:223:51:002
308619950178,85cyclictest13345-21ssh23:19:507
308619950132,126cyclictest121rcu_preempt21:54:487
308599950178,84cyclictest0-21swapper/523:59:575
308559950137,380cyclictest0-21swapper/123:33:071
308569950030,339cyclictest0-21swapper/222:29:592
308549950034,84cyclictest0-21swapper/023:17:070
308619949934,253cyclictest0-21swapper/722:26:047
308589949934,335cyclictest121rcu_preempt22:36:134
3085899499113,127cyclictest11190-21cat22:05:234
308569949934,84cyclictest0-21swapper/222:36:002
308599949834,380cyclictest0-21swapper/500:06:455
308549949833,84cyclictest0-21swapper/000:27:040
308619949729,465cyclictest0-21swapper/723:51:007
308599949628,84cyclictest0-21swapper/521:38:375
308579949674,42cyclictest17093-21sh00:30:573
308569949529,87cyclictest0-21swapper/200:40:392
3085999494239,253cyclictest561ktimersoftd/520:53:385
3085999493150,126cyclictest121rcu_preempt21:31:595
308549949227,126cyclictest32472-21irqstats22:35:190
308609949025,84cyclictest0-21swapper/621:54:356
308609948825,247cyclictest0-21swapper/621:35:016
308599948826,378cyclictest0-21swapper/523:33:185
308579948864,212cyclictest14436-21cat23:20:133
308569948767,336cyclictest30852-21cyclictest22:03:262
308569948767,336cyclictest30852-21cyclictest22:03:262
308559948723,219cyclictest0-21swapper/122:55:081
308619948621,42cyclictest0-21swapper/723:27:407
308609948617,343cyclictest0-21swapper/622:27:026
308579948516,296cyclictest30852-21cyclictest21:42:353
308569948560,127cyclictest29678-21idleruntime-cro20:55:002
308619948419,171cyclictest0-21swapper/700:00:177
308619948366,78cyclictest24586-1kworker/u17:222:54:197
308589948319,303cyclictest0-21swapper/400:40:584
308549948357,253cyclictest0-21swapper/022:45:140
308609948252,339cyclictest0-21swapper/623:17:116
308569948258,84cyclictest121rcu_preempt00:39:352
308549948219,252cyclictest0-21swapper/021:33:520
308599948012,253cyclictest0-21swapper/523:03:255
308559947511,126cyclictest121rcu_preempt21:32:421
308609947347,253cyclictest0-21swapper/622:40:076
3086099471253,169cyclictest1651-21ntpd22:05:236
308599947047,126cyclictest8784-21ssh23:35:205
3086199469174,210cyclictest721ktimersoftd/721:55:177
3086199469174,210cyclictest721ktimersoftd/721:55:177
30859994691,84cyclictest0-21swapper/522:20:155
30857994682,127cyclictest0-21swapper/322:45:143
308599946784,380cyclictest0-21swapper/522:02:055
308599946784,380cyclictest0-21swapper/522:02:055
3085999467171,126cyclictest9675-1kworker/u17:122:26:145
3085899467126,175cyclictest704-21nscd22:20:144
30855994670,42cyclictest0-21swapper/100:00:061
308589946682,253cyclictest18244-21taskset21:50:384
308569946681,296cyclictest0-21swapper/222:31:442
3086099465124,338cyclictest0-21swapper/622:31:266
308619946483,84cyclictest0-21swapper/721:44:027
308619946440,126cyclictest0-21swapper/721:37:147
3086199464124,338cyclictest0-21swapper/723:20:147
3086199463123,338cyclictest0-21swapper/723:32:187
3086099462166,165cyclictest121rcu_preempt00:07:366
308549946278,211cyclictest9-21ksoftirqd/022:33:210
308619946175,254cyclictest0-21swapper/700:06:417
3086099461206,253cyclictest641ktimersoftd/623:52:096
3086099460164,43cyclictest704-21nscd00:00:176
308609945937,255cyclictest0-21swapper/622:55:066
3086099458120,84cyclictest0-21swapper/622:45:146
308599945834,125cyclictest0-21swapper/500:30:555
308589945829,426cyclictest0-21swapper/423:35:194
308569945835,84cyclictest0-21swapper/220:01:062
308559945874,295cyclictest0-21swapper/122:40:091
308619945671,211cyclictest5523-21diskstats22:20:157
3085899456244,42cyclictest64450irq/122-eth000:05:204
308569945634,42cyclictest0-21swapper/222:45:152
3086099455114,126cyclictest65-21ksoftirqd/623:04:176
3085499455113,126cyclictest32651-21cron00:40:000
3086199454113,338cyclictest0-21swapper/723:06:347
308589945331,42cyclictest0-21swapper/400:15:094
3086199452113,84cyclictest30852-21cyclictest20:50:187
3086099452111,338cyclictest0-21swapper/622:20:156
3085799452111,338cyclictest30852-21cyclictest20:52:483
3085599451110,338cyclictest17016-21runrttasks00:14:551
308609945027,257cyclictest0-21swapper/623:34:306
308569944927,2cyclictest0-21swapper/223:59:172
308589944867,84cyclictest0-21swapper/420:55:134
308579944825,3cyclictest0-21swapper/300:14:363
308589944765,338cyclictest0-21swapper/421:55:144
308589944765,338cyclictest0-21swapper/421:55:144
308569944725,259cyclictest0-21swapper/200:25:402
308569944723,126cyclictest0-21swapper/220:55:132
308619944624,2cyclictest0-21swapper/723:59:177
3085799446103,211cyclictest12751-21ssh23:19:163
3085499446108,84cyclictest0-21swapper/000:14:150
308609944563,84cyclictest121rcu_preempt20:52:496
308569944521,84cyclictest121rcu_preempt00:14:552
308549944565,84cyclictest0-21swapper/023:20:140
3086099444102,210cyclictest0-21swapper/623:44:456
308579944463,42cyclictest0-21swapper/321:55:213
308579944463,42cyclictest0-21swapper/321:55:213
308619944320,256cyclictest0-21swapper/722:55:067
3085799443186,254cyclictest15285-21kworker/u16:223:52:113
3086099442187,126cyclictest121rcu_preempt21:55:176
3086099442187,126cyclictest121rcu_preempt21:55:176
308589944014,423cyclictest0-21swapper/420:05:094
308599943918,255cyclictest0-21swapper/523:20:205
308589943916,126cyclictest6197-21ssh21:45:124
308579943915,211cyclictest0-21swapper/323:10:053
308549943955,168cyclictest10213-21chrt23:35:330
308589943897,338cyclictest0-21swapper/423:52:114
308609943796,338cyclictest427-21ssh22:16:296
308599943716,255cyclictest0-21swapper/500:14:365
308619943653,338cyclictest0-21swapper/700:39:517
30857994368,339cyclictest0-21swapper/320:55:133
308549943411,297cyclictest0-21swapper/000:41:030
308599943311,126cyclictest0-21swapper/522:17:045
30855994333,300cyclictest25-21ksoftirqd/100:41:061
308549943312,209cyclictest0-21swapper/023:52:110
308589943291,338cyclictest0-21swapper/422:45:144
30857994291,259cyclictest41-21ksoftirqd/300:40:583
30861994271,211cyclictest0-21swapper/700:14:377
30856994262,253cyclictest0-21swapper/222:40:092
30860994256,80cyclictest0-21swapper/623:59:496
30859994252,131cyclictest11191-21ntp_states22:05:235
308599942440,42cyclictest121rcu_preempt21:45:065
30857994242,256cyclictest0-21swapper/323:59:173
308559942483,338cyclictest0-21swapper/122:20:151
308619942382,338cyclictest0-21swapper/722:05:207
308609942382,338cyclictest0-21swapper/621:45:066
308599942350,212cyclictest0-21swapper/500:25:105
308599942281,169cyclictest0-21swapper/520:55:135
308599942238,84cyclictest121rcu_preempt20:03:515
30858994221,255cyclictest0-21swapper/400:14:364
308569942283,84cyclictest0-21swapper/223:20:162
308569942282,338cyclictest0-21swapper/223:45:142
308569942280,339cyclictest0-21swapper/200:00:232
308619942141,296cyclictest0-21swapper/723:44:017
308609942180,338cyclictest0-21swapper/620:55:146
308589942182,84cyclictest0-21swapper/420:03:164
308579942181,84cyclictest0-21swapper/300:28:443
308549942180,338cyclictest0-21swapper/023:58:240
308609942040,214cyclictest0-21swapper/623:20:246
308579942082,171cyclictest0-21swapper/322:55:063
308579942081,84cyclictest0-21swapper/321:45:063
308579942080,84cyclictest0-21swapper/322:44:593
3085699420121,126cyclictest10722-21kworker/u16:121:55:172
3085699420121,126cyclictest10722-21kworker/u16:121:55:172
308559942079,338cyclictest0-21swapper/123:10:061
308579941979,84cyclictest0-21swapper/300:15:263
308569941939,296cyclictest0-21swapper/221:45:122
308619941837,296cyclictest0-21swapper/721:45:077
308599941877,338cyclictest0-21swapper/521:55:205
308599941877,338cyclictest0-21swapper/521:55:205
308569941835,210cyclictest0-21swapper/200:15:192
308609941778,336cyclictest0-21swapper/620:03:296
308599941776,338cyclictest0-21swapper/500:40:585
308589941777,337cyclictest0-21swapper/423:59:504
308549941733,210cyclictest0-21swapper/023:10:040
3085499417162,126cyclictest121rcu_preempt21:55:140
3085499417162,126cyclictest121rcu_preempt21:55:140
308619941675,338cyclictest0-21swapper/700:40:447
308609941675,338cyclictest0-21swapper/623:35:196
308609941675,338cyclictest0-21swapper/600:26:156
308599941675,338cyclictest0-21swapper/522:44:595
3085899416202,84cyclictest6265-21diskmemload00:30:554
3085799416117,84cyclictest41-21ksoftirqd/300:39:363
308619941576,84cyclictest0-21swapper/720:04:197
308569941535,296cyclictest0-21swapper/223:35:132
308569941534,297cyclictest0-21swapper/222:05:042
308619941472,339cyclictest0-21swapper/700:15:267
308569941474,338cyclictest0-21swapper/222:20:152
308619941271,338cyclictest0-21swapper/723:10:067
308609941271,338cyclictest0-21swapper/600:40:286
308609941228,256cyclictest0-21swapper/600:39:126
308549941272,337cyclictest0-21swapper/022:20:150
3085599411372,3cyclictest231rcuc/121:45:131
308619940968,338cyclictest0-21swapper/720:55:147
308619940934,290cyclictest0-21swapper/700:30:557
308569940968,338cyclictest0-21swapper/222:55:072
308559940929,296cyclictest0-21swapper/123:35:331
308609940866,339cyclictest0-21swapper/600:14:266
308589940868,83cyclictest121rcu_preempt23:45:134
308619940766,338cyclictest0-21swapper/723:45:057
3085999407107,169cyclictest19151-21ssh00:15:185
308569940766,338cyclictest0-21swapper/223:10:062
308549940727,127cyclictest0-21swapper/020:04:180
308619940626,173cyclictest0-21swapper/723:35:147
308579940626,7cyclictest0-21swapper/300:00:173
308599940322,48cyclictest0-21swapper/500:00:245
308549940324,2cyclictest0-21swapper/022:55:060
308589940261,338cyclictest0-21swapper/423:10:064
308579940015,214cyclictest0-21swapper/323:45:143
308559939920,300cyclictest0-21swapper/100:39:351
308549939857,338cyclictest0-21swapper/022:44:590
308599939515,212cyclictest0-21swapper/523:10:055
308549939554,338cyclictest0-21swapper/021:45:060
308579939464,118cyclictest41-21ksoftirqd/319:15:253
308589939252,337cyclictest0-21swapper/422:55:134
308549939196,84cyclictest9-21ksoftirqd/000:30:550
308569938911,294cyclictest0-21swapper/200:30:552
30857993865,170cyclictest41-21ksoftirqd/322:20:203
3085999376246,84cyclictest16406-21ssh22:45:105
308549937677,126cyclictest9-21ksoftirqd/020:05:080
3086099375161,84cyclictest121rcu_preempt00:15:086
308549937378,211cyclictest0-21swapper/000:15:090
308619937131,298cyclictest0-21swapper/722:45:107
308619937029,338cyclictest0-21swapper/722:44:597
308559937071,169cyclictest121rcu_preempt00:30:551
308579936969,127cyclictest41-21ksoftirqd/320:05:093
308609936831,253cyclictest0-21swapper/623:45:056
308559936869,125cyclictest25-21ksoftirqd/123:45:141
308549936666,211cyclictest0-21swapper/023:45:020
308549936528,46cyclictest0-21swapper/020:55:130
308619935514,338cyclictest0-21swapper/720:05:177
308599935316,3cyclictest0-21swapper/523:45:125
308599935213,84cyclictest29284-21kworker/u16:322:55:135
30856993454,338cyclictest0-21swapper/220:05:092
30860993443,338cyclictest0-21swapper/620:05:176
308589933435,211cyclictest0-21swapper/419:15:264
308609932934,211cyclictest0-21swapper/600:30:556
308609932732,211cyclictest0-21swapper/623:10:046
30854993045,169cyclictest0-21swapper/019:15:250
3085999290164,42cyclictest561ktimersoftd/520:05:095
308559928432,171cyclictest0-21swapper/120:45:361
30859992585,42cyclictest0-21swapper/520:45:365
308599925583,84cyclictest57-21ksoftirqd/519:15:255
308619925241,129cyclictest0-21swapper/720:45:377
308619925241,129cyclictest0-21swapper/719:15:257
308609925141,128cyclictest0-21swapper/619:15:256
308559925141,130cyclictest0-21swapper/119:15:251
308569925039,129cyclictest0-21swapper/219:15:252
308609924231,129cyclictest0-21swapper/620:45:366
308549924030,129cyclictest0-21swapper/020:45:360
308569923827,130cyclictest0-21swapper/220:45:362
308589922212,2cyclictest0-21swapper/420:45:364
308579920535,48cyclictest0-21swapper/320:45:363
284062105101,2sleep20-21swapper/219:05:142
3019229047,15sleep10-21swapper/119:06:421
3032928453,27sleep60-21swapper/619:08:396
3034528249,29sleep40-21swapper/419:08:534
3030828251,27sleep30-21swapper/319:08:203
3016828251,27sleep70-21swapper/719:06:257
3031928150,27sleep50-21swapper/519:08:305
3035027946,29sleep00-21swapper/019:08:580
10492770,0sleep00-21swapper/021:00:100
101872730,1sleep3401ktimersoftd/321:28:003
3042424239,1sleep70-21swapper/719:10:007
30856993110,20cyclictest0-21swapper/221:18:362
30856993010,19cyclictest0-21swapper/219:27:352
30861992910,18cyclictest0-21swapper/721:23:597
30861992910,18cyclictest0-21swapper/719:46:147
30858992911,1cyclictest30852-21cyclictest21:18:414
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional