You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 09:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Aug 15, 2026 00:53:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
221889974725,676cyclictest0-21swapper/122:59:501
2219399688644,41cyclictest631rcuc/622:19:276
22188996790,42cyclictest0-21swapper/122:07:411
2218799675207,211cyclictest121rcu_preempt23:00:180
221919966023,380cyclictest121rcu_preempt22:27:094
221889965113,84cyclictest25728-21ssh23:28:401
221879964956,126cyclictest13818-21diskmemload00:31:410
221889964710,549cyclictest0-21swapper/123:52:201
2219099632121,296cyclictest0-21swapper/322:09:153
221879962937,126cyclictest121rcu_preempt23:27:560
221889962876,549cyclictest0-21swapper/121:15:241
221889962734,126cyclictest0-21swapper/122:10:511
2219099622110,380cyclictest0-21swapper/323:28:003
221879961930,80cyclictest121rcu_preempt21:12:450
221909961720,126cyclictest0-21swapper/322:38:123
221909961720,126cyclictest0-21swapper/322:38:123
221929961158,380cyclictest0-21swapper/523:52:005
2219299610144,295cyclictest0-21swapper/523:38:315
221949960998,296cyclictest0-21swapper/722:57:567
221909960049,84cyclictest121rcu_preempt21:13:163
22192995950,84cyclictest0-21swapper/523:57:495
22194995940,84cyclictest0-21swapper/722:40:177
22189995940,84cyclictest0-21swapper/222:05:412
221889959482,296cyclictest0-21swapper/121:14:321
22191995930,84cyclictest0-21swapper/422:05:414
2218899591377,127cyclictest25-21ksoftirqd/121:39:141
221899959079,338cyclictest11386-21ssh23:39:132
2219399585244,338cyclictest704-21nscd21:38:276
221889958130,462cyclictest0-21swapper/122:20:491
221879958132,169cyclictest0-21swapper/022:38:170
221879958132,169cyclictest0-21swapper/022:38:170
221919957871,84cyclictest0-21swapper/421:14:344
2219199578365,126cyclictest17369-21ssh21:37:014
221949957626,84cyclictest0-21swapper/700:32:257
221889957628,469cyclictest0-21swapper/123:00:021
221889957623,550cyclictest0-21swapper/100:12:191
2219499573107,211cyclictest0-21swapper/722:38:237
2219499573107,211cyclictest0-21swapper/722:38:237
221889957321,83cyclictest0-21swapper/100:06:151
2219499564223,338cyclictest31370-21kworker/u16:121:15:557
221919956012,338cyclictest0-21swapper/422:40:024
221919956012,338cyclictest0-21swapper/422:40:024
22188995546,83cyclictest0-21swapper/122:29:241
2218799554430,122cyclictest101ktimersoftd/022:10:150
22188995520,42cyclictest0-21swapper/100:33:451
22188995510,41cyclictest0-21swapper/123:37:371
22187995511,84cyclictest0-21swapper/022:09:250
221909955081,296cyclictest0-21swapper/322:21:063
221939954679,210cyclictest9431-21ssh22:08:226
221909954639,296cyclictest0-21swapper/300:22:493
221909954634,381cyclictest0-21swapper/300:42:013
221919954580,126cyclictest121rcu_preempt22:58:284
221889954578,464cyclictest0-21swapper/100:41:561
221889954231,338cyclictest121rcu_preempt22:40:131
221939954173,465cyclictest0-21swapper/600:41:556
221939954133,126cyclictest0-21swapper/619:54:356
221909954029,296cyclictest0-21swapper/320:40:183
2218999539324,84cyclictest0-21swapper/200:32:172
221929953830,49cyclictest0-21swapper/500:35:305
2218799538201,126cyclictest121rcu_preempt21:40:000
221909953630,126cyclictest19796-21cat21:40:013
221929953322,295cyclictest0-21swapper/523:47:005
221909953368,42cyclictest0-21swapper/321:50:163
221929953163,465cyclictest0-21swapper/522:28:065
221909953166,91cyclictest0-21swapper/322:59:453
221899953124,126cyclictest121rcu_preempt23:26:402
221949953060,297cyclictest0-21swapper/723:07:507
2218999528104,258cyclictest2813-21nscd23:56:412
221909952716,508cyclictest187-21md0_raid121:15:013
221879952662,126cyclictest0-21swapper/023:07:020
221889952416,127cyclictest0-21swapper/122:39:161
221889952416,127cyclictest0-21swapper/122:39:161
221879952459,168cyclictest22185-21cyclictest00:22:190
221929952316,84cyclictest0-21swapper/521:36:195
2218999523267,126cyclictest713-21in:imuxsock21:37:412
221899952316,85cyclictest0-21swapper/222:10:282
221889952355,465cyclictest0-21swapper/122:19:351
221919952254,295cyclictest0-21swapper/422:10:144
221909952211,296cyclictest0-21swapper/300:12:183
221909952114,84cyclictest0-21swapper/300:33:123
221899952194,211cyclictest0-21swapper/222:49:372
221909952055,126cyclictest0-21swapper/323:15:393
221909952055,126cyclictest0-21swapper/323:15:393
221909951710,84cyclictest121rcu_preempt23:40:333
22193995111,342cyclictest0-21swapper/622:59:146
221909951140,296cyclictest0-21swapper/322:28:363
22190995111,338cyclictest0-21swapper/323:38:593
22187995110,84cyclictest0-21swapper/023:38:520
22188995100,507cyclictest0-21swapper/119:51:441
22194995090,84cyclictest0-21swapper/722:08:127
22192995091,211cyclictest0-21swapper/522:38:345
22192995091,211cyclictest0-21swapper/522:38:345
22192995090,84cyclictest0-21swapper/523:15:375
22192995090,84cyclictest0-21swapper/523:15:365
22189995090,84cyclictest0-21swapper/223:15:372
22189995090,84cyclictest0-21swapper/223:15:372
2219199508294,84cyclictest0-21swapper/422:21:014
221899950741,84cyclictest22185-21cyclictest22:39:162
221899950741,84cyclictest22185-21cyclictest22:39:162
2218999505121,169cyclictest33-21ksoftirqd/222:27:082
221879950579,211cyclictest8976-21ssh21:15:530
221919950478,338cyclictest22185-21cyclictest21:50:234
221919950437,380cyclictest0-21swapper/422:19:404
221899950334,84cyclictest121rcu_preempt22:19:402
221899950276,168cyclictest33-21ksoftirqd/222:58:222
2218799502119,211cyclictest0-21swapper/022:59:140
221889950032,465cyclictest0-21swapper/123:56:581
221879950076,84cyclictest121rcu_preempt22:26:570
2218799500115,255cyclictest121rcu_preempt00:42:120
221949949934,84cyclictest0-21swapper/721:39:577
221939949871,211cyclictest65-21ksoftirqd/623:37:246
221929949832,88cyclictest0-21swapper/523:27:075
221909949833,253cyclictest20167-21ssh22:50:143
221909949833,253cyclictest20167-21ssh22:50:143
2219099498117,84cyclictest0-21swapper/323:52:193
221939949730,211cyclictest0-21swapper/622:28:176
2219399496111,169cyclictest11268-21ssh22:10:096
221899949630,84cyclictest0-21swapper/200:22:522
2218999496113,127cyclictest0-21swapper/221:14:542
221889949630,84cyclictest0-21swapper/122:49:521
221949949571,84cyclictest0-21swapper/723:27:077
221899949529,126cyclictest0-21swapper/223:07:262
221879949529,84cyclictest0-21swapper/022:49:380
221939949467,211cyclictest65-21ksoftirqd/621:12:116
221939949366,169cyclictest0-21swapper/622:49:586
221899949327,50cyclictest0-21swapper/223:00:372
2218999493107,296cyclictest0-21swapper/221:16:022
221889949325,465cyclictest0-21swapper/121:40:111
221929949271,337cyclictest0-21swapper/522:09:395
221879949025,84cyclictest0-21swapper/023:40:330
2218899489104,211cyclictest25-21ksoftirqd/100:01:491
221939948862,423cyclictest0-21swapper/623:30:216
221949948763,127cyclictest0-21swapper/700:22:347
2219299487230,127cyclictest0-21swapper/521:10:535
221889948719,126cyclictest0-21swapper/100:22:561
2218899487108,84cyclictest0-21swapper/123:07:481
221889948521,127cyclictest0-21swapper/100:25:551
221939948360,89cyclictest0-21swapper/621:50:236
221919948115,84cyclictest0-21swapper/423:07:264
221879948112,339cyclictest0-21swapper/022:50:240
221879948112,339cyclictest0-21swapper/022:50:240
221939948054,126cyclictest7117-21switchtime23:00:276
221899948011,338cyclictest0-21swapper/200:01:342
22189994789,126cyclictest0-21swapper/223:40:332
221899947711,84cyclictest0-21swapper/222:40:162
2219499475133,254cyclictest19527-21ssh23:24:487
221949947492,85cyclictest0-21swapper/722:27:187
22193994748,126cyclictest0-21swapper/600:06:256
2219099474222,129cyclictest30209-21diskmemload23:07:193
221939947090,84cyclictest10832-1kworker/u17:222:37:346
221939947090,84cyclictest10832-1kworker/u17:222:37:346
22190994696,166cyclictest121rcu_preempt19:53:403
22187994691,296cyclictest121rcu_preempt20:40:180
2219499468124,341cyclictest0-21swapper/723:40:317
22192994679,77cyclictest0-21swapper/500:06:085
221919946782,211cyclictest0-21swapper/400:16:234
2219099467127,211cyclictest32447-21kworker/u16:323:56:403
221949946684,84cyclictest27834-1kworker/u17:200:06:237
2219499466124,339cyclictest7163-21ssh23:00:287
2219499466124,339cyclictest0-21swapper/722:11:157
2219399466209,254cyclictest641ktimersoftd/623:40:226
22192994662,126cyclictest0-21swapper/522:50:235
22192994662,126cyclictest0-21swapper/522:50:235
22189994661,126cyclictest0-21swapper/223:52:002
2218899466125,338cyclictest0-21swapper/100:16:171
22188994660,41cyclictest0-21swapper/119:55:051
2219099465124,339cyclictest0-21swapper/322:19:453
2219099465124,338cyclictest0-21swapper/323:00:143
2219099465123,339cyclictest0-21swapper/300:01:053
2218799465293,84cyclictest0-21swapper/000:35:350
2219499464122,339cyclictest0-21swapper/700:42:277
2219199464295,86cyclictest481ktimersoftd/423:39:324
2219199464123,338cyclictest28216-21ssh00:22:124
2219199464122,339cyclictest25598-21nscd21:40:104
221949946383,84cyclictest0-21swapper/721:40:107
2219399463121,339cyclictest27045-21sh23:47:056
221929946339,126cyclictest0-21swapper/522:10:335
2219199463126,126cyclictest49-21ksoftirqd/423:00:284
2219099463121,339cyclictest0-21swapper/322:49:523
221889946378,169cyclictest25-21ksoftirqd/122:50:291
221889946378,169cyclictest25-21ksoftirqd/122:50:281
221879946379,169cyclictest0-21swapper/021:50:280
221879946340,253cyclictest0-21swapper/023:57:030
2219499462120,339cyclictest15850irq/123-ahci[0021:12:427
221939946278,211cyclictest0-21swapper/622:50:276
221939946278,211cyclictest0-21swapper/622:50:276
221929946240,255cyclictest0-21swapper/522:49:385
221879946240,256cyclictest0-21swapper/022:20:500
221949946038,168cyclictest121rcu_preempt21:50:227
221939946038,257cyclictest0-21swapper/600:01:246
2219399460120,338cyclictest0-21swapper/623:51:536
221919945979,84cyclictest0-21swapper/419:52:114
2218799459118,169cyclictest0-21swapper/022:40:170
221919945834,84cyclictest0-21swapper/422:49:114
2219199458287,83cyclictest0-21swapper/421:15:114
221899945835,85cyclictest0-21swapper/200:12:192
2218999458118,338cyclictest0-21swapper/200:42:012
2218799458116,211cyclictest4744-21taskset23:16:070
2218799458116,211cyclictest4744-21taskset23:16:070
221939945735,257cyclictest0-21swapper/600:31:326
221909945734,253cyclictest29209-21open_files23:30:203
221949945630,211cyclictest73-21ksoftirqd/722:49:187
221939945633,256cyclictest0-21swapper/623:25:526
221949945531,296cyclictest0-21swapper/723:15:397
221949945531,296cyclictest0-21swapper/723:15:397
221909945575,296cyclictest0-21swapper/322:10:163
221879945534,255cyclictest0-21swapper/000:01:240
2219499454111,84cyclictest21172-21ssh00:00:597
221899945470,210cyclictest0-21swapper/219:53:532
221949945371,84cyclictest121rcu_preempt23:30:037
221929945370,380cyclictest0-21swapper/500:41:595
221929945330,256cyclictest0-21swapper/523:00:135
2219299453110,170cyclictest0-21swapper/521:15:185
221919945373,84cyclictest0-21swapper/400:42:274
2219299452238,126cyclictest0-21swapper/500:11:465
2219299452111,338cyclictest20042-21ssh23:07:235
2219399451109,127cyclictest0-21swapper/621:15:196
221919945172,168cyclictest0-21swapper/423:27:004
2219499450111,84cyclictest11157-21ssh23:38:557
2219499450107,127cyclictest73-21ksoftirqd/722:19:477
221899945070,84cyclictest0-21swapper/221:40:102
221929944927,44cyclictest0-21swapper/519:54:115
221919944970,168cyclictest0-21swapper/400:12:104
2219199449109,337cyclictest1553-21runrttasks00:06:234
2219499448109,84cyclictest0-21swapper/722:50:057
2219499448109,84cyclictest0-21swapper/722:50:057
221929944827,256cyclictest0-21swapper/522:58:075
2219099448108,337cyclictest0-21swapper/321:40:123
2218999448367,79cyclictest321ktimersoftd/200:16:182
221949944665,84cyclictest0-21swapper/700:16:177
2219499446107,84cyclictest0-21swapper/700:12:137
2219399446106,338cyclictest0-21swapper/623:16:026
2219399446106,338cyclictest0-21swapper/623:16:026
221929944624,255cyclictest0-21swapper/500:32:085
2219299446105,338cyclictest0-21swapper/521:40:095
221919944523,256cyclictest0-21swapper/423:56:414
221949944459,254cyclictest713-21in:imuxsock19:55:017
221909944422,253cyclictest0-21swapper/322:30:093
221889944464,46cyclictest121rcu_preempt23:16:231
221889944464,46cyclictest121rcu_preempt23:16:231
221919944320,127cyclictest0-21swapper/420:40:134
221909944321,253cyclictest0-21swapper/319:14:343
221889944363,84cyclictest0-21swapper/120:40:181
221879944216,135cyclictest0-21swapper/022:30:090
2218799442105,168cyclictest0-21swapper/021:40:230
2219099441102,84cyclictest0-21swapper/319:55:113
221949944012,212cyclictest73-21ksoftirqd/723:56:367
221939944019,256cyclictest0-21swapper/623:56:416
221889943956,168cyclictest0-21swapper/121:50:221
221889943913,423cyclictest0-21swapper/123:40:221
221919943895,126cyclictest121rcu_preempt23:30:174
221929943795,339cyclictest0-21swapper/500:01:065
221919943755,127cyclictest0-21swapper/423:15:464
221919943755,127cyclictest0-21swapper/423:15:464
221929943696,296cyclictest0-21swapper/523:40:225
22189994369,126cyclictest9767-21awk21:50:292
22192994359,253cyclictest0-21swapper/522:20:495
221889943413,83cyclictest30209-21diskmemload22:30:091
221929943311,42cyclictest0-21swapper/500:22:485
22192994314,211cyclictest0-21swapper/522:40:175
221919943091,84cyclictest0-21swapper/419:55:104
221919943091,48cyclictest0-21swapper/422:50:154
221919943091,48cyclictest0-21swapper/422:50:154
221909942986,127cyclictest22185-21cyclictest00:35:293
22191994271,212cyclictest0-21swapper/400:01:434
221879942742,296cyclictest0-21swapper/000:06:080
2219199425126,126cyclictest49-21ksoftirqd/400:32:104
221929942483,338cyclictest0-21swapper/519:55:055
221929942483,338cyclictest0-21swapper/500:16:185
22191994242,90cyclictest0-21swapper/423:40:274
221939942383,338cyclictest0-21swapper/622:20:086
221899942382,338cyclictest0-21swapper/219:14:342
221949942280,169cyclictest73-21ksoftirqd/722:20:097
221889942282,338cyclictest0-21swapper/119:14:341
22188994221,40cyclictest0-21swapper/119:40:311
221949942182,84cyclictest0-21swapper/719:14:347
221919942182,84cyclictest0-21swapper/423:52:104
221879942182,84cyclictest121rcu_preempt22:19:220
221909942079,338cyclictest0-21swapper/323:13:433
221899942079,338cyclictest0-21swapper/219:55:102
221889942036,253cyclictest0-21swapper/123:24:551
221909941939,296cyclictest0-21swapper/300:06:243
221909941935,169cyclictest121rcu_preempt23:24:493
221899941979,337cyclictest0-21swapper/222:20:102
221929941877,338cyclictest24334-21diskmemload21:58:465
221939941776,338cyclictest0-21swapper/623:07:246
221929941777,338cyclictest0-21swapper/522:19:405
221919941738,299cyclictest22185-21cyclictest22:40:164
221909941779,301cyclictest0-21swapper/321:58:473
221879941781,334cyclictest0-21swapper/019:14:340
221879941776,338cyclictest0-21swapper/019:52:050
221939941675,338cyclictest0-21swapper/600:25:556
221939941574,338cyclictest0-21swapper/621:58:476
221939941574,338cyclictest0-21swapper/621:40:236
221939941535,296cyclictest0-21swapper/600:12:196
221889941535,126cyclictest121rcu_preempt23:13:421
2219499414114,126cyclictest121rcu_preempt23:52:107
2219299414116,126cyclictest0-21swapper/522:30:095
221949941374,84cyclictest0-21swapper/700:35:347
221939941372,338cyclictest0-21swapper/622:40:166
221919941334,257cyclictest0-21swapper/423:24:544
2218999413245,42cyclictest0-21swapper/220:40:112
221939941272,338cyclictest0-21swapper/620:40:176
221929941271,338cyclictest0-21swapper/520:40:155
2219099411119,84cyclictest0-21swapper/319:40:253
221899941172,84cyclictest0-21swapper/200:06:232
221889941131,85cyclictest0-21swapper/123:46:591
221879941030,42cyclictest0-21swapper/023:52:180
2218799410112,126cyclictest121rcu_preempt21:58:460
221919940971,83cyclictest0-21swapper/419:14:334
221899940980,160cyclictest0-21swapper/223:30:242
221939940868,338cyclictest0-21swapper/600:22:306
221899940767,84cyclictest0-21swapper/222:50:032
221899940767,84cyclictest0-21swapper/222:50:032
221939940665,338cyclictest0-21swapper/619:55:056
221949940566,84cyclictest0-21swapper/719:40:277
221939940523,297cyclictest0-21swapper/619:14:356
221929940564,338cyclictest0-21swapper/521:50:195
221919940465,84cyclictest0-21swapper/400:35:384
221909940361,339cyclictest0-21swapper/300:16:173
221899940222,84cyclictest0-21swapper/223:47:052
221919940161,126cyclictest49-21ksoftirqd/419:40:314
221909940161,338cyclictest0-21swapper/322:40:173
221909940159,339cyclictest0-21swapper/300:25:543
221909940120,296cyclictest0-21swapper/323:46:583
221889940160,338cyclictest0-21swapper/123:30:211
221939939857,338cyclictest0-21swapper/619:40:266
221939939757,338cyclictest0-21swapper/600:16:176
2219199396183,125cyclictest121rcu_preempt00:25:554
221919939254,84cyclictest0-21swapper/423:47:014
221899939051,84cyclictest0-21swapper/222:30:082
22192993894,83cyclictest0-21swapper/519:14:355
2219499382125,254cyclictest0-21swapper/723:47:007
221939938241,338cyclictest0-21swapper/623:13:436
221899938143,84cyclictest0-21swapper/223:13:432
22187993812,126cyclictest29220-21/usr/sbin/munin23:30:200
221939938081,127cyclictest0-21swapper/622:30:086
221899937979,127cyclictest0-21swapper/200:26:082
221949937578,84cyclictest0-21swapper/700:25:557
2219399375122,42cyclictest30152-21nscd00:35:296
221879937534,338cyclictest0-21swapper/000:12:090
221949937477,126cyclictest0-21swapper/720:40:177
2219199374288,84cyclictest481ktimersoftd/422:30:094
2219099374119,219cyclictest0-21swapper/319:20:043
221899937333,84cyclictest0-21swapper/200:35:302
221919937134,42cyclictest0-21swapper/421:58:464
2219499368111,126cyclictest17941-21munin-node19:55:107
221889936828,337cyclictest0-21swapper/100:35:301
2218799368111,127cyclictest0-21swapper/000:16:190
221929936730,84cyclictest1551-21snmpd23:30:035
221879936364,126cyclictest9-21ksoftirqd/023:24:490
2218999362106,126cyclictest121rcu_preempt23:24:532
221929935920,84cyclictest0-21swapper/519:40:265
221899935920,83cyclictest121rcu_preempt19:40:252
221899935719,217cyclictest0-21swapper/219:20:022
221879935517,84cyclictest0-21swapper/023:46:590
2219499352140,84cyclictest18984-1kworker/u17:022:30:117
2218999352264,44cyclictest0-21swapper/221:58:462
22187993413,84cyclictest0-21swapper/019:40:310
221889934040,126cyclictest25-21ksoftirqd/121:58:451
221929933781,253cyclictest3142-21rm00:25:555
221889933435,169cyclictest121rcu_preempt19:20:041
221879932872,253cyclictest0-21swapper/019:55:050
221929932771,126cyclictest30209-21diskmemload23:24:545
221919932732,84cyclictest0-21swapper/423:13:434
221949932030,163cyclictest0-21swapper/719:20:047
221879931719,134cyclictest0-21swapper/023:13:430
221879931718,43cyclictest0-21swapper/000:26:080
221879931357,84cyclictest121rcu_preempt19:20:040
221949931011,126cyclictest24333-21chrt21:58:467
221929931013,85cyclictest0-21swapper/519:20:045
221939929539,85cyclictest0-21swapper/623:24:486
221949928831,211cyclictest121rcu_preempt23:13:447
221939928835,171cyclictest0-21swapper/619:20:046
221929928734,42cyclictest0-21swapper/523:13:425
221919926611,252cyclictest0-21swapper/419:20:034
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional