You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 06:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue May 12, 2026 00:58:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305429971678,635cyclictest16239-21ssh22:29:057
305429971333,677cyclictest0-21swapper/722:11:157
305429971333,677cyclictest0-21swapper/722:11:157
3053999708114,127cyclictest0-21swapper/400:46:504
305359969419,133cyclictest8179-21diskmemload21:10:290
30542996887,678cyclictest0-21swapper/722:39:357
30542996811,42cyclictest1183-21ssh22:56:557
3054199668115,380cyclictest1553-21runrttasks21:09:216
305379966631,84cyclictest0-21swapper/221:55:322
3053999664156,84cyclictest121rcu_preempt00:20:444
305429965922,634cyclictest0-21swapper/721:57:297
305379965925,2cyclictest0-21swapper/222:22:442
305399965522,380cyclictest9637-21timerandwakeup23:55:444
3053599644263,126cyclictest6150-21kworker/u16:100:35:140
3053599644263,126cyclictest6150-21kworker/u16:100:35:140
30541996407,382cyclictest0-21swapper/623:52:166
30536996350,84cyclictest0-21swapper/122:26:051
30535996350,84cyclictest121rcu_preempt22:29:050
30539996341,3cyclictest0-21swapper/422:22:444
3053999628287,338cyclictest64450irq/122-eth022:56:224
305369962675,85cyclictest121rcu_preempt22:38:551
305419962473,126cyclictest0-21swapper/623:24:236
305419962369,380cyclictest0-21swapper/621:37:526
3054299622111,380cyclictest0-21swapper/700:13:217
305379962268,381cyclictest0-21swapper/222:48:262
3053799621109,381cyclictest0-21swapper/223:55:352
3053799621109,296cyclictest0-21swapper/200:32:042
3053699620108,381cyclictest0-21swapper/123:35:111
305379961726,42cyclictest121rcu_preempt23:54:372
3053699612271,338cyclictest4591-21ssh00:31:031
3054299610100,295cyclictest0-21swapper/723:57:107
3053999608267,338cyclictest64450irq/122-eth022:48:454
305429960653,294cyclictest0-21swapper/722:07:307
305429960611,592cyclictest0-21swapper/700:22:497
305429960411,84cyclictest0-21swapper/722:23:497
3053999600260,338cyclictest64450irq/122-eth000:07:134
30538996008,383cyclictest0-21swapper/322:22:443
30537996007,126cyclictest0-21swapper/200:21:362
3053599599134,126cyclictest32531-21nscd00:12:290
30540995964,2cyclictest0-21swapper/522:22:445
30537995940,84cyclictest0-21swapper/222:26:332
30537995940,84cyclictest0-21swapper/222:10:172
30537995940,84cyclictest0-21swapper/222:10:172
30540995930,84cyclictest0-21swapper/523:43:055
30539995930,84cyclictest0-21swapper/422:09:334
305359959281,338cyclictest0-21swapper/021:39:510
30535995911,340cyclictest0-21swapper/023:52:160
305419959039,339cyclictest0-21swapper/623:41:406
305399958876,296cyclictest0-21swapper/421:56:554
305389958877,296cyclictest0-21swapper/321:09:013
305369958738,383cyclictest0-21swapper/122:22:441
305379958579,83cyclictest22297-21ssh23:44:362
305359958531,295cyclictest0-21swapper/022:06:080
305359958271,296cyclictest0-21swapper/022:12:450
305359958271,296cyclictest0-21swapper/022:12:450
305389958169,381cyclictest0-21swapper/322:39:173
3053899580281,126cyclictest6150-21kworker/u16:122:12:443
3053899580281,126cyclictest6150-21kworker/u16:122:12:443
305379957825,126cyclictest0-21swapper/221:38:192
305399957727,84cyclictest0-21swapper/422:39:174
305399957668,126cyclictest0-21swapper/423:25:154
3053999576150,299cyclictest121rcu_preempt23:53:334
3053799575109,126cyclictest0-21swapper/221:09:212
305429957464,507cyclictest0-21swapper/722:48:067
3053999574235,84cyclictest64450irq/122-eth000:13:224
305409957366,125cyclictest0-21swapper/522:06:085
3053699573152,84cyclictest6331-21kworker/u16:323:56:171
305389956717,126cyclictest0-21swapper/322:07:303
305359956757,295cyclictest121rcu_preempt00:06:420
3053999566101,126cyclictest121rcu_preempt22:25:464
305409956559,126cyclictest121rcu_preempt21:57:525
3053899565178,339cyclictest121rcu_preempt00:12:063
305359956515,126cyclictest121rcu_preempt23:41:320
305369956213,261cyclictest0-21swapper/100:07:201
305359956215,373cyclictest0-21swapper/023:55:440
305419956091,296cyclictest0-21swapper/600:06:116
30541995595,127cyclictest0-21swapper/622:37:586
30541995585,338cyclictest2662-21ssh22:58:416
30542995578,298cyclictest0-21swapper/723:52:167
3053899557130,296cyclictest0-21swapper/323:44:253
30539995555,126cyclictest1551-21snmpd23:00:174
30537995555,84cyclictest1651-21ntpd23:00:132
30542995541,42cyclictest0-21swapper/723:25:197
30542995541,42cyclictest0-21swapper/700:47:057
305429955282,127cyclictest0-21swapper/700:31:237
30541995520,85cyclictest0-21swapper/623:56:336
3053799552508,42cyclictest311rcuc/200:46:542
3053699550124,338cyclictest795-21kworker/u16:222:09:511
305429954941,424cyclictest0-21swapper/721:52:577
305429954938,508cyclictest0-21swapper/721:39:097
305429954841,260cyclictest0-21swapper/723:23:157
305409954634,295cyclictest0-21swapper/523:34:435
3054099546120,253cyclictest0-21swapper/500:06:565
305389954634,381cyclictest0-21swapper/300:21:183
3054099545165,84cyclictest704-21nscd00:33:075
305359954435,85cyclictest0-21swapper/000:22:310
3053999543119,84cyclictest121rcu_preempt22:30:084
305429954273,296cyclictest0-21swapper/700:15:117
305419954235,338cyclictest0-21swapper/600:23:246
3053899542115,258cyclictest0-21swapper/323:57:583
305369954173,380cyclictest0-21swapper/100:22:311
305389954031,84cyclictest0-21swapper/322:28:053
305429953929,507cyclictest0-21swapper/723:44:007
3054099538112,211cyclictest0-21swapper/500:12:305
305369953871,294cyclictest25-21ksoftirqd/122:57:291
305399953768,211cyclictest481ktimersoftd/423:43:484
305359953768,338cyclictest0-21swapper/022:23:490
305419953626,337cyclictest14056-21sh22:25:466
305359953628,84cyclictest0-21swapper/023:25:210
305429953524,508cyclictest0-21swapper/722:40:127
305399953570,126cyclictest0-21swapper/400:32:474
3053899535113,84cyclictest121rcu_preempt23:32:013
305369953567,465cyclictest0-21swapper/122:11:071
305369953567,465cyclictest0-21swapper/122:11:071
3053599535235,127cyclictest0-21swapper/000:33:160
3053999534277,85cyclictest0-21swapper/422:14:404
3053999534277,85cyclictest0-21swapper/422:14:404
305359953428,252cyclictest0-21swapper/023:23:560
3054099533107,295cyclictest0-21swapper/500:22:065
3053699533150,126cyclictest121rcu_preempt23:44:061
305359953326,126cyclictest0-21swapper/023:45:140
305399953263,338cyclictest0-21swapper/421:39:514
3053799532359,84cyclictest0-21swapper/223:23:412
305369953221,338cyclictest0-21swapper/121:10:261
305389953162,296cyclictest0-21swapper/323:52:133
3053599531110,206cyclictest121rcu_preempt21:55:140
305419953023,380cyclictest0-21swapper/600:31:466
305419952923,85cyclictest0-21swapper/621:58:486
305389952963,84cyclictest0-21swapper/300:35:143
305389952963,84cyclictest0-21swapper/300:35:143
305389952819,85cyclictest0-21swapper/322:58:163
3054099527444,4cyclictest551rcuc/521:10:295
305389952714,344cyclictest0-21swapper/323:23:343
305379952758,295cyclictest0-21swapper/222:57:522
3053699527105,128cyclictest25-21ksoftirqd/100:15:161
305429952616,507cyclictest0-21swapper/720:35:177
305379952614,381cyclictest0-21swapper/222:39:112
305369952697,295cyclictest0-21swapper/100:12:301
305369952517,217cyclictest0-21swapper/121:58:151
3053599525442,3cyclictest111rcuc/020:32:240
305429952312,168cyclictest0-21swapper/723:34:547
305419952363,335cyclictest6137-21diskmemload00:00:086
305409952355,253cyclictest1276-21chrt22:57:025
305389952315,126cyclictest32132-21taskset21:55:513
305379952212,338cyclictest0-21swapper/200:10:482
305389952051,254cyclictest0-21swapper/321:39:103
305429951911,424cyclictest0-21swapper/720:33:407
305419951910,126cyclictest0-21swapper/622:10:236
305419951910,126cyclictest0-21swapper/622:10:236
305369951912,256cyclictest5203-21ssh23:52:161
3054199518178,338cyclictest20778-1kworker/u17:223:45:176
305409951810,84cyclictest121rcu_preempt00:47:045
305389951852,211cyclictest0-21swapper/300:06:403
30536995185,338cyclictest0-21swapper/123:45:201
3054199517178,169cyclictest602-21ssh21:40:076
30540995168,84cyclictest0-21swapper/523:55:355
305419951511,124cyclictest0-21swapper/622:08:296
30538995124,168cyclictest0-21swapper/300:15:033
30537995113,126cyclictest0-21swapper/222:07:272
305369951184,296cyclictest0-21swapper/121:39:021
3054099509125,127cyclictest0-21swapper/522:46:325
30540995080,84cyclictest0-21swapper/522:26:335
305429950579,423cyclictest0-21swapper/722:00:087
305419950472,84cyclictest30533-21cyclictest21:55:006
305409950480,169cyclictest0-21swapper/521:39:335
3053999504420,3cyclictest481ktimersoftd/423:32:234
305379950439,3cyclictest0-21swapper/200:15:202
305369950440,126cyclictest0-21swapper/122:49:561
3054099503123,126cyclictest17403-21cron20:35:005
3053799503291,84cyclictest321ktimersoftd/221:10:232
305429950136,381cyclictest0-21swapper/700:35:147
305429950136,381cyclictest0-21swapper/700:35:147
3053799501116,296cyclictest121rcu_preempt22:15:042
305429950032,465cyclictest0-21swapper/721:40:067
305379950035,48cyclictest0-21swapper/220:35:032
3053699500115,127cyclictest121rcu_preempt23:32:351
305359949935,219cyclictest0-21swapper/022:39:120
305419949876,84cyclictest0-21swapper/600:14:106
305419949871,296cyclictest0-21swapper/623:33:166
305409949873,168cyclictest0-21swapper/523:24:485
3054099498324,126cyclictest0-21swapper/523:52:575
305359949830,126cyclictest0-21swapper/022:56:490
305419949733,296cyclictest0-21swapper/622:24:026
305389949731,84cyclictest0-21swapper/322:47:143
3053999496453,41cyclictest471rcuc/400:00:184
305399949531,2cyclictest0-21swapper/423:35:184
305359949569,295cyclictest0-21swapper/022:00:250
305429949427,464cyclictest0-21swapper/723:45:177
305429949426,465cyclictest0-21swapper/721:08:437
305409949471,84cyclictest0-21swapper/522:10:125
305409949471,84cyclictest0-21swapper/522:10:125
305399949428,84cyclictest0-21swapper/423:23:414
3054199493112,84cyclictest18358-21ssh22:49:366
3053899493194,126cyclictest121rcu_preempt00:33:463
305359949326,84cyclictest0-21swapper/022:47:170
305399949269,420cyclictest0-21swapper/422:50:134
305409949068,84cyclictest0-21swapper/523:00:135
305359948925,219cyclictest0-21swapper/000:25:210
305429948617,169cyclictest0-21swapper/722:50:147
305399948619,212cyclictest0-21swapper/423:45:094
305379948458,254cyclictest0-21swapper/221:53:042
305369948318,298cyclictest30533-21cyclictest00:25:171
305419948117,261cyclictest0-21swapper/600:35:156
305419948117,261cyclictest0-21swapper/600:35:146
305399948159,84cyclictest121rcu_preempt20:33:594
305379948054,253cyclictest121rcu_preempt22:00:222
305369948016,380cyclictest30533-21cyclictest23:23:471
305369948011,84cyclictest0-21swapper/121:53:391
30538994787,338cyclictest0-21swapper/323:00:173
305379947795,84cyclictest0-21swapper/223:33:432
305399947559,205cyclictest27852-1rm21:53:414
30542994724,465cyclictest0-21swapper/700:07:137
305419947291,85cyclictest8186-21chrt21:10:306
305359947248,127cyclictest0-21swapper/021:09:470
305409947150,83cyclictest0-21swapper/522:30:045
30539994701,84cyclictest0-21swapper/400:35:124
30539994701,84cyclictest0-21swapper/400:35:124
30537994701,84cyclictest0-21swapper/223:25:262
30541994681,211cyclictest0-21swapper/623:25:146
30537994683,168cyclictest0-21swapper/223:45:212
305409946782,211cyclictest0-21swapper/522:37:065
305399946788,210cyclictest0-21swapper/421:10:164
30538994671,211cyclictest0-21swapper/321:53:403
30536994672,135cyclictest0-21swapper/122:30:031
30536994671,84cyclictest0-21swapper/121:09:011
30536994670,84cyclictest0-21swapper/122:50:131
30535994660,84cyclictest0-21swapper/022:50:130
30537994651,83cyclictest0-21swapper/222:50:122
305369946341,260cyclictest0-21swapper/100:47:081
305359946341,255cyclictest0-21swapper/000:15:180
3054299462122,338cyclictest15850irq/123-ahci[0000:25:267
305409946240,255cyclictest0-21swapper/521:54:115
305389946277,211cyclictest41-21ksoftirqd/322:00:243
305369946182,84cyclictest0-21swapper/122:00:101
305359946176,211cyclictest5181-21sh23:34:230
305359946140,260cyclictest30533-21cyclictest21:54:280
3053599461122,336cyclictest0-21swapper/023:35:260
305429946038,344cyclictest0-21swapper/723:35:047
305409946038,256cyclictest0-21swapper/523:45:215
305389946037,256cyclictest0-21swapper/321:10:073
305429945934,422cyclictest0-21swapper/721:10:257
305419945936,257cyclictest6135-21cpuspeed_turbos23:35:126
305409945934,210cyclictest6323-21ssh21:10:025
305379945979,83cyclictest0-21swapper/200:06:582
305369945979,211cyclictest1553-21runrttasks00:00:141
305359945836,211cyclictest0-21swapper/020:35:320
305419945777,84cyclictest0-21swapper/600:15:156
305429945634,255cyclictest0-21swapper/700:00:227
305419945574,45cyclictest0-21swapper/600:46:356
3054199455369,84cyclictest631rcuc/622:40:056
305389945532,84cyclictest0-21swapper/300:25:123
305419945271,85cyclictest4420-21sh22:00:226
305409945230,256cyclictest0-21swapper/523:35:125
3053999452111,338cyclictest0-21swapper/420:35:244
305419945170,84cyclictest0-21swapper/622:30:086
305389945129,257cyclictest0-21swapper/323:35:123
3053799451110,338cyclictest0-21swapper/223:35:282
305369945124,260cyclictest0-21swapper/120:35:151
305399944927,3cyclictest0-21swapper/400:15:024
305389944825,256cyclictest0-21swapper/300:00:223
305379944820,127cyclictest33-21ksoftirqd/200:35:082
305379944820,127cyclictest33-21ksoftirqd/200:35:082
305369944726,255cyclictest22006-21runrttasks23:25:171
3054099445104,338cyclictest0-21swapper/500:35:205
3054099445104,338cyclictest0-21swapper/500:35:205
3053899444145,84cyclictest6137-21diskmemload00:46:333
3054099443145,133cyclictest22682-21cat23:25:265
305379944319,84cyclictest0-21swapper/222:40:132
305419944220,3cyclictest30533-21cyclictest20:34:086
305399944220,84cyclictest0-21swapper/422:00:224
305399944119,256cyclictest0-21swapper/421:08:454
305379944120,210cyclictest0-21swapper/220:35:202
305409944018,126cyclictest0-21swapper/500:15:055
305389943997,339cyclictest0-21swapper/322:30:023
305379943913,295cyclictest17436-21diskmemload22:30:082
305419943815,3cyclictest0-21swapper/620:35:216
305419943795,339cyclictest0-21swapper/623:00:186
305379943714,3cyclictest0-21swapper/200:25:122
305359943715,256cyclictest0-21swapper/023:00:190
305359943715,256cyclictest0-21swapper/000:00:220
305369943614,259cyclictest0-21swapper/120:34:081
305359943697,84cyclictest0-21swapper/000:47:000
305419943393,338cyclictest0-21swapper/600:25:126
30538994328,254cyclictest0-21swapper/323:25:153
30542994308,255cyclictest0-21swapper/722:15:037
30535994308,176cyclictest0-21swapper/022:15:030
30537994271,127cyclictest0-21swapper/200:00:042
3054199426127,126cyclictest65-21ksoftirqd/622:15:076
3053999426343,3cyclictest471rcuc/422:40:144
305359942487,295cyclictest1885-21sh22:40:140
305389942383,338cyclictest0-21swapper/323:45:213
305389942282,338cyclictest0-21swapper/320:34:023
305369942282,338cyclictest0-21swapper/121:40:071
305409942183,83cyclictest0-21swapper/520:35:195
305389942181,338cyclictest0-21swapper/322:50:173
305389942181,338cyclictest0-21swapper/321:40:073
305359942181,338cyclictest0-21swapper/021:40:070
305369942083,126cyclictest1789-21ssh22:40:041
305409941980,84cyclictest0-21swapper/500:00:055
305369941940,296cyclictest0-21swapper/123:00:201
305409941876,254cyclictest0-21swapper/522:00:165
305429941736,296cyclictest0-21swapper/723:00:207
305369941775,211cyclictest25-21ksoftirqd/100:35:081
305369941775,211cyclictest25-21ksoftirqd/100:35:081
3054199416124,290cyclictest19074-21rm22:50:046
305399941674,339cyclictest0-21swapper/421:40:064
305359941676,338cyclictest0-21swapper/022:30:020
305429941574,338cyclictest0-21swapper/722:30:027
305389941474,338cyclictest0-21swapper/320:35:203
305369941473,338cyclictest0-21swapper/122:15:141
305409941375,84cyclictest0-21swapper/522:40:055
305389941333,296cyclictest0-21swapper/322:40:123
305409941072,83cyclictest0-21swapper/500:25:185
305399941069,338cyclictest0-21swapper/400:25:244
305409940869,84cyclictest0-21swapper/521:40:075
305379940869,84cyclictest0-21swapper/221:40:072
305409940668,84cyclictest0-21swapper/522:15:075
305399939656,337cyclictest0-21swapper/422:15:074
305409939455,84cyclictest0-21swapper/522:50:135
305389938343,338cyclictest0-21swapper/322:15:133
2987629666,27sleep70-21swapper/719:06:507
25982880,2sleep53054099cyclictest21:00:245
2999028654,28sleep40-21swapper/419:08:244
3009228543,38sleep20-21swapper/219:09:502
3000928353,27sleep30-21swapper/319:08:393
2995428353,27sleep50-21swapper/519:07:535
2994128250,28sleep10-21swapper/119:07:401
2990728251,28sleep60-21swapper/619:07:136
2988727948,27sleep00-21swapper/019:06:590
198842730,0sleep50-21swapper/519:45:005
30541993026,3cyclictest0-21swapper/620:53:106
173572290,0sleep20-21swapper/221:30:372
173572290,0sleep20-21swapper/221:30:372
30542992810,18cyclictest0-21swapper/719:23:117
30542992810,0cyclictest0-21swapper/720:53:127
30541992828,0cyclictest0-21swapper/619:52:436
30541992810,0cyclictest0-21swapper/619:13:526
30538992810,0cyclictest0-21swapper/319:23:203
30536992810,0cyclictest0-21swapper/119:13:281
40642270,1sleep7711rcuc/720:10:177
30542992727,0cyclictest0-21swapper/721:32:347
30542992727,0cyclictest0-21swapper/721:32:347
30542992727,0cyclictest0-21swapper/719:13:577
30542992710,17cyclictest0-21swapper/720:17:267
30542992710,17cyclictest0-21swapper/720:17:267
30542992710,17cyclictest0-21swapper/719:43:597
30542992710,0cyclictest0-21swapper/720:06:117
30541992727,0cyclictest0-21swapper/619:43:546
30541992710,17cyclictest0-21swapper/621:32:276
30541992710,17cyclictest0-21swapper/621:32:276
30541992710,17cyclictest0-21swapper/619:32:536
30541992710,0cyclictest0-21swapper/620:17:436
30541992710,0cyclictest0-21swapper/620:17:436
30541992710,0cyclictest0-21swapper/620:06:046
30541992710,0cyclictest0-21swapper/619:23:176
30540992727,0cyclictest0-21swapper/520:53:145
30540992727,0cyclictest0-21swapper/520:06:145
30540992727,0cyclictest0-21swapper/519:22:525
30540992727,0cyclictest0-21swapper/519:13:525
30540992710,17cyclictest0-21swapper/521:32:315
30540992710,17cyclictest0-21swapper/521:32:315
30540992710,17cyclictest0-21swapper/519:32:545
30540992710,0cyclictest0-21swapper/519:52:375
30539992727,0cyclictest0-21swapper/419:13:254
30539992710,17cyclictest0-21swapper/420:17:054
30539992710,17cyclictest0-21swapper/420:17:054
30539992710,17cyclictest0-21swapper/419:52:404
30539992710,17cyclictest0-21swapper/419:43:174
30539992710,17cyclictest0-21swapper/419:33:164
30539992710,0cyclictest0-21swapper/421:32:274
30539992710,0cyclictest0-21swapper/421:32:274
30539992710,0cyclictest0-21swapper/420:52:484
30539992710,0cyclictest0-21swapper/420:06:314
30539992710,0cyclictest0-21swapper/419:23:174
30538992727,0cyclictest0-21swapper/320:52:473
30538992727,0cyclictest0-21swapper/320:17:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional