You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 13:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri May 08, 2026 00:55:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25261998900,84cyclictest0-21swapper/021:38:240
25261998900,84cyclictest0-21swapper/000:44:000
2526499789745,42cyclictest391rcuc/300:35:163
2526499789745,42cyclictest391rcuc/300:35:163
252619969356,634cyclictest0-21swapper/022:50:320
2526199673205,295cyclictest0-21swapper/023:52:280
2526399669115,381cyclictest0-21swapper/200:32:562
25261996360,42cyclictest20718-21idleruntime21:55:320
252659963481,211cyclictest49-21ksoftirqd/422:48:064
2526899632162,296cyclictest0-21swapper/700:10:197
252619963282,84cyclictest0-21swapper/023:23:590
252689963033,380cyclictest0-21swapper/722:50:027
252639960653,380cyclictest0-21swapper/219:49:422
25264995960,424cyclictest0-21swapper/323:52:063
25261995961,465cyclictest0-21swapper/023:56:520
25261995961,465cyclictest0-21swapper/023:56:520
25261995961,465cyclictest0-21swapper/023:56:510
25267995950,84cyclictest0-21swapper/621:50:256
25268995940,84cyclictest0-21swapper/721:52:177
25263995940,85cyclictest14983-21/usr/sbin/munin21:50:242
25266995930,84cyclictest0-21swapper/521:50:255
252619959387,253cyclictest30142-21ssh23:10:200
2526799590124,211cyclictest0-21swapper/622:05:026
252689958978,211cyclictest73-21ksoftirqd/722:50:357
2526699589120,210cyclictest0-21swapper/522:24:255
252639958333,127cyclictest21234-21rm00:18:552
252639958333,127cyclictest21234-21rm00:18:542
25261995830,501cyclictest0-21swapper/000:34:370
2526599581241,338cyclictest64450irq/122-eth021:49:124
2526399579113,130cyclictest19647-21sh23:58:222
2526399579113,130cyclictest19647-21sh23:58:222
2526399579113,130cyclictest19647-21sh23:58:212
252619957728,465cyclictest0-21swapper/019:50:150
252619957728,465cyclictest0-21swapper/019:50:140
252619957362,253cyclictest9-21ksoftirqd/021:48:560
2526599571102,296cyclictest0-21swapper/423:52:564
252689957020,126cyclictest0-21swapper/700:32:567
25265995585,550cyclictest0-21swapper/421:55:144
25261995574,465cyclictest0-21swapper/023:46:370
252619955410,465cyclictest0-21swapper/023:08:010
25261995520,84cyclictest0-21swapper/022:58:180
25261995510,2cyclictest3235-21ssh00:07:130
25261995504,501cyclictest0-21swapper/000:18:460
25261995504,501cyclictest0-21swapper/000:18:460
252689954878,169cyclictest73-21ksoftirqd/720:37:247
2526899546124,247cyclictest14818-21ssh23:55:027
2526899546124,247cyclictest14818-21ssh23:55:027
2526899546124,247cyclictest14818-21ssh23:55:027
2526899545115,426cyclictest0-21swapper/700:16:437
2526899545115,426cyclictest0-21swapper/700:16:427
2526699544160,126cyclictest121rcu_preempt23:00:175
252659954332,295cyclictest0-21swapper/422:04:564
252629954374,380cyclictest6404-21df00:10:171
252629954332,295cyclictest0-21swapper/123:10:201
2526299542498,42cyclictest231rcuc/121:40:191
252639954176,299cyclictest25259-21cyclictest22:03:112
252629954171,211cyclictest2071-21ssh23:45:431
252629954030,507cyclictest0-21swapper/123:00:261
252619953933,428cyclictest10903-21taskset22:24:440
2526499538153,255cyclictest15974-1kworker/u17:121:54:443
252659953323,507cyclictest64450irq/122-eth000:44:114
252629953364,211cyclictest0-21swapper/121:54:491
252639953019,340cyclictest0-21swapper/200:08:252
252659952721,3cyclictest0-21swapper/421:51:014
252629952455,211cyclictest0-21swapper/123:44:391
252629952355,465cyclictest0-21swapper/120:39:031
252619952110,508cyclictest1320-21ssh22:02:110
252659952056,83cyclictest0-21swapper/421:40:114
25261995152,388cyclictest19313-21hddtemp_smartct00:35:280
25261995152,388cyclictest19313-21hddtemp_smartct00:35:280
2526699514130,126cyclictest121rcu_preempt21:55:285
252619951310,161cyclictest0-21swapper/021:54:460
2526599508170,257cyclictest64450irq/122-eth000:19:154
2526599508170,257cyclictest64450irq/122-eth000:19:144
25264995081,7cyclictest0-21swapper/300:34:093
252629950781,211cyclictest0-21swapper/122:59:251
252629950780,211cyclictest0-21swapper/122:02:341
252639950533,84cyclictest698-21ptp4l22:25:142
2526799504121,380cyclictest0-21swapper/623:00:266
252649950477,211cyclictest0-21swapper/300:07:413
252639950481,126cyclictest33-21ksoftirqd/200:35:172
252639950481,126cyclictest33-21ksoftirqd/200:35:172
252639950333,296cyclictest0-21swapper/223:09:422
25261995030,161cyclictest0-21swapper/000:20:260
252659950278,83cyclictest121rcu_preempt00:34:554
2526599502161,210cyclictest610-21diskmemload00:35:194
2526599502161,210cyclictest610-21diskmemload00:35:194
252669950034,211cyclictest0-21swapper/521:49:125
252689949871,211cyclictest19228-21expr00:35:217
252689949871,211cyclictest19228-21expr00:35:217
2526699498242,253cyclictest561ktimersoftd/523:55:215
2526699498242,253cyclictest561ktimersoftd/523:55:215
2526699498242,253cyclictest561ktimersoftd/523:55:215
2526399498415,3cyclictest311rcuc/222:50:012
2526599497244,84cyclictest64450irq/122-eth022:50:144
252629949774,380cyclictest0-21swapper/123:58:121
252629949774,380cyclictest0-21swapper/123:58:121
252629949774,380cyclictest0-21swapper/123:58:121
252689949630,211cyclictest0-21swapper/700:41:487
252649949675,83cyclictest0-21swapper/323:07:443
252639949530,83cyclictest121rcu_preempt00:10:182
252679949466,127cyclictest0-21swapper/620:40:276
2526799494152,339cyclictest0-21swapper/600:32:566
252659949472,84cyclictest0-21swapper/423:44:064
252629949467,126cyclictest0-21swapper/100:10:001
252619949430,84cyclictest0-21swapper/000:10:120
2526799493110,381cyclictest0-21swapper/600:16:436
2526799493110,381cyclictest0-21swapper/600:16:436
252629949324,84cyclictest0-21swapper/123:08:141
2526199492235,84cyclictest9-21ksoftirqd/023:00:260
2526899491149,126cyclictest121rcu_preempt23:52:097
252679949165,210cyclictest121rcu_preempt00:07:166
252679949124,3cyclictest0-21swapper/623:06:166
2526799491150,126cyclictest3404-21sh22:04:396
2526799490235,253cyclictest641ktimersoftd/600:41:496
2526599490111,295cyclictest0-21swapper/421:38:164
252629949064,211cyclictest0-21swapper/122:25:151
252689948931,36cyclictest0-21swapper/722:03:417
252629948961,169cyclictest0-21swapper/122:24:291
2526399488445,41cyclictest311rcuc/200:44:242
252659948765,256cyclictest25259-21cyclictest23:08:534
252649948721,211cyclictest0-21swapper/300:42:263
2526799486187,126cyclictest121rcu_preempt23:00:006
2526699485234,121cyclictest3174-1kworker/u17:022:49:355
2526599485142,126cyclictest121rcu_preempt23:00:254
252679948420,84cyclictest0-21swapper/600:35:046
252679948420,84cyclictest0-21swapper/600:35:046
252639948413,83cyclictest0-21swapper/223:54:082
252689948318,2cyclictest0-21swapper/723:44:257
2526899483103,296cyclictest0-21swapper/721:38:157
252629948314,211cyclictest25-21ksoftirqd/100:41:121
252619948399,126cyclictest9-21ksoftirqd/023:44:210
252619948257,422cyclictest0-21swapper/020:40:260
2526799480225,253cyclictest641ktimersoftd/621:47:316
25264994809,212cyclictest41-21ksoftirqd/320:40:183
252629948016,83cyclictest0-21swapper/123:54:301
252629948016,253cyclictest0-21swapper/123:22:591
252619948055,422cyclictest0-21swapper/021:40:070
252659947652,422cyclictest0-21swapper/422:59:204
252639947654,338cyclictest0-21swapper/221:40:122
25266994759,84cyclictest1367-21ssh00:44:125
25263994758,84cyclictest0-21swapper/221:38:022
25261994746,465cyclictest0-21swapper/022:05:110
25262994735,211cyclictest0-21swapper/122:49:301
252619947210,459cyclictest0-21swapper/020:37:560
25261994717,261cyclictest0-21swapper/022:49:280
252679947088,209cyclictest0-21swapper/623:56:486
252679947088,209cyclictest0-21swapper/623:56:486
252679947088,209cyclictest0-21swapper/623:56:486
252659947047,125cyclictest49-21ksoftirqd/400:00:184
252649947086,126cyclictest41-21ksoftirqd/323:56:183
252649947086,126cyclictest41-21ksoftirqd/323:56:183
252649947086,126cyclictest41-21ksoftirqd/323:56:183
25265994691,296cyclictest49-21ksoftirqd/423:46:194
252649946984,211cyclictest0-21swapper/322:58:013
2526499468169,126cyclictest121rcu_preempt22:48:543
252679946743,84cyclictest5767-21ssh00:10:126
25265994671,84cyclictest0-21swapper/423:59:254
25265994671,84cyclictest0-21swapper/423:59:254
25265994671,84cyclictest0-21swapper/423:59:254
252639946740,3cyclictest0-21swapper/223:10:202
25262994671,211cyclictest0-21swapper/100:32:111
252629946639,380cyclictest0-21swapper/122:05:151
2526399465122,212cyclictest610-21diskmemload23:24:152
2526299465122,340cyclictest15974-1kworker/u17:121:55:031
252619946539,423cyclictest21204-21apt-get00:00:150
252659946481,252cyclictest49-21ksoftirqd/422:05:154
2526599464123,338cyclictest0-21swapper/420:37:054
252649946479,211cyclictest41-21ksoftirqd/322:01:513
252629946481,380cyclictest0-21swapper/100:20:281
252689946383,214cyclictest25259-21cyclictest23:46:587
252679946341,3cyclictest0-21swapper/620:39:176
2526799463123,338cyclictest0-21swapper/623:22:176
2526799463122,338cyclictest0-21swapper/623:52:456
2526599463122,338cyclictest0-21swapper/400:09:334
2526599463121,339cyclictest0-21swapper/423:23:504
252649946381,84cyclictest0-21swapper/321:48:233
252639946340,256cyclictest0-21swapper/222:59:532
2526399463123,337cyclictest0-21swapper/221:48:142
2526399463122,338cyclictest0-21swapper/222:05:062
252679946240,2cyclictest0-21swapper/621:39:516
252669946277,211cyclictest57-21ksoftirqd/523:51:175
252639946240,256cyclictest25259-21cyclictest22:24:042
2526399462122,338cyclictest0-21swapper/223:46:542
252629946240,256cyclictest0-21swapper/100:16:441
252629946240,256cyclictest0-21swapper/100:16:441
252689946137,127cyclictest0-21swapper/700:07:437
252659946177,169cyclictest121rcu_preempt23:10:274
25264994611,37cyclictest0-21swapper/323:44:013
252689946080,297cyclictest0-21swapper/723:08:427
252679946038,84cyclictest0-21swapper/600:20:226
2526499460162,126cyclictest121rcu_preempt23:45:483
2526299460119,338cyclictest0-21swapper/120:40:231
2526799459119,210cyclictest0-21swapper/622:24:576
252669945834,260cyclictest0-21swapper/523:08:305
252649945835,256cyclictest0-21swapper/322:25:223
2526299458119,84cyclictest0-21swapper/122:50:321
2526299458118,338cyclictest0-21swapper/121:37:431
2526799457115,340cyclictest0-21swapper/622:48:496
252649945772,84cyclictest0-21swapper/323:23:203
252629945734,257cyclictest0-21swapper/100:00:111
252659945634,255cyclictest0-21swapper/422:25:224
252629945669,169cyclictest10761-21chrt21:47:351
252619945675,84cyclictest121rcu_preempt19:49:430
252659945533,255cyclictest0-21swapper/400:10:294
252649945532,126cyclictest0-21swapper/300:10:253
2526799454113,338cyclictest0-21swapper/622:50:406
252689945329,3cyclictest0-21swapper/720:40:147
252649945371,85cyclictest610-21diskmemload00:20:213
2526899452111,339cyclictest0-21swapper/722:05:067
2526799452112,338cyclictest0-21swapper/623:46:456
252669945128,256cyclictest0-21swapper/522:59:525
252639945172,295cyclictest0-21swapper/223:43:472
2526799450109,338cyclictest0-21swapper/619:49:436
252649945066,381cyclictest0-21swapper/300:16:433
252649945066,381cyclictest0-21swapper/300:16:433
252639945023,84cyclictest0-21swapper/220:39:022
2526899448106,339cyclictest0-21swapper/721:55:247
2526799446112,251cyclictest0-21swapper/621:40:146
252669944566,84cyclictest0-21swapper/521:40:115
252649944564,84cyclictest610-21diskmemload21:55:263
2526399445146,126cyclictest121rcu_preempt22:50:222
252659944421,127cyclictest0-21swapper/422:23:554
252689944321,256cyclictest0-21swapper/722:59:537
252669944320,84cyclictest0-21swapper/523:23:445
252679944119,84cyclictest0-21swapper/621:55:096
252629944120,255cyclictest0-21swapper/100:35:101
252629944120,255cyclictest0-21swapper/100:35:091
252679944018,2cyclictest0-21swapper/600:00:106
252669944018,3cyclictest0-21swapper/523:44:265
252669944018,3cyclictest0-21swapper/522:05:085
252669944018,255cyclictest0-21swapper/500:10:285
252659944018,84cyclictest0-21swapper/400:20:234
2526399440101,169cyclictest0-21swapper/223:00:172
252619944010,427cyclictest0-21swapper/022:25:190
252679943998,338cyclictest0-21swapper/622:25:106
2526899438101,127cyclictest0-21swapper/723:24:317
252669943810,127cyclictest0-21swapper/500:20:205
252689943797,338cyclictest0-21swapper/723:00:257
252669943757,84cyclictest0-21swapper/523:45:305
252649943556,84cyclictest0-21swapper/321:38:163
252689943494,338cyclictest0-21swapper/723:10:177
2526599434353,45cyclictest481ktimersoftd/419:50:034
25264994349,127cyclictest0-21swapper/300:00:133
2526499434138,85cyclictest0-21swapper/320:38:083
252629943412,257cyclictest0-21swapper/119:50:001
252689943311,84cyclictest0-21swapper/700:20:237
252669943252,84cyclictest0-21swapper/520:38:165
252639943294,335cyclictest0-21swapper/221:55:142
252639943088,127cyclictest0-21swapper/220:40:262
25268994297,2cyclictest0-21swapper/722:24:047
2526799429176,83cyclictest641ktimersoftd/623:43:136
252679942887,338cyclictest0-21swapper/623:10:186
252639942684,126cyclictest33-21ksoftirqd/223:25:112
25262994264,256cyclictest0-21swapper/119:50:161
25262994264,256cyclictest0-21swapper/119:50:151
25268994241,256cyclictest0-21swapper/721:49:127
25266994248,171cyclictest0-21swapper/500:33:545
2526699424384,37cyclictest551rcuc/500:09:155
252669942383,84cyclictest0-21swapper/500:18:325
252669942383,84cyclictest0-21swapper/500:18:315
25264994231,256cyclictest0-21swapper/322:24:483
252669942283,84cyclictest0-21swapper/500:35:345
252669942283,84cyclictest0-21swapper/500:35:345
252669942283,83cyclictest0-21swapper/519:49:435
252689942180,338cyclictest0-21swapper/722:25:117
252669942183,84cyclictest0-21swapper/523:10:185
252669942182,84cyclictest0-21swapper/522:50:185
252679942039,84cyclictest0-21swapper/619:50:196
252679942039,84cyclictest0-21swapper/619:50:186
252669942082,84cyclictest0-21swapper/521:36:455
252669942082,84cyclictest0-21swapper/520:40:135
252649942081,84cyclictest0-21swapper/323:00:133
252649942081,84cyclictest0-21swapper/322:50:313
252669941875,127cyclictest57-21ksoftirqd/522:01:265
252669941678,171cyclictest0-21swapper/519:50:165
252669941678,171cyclictest0-21swapper/519:50:155
252649941677,84cyclictest0-21swapper/323:10:173
2526699414115,126cyclictest0-21swapper/522:25:105
252659941475,84cyclictest0-21swapper/420:40:134
252639941434,84cyclictest0-21swapper/200:20:172
252689941372,338cyclictest0-21swapper/719:49:427
252689941271,338cyclictest0-21swapper/700:00:117
252649941273,84cyclictest0-21swapper/322:05:163
252649941172,84cyclictest0-21swapper/319:50:003
252679940666,338cyclictest0-21swapper/623:25:116
252689940525,2cyclictest0-21swapper/719:50:167
252689940525,2cyclictest0-21swapper/719:50:157
252639940424,84cyclictest0-21swapper/219:50:152
252639940424,84cyclictest0-21swapper/219:50:152
252639940324,84cyclictest0-21swapper/200:00:332
252689940221,3cyclictest0-21swapper/721:40:197
252689940119,84cyclictest0-21swapper/723:25:107
252659939356,170cyclictest0-21swapper/419:50:164
252659939356,170cyclictest0-21swapper/419:50:154
252649939253,84cyclictest0-21swapper/321:40:123
252649939252,85cyclictest0-21swapper/323:25:103
252669938695,167cyclictest704-21nscd23:25:115
2526499373328,43cyclictest401ktimersoftd/319:50:153
2526499373328,43cyclictest401ktimersoftd/319:50:153
252669937233,84cyclictest0-21swapper/500:00:035
2526199360104,253cyclictest0-21swapper/023:25:090
252629935619,174cyclictest0-21swapper/123:25:111
252659932269,129cyclictest0-21swapper/423:25:104
2223428759,5sleep70-21swapper/719:05:087
61502860,0sleep1241ktimersoftd/123:31:081
2482128655,28sleep10-21swapper/119:09:511
2474728546,35sleep20-21swapper/219:08:482
2465528454,27sleep30-21swapper/319:07:283
2451428453,28sleep60-21swapper/619:05:306
2470428351,28sleep40-21swapper/419:08:104
2471428250,28sleep50-21swapper/519:08:185
2478427948,28sleep00-21swapper/019:09:170
293992780,0sleep40-21swapper/420:09:554
217382740,0sleep50-21swapper/522:30:145
49502720,1sleep70-21swapper/722:37:377
109002700,1sleep30-21swapper/321:15:013
128912690,0sleep00-21swapper/021:30:440
25264992910,18cyclictest0-21swapper/320:03:523
25268992810,18cyclictest0-21swapper/720:56:517
25268992810,0cyclictest0-21swapper/721:33:317
25268992810,0cyclictest0-21swapper/719:13:467
25265992810,18cyclictest0-21swapper/419:30:134
25264992810,18cyclictest0-21swapper/321:33:233
25264992810,0cyclictest0-21swapper/321:08:323
25264992810,0cyclictest0-21swapper/320:56:593
25263992810,18cyclictest0-21swapper/221:08:502
25263992810,0cyclictest0-21swapper/219:13:452
25262992810,18cyclictest0-21swapper/120:14:171
25261992810,18cyclictest0-21swapper/019:21:380
25261992810,17cyclictest0-21swapper/019:37:410
25261992810,0cyclictest0-21swapper/021:21:280
25261992810,0cyclictest0-21swapper/019:14:190
25268992727,0cyclictest0-21swapper/720:14:217
25268992727,0cyclictest0-21swapper/719:37:597
25268992710,17cyclictest0-21swapper/721:08:567
25268992710,17cyclictest0-21swapper/719:30:067
25268992710,17cyclictest0-21swapper/719:29:337
25268992710,0cyclictest0-21swapper/721:21:267
25268992710,0cyclictest0-21swapper/720:23:477
25268992710,0cyclictest0-21swapper/719:21:057
25267992710,17cyclictest0-21swapper/621:33:326
25267992710,17cyclictest0-21swapper/620:34:506
25267992710,17cyclictest0-21swapper/619:37:436
25267992710,17cyclictest0-21swapper/619:13:426
25267992710,0cyclictest0-21swapper/621:21:286
25267992710,0cyclictest0-21swapper/621:08:556
25267992710,0cyclictest0-21swapper/620:23:576
25267992710,0cyclictest0-21swapper/619:29:516
25266992727,0cyclictest0-21swapper/519:20:585
25266992727,0cyclictest0-21swapper/519:13:445
25266992710,17cyclictest0-21swapper/521:21:325
25266992710,17cyclictest0-21swapper/521:08:305
25266992710,17cyclictest0-21swapper/520:23:585
25266992710,17cyclictest0-21swapper/520:14:055
25266992710,17cyclictest0-21swapper/520:03:135
25266992710,17cyclictest0-21swapper/519:37:425
25266992710,17cyclictest0-21swapper/519:30:135
25266992710,17cyclictest0-21swapper/519:29:305
25266992710,0cyclictest0-21swapper/521:33:315
25266992710,0cyclictest0-21swapper/520:56:195
25266992710,0cyclictest0-21swapper/520:34:405
25265992727,0cyclictest0-21swapper/419:38:084
25265992727,0cyclictest0-21swapper/419:13:414
25265992710,17cyclictest0-21swapper/420:34:514
25265992710,17cyclictest0-21swapper/420:23:304
25265992710,17cyclictest0-21swapper/419:21:264
25265992710,0cyclictest0-21swapper/421:33:304
25265992710,0cyclictest0-21swapper/421:21:384
25265992710,0cyclictest0-21swapper/419:29:334
25264992727,0cyclictest0-21swapper/320:23:253
25264992727,0cyclictest0-21swapper/320:13:533
25264992727,0cyclictest0-21swapper/319:13:523
25264992710,17cyclictest0-21swapper/321:21:213
25264992710,17cyclictest0-21swapper/319:37:433
25264992710,0cyclictest0-21swapper/319:29:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional