You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 09:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu May 21, 2026 00:54:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122379973917,719cyclictest0-21swapper/422:03:344
12237996341,83cyclictest0-21swapper/423:26:534
122379963237,592cyclictest0-21swapper/421:57:414
122379963237,592cyclictest0-21swapper/421:57:414
122369963038,389cyclictest0-21swapper/321:48:223
122399962373,465cyclictest0-21swapper/622:14:126
122379961321,85cyclictest0-21swapper/423:22:014
122389961119,2cyclictest0-21swapper/500:23:025
122389961119,2cyclictest0-21swapper/500:23:015
122369961156,382cyclictest0-21swapper/321:13:373
122409960716,425cyclictest15850irq/123-ahci[0023:22:397
1223599606265,338cyclictest704-21nscd22:11:412
12235995931,127cyclictest0-21swapper/223:22:402
122339958535,126cyclictest0-21swapper/000:23:100
122339958535,126cyclictest0-21swapper/000:23:100
122349957870,126cyclictest0-21swapper/121:59:171
122349957870,126cyclictest0-21swapper/121:59:171
122369957421,338cyclictest20046-21diskmemload22:33:563
122359956414,2cyclictest0-21swapper/222:23:472
122359956414,2cyclictest0-21swapper/222:23:472
122379956294,338cyclictest0-21swapper/421:47:274
122379955645,508cyclictest64450irq/122-eth000:04:124
122379955645,508cyclictest64450irq/122-eth000:04:124
12238995522,383cyclictest0-21swapper/522:01:425
12236995511,384cyclictest0-21swapper/322:01:433
122379954939,507cyclictest0-21swapper/400:37:044
122359954677,380cyclictest0-21swapper/221:48:492
122379953828,169cyclictest0-21swapper/422:23:154
122379953828,169cyclictest0-21swapper/422:23:154
122369953771,253cyclictest11272-21sh23:07:003
1223399537114,209cyclictest0-21swapper/022:03:070
1224099533109,126cyclictest0-21swapper/723:44:157
1224099531107,211cyclictest12231-21cyclictest23:29:337
122409953023,340cyclictest0-21swapper/722:01:437
1223999529313,127cyclictest20046-21diskmemload21:13:346
122389952922,2cyclictest0-21swapper/523:29:235
122399952821,256cyclictest0-21swapper/619:30:096
1223699528148,255cyclictest12408-1kworker/u17:122:39:253
122379952720,87cyclictest0-21swapper/420:13:354
122379952720,87cyclictest0-21swapper/420:13:354
122369952498,296cyclictest0-21swapper/323:44:253
1223399524186,84cyclictest121rcu_preempt22:37:160
122379952213,41cyclictest0-21swapper/400:22:584
122379952213,41cyclictest0-21swapper/400:22:584
122379952211,42cyclictest0-21swapper/422:14:054
122399952115,2cyclictest0-21swapper/622:48:596
122339952155,126cyclictest0-21swapper/000:04:120
122339952155,126cyclictest0-21swapper/000:04:120
122389952013,256cyclictest0-21swapper/519:30:095
122379951710,256cyclictest0-21swapper/419:30:084
12236995179,2cyclictest0-21swapper/323:29:223
122349951751,211cyclictest0-21swapper/122:11:401
12237995169,42cyclictest0-21swapper/422:37:164
12239995125,2cyclictest0-21swapper/600:23:016
12239995125,2cyclictest0-21swapper/600:23:016
12238995111,44cyclictest0-21swapper/522:13:135
12240995103,2cyclictest0-21swapper/700:23:027
12240995103,2cyclictest0-21swapper/700:23:027
12236995092,256cyclictest0-21swapper/319:30:083
12240995081,255cyclictest0-21swapper/719:30:097
12236995081,211cyclictest0-21swapper/322:13:073
1223399508166,126cyclictest121rcu_preempt21:59:160
1223399508166,126cyclictest121rcu_preempt21:59:160
12239995070,2cyclictest14288-21sh23:29:236
122409950582,339cyclictest0-21swapper/722:34:017
122389950577,211cyclictest57-21ksoftirqd/523:06:065
1223399503119,211cyclictest9-21ksoftirqd/023:18:570
122399950131,254cyclictest0-21swapper/622:04:086
122349950135,84cyclictest121rcu_preempt22:38:391
122409950034,84cyclictest0-21swapper/721:59:297
122409950034,84cyclictest0-21swapper/721:59:297
122389950031,127cyclictest0-21swapper/523:21:345
122349950079,166cyclictest0-21swapper/121:13:181
1223599499455,42cyclictest311rcuc/221:58:132
1223599499455,42cyclictest311rcuc/221:58:132
1223499499243,126cyclictest0-21swapper/121:28:271
1223499499243,126cyclictest0-21swapper/121:28:261
1223999498118,296cyclictest0-21swapper/623:22:506
122359949872,211cyclictest33-21ksoftirqd/222:03:042
122409949772,210cyclictest0-21swapper/722:23:597
122409949772,210cyclictest0-21swapper/722:23:597
122379949733,427cyclictest0-21swapper/422:34:324
122339949733,84cyclictest0-21swapper/023:24:080
122379949537,79cyclictest64450irq/122-eth021:28:274
122379949537,79cyclictest64450irq/122-eth021:28:264
122379949526,85cyclictest0-21swapper/423:44:264
122369949424,381cyclictest0-21swapper/321:50:063
122339949026,42cyclictest0-21swapper/022:22:020
122339949026,42cyclictest0-21swapper/022:22:020
122379948918,468cyclictest0-21swapper/422:48:054
122389948320,2cyclictest0-21swapper/522:48:595
122369948318,381cyclictest0-21swapper/322:23:333
122369948318,381cyclictest0-21swapper/322:23:333
122339948314,296cyclictest0-21swapper/021:47:120
122409948115,211cyclictest0-21swapper/721:47:277
1223999481101,219cyclictest20046-21diskmemload00:40:456
1223999481101,219cyclictest20046-21diskmemload00:40:456
122389948113,465cyclictest0-21swapper/521:58:205
122389948113,465cyclictest0-21swapper/521:58:205
122349948154,380cyclictest0-21swapper/100:03:231
122349948154,380cyclictest0-21swapper/100:03:231
122389948016,337cyclictest0-21swapper/521:46:585
122359948011,338cyclictest0-21swapper/223:29:572
122399947792,211cyclictest10577-21ssh22:15:126
12237994745,42cyclictest0-21swapper/422:05:124
12239994727,211cyclictest0-21swapper/621:59:176
12239994727,211cyclictest0-21swapper/621:59:176
122359947243,126cyclictest121rcu_preempt19:43:422
122369947148,126cyclictest0-21swapper/323:22:563
12235994716,256cyclictest0-21swapper/219:30:082
12237994702,42cyclictest0-21swapper/419:45:004
12237994691,42cyclictest0-21swapper/419:29:164
1224099468130,213cyclictest20334-21nscd22:37:067
12233994683,126cyclictest0-21swapper/023:26:530
12236994672,298cyclictest0-21swapper/300:33:573
12236994672,298cyclictest0-21swapper/300:33:573
12234994672,2cyclictest0-21swapper/123:22:011
122389946640,296cyclictest0-21swapper/500:36:045
122359946639,211cyclictest33-21ksoftirqd/200:38:252
1223999465167,168cyclictest121rcu_preempt22:34:086
12234994651,2cyclictest0-21swapper/122:23:461
12234994651,2cyclictest0-21swapper/122:23:461
122409946441,256cyclictest0-21swapper/719:45:007
122369946441,3cyclictest0-21swapper/321:57:463
122369946441,3cyclictest0-21swapper/321:57:463
122339946438,211cyclictest101ktimersoftd/020:13:320
122339946438,211cyclictest101ktimersoftd/020:13:320
1224099463123,84cyclictest0-21swapper/722:13:317
1223799463123,338cyclictest12564-21sendmail_mailtr22:15:244
122399946239,340cyclictest0-21swapper/622:22:296
122399946239,340cyclictest0-21swapper/622:22:296
122389946239,220cyclictest0-21swapper/521:28:445
122389946239,220cyclictest0-21swapper/521:28:445
122379946240,255cyclictest0-21swapper/421:50:134
122379946216,279cyclictest0-21swapper/400:33:564
122379946216,279cyclictest0-21swapper/400:33:564
122409946139,256cyclictest0-21swapper/700:38:077
122389946139,255cyclictest0-21swapper/522:36:385
122379946177,211cyclictest28005-21ssh21:13:344
122379946139,260cyclictest1184-21sh23:19:504
122399946038,257cyclictest0-21swapper/622:37:186
1223499460123,4cyclictest241ktimersoftd/122:03:421
122399945837,210cyclictest0-21swapper/621:48:226
122339945834,211cyclictest0-21swapper/023:06:290
1223799457119,84cyclictest0-21swapper/423:30:094
122349945735,256cyclictest0-21swapper/123:29:261
1223499457120,92cyclictest0-21swapper/100:34:141
1223499457120,92cyclictest0-21swapper/100:34:141
122369945634,256cyclictest0-21swapper/300:21:503
122369945634,256cyclictest0-21swapper/300:21:503
122349945673,211cyclictest0-21swapper/100:41:101
122349945673,211cyclictest0-21swapper/100:41:101
1223499456449,4cyclictest231rcuc/121:47:461
1223899455116,336cyclictest14043-21ssh22:34:065
1223699455112,84cyclictest41-21ksoftirqd/323:19:433
122399945432,256cyclictest0-21swapper/619:29:566
122359945432,85cyclictest0-21swapper/222:35:012
122369945330,302cyclictest0-21swapper/300:38:263
122399945165,212cyclictest20046-21diskmemload23:06:276
12239994511,284cyclictest0-21swapper/600:33:576
12239994511,284cyclictest0-21swapper/600:33:576
1224099450110,338cyclictest0-21swapper/721:28:327
1224099450110,338cyclictest0-21swapper/721:28:327
122369945023,211cyclictest0-21swapper/319:27:563
122339945024,211cyclictest0-21swapper/022:13:350
122389944923,254cyclictest0-21swapper/521:13:085
1223899449151,125cyclictest121rcu_preempt22:23:585
1223899449151,125cyclictest121rcu_preempt22:23:585
1223499449108,338cyclictest0-21swapper/119:30:091
1223399449105,126cyclictest9-21ksoftirqd/021:14:060
122399944826,256cyclictest0-21swapper/619:45:006
1223599447156,207cyclictest321ktimersoftd/221:28:382
1223599447156,207cyclictest321ktimersoftd/221:28:382
122349944724,256cyclictest0-21swapper/100:23:021
122349944724,256cyclictest0-21swapper/100:23:011
122399944662,211cyclictest0-21swapper/623:30:166
122379944624,256cyclictest0-21swapper/423:07:014
122349944624,3cyclictest0-21swapper/123:07:041
122409944523,256cyclictest0-21swapper/719:27:517
122389944524,255cyclictest0-21swapper/519:27:515
122349944523,2cyclictest0-21swapper/100:36:121
122339944459,169cyclictest9-21ksoftirqd/021:28:060
122339944459,169cyclictest9-21ksoftirqd/021:28:060
122409944317,423cyclictest0-21swapper/721:50:137
1223999443102,338cyclictest31805-21ssh23:18:166
122369944261,296cyclictest704-21nscd21:28:133
122369944261,296cyclictest704-21nscd21:28:123
122359944119,2cyclictest0-21swapper/223:07:042
1223599441103,171cyclictest0-21swapper/200:21:492
1223599441103,171cyclictest0-21swapper/200:21:492
122349944160,84cyclictest0-21swapper/122:34:081
122409944097,340cyclictest0-21swapper/723:19:567
122389944017,256cyclictest0-21swapper/500:33:505
122389944017,256cyclictest0-21swapper/500:33:505
122359944060,214cyclictest0-21swapper/219:29:402
122359943812,295cyclictest22407-21sh00:40:482
122359943812,295cyclictest22407-21sh00:40:482
122339943816,3cyclictest0-21swapper/000:36:050
122369943753,211cyclictest26014-21ssh22:05:173
1223799433315,37cyclictest481ktimersoftd/400:40:464
1223799433315,37cyclictest481ktimersoftd/400:40:464
1223399431179,2cyclictest0-21swapper/019:30:090
12240994307,3cyclictest0-21swapper/722:48:587
12233994285,84cyclictest0-21swapper/019:43:130
122389942441,338cyclictest32269-21apt-get21:50:115
122399942383,338cyclictest0-21swapper/600:37:246
12234994231,256cyclictest0-21swapper/123:19:411
1223899422344,36cyclictest551rcuc/523:19:035
1223599422123,126cyclictest33-21ksoftirqd/200:03:542
1223599422123,126cyclictest33-21ksoftirqd/200:03:542
122409942180,338cyclictest0-21swapper/700:33:517
122409942180,338cyclictest0-21swapper/700:33:517
122359942180,211cyclictest12231-21cyclictest22:35:202
122409942078,339cyclictest0-21swapper/721:13:017
122369942035,127cyclictest22351-21sh00:40:453
122369942035,127cyclictest22351-21sh00:40:453
122409941978,338cyclictest0-21swapper/722:05:117
1223399417161,84cyclictest13987-21kworker/u16:322:05:170
122399941674,211cyclictest1253-21latency21:50:216
122389941435,176cyclictest0-21swapper/522:15:065
122389941434,217cyclictest0-21swapper/500:03:565
122389941434,217cyclictest0-21swapper/500:03:565
122339941475,84cyclictest0-21swapper/023:30:090
122359941232,256cyclictest0-21swapper/221:13:492
122339941274,84cyclictest0-21swapper/000:40:520
122339941274,84cyclictest0-21swapper/000:40:520
122389941170,338cyclictest0-21swapper/523:30:185
122359941172,84cyclictest0-21swapper/223:44:152
122349941172,84cyclictest0-21swapper/122:49:071
122409941030,296cyclictest0-21swapper/722:15:167
122339941030,126cyclictest0-21swapper/022:34:410
122399940967,211cyclictest0-21swapper/621:28:276
122399940967,211cyclictest0-21swapper/621:28:266
122389940925,253cyclictest0-21swapper/523:44:245
122339940970,84cyclictest0-21swapper/022:49:060
122399940867,338cyclictest0-21swapper/622:05:206
122389940828,296cyclictest0-21swapper/522:05:205
122349940767,85cyclictest0-21swapper/123:30:091
1223699406106,126cyclictest121rcu_preempt22:49:003
1223399406153,84cyclictest641-21dbus-daemon22:15:240
122409940525,260cyclictest0-21swapper/700:04:127
122409940525,260cyclictest0-21swapper/700:04:127
122339940462,211cyclictest0-21swapper/021:50:100
122399940361,253cyclictest0-21swapper/623:44:166
122359940364,84cyclictest0-21swapper/221:50:212
122409940222,259cyclictest0-21swapper/720:13:317
122409940222,259cyclictest0-21swapper/720:13:317
122409940162,84cyclictest0-21swapper/700:40:537
122409940162,84cyclictest0-21swapper/700:40:537
122349940121,3cyclictest0-21swapper/119:29:491
1223699400148,84cyclictest41-21ksoftirqd/319:42:503
122349939919,296cyclictest0-21swapper/122:05:151
122389939856,211cyclictest0-21swapper/519:43:135
122369939858,338cyclictest0-21swapper/322:15:173
122349939554,211cyclictest0-21swapper/121:50:121
122409939311,176cyclictest0-21swapper/723:07:007
12234993939,211cyclictest0-21swapper/123:43:531
122339939314,84cyclictest0-21swapper/019:28:340
12236993929,211cyclictest0-21swapper/300:03:483
12236993929,211cyclictest0-21swapper/300:03:483
12235993884,381cyclictest12231-21cyclictest22:05:112
122349938339,2cyclictest0-21swapper/119:43:131
12235993821,302cyclictest0-21swapper/222:48:592
1223699381125,253cyclictest0-21swapper/320:12:553
1223699381125,253cyclictest0-21swapper/320:12:553
122339938142,84cyclictest0-21swapper/023:44:160
122389937940,170cyclictest0-21swapper/500:41:005
122389937940,170cyclictest0-21swapper/500:41:005
122369937841,254cyclictest0-21swapper/323:30:023
122349937638,85cyclictest0-21swapper/122:15:251
122359937575,211cyclictest0-21swapper/222:15:172
122409937235,253cyclictest0-21swapper/723:30:037
122359937234,84cyclictest0-21swapper/200:34:052
122359937234,84cyclictest0-21swapper/200:34:052
122399937033,2cyclictest0-21swapper/600:04:176
122399937033,2cyclictest0-21swapper/600:04:176
122399936831,253cyclictest0-21swapper/620:13:356
122399936831,253cyclictest0-21swapper/620:13:356
122359936829,84cyclictest0-21swapper/223:18:162
122339936627,84cyclictest0-21swapper/000:33:510
122339936627,84cyclictest0-21swapper/000:33:500
12238993413,171cyclictest0-21swapper/520:12:525
12238993413,171cyclictest0-21swapper/520:12:515
122349933737,125cyclictest25-21ksoftirqd/120:13:361
122349933737,125cyclictest25-21ksoftirqd/120:13:361
122359933641,84cyclictest121rcu_preempt23:30:172
122359932829,126cyclictest121rcu_preempt20:13:332
122359932829,126cyclictest121rcu_preempt20:13:322
122379930712,134cyclictest121rcu_preempt23:53:504
122369928734,48cyclictest0-21swapper/323:53:493
122359928029,82cyclictest121rcu_preempt23:53:492
122409927821,254cyclictest0-21swapper/723:53:497
122389926914,253cyclictest0-21swapper/523:53:505
12239992544,119cyclictest0-21swapper/623:53:496
122349925443,129cyclictest0-21swapper/123:53:501
122339924836,85cyclictest9-21ksoftirqd/023:53:500
3122721290,4sleep21223599cyclictest21:15:182
3122721290,4sleep21223599cyclictest21:15:172
124722940,0sleep30-21swapper/320:55:133
1161128942,24sleep40-21swapper/419:07:154
1169828249,29sleep70-21swapper/719:08:307
1164928250,28sleep50-21swapper/519:07:485
1149628251,27sleep20-21swapper/219:05:362
1147928252,27sleep30-21swapper/319:05:213
1175328149,28sleep60-21swapper/619:09:186
1156928144,33sleep00-21swapper/019:06:390
1151328150,28sleep10-21swapper/119:05:511
211482790,0sleep60-21swapper/622:55:226
322392780,0sleep50-21swapper/520:35:145
239392710,0sleep00-21swapper/021:44:580
3812680,0sleep30-21swapper/300:12:033
1224099601,46cyclictest0-21swapper/700:05:047
1223499566,16cyclictest25-21ksoftirqd/100:05:061
1223599544,39cyclictest33-21ksoftirqd/200:05:032
12240995023,23cyclictest30942-21ssh21:15:177
12240995023,23cyclictest30942-21ssh21:15:177
12240995022,25cyclictest30100-21grep22:25:197
12233994910,9cyclictest121rcu_preempt19:45:090
1223399485,33cyclictest121rcu_preempt00:05:040
12240994724,20cyclictest27037-21grep21:30:127
12240994722,21cyclictest25755-21ssh22:41:047
12234994311,3cyclictest241ktimersoftd/122:40:211
1223399426,22cyclictest9-21ksoftirqd/022:25:140
1223599417,23cyclictest33-21ksoftirqd/219:45:142
1223499403,3cyclictest121rcu_preempt19:45:061
1223899392,33cyclictest0-21swapper/522:40:165
1223799391,34cyclictest22618-21grep22:40:114
1223599397,22cyclictest33-21ksoftirqd/222:40:192
12234993910,16cyclictest25-21ksoftirqd/123:55:231
12239993831,4cyclictest31530-21ssh23:55:086
1223699382,32cyclictest23199-21df22:40:133
1223399389,19cyclictest0-21swapper/022:50:150
1223399385,21cyclictest9-21ksoftirqd/022:40:210
12233993810,20cyclictest9-21ksoftirqd/023:55:250
1223999375,4cyclictest12433-21sh23:45:036
1223999372,31cyclictest22709-21ssh22:40:136
1223799371,33cyclictest0-21swapper/423:55:094
1223699372,5cyclictest30359-21cpuspeed_turbos21:15:143
1223699372,5cyclictest30359-21cpuspeed_turbos21:15:143
1223599378,17cyclictest33-21ksoftirqd/221:30:562
1223599376,18cyclictest33-21ksoftirqd/223:10:122
1223599374,20cyclictest33-21ksoftirqd/223:45:162
1223399376,20cyclictest9-21ksoftirqd/023:10:320
12233993730,4cyclictest0-21swapper/023:45:040
1224099362,31cyclictest0-21swapper/723:45:027
1223799361,32cyclictest0-21swapper/421:15:034
1223799361,32cyclictest0-21swapper/421:15:034
1223599368,18cyclictest33-21ksoftirqd/222:25:302
1223499361,32cyclictest0-21swapper/122:50:021
1223499361,31cyclictest12460-21sh23:45:061
12234993612,14cyclictest25-21ksoftirqd/123:10:121
1223399361,25cyclictest9-21ksoftirqd/000:25:440
12239993525,6cyclictest23312sleep619:45:146
1223599357,17cyclictest33-21ksoftirqd/223:55:382
1223599354,20cyclictest33-21ksoftirqd/200:25:172
1223499358,15cyclictest25-21ksoftirqd/120:15:131
1223499352,4cyclictest31632-21cat21:15:201
1223499352,4cyclictest31632-21cat21:15:201
1223399357,18cyclictest9-21ksoftirqd/020:15:130
1223399352,29cyclictest0-21swapper/021:15:210
1223399352,29cyclictest0-21swapper/021:15:210
1223399352,22cyclictest9-21ksoftirqd/021:30:180
1224099343,28cyclictest21261-1kworker/u17:223:55:097
1223999341,30cyclictest0-21swapper/621:15:136
1223999341,30cyclictest0-21swapper/621:15:136
12238993428,3cyclictest31529-21ssh23:55:095
12238993424,6cyclictest9455-21grep22:50:125
1223699341,30cyclictest0-21swapper/323:45:023
1223499342,29cyclictest0-21swapper/122:25:111
12240993325,5cyclictest20600-21head20:15:167
12240993310,17cyclictest0-21swapper/723:03:437
12239993323,7cyclictest20177-21tr00:05:256
12239993323,6cyclictest15176-21tr23:10:136
12238993324,5cyclictest20644-21wc00:05:295
1223899331,29cyclictest0-21swapper/521:15:145
1223899331,29cyclictest0-21swapper/521:15:145
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional