You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 06:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jul 23, 2026 00:55:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138919969863,82cyclictest0-21swapper/522:10:265
138919969863,82cyclictest0-21swapper/522:10:265
13891996812,126cyclictest0-21swapper/523:33:185
1389099678251,127cyclictest0-21swapper/423:55:554
138919966874,83cyclictest3958-21rm23:05:315
138919966835,549cyclictest6546-21diskstats00:40:155
138909965258,295cyclictest0-21swapper/400:45:014
13886996479,381cyclictest0-21swapper/000:35:380
13891996391,635cyclictest0-21swapper/521:29:015
138919963139,472cyclictest121rcu_preempt00:25:425
1388899631121,253cyclictest0-21swapper/222:06:482
1388999629545,3cyclictest401ktimersoftd/300:35:393
138919962731,593cyclictest13884-21cyclictest22:45:305
138879962572,126cyclictest0-21swapper/123:38:411
1388999624240,126cyclictest0-21swapper/323:44:473
138869962029,127cyclictest0-21swapper/019:20:160
138919961965,424cyclictest0-21swapper/522:39:085
1388699617148,423cyclictest704-21nscd23:46:390
1388699616150,126cyclictest29045-21sh23:38:290
138919961431,84cyclictest0-21swapper/523:04:365
138909961322,2cyclictest0-21swapper/421:27:144
138869961322,171cyclictest0-21swapper/022:55:040
138919961017,513cyclictest0-21swapper/523:26:035
138929960997,212cyclictest65-21ksoftirqd/600:15:266
138869960859,84cyclictest121rcu_preempt23:25:180
1389399603558,42cyclictest16005-21ssh00:08:147
1389299599218,84cyclictest32222-21kworker/u16:100:01:496
13889995993,381cyclictest0-21swapper/322:07:053
13891995971,593cyclictest0-21swapper/500:35:255
13892995953,3cyclictest0-21swapper/621:27:136
13889995940,84cyclictest0-21swapper/323:45:373
1389299593254,84cyclictest8098-21hddtemp_smartct23:45:176
13890995930,84cyclictest0-21swapper/422:39:014
13887995931,2cyclictest0-21swapper/121:27:131
138919959082,126cyclictest0-21swapper/522:06:485
138899959083,256cyclictest0-21swapper/323:55:563
1388699589167,296cyclictest6247-21rm23:44:470
138919958834,508cyclictest0-21swapper/500:15:325
1388999586502,3cyclictest401ktimersoftd/322:39:523
138939958269,296cyclictest0-21swapper/700:04:567
138919958233,468cyclictest0-21swapper/519:19:575
138899958170,338cyclictest0-21swapper/300:25:353
1389199580239,126cyclictest1551-21snmpd00:14:555
138889958031,84cyclictest0-21swapper/200:35:452
138869958027,338cyclictest0-21swapper/021:34:050
138879957971,126cyclictest121rcu_preempt19:36:371
1388699579110,338cyclictest121rcu_preempt22:06:390
138889957829,126cyclictest0-21swapper/223:13:382
138919957620,512cyclictest0-21swapper/523:35:225
1389399574108,211cyclictest0-21swapper/722:57:157
138879957466,126cyclictest0-21swapper/122:55:431
138869957365,126cyclictest0-21swapper/023:19:460
138869957117,381cyclictest0-21swapper/022:44:570
1389099570102,253cyclictest0-21swapper/400:30:134
1389099570102,253cyclictest0-21swapper/400:30:134
138939956918,126cyclictest0-21swapper/700:30:167
138939956918,126cyclictest0-21swapper/700:30:167
138909956919,297cyclictest0-21swapper/422:40:104
138929956818,126cyclictest0-21swapper/622:25:126
138919956520,80cyclictest0-21swapper/521:33:595
138889956514,84cyclictest27059-21ssh00:33:562
138889956514,84cyclictest27059-21ssh00:33:552
138919956498,127cyclictest0-21swapper/500:03:465
138889956453,126cyclictest0-21swapper/223:25:142
138939956211,126cyclictest0-21swapper/723:04:297
1388799561224,84cyclictest1933-21kworker/u16:123:05:271
138869956011,384cyclictest32162-21sshd19:38:260
1388799556129,296cyclictest0-21swapper/122:08:431
138869955688,338cyclictest0-21swapper/000:01:510
13888995551,84cyclictest0-21swapper/222:55:422
1388799555256,126cyclictest0-21swapper/123:44:211
138939955283,127cyclictest0-21swapper/722:08:207
138879955282,211cyclictest25-21ksoftirqd/100:28:351
138919955183,465cyclictest0-21swapper/523:20:235
13888995511,126cyclictest0-21swapper/200:04:372
138919955081,296cyclictest0-21swapper/523:14:225
13889995501,2cyclictest0-21swapper/319:38:253
13891995491,382cyclictest0-21swapper/519:38:265
13886995491,126cyclictest0-21swapper/023:13:280
1389099546293,84cyclictest0-21swapper/421:35:274
1389099545122,85cyclictest121rcu_preempt22:10:234
1389099545122,85cyclictest121rcu_preempt22:10:234
138869954534,296cyclictest0-21swapper/022:49:070
138919954434,507cyclictest0-21swapper/522:58:475
138899954476,465cyclictest0-21swapper/300:09:403
1388899544158,169cyclictest33-21ksoftirqd/223:06:342
1389399543117,295cyclictest0-21swapper/723:26:137
138879954335,84cyclictest0-21swapper/122:20:191
1388799543116,126cyclictest3463-1kworker/u17:023:24:181
138929954276,126cyclictest121rcu_preempt22:44:576
138889954272,127cyclictest0-21swapper/200:21:152
1389099541114,295cyclictest0-21swapper/400:01:024
138869954029,296cyclictest0-21swapper/021:26:560
1389399538113,129cyclictest4376-21python21:35:267
138909953872,126cyclictest21468-21diskmemload00:15:354
138899953873,211cyclictest0-21swapper/321:29:493
138879953729,84cyclictest0-21swapper/100:40:311
138919953629,422cyclictest0-21swapper/522:40:095
138939953465,296cyclictest0-21swapper/722:39:547
138889953464,296cyclictest0-21swapper/200:29:462
138869953422,126cyclictest21468-21diskmemload23:56:110
138939953364,338cyclictest0-21swapper/721:24:077
138919953368,295cyclictest0-21swapper/500:20:295
138869953327,340cyclictest15471-21sh00:07:410
1389199532148,84cyclictest5461-21kworker/u16:223:50:445
138889953224,256cyclictest0-21swapper/223:55:552
138919953125,255cyclictest0-21swapper/523:55:555
1389099531104,297cyclictest0-21swapper/422:08:464
138889953021,84cyclictest0-21swapper/223:32:412
138869953066,302cyclictest0-21swapper/000:21:060
138889952921,126cyclictest0-21swapper/222:44:582
138889952921,126cyclictest0-21swapper/220:50:212
138889952920,126cyclictest0-21swapper/221:26:552
138879952964,126cyclictest0-21swapper/122:49:451
138869952964,92cyclictest121rcu_preempt00:30:130
138869952964,92cyclictest121rcu_preempt00:30:120
138919952818,507cyclictest0-21swapper/523:15:115
138899952719,126cyclictest0-21swapper/322:45:353
1388699527105,218cyclictest10842-21cut20:50:350
138899952517,254cyclictest0-21swapper/323:25:283
138929952257,84cyclictest0-21swapper/622:45:356
138929952253,338cyclictest0-21swapper/600:05:446
138889952152,211cyclictest28123-21sh23:20:122
138929951911,126cyclictest0-21swapper/621:31:406
138899951951,380cyclictest0-21swapper/300:30:113
138899951951,380cyclictest0-21swapper/300:30:113
13888995179,126cyclictest20259-21diskmemload22:38:232
13887995166,126cyclictest6763-21switchtime23:25:281
138869951588,253cyclictest121rcu_preempt23:24:560
13888995147,254cyclictest0-21swapper/200:09:372
138869951348,84cyclictest0-21swapper/023:50:280
1388699512428,42cyclictest111rcuc/000:28:420
138939951045,127cyclictest0-21swapper/721:31:257
138909951085,422cyclictest0-21swapper/400:14:114
1388999510125,254cyclictest0-21swapper/322:25:123
13892995090,84cyclictest0-21swapper/623:33:126
138909950941,254cyclictest0-21swapper/423:40:134
13889995090,84cyclictest0-21swapper/323:33:133
1389299508212,84cyclictest121rcu_preempt00:26:176
13890995080,84cyclictest0-21swapper/423:33:134
138919950782,253cyclictest0-21swapper/523:46:155
1388799506211,84cyclictest0-21swapper/122:44:131
138939950477,211cyclictest73-21ksoftirqd/723:14:487
138919950440,383cyclictest0-21swapper/522:20:195
138909950481,84cyclictest0-21swapper/423:15:274
138869950435,211cyclictest101ktimersoftd/000:15:080
1389099503247,126cyclictest49-21ksoftirqd/400:35:324
1388999503420,3cyclictest391rcuc/321:38:593
138879950376,211cyclictest0-21swapper/123:13:351
138939950279,339cyclictest0-21swapper/700:29:587
138939950279,127cyclictest0-21swapper/700:40:017
138879950236,84cyclictest121rcu_preempt00:39:531
138939950179,84cyclictest0-21swapper/722:45:237
138889950137,302cyclictest0-21swapper/222:10:262
138889950137,302cyclictest0-21swapper/222:10:262
138929950032,84cyclictest0-21swapper/621:35:336
138899950036,253cyclictest0-21swapper/300:44:553
138929949973,295cyclictest0-21swapper/619:35:296
138919949931,465cyclictest0-21swapper/520:50:325
138939949829,42cyclictest0-21swapper/719:20:227
138929949876,84cyclictest0-21swapper/623:44:596
138909949834,2cyclictest64450irq/122-eth000:06:534
138879949875,84cyclictest16642-21kworker/u16:022:38:221
1389399497116,84cyclictest0-21swapper/722:20:207
1389299497245,3cyclictest0-21swapper/623:55:556
138919949732,462cyclictest0-21swapper/500:34:305
138919949732,462cyclictest0-21swapper/500:34:305
1388999497112,211cyclictest22164-21df_abs22:20:183
1388999496112,210cyclictest0-21swapper/323:20:263
138889949673,339cyclictest0-21swapper/222:45:352
1388799496243,3cyclictest0-21swapper/123:55:561
138929949571,169cyclictest0-21swapper/623:20:266
138909949570,422cyclictest0-21swapper/422:55:154
138879949568,211cyclictest0-21swapper/121:14:231
138879949468,211cyclictest0-21swapper/100:01:161
1389299493241,84cyclictest13418-1kworker/u17:022:08:086
138929949323,338cyclictest0-21swapper/600:33:556
138929949323,338cyclictest0-21swapper/600:33:556
138939949226,125cyclictest121rcu_preempt00:40:307
1388999492235,254cyclictest401ktimersoftd/300:01:453
138889949266,211cyclictest0-21swapper/221:31:242
138939949165,423cyclictest0-21swapper/719:39:077
138939949165,296cyclictest0-21swapper/700:13:457
138929949168,254cyclictest0-21swapper/623:50:276
138909949127,260cyclictest0-21swapper/422:20:194
1389099489105,253cyclictest0-21swapper/423:13:254
138919948865,420cyclictest6172-21ssh23:44:405
138909948864,84cyclictest0-21swapper/400:29:124
138909948863,422cyclictest0-21swapper/421:30:164
1389099488109,375cyclictest29303-21sh23:20:234
1388799488103,211cyclictest0-21swapper/122:00:251
138899948761,211cyclictest41-21ksoftirqd/320:50:253
138899948721,42cyclictest0-21swapper/323:50:233
1388999486103,211cyclictest21500-21ssh22:57:573
138869948665,337cyclictest0-21swapper/019:58:250
138939948519,84cyclictest0-21swapper/722:10:067
138939948519,84cyclictest0-21swapper/722:10:067
138929948563,84cyclictest0-21swapper/623:25:176
138889948519,126cyclictest0-21swapper/200:45:002
1388999484363,36cyclictest401ktimersoftd/300:21:283
138869948420,380cyclictest13884-21cyclictest23:04:470
138909948218,174cyclictest0-21swapper/423:51:234
138899948258,84cyclictest0-21swapper/323:39:563
138879948258,126cyclictest13884-21cyclictest00:30:121
138879948258,126cyclictest13884-21cyclictest00:30:121
138869948220,293cyclictest0-21swapper/022:54:570
138879948115,126cyclictest0-21swapper/121:33:551
138869948117,254cyclictest31211-21cpuspeed_turbos22:25:130
138889948053,211cyclictest0-21swapper/222:25:222
138869948057,380cyclictest0-21swapper/019:18:130
138909947953,295cyclictest49-21ksoftirqd/422:54:344
138909947913,84cyclictest121rcu_preempt23:04:504
138869947853,295cyclictest0-21swapper/022:38:240
138939947718,36cyclictest0-21swapper/721:26:137
1389399476432,41cyclictest711rcuc/722:00:367
138909947610,42cyclictest0-21swapper/423:39:064
138869947612,253cyclictest0-21swapper/022:14:520
138869947612,253cyclictest0-21swapper/022:14:520
13892994749,253cyclictest0-21swapper/623:39:306
138869947411,125cyclictest32120-21cat21:50:130
13888994729,212cyclictest0-21swapper/219:38:252
1388999471214,42cyclictest0-21swapper/321:34:383
1388699471388,3cyclictest101ktimersoftd/023:33:140
13888994704,84cyclictest0-21swapper/223:39:342
138929946946,128cyclictest21468-21diskmemload23:05:266
138889946888,296cyclictest0-21swapper/223:04:462
138939946783,296cyclictest0-21swapper/723:39:347
13890994671,84cyclictest0-21swapper/423:46:054
13891994662,380cyclictest0-21swapper/521:35:135
1389099466124,339cyclictest0-21swapper/420:50:384
13888994660,83cyclictest0-21swapper/223:15:122
1389099465123,168cyclictest23687-21taskset20:18:524
1388799465336,82cyclictest0-21swapper/100:20:551
1388799465291,126cyclictest0-21swapper/123:50:231
1388799465124,338cyclictest0-21swapper/121:35:271
138929946483,84cyclictest21305-21ssh22:40:026
138929946482,84cyclictest0-21swapper/621:45:256
1389099464125,336cyclictest0-21swapper/422:25:124
1388899464124,338cyclictest0-21swapper/223:45:202
138879946480,211cyclictest0-21swapper/123:34:271
13889994631,416cyclictest0-21swapper/300:15:583
138869946377,211cyclictest9-21ksoftirqd/021:10:310
138869946340,256cyclictest0-21swapper/022:20:230
1389399462163,169cyclictest121rcu_preempt20:50:397
1389399462161,211cyclictest8484-1kworker/u17:222:43:517
138919946236,422cyclictest0-21swapper/500:05:445
138899946239,257cyclictest0-21swapper/323:15:033
138929946181,84cyclictest0-21swapper/622:56:016
138909946182,84cyclictest0-21swapper/422:45:224
138879946134,211cyclictest0-21swapper/100:13:491
138869946177,84cyclictest0-21swapper/021:38:460
138919946034,423cyclictest0-21swapper/522:25:215
1388899460118,339cyclictest0-21swapper/222:54:502
138879946036,380cyclictest0-21swapper/121:54:061
1388799460119,338cyclictest0-21swapper/120:50:271
138899945979,295cyclictest0-21swapper/322:54:423
138899945975,211cyclictest0-21swapper/323:13:273
1388999459116,127cyclictest0-21swapper/321:24:073
138879945977,84cyclictest0-21swapper/100:15:521
1388799459118,211cyclictest25-21ksoftirqd/123:45:101
138939945835,168cyclictest0-21swapper/723:24:307
138929945776,126cyclictest0-21swapper/600:39:396
138919945735,340cyclictest0-21swapper/521:54:055
138889945634,256cyclictest0-21swapper/221:35:182
1388999455115,211cyclictest121rcu_preempt23:05:313
138889945533,84cyclictest0-21swapper/200:15:542
1389399454411,41cyclictest711rcuc/723:46:387
138899945475,295cyclictest0-21swapper/300:14:283
1389399453370,2cyclictest711rcuc/700:15:377
138929945368,168cyclictest65-21ksoftirqd/600:21:156
138889945324,211cyclictest1651-21ntpd23:40:182
138869945331,255cyclictest0-21swapper/000:14:270
138909945269,210cyclictest121rcu_preempt00:21:164
138889945230,84cyclictest0-21swapper/221:14:152
138929945128,169cyclictest0-21swapper/622:10:156
138929945128,169cyclictest0-21swapper/622:10:156
138879945123,338cyclictest19043-21runrttasks23:15:111
1388999450235,85cyclictest0-21swapper/320:55:093
1388799450109,126cyclictest0-21swapper/123:04:511
138939944926,256cyclictest0-21swapper/720:45:527
138939944873,245cyclictest0-21swapper/723:15:027
138939944725,84cyclictest0-21swapper/723:33:067
138919944725,338cyclictest0-21swapper/519:20:235
138909944768,84cyclictest0-21swapper/419:39:024
138879944765,84cyclictest0-21swapper/121:45:251
1389299446108,171cyclictest0-21swapper/620:50:176
1388999445406,3cyclictest401ktimersoftd/319:19:013
138889944460,381cyclictest0-21swapper/223:51:212
138939944220,83cyclictest0-21swapper/723:05:267
138929944219,84cyclictest0-21swapper/619:15:556
138879944258,127cyclictest20041-21taskset19:15:501
138869944218,42cyclictest0-21swapper/022:00:230
138869944216,253cyclictest0-21swapper/000:40:260
138939944119,256cyclictest0-21swapper/723:50:337
138929944020,288cyclictest0-21swapper/623:19:406
138899944017,2cyclictest0-21swapper/320:45:523
138879944018,2cyclictest0-21swapper/100:06:521
1389399439183,126cyclictest1553-21runrttasks23:55:437
138919943914,422cyclictest0-21swapper/520:28:135
138879943816,177cyclictest0-21swapper/120:18:461
138889943610,211cyclictest33-21ksoftirqd/219:19:252
138909943598,83cyclictest0-21swapper/419:40:144
138879943597,248cyclictest13418-1kworker/u17:022:14:451
138879943597,248cyclictest13418-1kworker/u17:022:14:441
138929943454,84cyclictest0-21swapper/622:00:256
138929943453,84cyclictest0-21swapper/623:13:566
138919943493,338cyclictest8484-1kworker/u17:222:19:555
13892994339,84cyclictest0-21swapper/621:10:296
138909943211,81cyclictest121rcu_preempt19:58:264
138929943152,84cyclictest0-21swapper/621:50:126
13891994315,423cyclictest0-21swapper/520:08:295
13889994319,84cyclictest0-21swapper/322:44:123
13891994305,422cyclictest0-21swapper/522:54:555
1389099430173,126cyclictest49-21ksoftirqd/421:50:224
13891994275,126cyclictest0-21swapper/522:00:235
1389299426128,125cyclictest65-21ksoftirqd/619:40:006
138889942582,84cyclictest33-21ksoftirqd/200:14:212
138939942486,126cyclictest73-21ksoftirqd/700:20:347
138939942482,339cyclictest0-21swapper/723:40:037
138939942482,339cyclictest0-21swapper/721:50:137
138899942484,338cyclictest0-21swapper/323:04:453
138879942483,168cyclictest0-21swapper/122:25:191
13886994242,2cyclictest0-21swapper/019:40:190
138919942282,338cyclictest0-21swapper/519:40:015
138909942282,85cyclictest0-21swapper/419:18:134
138889942281,338cyclictest0-21swapper/219:40:192
138889942280,339cyclictest0-21swapper/222:00:252
138899942079,338cyclictest0-21swapper/322:00:223
13886994201,81cyclictest0-21swapper/023:06:000
138929941980,84cyclictest0-21swapper/620:55:096
138899941978,338cyclictest0-21swapper/319:40:133
138879941938,85cyclictest0-21swapper/122:54:271
138929941837,84cyclictest0-21swapper/622:20:246
1389299418162,253cyclictest0-21swapper/622:19:546
138919941878,338cyclictest0-21swapper/521:45:275
138899941877,125cyclictest21762-21/usr/sbin/munin21:45:123
138939941776,338cyclictest0-21swapper/722:54:267
138929941737,42cyclictest0-21swapper/600:14:326
138899941776,339cyclictest0-21swapper/322:10:253
138899941776,339cyclictest0-21swapper/322:10:253
138909941678,84cyclictest0-21swapper/423:05:314
138889941637,256cyclictest0-21swapper/220:45:522
138929941576,84cyclictest0-21swapper/620:18:526
138919941533,253cyclictest0-21swapper/520:18:415
138909941534,84cyclictest4693-21ssh23:25:124
138869941533,85cyclictest0-21swapper/020:18:580
138899941429,169cyclictest32161-21ssh21:50:153
138889941475,336cyclictest0-21swapper/221:54:052
138889941474,338cyclictest0-21swapper/222:20:112
138919941327,383cyclictest0-21swapper/520:13:385
138939941271,338cyclictest0-21swapper/720:18:527
138919941231,296cyclictest0-21swapper/521:10:245
138919941229,380cyclictest0-21swapper/520:32:335
138899941228,84cyclictest121rcu_preempt19:20:173
138869941271,338cyclictest0-21swapper/020:08:290
138869941271,126cyclictest9-21ksoftirqd/020:32:320
138929941172,84cyclictest0-21swapper/600:44:566
138939941069,338cyclictest1578-21lldpd20:08:297
138909941072,84cyclictest0-21swapper/422:00:224
138879940972,168cyclictest0-21swapper/119:20:091
138899940821,84cyclictest121rcu_preempt19:58:253
138869940828,253cyclictest0-21swapper/021:45:270
138939940767,338cyclictest0-21swapper/719:40:197
138869940767,338cyclictest0-21swapper/020:13:390
138939940666,338cyclictest0-21swapper/719:19:077
138909940525,126cyclictest0-21swapper/422:19:554
138919940324,298cyclictest21468-21diskmemload21:24:125
138869940364,84cyclictest0-21swapper/020:28:140
138899940261,338cyclictest0-21swapper/320:08:293
138939940120,41cyclictest0-21swapper/721:10:297
138919940122,295cyclictest0-21swapper/522:30:475
138889940117,84cyclictest0-21swapper/220:32:332
1388899400147,42cyclictest121rcu_preempt19:20:182
138929939859,84cyclictest0-21swapper/622:54:496
138869939815,253cyclictest17414-21runrttasks21:24:120
138929939657,84cyclictest0-21swapper/623:04:566
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional