You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 04:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Sep 08, 2026 00:56:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
217339984782,84cyclictest0-21swapper/200:00:242
217339984076,761cyclictest0-21swapper/200:31:282
217339979631,762cyclictest0-21swapper/219:53:212
217339971476,635cyclictest0-21swapper/221:50:312
217339970020,84cyclictest0-21swapper/221:49:092
217339970020,84cyclictest0-21swapper/221:49:092
217339970020,84cyclictest0-21swapper/221:49:092
2173199664238,126cyclictest0-21swapper/021:19:230
217319965118,126cyclictest0-21swapper/021:13:020
21733996457,635cyclictest0-21swapper/220:09:332
2173599632165,252cyclictest21729-21cyclictest23:19:534
2173499630118,296cyclictest0-21swapper/323:29:073
217339963079,84cyclictest0-21swapper/222:49:542
217339963035,592cyclictest0-21swapper/222:56:002
217319963080,126cyclictest0-21swapper/023:50:570
2173699629123,84cyclictest121rcu_preempt21:16:265
2173899628288,338cyclictest16058-1kworker/u17:121:21:547
2173899628288,338cyclictest16058-1kworker/u17:121:21:547
217339962429,592cyclictest0-21swapper/223:49:252
217339962429,592cyclictest0-21swapper/223:49:252
2173499619107,381cyclictest0-21swapper/322:17:593
2173299619493,42cyclictest241ktimersoftd/122:17:511
217379961763,381cyclictest0-21swapper/621:35:006
2173499617108,127cyclictest0-21swapper/320:50:113
217339960915,592cyclictest0-21swapper/200:09:332
2173299609183,295cyclictest0-21swapper/100:01:151
2173299607142,125cyclictest121rcu_preempt21:54:391
217389960450,338cyclictest73-21ksoftirqd/721:17:517
217329960453,126cyclictest31717-21apt-get22:40:021
217349960351,127cyclictest0-21swapper/300:44:223
2173599602563,37cyclictest481ktimersoftd/400:30:454
21733995992,169cyclictest0-21swapper/223:59:192
217349959845,380cyclictest0-21swapper/323:38:323
21736995930,84cyclictest0-21swapper/500:03:255
21735995930,84cyclictest0-21swapper/421:50:494
21733995921,507cyclictest0-21swapper/221:34:202
2173899587287,84cyclictest0-21swapper/722:41:317
2173899587287,84cyclictest0-21swapper/722:41:317
2173699587117,127cyclictest0-21swapper/521:49:435
2173699587117,127cyclictest0-21swapper/521:49:435
2173699587117,127cyclictest0-21swapper/521:49:435
2173699585119,84cyclictest121rcu_preempt23:09:175
2173699585119,84cyclictest121rcu_preempt23:09:175
217339958334,465cyclictest0-21swapper/222:51:132
217359958132,85cyclictest0-21swapper/422:15:074
217329958131,127cyclictest0-21swapper/122:55:331
217369957971,126cyclictest0-21swapper/522:56:595
2173299579200,376cyclictest21463-1kworker/u17:122:55:011
217379957868,380cyclictest0-21swapper/621:20:276
217379957868,380cyclictest0-21swapper/621:20:276
2173299577110,294cyclictest0-21swapper/123:48:211
2173299577110,294cyclictest0-21swapper/123:48:211
2173799573315,126cyclictest0-21swapper/623:48:566
2173799573315,126cyclictest0-21swapper/623:48:566
217359957118,295cyclictest49-21ksoftirqd/422:39:264
217339957118,550cyclictest0-21swapper/200:42:482
217359956958,126cyclictest0-21swapper/422:32:434
217319956918,84cyclictest0-21swapper/022:47:580
217379956817,126cyclictest121rcu_preempt22:17:296
217349956818,126cyclictest0-21swapper/321:11:583
217319956856,296cyclictest0-21swapper/020:08:100
217339956411,169cyclictest0-21swapper/221:20:252
217339956411,169cyclictest0-21swapper/221:20:252
217349956310,338cyclictest41-21ksoftirqd/321:51:513
217339956314,465cyclictest0-21swapper/219:43:382
217349955990,338cyclictest0-21swapper/300:04:413
21734995595,127cyclictest0-21swapper/300:31:253
217389955846,380cyclictest0-21swapper/723:08:457
217389955846,380cyclictest0-21swapper/723:08:447
217379955384,253cyclictest12187-21ssh23:58:556
21736995520,295cyclictest13434-21sh00:00:015
217389954938,126cyclictest0-21swapper/721:14:257
2173499547207,338cyclictest21729-21cyclictest21:33:423
2173399547124,127cyclictest0-21swapper/223:29:162
217359954640,126cyclictest0-21swapper/421:33:304
217359954636,507cyclictest0-21swapper/400:37:594
217379954539,340cyclictest0-21swapper/600:06:276
2173699545121,84cyclictest121rcu_preempt22:52:115
217349954575,296cyclictest0-21swapper/322:51:153
217389954479,254cyclictest0-21swapper/722:15:077
217319954434,338cyclictest0-21swapper/022:35:130
217349954334,211cyclictest0-21swapper/323:52:053
217359954132,87cyclictest0-21swapper/421:19:364
217359954131,380cyclictest0-21swapper/423:10:054
217339954126,126cyclictest0-21swapper/222:36:362
2173399541119,84cyclictest121rcu_preempt22:34:342
217369953973,211cyclictest0-21swapper/520:50:015
217339953928,508cyclictest0-21swapper/221:18:092
217329953932,126cyclictest0-21swapper/123:10:281
217389953725,509cyclictest0-21swapper/722:48:057
2173499537110,211cyclictest41-21ksoftirqd/321:22:433
2173499537110,211cyclictest41-21ksoftirqd/321:22:433
217329953769,465cyclictest0-21swapper/121:01:061
2173799536112,169cyclictest0-21swapper/621:50:286
217349953522,381cyclictest0-21swapper/323:10:283
217329953523,296cyclictest12399-21taskset22:47:581
2173199535194,211cyclictest0-21swapper/022:40:120
2173199535194,211cyclictest0-21swapper/022:40:120
217349953425,84cyclictest0-21swapper/321:49:533
217349953425,84cyclictest0-21swapper/321:49:533
217349953425,84cyclictest0-21swapper/321:49:533
217349953322,338cyclictest0-21swapper/322:37:433
217389953124,212cyclictest0-21swapper/722:36:177
217369953165,126cyclictest0-21swapper/523:38:535
217359953066,380cyclictest0-21swapper/422:20:074
217359953063,464cyclictest0-21swapper/421:12:394
217339952963,84cyclictest121rcu_preempt22:19:112
217369952862,253cyclictest0-21swapper/521:54:435
217339952817,340cyclictest0-21swapper/221:13:332
217319952859,296cyclictest0-21swapper/022:17:270
217389952715,296cyclictest0-21swapper/721:48:027
217389952715,296cyclictest0-21swapper/721:48:027
217389952715,296cyclictest0-21swapper/721:48:027
217369952760,84cyclictest0-21swapper/521:22:005
217369952760,84cyclictest0-21swapper/521:22:005
217339952615,127cyclictest0-21swapper/200:37:022
217329952660,126cyclictest0-21swapper/123:19:001
217319952619,376cyclictest0-21swapper/022:57:010
217379952518,340cyclictest9770-21sh21:17:086
217379952513,296cyclictest0-21swapper/600:10:046
217339952513,338cyclictest0-21swapper/223:07:172
217339952513,338cyclictest0-21swapper/223:07:172
217319952518,302cyclictest21729-21cyclictest22:33:260
2173899524100,126cyclictest0-21swapper/722:55:347
217359952455,253cyclictest49-21ksoftirqd/400:06:244
2173599523183,338cyclictest64450irq/122-eth023:58:394
217359952315,126cyclictest0-21swapper/422:51:134
217369952215,210cyclictest13349-21ssh22:48:545
217339952211,126cyclictest0-21swapper/221:00:462
217349952114,253cyclictest0-21swapper/319:53:083
217329952195,295cyclictest0-21swapper/121:17:171
217389952053,127cyclictest121rcu_preempt21:51:097
217379952094,296cyclictest0-21swapper/623:50:166
21734995209,508cyclictest0-21swapper/322:48:043
217349952054,211cyclictest0-21swapper/322:40:433
217349952054,211cyclictest0-21swapper/322:40:433
217319951911,126cyclictest0-21swapper/019:43:370
21731995188,253cyclictest0-21swapper/000:42:270
21734995169,339cyclictest0-21swapper/322:33:263
21731995165,211cyclictest0-21swapper/000:02:520
2173199515132,211cyclictest0-21swapper/019:54:550
21738995121,381cyclictest0-21swapper/700:32:427
2173599511127,84cyclictest1651-21ntpd00:19:314
21734995111,294cyclictest0-21swapper/323:48:533
21734995111,294cyclictest0-21swapper/323:48:533
217369950983,296cyclictest0-21swapper/500:19:045
217349950943,211cyclictest0-21swapper/322:55:253
21732995091,84cyclictest0-21swapper/121:34:591
21732995091,84cyclictest0-21swapper/121:10:391
217319950943,84cyclictest121rcu_preempt21:50:370
2173299506165,126cyclictest121rcu_preempt00:41:121
21733995051,501cyclictest0-21swapper/222:41:422
21733995051,501cyclictest0-21swapper/222:41:422
217319950579,295cyclictest0-21swapper/021:34:180
217389950477,254cyclictest0-21swapper/721:34:027
217329950436,296cyclictest0-21swapper/123:29:281
21736995031,206cyclictest0-21swapper/521:04:345
217359950380,84cyclictest0-21swapper/423:52:324
217369950238,2cyclictest0-21swapper/522:44:285
217369950238,2cyclictest0-21swapper/522:44:285
2173499502206,212cyclictest401ktimersoftd/320:05:413
217379950178,211cyclictest6918-21ssh00:31:396
2173299501162,85cyclictest21729-21cyclictest20:08:341
217359950036,296cyclictest0-21swapper/423:39:424
217369949973,210cyclictest0-21swapper/521:14:545
217359949936,83cyclictest121rcu_preempt22:49:124
217339949930,466cyclictest0-21swapper/221:35:222
217329949974,126cyclictest0-21swapper/100:05:431
217389949870,338cyclictest0-21swapper/723:49:317
217389949870,338cyclictest0-21swapper/723:49:307
217389949833,2cyclictest0-21swapper/700:43:437
2173499498241,126cyclictest0-21swapper/321:35:213
217339949831,465cyclictest0-21swapper/223:52:062
2173899497157,338cyclictest19015-1kworker/u17:100:06:587
217369949770,254cyclictest0-21swapper/522:17:045
217349949728,211cyclictest121rcu_preempt00:00:003
217329949732,126cyclictest0-21swapper/119:50:451
2173799496112,126cyclictest1708-21ssh21:11:436
217339949628,126cyclictest0-21swapper/200:19:292
2173199496197,211cyclictest10818-21ssh23:57:420
217339949571,126cyclictest0-21swapper/220:49:352
2173699494237,126cyclictest0-21swapper/522:39:225
217359949469,422cyclictest0-21swapper/400:10:044
217319949327,127cyclictest0-21swapper/000:31:380
217369949266,253cyclictest0-21swapper/500:07:545
217359949226,211cyclictest0-21swapper/423:20:124
2173799491154,255cyclictest641ktimersoftd/622:46:406
2173599491408,3cyclictest471rcuc/423:07:224
2173599491408,3cyclictest471rcuc/423:07:224
217359949128,302cyclictest0-21swapper/421:23:124
217359949128,302cyclictest0-21swapper/421:23:124
217319949164,211cyclictest9-21ksoftirqd/021:23:360
217319949164,211cyclictest9-21ksoftirqd/021:23:360
217379949023,213cyclictest0-21swapper/622:55:016
217379948962,296cyclictest0-21swapper/622:36:296
2173799489233,254cyclictest641ktimersoftd/600:02:376
217369948966,84cyclictest0-21swapper/523:10:175
217369948966,126cyclictest0-21swapper/519:44:095
217369948721,211cyclictest0-21swapper/523:51:335
2173599487147,210cyclictest121rcu_preempt00:03:244
217349948720,91cyclictest121rcu_preempt20:50:023
2173299486233,84cyclictest0-21swapper/123:57:081
2173199486403,3cyclictest101ktimersoftd/023:07:350
2173199486403,3cyclictest101ktimersoftd/023:07:350
217319948618,84cyclictest121rcu_preempt22:52:080
2173299484103,126cyclictest10872-21kworker/u16:300:18:521
2173199484142,338cyclictest29507-21diskmemload00:35:360
2173899483143,85cyclictest1553-21runrttasks20:09:087
217359948320,125cyclictest0-21swapper/420:06:504
217349948316,127cyclictest0-21swapper/323:08:443
217349948316,127cyclictest0-21swapper/323:08:443
217379948254,296cyclictest0-21swapper/623:19:036
2173899481184,84cyclictest21729-21cyclictest00:35:477
217379948154,211cyclictest0-21swapper/600:35:556
217349948116,297cyclictest0-21swapper/300:06:263
217339948113,126cyclictest0-21swapper/200:30:002
217329948115,42cyclictest0-21swapper/120:45:411
2173299480223,255cyclictest27835-21missed_timers20:10:181
217329948016,297cyclictest0-21swapper/119:42:291
217339947953,423cyclictest27802-21missed_timers20:10:172
217329947952,296cyclictest0-21swapper/121:49:531
217329947952,296cyclictest0-21swapper/121:49:531
217329947952,296cyclictest0-21swapper/121:49:531
2173299479223,254cyclictest241ktimersoftd/122:40:111
2173299479223,254cyclictest241ktimersoftd/122:40:111
217389947898,296cyclictest4769-21kworker/u16:022:20:077
217369947813,85cyclictest0-21swapper/500:35:045
217329947712,3cyclictest0-21swapper/100:30:181
217319947654,84cyclictest0-21swapper/023:10:170
21736994757,295cyclictest0-21swapper/500:34:585
21733994757,465cyclictest0-21swapper/223:38:332
217319947513,3cyclictest0-21swapper/000:09:140
21738994737,84cyclictest0-21swapper/722:54:127
21738994711,211cyclictest73-21ksoftirqd/723:40:047
2173899470170,127cyclictest121rcu_preempt19:50:487
2173899468125,84cyclictest121rcu_preempt20:48:327
217359946783,253cyclictest24749-21taskset23:47:064
217359946783,253cyclictest24749-21taskset23:47:054
217319946783,211cyclictest0-21swapper/000:29:460
21738994660,41cyclictest0-21swapper/723:36:097
2173299466171,42cyclictest121rcu_preempt23:08:591
2173299466171,42cyclictest121rcu_preempt23:08:591
217319946681,169cyclictest111rcuc/023:39:420
2173499465124,339cyclictest0-21swapper/323:19:533
217329946581,253cyclictest21729-21cyclictest23:36:131
21732994651,84cyclictest0-21swapper/100:36:281
21732994651,211cyclictest0-21swapper/121:21:041
21732994651,211cyclictest0-21swapper/121:21:041
217359946484,256cyclictest0-21swapper/419:42:284
217389946379,126cyclictest0-21swapper/723:29:407
2173899463123,338cyclictest21729-21cyclictest00:00:397
217379946380,380cyclictest0-21swapper/622:56:266
2173499463123,338cyclictest0-21swapper/321:19:363
2173299463124,337cyclictest0-21swapper/122:33:541
217379946182,295cyclictest0-21swapper/623:10:186
217379946181,296cyclictest0-21swapper/621:48:576
217379946181,296cyclictest0-21swapper/621:48:576
217379946181,296cyclictest0-21swapper/621:48:576
2173699461120,338cyclictest0-21swapper/519:54:035
2173399461124,84cyclictest17840-21ssh23:10:172
217369946081,84cyclictest0-21swapper/523:49:035
217369946081,84cyclictest0-21swapper/523:49:035
217339946038,254cyclictest0-21swapper/200:10:242
217339946034,423cyclictest0-21swapper/223:19:532
217359945936,126cyclictest27801-21missed_timers20:10:174
2173499459117,339cyclictest21729-21cyclictest00:20:193
217319945933,211cyclictest22460-21runrttasks23:29:470
2173899458120,82cyclictest0-21swapper/719:44:567
217369945833,84cyclictest0-21swapper/521:34:035
217359945879,295cyclictest0-21swapper/421:48:584
217359945879,295cyclictest0-21swapper/421:48:584
217359945879,295cyclictest0-21swapper/421:48:574
217349945835,256cyclictest0-21swapper/323:20:123
2173899457117,338cyclictest0-21swapper/721:03:147
217379945774,126cyclictest65-21ksoftirqd/623:09:366
217379945774,126cyclictest65-21ksoftirqd/623:09:356
217319945735,169cyclictest24751-21ssh23:47:080
217319945735,169cyclictest24751-21ssh23:47:080
2173899456116,338cyclictest31953-21ssh23:51:147
217379945671,253cyclictest65-21ksoftirqd/621:35:226
217359945634,256cyclictest0-21swapper/400:44:354
217349945633,84cyclictest0-21swapper/300:37:313
217389945533,256cyclictest0-21swapper/720:50:197
217379945532,3cyclictest0-21swapper/622:43:046
217379945532,3cyclictest0-21swapper/622:43:046
217329945532,127cyclictest32117-21ssh23:51:221
217319945575,296cyclictest0-21swapper/021:48:580
217319945575,296cyclictest0-21swapper/021:48:570
217319945575,296cyclictest0-21swapper/021:48:570
217379945469,211cyclictest0-21swapper/619:50:176
2173899452111,339cyclictest10185-21sh23:57:127
217349945230,338cyclictest0-21swapper/319:43:383
217329945268,211cyclictest19356-21cat20:50:221
217329945225,254cyclictest0-21swapper/100:29:441
217319945167,211cyclictest11102-21taskset19:45:020
217379945066,169cyclictest65-21ksoftirqd/622:33:126
2173699449109,338cyclictest0-21swapper/522:34:175
217359944963,211cyclictest49-21ksoftirqd/422:42:504
217359944963,211cyclictest49-21ksoftirqd/422:42:504
217389944825,254cyclictest0-21swapper/722:33:267
217339944822,211cyclictest0-21swapper/220:50:112
2173799447107,84cyclictest121rcu_preempt23:28:336
217369944561,211cyclictest0-21swapper/500:10:175
217359944519,423cyclictest0-21swapper/421:55:134
217379944216,296cyclictest0-21swapper/600:19:296
2173499442187,253cyclictest401ktimersoftd/321:00:443
217359944014,295cyclictest0-21swapper/422:56:234
217379943956,168cyclictest17546-21cron20:50:006
217349943916,48cyclictest0-21swapper/300:29:593
217319943918,84cyclictest0-21swapper/022:20:070
217369943859,84cyclictest0-21swapper/520:50:075
217379943753,295cyclictest0-21swapper/600:44:226
217349943613,298cyclictest1651-21ntpd21:05:153
217359943595,338cyclictest1553-21runrttasks19:53:214
217319943411,126cyclictest0-21swapper/020:48:110
21737994339,254cyclictest0-21swapper/623:39:476
217329943310,84cyclictest0-21swapper/100:10:111
217349943250,127cyclictest0-21swapper/319:45:063
2173199432221,84cyclictest101ktimersoftd/000:10:080
21735994316,84cyclictest0-21swapper/423:40:044
21731994319,84cyclictest0-21swapper/000:19:040
217389942787,338cyclictest0-21swapper/723:10:177
21732994271,211cyclictest0-21swapper/121:35:031
2173199426127,125cyclictest121rcu_preempt23:18:320
21736994253,2cyclictest0-21swapper/500:42:495
21731994254,126cyclictest0-21swapper/021:35:220
217389942481,126cyclictest121rcu_preempt21:35:097
21737994240,84cyclictest0-21swapper/620:50:216
2173599424168,127cyclictest9557-21ntpq21:35:214
2173599424130,210cyclictest64450irq/122-eth020:48:494
217389942382,338cyclictest0-21swapper/700:19:217
21737994231,84cyclictest0-21swapper/622:20:076
2173799423171,83cyclictest21729-21cyclictest19:43:376
21736994232,2cyclictest0-21swapper/520:08:255
217349942338,253cyclictest0-21swapper/300:18:513
217379942281,338cyclictest0-21swapper/621:55:046
217359942283,337cyclictest0-21swapper/421:01:364
217329942282,338cyclictest0-21swapper/121:55:061
217369942183,84cyclictest0-21swapper/523:29:475
217339942180,339cyclictest0-21swapper/221:05:142
217339942138,295cyclictest121rcu_preempt21:55:042
217369942081,84cyclictest0-21swapper/523:19:535
2173899419123,84cyclictest0-21swapper/721:05:187
217359941978,338cyclictest0-21swapper/420:50:124
217319941939,42cyclictest0-21swapper/021:03:350
217389941878,338cyclictest0-21swapper/700:30:007
217389941738,295cyclictest0-21swapper/719:45:067
217339941737,296cyclictest0-21swapper/223:20:042
2173799416117,126cyclictest0-21swapper/620:09:156
217359941675,338cyclictest0-21swapper/423:29:084
217319941675,338cyclictest0-21swapper/020:50:210
217389941574,338cyclictest0-21swapper/720:10:187
217389941474,338cyclictest0-21swapper/721:55:057
2173699414116,125cyclictest57-21ksoftirqd/521:35:075
217329941434,296cyclictest0-21swapper/122:20:071
217349941372,338cyclictest0-21swapper/320:10:173
217339941174,84cyclictest9610-21ssh23:40:032
217329941132,295cyclictest0-21swapper/119:45:061
217389941031,42cyclictest0-21swapper/700:20:047
2173899409110,296cyclictest0-21swapper/723:20:127
217349940929,296cyclictest0-21swapper/300:10:103
217369940869,84cyclictest0-21swapper/520:10:175
217369940867,168cyclictest0-21swapper/500:29:465
217369940729,2cyclictest0-21swapper/523:30:185
217369940666,85cyclictest0-21swapper/521:05:145
217389940521,254cyclictest0-21swapper/723:18:327
217369940563,168cyclictest57-21ksoftirqd/519:45:075
2173499405114,288cyclictest0-21swapper/323:30:173
217359940467,126cyclictest0-21swapper/400:29:434
217339940419,126cyclictest11116-21/usr/sbin/munin19:45:122
217349940362,339cyclictest0-21swapper/322:20:033
217319940363,337cyclictest0-21swapper/021:55:060
217349940262,338cyclictest0-21swapper/321:55:053
217339940164,126cyclictest27853-21ssh22:20:052
2173399399188,87cyclictest29507-21diskmemload23:30:192
217379939899,84cyclictest0-21swapper/621:03:446
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional