You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 11:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Thu Nov 20, 2025 00:45:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1893621220,0sleep00-21swapper/000:23:330
649821170,0sleep20-21swapper/200:08:522
685521080,0sleep40-21swapper/423:09:394
39772880,1sleep4491rcuc/421:47:324
82702830,0sleep50-21swapper/522:40:155
294852810,0sleep50-21swapper/522:09:455
70062800,1sleep76965-21sshd00:02:007
280132800,1sleep70-21swapper/722:19:257
275342790,0sleep4491rcuc/422:22:354
159082790,0sleep10-21swapper/121:55:151
46422780,0sleep00-21swapper/000:15:150
36902780,4sleep5466199cyclictest23:02:435
286082750,0sleep70-21swapper/722:12:527
49272740,0sleep10-21swapper/123:45:191
142062740,1sleep1231ktimersoftd/122:47:241
142062740,1sleep1231ktimersoftd/122:47:231
219522730,0sleep70-21swapper/723:53:337
174902720,0sleep30-21swapper/300:30:013
128732720,0sleep20-21swapper/223:16:432
98262710,1sleep30-21swapper/321:28:403
319712710,0sleep40-21swapper/400:28:104
8962700,0sleep00-21swapper/022:23:110
30412700,1sleep53038-21sshd22:23:245
194142700,0sleep50-21swapper/522:57:465
189522700,0sleep60-21swapper/622:21:416
65412680,0sleep50-21swapper/522:33:335
221472680,0sleep60-21swapper/623:27:286
92152670,0sleep30-21swapper/321:51:163
325662650,1sleep7771ktimersoftd/723:31:457
277102650,0sleep10-21swapper/100:20:531
52002640,0sleep60-21swapper/623:19:196
292462620,0sleep30-21swapper/300:27:533
216572610,3sleep2463899cyclictest23:30:372
415425949,6sleep60-21swapper/619:07:016
306002590,4sleep1463399cyclictest22:03:161
413725848,6sleep70-21swapper/719:06:547
432625544,7sleep50-21swapper/519:09:185
302772550,0sleep40-21swapper/421:50:134
10632540,0sleep50-21swapper/522:13:215
235424939,6sleep30-21swapper/319:05:073
128672490,1sleep60-21swapper/621:28:586
421124433,7sleep00-21swapper/019:07:520
423324333,6sleep40-21swapper/419:08:044
424824231,7sleep10-21swapper/119:08:161
424024130,7sleep20-21swapper/219:08:092
107932390,0sleep30-21swapper/323:42:403
294092280,0sleep50-21swapper/522:16:115
198642280,1sleep10-21swapper/100:03:301
80822270,0sleep70-21swapper/721:44:477
197762270,0sleep70-21swapper/722:38:097
197762270,0sleep70-21swapper/722:38:087
4633992411,12cyclictest0-21swapper/121:42:291
214042230,1sleep00-21swapper/021:36:140
463399220,1cyclictest0-21swapper/123:22:471
28982210,1sleep3411ktimersoftd/321:15:013
88332200,0sleep08835-21id22:46:510
88332200,0sleep08835-21id22:46:500
4633992018,1cyclictest0-21swapper/121:39:151
463399200,1cyclictest0-21swapper/123:27:211
463399200,19cyclictest465-21systemd-journal00:34:041
259292200,0sleep40-21swapper/421:43:164
214642200,1sleep7771ktimersoftd/700:16:597
168482200,1sleep216846-21sshd21:19:412
133012200,0sleep70-21swapper/721:38:457
464899194,7cyclictest31984-21sshd00:01:133
464899194,7cyclictest22253-21gdbus22:54:043
135122190,1sleep50-21swapper/522:47:205
135122190,1sleep50-21swapper/522:47:205
107372190,0sleep20-21swapper/222:20:492
6002180,0sleep10-21swapper/123:35:091
4648991814,2cyclictest0-21swapper/300:35:013
122382180,0sleep40-21swapper/422:50:244
105202180,0sleep6671rcuc/623:59:106
4665991713,2cyclictest662-21gdbus23:39:266
465499170,1cyclictest0-21swapper/400:36:334
464899173,7cyclictest0-21swapper/323:20:083
464899171,14cyclictest0-21swapper/322:47:493
464899171,14cyclictest0-21swapper/322:47:493
4633991714,1cyclictest19229-21sshd22:41:171
125552170,2sleep60-21swapper/600:29:326
75092160,0sleep00-21swapper/022:14:050
58682160,0sleep0121rcuc/022:36:410
58682160,0sleep0121rcuc/022:36:410
4665991614,1cyclictest15758-21sshd21:55:146
4665991613,2cyclictest768-21nscd22:45:406
4665991613,2cyclictest768-21nscd22:45:406
466599160,14cyclictest0-21swapper/623:33:236
4654991611,3cyclictest0-21swapper/423:28:264
464899167,5cyclictest660-21dbus-daemon21:30:313
464899163,6cyclictest32157-21sshd22:26:163
464899163,6cyclictest22389-21sshd22:31:503
464899163,4cyclictest660-21dbus-daemon00:15:593
4648991613,2cyclictest21900-21sshd22:05:333
464899161,14cyclictest0-21swapper/323:53:263
4633991612,2cyclictest0-21swapper/100:11:061
291922160,0sleep30-21swapper/323:47:453
257822160,0sleep30-21swapper/322:02:463
246662160,0sleep60-21swapper/621:39:576
160692160,1sleep60-21swapper/600:23:156
4671991511,2cyclictest704-21systemd-logind21:54:547
467199150,1cyclictest0-21swapper/722:07:567
467199150,13cyclictest660-21dbus-daemon21:45:057
466599150,13cyclictest0-21swapper/622:17:256
465499159,4cyclictest0-21swapper/423:40:004
465499155,2cyclictest22682-21sshd22:28:394
465499154,5cyclictest0-21swapper/423:15:444
465499154,2cyclictest660-21dbus-daemon23:40:114
465499153,4cyclictest0-21swapper/422:46:584
465499153,4cyclictest0-21swapper/422:46:584
4654991511,3cyclictest0-21swapper/421:13:384
4654991511,2cyclictest660-21dbus-daemon00:20:354
4654991511,2cyclictest0-21swapper/421:37:494
465499150,2cyclictest26272-21open_files20:20:194
465499150,1cyclictest0-21swapper/423:34:134
465499150,11cyclictest0-21swapper/423:02:144
464899153,6cyclictest3357-21sshd23:05:533
464899152,5cyclictest26098-21bash21:14:073
4648991513,1cyclictest0-21swapper/322:36:523
4648991513,1cyclictest0-21swapper/322:36:513
463899150,13cyclictest14980-21sshd00:26:212
463899150,13cyclictest0-21swapper/223:03:012
4633991512,2cyclictest1117-21nfsd21:50:411
4627991511,2cyclictest1-21systemd22:41:480
4627991511,2cyclictest0-21swapper/023:47:400
462799150,13cyclictest14276-21bash21:51:480
462799150,13cyclictest0-21swapper/023:21:110
4282150,0sleep40-21swapper/423:12:124
242872150,0sleep60-21swapper/623:04:536
225932150,1sleep7761rcuc/722:02:267
99612140,1sleep233-21ksoftirqd/221:38:252
63982140,1sleep76402-21tty23:45:257
467199140,2cyclictest0-21swapper/700:12:247
467199140,1cyclictest0-21swapper/722:28:027
467199140,12cyclictest21393-21sshd22:31:447
467199140,12cyclictest0-21swapper/721:19:577
4665991411,2cyclictest0-21swapper/600:01:206
466599140,1cyclictest0-21swapper/623:46:486
466599140,13cyclictest0-21swapper/619:52:576
466199140,1cyclictest0-21swapper/521:57:395
466199140,12cyclictest8945-21id23:32:405
466199140,12cyclictest465-21systemd-journal22:29:465
466199140,12cyclictest16892-21sshd22:37:505
466199140,12cyclictest16892-21sshd22:37:505
466199140,12cyclictest0-21swapper/500:29:165
465499145,2cyclictest9263-21bash22:56:424
465499145,1cyclictest8025-21grep21:15:244
465499145,1cyclictest4577-21sshd22:39:574
465499145,1cyclictest4577-21sshd22:39:574
465499144,2cyclictest654-21polkitd21:20:444
465499144,2cyclictest654-21polkitd21:20:434
465499144,2cyclictest31667-21sshd00:31:214
465499143,1cyclictest0-21swapper/422:34:124
465499140,2cyclictest22280-21sshd21:55:504
465499140,2cyclictest21696-21sshd00:03:424
465499140,2cyclictest16957-21grep22:44:294
465499140,1cyclictest3597-21sshd00:05:104
465499140,1cyclictest13186-21sshd00:12:494
465499140,12cyclictest0-21swapper/422:13:104
464899149,3cyclictest465-21systemd-journal22:19:503
464899147,5cyclictest0-21swapper/323:37:383
464899145,4cyclictest734-21ModemManager21:35:023
464899144,7cyclictest11811-21sshd23:13:233
464899144,6cyclictest660-21dbus-daemon23:30:063
464899144,4cyclictest660-21dbus-daemon00:06:113
464899143,7cyclictest0-21swapper/323:01:083
464899143,4cyclictest32077-21grep00:21:223
464899143,3cyclictest0-21swapper/322:42:523
464899141,12cyclictest0-21swapper/321:46:263
4638991411,2cyclictest0-21swapper/222:08:192
4638991411,2cyclictest0-21swapper/221:44:322
463899140,2cyclictest1-21systemd21:12:232
463899140,13cyclictest0-21swapper/223:24:562
463399149,1cyclictest21762-21sshd21:46:011
463399140,12cyclictest17944-21id22:31:221
463399140,12cyclictest1-21systemd22:15:541
153652140,0sleep40-21swapper/422:08:164
146402140,0sleep10-21swapper/123:56:011
4671991311,1cyclictest6922-21sshd22:56:287
4671991311,1cyclictest11373-21sshd00:25:597
467199130,12cyclictest0-21swapper/723:40:577
467199130,12cyclictest0-21swapper/723:16:437
4665991311,1cyclictest0-21swapper/622:40:586
4665991310,1cyclictest28619-21bash21:20:436
4665991310,1cyclictest28619-21bash21:20:436
466599130,12cyclictest0-21swapper/622:58:346
466599130,12cyclictest0-21swapper/622:31:576
466599130,11cyclictest0-21swapper/622:25:466
466199130,2cyclictest0-21swapper/522:54:305
465499135,1cyclictest1044-21sshd00:16:134
465499134,2cyclictest780-21basename20:35:144
465499134,2cyclictest662-21gdbus23:46:114
465499134,2cyclictest5992-21sshd23:55:134
465499134,2cyclictest465-21systemd-journal21:30:134
465499134,2cyclictest28556-21sshd23:50:524
465499130,7cyclictest0-21swapper/420:51:274
465499130,2cyclictest13229-21missed_timers21:00:154
465499130,1cyclictest4554-21sshd22:00:314
465499130,1cyclictest24558-21sshd22:15:404
465499130,1cyclictest23554-21sed20:15:174
465499130,1cyclictest14153-21sshd21:25:454
465499130,12cyclictest0-21swapper/423:23:364
464899139,3cyclictest0-21swapper/322:58:273
464899137,4cyclictest465-21systemd-journal21:57:483
464899134,6cyclictest24389-21sshd00:10:343
464899133,6cyclictest8971-21sshd22:20:373
464899133,6cyclictest10699-21date19:50:003
464899133,4cyclictest704-21systemd-logind23:56:553
464899132,7cyclictest24531-21sshd21:23:403
464899132,7cyclictest24531-21sshd21:23:403
463899139,3cyclictest0-21swapper/221:29:362
463899130,2cyclictest0-21swapper/223:41:202
463899130,1cyclictest738-21gdbus22:00:232
463899130,1cyclictest20862-21sshd23:27:212
463899130,1cyclictest0-21swapper/223:51:332
463899130,1cyclictest0-21swapper/221:48:422
463899130,12cyclictest14440-21sshd21:22:372
463899130,12cyclictest14440-21sshd21:22:372
463899130,12cyclictest0-21swapper/222:54:572
463399134,0cyclictest0-21swapper/122:05:151
463399133,9cyclictest0-21swapper/123:33:181
463399133,9cyclictest0-21swapper/121:23:371
463399133,9cyclictest0-21swapper/121:23:361
4633991311,1cyclictest778-21gdbus00:07:121
463399130,3cyclictest10965-21sshd21:25:241
463399130,1cyclictest0-21swapper/121:33:591
463399130,1cyclictest0-21swapper/100:39:121
463399130,12cyclictest0-21swapper/100:18:221
463399130,11cyclictest2297-21rm22:20:051
4627991310,2cyclictest0-21swapper/023:01:180
462799130,1cyclictest0-21swapper/021:40:390
462799130,1cyclictest0-21swapper/021:15:120
462799130,1cyclictest0-21swapper/000:03:070
462799130,12cyclictest25072-21id23:37:350
462799130,12cyclictest0-21swapper/023:18:460
462799130,12cyclictest0-21swapper/021:32:430
462799130,11cyclictest0-21swapper/023:26:020
276172130,0sleep10-21swapper/122:58:381
252142130,0sleep5581rcuc/500:10:395
222262130,0sleep70-21swapper/721:20:117
222262130,0sleep70-21swapper/721:20:117
153392130,1sleep50-21swapper/523:56:055
4671991210,1cyclictest0-21swapper/723:04:317
4671991210,1cyclictest0-21swapper/722:51:137
4671991210,1cyclictest0-21swapper/722:21:227
4671991210,1cyclictest0-21swapper/700:07:337
467199120,1cyclictest31844-21sshd23:05:287
467199120,1cyclictest0-21swapper/722:40:447
467199120,1cyclictest0-21swapper/700:34:437
467199120,1cyclictest0-21swapper/700:21:087
467199120,11cyclictest8002-21sshd23:29:237
467199120,11cyclictest7847-21date19:30:007
467199120,11cyclictest0-21swapper/723:35:107
467199120,11cyclictest0-21swapper/722:45:597
467199120,11cyclictest0-21swapper/722:45:597
466599123,1cyclictest0-21swapper/600:32:596
4665991210,1cyclictest0-21swapper/623:20:216
4665991210,1cyclictest0-21swapper/621:30:556
4665991210,1cyclictest0-21swapper/621:13:436
466599120,1cyclictest0-21swapper/622:09:066
466599120,1cyclictest0-21swapper/621:47:126
466599120,1cyclictest0-21swapper/600:07:396
466599120,11cyclictest0-21swapper/622:51:276
466599120,11cyclictest0-21swapper/622:04:006
466199129,2cyclictest0-21swapper/500:38:005
4661991210,1cyclictest16541-21bash21:35:445
4661991210,1cyclictest0-21swapper/523:54:195
4661991210,1cyclictest0-21swapper/523:40:515
4661991210,1cyclictest0-21swapper/523:18:095
4661991210,1cyclictest0-21swapper/521:24:355
4661991210,1cyclictest0-21swapper/521:24:345
4661991210,1cyclictest0-21swapper/521:18:325
466199120,1cyclictest0-21swapper/500:02:075
466199120,11cyclictest0-21swapper/523:35:065
466199120,11cyclictest0-21swapper/500:24:255
466199120,11cyclictest0-21swapper/500:06:005
465499123,2cyclictest0-21swapper/420:00:174
465499120,2cyclictest0-21swapper/421:05:274
465499120,2cyclictest0-21swapper/420:28:594
465499120,2cyclictest0-21swapper/419:51:344
465499120,1cyclictest31488-21timerandwakeup20:30:244
464899128,3cyclictest465-21systemd-journal21:41:463
464899124,6cyclictest9107-21perf19:39:593
464899123,5cyclictest28652-21sshd23:28:103
464899122,2cyclictest0-21swapper/323:16:163
4648991210,1cyclictest0-21swapper/320:52:013
464899120,7cyclictest2491-21sshd22:10:123
4638991210,1cyclictest79850irq/25-eno1-rx-00:39:502
4638991210,1cyclictest0-21swapper/223:47:072
4638991210,1cyclictest0-21swapper/221:50:342
463899120,1cyclictest0-21swapper/222:45:252
463899120,1cyclictest0-21swapper/222:45:252
463899120,1cyclictest0-21swapper/200:16:412
463399129,1cyclictest704-21systemd-logind21:10:111
463399126,5cyclictest662-21gdbus23:07:251
4633991210,1cyclictest0-21swapper/122:38:301
4633991210,1cyclictest0-21swapper/122:38:301
4633991210,1cyclictest0-21swapper/120:30:241
463399120,11cyclictest0-21swapper/122:11:451
4627991210,1cyclictest0-21swapper/022:01:370
4627991210,1cyclictest0-21swapper/021:28:330
4627991210,1cyclictest0-21swapper/021:20:410
4627991210,1cyclictest0-21swapper/021:20:410
462799120,1cyclictest19319-21sshd21:45:440
462799120,1cyclictest0-21swapper/023:56:480
462799120,1cyclictest0-21swapper/022:30:550
462799120,11cyclictest0-21swapper/023:50:380
462799120,11cyclictest0-21swapper/000:11:520
211532120,0sleep20-21swapper/223:07:452
467199119,1cyclictest0-21swapper/721:32:037
467199110,0cyclictest0-21swapper/723:55:527
466599119,1cyclictest8741-21sshd22:14:136
466599119,1cyclictest0-21swapper/623:50:116
466599114,1cyclictest1044-21sshd23:41:016
466599110,1cyclictest0-21swapper/623:13:576
466599110,1cyclictest0-21swapper/620:20:226
466199119,1cyclictest0-21swapper/521:47:495
466199119,1cyclictest0-21swapper/520:54:205
466199118,2cyclictest0-21swapper/523:47:365
466199110,2cyclictest0-21swapper/520:15:175
466199110,10cyclictest0-21swapper/521:41:475
465499110,2cyclictest0-21swapper/420:41:404
465499110,2cyclictest0-21swapper/419:14:394
464899113,6cyclictest14402-21munin-run21:05:003
464899112,7cyclictest271782sleep320:24:063
464899110,10cyclictest0-21swapper/320:39:553
463899119,1cyclictest0-21swapper/222:17:362
463899119,1cyclictest0-21swapper/220:30:112
463899119,1cyclictest0-21swapper/200:32:412
463899119,1cyclictest0-21swapper/200:11:512
463899110,9cyclictest654-21polkitd22:35:082
463899110,9cyclictest654-21polkitd22:35:072
463899110,0cyclictest0-21swapper/222:12:292
463399119,1cyclictest0-21swapper/123:50:401
463399119,1cyclictest0-21swapper/123:40:361
463399119,1cyclictest0-21swapper/123:01:211
463399119,1cyclictest0-21swapper/122:54:131
463399118,2cyclictest660-21dbus-daemon00:28:481
463399113,5cyclictest0-21swapper/119:13:491
463399113,3cyclictest0-21swapper/120:46:281
462799119,1cyclictest0-21swapper/022:29:590
462799119,1cyclictest0-21swapper/021:13:140
462799119,1cyclictest0-21swapper/000:07:010
462799117,3cyclictest0-21swapper/000:26:230
462799110,2cyclictest23190-21sshd23:30:470
462799110,0cyclictest0-21swapper/023:40:570
467199108,1cyclictest24657-21sshd23:24:337
467199108,1cyclictest0-21swapper/721:55:497
467199108,1cyclictest0-21swapper/721:26:577
466599108,1cyclictest0-21swapper/622:38:086
466599108,1cyclictest0-21swapper/622:38:086
466599108,1cyclictest0-21swapper/600:38:106
466199104,5cyclictest0-21swapper/520:32:145
466199104,5cyclictest0-21swapper/519:27:505
466199101,2cyclictest26352-21sshd21:27:015
464899108,1cyclictest0-21swapper/319:50:453
464899105,4cyclictest28285-21ls20:25:153
464899105,3cyclictest4258-21/usr/sbin/munin20:40:223
464899105,3cyclictest31374-21ls20:30:233
464899105,3cyclictest0-21swapper/320:15:143
464899104,4cyclictest18005-21tr20:05:123
464899104,4cyclictest18005-21tr20:05:123
464899104,4cyclictest11294-21timerandwakeup20:55:173
464899100,1cyclictest0-21swapper/320:49:213
463899100,9cyclictest0-21swapper/223:55:582
463899100,2cyclictest0-21swapper/222:44:562
463899100,2cyclictest0-21swapper/200:20:202
463399105,3cyclictest0-21swapper/119:49:501
463399104,2cyclictest22750-21sshd22:25:191
463399103,2cyclictest0-21swapper/120:11:251
463399102,5cyclictest0-21swapper/119:42:211
463399102,3cyclictest0-21swapper/121:03:091
463399102,3cyclictest0-21swapper/119:51:401
463399102,3cyclictest0-21swapper/119:32:181
463399102,1cyclictest0-21swapper/119:39:291
463399100,9cyclictest0-21swapper/119:28:501
463399100,5cyclictest0-21swapper/120:39:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional