You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 17:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot0.osadl.org (updated Thu Nov 20, 2025 12:45:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1488721100,0sleep60-21swapper/611:41:156
1488721100,0sleep60-21swapper/611:41:156
83932760,0sleep40-21swapper/411:11:404
3582760,1sleep4351-21sshd10:08:334
17442750,0sleep00-21swapper/010:18:150
257242740,0sleep30-21swapper/311:28:383
99632730,1sleep30-21swapper/309:55:333
240522710,0sleep50-21swapper/512:06:315
219662710,0sleep50-21swapper/510:25:495
37802700,0sleep30-21swapper/311:58:523
323342700,0sleep50-21swapper/509:25:375
136612660,0sleep3411ktimersoftd/310:05:343
85162650,0sleep70-21swapper/711:59:357
216682650,4sleep52872999cyclictest12:25:145
49552610,0sleep60-21swapper/609:16:506
2835925848,6sleep40-21swapper/407:08:204
2845425544,6sleep70-21swapper/707:09:377
2831724938,7sleep00-21swapper/007:07:520
2847424837,7sleep50-21swapper/507:09:515
2644824838,6sleep60-21swapper/607:05:116
73712460,1sleep451-21ksoftirqd/410:38:144
2821524636,6sleep10-21swapper/107:06:341
2840524231,7sleep30-21swapper/307:09:013
2812124230,7sleep20-21swapper/207:05:232
161902280,1sleep2311rcuc/210:49:022
2870699260,10cyclictest0-21swapper/112:17:121
292712240,0sleep40-21swapper/410:55:374
2870699240,5cyclictest0-21swapper/112:13:161
2870699240,23cyclictest0-21swapper/107:25:221
2870699240,20cyclictest0-21swapper/107:20:181
7292210,1sleep70-21swapper/711:05:427
2870699210,2cyclictest0-21swapper/112:20:221
2870699210,20cyclictest0-21swapper/110:30:191
2870699210,20cyclictest0-21swapper/110:25:271
2870699210,20cyclictest0-21swapper/110:15:031
104412210,1sleep60-21swapper/610:05:146
77632200,0sleep70-21swapper/709:31:417
28712992015,1cyclictest465-21systemd-journal10:40:152
133152200,0sleep20-21swapper/209:51:232
312722190,0sleep70-21swapper/709:11:067
2872999190,13cyclictest0-21swapper/511:23:095
2870099190,17cyclictest0-21swapper/011:15:150
273282190,1sleep4491rcuc/411:19:254
267762190,0sleep00-21swapper/009:25:000
250532190,1sleep40-21swapper/411:04:434
21072190,1sleep60-21swapper/612:08:086
28729991811,1cyclictest0-21swapper/509:30:465
110122180,1sleep10-21swapper/110:14:551
102782180,1sleep30-21swapper/311:40:323
102782180,1sleep30-21swapper/311:40:323
302072170,1sleep2321ktimersoftd/209:30:162
297302170,0sleep00-21swapper/009:15:380
28735991714,1cyclictest11469-21sshd09:46:216
28735991714,1cyclictest11469-21sshd09:46:206
245102170,0sleep70-21swapper/710:16:457
127962170,0sleep10-21swapper/108:50:001
121592170,0sleep30-21swapper/311:36:073
121592170,0sleep30-21swapper/311:36:073
2874299160,14cyclictest0-21swapper/711:44:127
2874299160,14cyclictest0-21swapper/711:44:127
28729991611,3cyclictest0-21swapper/508:40:155
28725991612,2cyclictest0-21swapper/411:35:114
28725991612,2cyclictest0-21swapper/411:35:114
28700991614,1cyclictest537-40kipmi011:30:180
164392160,0sleep50-21swapper/507:50:115
12462160,0sleep30-21swapper/310:03:593
304282150,0sleep50-21swapper/510:50:575
2873599150,3cyclictest0-21swapper/609:40:266
2873599150,13cyclictest0-21swapper/610:51:256
2873599150,13cyclictest0-21swapper/609:23:556
28729991511,2cyclictest0-21swapper/509:50:405
2872999150,13cyclictest0-21swapper/509:18:255
2872599150,13cyclictest0-21swapper/410:50:574
2871899150,13cyclictest0-21swapper/310:16:333
2870699159,5cyclictest0-21swapper/111:23:541
28706991512,2cyclictest0-21swapper/111:29:061
2870699150,13cyclictest0-21swapper/112:34:561
2870699150,13cyclictest0-21swapper/111:31:121
214082150,0sleep30-21swapper/311:04:103
80282140,1sleep20-21swapper/211:59:312
78072140,0sleep30-21swapper/312:18:313
28742991412,1cyclictest0-21swapper/710:22:057
28742991411,1cyclictest465-21systemd-journal12:36:457
28735991411,2cyclictest0-21swapper/610:34:536
2873599140,2cyclictest654-21polkitd10:46:346
28729991410,2cyclictest660-21dbus-daemon11:07:495
2872999140,3cyclictest0-21swapper/512:02:085
2872999140,12cyclictest9894-21sshd11:45:195
2872999140,12cyclictest9894-21sshd11:45:195
2872599140,2cyclictest465-21systemd-journal10:48:324
2872599140,12cyclictest28757-21sshd09:10:404
2872599140,12cyclictest0-21swapper/412:20:124
2872599140,12cyclictest0-21swapper/412:13:054
28718991411,2cyclictest0-21swapper/310:14:393
2871899140,13cyclictest0-21swapper/309:16:373
28712991410,2cyclictest0-21swapper/211:29:572
2871299140,2cyclictest1-21systemd11:51:352
2871299140,2cyclictest10465-21bash12:28:252
2871299140,2cyclictest0-21swapper/209:19:182
2870699142,9cyclictest0-21swapper/109:40:361
28706991412,1cyclictest0-21swapper/111:37:461
28706991412,1cyclictest0-21swapper/111:37:451
2870699141,10cyclictest0-21swapper/107:15:201
2870699140,7cyclictest0-21swapper/110:46:241
2870699140,1cyclictest0-21swapper/109:35:041
2870099141,12cyclictest5938-21kworker/0:107:30:150
2870099141,12cyclictest5938-21kworker/0:107:30:150
2870099140,12cyclictest0-21swapper/011:24:440
2870099140,12cyclictest0-21swapper/009:39:460
220982140,1sleep70-21swapper/711:37:407
220982140,1sleep70-21swapper/711:37:407
175612140,0sleep1221rcuc/109:52:031
102352140,0sleep20-21swapper/210:14:482
28742991311,1cyclictest17042-21grepconf.sh09:28:197
28742991311,1cyclictest0-21swapper/710:07:577
28742991310,2cyclictest0-21swapper/711:31:427
2874299130,1cyclictest0-21swapper/711:10:597
2874299130,12cyclictest4791-21sshd11:54:177
2874299130,12cyclictest0-21swapper/711:19:367
2874299130,12cyclictest0-21swapper/710:39:257
2874299130,11cyclictest0-21swapper/709:40:177
2873599139,2cyclictest0-21swapper/610:35:496
28735991311,1cyclictest24820-21sshd10:02:376
28735991311,1cyclictest0-21swapper/609:14:466
2873599130,12cyclictest660-21dbus-daemon10:57:126
2873599130,12cyclictest0-21swapper/611:53:226
2873599130,12cyclictest0-21swapper/611:46:396
2873599130,12cyclictest0-21swapper/611:46:396
2873599130,12cyclictest0-21swapper/609:28:296
28729991311,1cyclictest0-21swapper/510:14:125
28729991310,2cyclictest0-21swapper/511:01:065
28725991311,1cyclictest2098-21sshd11:44:194
28725991311,1cyclictest2098-21sshd11:44:194
28725991311,1cyclictest0-21swapper/412:26:234
28725991311,1cyclictest0-21swapper/410:43:184
2872599130,1cyclictest0-21swapper/409:59:534
28718991310,1cyclictest0-21swapper/311:49:343
28718991310,1cyclictest0-21swapper/311:49:343
2871899130,12cyclictest0-21swapper/311:53:523
2871899130,12cyclictest0-21swapper/310:26:243
2871899130,12cyclictest0-21swapper/309:35:503
2871299139,3cyclictest0-21swapper/209:43:142
28712991311,1cyclictest0-21swapper/211:41:302
28712991311,1cyclictest0-21swapper/211:41:292
28712991311,1cyclictest0-21swapper/210:54:522
28712991310,2cyclictest0-21swapper/209:27:062
28712991310,1cyclictest0-21swapper/212:10:492
2871299130,1cyclictest0-21swapper/211:15:582
2871299130,1cyclictest0-21swapper/210:16:342
2871299130,12cyclictest0-21swapper/211:35:442
2871299130,12cyclictest0-21swapper/211:35:442
2871299130,11cyclictest21742-21sshd10:35:232
2871299130,11cyclictest11424-21bash11:07:212
2870699132,10cyclictest0-21swapper/108:23:091
2870699131,9cyclictest0-21swapper/108:54:051
28706991312,0cyclictest1116-21nfsd09:20:571
28706991310,2cyclictest13299-21sshd11:17:131
2870699130,1cyclictest16366-21sshd09:28:131
2870699130,1cyclictest0-21swapper/109:48:071
2870699130,1cyclictest0-21swapper/109:48:071
2870699130,12cyclictest0-21swapper/112:07:461
2870699130,11cyclictest11507-21sshd12:38:001
2870699130,11cyclictest0-21swapper/109:55:301
2870699130,10cyclictest0-21swapper/110:40:401
2870099130,12cyclictest0-21swapper/011:50:160
2870099130,12cyclictest0-21swapper/011:48:480
2870099130,12cyclictest0-21swapper/011:48:480
2870099130,11cyclictest13999-21ntp_states08:50:180
2874299129,1cyclictest13608-21sshd11:22:017
28742991210,1cyclictest0-21swapper/712:01:007
28742991210,1cyclictest0-21swapper/710:51:477
28742991210,1cyclictest0-21swapper/710:25:507
2874299120,1cyclictest0-21swapper/710:46:577
2874299120,11cyclictest0-21swapper/712:30:347
2874299120,11cyclictest0-21swapper/712:23:277
2874299120,11cyclictest0-21swapper/712:11:057
2874299120,11cyclictest0-21swapper/709:49:337
2874299120,11cyclictest0-21swapper/709:49:337
2874299120,11cyclictest0-21swapper/709:20:317
2873599129,2cyclictest0-21swapper/611:10:386
2873599129,1cyclictest0-21swapper/609:57:066
28735991210,1cyclictest9292-21sshd11:30:486
28735991210,1cyclictest6573-21sshd10:42:496
28735991210,1cyclictest0-21swapper/612:32:296
2873599120,1cyclictest0-21swapper/609:30:466
2873599120,11cyclictest0-21swapper/612:25:226
2873599120,11cyclictest0-21swapper/611:39:566
2873599120,11cyclictest0-21swapper/611:39:566
2872999129,2cyclictest0-21swapper/511:30:245
2872999129,2cyclictest0-21swapper/510:35:495
2872999122,5cyclictest0-21swapper/508:10:145
28729991210,1cyclictest24911-21sshd10:02:385
28729991210,1cyclictest15982-21sshd09:42:205
28729991210,1cyclictest0-21swapper/511:27:595
28729991210,1cyclictest0-21swapper/509:57:085
28729991210,1cyclictest0-21swapper/509:35:215
2872999120,1cyclictest0-21swapper/511:41:585
2872999120,1cyclictest0-21swapper/511:41:585
2872999120,1cyclictest0-21swapper/509:46:305
2872999120,1cyclictest0-21swapper/509:46:295
2872999120,11cyclictest0-21swapper/512:30:455
2872999120,11cyclictest0-21swapper/511:55:245
2872999120,11cyclictest0-21swapper/510:43:455
28725991210,1cyclictest0-21swapper/412:34:274
28725991210,1cyclictest0-21swapper/411:05:524
28725991210,1cyclictest0-21swapper/409:46:594
28725991210,1cyclictest0-21swapper/409:46:594
28725991210,1cyclictest0-21swapper/409:42:494
2872599120,1cyclictest26162-21sshd12:02:034
2872599120,1cyclictest0-21swapper/411:32:454
2872599120,1cyclictest0-21swapper/410:10:544
2872599120,1cyclictest0-21swapper/409:50:124
2872599120,11cyclictest8079-21sshd09:22:064
2872599120,11cyclictest0-21swapper/411:58:424
2872599120,11cyclictest0-21swapper/410:34:254
2872599120,11cyclictest0-21swapper/407:11:194
2871899129,2cyclictest0-21swapper/307:20:133
2871899128,2cyclictest0-21swapper/312:03:003
28718991210,1cyclictest15674-21sshd12:29:133
28718991210,1cyclictest0-21swapper/312:22:063
28718991210,1cyclictest0-21swapper/311:12:043
28718991210,1cyclictest0-21swapper/310:49:293
28718991210,1cyclictest0-21swapper/309:31:163
28718991210,1cyclictest0-21swapper/309:22:073
28718991210,1cyclictest0-21swapper/307:35:153
2871899120,1cyclictest660-21dbus-daemon09:40:563
2871899120,1cyclictest13851-21bash11:17:183
2871899120,1cyclictest0-21swapper/312:10:403
2871899120,1cyclictest0-21swapper/312:07:193
2871899120,1cyclictest0-21swapper/309:26:413
2871899120,11cyclictest9701-21sshd10:38:363
2871899120,11cyclictest0-21swapper/312:30:093
28712991210,1cyclictest0-21swapper/212:34:362
28712991210,1cyclictest0-21swapper/210:04:282
28712991210,1cyclictest0-21swapper/209:21:272
28712991210,1cyclictest0-21swapper/209:11:062
2871299120,1cyclictest0-21swapper/212:21:182
2871299120,11cyclictest0-21swapper/212:07:272
2871299120,11cyclictest0-21swapper/211:20:162
2871299120,11cyclictest0-21swapper/208:05:152
2870699123,5cyclictest0-21swapper/107:50:591
2870699122,9cyclictest0-21swapper/108:59:531
28706991210,1cyclictest0-21swapper/110:57:041
28706991210,1cyclictest0-21swapper/110:05:111
2870699120,9cyclictest0-21swapper/108:25:371
2870699120,3cyclictest0-21swapper/107:55:191
2870699120,1cyclictest0-21swapper/111:45:111
2870699120,1cyclictest0-21swapper/111:45:111
2870699120,11cyclictest0-21swapper/112:04:241
2870699120,11cyclictest0-21swapper/111:06:121
2870699120,11cyclictest0-21swapper/110:52:131
2870699120,11cyclictest0-21swapper/110:37:571
28700991210,1cyclictest7176-21grep11:35:210
28700991210,1cyclictest7176-21grep11:35:210
28700991210,1cyclictest0-21swapper/012:10:500
28700991210,1cyclictest0-21swapper/010:43:280
28700991210,1cyclictest0-21swapper/009:44:520
2870099120,1cyclictest0-21swapper/011:42:040
2870099120,1cyclictest0-21swapper/011:42:040
2870099120,1cyclictest0-21swapper/009:30:050
2870099120,11cyclictest29045-21bash10:03:170
2870099120,11cyclictest0-21swapper/012:16:050
2870099120,11cyclictest0-21swapper/011:06:030
96502110,0sleep00-21swapper/011:11:520
2874299119,1cyclictest0-21swapper/711:46:377
2874299119,1cyclictest0-21swapper/711:46:377
2874299118,2cyclictest0-21swapper/709:56:577
2874299114,5cyclictest0-21swapper/709:52:337
2874299110,1cyclictest0-21swapper/711:03:207
2873599119,1cyclictest0-21swapper/612:24:256
2873599119,1cyclictest0-21swapper/612:00:066
2873599110,1cyclictest0-21swapper/612:12:046
2873599110,1cyclictest0-21swapper/611:00:326
2873599110,10cyclictest0-21swapper/611:28:236
2873599110,10cyclictest0-21swapper/609:35:206
2872999119,1cyclictest0-21swapper/512:22:415
2872999119,1cyclictest0-21swapper/511:38:365
2872999119,1cyclictest0-21swapper/511:38:365
2872999119,1cyclictest0-21swapper/510:55:195
2872999110,0cyclictest0-21swapper/510:45:385
2872599119,1cyclictest0-21swapper/411:47:414
2872599119,1cyclictest0-21swapper/411:47:414
2872599119,1cyclictest0-21swapper/411:26:594
2872599110,1cyclictest0-21swapper/408:25:394
2872599110,10cyclictest0-21swapper/409:37:424
2872599110,10cyclictest0-21swapper/409:33:324
2872599110,10cyclictest0-21swapper/407:49:214
2871899119,1cyclictest4683-21cstates09:50:133
2871899118,2cyclictest0-21swapper/312:37:173
2871899118,2cyclictest0-21swapper/311:07:463
2871899110,1cyclictest0-21swapper/309:10:423
2871299119,1cyclictest0-21swapper/211:10:442
2871299119,1cyclictest0-21swapper/211:00:392
2871299110,1cyclictest0-21swapper/209:37:112
2871299110,0cyclictest0-21swapper/210:06:452
2870699119,1cyclictest0-21swapper/111:57:411
2870699118,2cyclictest0-21swapper/109:04:551
2870699117,0cyclictest23454-21grep09:10:071
2870699116,3cyclictest0-21swapper/108:34:031
2870699115,4cyclictest0-21swapper/109:08:331
2870699115,4cyclictest0-21swapper/108:42:331
2870699113,5cyclictest0-21swapper/110:23:391
2870699113,1cyclictest0-21swapper/111:44:131
2870699113,1cyclictest0-21swapper/111:44:131
2870699111,9cyclictest0-21swapper/111:00:291
2870699110,8cyclictest0-21swapper/107:10:401
2870699110,7cyclictest0-21swapper/108:19:111
2870699110,10cyclictest0-21swapper/109:15:571
2870699110,10cyclictest0-21swapper/108:38:051
2870699110,10cyclictest0-21swapper/108:07:321
2870699110,10cyclictest0-21swapper/107:43:371
2870099119,1cyclictest0-21swapper/011:59:490
2870099119,1cyclictest0-21swapper/011:27:080
2870099118,2cyclictest0-21swapper/012:32:120
2870099110,1cyclictest0-21swapper/012:07:290
2870099110,1cyclictest0-21swapper/009:14:040
2870099110,1cyclictest0-21swapper/007:21:350
2870099110,10cyclictest0-21swapper/009:55:290
2870099110,0cyclictest0-21swapper/010:59:200
2874299108,1cyclictest0-21swapper/712:29:387
2874299108,1cyclictest0-21swapper/710:56:377
2874299108,1cyclictest0-21swapper/710:40:217
2874299108,1cyclictest0-21swapper/709:18:147
2874299103,5cyclictest0-21swapper/708:56:437
2874299103,5cyclictest0-21swapper/707:32:257
2874299103,5cyclictest0-21swapper/707:32:257
2874299103,1cyclictest0-21swapper/711:27:397
2874299100,2cyclictest0-21swapper/708:05:167
2874299100,1cyclictest0-21swapper/710:03:247
2873599108,1cyclictest0-21swapper/612:16:226
2873599108,1cyclictest0-21swapper/611:06:206
2873599108,1cyclictest0-21swapper/609:50:396
2873599107,2cyclictest0-21swapper/611:20:116
2873599100,9cyclictest0-21swapper/607:35:116
2872999108,1cyclictest0-21swapper/512:36:565
2872999108,1cyclictest0-21swapper/510:08:095
2872999108,1cyclictest0-21swapper/509:10:135
2872999104,5cyclictest0-21swapper/509:23:155
2872599108,1cyclictest0-21swapper/411:51:024
2872599108,1cyclictest0-21swapper/410:03:064
2872599108,1cyclictest0-21swapper/409:19:494
2872599108,1cyclictest0-21swapper/408:45:014
2872599108,1cyclictest0-21swapper/407:22:374
2872599100,9cyclictest0-21swapper/408:36:004
2871899108,1cyclictest0-21swapper/308:03:053
2871299108,1cyclictest0-21swapper/212:00:442
2871299101,2cyclictest0-21swapper/207:35:122
2871299100,9cyclictest0-21swapper/212:35:182
2870699106,2cyclictest0-21swapper/111:53:221
2870699106,2cyclictest0-21swapper/111:11:271
2870699103,5cyclictest0-21swapper/107:48:291
2870699103,3cyclictest0-21swapper/108:03:101
2870699103,3cyclictest0-21swapper/107:36:071
2870699100,9cyclictest0-21swapper/108:11:201
2870699100,5cyclictest0-21swapper/107:32:331
2870699100,5cyclictest0-21swapper/107:32:331
2870699100,1cyclictest0-21swapper/112:28:441
2870099109,0cyclictest537-40kipmi010:05:140
2870099108,1cyclictest0-21swapper/012:03:100
2870099108,1cyclictest0-21swapper/010:35:320
2870099108,1cyclictest0-21swapper/008:30:080
2870099103,5cyclictest465-21systemd-journal10:50:180
2870099101,5cyclictest30345-21awk08:20:000
2870099101,4cyclictest101rcu_sched09:29:310
2870099101,1cyclictest101rcu_sched12:20:140
2870099100,3cyclictest0-21swapper/008:25:110
2870099100,1cyclictest91rcu_preempt09:45:190
2870099100,1cyclictest91rcu_preempt09:45:190
103742100,1sleep70-21swapper/709:36:477
29608290,1sleep729721-21sshd10:31:537
287429994,4cyclictest0-21swapper/707:40:147
287429993,5cyclictest0-21swapper/708:51:337
287429993,5cyclictest0-21swapper/707:47:207
287429993,5cyclictest0-21swapper/707:10:467
287429992,5cyclictest0-21swapper/708:34:577
287429990,2cyclictest0-21swapper/712:18:507
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional