You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 21:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Nov 29, 2025 12:50:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2410721420,3sleep10-21swapper/107:05:171
25350210168,29sleep60-21swapper/607:07:566
2526429543,46sleep40-21swapper/407:06:424
2329029441,46sleep50-21swapper/507:05:145
2533729057,29sleep20-21swapper/207:07:452
242722840,1sleep62593399cyclictest11:09:276
2535628047,29sleep30-21swapper/307:08:013
2544827945,30sleep00-21swapper/007:09:180
2535127742,30sleep70-21swapper/707:07:577
134312770,0sleep70-21swapper/710:01:147
25930995610,45cyclictest0-21swapper/312:00:143
25927995452,1cyclictest0-21swapper/012:15:400
25929995353,0cyclictest0-21swapper/211:23:572
25928995310,0cyclictest0-21swapper/111:38:191
25927995310,0cyclictest0-21swapper/009:55:190
193392530,0sleep70-21swapper/711:06:177
25930995151,0cyclictest0-21swapper/311:39:193
25928995150,1cyclictest0-21swapper/112:38:381
25934995049,1cyclictest1331-21diskmemload12:00:017
25933994949,0cyclictest0-21swapper/611:45:216
25932994949,0cyclictest0-21swapper/512:14:045
25929994949,0cyclictest0-21swapper/212:09:502
25927994949,0cyclictest0-21swapper/011:05:140
25930994847,0cyclictest0-21swapper/310:20:233
25934994646,0cyclictest0-21swapper/712:36:147
25932994645,0cyclictest0-21swapper/511:38:165
25930994646,0cyclictest0-21swapper/312:14:183
25928994646,0cyclictest0-21swapper/111:55:151
93162450,0sleep50-21swapper/511:49:155
25932994545,0cyclictest0-21swapper/511:31:045
2592999450,44cyclictest0-21swapper/212:25:142
25928994444,0cyclictest0-21swapper/111:15:221
25928994443,0cyclictest0-21swapper/111:41:101
65822430,0sleep30-21swapper/310:45:153
25933994343,0cyclictest0-21swapper/608:25:146
25929994342,1cyclictest0-21swapper/211:02:512
25929994342,0cyclictest0-21swapper/212:34:562
25929994342,0cyclictest0-21swapper/212:15:182
25934994242,0cyclictest0-21swapper/711:35:157
25934994242,0cyclictest0-21swapper/711:30:047
25930994242,0cyclictest0-21swapper/312:38:053
25930994242,0cyclictest0-21swapper/312:32:213
25930994242,0cyclictest0-21swapper/312:22:443
25930994241,0cyclictest0-21swapper/311:00:003
25934994141,0cyclictest0-21swapper/712:28:527
2593499410,0cyclictest0-21swapper/712:23:067
25933994140,1cyclictest0-21swapper/611:23:576
2593399410,0cyclictest0-21swapper/612:10:236
2593199410,0cyclictest0-21swapper/411:20:024
25928994140,0cyclictest0-21swapper/112:22:201
25928994140,0cyclictest0-21swapper/111:45:241
25927994141,0cyclictest0-21swapper/009:25:160
25927994139,1cyclictest0-21swapper/009:30:130
25934994040,0cyclictest0-21swapper/711:40:237
25933994040,0cyclictest0-21swapper/612:20:226
25933994040,0cyclictest0-21swapper/609:15:126
25932994040,0cyclictest0-21swapper/512:38:385
25930994040,0cyclictest0-21swapper/311:45:183
25929994010,29cyclictest0-21swapper/209:20:162
25929994010,29cyclictest0-21swapper/209:20:162
25928994039,1cyclictest0-21swapper/111:20:221
2592899400,0cyclictest0-21swapper/110:25:181
25927994039,0cyclictest0-21swapper/012:07:370
25927994039,0cyclictest0-21swapper/010:45:180
25927994038,1cyclictest0-21swapper/012:23:490
25933993939,0cyclictest0-21swapper/610:30:146
25932993939,0cyclictest0-21swapper/512:06:575
25930993939,0cyclictest0-21swapper/312:26:323
25930993939,0cyclictest0-21swapper/310:50:223
25930993939,0cyclictest0-21swapper/310:15:223
25929993939,0cyclictest0-21swapper/212:23:222
25929993939,0cyclictest0-21swapper/212:01:252
25929993938,0cyclictest0-21swapper/211:56:212
25928993939,0cyclictest0-21swapper/111:05:151
25927993938,1cyclictest0-21swapper/011:55:170
2593499380,0cyclictest0-21swapper/711:16:227
25933993838,0cyclictest0-21swapper/612:32:326
25933993837,1cyclictest0-21swapper/611:40:026
25932993837,1cyclictest0-21swapper/511:55:155
25928993838,0cyclictest0-21swapper/112:06:051
25928993836,1cyclictest0-21swapper/112:12:501
25933993737,0cyclictest0-21swapper/612:39:136
25932993737,0cyclictest0-21swapper/510:56:325
25932993735,1cyclictest0-21swapper/511:15:225
25931993737,0cyclictest0-21swapper/412:17:594
25930993737,0cyclictest0-21swapper/312:07:563
25930993736,1cyclictest0-21swapper/310:25:233
25930993736,0cyclictest0-21swapper/312:19:053
25930993736,0cyclictest0-21swapper/311:55:183
2592899370,0cyclictest0-21swapper/111:52:121
25927993737,0cyclictest0-21swapper/012:36:120
25927993737,0cyclictest0-21swapper/012:31:560
25927993737,0cyclictest0-21swapper/012:27:480
25927993736,0cyclictest0-21swapper/011:15:120
25934993636,0cyclictest0-21swapper/712:30:057
25934993636,0cyclictest0-21swapper/712:10:247
25934993635,0cyclictest0-21swapper/708:20:127
25932993636,0cyclictest0-21swapper/512:25:155
25931993635,0cyclictest0-21swapper/412:35:224
25931993635,0cyclictest0-21swapper/412:05:134
25929993635,0cyclictest0-21swapper/210:40:002
25929993634,1cyclictest0-21swapper/212:13:502
2592999360,0cyclictest0-21swapper/210:25:182
25928993635,0cyclictest0-21swapper/112:15:401
25928993610,26cyclictest0-21swapper/111:01:091
25927993636,0cyclictest0-21swapper/010:56:070
25933993535,0cyclictest0-21swapper/612:09:506
25933993535,0cyclictest0-21swapper/611:50:496
25932993535,0cyclictest0-21swapper/509:20:005
25931993535,0cyclictest0-21swapper/411:50:144
25931993535,0cyclictest0-21swapper/411:32:144
25931993535,0cyclictest0-21swapper/410:57:484
25931993534,0cyclictest0-21swapper/411:45:574
25930993535,0cyclictest0-21swapper/311:23:373
2593099350,0cyclictest0-21swapper/311:02:513
25928993535,0cyclictest0-21swapper/110:35:171
25927993535,0cyclictest0-21swapper/012:14:040
25927993534,1cyclictest0-21swapper/011:25:010
25927993534,0cyclictest0-21swapper/009:35:190
25933993434,0cyclictest0-21swapper/611:19:506
25932993434,0cyclictest0-21swapper/512:15:185
25932993434,0cyclictest0-21swapper/511:27:495
25932993434,0cyclictest0-21swapper/511:08:215
25931993434,0cyclictest0-21swapper/412:23:104
25931993434,0cyclictest0-21swapper/410:00:224
25931993434,0cyclictest0-21swapper/409:55:194
25931993433,1cyclictest0-21swapper/410:15:014
25930993434,0cyclictest0-21swapper/311:34:033
25930993433,0cyclictest0-21swapper/311:18:263
25930993433,0cyclictest0-21swapper/310:30:203
25929993433,0cyclictest0-21swapper/211:27:542
25929993432,1cyclictest1331-21diskmemload11:15:192
25929993432,1cyclictest0-21swapper/209:35:142
25928993433,0cyclictest0-21swapper/111:26:571
25927993434,0cyclictest0-21swapper/009:10:160
25927993432,1cyclictest0-21swapper/007:40:130
2593499330,33cyclictest0-21swapper/711:50:127
25932993333,0cyclictest0-21swapper/511:41:105
25932993333,0cyclictest0-21swapper/511:24:115
25932993333,0cyclictest0-21swapper/510:25:185
25932993332,1cyclictest1728-21ssh12:00:235
25932993331,1cyclictest128922sleep511:50:185
25931993333,0cyclictest0-21swapper/410:40:134
25931993333,0cyclictest0-21swapper/409:40:154
25931993332,0cyclictest0-21swapper/412:26:564
2593199330,0cyclictest0-21swapper/412:14:324
25929993333,0cyclictest0-21swapper/211:40:242
2592799330,0cyclictest0-21swapper/008:30:110
25934993232,0cyclictest0-21swapper/708:55:127
25934993232,0cyclictest0-21swapper/707:20:147
25933993232,0cyclictest0-21swapper/611:27:126
25933993232,0cyclictest0-21swapper/609:55:186
25933993231,0cyclictest0-21swapper/612:25:146
25932993231,1cyclictest0-21swapper/512:22:205
25929993232,0cyclictest0-21swapper/211:06:522
25929993231,0cyclictest0-21swapper/212:35:132
25929993230,1cyclictest0-21swapper/209:30:122
25934993131,0cyclictest0-21swapper/712:00:047
25933993131,0cyclictest0-21swapper/609:35:226
25933993131,0cyclictest0-21swapper/609:05:156
25931993129,1cyclictest0-21swapper/411:05:144
25930993131,0cyclictest0-21swapper/309:50:233
25930993129,1cyclictest0-21swapper/311:43:233
25927993130,1cyclictest0-21swapper/011:43:230
25934993030,0cyclictest0-21swapper/711:12:197
25933993030,0cyclictest0-21swapper/611:37:166
25932993030,0cyclictest0-21swapper/510:15:015
25931993030,0cyclictest0-21swapper/410:35:004
25929993029,0cyclictest0-21swapper/211:35:002
25929993029,0cyclictest0-21swapper/210:05:222
25928993029,0cyclictest0-21swapper/112:27:521
25934992929,0cyclictest0-21swapper/712:17:337
25933992929,0cyclictest0-21swapper/612:15:186
25933992929,0cyclictest0-21swapper/611:02:516
25933992929,0cyclictest0-21swapper/609:45:166
25931992929,0cyclictest1331-21diskmemload10:05:174
25931992927,1cyclictest0-21swapper/409:35:134
25930992929,0cyclictest0-21swapper/309:45:123
25929992929,0cyclictest0-21swapper/208:05:132
25929992928,0cyclictest0-21swapper/211:32:462
25929992927,1cyclictest0-21swapper/211:50:222
25928992928,0cyclictest0-21swapper/110:15:141
25934992828,0cyclictest0-21swapper/712:05:397
25934992828,0cyclictest0-21swapper/711:24:027
25933992828,0cyclictest0-21swapper/611:55:106
25931992827,1cyclictest0-21swapper/411:13:314
25931992827,0cyclictest0-21swapper/410:20:184
25927992828,0cyclictest0-21swapper/011:04:360
25927992826,1cyclictest0-21swapper/007:35:170
25934992727,0cyclictest0-21swapper/711:05:007
25934992727,0cyclictest0-21swapper/710:35:137
25933992726,1cyclictest0-21swapper/612:01:256
25932992727,0cyclictest0-21swapper/509:50:175
25931992727,0cyclictest0-21swapper/411:39:044
25931992727,0cyclictest0-21swapper/411:29:514
25931992727,0cyclictest0-21swapper/410:30:124
25930992727,0cyclictest0-21swapper/311:50:523
25933992626,0cyclictest0-21swapper/609:20:166
25933992626,0cyclictest0-21swapper/609:20:166
25933992624,1cyclictest30885-21ls10:25:186
25932992626,0cyclictest0-21swapper/510:35:175
25931992626,0cyclictest0-21swapper/410:10:224
25930992626,0cyclictest0-21swapper/311:10:153
25930992625,1cyclictest24498-21apt-get11:25:153
25929992625,1cyclictest0-21swapper/208:45:132
25929992625,1cyclictest0-21swapper/208:45:132
25928992626,0cyclictest0-21swapper/110:57:491
25928992626,0cyclictest0-21swapper/110:00:131
25928992625,1cyclictest0-21swapper/108:25:131
25927992625,0cyclictest0-21swapper/011:30:040
25927992624,1cyclictest0-21swapper/007:10:110
25934992524,0cyclictest24370-21ls09:20:157
25934992524,0cyclictest24370-21ls09:20:157
2593399250,0cyclictest0-21swapper/611:10:236
25932992525,0cyclictest0-21swapper/511:00:225
25931992525,0cyclictest0-21swapper/408:35:134
25927992525,0cyclictest0-21swapper/011:52:340
25927992525,0cyclictest0-21swapper/011:20:120
25934992424,0cyclictest0-21swapper/711:47:467
25932992424,0cyclictest0-21swapper/511:10:295
25931992424,0cyclictest71450irq/122-eth011:59:414
25931992423,1cyclictest71450irq/122-eth012:31:134
2593199240,0cyclictest0-21swapper/408:45:124
2593199240,0cyclictest0-21swapper/408:45:124
25929992424,0cyclictest0-21swapper/211:45:242
25928992424,0cyclictest0-21swapper/111:32:141
25927992424,0cyclictest0-21swapper/012:02:220
25927992424,0cyclictest0-21swapper/011:35:150
2592799240,0cyclictest0-21swapper/010:37:140
745122310,0sleep70-21swapper/709:27:537
25934992322,1cyclictest0-21swapper/710:20:237
25933992322,1cyclictest0-21swapper/610:40:016
25932992323,0cyclictest0-21swapper/510:05:135
25932992323,0cyclictest0-21swapper/509:25:125
25930992323,0cyclictest0-21swapper/311:09:023
25928992323,0cyclictest0-21swapper/110:40:131
25928992323,0cyclictest0-21swapper/109:55:191
25928992323,0cyclictest0-21swapper/109:50:171
25928992323,0cyclictest0-21swapper/109:40:161
25928992323,0cyclictest0-21swapper/108:54:461
25928992310,6cyclictest0-21swapper/108:15:161
172222310,0sleep50-21swapper/512:32:305
1136022310,0sleep10-21swapper/110:31:211
25934992222,0cyclictest0-21swapper/711:25:187
25934992219,2cyclictest23113-21nscd10:43:467
25933992222,0cyclictest0-21swapper/610:05:186
25933992222,0cyclictest0-21swapper/608:15:126
25932992222,0cyclictest0-21swapper/510:00:215
25931992222,0cyclictest0-21swapper/407:50:134
25930992222,0cyclictest0-21swapper/310:00:173
25930992210,6cyclictest0-21swapper/308:40:223
25929992222,0cyclictest0-21swapper/210:40:172
25929992222,0cyclictest0-21swapper/209:15:122
25929992222,0cyclictest0-21swapper/207:50:132
25929992210,7cyclictest0-21swapper/209:50:512
25929992210,0cyclictest0-21swapper/208:00:182
2592899220,22cyclictest0-21swapper/110:50:221
25934992110,0cyclictest0-21swapper/707:10:167
25932992110,7cyclictest0-21swapper/509:30:015
25931992120,1cyclictest0-21swapper/409:25:164
25930992121,0cyclictest0-21swapper/310:37:143
25930992110,4cyclictest0-21swapper/307:20:223
25930992110,2cyclictest0-21swapper/309:26:373
25930992110,0cyclictest0-21swapper/308:25:233
25929992120,1cyclictest658-21ptp4l09:46:472
25927992121,0cyclictest0-21swapper/011:45:500
25927992120,1cyclictest0-21swapper/010:15:230
25934992020,0cyclictest0-21swapper/710:55:137
25934992010,6cyclictest0-21swapper/707:35:257
25934992010,5cyclictest0-21swapper/708:25:237
25933992010,4cyclictest0-21swapper/610:41:356
25932992010,3cyclictest0-21swapper/508:30:155
25932992010,10cyclictest0-21swapper/509:55:195
25931992010,6cyclictest0-21swapper/408:30:154
25931992010,4cyclictest0-21swapper/411:00:174
25930992020,0cyclictest0-21swapper/310:40:233
25930992015,3cyclictest0-21swapper/309:23:023
25930992015,3cyclictest0-21swapper/309:23:023
25930992013,5cyclictest30098-21perf08:10:003
25930992011,6cyclictest15111-21grep08:35:213
25930992010,5cyclictest0-21swapper/307:35:163
25930992010,4cyclictest0-21swapper/308:10:193
25930992010,4cyclictest0-21swapper/307:45:213
25929992018,1cyclictest0-21swapper/207:10:122
25929992010,6cyclictest0-21swapper/209:12:382
25929992010,0cyclictest0-21swapper/210:32:142
25929992010,0cyclictest0-21swapper/207:25:212
25928992014,6cyclictest9307-21nscd09:30:051
25928992010,9cyclictest0-21swapper/112:02:001
25928992010,6cyclictest0-21swapper/107:35:201
25928992010,5cyclictest0-21swapper/109:17:341
25928992010,4cyclictest0-21swapper/107:55:011
25928992010,2cyclictest0-21swapper/107:50:171
25928992010,2cyclictest0-21swapper/107:25:161
25927992010,3cyclictest0-21swapper/009:49:420
25927992010,3cyclictest0-21swapper/008:05:220
25927992010,1cyclictest0-21swapper/010:11:110
1326822010,0sleep00-21swapper/010:01:090
25934991918,0cyclictest0-21swapper/710:45:227
25934991913,6cyclictest765-21gmain09:35:497
25934991910,7cyclictest0-21swapper/709:48:197
25934991910,2cyclictest0-21swapper/710:25:187
25934991910,2cyclictest0-21swapper/708:10:237
25934991910,0cyclictest0-21swapper/709:05:237
25933991914,2cyclictest0-21swapper/608:45:176
25933991914,2cyclictest0-21swapper/608:45:176
25933991910,4cyclictest0-21swapper/609:25:166
25933991910,4cyclictest0-21swapper/607:30:176
25933991910,3cyclictest0-21swapper/608:20:206
25933991910,2cyclictest0-21swapper/609:10:216
25932991910,6cyclictest0-21swapper/510:43:515
25932991910,4cyclictest0-21swapper/510:30:175
25931991919,0cyclictest0-21swapper/407:15:124
25931991918,1cyclictest0-21swapper/410:45:184
25931991910,5cyclictest0-21swapper/407:30:114
25930991919,0cyclictest0-21swapper/310:10:183
25930991910,7cyclictest0-21swapper/309:12:303
25930991910,6cyclictest0-21swapper/310:05:363
25930991910,4cyclictest0-21swapper/309:35:223
25930991910,4cyclictest0-21swapper/309:30:023
25930991910,4cyclictest0-21swapper/307:15:143
25930991910,3cyclictest0-21swapper/309:58:223
25930991910,3cyclictest0-21swapper/307:40:213
25930991910,3cyclictest0-21swapper/307:25:213
25929991919,0cyclictest0-21swapper/210:55:172
25929991919,0cyclictest0-21swapper/210:10:182
25929991919,0cyclictest0-21swapper/209:55:142
25929991913,1cyclictest27639-21kworker/u16:110:24:412
25929991911,5cyclictest0-21swapper/207:45:162
25929991910,4cyclictest0-21swapper/207:20:182
25929991910,3cyclictest0-21swapper/210:50:332
25929991910,3cyclictest0-21swapper/209:41:052
25929991910,2cyclictest0-21swapper/210:03:432
25929991910,0cyclictest0-21swapper/210:16:012
25928991918,1cyclictest0-21swapper/110:05:171
25928991910,7cyclictest3419-21latency09:10:161
25928991910,4cyclictest0-21swapper/109:24:181
25928991910,4cyclictest0-21swapper/109:24:181
25928991910,3cyclictest0-21swapper/109:00:221
25928991910,3cyclictest0-21swapper/108:35:011
25928991910,2cyclictest0-21swapper/107:15:171
25927991919,0cyclictest99-21kswapd010:20:130
25927991919,0cyclictest0-21swapper/008:35:010
25927991913,1cyclictest24462-21nscd09:41:170
25927991910,9cyclictest0-21swapper/010:07:470
25927991910,7cyclictest0-21swapper/010:25:140
25927991910,6cyclictest0-21swapper/007:20:160
25927991910,5cyclictest0-21swapper/007:50:220
25927991910,3cyclictest0-21swapper/007:15:170
1706321910,0sleep30-21swapper/309:16:453
945121810,0sleep10-21swapper/110:45:531
25934991818,0cyclictest0-21swapper/710:15:227
25934991818,0cyclictest0-21swapper/708:40:137
25934991814,4cyclictest765-21gmain10:50:137
25934991810,7cyclictest0-21swapper/710:05:227
25934991810,6cyclictest0-21swapper/709:00:167
25934991810,4cyclictest0-21swapper/709:16:557
25934991810,3cyclictest0-21swapper/709:50:067
25934991810,3cyclictest0-21swapper/707:25:197
25934991810,2cyclictest0-21swapper/709:55:237
25934991810,2cyclictest0-21swapper/708:00:177
25934991810,1cyclictest0-21swapper/709:10:207
25934991810,1cyclictest0-21swapper/708:35:217
25933991818,0cyclictest0-21swapper/611:30:136
25933991816,1cyclictest11704-21apt-get09:30:126
25933991810,5cyclictest0-21swapper/610:00:496
25933991810,5cyclictest0-21swapper/609:50:036
25933991810,4cyclictest0-21swapper/610:56:446
25933991810,3cyclictest0-21swapper/610:16:266
25933991810,3cyclictest0-21swapper/607:25:216
25933991810,2cyclictest0-21swapper/610:10:036
25933991810,2cyclictest0-21swapper/608:50:226
25932991810,5cyclictest0-21swapper/510:14:275
25932991810,5cyclictest0-21swapper/509:45:205
25932991810,3cyclictest0-21swapper/508:00:225
25932991810,1cyclictest0-21swapper/508:50:225
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional