You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 16:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Nov 30, 2025 12:50:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
348328754,29sleep60-21swapper/607:09:326
345328368,10sleep30-21swapper/307:09:053
342228353,26sleep10-21swapper/107:08:381
326027944,30sleep70-21swapper/707:06:217
331427743,30sleep40-21swapper/407:07:064
352227642,30sleep20-21swapper/207:10:012
90927338,31sleep50-21swapper/507:05:055
326227238,29sleep00-21swapper/007:06:220
3957995749,7cyclictest0-21swapper/712:10:227
3953995353,0cyclictest0-21swapper/312:03:353
3957995252,0cyclictest0-21swapper/711:30:147
20472520,0sleep70-21swapper/710:38:137
3952995150,0cyclictest0-21swapper/212:20:172
3951995110,0cyclictest0-21swapper/111:21:521
103432510,0sleep70-21swapper/710:41:507
3955995010,40cyclictest0-21swapper/511:40:345
3951995010,0cyclictest0-21swapper/110:35:131
3956994948,0cyclictest0-21swapper/611:27:546
3954994910,38cyclictest0-21swapper/410:00:144
3956994847,0cyclictest0-21swapper/611:32:376
3952994847,0cyclictest0-21swapper/211:40:122
3952994810,37cyclictest0-21swapper/212:03:022
3957994746,0cyclictest0-21swapper/712:18:227
3955994747,0cyclictest0-21swapper/511:35:245
3952994747,0cyclictest0-21swapper/212:28:022
3952994747,0cyclictest0-21swapper/209:40:202
3952994746,0cyclictest0-21swapper/212:17:362
3950994745,1cyclictest0-21swapper/012:30:150
214682470,0sleep665-21ksoftirqd/610:15:466
3957994646,0cyclictest0-21swapper/712:35:227
3956994646,0cyclictest0-21swapper/612:31:046
3956994646,0cyclictest0-21swapper/612:25:516
3954994646,0cyclictest0-21swapper/411:20:204
3954994645,0cyclictest0-21swapper/409:45:164
3954994610,0cyclictest0-21swapper/411:35:134
3953994646,0cyclictest0-21swapper/311:46:313
3952994645,0cyclictest0-21swapper/212:36:112
3956994545,0cyclictest0-21swapper/611:51:116
3956994511,1cyclictest17630-21grep10:45:186
3955994545,0cyclictest0-21swapper/512:01:545
3952994545,0cyclictest0-21swapper/210:40:162
173112450,0sleep10-21swapper/112:19:521
3957994444,0cyclictest0-21swapper/712:30:487
3956994444,0cyclictest0-21swapper/612:01:366
3951994443,0cyclictest11765-21diskmemload11:52:271
3956994343,0cyclictest0-21swapper/610:20:186
395599430,0cyclictest0-21swapper/512:20:175
3952994343,0cyclictest0-21swapper/212:10:172
3952994342,0cyclictest0-21swapper/211:48:332
395299430,0cyclictest0-21swapper/211:35:442
395199430,1cyclictest0-21swapper/111:55:161
3957994210,32cyclictest0-21swapper/711:42:287
3956994210,32cyclictest0-21swapper/611:47:056
3954994241,0cyclictest0-21swapper/410:35:134
3953994242,0cyclictest0-21swapper/312:25:413
3953994210,32cyclictest0-21swapper/312:21:423
3953994210,32cyclictest0-21swapper/311:51:283
3950994242,0cyclictest0-21swapper/011:07:250
3955994141,0cyclictest0-21swapper/509:40:205
3955994141,0cyclictest0-21swapper/508:05:135
3955994136,4cyclictest0-21swapper/512:19:595
3954994141,0cyclictest0-21swapper/411:28:254
3953994141,0cyclictest0-21swapper/308:20:123
395299410,41cyclictest0-21swapper/211:58:122
3950994141,0cyclictest0-21swapper/011:59:200
3950994141,0cyclictest0-21swapper/010:05:180
3950994140,1cyclictest0-21swapper/012:35:550
3950994140,0cyclictest0-21swapper/012:02:010
3956994040,0cyclictest0-21swapper/612:13:396
3956994040,0cyclictest0-21swapper/611:55:146
3956994040,0cyclictest0-21swapper/611:10:306
3956994040,0cyclictest0-21swapper/609:55:226
3954994010,0cyclictest0-21swapper/411:15:114
3953994039,0cyclictest0-21swapper/309:05:043
3953994039,0cyclictest0-21swapper/309:05:043
3951994040,0cyclictest0-21swapper/112:28:221
3951994039,0cyclictest0-21swapper/109:55:221
3957993939,0cyclictest0-21swapper/711:50:007
3956993939,0cyclictest0-21swapper/612:22:316
395699390,39cyclictest0-21swapper/611:41:046
3955993939,0cyclictest0-21swapper/512:36:115
3955993938,0cyclictest0-21swapper/511:52:115
3955993938,0cyclictest0-21swapper/507:10:015
395599390,38cyclictest6972-21load10:40:165
3954993910,1cyclictest71450irq/122-eth012:20:174
3953993939,0cyclictest0-21swapper/311:41:483
3952993939,0cyclictest0-21swapper/210:05:232
3951993938,0cyclictest9493-21ls10:10:171
395199390,38cyclictest0-21swapper/109:15:141
3950993939,0cyclictest0-21swapper/011:00:140
3950993939,0cyclictest0-21swapper/009:30:120
3956993838,0cyclictest0-21swapper/612:37:076
3956993838,0cyclictest0-21swapper/611:08:566
3954993837,1cyclictest0-21swapper/412:07:434
3953993838,0cyclictest0-21swapper/310:00:143
395399380,0cyclictest0-21swapper/311:39:483
3952993838,0cyclictest0-21swapper/211:23:392
3952993810,26cyclictest0-21swapper/209:20:152
3951993838,0cyclictest0-21swapper/112:09:431
3951993838,0cyclictest0-21swapper/109:50:111
3951993838,0cyclictest0-21swapper/108:00:131
3951993837,0cyclictest0-21swapper/112:10:231
3950993838,0cyclictest0-21swapper/012:12:090
3950993838,0cyclictest0-21swapper/011:52:260
3950993838,0cyclictest0-21swapper/011:33:100
3950993838,0cyclictest0-21swapper/010:50:150
3950993838,0cyclictest0-21swapper/008:25:130
395099380,0cyclictest0-21swapper/012:27:270
3957993737,0cyclictest0-21swapper/711:20:197
3957993736,0cyclictest0-21swapper/709:45:167
395699370,0cyclictest25954-21apt-get07:45:126
3955993737,0cyclictest0-21swapper/512:10:175
3954993736,1cyclictest0-21swapper/412:30:004
3953993737,0cyclictest0-21swapper/309:20:163
3952993729,7cyclictest0-21swapper/210:25:222
3951993737,0cyclictest0-21swapper/112:02:081
3951993736,0cyclictest0-21swapper/112:35:151
3950993737,0cyclictest0-21swapper/011:40:470
3950993736,0cyclictest0-21swapper/009:50:200
3957993636,0cyclictest0-21swapper/711:58:337
3955993636,0cyclictest0-21swapper/511:58:125
3955993636,0cyclictest0-21swapper/511:48:335
3954993636,0cyclictest0-21swapper/411:40:054
3954993636,0cyclictest0-21swapper/411:30:164
3953993610,26cyclictest0-21swapper/311:59:303
3952993636,0cyclictest0-21swapper/209:55:172
3951993636,0cyclictest0-21swapper/112:30:221
3951993636,0cyclictest0-21swapper/111:05:481
3956993535,0cyclictest0-21swapper/612:16:556
3956993535,0cyclictest0-21swapper/611:01:186
3956993535,0cyclictest0-21swapper/610:50:236
3956993533,1cyclictest0-21swapper/609:10:016
3956993533,1cyclictest0-21swapper/609:10:006
3955993531,3cyclictest0-21swapper/509:20:205
3954993535,0cyclictest0-21swapper/412:27:154
3954993535,0cyclictest0-21swapper/412:15:474
3953993535,0cyclictest0-21swapper/312:05:293
3952993510,10cyclictest0-21swapper/207:45:212
3951993535,0cyclictest0-21swapper/111:47:121
3951993535,0cyclictest0-21swapper/111:42:021
3957993434,0cyclictest0-21swapper/712:20:257
3955993433,0cyclictest0-21swapper/511:15:005
3955993431,3cyclictest0-21swapper/512:30:515
3954993434,0cyclictest0-21swapper/411:58:584
3954993432,1cyclictest0-21swapper/411:10:144
3953993434,0cyclictest0-21swapper/312:15:343
3953993434,0cyclictest0-21swapper/311:26:323
3953993434,0cyclictest0-21swapper/309:10:163
3952993429,5cyclictest0-21swapper/211:00:242
3951993434,0cyclictest0-21swapper/110:50:001
3951993433,0cyclictest14808-21ls11:30:211
3950993434,0cyclictest0-21swapper/012:19:430
3950993434,0cyclictest0-21swapper/009:40:150
3950993433,0cyclictest0-21swapper/009:45:110
3957993333,0cyclictest0-21swapper/707:50:137
3957993332,0cyclictest0-21swapper/711:15:117
3955993333,0cyclictest0-21swapper/510:05:235
3955993333,0cyclictest0-21swapper/509:15:185
395599330,0cyclictest0-21swapper/510:20:145
3954993333,0cyclictest0-21swapper/411:45:004
3952993332,0cyclictest0-21swapper/212:06:192
3951993333,0cyclictest0-21swapper/111:19:481
3950993333,0cyclictest0-21swapper/010:55:130
395099330,1cyclictest18207-21apt-get12:20:110
3957993232,0cyclictest0-21swapper/711:28:257
3956993232,0cyclictest0-21swapper/609:35:116
3955993232,0cyclictest0-21swapper/512:27:365
3955993232,0cyclictest0-21swapper/511:23:405
3954993232,0cyclictest0-21swapper/412:37:444
3954993232,0cyclictest0-21swapper/411:52:274
3954993231,1cyclictest0-21swapper/410:15:114
3953993232,0cyclictest0-21swapper/312:37:023
3953993231,1cyclictest11765-21diskmemload12:33:003
3953993230,1cyclictest0-21swapper/312:10:183
395399320,0cyclictest0-21swapper/311:15:343
3952993232,0cyclictest0-21swapper/211:15:132
3951993231,1cyclictest0-21swapper/111:25:171
3951993231,0cyclictest0-21swapper/111:00:141
3950993231,0cyclictest0-21swapper/012:05:150
3957993131,0cyclictest0-21swapper/712:25:537
3956993130,1cyclictest0-21swapper/609:50:206
3955993131,0cyclictest0-21swapper/511:14:055
395599310,0cyclictest0-21swapper/510:50:145
3953993131,0cyclictest0-21swapper/310:25:223
3953993130,1cyclictest7083-21ls10:40:163
3952993110,11cyclictest0-21swapper/208:05:012
3950993131,0cyclictest0-21swapper/010:20:010
3956993030,0cyclictest0-21swapper/611:23:286
3956993030,0cyclictest0-21swapper/609:00:126
3955993030,0cyclictest0-21swapper/510:30:185
3955993030,0cyclictest0-21swapper/509:55:185
3954993029,0cyclictest0-21swapper/409:40:004
3952993030,0cyclictest0-21swapper/211:53:282
3952993029,1cyclictest0-21swapper/211:34:312
3952993011,18cyclictest121rcu_preempt09:30:362
3952993011,17cyclictest121rcu_preempt10:23:122
3952993010,18cyclictest0-21swapper/210:50:222
3952993010,18cyclictest0-21swapper/210:12:222
3952993010,17cyclictest0-21swapper/211:07:182
3957992929,0cyclictest28098-21sendmail-msp10:20:017
3956992929,0cyclictest0-21swapper/611:35:216
3956992929,0cyclictest0-21swapper/609:30:196
3955992928,0cyclictest0-21swapper/512:08:425
3954992929,0cyclictest0-21swapper/412:14:204
3954992928,0cyclictest0-21swapper/410:45:234
3954992928,0cyclictest0-21swapper/409:15:144
3953992929,0cyclictest0-21swapper/310:10:153
3953992929,0cyclictest0-21swapper/307:20:173
3952992911,16cyclictest121rcu_preempt11:13:292
3952992911,16cyclictest121rcu_preempt09:54:192
3952992911,13cyclictest121rcu_preempt11:29:382
3952992910,4cyclictest0-21swapper/210:39:292
3952992910,4cyclictest0-21swapper/209:25:512
3952992910,18cyclictest15922-21dpkg12:35:012
3952992910,17cyclictest121rcu_preempt10:47:232
3952992910,17cyclictest121rcu_preempt10:19:032
3951992929,0cyclictest0-21swapper/112:23:311
3951992929,0cyclictest0-21swapper/111:35:141
3951992929,0cyclictest0-21swapper/110:25:221
3950992929,0cyclictest0-21swapper/011:45:160
3954992828,0cyclictest0-21swapper/409:55:224
3954992826,1cyclictest0-21swapper/410:10:174
3952992828,0cyclictest0-21swapper/209:15:172
3952992815,11cyclictest121rcu_preempt07:30:182
3952992811,15cyclictest121rcu_preempt08:30:142
3952992810,11cyclictest0-21swapper/208:05:172
3957992727,0cyclictest0-21swapper/712:07:427
3957992727,0cyclictest0-21swapper/711:07:257
3957992727,0cyclictest0-21swapper/710:30:157
3955992727,0cyclictest0-21swapper/510:45:185
3954992727,0cyclictest0-21swapper/409:50:124
3954992727,0cyclictest0-21swapper/408:00:134
3952992714,11cyclictest121rcu_preempt09:45:542
3952992711,13cyclictest121rcu_preempt10:32:522
3952992710,16cyclictest0-21swapper/209:05:222
3952992710,16cyclictest0-21swapper/209:05:222
3952992710,16cyclictest0-21swapper/208:50:212
3952992710,16cyclictest0-21swapper/208:45:012
3952992710,16cyclictest0-21swapper/208:45:002
3952992710,15cyclictest0-21swapper/210:00:272
3952992710,15cyclictest0-21swapper/209:35:182
3952992710,13cyclictest0-21swapper/210:55:152
3950992727,0cyclictest0-21swapper/010:30:280
3957992626,0cyclictest0-21swapper/709:05:047
3957992626,0cyclictest0-21swapper/709:05:047
3956992626,0cyclictest0-21swapper/612:07:396
3956992626,0cyclictest0-21swapper/609:10:206
3956992625,1cyclictest14475-21apt-get08:20:136
3955992626,0cyclictest0-21swapper/510:25:135
3955992626,0cyclictest0-21swapper/509:50:155
3954992626,0cyclictest0-21swapper/412:02:084
3953992626,0cyclictest0-21swapper/311:00:243
3953992626,0cyclictest0-21swapper/309:15:193
3952992610,15cyclictest0-21swapper/207:50:152
3950992626,0cyclictest0-21swapper/010:10:120
395799250,25cyclictest0-21swapper/711:45:167
3956992525,0cyclictest0-21swapper/610:40:266
3955992525,0cyclictest21865-21apt-get09:30:115
3955992523,2cyclictest0-21swapper/511:00:245
3954992525,0cyclictest0-21swapper/411:05:484
3953992523,1cyclictest20054-21munin-run09:45:013
3952992510,6cyclictest0-21swapper/208:45:172
3952992510,15cyclictest0-21swapper/207:10:172
3952992510,14cyclictest121rcu_preempt09:13:112
3952992510,14cyclictest0-21swapper/207:30:012
3952992510,13cyclictest0-21swapper/208:55:202
3952992510,13cyclictest0-21swapper/208:20:002
3952992510,12cyclictest0-21swapper/207:40:192
3951992525,0cyclictest0-21swapper/109:10:121
3951992524,0cyclictest0-21swapper/109:45:121
3950992524,0cyclictest9130-21apt-get09:55:140
3957992424,0cyclictest0-21swapper/711:10:147
3956992424,0cyclictest0-21swapper/610:55:116
3956992424,0cyclictest0-21swapper/610:05:196
3952992413,5cyclictest121rcu_preempt07:35:202
3952992410,3cyclictest0-21swapper/207:55:152
3952992410,3cyclictest0-21swapper/207:55:142
3952992410,12cyclictest0-21swapper/208:25:162
3951992424,0cyclictest0-21swapper/111:10:171
3951992424,0cyclictest0-21swapper/110:55:221
3950992424,0cyclictest1415-21ls09:35:160
3950992424,0cyclictest0-21swapper/010:44:270
3950992424,0cyclictest0-21swapper/008:45:130
3957992323,0cyclictest0-21swapper/709:35:197
3956992310,4cyclictest0-21swapper/607:55:176
3956992310,4cyclictest0-21swapper/607:55:166
395599239,12cyclictest0-21swapper/511:05:355
395599239,11cyclictest0-21swapper/507:55:225
395599239,11cyclictest0-21swapper/507:55:215
395599235,17cyclictest13147-21ntpq09:25:165
3955992323,0cyclictest0-21swapper/511:34:315
3954992323,0cyclictest0-21swapper/410:50:014
3954992322,0cyclictest0-21swapper/407:15:134
3954992310,5cyclictest0-21swapper/407:55:224
3954992310,5cyclictest0-21swapper/407:55:224
3953992323,0cyclictest0-21swapper/311:20:483
3953992323,0cyclictest0-21swapper/308:05:133
3953992310,8cyclictest0-21swapper/309:49:493
3953992310,7cyclictest0-21swapper/311:07:473
3952992310,12cyclictest121rcu_preempt08:20:182
3952992310,12cyclictest0-21swapper/209:00:162
3952992310,12cyclictest0-21swapper/208:35:152
3951992323,0cyclictest0-21swapper/109:05:131
3951992323,0cyclictest0-21swapper/109:05:121
3950992323,0cyclictest0-21swapper/011:25:170
3950992323,0cyclictest0-21swapper/011:21:470
3950992323,0cyclictest0-21swapper/009:20:150
3950992322,0cyclictest0-21swapper/008:05:130
3073122310,0sleep70-21swapper/710:51:287
577222210,0sleep40-21swapper/410:24:504
3956992222,0cyclictest0-21swapper/608:35:136
395599229,8cyclictest0-21swapper/510:11:435
395599229,8cyclictest0-21swapper/510:04:545
395599229,11cyclictest0-21swapper/509:00:215
3955992222,0cyclictest0-21swapper/511:25:215
3955992221,1cyclictest1589-21snmpd09:12:405
3954992222,0cyclictest0-21swapper/408:50:124
3954992210,7cyclictest0-21swapper/410:58:294
3952992214,4cyclictest121rcu_preempt08:10:142
3952992210,12cyclictest0-21swapper/207:15:162
3951992222,0cyclictest0-21swapper/110:05:141
3950992222,0cyclictest0-21swapper/011:35:570
1744622210,0sleep70-21swapper/709:27:377
3957992113,5cyclictest0-21swapper/710:13:117
3957992110,7cyclictest0-21swapper/710:06:197
3957992110,5cyclictest0-21swapper/708:15:227
3956992110,4cyclictest0-21swapper/609:18:066
395599219,10cyclictest0-21swapper/510:57:335
395599215,15cyclictest13027-21ntpq08:15:205
395599214,16cyclictest0-21swapper/509:05:225
395599214,16cyclictest0-21swapper/509:05:225
3955992117,3cyclictest27977-21sh08:40:195
3955992117,3cyclictest27977-21sh08:40:195
3955992117,3cyclictest0-21swapper/507:30:005
3955992110,3cyclictest0-21swapper/508:50:205
3954992121,0cyclictest0-21swapper/407:30:024
3954992120,0cyclictest0-21swapper/411:00:124
3954992110,6cyclictest0-21swapper/408:25:164
3954992110,4cyclictest0-21swapper/408:10:174
3953992121,0cyclictest0-21swapper/309:25:123
3953992121,0cyclictest0-21swapper/307:10:013
3951992121,0cyclictest0-21swapper/107:15:141
395199210,20cyclictest0-21swapper/110:40:121
3950992119,1cyclictest13705-21ls09:25:200
3950992110,5cyclictest0-21swapper/007:25:170
505822010,0sleep10-21swapper/110:24:231
3957992019,1cyclictest677-21nscd09:51:457
3957992019,0cyclictest0-21swapper/709:15:137
3957992016,3cyclictest10821-21/usr/sbin/munin07:20:187
3957992010,6cyclictest0-21swapper/709:57:127
3957992010,4cyclictest0-21swapper/710:00:117
3957992010,0cyclictest0-21swapper/709:12:247
3956992010,3cyclictest0-21swapper/607:25:176
3956992010,1cyclictest0-21swapper/608:40:156
3956992010,1cyclictest0-21swapper/608:40:146
395599203,16cyclictest17662-21df_abs07:30:125
3955992017,2cyclictest25099-21ls07:40:245
3955992016,3cyclictest28074-21systemctl10:20:015
3955992016,3cyclictest11765-21diskmemload09:48:335
3955992016,1cyclictest121rcu_preempt10:35:195
3954992020,0cyclictest0-21swapper/409:05:134
3954992020,0cyclictest0-21swapper/409:05:124
3954992020,0cyclictest0-21swapper/407:29:574
3954992010,7cyclictest0-21swapper/408:30:164
3954992010,4cyclictest0-21swapper/410:25:144
3953992020,0cyclictest0-21swapper/311:30:563
3953992010,8cyclictest0-21swapper/311:11:233
3953992010,6cyclictest0-21swapper/310:46:223
3953992010,5cyclictest0-21swapper/309:55:203
3953992010,4cyclictest0-21swapper/307:40:233
3953992010,3cyclictest0-21swapper/310:37:463
3953992010,2cyclictest0-21swapper/307:45:113
3952992010,9cyclictest121rcu_preempt07:20:222
3951992010,7cyclictest0-21swapper/110:45:011
3951992010,7cyclictest0-21swapper/109:34:371
3950992020,0cyclictest0-21swapper/009:15:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional