You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 21:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Dec 17, 2025 12:50:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2010421370,2sleep50-21swapper/507:05:295
2125828139,10sleep10-21swapper/107:07:581
1907028178,1sleep00-21swapper/007:05:250
2126327946,29sleep60-21swapper/607:08:036
2126027945,30sleep30-21swapper/307:08:003
2116027537,9sleep70-21swapper/707:06:367
2137327238,30sleep40-21swapper/407:09:394
2119127238,30sleep20-21swapper/207:07:032
89722490,0sleep60-21swapper/607:40:136
21835994646,0cyclictest0-21swapper/612:30:106
275962450,0sleep50-21swapper/510:50:205
21832994343,0cyclictest0-21swapper/310:25:093
21834994035,4cyclictest0-21swapper/510:40:015
21831994039,0cyclictest0-21swapper/209:00:122
21831994038,1cyclictest15367-21idleruntime-cro09:40:002
2183699380,0cyclictest0-21swapper/711:50:097
21833993837,1cyclictest0-21swapper/408:15:124
21830993837,0cyclictest0-21swapper/112:15:091
21830993736,0cyclictest0-21swapper/108:45:121
21836993635,1cyclictest0-21swapper/711:55:117
21833993636,0cyclictest0-21swapper/411:30:014
21832993636,0cyclictest0-21swapper/307:10:193
21836993534,0cyclictest0-21swapper/711:45:117
21835993434,0cyclictest0-21swapper/608:40:116
21832993433,1cyclictest0-21swapper/311:50:093
21829993432,1cyclictest0-21swapper/011:30:010
21836993332,1cyclictest0-21swapper/708:30:127
21835993331,1cyclictest0-21swapper/611:00:006
21830993310,23cyclictest0-21swapper/111:30:111
21834993231,0cyclictest0-21swapper/509:30:115
21834993231,0cyclictest0-21swapper/509:30:115
21834993210,19cyclictest121rcu_preempt12:05:005
2183499320,3cyclictest0-21swapper/511:40:105
21833993232,0cyclictest0-21swapper/407:10:214
2183299320,32cyclictest0-21swapper/311:35:123
21829993232,0cyclictest0-21swapper/008:15:120
21836993131,0cyclictest0-21swapper/708:35:117
2183599310,30cyclictest0-21swapper/611:55:016
21833993129,1cyclictest0-21swapper/411:00:014
21831993130,0cyclictest0-21swapper/210:55:122
21830993131,0cyclictest0-21swapper/110:00:101
21829993131,0cyclictest0-21swapper/009:40:100
21836993028,1cyclictest0-21swapper/707:20:117
21834993010,18cyclictest121rcu_preempt11:25:145
2183399300,0cyclictest0-21swapper/411:15:124
21832993030,0cyclictest0-21swapper/312:20:093
21832993029,0cyclictest0-21swapper/311:55:113
21831993029,0cyclictest0-21swapper/211:05:112
21830993029,0cyclictest0-21swapper/107:15:101
21836992929,0cyclictest0-21swapper/708:20:117
21834992910,17cyclictest121rcu_preempt11:55:115
21832992929,0cyclictest0-21swapper/307:55:023
21832992929,0cyclictest0-21swapper/307:50:123
21832992928,1cyclictest0-21swapper/311:45:113
21831992927,2cyclictest0-21swapper/210:40:012
21830992929,0cyclictest0-21swapper/107:10:011
21835992828,0cyclictest0-21swapper/611:20:116
2183499280,23cyclictest0-21swapper/507:45:195
21831992828,0cyclictest0-21swapper/211:35:122
21830992828,0cyclictest0-21swapper/108:10:101
21829992827,1cyclictest0-21swapper/007:10:210
21836992727,0cyclictest0-21swapper/707:45:117
21835992727,0cyclictest0-21swapper/608:05:106
21834992727,0cyclictest0-21swapper/511:30:015
21834992710,17cyclictest0-21swapper/507:15:015
21834992710,16cyclictest0-21swapper/510:30:215
21830992727,0cyclictest0-21swapper/111:50:101
21830992727,0cyclictest0-21swapper/109:30:111
21830992727,0cyclictest0-21swapper/109:30:111
21834992610,15cyclictest0-21swapper/508:45:185
21834992610,11cyclictest121rcu_preempt12:15:175
21833992626,0cyclictest0-21swapper/409:20:124
21832992626,0cyclictest0-21swapper/308:30:123
21829992626,0cyclictest0-21swapper/011:15:120
21829992625,0cyclictest0-21swapper/011:00:010
21836992525,0cyclictest0-21swapper/710:35:117
21835992523,1cyclictest0-21swapper/607:30:116
21834992524,0cyclictest12741-21apt-get09:35:115
21834992510,3cyclictest0-21swapper/508:30:215
21834992510,15cyclictest0-21swapper/509:10:215
21834992510,15cyclictest0-21swapper/507:25:205
21833992525,0cyclictest0-21swapper/412:30:104
21834992424,0cyclictest0-21swapper/512:05:115
21834992424,0cyclictest0-21swapper/512:05:115
21834992412,8cyclictest121rcu_preempt08:15:125
2183499240,23cyclictest0-21swapper/509:25:005
2183299240,24cyclictest0-21swapper/308:35:113
21831992423,1cyclictest0-21swapper/209:30:122
21831992423,1cyclictest0-21swapper/209:30:112
21831992421,2cyclictest23469-21apt-get11:40:102
21836992323,0cyclictest0-21swapper/708:25:127
21835992321,1cyclictest0-21swapper/611:05:116
21834992323,0cyclictest0-21swapper/512:30:115
21834992314,7cyclictest121rcu_preempt10:55:125
21834992310,8cyclictest0-21swapper/507:50:205
21834992310,6cyclictest121rcu_preempt09:10:015
21834992310,4cyclictest0-21swapper/508:40:195
21834992310,13cyclictest0-21swapper/508:00:195
21834992310,10cyclictest0-21swapper/511:35:165
21834992310,10cyclictest0-21swapper/508:10:185
21833992323,0cyclictest0-21swapper/408:00:004
21833992322,1cyclictest0-21swapper/407:50:104
21832992310,0cyclictest0-21swapper/307:40:153
21831992322,1cyclictest33-21ksoftirqd/208:55:002
21831992310,8cyclictest0-21swapper/207:10:192
21830992310,5cyclictest0-21swapper/107:20:191
21830992310,0cyclictest0-21swapper/111:55:201
21836992222,0cyclictest0-21swapper/709:25:127
21836992220,1cyclictest24903-21apt-get09:55:107
21836992210,3cyclictest0-21swapper/708:15:167
21835992222,0cyclictest0-21swapper/611:00:016
21835992221,1cyclictest780-21apt-get09:15:116
21835992210,3cyclictest0-21swapper/610:25:136
21834992222,0cyclictest0-21swapper/509:00:005
21834992210,9cyclictest121rcu_preempt07:10:245
21834992210,3cyclictest0-21swapper/511:50:135
21834992210,12cyclictest0-21swapper/512:20:185
21834992210,12cyclictest0-21swapper/508:10:015
21834992210,10cyclictest0-21swapper/510:05:165
21833992210,6cyclictest0-21swapper/409:25:164
21832992222,0cyclictest0-21swapper/307:20:113
2183299220,22cyclictest0-21swapper/308:20:113
21831992222,0cyclictest0-21swapper/211:30:112
21831992221,1cyclictest33-21ksoftirqd/207:40:012
21831992211,10cyclictest0-21swapper/209:55:102
21830992222,0cyclictest0-21swapper/112:10:011
21830992222,0cyclictest0-21swapper/109:50:021
21830992222,0cyclictest0-21swapper/109:05:121
21830992222,0cyclictest0-21swapper/108:55:121
21829992222,0cyclictest0-21swapper/009:20:120
21829992210,5cyclictest0-21swapper/011:45:200
21836992110,4cyclictest0-21swapper/709:40:207
21836992110,4cyclictest0-21swapper/708:40:157
21835992110,8cyclictest0-21swapper/608:20:106
21835992110,6cyclictest0-21swapper/609:40:206
21834992111,7cyclictest121rcu_preempt09:20:005
21834992110,9cyclictest121rcu_preempt10:45:125
21834992110,8cyclictest0-21swapper/511:45:145
21834992110,11cyclictest0-21swapper/512:15:005
21834992110,10cyclictest0-21swapper/511:20:155
21833992121,0cyclictest0-21swapper/409:40:114
21833992119,1cyclictest0-21swapper/412:15:094
21832992120,1cyclictest0-21swapper/307:45:123
2183199219,8cyclictest33-21ksoftirqd/210:05:112
21831992120,1cyclictest33-21ksoftirqd/210:40:002
21831992119,2cyclictest33-21ksoftirqd/211:50:182
21831992119,1cyclictest33-21ksoftirqd/207:45:152
21831992118,1cyclictest121rcu_preempt11:20:002
21831992112,8cyclictest33-21ksoftirqd/208:10:192
21831992110,7cyclictest0-21swapper/208:30:182
21831992110,6cyclictest0-21swapper/207:55:162
21829992120,1cyclictest0-21swapper/012:30:100
2182999210,21cyclictest0-21swapper/008:05:110
50552200,0sleep70-21swapper/712:00:197
21836992020,0cyclictest0-21swapper/710:00:117
21836992019,1cyclictest2257-21apt-get07:30:107
21836992019,1cyclictest21359-21http09:50:007
21836992010,10cyclictest0-21swapper/711:40:107
21835992020,0cyclictest0-21swapper/612:35:116
21835992020,0cyclictest0-21swapper/608:10:106
21835992010,8cyclictest0-21swapper/608:45:166
21835992010,3cyclictest0-21swapper/611:30:176
21834992011,7cyclictest121rcu_preempt10:15:145
21834992011,7cyclictest121rcu_preempt10:00:155
21834992011,7cyclictest121rcu_preempt07:35:225
21834992011,7cyclictest0-21swapper/510:10:205
21834992011,6cyclictest121rcu_preempt08:25:165
21834992010,9cyclictest0-21swapper/508:35:155
21834992010,9cyclictest0-21swapper/507:20:205
21834992010,7cyclictest121rcu_preempt09:00:215
21834992010,7cyclictest121rcu_preempt08:00:005
21834992010,7cyclictest0-21swapper/507:30:145
21834992010,3cyclictest121rcu_preempt12:25:155
21833992020,0cyclictest0-21swapper/409:15:104
21833992010,7cyclictest0-21swapper/408:20:194
21833992010,6cyclictest0-21swapper/412:35:194
21833992010,4cyclictest0-21swapper/410:30:164
21833992010,3cyclictest0-21swapper/410:50:194
21833992010,0cyclictest0-21swapper/407:55:014
21832992019,1cyclictest0-21swapper/310:35:113
21832992016,1cyclictest27231-21/usr/sbin/munin09:05:133
21832992010,5cyclictest0-21swapper/312:35:203
21832992010,5cyclictest0-21swapper/311:30:203
21832992010,5cyclictest0-21swapper/308:50:153
21832992010,3cyclictest0-21swapper/307:35:173
21832992010,1cyclictest0-21swapper/310:10:203
2183199205,4cyclictest121rcu_preempt10:00:182
21831992010,4cyclictest0-21swapper/207:50:012
21831992010,1cyclictest0-21swapper/212:15:182
21830992020,0cyclictest0-21swapper/107:50:011
21830992010,4cyclictest0-21swapper/108:25:161
21830992010,2cyclictest0-21swapper/111:15:221
21830992010,1cyclictest0-21swapper/110:30:201
21829992010,5cyclictest0-21swapper/010:30:120
21829992010,5cyclictest0-21swapper/009:30:200
21829992010,5cyclictest0-21swapper/009:30:200
21829992010,4cyclictest0-21swapper/009:35:190
1667522010,0sleep60-21swapper/607:50:316
21836991919,0cyclictest0-21swapper/710:20:117
21836991910,8cyclictest0-21swapper/710:15:207
21836991910,5cyclictest0-21swapper/708:50:207
21836991910,4cyclictest0-21swapper/709:30:157
21836991910,4cyclictest0-21swapper/709:30:157
21836991910,3cyclictest0-21swapper/710:40:167
21836991910,3cyclictest0-21swapper/708:55:027
21835991919,0cyclictest0-21swapper/612:10:016
21835991918,0cyclictest0-21swapper/612:20:096
21835991910,7cyclictest0-21swapper/611:15:206
21835991910,6cyclictest0-21swapper/608:25:206
21835991910,5cyclictest0-21swapper/608:55:216
21835991910,2cyclictest0-21swapper/610:00:106
2183499192,15cyclictest0-21swapper/509:50:105
21834991919,0cyclictest0-21swapper/511:10:115
21834991911,6cyclictest121rcu_preempt10:25:005
21834991910,7cyclictest121rcu_preempt10:25:005
21834991910,7cyclictest121rcu_preempt09:55:135
21834991910,6cyclictest121rcu_preempt11:15:135
21834991910,6cyclictest121rcu_preempt11:05:155
21834991910,6cyclictest121rcu_preempt10:35:115
21834991910,6cyclictest121rcu_preempt09:25:195
21834991910,6cyclictest121rcu_preempt08:50:155
21834991910,4cyclictest0-21swapper/507:40:165
21833991917,1cyclictest0-21swapper/410:05:124
21833991912,4cyclictest0-21swapper/408:35:164
21833991910,5cyclictest0-21swapper/408:10:194
21833991910,4cyclictest0-21swapper/407:25:134
21833991910,3cyclictest0-21swapper/412:10:014
21833991910,3cyclictest0-21swapper/410:00:154
21833991910,2cyclictest0-21swapper/407:45:194
21832991910,8cyclictest0-21swapper/308:55:193
21832991910,6cyclictest0-21swapper/312:30:123
21832991910,4cyclictest0-21swapper/307:30:153
21832991910,2cyclictest0-21swapper/312:15:193
2183199199,5cyclictest33-21ksoftirqd/207:25:202
2183199196,4cyclictest0-21swapper/211:45:152
2183199196,0cyclictest0-21swapper/210:10:202
2183199193,9cyclictest121rcu_preempt11:00:182
21831991919,0cyclictest0-21swapper/212:03:052
21831991916,2cyclictest321ktimersoftd/208:30:002
21831991915,3cyclictest33-21ksoftirqd/208:20:122
21831991910,5cyclictest0-21swapper/212:10:092
21831991910,5cyclictest0-21swapper/207:40:202
21831991910,5cyclictest0-21swapper/207:15:192
21831991910,4cyclictest0-21swapper/211:10:182
21831991910,2cyclictest0-21swapper/209:40:112
21831991910,1cyclictest0-21swapper/210:50:122
21830991910,7cyclictest0-21swapper/111:00:021
21830991910,7cyclictest0-21swapper/110:15:201
21830991910,6cyclictest0-21swapper/112:05:141
21830991910,6cyclictest0-21swapper/112:05:141
21830991910,5cyclictest0-21swapper/110:25:151
21830991910,4cyclictest0-21swapper/108:05:151
21830991910,3cyclictest0-21swapper/112:25:121
21830991910,1cyclictest0-21swapper/109:20:201
21829991919,0cyclictest0-21swapper/010:20:110
21829991919,0cyclictest0-21swapper/008:00:000
21829991910,5cyclictest0-21swapper/012:00:160
21829991910,5cyclictest0-21swapper/008:35:200
21829991910,4cyclictest0-21swapper/010:45:140
21829991910,3cyclictest0-21swapper/007:30:120
21829991910,1cyclictest0-21swapper/010:05:150
21829991910,0cyclictest0-21swapper/008:45:190
21836991817,1cyclictest0-21swapper/709:00:127
21836991813,4cyclictest15750irq/123-ahci[0007:55:237
21836991810,7cyclictest0-21swapper/711:05:207
21836991810,5cyclictest0-21swapper/709:15:187
21836991810,3cyclictest0-21swapper/709:10:167
21836991810,2cyclictest0-21swapper/708:00:167
21835991818,0cyclictest0-21swapper/610:05:116
21835991810,4cyclictest0-21swapper/609:35:196
21835991810,2cyclictest0-21swapper/612:00:156
21835991810,2cyclictest0-21swapper/610:15:166
21835991810,2cyclictest0-21swapper/609:55:136
21835991810,2cyclictest0-21swapper/607:25:156
21835991810,1cyclictest0-21swapper/611:45:196
21834991811,4cyclictest121rcu_preempt08:20:195
21834991810,7cyclictest121rcu_preempt11:00:155
21834991810,7cyclictest0-21swapper/509:40:115
21834991810,6cyclictest121rcu_preempt09:45:135
21834991810,6cyclictest0-21swapper/512:35:145
21833991810,6cyclictest0-21swapper/412:00:154
21833991810,5cyclictest0-21swapper/410:40:014
21833991810,4cyclictest0-21swapper/412:25:184
21833991810,4cyclictest0-21swapper/412:20:154
21833991810,4cyclictest0-21swapper/411:20:204
21833991810,4cyclictest0-21swapper/408:55:214
21833991810,4cyclictest0-21swapper/408:45:164
21833991810,3cyclictest0-21swapper/409:35:194
21833991810,2cyclictest0-21swapper/409:55:154
21833991810,0cyclictest0-21swapper/408:30:214
21832991810,5cyclictest0-21swapper/310:45:133
21832991810,4cyclictest0-21swapper/308:40:153
21832991810,3cyclictest0-21swapper/310:15:163
21832991810,2cyclictest0-21swapper/312:25:123
21832991810,1cyclictest0-21swapper/311:00:203
21832991810,0cyclictest0-21swapper/309:35:103
21831991818,0cyclictest0-21swapper/212:35:152
21831991817,1cyclictest33-21ksoftirqd/208:15:122
21831991817,1cyclictest321ktimersoftd/209:10:222
21831991816,1cyclictest6196-21apt-get12:05:112
21831991816,1cyclictest6196-21apt-get12:05:112
21831991816,1cyclictest33-21ksoftirqd/208:35:122
21831991816,1cyclictest33-21ksoftirqd/208:00:112
21831991811,3cyclictest33-21ksoftirqd/208:40:112
21831991810,6cyclictest33-21ksoftirqd/209:15:122
21831991810,5cyclictest0-21swapper/212:25:122
21830991813,0cyclictest0-21swapper/110:05:191
21830991810,6cyclictest0-21swapper/109:40:171
21830991810,4cyclictest0-21swapper/108:30:221
21830991810,2cyclictest0-21swapper/107:35:221
21830991810,2cyclictest0-21swapper/107:30:151
21830991810,0cyclictest0-21swapper/111:05:211
21830991810,0cyclictest0-21swapper/109:25:201
21829991818,0cyclictest0-21swapper/007:50:100
21829991810,4cyclictest0-21swapper/011:35:210
21829991810,4cyclictest0-21swapper/011:10:140
21829991810,4cyclictest0-21swapper/009:05:160
21829991810,3cyclictest0-21swapper/012:35:190
21829991810,3cyclictest0-21swapper/009:00:200
21829991810,3cyclictest0-21swapper/007:55:010
21829991810,2cyclictest0-21swapper/009:55:190
21829991810,2cyclictest0-21swapper/009:50:150
21836991715,1cyclictest73-21ksoftirqd/708:50:007
21836991710,5cyclictest0-21swapper/712:35:207
21836991710,5cyclictest0-21swapper/710:25:097
21836991710,5cyclictest0-21swapper/709:50:147
21836991710,4cyclictest0-21swapper/712:15:157
21836991710,4cyclictest0-21swapper/707:10:227
21836991710,3cyclictest0-21swapper/711:30:167
21836991710,2cyclictest0-21swapper/710:30:157
21836991710,1cyclictest0-21swapper/712:10:187
21836991710,0cyclictest0-21swapper/711:10:187
21836991710,0cyclictest0-21swapper/709:05:127
21835991717,0cyclictest0-21swapper/608:00:116
21835991715,2cyclictest659-21ptp4l12:08:116
21835991715,2cyclictest659-21ptp4l12:08:116
21835991710,5cyclictest0-21swapper/611:40:186
21835991710,5cyclictest0-21swapper/609:32:006
21835991710,5cyclictest0-21swapper/609:32:006
21835991710,5cyclictest0-21swapper/607:10:196
21835991710,4cyclictest0-21swapper/611:10:166
21835991710,3cyclictest0-21swapper/611:25:196
21835991710,3cyclictest0-21swapper/609:50:156
21835991710,3cyclictest0-21swapper/608:30:166
21835991710,2cyclictest0-21swapper/612:15:136
21835991710,2cyclictest0-21swapper/611:35:216
21835991710,2cyclictest0-21swapper/609:20:226
21835991710,2cyclictest0-21swapper/609:05:176
21835991710,2cyclictest0-21swapper/609:00:116
21835991710,2cyclictest0-21swapper/608:35:206
21835991710,2cyclictest0-21swapper/607:35:176
21833991710,7cyclictest0-21swapper/409:45:154
21833991710,4cyclictest0-21swapper/410:35:164
21833991710,4cyclictest0-21swapper/410:25:184
21833991710,4cyclictest0-21swapper/408:50:204
21833991710,4cyclictest0-21swapper/407:20:194
21833991710,3cyclictest0-21swapper/411:35:174
21833991710,3cyclictest0-21swapper/410:45:204
21833991710,2cyclictest0-21swapper/411:50:014
21833991710,2cyclictest0-21swapper/411:25:144
21833991710,2cyclictest0-21swapper/410:10:174
21833991710,2cyclictest0-21swapper/409:30:194
21833991710,2cyclictest0-21swapper/409:30:194
21833991710,2cyclictest0-21swapper/407:35:134
21833991710,1cyclictest0-21swapper/410:15:204
21833991710,1cyclictest0-21swapper/408:25:214
21833991710,0cyclictest0-21swapper/411:55:194
21832991717,0cyclictest0-21swapper/308:25:123
21832991716,1cyclictest0-21swapper/309:25:123
21832991713,3cyclictest0-21swapper/307:15:193
21832991710,7cyclictest0-21swapper/308:05:113
21832991710,6cyclictest0-21swapper/311:15:203
21832991710,6cyclictest0-21swapper/309:10:163
21832991710,4cyclictest0-21swapper/311:25:193
21832991710,3cyclictest0-21swapper/311:05:193
21832991710,3cyclictest0-21swapper/310:40:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional