You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 08:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Dec 30, 2025 00:50:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
112782880,0sleep00-21swapper/023:05:200
2834128449,30sleep30-21swapper/319:08:483
2820028451,29sleep50-21swapper/519:06:515
2826428350,29sleep00-21swapper/019:07:410
2823528148,29sleep10-21swapper/119:07:191
2819728148,29sleep20-21swapper/219:06:482
2811828147,30sleep60-21swapper/619:05:396
2840128045,30sleep70-21swapper/719:09:417
2836927844,30sleep40-21swapper/419:09:144
28859994948,0cyclictest0-21swapper/521:45:015
28860994848,0cyclictest0-21swapper/620:25:136
322632470,0sleep20-21swapper/221:00:162
28857994646,0cyclictest0-21swapper/321:20:113
28855994646,0cyclictest0-21swapper/119:35:141
83142440,0sleep20-21swapper/223:55:172
28856994140,0cyclictest0-21swapper/220:05:012
28854994140,0cyclictest0-21swapper/023:45:120
28860994039,1cyclictest0-21swapper/600:30:136
28855994040,0cyclictest0-21swapper/121:10:121
28859993837,0cyclictest0-21swapper/519:40:125
28858993837,1cyclictest0-21swapper/420:00:114
28857993838,0cyclictest0-21swapper/319:20:013
28854993838,0cyclictest0-21swapper/019:15:130
2886199370,36cyclictest0-21swapper/723:00:127
28854993737,0cyclictest0-21swapper/020:25:130
2886199360,35cyclictest32347-21apt-get21:55:137
28854993636,0cyclictest0-21swapper/023:25:100
28861993534,0cyclictest0-21swapper/723:50:137
28861993533,1cyclictest0-21swapper/719:40:117
2886199350,34cyclictest0-21swapper/719:20:137
28860993534,0cyclictest0-21swapper/620:15:136
28857993535,0cyclictest0-21swapper/300:10:133
28854993535,0cyclictest0-21swapper/020:15:010
28856993434,0cyclictest0-21swapper/200:30:132
28855993434,0cyclictest0-21swapper/100:10:011
28855993333,0cyclictest0-21swapper/120:25:011
28855993332,0cyclictest0-21swapper/121:25:141
28854993333,0cyclictest0-21swapper/020:35:130
28854993331,1cyclictest17201-21apt-get21:30:120
28860993230,1cyclictest12470-21apt-get19:35:146
28860993230,1cyclictest0-21swapper/623:45:116
28855993232,0cyclictest0-21swapper/120:00:021
28860993130,1cyclictest0-21swapper/623:30:136
28859993131,0cyclictest0-21swapper/520:15:135
28857993131,0cyclictest0-21swapper/320:00:013
28857993131,0cyclictest0-21swapper/319:10:003
28856993129,1cyclictest0-21swapper/220:15:132
28855993131,0cyclictest0-21swapper/120:05:111
28859993029,1cyclictest0-21swapper/520:30:095
28859993029,0cyclictest0-21swapper/522:35:135
28859993029,0cyclictest0-21swapper/500:00:125
28856993030,0cyclictest0-21swapper/221:15:122
28855993029,0cyclictest0-21swapper/100:05:111
28854993030,0cyclictest0-21swapper/020:30:100
28860992928,0cyclictest0-21swapper/619:15:136
28859992928,1cyclictest0-21swapper/521:40:015
28859992923,4cyclictest57-21ksoftirqd/519:40:015
28857992928,0cyclictest27283-21apt-get23:35:123
28855992928,0cyclictest0-21swapper/119:25:141
28861992828,0cyclictest0-21swapper/721:45:107
28860992826,1cyclictest0-21swapper/623:25:096
28859992828,0cyclictest0-21swapper/520:20:125
28858992827,0cyclictest0-21swapper/419:40:104
28857992828,0cyclictest0-21swapper/323:50:023
28857992828,0cyclictest0-21swapper/321:00:163
28856992828,0cyclictest0-21swapper/223:25:092
28854992827,0cyclictest0-21swapper/021:45:010
28859992727,0cyclictest0-21swapper/520:10:125
28859992725,1cyclictest57-21ksoftirqd/520:05:015
28858992727,0cyclictest0-21swapper/419:35:134
28857992727,0cyclictest0-21swapper/321:15:133
28856992725,1cyclictest0-21swapper/223:45:112
28861992626,0cyclictest0-21swapper/720:30:097
28861992626,0cyclictest0-21swapper/720:15:137
28858992626,0cyclictest0-21swapper/400:25:124
28857992626,0cyclictest0-21swapper/323:40:113
28857992626,0cyclictest0-21swapper/320:05:013
28856992625,1cyclictest0-21swapper/223:30:132
28856992625,0cyclictest0-21swapper/219:35:142
28861992524,0cyclictest0-21swapper/722:35:127
28860992524,1cyclictest0-21swapper/620:35:146
28858992525,0cyclictest0-21swapper/422:25:124
28858992525,0cyclictest0-21swapper/419:55:124
28858992524,1cyclictest762-21gmain20:15:394
28856992523,1cyclictest10779-21cpu20:25:142
28856992523,1cyclictest0-21swapper/219:15:132
28854992525,0cyclictest0-21swapper/000:35:160
28861992424,0cyclictest0-21swapper/700:00:137
28861992422,1cyclictest0-21swapper/720:35:137
28861992410,0cyclictest0-21swapper/722:55:227
2885999247,15cyclictest57-21ksoftirqd/523:55:225
28859992423,1cyclictest57-21ksoftirqd/522:35:015
28858992424,0cyclictest0-21swapper/419:10:124
28857992424,0cyclictest0-21swapper/322:55:133
28856992424,0cyclictest0-21swapper/223:50:112
28856992410,4cyclictest0-21swapper/222:45:212
28855992424,0cyclictest0-21swapper/121:40:131
28861992323,0cyclictest0-21swapper/721:40:007
28861992323,0cyclictest0-21swapper/720:20:137
28857992323,0cyclictest0-21swapper/320:40:133
28856992322,1cyclictest0-21swapper/220:35:592
28854992322,0cyclictest0-21swapper/023:00:110
2643122310,0sleep00-21swapper/019:55:210
28861992222,0cyclictest0-21swapper/720:10:137
28860992210,4cyclictest0-21swapper/622:05:186
28859992221,1cyclictest57-21ksoftirqd/500:20:015
28859992220,1cyclictest57-21ksoftirqd/521:55:165
28859992220,1cyclictest561ktimersoftd/500:25:175
28859992220,1cyclictest28743-21ls22:40:205
28859992216,5cyclictest57-21ksoftirqd/519:25:205
28859992210,7cyclictest0-21swapper/522:45:155
28858992221,1cyclictest0-21swapper/421:10:124
28858992220,1cyclictest1555-21munin-run00:40:014
28858992210,5cyclictest0-21swapper/420:05:164
28855992222,0cyclictest0-21swapper/121:05:141
28855992220,1cyclictest5924-21apt-get22:05:141
28855992210,6cyclictest0-21swapper/121:50:201
28854992222,0cyclictest0-21swapper/019:25:130
28854992210,8cyclictest0-21swapper/019:35:220
28861992110,4cyclictest0-21swapper/722:10:167
28860992121,0cyclictest0-21swapper/621:30:116
28860992120,1cyclictest0-21swapper/620:30:116
28859992119,1cyclictest57-21ksoftirqd/522:25:175
28859992119,1cyclictest57-21ksoftirqd/520:40:165
28859992115,6cyclictest57-21ksoftirqd/520:45:185
28859992112,8cyclictest561ktimersoftd/521:25:205
28859992110,7cyclictest121rcu_preempt22:50:175
28859992110,6cyclictest0-21swapper/521:50:165
28859992110,0cyclictest0-21swapper/521:17:005
28858992121,0cyclictest0-21swapper/421:50:124
28858992110,5cyclictest0-21swapper/423:30:184
28858992110,4cyclictest0-21swapper/423:15:224
28858992110,0cyclictest0-21swapper/423:10:204
28857992110,7cyclictest0-21swapper/323:05:163
28857992110,3cyclictest0-21swapper/320:10:223
28857992110,3cyclictest0-21swapper/300:25:193
28856992110,3cyclictest0-21swapper/221:55:222
28855992121,0cyclictest0-21swapper/100:00:121
28855992110,3cyclictest0-21swapper/121:55:231
28855992110,11cyclictest0-21swapper/120:14:501
28854992110,4cyclictest0-21swapper/020:10:220
28854992110,3cyclictest0-21swapper/000:25:210
28861992010,5cyclictest0-21swapper/721:40:207
28860992018,1cyclictest0-21swapper/621:45:006
28860992010,3cyclictest0-21swapper/619:50:166
28860992010,2cyclictest0-21swapper/622:55:226
28860992010,2cyclictest0-21swapper/600:25:206
28859992019,0cyclictest0-21swapper/523:50:205
28859992018,1cyclictest561ktimersoftd/521:05:225
28859992010,9cyclictest0-21swapper/522:00:175
28858992020,0cyclictest0-21swapper/419:50:114
28858992010,6cyclictest0-21swapper/400:00:224
28858992010,5cyclictest0-21swapper/422:05:154
28858992010,3cyclictest0-21swapper/421:35:194
28858992010,0cyclictest0-21swapper/422:35:164
28857992020,0cyclictest0-21swapper/320:25:123
28856992011,6cyclictest20736-21grep00:15:172
28856992010,8cyclictest0-21swapper/220:20:222
28856992010,6cyclictest0-21swapper/220:45:132
28856992010,5cyclictest0-21swapper/200:20:222
28856992010,3cyclictest0-21swapper/221:10:192
28856992010,3cyclictest0-21swapper/219:45:142
28855992020,0cyclictest0-21swapper/123:10:111
28855992020,0cyclictest0-21swapper/119:10:011
28855992018,1cyclictest2920-21apt-get19:20:021
28854992019,0cyclictest0-21swapper/021:55:140
28854992010,5cyclictest0-21swapper/022:25:160
28854992010,5cyclictest0-21swapper/000:10:180
28854992010,3cyclictest0-21swapper/019:30:210
28861991918,1cyclictest721ktimersoftd/720:00:197
28861991917,1cyclictest711rcuc/722:35:007
28861991910,8cyclictest0-21swapper/722:50:127
28861991910,7cyclictest0-21swapper/723:25:107
28861991910,5cyclictest0-21swapper/723:30:227
28861991910,4cyclictest0-21swapper/723:40:177
28861991910,2cyclictest0-21swapper/720:40:137
28860991912,5cyclictest32344-21/usr/sbin/munin21:55:216
28860991910,7cyclictest0-21swapper/619:55:176
28860991910,5cyclictest0-21swapper/623:40:166
28860991910,5cyclictest0-21swapper/622:40:226
28860991910,4cyclictest0-21swapper/623:05:216
28860991910,3cyclictest0-21swapper/600:00:016
28860991910,0cyclictest0-21swapper/600:05:166
2885999199,9cyclictest57-21ksoftirqd/519:50:215
28859991918,1cyclictest57-21ksoftirqd/519:15:235
28859991918,1cyclictest561ktimersoftd/522:55:225
28859991918,1cyclictest561ktimersoftd/521:10:175
28859991917,2cyclictest57-21ksoftirqd/519:20:195
28859991917,2cyclictest15811-21kworker/5:000:30:155
28859991917,1cyclictest57-21ksoftirqd/523:25:175
28859991917,1cyclictest561ktimersoftd/522:15:015
28859991917,1cyclictest551rcuc/521:20:195
28859991912,1cyclictest561ktimersoftd/523:25:005
28859991910,4cyclictest0-21swapper/523:00:155
28859991910,3cyclictest0-21swapper/521:30:175
28858991913,4cyclictest0-21swapper/422:10:144
28858991910,4cyclictest0-21swapper/423:45:204
28858991910,3cyclictest0-21swapper/422:20:184
28858991910,2cyclictest0-21swapper/420:50:164
28857991919,0cyclictest0-21swapper/321:55:133
28857991910,6cyclictest0-21swapper/300:35:193
28857991910,4cyclictest0-21swapper/300:20:223
28857991910,2cyclictest0-21swapper/320:35:183
28856991910,8cyclictest0-21swapper/221:50:112
28856991910,5cyclictest0-21swapper/222:25:012
28856991910,3cyclictest0-21swapper/222:50:142
28856991910,2cyclictest0-21swapper/219:25:232
28855991918,0cyclictest0-21swapper/120:50:111
28855991910,7cyclictest0-21swapper/122:55:191
28855991910,0cyclictest0-21swapper/121:18:341
28854991918,0cyclictest0-21swapper/019:20:130
28854991910,3cyclictest0-21swapper/023:35:210
28854991910,2cyclictest0-21swapper/020:25:000
2886199186,9cyclictest73-21ksoftirqd/719:50:207
28861991810,8cyclictest0-21swapper/723:20:217
28861991810,3cyclictest0-21swapper/721:15:177
28861991810,3cyclictest0-21swapper/720:05:167
28861991810,0cyclictest0-21swapper/722:15:147
28860991812,4cyclictest0-21swapper/620:50:166
28860991810,7cyclictest0-21swapper/622:45:146
28860991810,5cyclictest0-21swapper/623:20:126
28860991810,4cyclictest0-21swapper/621:10:196
28860991810,4cyclictest0-21swapper/620:40:216
28860991810,3cyclictest0-21swapper/623:50:206
28860991810,3cyclictest0-21swapper/622:30:226
28860991810,3cyclictest0-21swapper/621:25:186
28860991810,3cyclictest0-21swapper/620:10:146
28860991810,3cyclictest0-21swapper/619:30:176
28860991810,3cyclictest0-21swapper/600:35:236
28860991810,2cyclictest0-21swapper/623:10:156
28860991810,2cyclictest0-21swapper/621:35:176
28859991816,1cyclictest561ktimersoftd/523:15:155
28859991816,1cyclictest561ktimersoftd/519:30:185
28859991816,1cyclictest561ktimersoftd/519:10:235
28859991815,2cyclictest57-21ksoftirqd/521:40:175
28859991812,4cyclictest29092-21swap23:35:205
28859991810,3cyclictest0-21swapper/523:30:235
28859991810,3cyclictest0-21swapper/519:55:215
28859991810,2cyclictest0-21swapper/523:10:115
28858991817,0cyclictest0-21swapper/422:15:104
28858991816,2cyclictest71850irq/122-eth023:40:154
28858991810,7cyclictest0-21swapper/423:50:024
28858991810,6cyclictest0-21swapper/420:45:134
28858991810,5cyclictest71850irq/122-eth022:55:154
28858991810,4cyclictest0-21swapper/423:35:224
28858991810,4cyclictest0-21swapper/422:00:204
28858991810,4cyclictest0-21swapper/421:05:184
28858991810,3cyclictest0-21swapper/421:40:224
28858991810,3cyclictest0-21swapper/421:25:164
28858991810,3cyclictest0-21swapper/420:40:234
28858991810,2cyclictest0-21swapper/423:25:144
28858991810,2cyclictest0-21swapper/422:40:124
28857991815,0cyclictest16361-21strings22:20:193
28857991810,5cyclictest0-21swapper/319:15:003
28857991810,3cyclictest0-21swapper/322:05:143
28857991810,3cyclictest0-21swapper/321:50:183
28857991810,3cyclictest0-21swapper/320:45:153
28857991810,3cyclictest0-21swapper/319:50:103
28857991810,0cyclictest0-21swapper/323:00:183
28856991810,4cyclictest0-21swapper/200:00:012
28856991810,3cyclictest0-21swapper/222:55:172
28856991810,3cyclictest0-21swapper/221:40:162
28856991810,3cyclictest0-21swapper/221:25:182
28856991810,2cyclictest0-21swapper/222:00:202
28856991810,2cyclictest0-21swapper/221:45:192
28856991810,2cyclictest0-21swapper/200:25:152
28856991810,2cyclictest0-21swapper/200:10:002
28856991810,0cyclictest0-21swapper/223:15:212
28855991818,0cyclictest0-21swapper/120:15:011
28855991810,5cyclictest0-21swapper/123:22:401
28855991810,4cyclictest0-21swapper/122:15:121
28855991810,3cyclictest0-21swapper/122:30:191
28855991810,3cyclictest0-21swapper/121:35:181
28855991810,3cyclictest0-21swapper/120:45:141
28855991810,3cyclictest0-21swapper/119:50:161
28855991810,3cyclictest0-21swapper/100:30:131
28855991810,3cyclictest0-21swapper/100:25:151
28855991810,1cyclictest0-21swapper/121:30:211
28854991816,1cyclictest0-21swapper/019:40:110
28854991810,8cyclictest0-21swapper/000:06:300
28854991810,5cyclictest0-21swapper/021:30:010
28854991810,3cyclictest0-21swapper/022:40:200
28854991810,3cyclictest0-21swapper/022:10:160
28854991810,3cyclictest0-21swapper/021:50:160
28854991810,1cyclictest0-21swapper/019:10:120
2886199177,7cyclictest721ktimersoftd/700:05:137
2886199173,13cyclictest73-21ksoftirqd/723:55:237
28861991715,2cyclictest73-21ksoftirqd/719:40:007
28861991710,5cyclictest0-21swapper/721:05:207
28861991710,4cyclictest0-21swapper/723:10:197
28861991710,4cyclictest0-21swapper/700:30:237
28861991710,3cyclictest0-21swapper/723:35:217
28861991710,2cyclictest0-21swapper/722:20:147
28861991710,2cyclictest0-21swapper/722:05:227
28861991710,1cyclictest0-21swapper/720:45:237
28861991710,0cyclictest0-21swapper/722:00:197
28860991717,0cyclictest0-21swapper/623:15:126
28860991710,4cyclictest0-21swapper/622:15:166
28860991710,4cyclictest0-21swapper/619:45:126
28860991710,4cyclictest0-21swapper/619:20:226
28860991710,3cyclictest0-21swapper/621:40:126
28860991710,3cyclictest0-21swapper/620:55:166
28860991710,3cyclictest0-21swapper/619:10:226
28860991710,3cyclictest0-21swapper/600:20:136
28860991710,2cyclictest0-21swapper/621:50:116
28860991710,2cyclictest0-21swapper/621:05:176
28860991710,1cyclictest0-21swapper/622:50:176
28860991710,1cyclictest0-21swapper/621:20:156
28859991716,1cyclictest57-21ksoftirqd/520:05:185
28859991716,1cyclictest561ktimersoftd/520:55:155
28859991716,1cyclictest561ktimersoftd/520:25:175
28859991716,1cyclictest561ktimersoftd/500:35:185
28859991715,1cyclictest561ktimersoftd/521:00:215
28859991714,3cyclictest57-21ksoftirqd/523:45:125
28859991714,2cyclictest561ktimersoftd/500:05:125
28859991713,0cyclictest23739-21ls00:20:185
28859991711,5cyclictest561ktimersoftd/500:10:165
28859991710,4cyclictest0-21swapper/520:35:225
28859991710,2cyclictest0-21swapper/523:40:135
28858991710,4cyclictest0-21swapper/400:15:224
28858991710,3cyclictest0-21swapper/421:30:214
28858991710,3cyclictest0-21swapper/420:10:164
28858991710,3cyclictest0-21swapper/419:45:174
28858991710,3cyclictest0-21swapper/400:30:234
28858991710,2cyclictest0-21swapper/423:00:214
28858991710,2cyclictest0-21swapper/422:30:204
28858991710,2cyclictest0-21swapper/421:20:204
28857991717,0cyclictest2943-21apt-get22:00:123
28857991712,0cyclictest0-21swapper/319:35:143
28857991710,4cyclictest0-21swapper/320:30:143
28857991710,4cyclictest0-21swapper/300:15:143
28857991710,3cyclictest0-21swapper/323:20:163
28857991710,3cyclictest0-21swapper/320:20:223
28857991710,3cyclictest0-21swapper/319:25:173
28857991710,3cyclictest0-21swapper/300:05:133
28857991710,2cyclictest0-21swapper/323:45:203
28857991710,2cyclictest0-21swapper/322:35:133
28857991710,2cyclictest0-21swapper/321:25:163
28857991710,2cyclictest0-21swapper/320:15:123
28857991710,2cyclictest0-21swapper/300:30:223
28856991716,1cyclictest0-21swapper/221:30:112
28856991710,3cyclictest0-21swapper/223:35:162
28856991710,3cyclictest0-21swapper/222:25:172
28856991710,3cyclictest0-21swapper/220:00:142
28856991710,3cyclictest0-21swapper/219:55:212
28856991710,3cyclictest0-21swapper/219:30:132
28856991710,2cyclictest0-21swapper/222:15:112
28855991710,6cyclictest0-21swapper/122:45:201
28855991710,5cyclictest0-21swapper/123:00:131
28855991710,5cyclictest0-21swapper/120:55:131
28855991710,4cyclictest0-21swapper/123:30:131
28855991710,4cyclictest0-21swapper/119:55:171
28855991710,3cyclictest0-21swapper/123:50:161
28855991710,3cyclictest0-21swapper/119:15:181
28855991710,2cyclictest0-21swapper/123:35:161
28855991710,0cyclictest0-21swapper/123:25:131
28855991710,0cyclictest0-21swapper/122:00:211
28855991710,0cyclictest0-21swapper/100:35:151
28854991717,0cyclictest0-21swapper/023:50:130
28854991710,3cyclictest0-21swapper/021:40:210
28854991710,3cyclictest0-21swapper/020:05:000
28854991710,1cyclictest0-21swapper/022:15:150
2340421710,2sleep20-21swapper/222:34:332
2886199167,8cyclictest73-21ksoftirqd/721:25:197
28861991615,1cyclictest711rcuc/723:45:127
28861991614,1cyclictest721ktimersoftd/720:50:127
28861991614,1cyclictest721ktimersoftd/719:10:157
28861991610,4cyclictest0-21swapper/700:25:117
28861991610,3cyclictest0-21swapper/723:05:007
28861991610,3cyclictest0-21swapper/722:45:177
28861991610,3cyclictest0-21swapper/721:10:167
28861991610,3cyclictest0-21swapper/720:55:227
28861991610,3cyclictest0-21swapper/720:25:237
28861991610,3cyclictest0-21swapper/719:45:197
28861991610,2cyclictest0-21swapper/721:50:157
28861991610,0cyclictest0-21swapper/721:30:167
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional