You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 14:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Thu Aug 13, 2026 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3337932253183,20sleep40-21swapper/419:08:164
3337742247181,54sleep30-21swapper/319:08:003
3337522234172,19sleep10-21swapper/119:07:411
3336382231194,25sleep60-21swapper/619:06:016
3337112224161,20sleep50-21swapper/519:07:055
3338572223187,24sleep20-21swapper/219:09:122
3337782222182,27sleep70-21swapper/719:08:037
3313922207172,23sleep00-21swapper/019:05:070
3394992470,0sleep20-21swapper/219:15:192
33412299320,18cyclictest0-21swapper/022:09:410
33413399290,28cyclictest352444-21cron19:40:024
33413399280,28cyclictest0-21swapper/423:20:134
334133992620,5cyclictest0-21swapper/400:15:204
33413399260,25cyclictest417431-21dump-pmu-power21:30:024
33413399260,25cyclictest0-21swapper/423:40:124
33413399260,25cyclictest0-21swapper/419:15:134
33412299264,4cyclictest0-21swapper/000:32:280
33414099250,24cyclictest383743-21ntpq20:30:227
33414099250,24cyclictest0-21swapper/720:20:137
334136992523,1cyclictest0-21swapper/620:35:136
334136992522,3cyclictest463460-21ntpq22:45:196
334136992520,4cyclictest446958-21idleruntime-cro22:20:016
33413699250,24cyclictest0-21swapper/600:20:136
33413699250,23cyclictest0-21swapper/623:25:136
33413499250,24cyclictest361317-21awk19:55:015
33413499250,24cyclictest349504-21cron19:35:025
334133992523,2cyclictest0-21swapper/422:35:124
33413399250,24cyclictest0-21swapper/421:00:194
33413399250,24cyclictest0-21swapper/420:00:124
33413399250,24cyclictest0-21swapper/419:50:134
33413399250,24cyclictest0-21swapper/419:30:134
33413399250,0cyclictest0-21swapper/400:00:134
33413099251,1cyclictest526616-21idleruntime-cro00:35:013
33413099250,24cyclictest364244-21turbostat.cron20:00:013
33413099250,24cyclictest0-21swapper/321:40:123
33412299253,4cyclictest0-21swapper/023:04:370
33412299253,4cyclictest0-21swapper/019:24:560
334122992524,1cyclictest0-21swapper/000:20:130
33412299250,24cyclictest364246-21sendmail20:00:020
33414099240,23cyclictest0-21swapper/721:50:127
33414099240,23cyclictest0-21swapper/721:35:137
33414099240,22cyclictest0-21swapper/723:30:207
334136992422,1cyclictest361308-21munin-run19:55:016
33413699240,23cyclictest373548-21apt-get20:15:126
33413699240,23cyclictest0-21swapper/621:10:136
33413699240,22cyclictest476443-21ls23:10:026
334134992422,1cyclictest0-21swapper/522:05:225
334134992422,1cyclictest0-21swapper/500:30:215
334133992421,3cyclictest0-21swapper/422:15:014
334133992420,4cyclictest0-21swapper/400:00:014
334133992420,3cyclictest0-21swapper/423:35:124
33413399240,23cyclictest0-21swapper/421:50:014
33413399240,23cyclictest0-21swapper/420:30:164
33413399240,23cyclictest0-21swapper/420:05:134
33413399240,23cyclictest0-21swapper/419:45:154
33413099240,24cyclictest0-21swapper/323:25:143
334128992422,2cyclictest423792-21apt-get21:40:132
33412899240,24cyclictest0-21swapper/200:15:192
33412899240,23cyclictest0-21swapper/220:05:122
33412899240,1cyclictest0-21swapper/220:15:132
33412899240,0cyclictest0-21swapper/200:30:142
334124992423,1cyclictest0-21swapper/119:40:201
33412499240,0cyclictest0-21swapper/100:15:041
334122992423,1cyclictest485717-21apt-get23:25:130
334122992422,1cyclictest509308-21apt-get00:05:170
33412299240,3cyclictest484059-21ntpq23:20:190
33412299240,23cyclictest0-21swapper/022:10:120
334140992322,1cyclictest352903-21apt-get19:40:137
334140992321,1cyclictest370570-21apt-get20:10:127
334140992321,1cyclictest0-21swapper/723:25:127
33414099230,22cyclictest506366-21apt-get00:00:127
33414099230,22cyclictest0-21swapper/722:55:137
33414099230,22cyclictest0-21swapper/722:15:117
33414099230,22cyclictest0-21swapper/720:40:127
33414099230,22cyclictest0-21swapper/720:40:117
33414099230,22cyclictest0-21swapper/720:35:147
33414099230,22cyclictest0-21swapper/719:15:197
334136992321,1cyclictest364692-21apt-get20:00:136
334136992321,1cyclictest0-21swapper/619:15:136
334136992319,3cyclictest373106-21idleruntime-cro20:15:016
33413699230,1cyclictest526617-21basename00:35:016
33413699230,1cyclictest397170-21apt-get20:55:146
33413699230,0cyclictest423792-21apt-get21:40:126
334134992323,0cyclictest0-21swapper/500:10:135
334134992322,1cyclictest491612-21apt-get23:35:125
334134992322,1cyclictest0-21swapper/519:45:205
334134992321,1cyclictest711ktimers/520:40:015
334134992321,1cyclictest0-21swapper/522:50:175
334134992321,1cyclictest0-21swapper/519:25:135
33413499230,2cyclictest373082-21munin-plugin-st20:15:015
33413499230,22cyclictest485292-21munin-run23:25:015
33413499230,22cyclictest456201-21apt-get22:35:115
33413499230,22cyclictest0-21swapper/522:20:015
33413499230,22cyclictest0-21swapper/521:50:135
33413499230,22cyclictest0-21swapper/521:25:215
33413499230,22cyclictest0-21swapper/521:05:015
33413499230,22cyclictest0-21swapper/520:30:165
334133992320,2cyclictest396763-21basename20:55:024
334133992318,4cyclictest0-21swapper/419:20:124
33413399230,22cyclictest0-21swapper/423:30:134
33413399230,22cyclictest0-21swapper/422:00:024
33413399230,22cyclictest0-21swapper/421:50:124
334130992323,0cyclictest0-21swapper/320:35:133
334130992321,1cyclictest0-21swapper/320:00:123
334130992321,1cyclictest0-21swapper/319:35:123
33413099231,1cyclictest476868-21apt-get23:10:113
33413099230,23cyclictest416205-21ntpq21:25:203
33413099230,22cyclictest459165-21apt-get22:40:123
33413099230,22cyclictest0-21swapper/320:50:053
33413099230,22cyclictest0-21swapper/300:05:173
33413099230,1cyclictest519502-21ntpq00:20:203
33413099230,1cyclictest432617-21apt-get21:55:133
33413099230,1cyclictest0-21swapper/319:25:013
33413099230,0cyclictest441461-21apt-get22:10:123
334128992322,1cyclictest492937-21ntpq23:35:182
334128992322,1cyclictest0-21swapper/221:55:012
334128992322,1cyclictest0-21swapper/219:30:132
33412899230,22cyclictest0-21swapper/223:55:142
33412899230,22cyclictest0-21swapper/223:40:132
33412899230,22cyclictest0-21swapper/222:25:182
33412899230,22cyclictest0-21swapper/221:15:132
33412899230,22cyclictest0-21swapper/220:15:012
334124992323,0cyclictest0-21swapper/123:05:181
33412499230,23cyclictest0-21swapper/122:45:131
33412499230,22cyclictest429249-21ls21:50:011
33412499230,22cyclictest0-21swapper/121:25:141
33412499230,1cyclictest0-21swapper/122:00:221
334122992320,2cyclictest361313-21perf19:55:010
33412299230,22cyclictest408991-21apt-get21:15:130
33412299230,22cyclictest385348-21apt-get20:35:140
33412299230,22cyclictest0-21swapper/023:35:120
33412299230,22cyclictest0-21swapper/022:40:120
33412299230,1cyclictest0-21swapper/020:45:020
33412299230,1cyclictest0-21swapper/020:45:010
33412299230,0cyclictest0-21swapper/021:55:130
334140992221,1cyclictest369007-21ntpq20:05:197
334140992221,1cyclictest0-21swapper/723:10:127
334140992221,1cyclictest0-21swapper/723:05:137
334140992220,1cyclictest346574-21ls19:30:017
33414099220,21cyclictest0-21swapper/722:10:127
33414099220,21cyclictest0-21swapper/721:55:207
33414099220,21cyclictest0-21swapper/721:45:127
33414099220,21cyclictest0-21swapper/721:40:127
33414099220,21cyclictest0-21swapper/721:30:037
33414099220,21cyclictest0-21swapper/720:15:037
33414099220,21cyclictest0-21swapper/719:50:137
33414099220,21cyclictest0-21swapper/700:40:017
33414099220,21cyclictest0-21swapper/700:40:017
33414099220,21cyclictest0-21swapper/700:30:147
33414099220,21cyclictest0-21swapper/700:05:237
33414099220,1cyclictest436948-21ntp_states22:00:227
33414099220,1cyclictest0-21swapper/723:25:017
33414099220,0cyclictest0-21swapper/721:20:137
334136992222,0cyclictest0-21swapper/621:30:046
334136992221,1cyclictest500454-21apt-get23:50:126
334136992220,1cyclictest503398-21apt-get23:55:136
334136992220,1cyclictest488668-21apt23:30:136
334136992220,1cyclictest346999-21apt-get19:30:136
334136992220,1cyclictest0-21swapper/621:35:146
334136992220,1cyclictest0-21swapper/621:05:036
334136992220,1cyclictest0-21swapper/620:30:166
334136992220,1cyclictest0-21swapper/600:10:126
33413699220,2cyclictest364245-21dump-pmu-power20:00:016
33413699220,22cyclictest370165-21basename20:10:016
33413699220,21cyclictest393756-21apt-get20:50:046
33413699220,21cyclictest379455-21apt-get20:25:136
33413699220,21cyclictest351221-21ntpq19:35:186
33413699220,21cyclictest0-21swapper/623:10:116
33413699220,21cyclictest0-21swapper/621:20:146
33413699220,21cyclictest0-21swapper/620:40:126
33413699220,21cyclictest0-21swapper/620:40:116
33413699220,21cyclictest0-21swapper/600:05:176
33413699220,1cyclictest0-21swapper/619:25:026
334134992221,0cyclictest0-21swapper/520:15:035
334134992220,1cyclictest0-21swapper/520:00:125
334134992217,4cyclictest438111-21awk22:05:015
33413499220,22cyclictest0-21swapper/522:45:035
33413499220,21cyclictest402715-21appstreamcli21:05:035
33413499220,21cyclictest0-21swapper/523:50:115
33413499220,21cyclictest0-21swapper/523:25:135
33413499220,21cyclictest0-21swapper/522:40:125
33413499220,21cyclictest0-21swapper/521:45:125
33413499220,21cyclictest0-21swapper/521:35:135
33413499220,21cyclictest0-21swapper/521:30:135
33413499220,21cyclictest0-21swapper/519:40:135
33413499220,21cyclictest0-21swapper/500:35:135
33413499220,21cyclictest0-21swapper/500:35:135
33413499220,21cyclictest0-21swapper/500:00:135
33413499220,1cyclictest0-21swapper/520:40:135
33413499220,1cyclictest0-21swapper/520:40:125
334133992222,0cyclictest0-21swapper/419:10:194
334133992220,2cyclictest0-21swapper/423:15:134
334133992220,2cyclictest0-21swapper/421:15:134
33413399220,21cyclictest0-21swapper/423:45:114
33413399220,21cyclictest0-21swapper/422:50:184
33413399220,21cyclictest0-21swapper/422:45:034
33413399220,21cyclictest0-21swapper/422:05:134
33413399220,21cyclictest0-21swapper/420:55:144
33413399220,21cyclictest0-21swapper/420:50:024
33413399220,21cyclictest0-21swapper/419:40:134
33413399220,21cyclictest0-21swapper/400:20:134
334130992221,1cyclictest497514-21apt-get23:45:113
334130992221,1cyclictest470987-21apt-get23:00:123
334130992221,1cyclictest0-21swapper/321:05:123
334130992220,1cyclictest0-21swapper/320:55:153
334130992220,1cyclictest0-21swapper/320:40:113
334130992220,1cyclictest0-21swapper/320:40:113
334130992220,1cyclictest0-21swapper/320:10:113
334130992220,1cyclictest0-21swapper/319:40:143
33413099220,22cyclictest429251-21munin-run21:50:013
33413099220,1cyclictest0-21swapper/321:20:143
334128992221,1cyclictest528317-21ntpq00:35:192
334128992221,1cyclictest528317-21ntpq00:35:192
334128992221,1cyclictest0-21swapper/223:15:012
334128992221,1cyclictest0-21swapper/220:55:152
334128992219,3cyclictest393793-21http20:50:012
33412899220,22cyclictest0-21swapper/221:30:132
33412899220,21cyclictest0-21swapper/222:50:112
33412899220,21cyclictest0-21swapper/220:40:112
33412899220,21cyclictest0-21swapper/220:40:112
33412899220,21cyclictest0-21swapper/219:55:122
33412899220,21cyclictest0-21swapper/219:10:132
33412899220,21cyclictest0-21swapper/200:05:172
33412899220,1cyclictest454527-21ntpq22:30:182
33412899220,1cyclictest449897-21perf22:25:012
33412899220,1cyclictest0-21swapper/223:50:112
334124992222,0cyclictest0-21swapper/122:35:181
334124992221,1cyclictest334451-21apt-get19:10:141
334124992218,3cyclictest482333-21dump-pmu-power23:20:011
33412499220,21cyclictest0-21swapper/123:45:111
33412499220,21cyclictest0-21swapper/122:15:111
33412499220,21cyclictest0-21swapper/120:35:131
33412499220,1cyclictest502965-21apt23:55:021
33412499220,1cyclictest0-21swapper/121:10:131
33412299224,0cyclictest0-21swapper/019:35:550
33412299223,18cyclictest0-21swapper/022:20:410
334122992222,0cyclictest0-21swapper/021:10:140
33412299220,22cyclictest517799-21awk00:20:010
33412299220,22cyclictest0-21swapper/021:40:190
33412299220,21cyclictest382402-21apt-get20:30:160
33412299220,21cyclictest0-21swapper/022:30:130
33412299220,21cyclictest0-21swapper/021:25:200
33412299220,21cyclictest0-21swapper/021:20:140
33412299220,21cyclictest0-21swapper/020:55:140
33412299220,21cyclictest0-21swapper/020:00:120
33412299220,1cyclictest0-21swapper/019:45:140
334140992121,0cyclictest0-21swapper/723:00:137
334140992120,1cyclictest404451-21ntpq21:05:187
334140992120,1cyclictest0-21swapper/722:45:037
334140992120,1cyclictest0-21swapper/721:10:147
334140992120,1cyclictest0-21swapper/719:55:137
334140992120,1cyclictest0-21swapper/700:15:017
334140992120,0cyclictest0-21swapper/722:05:137
334140992119,1cyclictest0-21swapper/722:40:137
33414099210,20cyclictest0-21swapper/700:15:037
33414099210,1cyclictest355846-21apt-get19:45:157
33414099210,1cyclictest0-21swapper/721:00:127
33414099210,0cyclictest0-21swapper/722:25:127
33414099210,0cyclictest0-21swapper/720:00:137
33414099210,0cyclictest0-21swapper/719:20:127
334136992121,0cyclictest0-21swapper/619:10:126
334136992120,1cyclictest791rcuc/620:25:016
334136992120,1cyclictest461747-21appstreamcli22:45:016
334136992120,1cyclictest0-21swapper/621:50:206
334136992120,1cyclictest0-21swapper/621:15:146
334136992120,0cyclictest0-21swapper/600:15:136
334136992119,1cyclictest0-21swapper/622:55:126
33413699210,0cyclictest0-21swapper/623:35:176
334134992121,0cyclictest0-21swapper/519:15:135
334134992121,0cyclictest0-21swapper/500:25:135
334134992120,1cyclictest453260-21apt-get22:30:145
334134992120,1cyclictest0-21swapper/521:40:125
334134992120,1cyclictest0-21swapper/520:05:145
334134992119,1cyclictest0-21swapper/521:20:015
33413499210,20cyclictest0-21swapper/522:10:125
33413499210,20cyclictest0-21swapper/520:50:135
33413499210,0cyclictest0-21swapper/522:20:125
33413499210,0cyclictest0-21swapper/520:45:135
334133992121,0cyclictest0-21swapper/420:40:114
334133992121,0cyclictest0-21swapper/420:40:114
334133992121,0cyclictest0-21swapper/420:20:134
334133992120,1cyclictest0-21swapper/419:25:204
334133992120,1cyclictest0-21swapper/400:05:234
334133992119,2cyclictest0-21swapper/422:55:174
334133992119,2cyclictest0-21swapper/422:15:174
334133992119,1cyclictest0-21swapper/422:20:134
33413399210,21cyclictest0-21swapper/421:30:144
33413399210,20cyclictest408822-21sort21:15:024
33413399210,20cyclictest0-21swapper/423:25:134
33413399210,20cyclictest0-21swapper/422:00:154
33413399210,1cyclictest0-21swapper/420:35:134
33413399210,0cyclictest0-21swapper/422:25:124
334130992121,0cyclictest0-21swapper/322:45:193
334130992121,0cyclictest0-21swapper/321:30:053
334130992121,0cyclictest0-21swapper/319:55:013
334130992120,0cyclictest0-21swapper/322:50:113
334130992120,0cyclictest0-21swapper/319:15:133
334130992120,0cyclictest0-21swapper/300:15:133
334130992119,2cyclictest446947-21systemctl22:20:013
334130992119,1cyclictest521142-21apt-get00:25:133
334130992119,1cyclictest488669-21apt-get23:30:143
334130992119,1cyclictest400131-21apt-get21:00:123
334130992119,1cyclictest367631-21apt-get20:05:123
334130992119,1cyclictest0-21swapper/323:40:123
334130992119,1cyclictest0-21swapper/321:35:153
334130992119,1cyclictest0-21swapper/320:20:133
33413099210,21cyclictest0-21swapper/322:20:133
33413099210,21cyclictest0-21swapper/320:25:133
33413099210,21cyclictest0-21swapper/320:15:133
33413099210,0cyclictest391248-21apt-get20:45:123
33413099210,0cyclictest0-21swapper/323:35:123
334128992121,0cyclictest0-21swapper/222:45:132
334128992121,0cyclictest0-21swapper/222:40:132
334128992121,0cyclictest0-21swapper/222:00:142
334128992121,0cyclictest0-21swapper/221:45:192
334128992121,0cyclictest0-21swapper/200:00:132
334128992120,1cyclictest0-21swapper/222:40:002
334128992120,1cyclictest0-21swapper/221:00:202
33412899210,21cyclictest0-21swapper/219:35:122
33412899210,21cyclictest0-21swapper/219:20:122
33412899210,1cyclictest0-21swapper/219:50:222
33412899210,0cyclictest0-21swapper/220:50:122
33412899210,0cyclictest0-21swapper/220:20:142
33412899210,0cyclictest0-21swapper/219:45:162
334124992121,0cyclictest417491-21appstreamcli21:30:041
334124992121,0cyclictest0-21swapper/121:35:201
334124992121,0cyclictest0-21swapper/121:05:051
334124992121,0cyclictest0-21swapper/119:55:121
334124992121,0cyclictest0-21swapper/119:30:131
334124992120,1cyclictest527025-21apt-get00:35:141
334124992120,1cyclictest527025-21apt-get00:35:131
334124992120,1cyclictest453260-21apt-get22:30:121
334124992120,1cyclictest450316-21apt-get22:25:131
334124992120,1cyclictest411957-21apt-get21:20:131
33412499210,21cyclictest0-21swapper/121:50:121
33412499210,21cyclictest0-21swapper/121:00:121
33412499210,21cyclictest0-21swapper/120:20:131
33412499210,21cyclictest0-21swapper/120:00:131
33412499210,21cyclictest0-21swapper/100:00:181
33412499210,0cyclictest0-21swapper/123:55:131
33412499210,0cyclictest0-21swapper/121:55:131
33412499210,0cyclictest0-21swapper/100:10:121
334122992121,0cyclictest0-21swapper/021:30:030
334122992121,0cyclictest0-21swapper/020:15:130
334122992120,1cyclictest0-21swapper/022:45:190
334122992120,0cyclictest0-21swapper/021:05:040
334122992119,2cyclictest242679-21kworker/0:1+events22:35:180
334122992119,1cyclictest494575-21apt-get23:40:130
334122992119,1cyclictest465084-21apt-get22:50:120
334122992119,1cyclictest0-21swapper/019:15:140
334122992117,3cyclictest423396-21systemd-run21:40:010
33412299210,21cyclictest0-21swapper/020:10:010
33412299210,0cyclictest0-21swapper/023:10:120
33412299210,0cyclictest0-21swapper/020:45:120
334140992020,0cyclictest0-21swapper/722:50:127
334140992020,0cyclictest0-21swapper/721:00:017
334140992020,0cyclictest0-21swapper/719:30:137
334140992019,1cyclictest0-21swapper/721:30:017
334140992019,0cyclictest0-21swapper/723:55:147
334140992018,1cyclictest0-21swapper/719:15:017
33414099200,20cyclictest0-21swapper/723:20:017
33414099200,1cyclictest0-21swapper/720:45:127
33414099200,19cyclictest0-21swapper/700:25:137
33414099200,0cyclictest0-21swapper/722:40:007
334136992020,0cyclictest0-21swapper/623:40:126
334136992020,0cyclictest0-21swapper/622:50:116
334136992020,0cyclictest0-21swapper/622:05:126
334136992020,0cyclictest0-21swapper/619:25:136
334136992019,1cyclictest0-21swapper/622:25:146
334136992019,1cyclictest0-21swapper/600:25:136
334136992018,1cyclictest0-21swapper/622:35:116
334136992018,1cyclictest0-21swapper/600:35:136
334136992018,1cyclictest0-21swapper/600:35:126
33413699200,0cyclictest0-21swapper/619:40:136
334134992020,0cyclictest0-21swapper/523:00:125
334134992020,0cyclictest0-21swapper/519:10:125
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional