You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 06:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Tue Jul 28, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
569532248174,23sleep30-21swapper/319:08:293
568512237199,25sleep20-21swapper/219:07:012
569572227193,22sleep70-21swapper/719:08:347
568532220183,25sleep40-21swapper/419:07:024
545312218180,25sleep60-21swapper/619:05:036
570492217185,21sleep50-21swapper/519:09:525
567912217186,20sleep10-21swapper/119:06:111
570532215176,25sleep00-21swapper/019:09:560
1651772530,0sleep40-21swapper/422:10:134
5726699280,21cyclictest128755-21sh21:10:001
5727299270,23cyclictest219069-21ntpq23:40:193
5727299270,22cyclictest0-21swapper/322:25:203
5726699260,0cyclictest0-21swapper/119:55:131
5726399260,22cyclictest161207-21awk22:05:000
5728199250,24cyclictest181860-21idleruntime-cro22:40:007
57277992522,2cyclictest134655-21grep21:19:595
5727799250,24cyclictest175958-21munin-run22:29:595
5727499251,23cyclictest146467-21awk21:40:004
5727299250,24cyclictest0-21swapper/320:10:043
5726699253,22cyclictest0-21swapper/100:00:001
5726699250,1cyclictest112824-21ntpq20:40:181
5726699250,0cyclictest0-21swapper/120:25:121
57263992523,1cyclictest241614-21cron00:20:010
57263992523,1cyclictest0-21swapper/020:20:010
5728199240,2cyclictest78607-21turbostat19:45:017
5728199240,24cyclictest1-21systemd20:20:017
57278992422,2cyclictest214299-21923:35:006
5727799240,23cyclictest173203-21date22:25:015
57274992420,3cyclictest238101-21latency_hist00:15:004
57272992422,1cyclictest0-21swapper/300:10:133
57272992421,2cyclictest72705-21apt19:35:013
57272992420,3cyclictest0-21swapper/322:20:173
5727299240,22cyclictest223565-21apt-get23:50:133
5727299240,21cyclictest229474-21apt-get00:00:123
5727299240,21cyclictest0-21swapper/321:40:113
5727299240,1cyclictest76100-21apt-get19:40:133
5727299240,1cyclictest0-21swapper/321:10:003
5727299240,0cyclictest0-21swapper/322:15:203
5727299240,0cyclictest0-21swapper/321:50:133
57267992423,0cyclictest0-21swapper/222:55:142
57267992419,4cyclictest152341-21turbostat21:50:002
57267992419,4cyclictest146421-21cron21:39:592
5726799240,23cyclictest0-21swapper/223:40:122
57266992422,2cyclictest214725-21apt-get23:35:151
57266992419,4cyclictest250481-21munin-run00:35:001
5726699240,23cyclictest74439-21ntpq19:35:191
5726699240,23cyclictest0-21swapper/122:40:131
57263992424,0cyclictest0-21swapper/023:30:130
57263992422,1cyclictest0-21swapper/020:30:010
57281992321,1cyclictest205852-21apt-get23:20:117
5728199230,23cyclictest0-21swapper/723:45:187
5728199230,22cyclictest245025-21apt-get00:25:127
5727899230,22cyclictest234932-21grep00:10:006
5727899230,1cyclictest60117-21perf19:15:016
57277992323,0cyclictest0-21swapper/520:00:145
57277992322,1cyclictest217686-21apt-get23:40:135
57277992322,1cyclictest0-21swapper/500:35:015
57274992321,2cyclictest217272-21tr23:40:004
57274992319,3cyclictest0-21swapper/423:05:004
5727499230,22cyclictest241630-21latency_hist00:20:004
5727499230,22cyclictest0-21swapper/423:25:144
5727499230,22cyclictest0-21swapper/421:20:114
5727499230,22cyclictest0-21swapper/421:15:134
5727499230,22cyclictest0-21swapper/419:55:154
5727499230,22cyclictest0-21swapper/419:40:204
5727499230,1cyclictest0-21swapper/419:50:124
57272992320,3cyclictest191108-21apt-get22:55:143
57272992320,3cyclictest0-21swapper/323:35:133
57272992319,3cyclictest0-21swapper/320:45:143
5727299230,22cyclictest0-21swapper/319:20:123
57267992323,0cyclictest126256-21apt-get21:05:142
57267992321,1cyclictest196576-21apt23:05:012
57267992321,1cyclictest0-21swapper/223:10:182
57267992319,4cyclictest0-21swapper/220:10:012
5726799230,23cyclictest0-21swapper/223:50:172
5726799230,22cyclictest0-21swapper/221:25:192
5726799230,22cyclictest0-21swapper/221:15:142
5726799230,22cyclictest0-21swapper/220:25:192
5726799230,0cyclictest0-21swapper/220:00:142
57266992322,1cyclictest96738-21apt-get20:15:121
57266992322,1cyclictest0-21swapper/119:35:011
57266992321,2cyclictest0-21swapper/122:20:101
5726699230,3cyclictest134628-21cron21:20:001
5726699230,23cyclictest0-21swapper/100:10:141
5726699230,22cyclictest0-21swapper/120:20:131
5726699230,0cyclictest0-21swapper/120:05:131
57263992323,0cyclictest0-21swapper/022:45:130
57263992323,0cyclictest0-21swapper/022:45:120
57263992323,0cyclictest0-21swapper/000:35:110
57263992320,3cyclictest226092-21idleruntime-cro23:55:000
5726399230,22cyclictest0-21swapper/021:50:110
5726399230,22cyclictest0-21swapper/021:10:200
5726399230,22cyclictest0-21swapper/020:40:120
5726399230,22cyclictest0-21swapper/020:05:120
5726399230,22cyclictest0-21swapper/000:10:130
5726399230,1cyclictest161623-21apt-get22:05:130
57281992222,0cyclictest0-21swapper/719:30:127
57281992221,1cyclictest190684-21munin-run22:55:017
57281992221,1cyclictest190684-21munin-run22:55:007
57281992221,1cyclictest120356-21apt-get20:55:147
57281992221,1cyclictest0-21swapper/721:40:007
57281992221,1cyclictest0-21swapper/720:40:187
57281992221,1cyclictest0-21swapper/700:10:137
5728199220,21cyclictest176387-21apt-get22:30:147
5728199220,21cyclictest0-21swapper/723:55:137
5728199220,21cyclictest0-21swapper/723:25:147
5728199220,21cyclictest0-21swapper/721:45:167
5728199220,21cyclictest0-21swapper/719:15:447
5728199220,1cyclictest250905-21apt-get00:35:127
57278992222,0cyclictest0-21swapper/622:55:216
57278992221,1cyclictest69773-21munin-run19:30:006
57278992221,1cyclictest0-21swapper/620:20:016
5727899220,22cyclictest0-21swapper/600:15:186
5727899220,21cyclictest0-21swapper/623:25:136
5727899220,21cyclictest0-21swapper/621:20:126
5727899220,21cyclictest0-21swapper/621:05:136
5727899220,21cyclictest0-21swapper/621:00:146
5727899220,21cyclictest0-21swapper/619:30:126
5727899220,1cyclictest188166-21apt-get22:50:126
5727899220,1cyclictest188166-21apt-get22:50:126
5727899220,0cyclictest0-21swapper/622:15:146
57277992222,0cyclictest0-21swapper/523:50:185
57277992222,0cyclictest0-21swapper/500:15:165
57277992221,1cyclictest0-21swapper/520:25:205
57277992221,1cyclictest0-21swapper/520:15:125
5727799220,22cyclictest65540-21ntpq19:20:175
5727799220,22cyclictest0-21swapper/519:10:135
5727799220,21cyclictest0-21swapper/522:20:005
5727799220,21cyclictest0-21swapper/521:30:135
5727799220,21cyclictest0-21swapper/520:30:135
5727799220,1cyclictest232422-21apt-get00:05:135
5727799220,1cyclictest214725-21apt-get23:35:145
5727799220,1cyclictest114476-21apt-get20:45:135
5727799220,1cyclictest0-21swapper/521:14:595
57274992222,0cyclictest0-21swapper/419:20:124
57274992221,0cyclictest0-21swapper/423:30:134
57274992220,1cyclictest0-21swapper/422:25:214
5727499220,22cyclictest0-21swapper/423:05:134
5727499220,21cyclictest611rcuc/420:05:014
5727499220,21cyclictest0-21swapper/423:40:124
5727499220,21cyclictest0-21swapper/423:20:124
5727499220,21cyclictest0-21swapper/422:05:124
5727499220,21cyclictest0-21swapper/422:00:114
5727499220,21cyclictest0-21swapper/420:40:124
5727499220,21cyclictest0-21swapper/420:10:034
5727499220,0cyclictest0-21swapper/423:15:134
5727499220,0cyclictest0-21swapper/400:30:134
57272992222,0cyclictest0-21swapper/322:40:123
57272992222,0cyclictest0-21swapper/322:00:123
57272992221,1cyclictest202472-21awk23:15:013
57272992221,1cyclictest0-21swapper/323:20:123
57272992221,1cyclictest0-21swapper/320:55:123
57272992221,1cyclictest0-21swapper/300:30:133
5727299220,2cyclictest3422186-21systemd-journal21:20:003
5727299220,22cyclictest195375-21awk23:00:183
5727299220,21cyclictest123315-21apt-get21:00:143
5727299220,21cyclictest0-21swapper/323:55:143
5727299220,1cyclictest0-21swapper/323:45:183
5727299220,1cyclictest0-21swapper/300:35:123
57267992221,1cyclictest0-21swapper/221:55:212
57267992221,1cyclictest0-21swapper/221:20:122
57267992221,1cyclictest0-21swapper/219:45:112
57267992221,1cyclictest0-21swapper/200:15:022
5726799220,22cyclictest211746-21apt-get23:30:142
5726799220,22cyclictest0-21swapper/221:50:132
5726799220,22cyclictest0-21swapper/220:20:022
5726799220,22cyclictest0-21swapper/220:15:132
5726799220,22cyclictest0-21swapper/200:40:002
5726799220,21cyclictest0-21swapper/222:25:132
5726799220,21cyclictest0-21swapper/222:05:122
5726799220,21cyclictest0-21swapper/221:00:132
5726799220,21cyclictest0-21swapper/219:30:132
5726799220,1cyclictest140990-21apt-get21:30:122
5726799220,1cyclictest114054-21awk20:45:002
5726799220,1cyclictest0-21swapper/223:35:042
57266992222,0cyclictest0-21swapper/123:20:121
57266992222,0cyclictest0-21swapper/100:25:171
57266992221,1cyclictest0-21swapper/122:55:141
57266992221,1cyclictest0-21swapper/122:15:181
57266992221,1cyclictest0-21swapper/121:25:001
57266992221,1cyclictest0-21swapper/121:00:191
57266992220,2cyclictest0-21swapper/120:00:191
57266992220,1cyclictest0-21swapper/122:35:131
57266992220,1cyclictest0-21swapper/120:45:141
57266992219,3cyclictest0-21swapper/119:20:111
57266992216,0cyclictest0-21swapper/121:40:171
5726699220,22cyclictest0-21swapper/122:30:001
5726699220,22cyclictest0-21swapper/119:50:191
5726699220,21cyclictest0-21swapper/121:55:211
5726699220,21cyclictest0-21swapper/120:55:121
5726699220,1cyclictest226082-21munin-run23:55:001
57263992222,0cyclictest0-21swapper/022:40:010
57263992221,1cyclictest0-21swapper/020:35:120
5726399220,22cyclictest61331-21apt-get19:15:430
5726399220,22cyclictest0-21swapper/020:35:000
5726399220,21cyclictest138047-21apt-get21:25:140
5726399220,21cyclictest0-21swapper/023:45:130
5726399220,21cyclictest0-21swapper/022:55:140
5726399220,21cyclictest0-21swapper/021:00:140
5726399220,21cyclictest0-21swapper/020:55:140
5726399220,1cyclictest0-21swapper/023:55:130
57281992121,0cyclictest0-21swapper/700:15:117
57281992121,0cyclictest0-21swapper/700:05:147
57281992120,1cyclictest99345-21appstreamcli20:20:037
57281992120,1cyclictest173441-21apt-get22:25:127
57281992120,1cyclictest165877-21ntpq22:10:187
57281992120,1cyclictest0-21swapper/723:50:127
57281992120,1cyclictest0-21swapper/722:55:147
57281992120,1cyclictest0-21swapper/719:35:137
57281992120,1cyclictest0-21swapper/700:00:127
5728199210,21cyclictest0-21swapper/720:25:147
5728199210,21cyclictest0-21swapper/719:50:127
5728199210,20cyclictest0-21swapper/723:35:157
5728199210,20cyclictest0-21swapper/719:20:167
5728199210,1cyclictest0-21swapper/723:40:207
5728199210,0cyclictest0-21swapper/723:10:137
57278992121,0cyclictest0-21swapper/623:45:136
57278992121,0cyclictest0-21swapper/623:40:126
57278992121,0cyclictest0-21swapper/623:20:116
57278992121,0cyclictest0-21swapper/620:50:126
57278992121,0cyclictest0-21swapper/619:20:126
57278992120,1cyclictest79040-21apt-get19:45:126
57278992120,1cyclictest105220-21idleruntime-cro20:30:016
57278992120,1cyclictest0-21swapper/622:35:136
57278992120,1cyclictest0-21swapper/622:20:106
57278992120,1cyclictest0-21swapper/621:40:126
57278992120,0cyclictest0-21swapper/622:45:136
57278992120,0cyclictest0-21swapper/622:45:136
5727899210,21cyclictest201230-21ntpq23:10:196
5727899210,21cyclictest111533-21apt-get20:40:116
5727899210,21cyclictest0-21swapper/623:55:206
5727899210,21cyclictest0-21swapper/621:45:106
5727899210,21cyclictest0-21swapper/620:55:146
5727899210,21cyclictest0-21swapper/620:35:126
5727899210,21cyclictest0-21swapper/600:20:136
5727899210,20cyclictest0-21swapper/621:25:146
5727899210,20cyclictest0-21swapper/620:05:126
57277992121,0cyclictest0-21swapper/522:55:135
57277992121,0cyclictest0-21swapper/522:50:125
57277992121,0cyclictest0-21swapper/522:50:115
57277992121,0cyclictest0-21swapper/522:05:145
57277992121,0cyclictest0-21swapper/500:39:595
57277992120,1cyclictest77491-21ntpq19:40:205
57277992120,1cyclictest197009-21apt-get23:05:135
57277992120,1cyclictest109958-21ntpq20:35:205
57277992120,1cyclictest0-21swapper/522:45:195
57277992120,1cyclictest0-21swapper/522:45:195
57277992120,1cyclictest0-21swapper/520:20:135
57277992119,1cyclictest0-21swapper/522:30:135
57277992118,3cyclictest196583-21munin-plugin-st23:05:015
5727799210,21cyclictest182288-21apt-get22:40:135
5727799210,21cyclictest155715-21apt-get21:55:145
5727799210,21cyclictest117413-21apt-get20:50:125
5727799210,21cyclictest0-21swapper/521:50:125
5727799210,21cyclictest0-21swapper/521:35:135
5727799210,20cyclictest0-21swapper/520:44:595
5727799210,1cyclictest128768-21munin-run21:10:005
5727799210,0cyclictest0-21swapper/521:40:125
57274992121,0cyclictest226507-21apt-get23:55:144
57274992121,0cyclictest0-21swapper/422:40:114
57274992120,1cyclictest63-21ksoftirqd/419:35:134
57274992120,1cyclictest0-21swapper/419:15:444
57274992120,0cyclictest0-21swapper/420:30:184
5727499211,19cyclictest158219-21turbostat.cron21:59:594
5727499210,20cyclictest0-21swapper/423:10:144
5727499210,20cyclictest0-21swapper/419:45:114
5727499210,0cyclictest0-21swapper/420:05:134
5727499210,0cyclictest0-21swapper/400:05:134
57272992121,0cyclictest0-21swapper/321:55:213
57272992121,0cyclictest0-21swapper/320:25:133
57272992121,0cyclictest0-21swapper/319:50:193
57272992120,1cyclictest176387-21apt-get22:30:133
57272992120,1cyclictest0-21swapper/323:30:143
57272992119,2cyclictest0-21swapper/320:00:203
5727299210,21cyclictest93347-21awk20:10:013
5727299210,21cyclictest0-21swapper/321:30:123
5727299210,21cyclictest0-21swapper/320:20:123
5727299210,21cyclictest0-21swapper/300:25:133
5727299210,21cyclictest0-21swapper/300:20:123
5727299210,0cyclictest0-21swapper/321:20:113
5727299210,0cyclictest0-21swapper/320:50:123
57267992121,0cyclictest0-21swapper/219:25:122
57267992121,0cyclictest0-21swapper/200:00:132
57267992120,1cyclictest179328-21apt-get22:35:122
57267992120,1cyclictest0-21swapper/200:25:122
5726799210,21cyclictest0-21swapper/222:50:122
5726799210,21cyclictest0-21swapper/222:50:122
5726799210,21cyclictest0-21swapper/222:40:112
5726799210,21cyclictest0-21swapper/222:20:172
5726799210,21cyclictest0-21swapper/219:50:112
5726799210,1cyclictest0-21swapper/222:20:002
5726799210,0cyclictest0-21swapper/220:30:192
5726799210,0cyclictest0-21swapper/219:40:212
57266992121,0cyclictest0-21swapper/121:35:111
57266992121,0cyclictest0-21swapper/100:35:131
57266992120,1cyclictest0-21swapper/123:05:111
57266992120,1cyclictest0-21swapper/100:15:031
57266992118,3cyclictest106938-21ntpq20:30:181
57266992117,4cyclictest0-21swapper/122:14:591
57266992116,5cyclictest0-21swapper/120:35:131
57266992115,1cyclictest0-21swapper/123:40:131
5726699210,21cyclictest0-21swapper/122:50:121
5726699210,21cyclictest0-21swapper/122:50:121
5726699210,21cyclictest0-21swapper/119:15:421
5726699210,15cyclictest0-21swapper/122:35:001
5726699210,0cyclictest0-21swapper/121:25:141
57263992121,0cyclictest0-21swapper/023:35:030
57263992121,0cyclictest0-21swapper/021:05:140
57263992121,0cyclictest0-21swapper/020:20:130
57263992121,0cyclictest0-21swapper/000:04:270
57263992120,1cyclictest70197-21apt-get19:30:120
57263992120,1cyclictest199949-21apt-get23:10:130
57263992120,1cyclictest199537-21sleep23:10:010
57263992120,1cyclictest172971-21apt-get22:25:030
57263992120,1cyclictest0-21swapper/021:30:130
57263992120,1cyclictest0-21swapper/021:20:120
57263992120,1cyclictest0-21swapper/020:00:120
57263992120,1cyclictest0-21swapper/019:40:190
57263992120,0cyclictest0-21swapper/019:20:110
57263992119,1cyclictest93798-21apt-get20:10:140
57263992119,1cyclictest0-21swapper/022:15:180
5726399210,21cyclictest0-21swapper/022:40:130
5726399210,0cyclictest0-21swapper/023:40:130
5726399210,0cyclictest0-21swapper/023:15:120
5726399210,0cyclictest0-21swapper/021:45:100
57281992020,0cyclictest0-21swapper/721:55:157
57281992020,0cyclictest0-21swapper/721:30:197
57281992020,0cyclictest0-21swapper/721:20:127
57281992020,0cyclictest0-21swapper/720:35:187
57281992020,0cyclictest0-21swapper/719:45:137
57281992019,1cyclictest0-21swapper/721:40:117
57281992019,1cyclictest0-21swapper/700:20:137
57281992018,1cyclictest0-21swapper/721:50:197
5728199200,20cyclictest0-21swapper/721:15:197
5728199200,20cyclictest0-21swapper/720:50:197
5728199200,1cyclictest0-21swapper/720:35:007
5728199200,0cyclictest0-21swapper/723:00:137
57278992020,0cyclictest0-21swapper/622:10:006
57278992020,0cyclictest0-21swapper/620:45:136
57278992020,0cyclictest0-21swapper/620:20:136
57278992020,0cyclictest0-21swapper/620:00:146
57278992020,0cyclictest0-21swapper/619:50:126
57278992020,0cyclictest0-21swapper/600:25:136
57278992019,1cyclictest202889-21apt-get23:15:126
57278992019,0cyclictest0-21swapper/621:50:126
57278992018,2cyclictest789-21dbus-daemon21:59:596
5727899200,0cyclictest0-21swapper/620:10:136
57277992020,0cyclictest0-21swapper/523:10:135
57277992020,0cyclictest0-21swapper/521:00:145
57277992020,0cyclictest0-21swapper/519:50:125
57277992020,0cyclictest0-21swapper/519:30:125
57277992019,1cyclictest137607-21cron21:24:595
5727799200,0cyclictest231921-40updatedb.plocat00:04:265
57274992020,0cyclictest108574-21apt-get20:35:134
57274992020,0cyclictest0-21swapper/423:50:134
57274992020,0cyclictest0-21swapper/421:55:004
57274992020,0cyclictest0-21swapper/420:20:124
57274992019,1cyclictest0-21swapper/420:25:134
57274992019,0cyclictest0-21swapper/420:55:144
5727499200,19cyclictest0-21swapper/422:55:124
5727499200,19cyclictest0-21swapper/422:30:134
57272992020,0cyclictest0-21swapper/320:15:123
57272992020,0cyclictest0-21swapper/319:15:423
57272992019,1cyclictest105622-21apt-get20:30:133
57272992019,1cyclictest0-21swapper/322:05:123
57272992019,0cyclictest0-21swapper/321:35:113
57272992016,3cyclictest0-21swapper/322:14:593
57267992020,0cyclictest0-21swapper/222:30:142
57267992020,0cyclictest0-21swapper/220:55:132
57267992020,0cyclictest0-21swapper/220:50:132
57267992020,0cyclictest0-21swapper/219:55:132
57267992020,0cyclictest0-21swapper/219:10:182
57267992020,0cyclictest0-21swapper/200:30:192
57267992020,0cyclictest0-21swapper/200:10:132
57267992019,0cyclictest0-21swapper/220:35:132
5726799200,0cyclictest0-21swapper/222:45:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional