You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 06:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Wed Jun 17, 2026 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5890482268182,25sleep50-21swapper/519:06:465
5892312260176,24sleep40-21swapper/419:09:264
5889932259175,25sleep60-21swapper/619:05:586
5891752230167,53sleep20-21swapper/219:08:352
5890772224190,22sleep70-21swapper/719:07:127
5892032223182,26sleep30-21swapper/319:09:013
5891622222162,49sleep00-21swapper/019:08:260
5890332218180,25sleep10-21swapper/119:06:331
589492994513,18cyclictest608098-21latency_hist19:39:595
58948199290,28cyclictest0-21swapper/123:10:121
58948199290,25cyclictest761494-21date00:00:001
58948199280,24cyclictest672833-21idleruntime-cro21:30:001
58949399270,26cyclictest3422186-21systemd-journal23:45:006
589489992622,3cyclictest664328-21tar21:15:014
589487992621,4cyclictest655070-21idleruntime-cro21:00:003
58948199260,0cyclictest0-21swapper/121:40:101
589489992523,1cyclictest744054-21apt-get23:30:104
589487992521,4cyclictest0-21swapper/323:10:123
589487992520,5cyclictest646639-21apt-get20:45:123
58948799250,24cyclictest0-21swapper/320:40:133
589483992523,1cyclictest714110-21sendmail22:40:012
58948399250,24cyclictest0-21swapper/221:50:202
58948399250,24cyclictest0-21swapper/220:20:112
589481992520,4cyclictest637365-21dump-pmu-power20:29:591
58948199250,24cyclictest755437-21basename23:49:591
58948199250,21cyclictest0-21swapper/121:15:011
58947899250,24cyclictest0-21swapper/020:05:130
589497992423,1cyclictest0-21swapper/700:30:127
58949799240,24cyclictest733617-21ntp_states23:10:197
58949799240,23cyclictest777938-21ntpq00:25:187
589493992423,1cyclictest1-21systemd20:39:596
58949399240,23cyclictest0-21swapper/623:50:126
589492992423,1cyclictest696425-21cron22:10:015
58948999240,24cyclictest698135-21ntpq22:10:154
58948999240,23cyclictest761682-21tar00:00:004
589487992423,1cyclictest0-21swapper/300:05:153
589487992421,3cyclictest0-21swapper/319:30:023
589487992420,3cyclictest714099-21cron22:40:003
58948799240,23cyclictest599414-21apt-get19:25:143
58948799240,23cyclictest0-21swapper/321:10:123
58948799240,23cyclictest0-21swapper/300:00:033
58948799240,22cyclictest0-21swapper/319:45:113
58948399240,23cyclictest0-21swapper/200:25:122
58948399240,1cyclictest605338-21apt-get19:35:122
589481992420,3cyclictest0-21swapper/122:00:131
58948199240,23cyclictest0-21swapper/119:30:121
58948199240,23cyclictest0-21swapper/119:25:141
58948199240,0cyclictest0-21swapper/120:40:141
58947899240,24cyclictest708202-21cron22:30:010
58947899240,23cyclictest720009-21apt22:50:010
58947899240,23cyclictest0-21swapper/022:40:130
58949799230,23cyclictest602123-21date19:29:597
58949799230,22cyclictest664274-21latency_hist21:15:017
58949799230,22cyclictest634852-21apt-get20:25:137
589493992322,1cyclictest667349-21apt-get21:20:126
58949399230,22cyclictest770360-21appstreamcli00:15:026
58949399230,22cyclictest720442-21apt-get22:50:136
58949399230,22cyclictest608298-21apt-get19:40:126
589492992323,0cyclictest0-21swapper/523:50:185
589492992323,0cyclictest0-21swapper/521:40:115
589492992321,1cyclictest746999-21apt-get23:35:125
589492992319,3cyclictest711189-21idleruntime-cro22:35:005
589489992323,0cyclictest623070-21apt-get20:05:144
58948999230,22cyclictest770385-21cat00:15:004
58948999230,22cyclictest0-21swapper/422:15:214
589487992322,1cyclictest0-21swapper/319:10:193
589487992321,2cyclictest738133-21apt-get23:20:123
589487992320,3cyclictest0-21swapper/320:35:133
589487992319,3cyclictest997-21runrttasks20:20:123
589487992319,3cyclictest0-21swapper/321:40:123
58948799230,2cyclictest758362-21turbostat23:55:003
58948799230,23cyclictest678706-21munin-run21:39:593
58948799230,23cyclictest0-21swapper/300:30:123
58948799230,22cyclictest637794-21apt-get20:30:123
58948799230,22cyclictest0-21swapper/321:20:123
589483992321,1cyclictest631472-21awk20:20:002
589483992321,1cyclictest0-21swapper/220:25:192
589483992321,1cyclictest0-21swapper/220:15:002
58948399230,22cyclictest757123-21ntpq23:50:172
58948399230,22cyclictest589809-21apt-get19:10:132
58948399230,22cyclictest0-21swapper/223:45:112
58948399230,22cyclictest0-21swapper/222:55:132
58948399230,22cyclictest0-21swapper/222:40:132
58948399230,22cyclictest0-21swapper/222:10:092
58948399230,1cyclictest0-21swapper/220:55:122
589481992322,1cyclictest0-21swapper/123:35:121
589481992320,3cyclictest0-21swapper/122:40:131
589481992320,3cyclictest0-21swapper/121:35:131
589481992320,3cyclictest0-21swapper/100:15:121
58948199230,23cyclictest0-21swapper/120:45:121
58948199230,22cyclictest740715-21appstreamcli23:25:021
58948199230,22cyclictest664384-21apt-get21:15:141
58948199230,20cyclictest0-21swapper/119:50:001
58948199230,0cyclictest0-21swapper/100:30:211
58947899230,22cyclictest681667-21cut21:45:000
58947899230,22cyclictest617128-21apt-get19:55:120
58947899230,22cyclictest0-21swapper/023:35:110
58947899230,22cyclictest0-21swapper/021:50:010
58947899230,22cyclictest0-21swapper/000:10:000
58947899230,0cyclictest0-21swapper/020:40:130
589497992222,0cyclictest0-21swapper/722:50:147
589497992221,1cyclictest764810-21apt-get00:05:157
589497992221,1cyclictest596470-21apt-get19:20:097
589497992221,1cyclictest0-21swapper/721:25:137
58949799220,22cyclictest758793-21apt-get23:55:127
58949799220,21cyclictest761430-21appstreamcli00:00:027
58949399222,20cyclictest888-21rs:main6
589493992222,0cyclictest0-21swapper/620:50:036
589493992221,1cyclictest752902-21apt-get23:45:126
589493992221,1cyclictest611239-21apt-get19:45:136
589493992221,1cyclictest0-21swapper/623:15:126
58949399220,2cyclictest696442-21awk22:10:016
58949399220,22cyclictest726345-21apt-get23:00:146
58949399220,22cyclictest0-21swapper/620:45:006
58949399220,22cyclictest0-21swapper/619:35:176
58949399220,22cyclictest0-21swapper/619:15:136
58949399220,21cyclictest699806-21apt-get22:15:156
58949399220,21cyclictest652565-21apt-get20:55:136
58949399220,21cyclictest602391-21apt-get19:30:116
58949399220,21cyclictest0-21swapper/623:55:126
58949399220,21cyclictest0-21swapper/620:15:126
58949399220,21cyclictest0-21swapper/620:10:126
58949399220,21cyclictest0-21swapper/600:35:116
589492992221,1cyclictest767784-21apt-get00:10:115
589492992221,1cyclictest698245-21ntpq22:10:175
589492992221,1cyclictest0-21swapper/522:45:195
589492992221,1cyclictest0-21swapper/521:15:035
589492992220,1cyclictest0-21swapper/521:30:135
589492992219,3cyclictest743633-21perf23:29:595
58949299220,22cyclictest701087-21ntpq22:15:205
58949299220,22cyclictest0-21swapper/521:55:115
58949299220,1cyclictest0-21swapper/520:30:125
589489992221,1cyclictest0-21swapper/422:45:134
58948999220,22cyclictest684636-21ls21:50:014
58948999220,21cyclictest705287-21munin-run22:25:014
58948999220,21cyclictest0-21swapper/423:45:124
58948999220,21cyclictest0-21swapper/423:35:124
58948999220,21cyclictest0-21swapper/421:25:134
58948999220,21cyclictest0-21swapper/420:45:114
58948999220,21cyclictest0-21swapper/420:00:004
58948999220,21cyclictest0-21swapper/419:45:134
58948999220,21cyclictest0-21swapper/419:25:144
58948999220,21cyclictest0-21swapper/400:30:124
58948999220,1cyclictest688007-21apt-get21:55:124
58948999220,1cyclictest628944-21apt-get20:15:114
589487992222,0cyclictest0-21swapper/322:15:143
589487992221,1cyclictest705712-21apt-get22:25:133
589487992220,2cyclictest663911-21apt-get21:15:043
589487992220,2cyclictest0-21swapper/321:30:003
58948799220,22cyclictest0-21swapper/322:00:213
58948799220,21cyclictest0-21swapper/320:05:133
58948799220,21cyclictest0-21swapper/300:20:123
58948799220,1cyclictest717501-21apt-get22:45:133
589483992222,0cyclictest0-21swapper/220:05:142
589483992222,0cyclictest0-21swapper/219:55:182
589483992221,0cyclictest0-21swapper/219:30:022
589483992220,1cyclictest702330-21munin-run22:20:012
58948399220,21cyclictest785116-21sqv00:40:002
58948399220,21cyclictest600755-21ntpq19:25:202
58948399220,21cyclictest0-21swapper/222:25:142
58948399220,21cyclictest0-21swapper/221:35:132
58948399220,21cyclictest0-21swapper/221:25:132
58948399220,21cyclictest0-21swapper/221:05:192
58948399220,21cyclictest0-21swapper/220:30:122
58948399220,1cyclictest0-21swapper/221:15:012
589481992221,1cyclictest0-21swapper/123:15:171
589481992221,1cyclictest0-21swapper/121:00:091
589481992221,1cyclictest0-21swapper/119:35:131
589481992220,1cyclictest0-21swapper/122:20:131
589481992219,2cyclictest625581-21grep20:10:001
589481992217,5cyclictest0-21swapper/123:30:121
58948199220,22cyclictest631911-21apt-get20:20:121
58948199220,22cyclictest626006-21apt-get20:10:131
58948199220,21cyclictest649228-21appstreamcli20:50:031
58948199220,21cyclictest0-21swapper/122:35:131
58948199220,21cyclictest0-21swapper/120:20:001
58948199220,21cyclictest0-21swapper/119:40:121
58948199220,21cyclictest0-21swapper/100:25:131
58948199220,21cyclictest0-21swapper/100:20:131
58948199220,0cyclictest0-21swapper/123:00:201
589478992221,1cyclictest0-21swapper/022:00:120
589478992221,1cyclictest0-21swapper/020:45:120
589478992221,1cyclictest0-21swapper/019:30:120
589478992220,1cyclictest742443-21ntpq23:25:190
589478992220,1cyclictest594841-21ntpq19:15:180
58947899220,22cyclictest0-21swapper/019:55:000
58947899220,21cyclictest0-21swapper/023:05:140
58947899220,21cyclictest0-21swapper/022:30:130
58947899220,21cyclictest0-21swapper/021:55:120
58947899220,21cyclictest0-21swapper/021:05:180
58947899220,21cyclictest0-21swapper/021:00:100
58947899220,21cyclictest0-21swapper/019:20:090
58947899220,21cyclictest0-21swapper/000:15:130
58947899220,21cyclictest0-21swapper/000:10:020
58947899220,1cyclictest789-21dbus-daemon23:59:590
58947899220,1cyclictest0-21swapper/022:25:000
589497992121,0cyclictest0-21swapper/721:20:127
589497992121,0cyclictest0-21swapper/720:10:197
589497992121,0cyclictest0-21swapper/720:00:127
589497992121,0cyclictest0-21swapper/719:50:127
589497992121,0cyclictest0-21swapper/719:40:127
589497992120,1cyclictest881rcuc/723:19:597
589497992120,1cyclictest758388-21idleruntime-cro23:55:007
589497992120,1cyclictest0-21swapper/720:50:137
589497992120,1cyclictest0-21swapper/719:30:037
58949799210,21cyclictest725907-21perf23:00:017
58949799210,21cyclictest714089-21cron22:40:017
58949799210,21cyclictest0-21swapper/723:45:197
58949799210,21cyclictest0-21swapper/723:35:187
58949799210,21cyclictest0-21swapper/722:15:217
58949799210,21cyclictest0-21swapper/721:45:017
58949799210,21cyclictest0-21swapper/720:30:117
58949799210,21cyclictest0-21swapper/719:10:137
58949799210,20cyclictest0-21swapper/723:30:117
58949799210,1cyclictest673242-21apt-get21:30:127
58949799210,1cyclictest655084-21munin-run21:00:007
58949799210,0cyclictest0-21swapper/723:20:127
589493992121,0cyclictest0-21swapper/619:10:136
589493992121,0cyclictest0-21swapper/600:00:016
589493992120,1cyclictest614176-21apt-get19:50:116
58949399210,21cyclictest740643-21apt-get23:25:036
58949399210,21cyclictest696860-21apt-get22:10:096
58949399210,21cyclictest0-21swapper/623:35:186
58949399210,21cyclictest0-21swapper/622:45:186
58949399210,21cyclictest0-21swapper/621:30:136
58949399210,21cyclictest0-21swapper/621:05:006
58949399210,21cyclictest0-21swapper/620:45:116
58949399210,21cyclictest0-21swapper/619:55:136
58949399210,21cyclictest0-21swapper/619:25:126
58949399210,21cyclictest0-21swapper/600:30:126
58949399210,20cyclictest685065-21apt-get21:50:116
58949399210,20cyclictest0-21swapper/621:10:116
58949399210,0cyclictest0-21swapper/622:00:126
58949399210,0cyclictest0-21swapper/600:10:126
589492992121,0cyclictest0-21swapper/523:30:115
589492992121,0cyclictest0-21swapper/521:25:125
589492992121,0cyclictest0-21swapper/520:35:135
589492992120,1cyclictest655522-21apt-get21:00:105
589492992120,1cyclictest0-21swapper/523:05:205
58949299210,21cyclictest0-21swapper/523:10:185
58949299210,21cyclictest0-21swapper/522:40:135
58949299210,21cyclictest0-21swapper/522:00:135
58949299210,21cyclictest0-21swapper/520:40:135
58949299210,21cyclictest0-21swapper/520:25:135
58949299210,20cyclictest0-21swapper/522:55:125
58949299210,20cyclictest0-21swapper/500:05:145
58949299210,1cyclictest711598-21apt-get22:35:145
58949299210,0cyclictest0-21swapper/523:20:125
58949299210,0cyclictest0-21swapper/522:50:135
58949299210,0cyclictest0-21swapper/520:10:135
58949299210,0cyclictest0-21swapper/520:05:145
589489992121,0cyclictest0-21swapper/423:25:034
589489992121,0cyclictest0-21swapper/420:40:144
589489992120,1cyclictest717088-21awk22:45:014
589489992120,1cyclictest0-21swapper/421:00:154
589489992120,1cyclictest0-21swapper/421:00:004
589489992120,1cyclictest0-21swapper/420:50:034
589489992119,2cyclictest728842-21cron23:04:594
589489992119,1cyclictest681685-21basename21:45:014
589489992119,1cyclictest643250-21turbostat20:40:004
589489992119,1cyclictest0-21swapper/400:15:124
58948999210,21cyclictest611rcuc/422:05:004
58948999210,21cyclictest0-21swapper/423:20:124
58948999210,21cyclictest0-21swapper/423:10:124
58948999210,21cyclictest0-21swapper/400:00:024
58948999210,20cyclictest0-21swapper/422:50:144
58948999210,0cyclictest0-21swapper/423:40:184
58948999210,0cyclictest0-21swapper/423:15:124
58948999210,0cyclictest0-21swapper/419:40:114
589487992121,0cyclictest0-21swapper/323:00:143
589487992121,0cyclictest0-21swapper/322:20:123
589487992121,0cyclictest0-21swapper/320:10:133
589487992121,0cyclictest0-21swapper/319:40:123
589487992120,1cyclictest0-21swapper/322:10:103
589487992119,2cyclictest0-21swapper/300:35:183
589487992119,1cyclictest755420-21munin-run23:50:003
58948799210,21cyclictest0-21swapper/323:25:133
58948799210,21cyclictest0-21swapper/319:15:133
58948799210,20cyclictest0-21swapper/321:45:133
58948799210,0cyclictest0-21swapper/322:05:153
58948799210,0cyclictest0-21swapper/320:50:023
58948799210,0cyclictest0-21swapper/319:20:103
589483992121,0cyclictest0-21swapper/223:55:122
589483992121,0cyclictest0-21swapper/220:35:122
589483992120,1cyclictest0-21swapper/223:05:142
589483992120,1cyclictest0-21swapper/223:00:142
58948399210,20cyclictest0-21swapper/222:00:132
58948399210,20cyclictest0-21swapper/200:15:122
58948399210,0cyclictest0-21swapper/219:45:132
58948399210,0cyclictest0-21swapper/219:20:102
589481992121,0cyclictest0-21swapper/123:20:121
589481992120,1cyclictest0-21swapper/121:30:121
589481992120,1cyclictest0-21swapper/119:15:121
589481992120,1cyclictest0-21swapper/100:40:001
589481992120,0cyclictest0-21swapper/119:50:111
589481992119,1cyclictest730628-21ntpq23:05:201
589481992116,0cyclictest0-21swapper/100:05:211
58948199210,21cyclictest620125-21apt-get20:00:111
58948199210,21cyclictest0-21swapper/100:00:121
58948199210,20cyclictest0-21swapper/123:50:111
58948199210,0cyclictest0-21swapper/122:05:211
58948199210,0cyclictest0-21swapper/120:55:131
58948199210,0cyclictest0-21swapper/120:35:121
58948199210,0cyclictest0-21swapper/119:55:131
589478992121,0cyclictest0-21swapper/022:15:130
589478992120,1cyclictest0-21swapper/023:50:120
589478992120,1cyclictest0-21swapper/023:45:120
589478992120,1cyclictest0-21swapper/020:55:130
589478992120,1cyclictest0-21swapper/019:45:130
589478992120,0cyclictest0-21swapper/020:00:030
589478992119,1cyclictest678700-21sendmail21:40:000
589478992119,1cyclictest0-21swapper/021:50:120
58947899210,21cyclictest761864-21apt-get00:00:120
58947899210,21cyclictest0-21swapper/023:15:110
58947899210,0cyclictest0-21swapper/020:10:190
589497992020,0cyclictest0-21swapper/723:40:177
589497992020,0cyclictest0-21swapper/723:00:147
589497992020,0cyclictest0-21swapper/722:20:117
589497992020,0cyclictest0-21swapper/722:00:137
589497992020,0cyclictest0-21swapper/721:55:127
589497992020,0cyclictest0-21swapper/721:40:187
589497992020,0cyclictest0-21swapper/721:15:037
589497992019,1cyclictest612564-21ntpq19:45:197
589497992019,1cyclictest0-21swapper/722:45:127
589493992020,0cyclictest0-21swapper/622:40:136
589493992020,0cyclictest0-21swapper/622:25:136
589493992020,0cyclictest0-21swapper/621:45:046
589493992020,0cyclictest0-21swapper/600:20:136
589493992019,1cyclictest766179-21ntpq00:05:226
589493992019,1cyclictest0-21swapper/622:20:116
58949399200,0cyclictest0-21swapper/619:20:106
58949299207,0cyclictest0-21swapper/523:41:385
589492992020,0cyclictest0-21swapper/523:55:135
589492992020,0cyclictest0-21swapper/523:15:125
589492992020,0cyclictest0-21swapper/520:45:125
589492992020,0cyclictest0-21swapper/520:15:125
589492992020,0cyclictest0-21swapper/500:15:135
589492992019,1cyclictest773722-21apt-get00:20:135
589492992019,1cyclictest0-21swapper/519:25:195
589492992018,2cyclictest609630-21ntpq19:40:185
58949299200,20cyclictest0-21swapper/522:25:145
58949299200,0cyclictest0-21swapper/520:55:195
58949299200,0cyclictest0-21swapper/520:25:005
58949299200,0cyclictest0-21swapper/519:10:125
589489992020,0cyclictest729286-21apt-get23:05:144
589489992020,0cyclictest0-21swapper/422:30:134
589489992020,0cyclictest0-21swapper/422:25:144
589489992020,0cyclictest0-21swapper/420:00:124
589489992020,0cyclictest0-21swapper/419:20:104
589489992019,1cyclictest663940-21basename21:15:004
589489992019,1cyclictest0-21swapper/419:15:194
589489992016,3cyclictest3422186-21systemd-journal19:35:054
58948999200,0cyclictest0-21swapper/421:20:134
589487992020,0cyclictest0-21swapper/323:35:113
589487992020,0cyclictest0-21swapper/323:15:113
589487992020,0cyclictest0-21swapper/321:50:123
589487992020,0cyclictest0-21swapper/321:00:103
589487992019,1cyclictest0-21swapper/321:30:123
589487992019,1cyclictest0-21swapper/300:10:123
589487992013,6cyclictest0-21swapper/323:30:123
58948799200,0cyclictest0-21swapper/321:55:123
589483992020,0cyclictest667349-21apt-get21:20:122
589483992020,0cyclictest0-21swapper/223:20:122
589483992020,0cyclictest0-21swapper/223:10:112
589483992020,0cyclictest0-21swapper/222:45:132
589483992020,0cyclictest0-21swapper/221:00:162
589483992020,0cyclictest0-21swapper/220:50:032
589483992020,0cyclictest0-21swapper/200:00:032
589483992019,1cyclictest0-21swapper/219:50:112
589483992019,1cyclictest0-21swapper/219:40:122
589483992018,1cyclictest0-21swapper/200:10:192
58948399200,19cyclictest746574-21grep23:35:002
58948399200,0cyclictest0-21swapper/221:15:032
589481992020,0cyclictest0-21swapper/122:55:181
589481992020,0cyclictest0-21swapper/122:15:131
589481992020,0cyclictest0-21swapper/121:45:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional