You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 05:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Fri Apr 10, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2498382224161,49sleep40-21swapper/419:09:454
2498112219162,19sleep50-21swapper/519:09:235
2496382213183,19sleep30-21swapper/319:06:553
2497472209177,20sleep60-21swapper/619:08:286
2495682208175,21sleep70-21swapper/719:05:567
2497692205176,18sleep10-21swapper/119:08:471
2497592205170,22sleep00-21swapper/019:08:380
2497252203176,17sleep20-21swapper/219:08:082
3753072560,0sleep351-21ksoftirqd/322:45:153
250092992925,4cyclictest285288-21dump-pmu-power20:10:005
25009299280,22cyclictest251644-21awk19:10:175
25009299270,22cyclictest345789-21munin-run21:55:005
25009299270,1cyclictest0-21swapper/523:25:015
25009899258,4cyclictest0-21swapper/720:42:297
25009299250,1cyclictest369322-21apt-get22:35:135
25009299250,1cyclictest369322-21apt-get22:35:135
25008799250,25cyclictest264005-21chrt19:30:183
25008799250,1cyclictest0-21swapper/323:20:013
250081992521,1cyclictest271428-21apt-get19:45:121
25008199250,22cyclictest316710-21munin-run21:04:591
25008199250,21cyclictest0-21swapper/123:40:131
25009899240,23cyclictest310979-21turbostat20:55:007
25009599240,23cyclictest262384-21munin-run19:30:006
25009599240,23cyclictest252823-21munin-run19:15:016
25009599240,23cyclictest0-21swapper/622:00:126
25009299240,24cyclictest0-21swapper/522:30:005
25008999240,23cyclictest0-21swapper/423:10:124
25008799242,1cyclictest0-21swapper/323:00:003
25008399240,23cyclictest412557-21perf23:50:002
25008399240,23cyclictest0-21swapper/222:45:152
25008399240,23cyclictest0-21swapper/221:25:112
250081992420,1cyclictest0-21swapper/119:30:131
25008199240,23cyclictest0-21swapper/121:45:131
25008199240,22cyclictest0-21swapper/119:35:121
25007799240,23cyclictest0-21swapper/022:10:120
250098992321,1cyclictest280000-21apt-get20:00:127
25009899230,22cyclictest397734-21apt-get23:25:017
25009899230,22cyclictest0-21swapper/719:20:117
25009899230,1cyclictest0-21swapper/723:25:137
25009899230,1cyclictest0-21swapper/721:40:127
250095992321,1cyclictest291425-21apt-get20:20:116
25009599230,22cyclictest0-21swapper/621:45:006
25009599230,22cyclictest0-21swapper/621:00:006
25009599230,22cyclictest0-21swapper/600:30:016
250092992320,3cyclictest0-21swapper/523:10:115
25009299230,22cyclictest274276-21apt-get19:50:115
25009299230,22cyclictest0-21swapper/520:00:125
25009299230,22cyclictest0-21swapper/500:10:005
25009299230,0cyclictest302852-21apt-get20:40:115
25009299230,0cyclictest0-21swapper/519:45:135
250089992322,1cyclictest0-21swapper/420:30:134
25008999230,2cyclictest409440-21munin-run23:45:004
25008999230,1cyclictest432680-21awk00:25:014
250087992321,1cyclictest409429-21idleruntime-cro23:45:003
25008799230,23cyclictest0-21swapper/321:35:113
25008799230,22cyclictest0-21swapper/323:00:113
25008399230,22cyclictest308140-21perf20:50:002
25008399230,1cyclictest0-21swapper/200:00:012
250081992321,1cyclictest0-21swapper/123:25:121
25008199230,22cyclictest0-21swapper/123:50:121
250077992321,1cyclictest351929-21apt-get22:05:120
25007799230,22cyclictest282420-21idleruntime-cro20:05:000
25007799230,22cyclictest0-21swapper/023:25:130
25007799230,22cyclictest0-21swapper/020:15:120
25007799230,22cyclictest0-21swapper/019:40:120
25007799230,1cyclictest336970-21awk21:39:590
250098992222,0cyclictest0-21swapper/723:10:007
250098992221,1cyclictest0-21swapper/721:10:147
250098992221,1cyclictest0-21swapper/720:05:097
250098992221,0cyclictest0-21swapper/721:45:137
250098992220,1cyclictest435938-21apt-get00:30:117
25009899220,21cyclictest0-21swapper/722:05:127
25009899220,21cyclictest0-21swapper/721:15:137
25009899220,1cyclictest0-21swapper/700:40:007
250095992220,1cyclictest277127-21apt-get19:55:136
25009599220,22cyclictest0-21swapper/622:40:016
25009599220,22cyclictest0-21swapper/622:40:016
25009599220,21cyclictest0-21swapper/623:50:136
25009599220,21cyclictest0-21swapper/623:25:026
25009599220,21cyclictest0-21swapper/621:55:146
25009599220,21cyclictest0-21swapper/621:35:116
25009599220,21cyclictest0-21swapper/619:35:006
25009599220,20cyclictest0-21swapper/621:20:146
25009599220,1cyclictest0-21swapper/622:29:596
250092992222,0cyclictest0-21swapper/523:35:115
250092992221,1cyclictest0-21swapper/520:15:135
250092992220,1cyclictest0-21swapper/523:45:125
25009299220,21cyclictest0-21swapper/523:15:145
25009299220,21cyclictest0-21swapper/520:30:135
25009299220,21cyclictest0-21swapper/519:20:125
25009299220,21cyclictest0-21swapper/519:20:015
25009299220,21cyclictest0-21swapper/500:30:125
250089992221,1cyclictest0-21swapper/400:05:104
250089992220,1cyclictest360766-21apt-get22:20:134
25008999220,21cyclictest0-21swapper/423:55:114
25008999220,21cyclictest0-21swapper/423:45:124
25008999220,21cyclictest0-21swapper/422:20:004
25008999220,21cyclictest0-21swapper/421:25:014
25008999220,21cyclictest0-21swapper/421:05:114
25008999220,0cyclictest0-21swapper/423:35:114
25008999220,0cyclictest0-21swapper/421:45:124
250087992221,1cyclictest357468-21turbostat22:14:593
250087992221,1cyclictest0-21swapper/320:00:113
250087992221,1cyclictest0-21swapper/300:30:113
250087992220,1cyclictest291425-21apt-get20:20:123
250087992219,2cyclictest256401-21munin-run19:20:003
250083992222,0cyclictest0-21swapper/220:00:122
250083992221,1cyclictest430240-21apt-get00:20:142
250083992221,0cyclictest0-21swapper/222:10:002
25008399220,22cyclictest305276-21turbostat.cron20:45:002
25008399220,21cyclictest346208-21apt-get21:55:142
25008399220,21cyclictest285698-21apt-get20:10:092
250081992220,1cyclictest433088-21apt-get00:25:131
25008199220,21cyclictest0-21swapper/123:55:121
25008199220,21cyclictest0-21swapper/120:15:131
25008199220,1cyclictest0-21swapper/122:55:101
25008199220,0cyclictest0-21swapper/120:20:121
250077992222,0cyclictest0-21swapper/020:40:100
250077992222,0cyclictest0-21swapper/019:50:100
250077992220,1cyclictest350275-21ntpq22:00:170
25007799220,21cyclictest256389-21apt-get19:20:010
25007799220,21cyclictest0-21swapper/023:50:120
25007799220,21cyclictest0-21swapper/021:40:120
25007799220,21cyclictest0-21swapper/021:09:590
25007799220,0cyclictest0-21swapper/021:25:010
250098992121,0cyclictest0-21swapper/721:50:037
250098992121,0cyclictest0-21swapper/700:10:127
250098992120,1cyclictest0-21swapper/720:25:147
25009899210,21cyclictest0-21swapper/722:35:127
25009899210,21cyclictest0-21swapper/722:35:127
25009899210,20cyclictest270996-21latency_hist19:45:017
25009899210,0cyclictest0-21swapper/722:15:137
25009899210,0cyclictest0-21swapper/720:30:137
250095992121,0cyclictest0-21swapper/622:20:136
250095992121,0cyclictest0-21swapper/619:20:026
250095992121,0cyclictest0-21swapper/600:35:106
250095992120,1cyclictest270806-21apt-get19:42:566
250095992120,1cyclictest0-21swapper/622:40:126
250095992120,1cyclictest0-21swapper/622:40:116
250095992117,3cyclictest383192-21basename23:00:016
25009599210,21cyclictest0-21swapper/619:15:126
25009599210,0cyclictest0-21swapper/622:30:116
250092992121,0cyclictest0-21swapper/519:35:005
250092992119,2cyclictest0-21swapper/523:00:125
250092992118,3cyclictest407005-21apt-get23:40:135
25009299210,20cyclictest291428-21seq20:20:115
25009299210,20cyclictest0-21swapper/520:45:125
25009299210,0cyclictest0-21swapper/522:20:135
25009299210,0cyclictest0-21swapper/520:50:125
25009299210,0cyclictest0-21swapper/519:55:125
25008999210,20cyclictest342664-21apt-get21:50:034
25008999210,1cyclictest435523-21grep00:30:004
25008999210,1cyclictest400862-21munin-run23:30:014
25008999210,0cyclictest0-21swapper/422:55:104
250087992121,0cyclictest0-21swapper/323:35:123
250087992121,0cyclictest0-21swapper/322:05:123
250087992121,0cyclictest0-21swapper/319:45:133
250087992120,1cyclictest432674-21perf00:25:013
250087992120,1cyclictest325268-21munin-run21:19:593
250087992120,1cyclictest0-21swapper/321:10:143
25008799210,21cyclictest0-21swapper/323:45:133
25008799210,21cyclictest0-21swapper/321:55:143
25008799210,20cyclictest0-21swapper/320:25:123
250083992121,0cyclictest0-21swapper/219:25:112
250083992118,3cyclictest409447-21awk23:45:012
25008399210,21cyclictest0-21swapper/219:20:002
250081992120,1cyclictest0-21swapper/122:25:131
25008199210,21cyclictest0-21swapper/121:25:121
25008199210,20cyclictest386732-21apt-get23:05:121
25008199210,0cyclictest0-21swapper/119:55:121
25008199210,0cyclictest0-21swapper/100:30:121
250077992121,0cyclictest0-21swapper/023:30:100
250077992121,0cyclictest0-21swapper/023:00:110
250077992119,1cyclictest395312-21apt-get23:20:120
250077992118,2cyclictest418347-21munin-run00:00:000
25007799210,20cyclictest0-21swapper/022:30:120
25007799210,20cyclictest0-21swapper/019:30:130
25007799210,1cyclictest0-21swapper/022:25:120
250098992020,0cyclictest409634-21gpgv23:45:017
250098992020,0cyclictest0-21swapper/723:55:117
250098992020,0cyclictest0-21swapper/723:45:127
250098992020,0cyclictest0-21swapper/723:15:147
250098992020,0cyclictest0-21swapper/720:45:137
250098992019,1cyclictest331255-21perf21:30:007
250098992018,1cyclictest374626-21munin-run22:45:017
250098992018,1cyclictest374626-21munin-run22:45:007
250095992020,0cyclictest0-21swapper/621:30:006
250095992020,0cyclictest0-21swapper/620:00:126
250095992020,0cyclictest0-21swapper/600:00:116
250095992018,1cyclictest0-21swapper/621:35:006
25009599200,20cyclictest0-21swapper/620:50:006
25009599200,0cyclictest0-21swapper/623:10:116
250092992020,0cyclictest0-21swapper/519:30:005
250092992019,1cyclictest0-21swapper/523:50:135
250092992019,1cyclictest0-21swapper/521:39:595
250092992017,3cyclictest0-21swapper/521:05:005
25009299200,0cyclictest0-21swapper/520:25:145
250089992020,0cyclictest0-21swapper/422:50:114
250089992020,0cyclictest0-21swapper/422:05:124
250089992020,0cyclictest0-21swapper/419:35:114
250089992019,1cyclictest0-21swapper/421:30:134
250089992018,1cyclictest288552-21apt-get20:15:134
250087992020,0cyclictest0-21swapper/322:30:123
250087992020,0cyclictest0-21swapper/321:25:133
250087992020,0cyclictest0-21swapper/320:50:113
250087992020,0cyclictest0-21swapper/319:40:103
250087992020,0cyclictest0-21swapper/300:25:123
250087992019,1cyclictest0-21swapper/323:25:133
250083992020,0cyclictest0-21swapper/222:05:122
250083992020,0cyclictest0-21swapper/220:25:132
250083992020,0cyclictest0-21swapper/219:10:112
250083992020,0cyclictest0-21swapper/200:10:112
250083992019,1cyclictest310985-21awk20:55:002
250083992019,1cyclictest265655-21apt-get19:35:122
25008399200,0cyclictest0-21swapper/223:15:132
25008399200,0cyclictest0-21swapper/222:55:092
250081992020,0cyclictest0-21swapper/122:30:121
250081992020,0cyclictest0-21swapper/119:25:121
250081992019,1cyclictest0-21swapper/122:10:021
250081992018,1cyclictest377476-21munin-run22:50:011
250081992018,1cyclictest0-21swapper/121:35:121
250081992018,1cyclictest0-21swapper/121:05:111
250077992020,0cyclictest0-21swapper/023:15:140
250077992020,0cyclictest0-21swapper/021:15:130
250077992020,0cyclictest0-21swapper/020:55:130
250077992020,0cyclictest0-21swapper/000:10:120
25007799200,19cyclictest0-21swapper/022:35:120
25007799200,19cyclictest0-21swapper/022:35:120
25007799200,0cyclictest0-21swapper/022:55:100
25007799200,0cyclictest0-21swapper/019:15:120
250098991919,0cyclictest0-21swapper/719:55:127
250098991919,0cyclictest0-21swapper/719:10:127
250098991919,0cyclictest0-21swapper/700:20:137
250098991918,1cyclictest0-21swapper/722:50:017
250098991918,1cyclictest0-21swapper/722:00:127
250098991917,1cyclictest0-21swapper/722:24:597
250095991919,0cyclictest0-21swapper/623:40:136
250095991919,0cyclictest0-21swapper/623:15:136
250095991919,0cyclictest0-21swapper/620:50:126
250095991919,0cyclictest0-21swapper/619:45:136
250095991918,1cyclictest302405-21apt20:40:006
250095991918,1cyclictest285698-21apt-get20:10:106
250095991918,1cyclictest0-21swapper/600:10:126
250095991917,1cyclictest0-21swapper/600:05:126
25009599190,0cyclictest0-21swapper/622:50:126
250092991919,0cyclictest0-21swapper/522:40:125
250092991919,0cyclictest0-21swapper/522:40:125
250092991919,0cyclictest0-21swapper/521:45:135
250092991919,0cyclictest0-21swapper/520:10:105
250092991918,1cyclictest380743-21apt-get22:55:105
250092991916,3cyclictest0-21swapper/523:05:025
250089991919,0cyclictest0-21swapper/419:20:024
250089991918,1cyclictest0-21swapper/423:55:014
250089991917,1cyclictest0-21swapper/420:50:114
250087991918,1cyclictest501ktimers/322:25:133
250087991918,1cyclictest397734-21apt-get23:25:003
250087991918,0cyclictest0-21swapper/319:10:103
250083991919,0cyclictest0-21swapper/223:25:122
250083991919,0cyclictest0-21swapper/223:00:102
250083991919,0cyclictest0-21swapper/221:50:022
250083991919,0cyclictest0-21swapper/219:40:102
250083991919,0cyclictest0-21swapper/219:20:122
250083991918,1cyclictest435531-21sleep00:30:012
250083991918,1cyclictest0-21swapper/223:30:112
25008399190,18cyclictest0-21swapper/219:30:132
250081991919,0cyclictest0-21swapper/122:40:111
250081991919,0cyclictest0-21swapper/122:40:111
250081991919,0cyclictest0-21swapper/121:50:101
250081991919,0cyclictest0-21swapper/100:20:141
250081991917,1cyclictest0-21swapper/119:20:011
25008199190,18cyclictest0-21swapper/121:55:131
250077991919,0cyclictest0-21swapper/020:10:100
250077991919,0cyclictest0-21swapper/019:10:120
250077991919,0cyclictest0-21swapper/000:05:110
250077991917,1cyclictest363186-21apt22:24:590
250077991917,1cyclictest308135-21munin-run20:50:000
250098991818,0cyclictest0-21swapper/723:30:107
250098991818,0cyclictest0-21swapper/720:35:127
250098991818,0cyclictest0-21swapper/719:50:107
250098991818,0cyclictest0-21swapper/719:35:127
250098991817,0cyclictest0-21swapper/719:30:137
250095991818,0cyclictest0-21swapper/620:15:126
250095991818,0cyclictest0-21swapper/600:30:126
250095991816,1cyclictest0-21swapper/623:10:006
25009599180,17cyclictest322831-21apt-get21:15:136
250092991818,0cyclictest0-21swapper/519:35:125
250092991817,1cyclictest0-21swapper/500:20:015
25009299180,15cyclictest0-21swapper/500:13:585
250089991818,0cyclictest0-21swapper/420:05:094
250089991818,0cyclictest0-21swapper/419:25:124
250089991817,1cyclictest0-21swapper/421:44:594
250089991816,1cyclictest294280-21apt-get20:25:134
250087991818,0cyclictest0-21swapper/320:35:123
250087991818,0cyclictest0-21swapper/320:05:093
250087991817,1cyclictest290987-21sendmail20:20:003
250087991817,1cyclictest0-21swapper/320:00:003
250087991817,1cyclictest0-21swapper/300:35:093
250087991816,2cyclictest418291-21run-parts00:00:013
25008799180,1cyclictest0-21swapper/319:25:123
25008799180,18cyclictest0-21swapper/300:00:123
250083991818,0cyclictest0-21swapper/223:05:022
250083991818,0cyclictest0-21swapper/221:00:122
250083991817,1cyclictest0-21swapper/222:00:182
250083991816,1cyclictest368908-21perf22:35:002
250081991817,1cyclictest0-21swapper/123:10:121
250081991817,1cyclictest0-21swapper/100:15:121
250077991818,0cyclictest0-21swapper/023:45:130
250077991818,0cyclictest0-21swapper/022:50:120
250077991818,0cyclictest0-21swapper/021:30:120
250077991817,1cyclictest0-21swapper/021:25:010
250077991816,1cyclictest342664-21apt-get21:50:030
25007799180,17cyclictest347499-21ntpq21:55:190
250098991717,0cyclictest0-21swapper/722:25:127
250098991717,0cyclictest0-21swapper/721:20:147
250098991717,0cyclictest0-21swapper/721:00:127
250098991717,0cyclictest0-21swapper/719:45:127
250098991717,0cyclictest0-21swapper/719:15:127
250095991717,0cyclictest0-21swapper/622:15:136
250092991717,0cyclictest0-21swapper/521:25:135
250092991716,1cyclictest0-21swapper/523:25:025
250089991717,0cyclictest0-21swapper/423:05:124
250089991717,0cyclictest0-21swapper/422:45:154
250089991717,0cyclictest0-21swapper/422:10:124
250089991717,0cyclictest0-21swapper/421:55:144
250089991717,0cyclictest0-21swapper/400:15:134
250089991717,0cyclictest0-21swapper/400:10:124
250087991717,0cyclictest0-21swapper/321:50:113
250087991716,1cyclictest403706-21turbostat.cron23:35:013
250087991716,1cyclictest342683-21awk21:49:593
250087991716,1cyclictest331670-21apt-get21:30:133
250083991717,0cyclictest0-21swapper/223:20:112
250083991717,0cyclictest0-21swapper/220:55:112
250083991717,0cyclictest0-21swapper/200:35:092
250081991716,1cyclictest253964-21apt-get19:15:111
250081991716,1cyclictest0-21swapper/119:10:121
250081991715,2cyclictest369322-21apt-get22:35:121
250081991715,2cyclictest369322-21apt-get22:35:121
25008199170,16cyclictest321210-21ntpq21:10:201
250077991717,0cyclictest0-21swapper/023:40:130
250077991717,0cyclictest0-21swapper/021:10:140
250077991717,0cyclictest0-21swapper/019:35:120
250077991717,0cyclictest0-21swapper/019:25:100
250077991717,0cyclictest0-21swapper/000:35:100
250077991714,2cyclictest390875-21ntpq23:10:180
250098991616,0cyclictest0-21swapper/723:35:127
250098991616,0cyclictest0-21swapper/722:50:137
250098991616,0cyclictest0-21swapper/721:05:117
250098991614,1cyclictest311405-21apt-get20:55:127
25009899160,15cyclictest0-21swapper/719:25:177
25009899160,15cyclictest0-21swapper/700:03:087
250095991616,0cyclictest0-21swapper/623:55:106
250095991616,0cyclictest0-21swapper/600:20:136
250095991615,1cyclictest265655-21apt-get19:35:126
250095991615,1cyclictest0-21swapper/622:50:006
25009599160,15cyclictest0-21swapper/623:35:156
25009599160,15cyclictest0-21swapper/621:50:206
250092991616,0cyclictest0-21swapper/523:55:125
250092991616,0cyclictest0-21swapper/500:20:155
250092991615,1cyclictest0-21swapper/500:25:125
250089991616,0cyclictest0-21swapper/423:15:124
250089991616,0cyclictest0-21swapper/422:40:124
250089991616,0cyclictest0-21swapper/422:40:124
250089991615,1cyclictest0-21swapper/421:14:594
250089991615,1cyclictest0-21swapper/421:00:134
250089991615,0cyclictest0-21swapper/422:30:124
25008999160,15cyclictest312170-21hddtemp_smartct20:55:154
25008999160,15cyclictest0-21swapper/421:25:014
25008999160,15cyclictest0-21swapper/420:03:344
250087991616,0cyclictest0-21swapper/323:05:123
250087991616,0cyclictest0-21swapper/320:10:103
250087991615,1cyclictest0-21swapper/323:50:173
250087991615,1cyclictest0-21swapper/320:55:133
250087991615,1cyclictest0-21swapper/300:15:003
250087991615,1cyclictest0-21swapper/300:05:113
250087991614,1cyclictest328139-21munin-run21:24:593
250083991616,0cyclictest0-21swapper/223:10:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional