You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 01:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Tue Jul 14, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3638782242171,58sleep70-21swapper/707:09:237
3637602237166,59sleep40-21swapper/407:07:434
3637492228167,19sleep20-21swapper/207:07:332
3637032222182,25sleep30-21swapper/307:06:533
3636232218184,23sleep60-21swapper/607:05:436
3638602217179,25sleep00-21swapper/007:09:080
3636692217181,23sleep50-21swapper/507:06:235
3637012216179,26sleep10-21swapper/107:06:511
4137002910,0sleep6413693-21ntpq08:30:196
36413599290,27cyclictest0-21swapper/308:20:003
36413599290,0cyclictest0-21swapper/308:35:173
36413599280,27cyclictest435568-21ls09:10:013
36413099280,27cyclictest444447-21cron09:25:012
36414399260,25cyclictest515284-21perf11:25:007
36413599260,25cyclictest0-21swapper/310:45:113
36413599260,25cyclictest0-21swapper/309:20:123
36413599260,0cyclictest0-21swapper/307:15:013
36414399250,24cyclictest388401-21munin-plugin-st07:50:007
36414399250,24cyclictest388401-21munin-plugin-st07:50:007
36414399250,24cyclictest0-21swapper/709:05:137
364135992523,1cyclictest471001-21cron10:10:003
364135992522,3cyclictest0-21swapper/312:30:123
364135992522,3cyclictest0-21swapper/309:25:143
364135992520,4cyclictest0-21swapper/312:25:003
36413599250,24cyclictest0-21swapper/310:55:143
36413599250,24cyclictest0-21swapper/308:50:123
36413599250,24cyclictest0-21swapper/307:35:143
36413599250,0cyclictest0-21swapper/310:50:203
36413599250,0cyclictest0-21swapper/310:35:003
36413599250,0cyclictest0-21swapper/310:10:113
36413099250,24cyclictest509616-21latency_hist11:15:002
364143992420,3cyclictest488731-21cron10:40:007
36414199240,23cyclictest441542-21basename09:20:016
36414199240,23cyclictest0-21swapper/610:30:136
36414199240,23cyclictest0-21swapper/609:10:006
364139992424,0cyclictest0-21swapper/509:25:145
364139992421,2cyclictest394287-21munin-plugin-st08:00:005
364139992420,3cyclictest465123-21dump-pmu-power10:00:005
36413699240,23cyclictest0-21swapper/409:30:124
364135992421,2cyclictest509321-21turbostat11:15:003
364135992420,4cyclictest0-21swapper/308:40:183
36413599240,23cyclictest0-21swapper/308:45:133
36413599240,0cyclictest0-21swapper/312:00:133
36413599240,0cyclictest0-21swapper/309:10:043
364130992423,1cyclictest500926-21apt-get11:00:122
364143992321,1cyclictest462596-21apt-get09:55:137
36414399230,22cyclictest503866-21apt-get11:05:117
36414399230,22cyclictest447829-21apt-get09:30:127
36414399230,22cyclictest0-21swapper/711:55:127
36414399230,22cyclictest0-21swapper/711:50:037
36414399230,22cyclictest0-21swapper/710:40:127
36414399230,22cyclictest0-21swapper/709:40:027
364141992322,1cyclictest465556-21apt-get10:00:126
36414199230,23cyclictest456291-21awk09:45:006
36414199230,22cyclictest0-21swapper/609:40:006
364139992321,1cyclictest377018-21apt-get07:30:125
364139992319,3cyclictest376587-21dump-pmu-power07:30:005
36413999230,23cyclictest417869-21turbostat.cron08:40:005
36413999230,23cyclictest0-21swapper/508:50:125
36413999230,0cyclictest0-21swapper/510:45:115
364136992323,0cyclictest0-21swapper/411:15:014
364136992322,1cyclictest0-21swapper/407:10:114
364136992321,2cyclictest409472-21apt-get08:25:144
36413699230,22cyclictest371129-21apt-get07:20:134
36413699230,22cyclictest0-21swapper/408:40:134
364135992320,3cyclictest0-21swapper/311:55:133
36413599230,22cyclictest0-21swapper/311:40:003
36413599230,22cyclictest0-21swapper/311:40:003
36413599230,22cyclictest0-21swapper/310:20:113
36413599230,22cyclictest0-21swapper/309:45:103
36413599230,22cyclictest0-21swapper/307:55:123
36413599230,22cyclictest0-21swapper/307:30:123
36413599230,22cyclictest0-21swapper/307:25:133
36413599230,1cyclictest0-21swapper/311:05:113
36413599230,0cyclictest0-21swapper/308:05:183
36413599230,0cyclictest0-21swapper/307:45:143
36413599230,0cyclictest0-21swapper/307:45:143
364130992322,1cyclictest471439-21apt-get10:10:112
364130992321,1cyclictest429649-21cron09:00:012
36413099230,22cyclictest0-21swapper/210:15:132
36413099230,22cyclictest0-21swapper/207:45:142
36413099230,22cyclictest0-21swapper/207:45:142
36413099230,1cyclictest0-21swapper/210:35:112
364129992322,1cyclictest429647-21cron09:00:011
364129992321,1cyclictest0-21swapper/107:50:141
36412999230,23cyclictest0-21swapper/111:00:121
36412999230,23cyclictest0-21swapper/108:25:141
36412999230,22cyclictest385890-21apt-get07:45:141
36412999230,22cyclictest385890-21apt-get07:45:141
36412999230,22cyclictest0-21swapper/112:25:131
36412999230,22cyclictest0-21swapper/111:25:131
36412999230,1cyclictest474380-21apt-get10:15:131
36412999230,1cyclictest0-21swapper/110:30:131
364126992323,0cyclictest0-21swapper/011:00:120
364126992322,1cyclictest0-21swapper/011:50:020
364126992322,1cyclictest0-21swapper/008:25:140
364126992318,4cyclictest490468-21ntpq10:40:190
36412699230,23cyclictest471013-21grep10:10:000
36412699230,23cyclictest430105-21apt-get09:00:120
364143992222,0cyclictest0-21swapper/707:35:147
364143992221,1cyclictest478612-21ntpq10:20:177
364143992221,1cyclictest0-21swapper/709:20:197
36414399220,22cyclictest0-21swapper/709:15:127
36414399220,21cyclictest547732-21perf12:20:007
36414399220,21cyclictest492074-21apt-get10:45:107
36414399220,21cyclictest0-21swapper/711:15:127
36414399220,21cyclictest0-21swapper/711:00:127
36414399220,21cyclictest0-21swapper/710:15:147
36414399220,21cyclictest0-21swapper/710:00:127
36414399220,21cyclictest0-21swapper/709:35:127
36414399220,1cyclictest497967-21apt-get10:55:147
36414399220,1cyclictest424202-21apt-get08:50:127
36414399220,1cyclictest367629-21ntpq07:15:017
364141992221,1cyclictest533418-21apt-get11:55:126
364141992220,1cyclictest427145-21apt-get08:55:136
36414199220,22cyclictest0-21swapper/611:20:136
36414199220,22cyclictest0-21swapper/609:55:136
36414199220,22cyclictest0-21swapper/607:15:116
36414199220,21cyclictest444883-21apt-get09:25:146
36414199220,21cyclictest0-21swapper/612:35:116
36414199220,21cyclictest0-21swapper/612:00:136
36414199220,21cyclictest0-21swapper/611:05:126
36414199220,21cyclictest0-21swapper/610:55:146
36414199220,21cyclictest0-21swapper/607:20:136
36414199220,1cyclictest548168-21apt-get12:20:136
36414199220,1cyclictest488719-21awk10:40:006
36414199220,1cyclictest477344-21apt-get10:20:116
36414199220,1cyclictest0-21swapper/607:35:146
364139992221,1cyclictest0-21swapper/510:15:135
364139992221,1cyclictest0-21swapper/508:10:195
364139992220,2cyclictest388830-21apt-get07:50:135
364139992220,1cyclictest0-21swapper/511:20:135
36413999220,22cyclictest541837-21munin-run12:10:005
36413999220,22cyclictest0-21swapper/512:05:005
36413999220,22cyclictest0-21swapper/509:40:005
36413999220,22cyclictest0-21swapper/508:05:005
36413999220,21cyclictest435637-21appstreamcli09:10:035
36413999220,21cyclictest0-21swapper/511:30:125
36413999220,21cyclictest0-21swapper/511:30:125
36413999220,21cyclictest0-21swapper/510:50:195
36413999220,21cyclictest0-21swapper/510:20:125
36413999220,21cyclictest0-21swapper/509:05:135
36413999220,21cyclictest0-21swapper/508:40:125
36413999220,21cyclictest0-21swapper/508:20:105
36413999220,21cyclictest0-21swapper/508:15:135
36413999220,21cyclictest0-21swapper/507:35:145
36413999220,0cyclictest0-21swapper/511:25:205
364136992221,1cyclictest554054-21apt-get12:30:124
36413699220,21cyclictest406527-21apt-get08:20:104
36413699220,21cyclictest0-21swapper/412:35:124
36413699220,21cyclictest0-21swapper/410:30:134
36413699220,21cyclictest0-21swapper/409:25:144
36413699220,21cyclictest0-21swapper/409:20:124
36413699220,21cyclictest0-21swapper/409:15:124
36413699220,21cyclictest0-21swapper/409:00:124
36413699220,21cyclictest0-21swapper/408:10:184
36413699220,21cyclictest0-21swapper/407:45:144
36413699220,21cyclictest0-21swapper/407:45:144
36413699220,21cyclictest0-21swapper/407:15:124
36413699220,1cyclictest394731-21apt-get08:00:114
36413699220,1cyclictest0-21swapper/411:50:034
36413699220,0cyclictest0-21swapper/409:05:124
36413699220,0cyclictest0-21swapper/408:50:124
364135992220,2cyclictest0-21swapper/310:35:113
364135992220,2cyclictest0-21swapper/307:15:123
364135992219,3cyclictest0-21swapper/312:15:003
364135992219,3cyclictest0-21swapper/311:50:133
364135992214,7cyclictest453296-21cut09:40:003
36413599220,21cyclictest0-21swapper/311:40:133
36413599220,1cyclictest0-21swapper/311:20:193
36413599220,0cyclictest0-21swapper/310:15:133
364130992221,1cyclictest515703-21apt-get11:25:132
364130992221,1cyclictest438975-21apt-get09:15:122
364130992221,1cyclictest0-21swapper/212:25:132
364130992221,1cyclictest0-21swapper/210:40:192
364130992221,1cyclictest0-21swapper/209:25:142
36413099220,22cyclictest0-21swapper/211:15:022
36413099220,22cyclictest0-21swapper/209:35:112
36413099220,22cyclictest0-21swapper/207:30:192
36413099220,21cyclictest0-21swapper/212:15:202
36413099220,21cyclictest0-21swapper/211:30:112
36413099220,21cyclictest0-21swapper/211:30:112
36413099220,21cyclictest0-21swapper/210:55:142
36413099220,21cyclictest0-21swapper/210:20:112
36413099220,1cyclictest494599-21grep10:50:002
36413099220,1cyclictest0-21swapper/210:05:122
36413099220,1cyclictest0-21swapper/208:15:192
36413099220,0cyclictest0-21swapper/209:45:102
36413099220,0cyclictest0-21swapper/207:50:192
364129992222,0cyclictest0-21swapper/112:05:171
364129992222,0cyclictest0-21swapper/111:10:121
364129992222,0cyclictest0-21swapper/108:20:111
364129992221,1cyclictest368160-21apt-get07:15:121
364129992221,1cyclictest0-21swapper/111:05:111
364129992220,1cyclictest0-21swapper/109:30:121
364129992219,2cyclictest385455-21idleruntime-cro07:45:001
364129992219,2cyclictest385455-21idleruntime-cro07:45:001
36412999220,22cyclictest546530-21ntpq12:15:201
36412999220,22cyclictest469892-21ntpq10:05:191
36412999220,22cyclictest0-21swapper/112:35:121
36412999220,22cyclictest0-21swapper/110:45:001
36412999220,22cyclictest0-21swapper/110:25:121
36412999220,22cyclictest0-21swapper/110:10:101
36412999220,21cyclictest0-21swapper/110:45:111
36412999220,21cyclictest0-21swapper/109:25:141
36412999220,21cyclictest0-21swapper/109:15:121
36412999220,1cyclictest509785-21apt-get11:15:111
36412999220,1cyclictest456712-21apt-get09:45:101
36412999220,1cyclictest450772-21apt-get09:35:101
364126992221,1cyclictest364457-21apt-get07:10:110
364126992221,1cyclictest0-21swapper/012:15:130
364126992221,1cyclictest0-21swapper/009:50:110
36412699220,22cyclictest0-21swapper/009:10:010
36412699220,22cyclictest0-21swapper/007:20:000
36412699220,21cyclictest0-21swapper/010:15:130
36412699220,21cyclictest0-21swapper/009:55:130
36412699220,21cyclictest0-21swapper/009:20:120
36412699220,21cyclictest0-21swapper/008:35:100
36412699220,1cyclictest0-21swapper/008:30:130
36412699220,0cyclictest0-21swapper/009:25:140
364143992121,0cyclictest0-21swapper/712:05:117
364143992121,0cyclictest0-21swapper/712:00:127
364143992121,0cyclictest0-21swapper/708:45:137
364143992120,1cyclictest556996-21apt-get12:35:127
364143992120,1cyclictest495024-21apt-get10:50:137
364143992120,1cyclictest480287-21apt-get10:25:127
36414399210,21cyclictest415358-21apt-get08:35:117
36414399210,20cyclictest0-21swapper/712:10:127
36414399210,20cyclictest0-21swapper/707:20:207
36414399210,0cyclictest0-21swapper/710:10:127
36414399210,0cyclictest0-21swapper/708:25:147
36414399210,0cyclictest0-21swapper/708:05:127
364141992121,0cyclictest0-21swapper/608:45:136
364141992120,1cyclictest385464-21munin-run07:45:006
364141992120,1cyclictest385464-21munin-run07:45:006
364141992120,1cyclictest0-21swapper/610:10:116
364141992120,1cyclictest0-21swapper/607:10:186
36414199210,21cyclictest0-21swapper/608:40:126
36414199210,21cyclictest0-21swapper/607:30:116
36414199210,20cyclictest0-21swapper/612:15:136
36414199210,20cyclictest0-21swapper/611:15:126
36414199210,20cyclictest0-21swapper/608:35:116
36414199210,1cyclictest407915-21ntpq08:20:186
36414199210,0cyclictest0-21swapper/611:40:136
364139992121,0cyclictest0-21swapper/511:15:025
364139992121,0cyclictest0-21swapper/511:05:185
364139992120,1cyclictest0-21swapper/511:10:125
364139992120,1cyclictest0-21swapper/510:30:135
364139992120,1cyclictest0-21swapper/509:40:035
364139992120,1cyclictest0-21swapper/509:00:125
364139992119,1cyclictest800-21mta-sts-daemon10:10:125
36413999211,0cyclictest0-21swapper/511:55:125
36413999210,21cyclictest0-21swapper/510:00:115
36413999210,0cyclictest0-21swapper/510:35:115
36413999210,0cyclictest0-21swapper/508:05:125
364136992121,0cyclictest0-21swapper/411:40:134
364136992121,0cyclictest0-21swapper/410:50:134
364136992121,0cyclictest0-21swapper/410:50:004
364136992121,0cyclictest0-21swapper/409:40:124
364136992121,0cyclictest0-21swapper/407:35:144
364136992120,1cyclictest512754-21apt-get11:20:144
364136992120,1cyclictest0-21swapper/408:20:004
364136992119,1cyclictest460980-21ntp_kernel_pll_09:50:174
36413699210,21cyclictest414940-21perf08:35:004
36413699210,20cyclictest0-21swapper/407:25:134
36413699210,0cyclictest0-21swapper/412:00:124
364135992121,0cyclictest0-21swapper/308:55:123
364135992121,0cyclictest0-21swapper/308:30:133
364135992120,1cyclictest0-21swapper/311:45:103
364135992120,1cyclictest0-21swapper/310:25:133
364135992120,1cyclictest0-21swapper/309:55:133
364135992120,1cyclictest0-21swapper/309:30:123
364135992119,2cyclictest0-21swapper/312:35:123
36413599210,20cyclictest0-21swapper/310:00:123
364130992121,0cyclictest0-21swapper/212:35:122
364130992121,0cyclictest0-21swapper/210:25:122
364130992121,0cyclictest0-21swapper/208:50:122
364130992121,0cyclictest0-21swapper/208:35:112
364130992121,0cyclictest0-21swapper/208:10:122
364130992120,1cyclictest539319-21apt-get12:05:112
364130992120,1cyclictest483229-21apt-get10:30:132
364130992120,1cyclictest0-21swapper/208:20:112
364130992119,1cyclictest0-21swapper/209:50:112
364130992117,4cyclictest0-21swapper/212:05:002
364129992121,0cyclictest0-21swapper/110:55:141
364129992120,1cyclictest528805-21ntpq11:45:171
364129992120,1cyclictest0-21swapper/112:30:131
364129992120,1cyclictest0-21swapper/112:00:001
364129992120,1cyclictest0-21swapper/109:50:111
364129992120,1cyclictest0-21swapper/108:40:131
364129992119,1cyclictest374068-21apt-get07:25:141
364129992118,3cyclictest538910-21perf-exec12:05:001
364129992116,4cyclictest394285-21sendmail08:00:001
36412999210,21cyclictest0-21swapper/108:50:121
36412999210,21cyclictest0-21swapper/108:35:111
36412999210,21cyclictest0-21swapper/108:15:141
36412999210,21cyclictest0-21swapper/107:30:121
36412999210,0cyclictest0-21swapper/111:50:131
364126992121,0cyclictest0-21swapper/012:10:130
364126992121,0cyclictest0-21swapper/011:40:120
364126992121,0cyclictest0-21swapper/010:35:110
364126992121,0cyclictest0-21swapper/008:05:180
364126992121,0cyclictest0-21swapper/007:35:140
364126992120,1cyclictest559542-21sendmail12:40:000
364126992120,1cyclictest0-21swapper/011:30:200
364126992120,1cyclictest0-21swapper/011:30:200
364126992120,1cyclictest0-21swapper/011:20:140
36412699210,21cyclictest0-21swapper/011:05:110
36412699210,21cyclictest0-21swapper/010:20:110
36412699210,21cyclictest0-21swapper/007:40:110
36412699210,21cyclictest0-21swapper/007:40:100
36412699210,0cyclictest0-21swapper/010:10:110
36412699210,0cyclictest0-21swapper/009:15:120
36412699210,0cyclictest0-21swapper/008:55:130
36412699210,0cyclictest0-21swapper/007:55:120
36412699210,0cyclictest0-21swapper/007:25:140
364143992020,0cyclictest0-21swapper/712:30:127
364143992020,0cyclictest0-21swapper/711:40:207
364143992020,0cyclictest0-21swapper/710:05:127
364143992020,0cyclictest0-21swapper/709:50:117
364143992020,0cyclictest0-21swapper/709:45:117
364143992020,0cyclictest0-21swapper/709:10:037
364143992020,0cyclictest0-21swapper/709:00:197
364143992020,0cyclictest0-21swapper/708:15:147
364143992020,0cyclictest0-21swapper/708:00:117
364143992020,0cyclictest0-21swapper/707:25:147
364143992020,0cyclictest0-21swapper/707:10:117
36414399200,20cyclictest0-21swapper/710:30:187
36414399200,0cyclictest0-21swapper/708:40:197
364141992020,0cyclictest0-21swapper/611:50:136
364141992020,0cyclictest0-21swapper/610:25:136
364141992020,0cyclictest0-21swapper/609:30:126
364141992020,0cyclictest0-21swapper/609:00:186
364141992020,0cyclictest0-21swapper/608:50:126
364141992020,0cyclictest0-21swapper/608:15:206
364141992020,0cyclictest0-21swapper/608:10:126
364141992020,0cyclictest0-21swapper/608:00:116
364141992019,1cyclictest468497-21apt-get10:05:126
364141992019,1cyclictest0-21swapper/612:05:116
364141992019,1cyclictest0-21swapper/611:05:006
364141992019,1cyclictest0-21swapper/610:45:006
36414199200,20cyclictest0-21swapper/609:10:036
36414199200,20cyclictest0-21swapper/607:55:116
364139992020,0cyclictest0-21swapper/512:30:125
364139992020,0cyclictest0-21swapper/512:25:195
364139992020,0cyclictest0-21swapper/511:35:125
364139992020,0cyclictest0-21swapper/511:35:125
364139992020,0cyclictest0-21swapper/511:00:125
364139992020,0cyclictest0-21swapper/510:55:145
364139992020,0cyclictest0-21swapper/509:30:175
364139992020,0cyclictest0-21swapper/509:15:125
364139992020,0cyclictest0-21swapper/508:55:195
364139992020,0cyclictest0-21swapper/507:20:195
364139992019,1cyclictest421261-21apt-get08:45:135
364136992020,0cyclictest0-21swapper/412:15:134
364136992020,0cyclictest0-21swapper/411:45:114
364136992020,0cyclictest0-21swapper/411:00:124
364136992020,0cyclictest0-21swapper/410:25:124
364136992020,0cyclictest0-21swapper/409:35:124
364136992020,0cyclictest0-21swapper/409:10:114
364136992020,0cyclictest0-21swapper/408:55:134
364136992020,0cyclictest0-21swapper/408:35:114
364136992020,0cyclictest0-21swapper/407:55:114
364136992019,1cyclictest475664-21ntpq10:15:194
364136992015,4cyclictest500492-21perf11:00:004
36413699200,19cyclictest0-21swapper/412:05:114
36413699200,19cyclictest0-21swapper/407:50:144
36413699200,0cyclictest0-21swapper/411:40:004
36413699200,0cyclictest0-21swapper/411:40:004
36413699200,0cyclictest0-21swapper/410:00:004
36413699200,0cyclictest0-21swapper/408:05:124
364135992020,0cyclictest0-21swapper/312:05:113
364135992020,0cyclictest0-21swapper/308:20:103
364135992020,0cyclictest0-21swapper/307:50:143
36413599200,19cyclictest456476-21ls09:45:003
36413599200,19cyclictest0-21swapper/311:25:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional