You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 21:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Thu Jul 23, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1772692263181,67sleep20-21swapper/207:08:342
1771582233186,25sleep30-21swapper/307:06:583
1770772223191,21sleep50-21swapper/507:05:475
1771282221167,43sleep00-21swapper/007:06:300
1773002218184,22sleep60-21swapper/607:09:016
1748462218185,22sleep40-21swapper/407:05:054
1772952217183,23sleep10-21swapper/107:08:571
1770612211179,21sleep70-21swapper/707:05:337
2184412630,0sleep10-21swapper/108:15:201
17762099364,19cyclictest2340292sleep508:41:195
17761199330,1cyclictest0-21swapper/211:15:112
17761199330,1cyclictest0-21swapper/211:15:112
177617992820,7cyclictest281514-21cron10:05:004
17761199280,27cyclictest361229-21dump-pmu-power12:20:012
177617992722,4cyclictest233106-21awk08:40:184
17761799270,26cyclictest228838-21apt-get08:35:144
17761799260,1cyclictest313986-21apt-get10:59:594
17761599260,25cyclictest316986-21ls11:04:593
177611992621,4cyclictest234329-21perf08:45:012
177611992621,4cyclictest0-21swapper/210:29:592
17761199260,1cyclictest0-21swapper/210:15:132
177609992621,4cyclictest313988-21turbostat11:00:001
17762399250,24cyclictest3422186-21systemd-journal08:30:017
177617992520,5cyclictest306919-21ntpq10:45:194
177617992520,4cyclictest0-21swapper/408:55:154
177611992522,3cyclictest0-21swapper/207:15:142
177611992522,3cyclictest0-21swapper/207:15:142
177611992520,4cyclictest0-21swapper/211:45:132
17761199250,21cyclictest0-21swapper/211:25:032
17761199250,1cyclictest0-21swapper/208:25:132
17761199250,1cyclictest0-21swapper/208:15:192
177609992524,1cyclictest0-21swapper/108:20:121
17762399240,23cyclictest367595-21apt-get12:30:117
17762399240,23cyclictest0-21swapper/707:15:147
17762399240,23cyclictest0-21swapper/707:15:147
17762399240,22cyclictest0-21swapper/710:40:007
177621992419,4cyclictest207774-21awk08:00:016
17762199240,23cyclictest254975-21latency_hist09:20:006
17762199240,23cyclictest0-21swapper/607:30:016
17762199240,23cyclictest0-21swapper/607:30:016
177617992423,1cyclictest217042-21apt-get08:15:134
177617992420,4cyclictest269747-21perf09:45:004
17761799240,22cyclictest0-21swapper/409:50:194
17761799240,21cyclictest0-21swapper/412:25:154
17761799240,0cyclictest0-21swapper/410:40:134
17761599240,23cyclictest0-21swapper/310:55:113
17761599240,23cyclictest0-21swapper/308:50:123
17761599240,23cyclictest0-21swapper/308:30:113
177611992422,1cyclictest346496-21turbostat11:55:002
177611992420,4cyclictest0-21swapper/212:25:112
17761199240,23cyclictest0-21swapper/207:45:202
17761199240,23cyclictest0-21swapper/207:25:132
17761199240,23cyclictest0-21swapper/207:25:122
177609992423,1cyclictest295165-21ntpq10:25:201
17760999240,23cyclictest275626-21awk09:54:591
17760999240,23cyclictest246112-21munin-run09:05:011
17760999240,23cyclictest0-21swapper/109:55:151
17760999240,1cyclictest0-21swapper/108:55:201
17760699240,24cyclictest266805-21plymouth09:40:000
17760699240,23cyclictest231350-21turbostat08:40:010
17760699240,1cyclictest0-21swapper/011:30:000
177623992321,1cyclictest314472-21apt-get11:00:137
17762399230,22cyclictest319931-21grep11:10:007
17762399230,22cyclictest0-21swapper/710:00:117
17762399230,22cyclictest0-21swapper/708:30:127
17762399230,22cyclictest0-21swapper/708:10:127
177621992322,1cyclictest321712-21ntpq11:10:186
177621992321,1cyclictest216616-21munin-run08:15:006
177621992321,1cyclictest201892-21munin-run07:50:016
17762199230,22cyclictest177943-21apt-get07:10:116
17762199230,22cyclictest0-21swapper/609:50:126
17762199230,1cyclictest222948-21apt-get08:25:126
17762099230,22cyclictest240634-21apt-get08:55:145
17762099230,22cyclictest234748-21apt-get08:45:115
17762099230,22cyclictest0-21swapper/507:25:125
17762099230,22cyclictest0-21swapper/507:25:125
17762099230,0cyclictest0-21swapper/510:30:125
177617992323,0cyclictest0-21swapper/411:35:194
177617992322,1cyclictest290799-21apt-get10:20:104
177617992320,2cyclictest0-21swapper/408:20:174
177617992319,4cyclictest0-21swapper/411:25:184
177617992319,3cyclictest244869-21ntpq09:00:164
177615992323,0cyclictest0-21swapper/307:25:183
177615992323,0cyclictest0-21swapper/307:25:183
177615992322,1cyclictest0-21swapper/309:40:113
17761599230,23cyclictest888-21rs:main3
17761599230,22cyclictest361226-21apt-get12:20:043
17761599230,22cyclictest279013-21apt-get10:00:133
17761599230,22cyclictest0-21swapper/309:05:023
17761599230,22cyclictest0-21swapper/307:35:133
177611992322,1cyclictest0-21swapper/207:10:122
177611992321,2cyclictest0-21swapper/209:30:122
177611992320,3cyclictest0-21swapper/209:40:122
177611992320,3cyclictest0-21swapper/207:30:122
17761199230,1cyclictest0-21swapper/208:25:012
177609992323,0cyclictest0-21swapper/111:25:021
17760999230,22cyclictest262655-21awk09:30:191
17760999230,22cyclictest0-21swapper/110:35:111
17760999230,22cyclictest0-21swapper/110:10:121
177606992322,1cyclictest0-21swapper/009:30:000
177606992322,1cyclictest0-21swapper/009:05:120
177606992321,2cyclictest1-21systemd07:40:010
17760699230,23cyclictest1-21systemd10:39:590
17760699230,1cyclictest312790-21ntpq10:55:170
17760699230,1cyclictest0-21swapper/010:20:110
17760699230,0cyclictest0-21swapper/007:45:200
17760699230,0cyclictest0-21swapper/007:25:130
17760699230,0cyclictest0-21swapper/007:25:120
177623992222,0cyclictest0-21swapper/708:55:207
177623992222,0cyclictest0-21swapper/708:15:127
177623992221,1cyclictest0-21swapper/711:45:127
177623992221,1cyclictest0-21swapper/707:35:137
177623992220,1cyclictest361235-21munin-run12:20:007
177623992220,1cyclictest0-21swapper/709:20:107
177623992220,1cyclictest0-21swapper/707:15:017
17762399220,21cyclictest0-21swapper/711:50:127
17762399220,21cyclictest0-21swapper/711:40:127
17762399220,21cyclictest0-21swapper/711:10:177
17762399220,21cyclictest0-21swapper/710:55:177
17762399220,21cyclictest0-21swapper/710:25:137
17762399220,21cyclictest0-21swapper/710:15:137
17762399220,21cyclictest0-21swapper/710:05:107
17762399220,21cyclictest0-21swapper/709:00:187
17762399220,21cyclictest0-21swapper/707:55:147
17762399220,21cyclictest0-21swapper/707:50:137
17762399220,1cyclictest185953-21ntpq07:20:197
17762399220,1cyclictest185953-21ntpq07:20:197
17762399220,1cyclictest0-21swapper/707:25:137
17762399220,1cyclictest0-21swapper/707:25:137
177621992221,1cyclictest355770-21apt-get12:10:136
177621992221,1cyclictest202314-21apt-get07:50:136
177621992221,1cyclictest0-21swapper/608:35:016
17762199220,22cyclictest1-21systemd11:20:006
17762199220,22cyclictest1-21systemd11:19:596
17762199220,21cyclictest335143-21apt-get11:35:146
17762199220,21cyclictest287837-21apt-get10:15:146
17762199220,21cyclictest0-21swapper/612:25:116
17762199220,1cyclictest293796-21apt-get10:25:146
17762199220,1cyclictest182978-21ntpq07:15:206
17762199220,1cyclictest182978-21ntpq07:15:206
17762199220,1cyclictest0-21swapper/611:20:126
177620992222,0cyclictest0-21swapper/510:50:115
177620992222,0cyclictest0-21swapper/510:20:175
177620992222,0cyclictest0-21swapper/507:40:185
177620992222,0cyclictest0-21swapper/507:15:135
177620992222,0cyclictest0-21swapper/507:15:125
177620992221,1cyclictest364652-21apt-get12:25:105
177620992221,1cyclictest284474-21perf10:09:595
177620992221,1cyclictest281521-21apt10:05:005
177620992221,1cyclictest231361-21perf08:40:015
17762099220,22cyclictest0-21swapper/511:35:005
17762099220,22cyclictest0-21swapper/507:20:205
17762099220,22cyclictest0-21swapper/507:20:205
17762099220,1cyclictest302653-21apt-get10:40:135
17762099220,1cyclictest252459-21apt-get09:15:145
17762099220,1cyclictest249517-21apt-get09:10:135
17762099220,0cyclictest0-21swapper/512:15:125
17762099220,0cyclictest0-21swapper/508:25:135
177617992222,0cyclictest0-21swapper/412:30:104
177617992221,1cyclictest332196-21apt-get11:30:124
177617992221,1cyclictest0-21swapper/411:05:194
177617992220,2cyclictest0-21swapper/412:05:194
177617992220,1cyclictest361710-21apt-get12:20:124
177617992219,2cyclictest270167-21apt-get09:45:144
177617992218,3cyclictest0-21swapper/409:05:034
17761799220,22cyclictest0-21swapper/407:40:124
17761799220,21cyclictest225892-21apt-get08:30:124
17761799220,21cyclictest0-21swapper/411:45:124
17761799220,21cyclictest0-21swapper/411:20:124
17761799220,21cyclictest0-21swapper/411:15:124
17761799220,21cyclictest0-21swapper/411:15:124
17761799220,21cyclictest0-21swapper/410:05:094
17761799220,1cyclictest0-21swapper/407:20:134
17761799220,1cyclictest0-21swapper/407:20:134
17761799220,0cyclictest0-21swapper/411:40:194
177615992221,1cyclictest231358-21munin-run08:40:013
17761599220,22cyclictest361420-21cut12:20:013
17761599220,22cyclictest276048-21apt-get09:55:113
17761599220,22cyclictest0-21swapper/311:30:113
17761599220,21cyclictest370539-21apt-get12:35:093
17761599220,21cyclictest214100-21apt-get08:10:133
17761599220,21cyclictest0-21swapper/307:45:133
17761599220,1cyclictest255422-21apt-get09:20:123
17761599220,1cyclictest0-21swapper/307:15:013
17761599220,0cyclictest0-21swapper/311:05:123
177611992222,0cyclictest0-21swapper/208:10:132
177611992221,1cyclictest0-21swapper/211:15:002
177611992221,1cyclictest0-21swapper/210:35:122
177611992220,1cyclictest0-21swapper/210:30:182
17761199220,22cyclictest239066-21ntpq08:50:192
17761199220,22cyclictest0-21swapper/211:40:192
17761199220,21cyclictest0-21swapper/211:55:112
17761199220,21cyclictest0-21swapper/209:50:122
17761199220,21cyclictest0-21swapper/209:25:002
17761199220,21cyclictest0-21swapper/207:40:122
17761199220,0cyclictest0-21swapper/209:05:112
177609992222,0cyclictest0-21swapper/107:10:021
177609992221,1cyclictest0-21swapper/109:35:121
177609992221,0cyclictest0-21swapper/112:00:131
17760999220,21cyclictest0-21swapper/112:00:011
17760999220,21cyclictest0-21swapper/111:00:121
17760999220,21cyclictest0-21swapper/110:00:131
17760999220,21cyclictest0-21swapper/109:15:121
17760999220,21cyclictest0-21swapper/109:10:121
17760999220,21cyclictest0-21swapper/108:50:191
17760999220,21cyclictest0-21swapper/108:25:121
17760999220,21cyclictest0-21swapper/108:10:131
17760999220,1cyclictest0-21swapper/110:50:001
17760999220,0cyclictest0-21swapper/112:20:001
177606992222,0cyclictest0-21swapper/009:30:130
177606992221,1cyclictest0-21swapper/011:25:010
177606992221,1cyclictest0-21swapper/009:05:010
177606992220,2cyclictest337672-21systemctl11:40:000
17760699220,22cyclictest352401-21turbostat12:05:010
17760699220,22cyclictest0-21swapper/011:40:180
17760699220,22cyclictest0-21swapper/010:20:000
17760699220,22cyclictest0-21swapper/007:55:130
17760699220,22cyclictest0-21swapper/007:15:020
17760699220,22cyclictest0-21swapper/007:15:020
17760699220,21cyclictest320354-21apt-get11:10:120
17760699220,21cyclictest0-21swapper/012:30:170
17760699220,21cyclictest0-21swapper/010:05:100
17760699220,21cyclictest0-21swapper/008:45:100
17760699220,21cyclictest0-21swapper/007:30:110
17760699220,1cyclictest325859-21cron11:20:000
17760699220,1cyclictest325859-21cron11:19:590
17760699220,0cyclictest270167-21apt-get09:45:140
177623992121,0cyclictest0-21swapper/708:50:127
177623992120,1cyclictest284894-21apt-get10:10:127
177623992120,1cyclictest275630-21perf09:55:007
177623992120,1cyclictest261321-21apt-get09:30:137
177623992120,1cyclictest199368-21apt-get07:45:147
177623992120,1cyclictest0-21swapper/710:49:597
177623992120,1cyclictest0-21swapper/708:00:117
177623992119,1cyclictest0-21swapper/712:25:177
17762399210,0cyclictest231799-21apt-get08:40:107
177621992121,0cyclictest0-21swapper/610:20:116
177621992121,0cyclictest0-21swapper/609:05:126
177621992121,0cyclictest0-21swapper/608:45:116
177621992121,0cyclictest0-21swapper/608:00:116
177621992121,0cyclictest0-21swapper/607:40:126
177621992121,0cyclictest0-21swapper/607:25:016
177621992121,0cyclictest0-21swapper/607:25:016
177621992120,1cyclictest343560-21munin-run11:49:596
177621992120,1cyclictest281950-21apt-get10:05:086
177621992120,1cyclictest0-21swapper/612:05:196
177621992120,0cyclictest0-21swapper/611:05:136
17762199210,21cyclictest346508-21perf11:54:596
17762199210,21cyclictest0-21swapper/610:45:186
17762199210,20cyclictest0-21swapper/609:55:116
17762199210,0cyclictest0-21swapper/612:35:106
17762199210,0cyclictest0-21swapper/610:35:116
17762199210,0cyclictest0-21swapper/609:35:126
17762199210,0cyclictest0-21swapper/609:00:136
177620992121,0cyclictest0-21swapper/511:10:125
177620992121,0cyclictest0-21swapper/511:00:135
177620992121,0cyclictest0-21swapper/509:20:125
177620992121,0cyclictest0-21swapper/508:30:195
177620992121,0cyclictest0-21swapper/507:10:015
177620992120,1cyclictest363043-21ntpq12:20:185
177620992120,1cyclictest196014-21awk07:40:005
177620992120,1cyclictest0-21swapper/509:05:015
177620992120,1cyclictest0-21swapper/507:55:015
177620992117,4cyclictest354194-21cat12:05:215
17762099210,21cyclictest0-21swapper/512:35:115
17762099210,21cyclictest0-21swapper/512:10:135
17762099210,21cyclictest0-21swapper/511:20:125
17762099210,0cyclictest0-21swapper/509:40:125
177617992121,0cyclictest0-21swapper/408:05:124
177617992120,1cyclictest0-21swapper/411:10:114
177617992120,1cyclictest0-21swapper/408:50:124
177617992120,1cyclictest0-21swapper/407:25:184
177617992120,1cyclictest0-21swapper/407:25:184
177617992119,2cyclictest0-21swapper/412:10:134
17761799210,21cyclictest0-21swapper/411:55:114
17761799210,21cyclictest0-21swapper/407:30:184
17761799210,21cyclictest0-21swapper/407:10:034
17761799210,1cyclictest266794-21idleruntime-cro09:39:594
17761799210,0cyclictest0-21swapper/407:55:134
177615992121,0cyclictest0-21swapper/312:05:133
177615992121,0cyclictest0-21swapper/311:45:183
177615992121,0cyclictest0-21swapper/310:50:193
177615992121,0cyclictest0-21swapper/310:25:133
177615992120,1cyclictest351168-21awk12:00:183
177615992120,1cyclictest208216-21apt-get08:00:113
177615992120,1cyclictest0-21swapper/308:40:123
17761599210,21cyclictest0-21swapper/311:26:353
17761599210,21cyclictest0-21swapper/309:05:003
17761599210,21cyclictest0-21swapper/308:45:113
17761599210,0cyclictest0-21swapper/310:35:123
17761599210,0cyclictest0-21swapper/308:55:213
177611992121,0cyclictest0-21swapper/209:45:132
177611992121,0cyclictest0-21swapper/207:20:192
177611992121,0cyclictest0-21swapper/207:20:182
177611992120,1cyclictest0-21swapper/210:10:122
177611992120,1cyclictest0-21swapper/208:35:132
177611992120,1cyclictest0-21swapper/207:50:122
177611992117,3cyclictest293366-21ls10:25:002
17761199210,1cyclictest355346-21munin-run12:10:002
17761199210,1cyclictest308116-21perf10:50:002
17761199210,1cyclictest0-21swapper/212:00:182
17761199210,1cyclictest0-21swapper/211:20:132
17761199210,10cyclictest357803-21grep12:10:232
17761199210,0cyclictest0-21swapper/209:55:102
17761199210,0cyclictest0-21swapper/208:05:192
177609992121,0cyclictest0-21swapper/110:50:121
177609992121,0cyclictest0-21swapper/108:00:101
177609992121,0cyclictest0-21swapper/107:50:131
177609992120,1cyclictest0-21swapper/111:25:011
177609992120,1cyclictest0-21swapper/107:15:141
177609992120,1cyclictest0-21swapper/107:15:141
177609992119,1cyclictest36-21ksoftirqd/108:10:011
177609992119,1cyclictest338103-21apt-get11:40:121
17760999210,20cyclictest0-21swapper/111:50:191
17760999210,20cyclictest0-21swapper/107:40:121
17760999210,1cyclictest0-21swapper/110:40:131
17760999210,0cyclictest0-21swapper/112:35:101
17760999210,0cyclictest0-21swapper/112:25:171
17760999210,0cyclictest0-21swapper/110:20:111
17760999210,0cyclictest0-21swapper/109:45:141
17760999210,0cyclictest0-21swapper/109:20:111
17760999210,0cyclictest0-21swapper/107:45:141
177606992121,0cyclictest0-21swapper/009:10:120
177606992121,0cyclictest0-21swapper/008:20:120
177606992121,0cyclictest0-21swapper/008:05:120
177606992121,0cyclictest0-21swapper/008:00:160
177606992120,1cyclictest317416-21apt-get11:05:130
177606992120,1cyclictest238990-21ntpq08:50:180
177606992120,1cyclictest204834-21perf07:55:010
177606992120,1cyclictest0-21swapper/012:20:120
177606992120,1cyclictest0-21swapper/011:30:120
177606992120,1cyclictest0-21swapper/008:30:120
17760699210,21cyclictest0-21swapper/009:55:090
17760699210,21cyclictest0-21swapper/008:25:130
17760699210,1cyclictest0-21swapper/008:15:120
17760699210,0cyclictest0-21swapper/011:45:110
177623992020,0cyclictest0-21swapper/712:10:137
177623992020,0cyclictest0-21swapper/711:30:127
177623992020,0cyclictest0-21swapper/711:25:037
177623992020,0cyclictest0-21swapper/709:55:157
177623992020,0cyclictest0-21swapper/709:15:137
177623992020,0cyclictest0-21swapper/708:35:207
177623992020,0cyclictest0-21swapper/708:20:127
177623992019,1cyclictest0-21swapper/712:35:107
177623992016,3cyclictest265639-21ntp_states09:35:197
177621992020,0cyclictest0-21swapper/611:30:126
177621992020,0cyclictest0-21swapper/609:20:116
177621992020,0cyclictest0-21swapper/608:50:126
177621992020,0cyclictest0-21swapper/608:40:126
177621992020,0cyclictest0-21swapper/608:35:146
177621992020,0cyclictest0-21swapper/608:15:116
177621992020,0cyclictest0-21swapper/607:35:126
177621992019,1cyclictest349886-21apt-get12:00:126
177621992019,1cyclictest296747-21apt-get10:30:126
17762199200,20cyclictest0-21swapper/612:15:126
17762199200,0cyclictest0-21swapper/611:45:006
177620992020,0cyclictest0-21swapper/511:45:125
177620992020,0cyclictest0-21swapper/511:40:195
177620992020,0cyclictest0-21swapper/511:35:135
177620992020,0cyclictest0-21swapper/511:25:035
177620992020,0cyclictest0-21swapper/510:15:145
177620992020,0cyclictest0-21swapper/509:25:125
177620992019,1cyclictest349485-21awk12:00:005
17762099200,20cyclictest0-21swapper/511:00:015
177617992020,0cyclictest0-21swapper/409:10:134
177617992020,0cyclictest0-21swapper/408:45:114
177617992019,1cyclictest343984-21apt-get11:50:124
177617992019,1cyclictest0-21swapper/409:30:134
177617992019,1cyclictest0-21swapper/409:25:134
17761799200,0cyclictest0-21swapper/410:25:194
177615992020,0cyclictest0-21swapper/311:40:143
177615992020,0cyclictest0-21swapper/311:20:123
177615992020,0cyclictest0-21swapper/311:10:113
177615992020,0cyclictest0-21swapper/310:20:103
177615992020,0cyclictest0-21swapper/309:45:133
177615992020,0cyclictest0-21swapper/309:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional