You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 20:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Fri May 29, 2026 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6181612274192,24sleep50-21swapper/507:09:505
6181612274192,24sleep50-21swapper/507:09:505
6178852229192,25sleep10-21swapper/107:05:511
6178852229192,25sleep10-21swapper/107:05:511
6179782227166,19sleep00-21swapper/007:07:120
6179782227166,19sleep00-21swapper/007:07:120
6181672225186,26sleep20-21swapper/207:09:552
6181672225186,26sleep20-21swapper/207:09:552
6180502225187,25sleep70-21swapper/707:08:167
6180502225187,25sleep70-21swapper/707:08:167
6179732225174,19sleep40-21swapper/407:07:074
6179732225174,19sleep40-21swapper/407:07:074
6180672224187,24sleep60-21swapper/607:08:306
6180672224187,24sleep60-21swapper/607:08:306
6179522219190,19sleep30-21swapper/307:06:503
6179522219190,19sleep30-21swapper/307:06:503
61839599260,24cyclictest648037-21munin-plugin-st08:25:004
61838499260,25cyclictest628295-21ntpq07:30:180
618404992523,1cyclictest0-21swapper/609:25:126
61840099250,24cyclictest637609-21sh08:00:005
61839599250,24cyclictest621413-21latency_hist07:15:004
61839599250,24cyclictest621413-21latency_hist07:15:004
61839199250,4cyclictest661784-21taskset08:55:123
61839199250,24cyclictest0-21swapper/307:20:143
61838999250,24cyclictest0-21swapper/208:35:112
61838999250,1cyclictest657193-21ntpq08:45:142
61838699250,24cyclictest741151-21latency_hist11:10:001
61838499250,4cyclictest643517-21turbostat08:10:000
618406992423,1cyclictest762538-21ntpq11:40:177
618406992423,1cyclictest759614-21sh11:35:187
618406992423,1cyclictest676085-21grep09:20:007
618404992423,1cyclictest0-21swapper/611:15:116
61840499240,1cyclictest650972-21cron08:30:016
61840099240,23cyclictest775962-21apt-get12:05:125
61840099240,23cyclictest682024-21ls09:30:005
618395992417,7cyclictest0-21swapper/411:12:184
618395992417,7cyclictest0-21swapper/411:12:184
618391992423,1cyclictest0-21swapper/311:12:183
618391992423,1cyclictest0-21swapper/311:12:183
618391992422,1cyclictest0-21swapper/312:39:343
61839199240,23cyclictest0-21swapper/309:25:113
618386992420,4cyclictest664320-21awk09:00:001
61838699240,24cyclictest795331-21grep12:35:171
61838499240,23cyclictest784844-21apt-get12:20:110
61840699230,22cyclictest685397-21apt-get09:35:117
61840699230,22cyclictest634343-21apt-get07:50:087
61840699230,0cyclictest790820-21apt-get12:30:147
618404992321,1cyclictest717551-21cron10:30:006
618404992321,1cyclictest633165-21munin-run07:45:006
618404992321,1cyclictest0-21swapper/612:25:006
618404992321,1cyclictest0-21swapper/612:00:126
618404992321,1cyclictest0-21swapper/610:20:006
61840499230,22cyclictest0-21swapper/612:35:186
61840499230,22cyclictest0-21swapper/612:34:546
61840499230,22cyclictest0-21swapper/607:20:196
61840499230,1cyclictest684968-21turbostat09:35:006
61840499230,1cyclictest0-21swapper/608:05:116
618400992321,1cyclictest778902-21apt-get12:10:105
618400992321,1cyclictest676093-21perf09:20:005
61840099230,22cyclictest0-21swapper/511:40:025
61840099230,22cyclictest0-21swapper/511:10:105
61840099230,22cyclictest0-21swapper/511:10:105
618395992322,1cyclictest673562-21apt-get09:15:114
618395992322,1cyclictest0-21swapper/409:45:004
618395992321,1cyclictest0-21swapper/407:50:004
61839599230,22cyclictest1-21systemd12:39:344
61839599230,22cyclictest0-21swapper/412:20:114
61839599230,22cyclictest0-21swapper/412:05:104
618391992323,0cyclictest0-21swapper/309:45:163
618391992322,1cyclictest664742-21apt-get09:00:113
618391992321,1cyclictest0-21swapper/310:55:123
61839199230,22cyclictest0-21swapper/311:45:113
61839199230,22cyclictest0-21swapper/311:40:173
61839199230,22cyclictest0-21swapper/308:50:113
61839199230,22cyclictest0-21swapper/308:25:123
618389992321,2cyclictest743933-21systemctl11:12:182
618389992321,2cyclictest743933-21systemctl11:12:172
61838999230,23cyclictest651001-21idleruntime-cro08:30:002
61838999230,22cyclictest660112-21ntpq08:50:172
61838999230,22cyclictest0-21swapper/212:05:002
61838999230,22cyclictest0-21swapper/211:35:122
61838999230,22cyclictest0-21swapper/210:00:102
618386992323,0cyclictest0-21swapper/111:12:181
618386992323,0cyclictest0-21swapper/111:12:181
618386992322,1cyclictest0-21swapper/111:45:121
618386992322,1cyclictest0-21swapper/110:30:181
618386992322,1cyclictest0-21swapper/108:00:001
61838699230,23cyclictest0-21swapper/109:20:121
61838699230,23cyclictest0-21swapper/107:30:121
61838699230,22cyclictest0-21swapper/108:20:031
61838699230,1cyclictest653501-21ntpq08:35:171
61838699230,1cyclictest630205-21munin-run07:40:011
61838499230,22cyclictest0-21swapper/010:35:130
61838499230,22cyclictest0-21swapper/010:30:100
61838499230,22cyclictest0-21swapper/009:45:150
61838499230,22cyclictest0-21swapper/008:50:120
61838499230,1cyclictest0-21swapper/010:50:110
618406992222,0cyclictest0-21swapper/708:15:177
618406992221,1cyclictest711650-21cron10:20:007
618406992221,1cyclictest676564-21apt-get09:20:117
618406992221,1cyclictest0-21swapper/712:25:117
618406992221,1cyclictest0-21swapper/708:20:037
61840699220,22cyclictest0-21swapper/712:00:117
61840699220,22cyclictest0-21swapper/710:50:117
61840699220,22cyclictest0-21swapper/709:00:177
61840699220,21cyclictest732739-21apt-get10:55:127
61840699220,21cyclictest0-21swapper/712:20:117
61840699220,21cyclictest0-21swapper/712:05:117
61840699220,21cyclictest0-21swapper/709:50:107
61840699220,21cyclictest0-21swapper/708:00:127
61840699220,1cyclictest0-21swapper/710:10:127
61840699220,0cyclictest0-21swapper/709:05:187
618404992222,0cyclictest0-21swapper/611:12:176
618404992222,0cyclictest0-21swapper/611:12:176
618404992222,0cyclictest0-21swapper/610:10:136
618404992222,0cyclictest0-21swapper/608:15:106
618404992220,1cyclictest723459-21munin-plugin-st10:40:006
618404992220,1cyclictest0-21swapper/611:45:116
618404992220,1cyclictest0-21swapper/610:40:196
618404992220,1cyclictest0-21swapper/607:40:006
61840499220,21cyclictest0-21swapper/611:55:126
61840499220,21cyclictest0-21swapper/610:05:136
61840499220,21cyclictest0-21swapper/609:55:126
61840499220,21cyclictest0-21swapper/608:35:166
61840499220,1cyclictest0-21swapper/609:55:006
618400992222,0cyclictest0-21swapper/512:20:035
618400992220,1cyclictest694299-21apt-get09:50:115
618400992220,1cyclictest0-21swapper/510:45:195
618400992220,1cyclictest0-21swapper/509:35:195
61840099220,22cyclictest0-21swapper/512:35:115
61840099220,21cyclictest752341-21apt-get11:25:125
61840099220,21cyclictest648467-21apt-get08:25:135
61840099220,21cyclictest644703-21apt-get08:15:105
61840099220,21cyclictest0-21swapper/511:35:175
61840099220,21cyclictest0-21swapper/511:05:115
61840099220,21cyclictest0-21swapper/509:45:155
61840099220,21cyclictest0-21swapper/509:40:135
61840099220,1cyclictest682453-21apt-get09:30:115
618395992222,0cyclictest0-21swapper/410:05:124
618395992222,0cyclictest0-21swapper/409:10:124
618395992221,1cyclictest755287-21apt-get11:30:144
618395992221,1cyclictest0-21swapper/407:40:124
618395992219,3cyclictest735268-21sendmail11:00:014
61839599220,22cyclictest0-21swapper/412:30:124
61839599220,22cyclictest0-21swapper/411:40:004
61839599220,22cyclictest0-21swapper/409:40:004
61839599220,21cyclictest0-21swapper/411:45:114
61839599220,21cyclictest0-21swapper/410:15:134
61839599220,21cyclictest0-21swapper/409:45:164
61839599220,21cyclictest0-21swapper/408:35:124
61839599220,1cyclictest0-21swapper/408:20:004
61839599220,0cyclictest0-21swapper/410:35:194
61839599220,0cyclictest0-21swapper/407:20:134
618391992222,0cyclictest0-21swapper/310:15:123
618391992221,1cyclictest655885-21apt-get08:45:083
618391992221,1cyclictest0-21swapper/312:30:123
618391992220,1cyclictest687949-21cron09:40:003
618391992220,1cyclictest0-21swapper/309:20:103
618391992220,1cyclictest0-21swapper/308:35:113
61839199220,22cyclictest0-21swapper/311:50:123
61839199220,21cyclictest0-21swapper/312:25:183
61839199220,21cyclictest0-21swapper/311:15:163
61839199220,21cyclictest0-21swapper/310:50:113
61839199220,21cyclictest0-21swapper/309:40:123
61839199220,21cyclictest0-21swapper/309:15:193
61839199220,1cyclictest718001-21apt-get10:30:103
61839199220,1cyclictest0-21swapper/311:35:173
61839199220,1cyclictest0-21swapper/308:05:173
618389992222,0cyclictest0-21swapper/212:05:112
618389992221,1cyclictest793438-21apt-get12:34:532
618389992221,1cyclictest709063-21apt-get10:15:122
618389992220,1cyclictest3422186-21systemd-journal08:00:002
61838999220,22cyclictest0-21swapper/207:30:132
61838999220,21cyclictest0-21swapper/211:30:132
61838999220,21cyclictest0-21swapper/211:20:112
61838999220,21cyclictest0-21swapper/209:55:032
61838999220,21cyclictest0-21swapper/209:40:122
61838999220,21cyclictest0-21swapper/209:25:122
61838999220,1cyclictest651755-21awk08:35:002
61838999220,1cyclictest641006-21apt-get08:05:122
61838999220,0cyclictest0-21swapper/211:50:122
618386992221,1cyclictest0-21swapper/112:30:011
61838699220,22cyclictest0-21swapper/112:20:001
61838699220,22cyclictest0-21swapper/110:05:121
61838699220,21cyclictest773021-21apt-get12:00:111
61838699220,21cyclictest0-21swapper/112:30:131
61838699220,21cyclictest0-21swapper/111:55:111
61838699220,21cyclictest0-21swapper/108:15:101
618384992221,1cyclictest712117-21apt-get10:20:110
618384992221,1cyclictest652168-21apt-get08:35:110
618384992221,1cyclictest0-21swapper/012:33:510
618384992221,1cyclictest0-21swapper/012:20:010
61838499220,22cyclictest0-21swapper/011:25:100
61838499220,22cyclictest0-21swapper/009:55:000
61838499220,22cyclictest0-21swapper/008:25:180
61838499220,21cyclictest0-21swapper/011:35:110
61838499220,21cyclictest0-21swapper/009:20:110
61838499220,21cyclictest0-21swapper/008:45:080
61838499220,1cyclictest723908-21apt-get10:40:120
61838499220,1cyclictest620078-21ntpq07:10:170
61838499220,1cyclictest620078-21ntpq07:10:170
61838499220,1cyclictest0-21swapper/009:04:590
618406992121,0cyclictest0-21swapper/712:35:117
618406992121,0cyclictest0-21swapper/712:15:117
618406992121,0cyclictest0-21swapper/708:35:117
618406992121,0cyclictest0-21swapper/708:25:127
618406992120,1cyclictest661781-21apt-get08:55:127
618406992120,1cyclictest0-21swapper/711:45:167
618406992120,1cyclictest0-21swapper/711:15:187
618406992120,0cyclictest679506-21apt-get09:25:117
61840699210,21cyclictest0-21swapper/709:30:127
61840699210,0cyclictest0-21swapper/707:30:117
618404992121,0cyclictest0-21swapper/611:40:036
618404992121,0cyclictest0-21swapper/609:40:126
618404992121,0cyclictest0-21swapper/609:15:186
618404992121,0cyclictest0-21swapper/609:05:126
618404992121,0cyclictest0-21swapper/607:30:176
618404992121,0cyclictest0-21swapper/607:10:116
618404992121,0cyclictest0-21swapper/607:10:106
618404992120,1cyclictest760800-21sendmail11:40:006
618404992120,1cyclictest749403-21apt-get11:20:136
618404992120,1cyclictest0-21swapper/610:50:176
618404992120,1cyclictest0-21swapper/610:30:156
618404992120,1cyclictest0-21swapper/609:45:216
618404992120,1cyclictest0-21swapper/608:20:036
61840499210,0cyclictest0-21swapper/609:20:116
61840499210,0cyclictest0-21swapper/608:50:126
618400992121,0cyclictest0-21swapper/512:30:135
618400992121,0cyclictest0-21swapper/512:15:115
618400992121,0cyclictest0-21swapper/511:45:115
618400992121,0cyclictest0-21swapper/511:00:125
618400992121,0cyclictest0-21swapper/510:10:135
618400992121,0cyclictest0-21swapper/509:55:195
618400992120,1cyclictest773021-21apt-get12:00:115
618400992120,1cyclictest654698-21systemctl08:40:005
618400992120,1cyclictest0-21swapper/510:35:125
618400992120,1cyclictest0-21swapper/507:20:135
618400992120,0cyclictest0-21swapper/507:10:125
618400992120,0cyclictest0-21swapper/507:10:115
618400992119,1cyclictest0-21swapper/509:05:195
61840099210,21cyclictest748963-21munin-run11:20:005
61840099210,20cyclictest676169-21appstreamcli09:20:025
61840099210,20cyclictest0-21swapper/507:30:115
61840099210,1cyclictest767119-21apt-get11:50:125
618395992121,0cyclictest0-21swapper/411:40:174
618395992121,0cyclictest0-21swapper/409:20:114
618395992121,0cyclictest0-21swapper/408:50:114
61839599210,0cyclictest0-21swapper/411:15:164
61839599210,0cyclictest0-21swapper/410:30:104
61839599210,0cyclictest0-21swapper/408:25:114
618391992121,0cyclictest0-21swapper/311:55:163
618391992121,0cyclictest0-21swapper/311:20:113
618391992121,0cyclictest0-21swapper/311:05:193
618391992121,0cyclictest0-21swapper/310:40:123
618391992121,0cyclictest0-21swapper/308:20:033
61839199210,21cyclictest715062-21apt-get10:25:153
61839199210,21cyclictest0-21swapper/310:35:183
61839199210,21cyclictest0-21swapper/307:10:103
61839199210,21cyclictest0-21swapper/307:10:103
61839199210,0cyclictest0-21swapper/312:15:103
61839199210,0cyclictest0-21swapper/310:10:003
618389992121,0cyclictest0-21swapper/212:25:122
618389992121,0cyclictest0-21swapper/210:55:122
618389992121,0cyclictest0-21swapper/208:15:102
618389992121,0cyclictest0-21swapper/207:10:112
618389992121,0cyclictest0-21swapper/207:10:112
618389992120,1cyclictest703182-21apt-get10:05:122
618389992120,1cyclictest686739-21ntpq09:35:182
61838999210,21cyclictest708656-21basename10:15:002
61838999210,21cyclictest0-21swapper/209:10:132
61838999210,21cyclictest0-21swapper/208:00:182
61838999210,0cyclictest0-21swapper/211:25:172
61838999210,0cyclictest0-21swapper/211:05:122
61838999210,0cyclictest0-21swapper/210:25:152
61838999210,0cyclictest0-21swapper/207:40:112
618386992121,0cyclictest667684-21apt-get09:05:121
618386992121,0cyclictest0-21swapper/110:35:121
618386992121,0cyclictest0-21swapper/110:15:501
618386992121,0cyclictest0-21swapper/109:40:121
618386992120,1cyclictest0-21swapper/109:30:011
61838699210,21cyclictest0-21swapper/112:20:041
61838699210,20cyclictest0-21swapper/110:25:131
61838699210,0cyclictest0-21swapper/111:20:121
61838699210,0cyclictest0-21swapper/110:20:111
61838699210,0cyclictest0-21swapper/109:10:111
618384992121,0cyclictest0-21swapper/011:40:110
618384992121,0cyclictest0-21swapper/010:10:120
618384992120,1cyclictest764177-21apt-get11:45:120
618384992120,1cyclictest0-21swapper/007:20:120
61838499210,21cyclictest0-21swapper/010:15:110
61838499210,20cyclictest0-21swapper/008:00:120
61838499210,1cyclictest0-21swapper/009:15:110
61838499210,0cyclictest0-21swapper/011:10:110
61838499210,0cyclictest0-21swapper/011:10:100
61838499210,0cyclictest0-21swapper/010:05:130
618406992020,0cyclictest0-21swapper/711:30:207
618406992020,0cyclictest0-21swapper/711:10:047
618406992020,0cyclictest0-21swapper/711:10:037
618406992020,0cyclictest0-21swapper/711:05:127
618406992020,0cyclictest0-21swapper/710:40:187
618406992020,0cyclictest0-21swapper/709:40:127
618406992020,0cyclictest0-21swapper/708:45:007
618406992020,0cyclictest0-21swapper/708:05:117
618406992020,0cyclictest0-21swapper/708:00:007
618406992020,0cyclictest0-21swapper/707:40:127
618406992019,1cyclictest735699-21apt-get11:00:127
618406992019,1cyclictest621396-21cat07:15:007
618406992019,1cyclictest621396-21cat07:15:007
618406992019,0cyclictest0-21swapper/709:55:027
61840699200,20cyclictest0-21swapper/711:20:117
61840699200,0cyclictest0-21swapper/711:55:127
618404992020,0cyclictest0-21swapper/612:05:116
618404992020,0cyclictest0-21swapper/611:05:126
618404992020,0cyclictest0-21swapper/609:10:126
618404992019,1cyclictest0-21swapper/608:00:116
61840499200,0cyclictest0-21swapper/612:25:116
618400992020,0cyclictest0-21swapper/511:20:135
618400992019,1cyclictest704484-21ntpq10:05:185
618400992019,1cyclictest0-21swapper/511:30:135
618400992019,1cyclictest0-21swapper/509:00:125
618395992020,0cyclictest0-21swapper/412:10:114
618395992020,0cyclictest0-21swapper/412:00:184
618395992020,0cyclictest0-21swapper/411:50:114
618395992020,0cyclictest0-21swapper/411:25:124
618395992020,0cyclictest0-21swapper/411:05:124
618395992020,0cyclictest0-21swapper/411:00:134
618395992020,0cyclictest0-21swapper/410:10:184
618395992020,0cyclictest0-21swapper/409:00:124
618395992020,0cyclictest0-21swapper/408:00:124
618395992019,1cyclictest729791-21apt-get10:50:114
618395992019,1cyclictest723908-21apt-get10:40:114
618395992019,1cyclictest0-21swapper/412:15:184
618395992019,1cyclictest0-21swapper/409:50:114
618395992019,1cyclictest0-21swapper/407:50:144
61839599200,0cyclictest0-21swapper/408:05:174
618391992020,0cyclictest0-21swapper/310:45:123
618391992020,0cyclictest0-21swapper/310:00:103
618391992020,0cyclictest0-21swapper/309:50:123
618391992020,0cyclictest0-21swapper/309:10:183
618391992019,1cyclictest0-21swapper/311:05:013
61839199200,0cyclictest0-21swapper/308:20:013
61839199200,0cyclictest0-21swapper/308:00:193
618389992020,0cyclictest0-21swapper/212:35:102
618389992020,0cyclictest0-21swapper/211:15:102
618389992020,0cyclictest0-21swapper/210:50:122
618389992020,0cyclictest0-21swapper/210:45:182
618389992020,0cyclictest0-21swapper/210:20:122
618389992020,0cyclictest0-21swapper/209:50:112
618389992020,0cyclictest0-21swapper/209:05:122
618389992020,0cyclictest0-21swapper/208:45:012
618389992020,0cyclictest0-21swapper/207:50:082
618389992019,1cyclictest720523-21munin-run10:35:012
618389992019,1cyclictest676407-21latency_hist09:20:012
618389992019,1cyclictest0-21swapper/211:05:002
618389992018,1cyclictest0-21swapper/212:20:012
618386992020,0cyclictest623193-21apt-get07:20:131
618386992020,0cyclictest0-21swapper/112:10:101
618386992020,0cyclictest0-21swapper/112:05:111
618386992020,0cyclictest0-21swapper/111:35:111
618386992020,0cyclictest0-21swapper/110:50:121
618386992020,0cyclictest0-21swapper/108:50:121
618386992020,0cyclictest0-21swapper/108:45:091
618386992020,0cyclictest0-21swapper/108:10:011
618386992019,1cyclictest761236-21apt-get11:40:121
618386992019,1cyclictest341rcuc/110:05:011
618386992019,1cyclictest0-21swapper/111:20:001
618386992019,1cyclictest0-21swapper/109:55:131
618386992019,1cyclictest0-21swapper/107:50:081
61838699200,0cyclictest0-21swapper/111:00:121
61838699200,0cyclictest0-21swapper/109:50:111
61838699200,0cyclictest0-21swapper/109:00:101
618384992020,0cyclictest0-21swapper/012:35:070
618384992020,0cyclictest0-21swapper/012:10:090
618384992020,0cyclictest0-21swapper/012:05:110
618384992020,0cyclictest0-21swapper/009:25:180
618384992020,0cyclictest0-21swapper/008:15:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional