You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 07:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Wed Jul 01, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7034192257184,22sleep10-21swapper/119:06:571
7033212248174,22sleep70-21swapper/719:05:347
7035702246185,50sleep40-21swapper/419:09:104
7034892229192,24sleep60-21swapper/619:07:586
7036042225185,26sleep00-21swapper/019:09:370
7033402224166,48sleep50-21swapper/519:05:485
7034202221186,23sleep20-21swapper/219:06:582
7033262221187,23sleep30-21swapper/319:05:393
7488552770,1sleep2431rcuc/220:25:012
70384999290,28cyclictest710388-21dump-pmu-power19:20:004
703849992821,6cyclictest0-21swapper/420:30:004
70384999270,1cyclictest869683-21idleruntime-cro23:49:594
70384999260,25cyclictest0-21swapper/423:40:004
70384999260,25cyclictest0-21swapper/419:50:134
70384999260,1cyclictest0-21swapper/421:10:124
703849992521,3cyclictest719282-21perf-exec19:34:594
703849992520,4cyclictest728143-21idleruntime-cro19:50:004
703849992520,4cyclictest0-21swapper/421:05:004
70384999250,20cyclictest0-21swapper/423:10:114
70384999250,0cyclictest0-21swapper/421:50:134
70384999250,0cyclictest0-21swapper/421:25:104
70384999250,0cyclictest0-21swapper/420:00:114
703857992420,3cyclictest879289-21basename00:09:597
70384999240,23cyclictest0-21swapper/422:10:034
70384999240,0cyclictest0-21swapper/422:30:124
70384999240,0cyclictest0-21swapper/419:25:114
70384699240,23cyclictest853717-21ntpq23:20:173
70384699240,1cyclictest873028-21apt-get23:55:093
70384699240,1cyclictest0-21swapper/300:00:113
70383999240,0cyclictest0-21swapper/123:05:131
703838992422,1cyclictest861243-21apt-get23:35:130
70383899240,23cyclictest857862-21latency_hist23:29:590
70383899240,1cyclictest821282-21ntpq22:25:180
703857992323,0cyclictest0-21swapper/723:00:127
703857992322,1cyclictest805238-21apt-get22:00:137
70385799230,22cyclictest706899-21latency_hist19:15:017
70385799230,22cyclictest0-21swapper/720:20:137
70385799230,22cyclictest0-21swapper/719:45:127
70385399230,23cyclictest0-21swapper/621:20:126
70385399230,22cyclictest769880-21apt-get21:00:116
70385399230,0cyclictest0-21swapper/619:45:126
703850992323,0cyclictest0-21swapper/523:15:135
703850992322,1cyclictest807752-21munin-run22:05:005
703850992322,1cyclictest761041-21apt-get20:45:135
703850992322,1cyclictest0-21swapper/521:55:125
703850992322,1cyclictest0-21swapper/520:05:005
703850992321,1cyclictest0-21swapper/520:55:005
70385099230,22cyclictest707867-21apt-get19:15:115
70385099230,22cyclictest3422186-21systemd-journal23:00:005
70385099230,22cyclictest0-21swapper/522:40:125
703849992321,1cyclictest748834-21perf20:25:004
703849992320,3cyclictest0-21swapper/421:35:104
703849992320,3cyclictest0-21swapper/421:35:104
703849992319,3cyclictest795970-21munin-plugin-st21:45:014
703849992319,3cyclictest0-21swapper/422:40:124
70384999230,22cyclictest0-21swapper/423:00:134
70384999230,22cyclictest0-21swapper/419:40:134
70384999230,22cyclictest0-21swapper/400:35:144
70384999230,0cyclictest0-21swapper/421:55:134
703846992323,0cyclictest0-21swapper/321:35:103
703846992323,0cyclictest0-21swapper/321:35:103
70384699230,22cyclictest837664-21apt-get22:55:123
70384699230,22cyclictest735800-21ntpq20:00:183
70384699230,22cyclictest0-21swapper/322:00:123
70384699230,22cyclictest0-21swapper/319:25:113
703844992322,1cyclictest802280-21apt-get21:55:132
70384499230,22cyclictest0-21swapper/223:25:122
70384499230,22cyclictest0-21swapper/222:30:132
70384499230,22cyclictest0-21swapper/220:10:132
70384499230,1cyclictest0-21swapper/223:59:592
70384499230,1cyclictest0-21swapper/220:40:132
70384499230,0cyclictest0-21swapper/222:05:122
70383999230,22cyclictest991-21snmpd23:30:121
70383999230,22cyclictest840633-21apt-get23:00:121
70383999230,22cyclictest741708-21ntpq20:10:181
70383999230,22cyclictest0-21swapper/120:20:131
70383999230,22cyclictest0-21swapper/119:10:131
70383999230,1cyclictest719698-21apt-get19:35:111
70383999230,1cyclictest0-21swapper/121:05:151
703838992322,1cyclictest750629-21sh20:25:190
70383899230,22cyclictest710361-21cron19:20:000
70383899230,22cyclictest0-21swapper/020:55:120
70383899230,22cyclictest0-21swapper/020:00:130
70383899230,22cyclictest0-21swapper/000:00:120
70383899230,1cyclictest790495-21apt-get21:35:110
70383899230,1cyclictest790495-21apt-get21:35:100
703857992221,1cyclictest731523-21apt-get19:55:137
70385799220,22cyclictest844890-21ntpq23:05:187
70385799220,22cyclictest0-21swapper/723:50:127
70385799220,22cyclictest0-21swapper/700:30:137
70385799220,1cyclictest864202-21apt-get23:40:117
70385799220,1cyclictest766921-21apt-get20:55:127
703853992222,0cyclictest0-21swapper/620:45:126
703853992222,0cyclictest0-21swapper/620:05:036
703853992221,1cyclictest888584-21apt-get00:25:126
703853992221,1cyclictest814092-21apt-get22:15:116
703853992221,1cyclictest749255-21apt-get20:25:116
703853992221,1cyclictest740402-21apt-get20:10:126
703853992221,1cyclictest0-21swapper/622:45:146
703853992221,1cyclictest0-21swapper/619:35:186
70385399220,22cyclictest725171-21munin-run19:45:006
70385399220,22cyclictest0-21swapper/622:40:006
70385399220,22cyclictest0-21swapper/619:10:136
70385399220,21cyclictest811155-21apt-get22:10:126
70385399220,21cyclictest0-21swapper/623:45:136
70385399220,21cyclictest0-21swapper/622:50:156
70385399220,21cyclictest0-21swapper/622:20:126
70385399220,21cyclictest0-21swapper/621:40:176
70385399220,21cyclictest0-21swapper/621:10:136
70385399220,1cyclictest713349-21awk19:25:006
70385399220,0cyclictest0-21swapper/619:55:126
703850992222,0cyclictest0-21swapper/521:15:145
703850992221,1cyclictest772823-21apt-get21:05:135
703850992221,1cyclictest0-21swapper/520:30:125
70385099220,22cyclictest0-21swapper/522:50:155
70385099220,22cyclictest0-21swapper/519:40:015
70385099220,22cyclictest0-21swapper/500:25:125
70385099220,21cyclictest0-21swapper/523:50:125
70385099220,21cyclictest0-21swapper/522:20:145
70385099220,21cyclictest0-21swapper/521:20:125
70385099220,21cyclictest0-21swapper/520:10:145
70385099220,21cyclictest0-21swapper/519:55:125
70385099220,1cyclictest873031-21sshd-session23:55:105
70385099220,1cyclictest716282-21apt-get19:30:055
703849992221,1cyclictest0-21swapper/423:30:124
703849992221,1cyclictest0-21swapper/400:15:034
703849992220,2cyclictest0-21swapper/423:15:124
703849992220,1cyclictest840211-21sendmail23:00:014
703849992219,3cyclictest0-21swapper/421:20:204
703849992219,3cyclictest0-21swapper/421:05:134
703849992218,3cyclictest0-21swapper/423:20:114
70384999220,21cyclictest722187-21cron19:40:004
70384999220,21cyclictest0-21swapper/422:35:124
70384999220,21cyclictest0-21swapper/420:05:024
70384999220,1cyclictest857880-21perf23:29:594
70384999220,1cyclictest0-21swapper/423:55:164
703846992222,0cyclictest0-21swapper/319:40:133
703846992222,0cyclictest0-21swapper/300:15:143
703846992221,1cyclictest885645-21apt-get00:20:133
703846992221,1cyclictest0-21swapper/319:20:133
703846992220,1cyclictest0-21swapper/319:35:173
70384699220,22cyclictest0-21swapper/323:15:133
70384699220,21cyclictest894473-21apt-get00:35:143
70384699220,21cyclictest0-21swapper/321:05:133
70384699220,21cyclictest0-21swapper/321:00:173
70384699220,21cyclictest0-21swapper/319:50:123
70384699220,21cyclictest0-21swapper/300:25:193
70384699220,1cyclictest0-21swapper/323:25:123
70384699220,1cyclictest0-21swapper/322:30:013
70384699220,0cyclictest0-21swapper/322:05:123
70384699220,0cyclictest0-21swapper/321:30:013
703844992222,0cyclictest0-21swapper/222:10:022
703844992222,0cyclictest0-21swapper/221:45:132
703844992222,0cyclictest0-21swapper/220:05:002
703844992221,1cyclictest0-21swapper/221:25:112
703844992221,1cyclictest0-21swapper/219:20:012
703844992221,1cyclictest0-21swapper/200:15:202
703844992220,1cyclictest0-21swapper/221:50:142
70384499220,21cyclictest0-21swapper/223:20:002
70384499220,21cyclictest0-21swapper/221:00:112
70384499220,21cyclictest0-21swapper/220:50:192
70384499220,21cyclictest0-21swapper/220:35:112
70384499220,21cyclictest0-21swapper/219:55:122
70384499220,21cyclictest0-21swapper/219:45:032
70384499220,21cyclictest0-21swapper/219:40:122
70384499220,21cyclictest0-21swapper/219:35:112
70384499220,1cyclictest846512-21apt-get23:10:122
70384499220,1cyclictest0-21swapper/220:05:132
70384499220,0cyclictest781666-21apt-get21:20:122
703839992221,1cyclictest0-21swapper/122:10:001
703839992221,1cyclictest0-21swapper/100:10:141
703839992217,4cyclictest716579-21tar19:30:011
70383999220,22cyclictest0-21swapper/123:44:591
70383999220,21cyclictest732787-21ntpq19:55:181
703838992222,0cyclictest0-21swapper/021:00:110
703838992221,1cyclictest882202-21apt-get00:15:030
703838992221,1cyclictest870091-21apt-get23:50:120
703838992221,1cyclictest737461-21apt-get20:05:120
703838992221,1cyclictest0-21swapper/020:45:180
703838992220,1cyclictest875554-21perf00:00:000
70383899220,21cyclictest828847-21apt-get22:40:130
70383899220,21cyclictest775761-21apt-get21:10:130
70383899220,21cyclictest0-21swapper/022:20:000
70383899220,21cyclictest0-21swapper/020:30:130
70383899220,21cyclictest0-21swapper/000:20:140
70383899220,1cyclictest858301-21apt-get23:30:130
70383899220,1cyclictest817062-21apt-get22:20:130
703857992121,0cyclictest0-21swapper/723:30:137
703857992121,0cyclictest0-21swapper/722:40:007
703857992121,0cyclictest0-21swapper/722:30:117
703857992121,0cyclictest0-21swapper/722:25:197
703857992121,0cyclictest0-21swapper/722:10:127
703857992121,0cyclictest0-21swapper/721:50:137
703857992121,0cyclictest0-21swapper/721:40:117
703857992121,0cyclictest0-21swapper/721:10:147
703857992121,0cyclictest0-21swapper/720:10:127
703857992120,1cyclictest875999-21apt-get00:00:137
703857992120,1cyclictest736990-21apt-get20:05:037
703857992120,1cyclictest734483-21apt-get20:00:137
70385799210,21cyclictest743339-21apt-get20:15:117
70385799210,21cyclictest713367-21basename19:25:017
70385799210,21cyclictest0-21swapper/723:10:117
70385799210,21cyclictest0-21swapper/721:45:127
70385799210,21cyclictest0-21swapper/720:50:117
70385799210,21cyclictest0-21swapper/720:25:117
70385799210,21cyclictest0-21swapper/719:15:117
70385799210,21cyclictest0-21swapper/700:25:127
703853992121,0cyclictest0-21swapper/623:30:136
703853992121,0cyclictest0-21swapper/623:10:176
703853992120,1cyclictest852418-21apt-get23:20:126
703853992120,1cyclictest737063-21appstreamcli20:05:016
703853992120,1cyclictest0-21swapper/622:30:116
70385399210,21cyclictest0-21swapper/621:45:136
70385399210,21cyclictest0-21swapper/621:25:106
70385399210,21cyclictest0-21swapper/620:20:136
70385399210,20cyclictest0-21swapper/620:40:216
70385399210,1cyclictest790075-21awk21:35:006
70385399210,1cyclictest790075-21awk21:35:006
70385399210,0cyclictest0-21swapper/623:50:126
70385399210,0cyclictest0-21swapper/622:55:116
70385399210,0cyclictest0-21swapper/622:05:006
703850992121,0cyclictest0-21swapper/523:05:125
703850992121,0cyclictest0-21swapper/521:00:115
703850992120,1cyclictest725634-21apt-get19:45:115
703850992120,1cyclictest0-21swapper/523:10:115
703850992120,1cyclictest0-21swapper/522:30:125
703850992120,1cyclictest0-21swapper/522:05:125
703850992120,1cyclictest0-21swapper/520:40:135
703850992120,1cyclictest0-21swapper/519:50:125
703850992120,1cyclictest0-21swapper/500:35:145
703850992120,0cyclictest0-21swapper/523:40:115
703850992120,0cyclictest0-21swapper/500:30:125
70385099210,21cyclictest784610-21apt-get21:25:105
70385099210,21cyclictest0-21swapper/523:35:145
70385099210,21cyclictest0-21swapper/522:10:135
70385099210,21cyclictest0-21swapper/520:20:135
70385099210,21cyclictest0-21swapper/519:25:115
70385099210,20cyclictest0-21swapper/523:20:125
70385099210,0cyclictest0-21swapper/521:50:135
70385099210,0cyclictest0-21swapper/520:05:035
70384999213,17cyclictest0-21swapper/421:15:194
703849992121,0cyclictest0-21swapper/423:05:124
703849992121,0cyclictest0-21swapper/400:25:184
703849992120,1cyclictest0-21swapper/422:20:144
703849992120,1cyclictest0-21swapper/421:45:134
703849992120,1cyclictest0-21swapper/421:35:004
703849992120,1cyclictest0-21swapper/421:35:004
703849992119,1cyclictest0-21swapper/420:20:014
703849992118,3cyclictest0-21swapper/423:40:184
70384999210,20cyclictest807750-21ls22:05:004
70384999210,20cyclictest0-21swapper/419:20:134
70384999210,0cyclictest0-21swapper/419:10:124
70384999210,0cyclictest0-21swapper/400:20:214
703846992121,0cyclictest0-21swapper/323:30:123
703846992121,0cyclictest0-21swapper/323:05:193
703846992121,0cyclictest0-21swapper/323:00:143
703846992121,0cyclictest0-21swapper/321:50:143
703846992121,0cyclictest0-21swapper/320:55:133
703846992121,0cyclictest0-21swapper/320:10:123
703846992121,0cyclictest0-21swapper/300:30:123
703846992121,0cyclictest0-21swapper/300:10:073
703846992120,1cyclictest0-21swapper/322:50:133
703846992120,1cyclictest0-21swapper/320:05:133
703846992120,1cyclictest0-21swapper/319:15:013
70384699210,21cyclictest0-21swapper/320:15:123
70384699210,1cyclictest794789-21ntpq21:40:183
70384699210,0cyclictest0-21swapper/323:10:113
70384699210,0cyclictest0-21swapper/321:45:133
70384699210,0cyclictest0-21swapper/321:10:123
70384699210,0cyclictest0-21swapper/319:10:143
703844992121,0cyclictest0-21swapper/223:30:122
703844992121,0cyclictest0-21swapper/223:20:122
703844992121,0cyclictest0-21swapper/223:05:132
703844992121,0cyclictest0-21swapper/220:45:122
703844992121,0cyclictest0-21swapper/219:50:132
703844992120,1cyclictest0-21swapper/221:40:002
703844992120,1cyclictest0-21swapper/221:40:002
703844992120,1cyclictest0-21swapper/221:15:132
703844992120,1cyclictest0-21swapper/220:25:132
703844992120,1cyclictest0-21swapper/200:20:202
703844992119,1cyclictest706672-21idleruntime-cro19:15:012
70384499210,20cyclictest0-21swapper/219:30:032
70384499210,0cyclictest0-21swapper/223:35:122
70384499210,0cyclictest0-21swapper/222:50:142
70384499210,0cyclictest0-21swapper/222:35:132
70384499210,0cyclictest0-21swapper/221:30:202
70384499210,0cyclictest0-21swapper/221:30:192
703839992121,0cyclictest0-21swapper/122:40:131
703839992121,0cyclictest0-21swapper/122:10:111
703839992120,1cyclictest716753-21apt-get19:30:121
703839992120,1cyclictest0-21swapper/119:45:121
703839992120,1cyclictest0-21swapper/119:45:001
703839992120,1cyclictest0-21swapper/119:15:131
703839992117,3cyclictest751789-21idleruntime-cro20:30:011
70383999210,21cyclictest0-21swapper/123:25:111
70383999210,21cyclictest0-21swapper/122:35:141
70383999210,21cyclictest0-21swapper/100:35:141
70383999210,20cyclictest0-21swapper/123:55:111
703838992121,0cyclictest0-21swapper/021:25:100
703838992121,0cyclictest0-21swapper/020:40:130
703838992121,0cyclictest0-21swapper/019:50:120
703838992121,0cyclictest0-21swapper/000:30:130
703838992121,0cyclictest0-21swapper/000:10:070
703838992120,1cyclictest0-21swapper/023:40:180
703838992120,1cyclictest0-21swapper/020:35:190
70383899210,21cyclictest0-21swapper/023:05:000
70383899210,21cyclictest0-21swapper/022:10:110
70383899210,20cyclictest0-21swapper/019:45:020
70383899210,1cyclictest705544-21ntpq19:10:190
70383899210,0cyclictest0-21swapper/000:35:150
703857992020,0cyclictest0-21swapper/723:45:137
703857992020,0cyclictest0-21swapper/722:40:137
703857992020,0cyclictest0-21swapper/722:20:127
703857992020,0cyclictest0-21swapper/722:15:107
703857992020,0cyclictest0-21swapper/721:35:117
703857992020,0cyclictest0-21swapper/721:35:107
703857992020,0cyclictest0-21swapper/721:30:147
703857992020,0cyclictest0-21swapper/721:30:137
703857992020,0cyclictest0-21swapper/721:15:137
703857992020,0cyclictest0-21swapper/721:05:147
703857992020,0cyclictest0-21swapper/721:00:127
703857992020,0cyclictest0-21swapper/720:45:127
703857992020,0cyclictest0-21swapper/720:40:137
703857992020,0cyclictest0-21swapper/720:30:137
703857992019,1cyclictest0-21swapper/723:55:117
70385799200,20cyclictest0-21swapper/719:50:127
70385799200,20cyclictest0-21swapper/700:20:147
703853992020,0cyclictest0-21swapper/623:55:106
703853992020,0cyclictest0-21swapper/621:05:146
703853992020,0cyclictest0-21swapper/600:35:156
703853992020,0cyclictest0-21swapper/600:30:126
703853992020,0cyclictest0-21swapper/600:15:026
703853992019,1cyclictest799340-21apt-get21:50:136
703853992019,1cyclictest0-21swapper/623:00:186
703853992019,1cyclictest0-21swapper/600:15:006
70385399200,0cyclictest0-21swapper/621:55:126
703850992020,0cyclictest0-21swapper/522:25:125
703850992020,0cyclictest0-21swapper/521:30:135
703850992020,0cyclictest0-21swapper/521:30:135
703850992020,0cyclictest0-21swapper/520:25:115
703850992020,0cyclictest0-21swapper/519:40:115
703850992020,0cyclictest0-21swapper/500:15:125
703850992020,0cyclictest0-21swapper/500:10:085
703850992019,1cyclictest8696722sleep523:49:595
703850992019,1cyclictest0-21swapper/523:00:135
703850992019,1cyclictest0-21swapper/522:45:135
70385099200,0cyclictest0-21swapper/522:35:125
703849992020,0cyclictest0-21swapper/420:15:014
703849992020,0cyclictest0-21swapper/400:30:124
703849992019,1cyclictest0-21swapper/422:25:124
703849992019,1cyclictest0-21swapper/420:40:134
703849992017,3cyclictest0-21swapper/419:55:124
70384999200,20cyclictest0-21swapper/422:05:124
70384999200,1cyclictest0-21swapper/423:50:204
70384999200,19cyclictest0-21swapper/400:00:114
70384999200,17cyclictest0-21swapper/422:15:154
70384999200,0cyclictest0-21swapper/420:30:114
703846992020,0cyclictest0-21swapper/323:45:143
703846992020,0cyclictest0-21swapper/322:45:133
703846992020,0cyclictest0-21swapper/322:40:123
703846992020,0cyclictest0-21swapper/322:10:023
703846992020,0cyclictest0-21swapper/321:30:133
703846992020,0cyclictest0-21swapper/321:30:133
703846992020,0cyclictest0-21swapper/320:35:123
703846992020,0cyclictest0-21swapper/319:45:203
703846992019,1cyclictest716355-21appstreamcli19:30:033
703844992020,0cyclictest0-21swapper/223:45:142
703844992020,0cyclictest0-21swapper/222:40:192
703844992020,0cyclictest0-21swapper/222:20:122
703844992019,1cyclictest882213-21munin-run00:14:592
703844992018,1cyclictest891097-21munin-run00:30:012
70384499200,19cyclictest0-21swapper/220:15:112
70384499200,0cyclictest0-21swapper/222:25:122
703839992020,0cyclictest0-21swapper/122:55:111
703839992020,0cyclictest0-21swapper/121:50:131
703839992020,0cyclictest0-21swapper/121:35:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional