You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 08:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Wed May 20, 2026 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4463632260173,24sleep40-21swapper/419:05:434
4465032231193,26sleep50-21swapper/519:07:455
4465082222184,25sleep10-21swapper/119:07:501
4465612221187,22sleep70-21swapper/719:08:367
4464562221188,22sleep30-21swapper/319:07:033
4464532221186,23sleep00-21swapper/019:07:000
4441412217183,23sleep20-21swapper/219:05:082
4464122215180,23sleep60-21swapper/619:06:256
44690399340,33cyclictest0-21swapper/122:55:111
44690399280,27cyclictest500665-21cron20:40:011
44690899260,25cyclictest550806-21cron22:05:003
44690899260,25cyclictest500731-21mkdir20:40:003
446924992520,4cyclictest618663-21turbostat00:00:007
446921992524,1cyclictest462358-21awk19:35:006
446921992523,1cyclictest0-21swapper/619:50:006
446921992523,1cyclictest0-21swapper/619:50:006
44691499250,24cyclictest595501-21apt-get23:20:125
44691499250,24cyclictest0-21swapper/521:45:205
44691499250,24cyclictest0-21swapper/519:25:125
44691099250,24cyclictest541997-21perf-exec21:50:004
44692199240,23cyclictest0-21swapper/600:20:006
446914992423,1cyclictest0-21swapper/523:30:115
446914992422,1cyclictest0-21swapper/521:10:005
44691499240,23cyclictest72-21ksoftirqd/523:15:155
44691499240,1cyclictest0-21swapper/521:40:125
44691099240,23cyclictest0-21swapper/420:15:184
44691099240,1cyclictest506592-21munin-run20:50:004
44690899242,1cyclictest598013-21ls23:25:003
44690599240,24cyclictest0-21swapper/219:50:182
44690599240,24cyclictest0-21swapper/219:50:182
44690599240,23cyclictest82950irq/129-eno123:45:132
44690599240,23cyclictest449947-21latency_hist19:15:002
44690399240,23cyclictest579128-21ntpq22:50:201
44690399240,23cyclictest465761-21apt-get19:40:121
446898992422,1cyclictest483435-21apt-get20:10:140
446898992422,1cyclictest17-21ksoftirqd/023:10:010
44689899240,23cyclictest241rcuc/019:25:000
44689899240,23cyclictest17-21ksoftirqd/020:20:000
44689899240,23cyclictest0-21swapper/023:40:000
44689899240,23cyclictest0-21swapper/000:20:210
44689899240,22cyclictest0-21swapper/022:55:000
446924992322,1cyclictest0-21swapper/721:25:177
44692499230,22cyclictest480494-21apt-get20:05:137
44692499230,22cyclictest0-21swapper/722:55:117
44692499230,22cyclictest0-21swapper/721:05:127
44692499230,22cyclictest0-21swapper/720:35:117
446921992323,0cyclictest0-21swapper/619:40:026
446921992321,1cyclictest506591-21awk20:50:016
446921992321,1cyclictest477552-21apt-get20:00:126
446921992319,3cyclictest571476-21idleruntime-cro22:40:016
44692199230,22cyclictest481845-21ntp_offset20:05:206
44692199230,22cyclictest1-21systemd00:25:016
44692199230,22cyclictest0-21swapper/622:00:206
44692199230,22cyclictest0-21swapper/600:10:126
44692199230,1cyclictest0-21swapper/621:20:126
446914992322,0cyclictest0-21swapper/521:35:115
446914992321,1cyclictest0-21swapper/500:25:125
446914992318,4cyclictest3422186-21systemd-journal23:15:005
44691499231,21cyclictest0-21swapper/519:30:115
44691499231,1cyclictest72-21ksoftirqd/520:55:015
44691499230,22cyclictest701rcuc/519:25:005
44691499230,22cyclictest488869-21cron20:20:005
44691499230,22cyclictest0-21swapper/523:40:005
44691499230,22cyclictest0-21swapper/500:30:135
44691499230,1cyclictest0-21swapper/520:30:135
44691099230,23cyclictest468297-21basename19:45:004
44691099230,23cyclictest0-21swapper/420:30:134
44690899230,22cyclictest640563-21apt-get00:35:123
44690899230,22cyclictest0-21swapper/322:20:123
44690899230,22cyclictest0-21swapper/321:00:133
44690899230,1cyclictest630468-21turbostat00:20:003
446905992323,0cyclictest0-21swapper/219:20:002
44690599230,22cyclictest518796-21apt-get21:10:122
44690599230,22cyclictest0-21swapper/223:35:122
44690599230,1cyclictest500684-21apt20:40:002
446903992322,1cyclictest590949-21ntpq23:10:171
44690399230,23cyclictest0-21swapper/120:40:171
44690399230,22cyclictest592536-21apt-get23:15:141
44690399230,22cyclictest495234-21apt-get20:30:131
446898992323,0cyclictest0-21swapper/023:30:110
446898992323,0cyclictest0-21swapper/023:15:140
446898992322,1cyclictest0-21swapper/021:10:000
44689899230,22cyclictest590899-21ntpq23:10:160
44689899230,22cyclictest0-21swapper/022:05:000
44689899230,22cyclictest0-21swapper/000:30:130
44689899230,1cyclictest0-21swapper/020:50:180
44689899230,0cyclictest0-21swapper/023:20:120
44689899230,0cyclictest0-21swapper/019:25:110
446924992222,0cyclictest0-21swapper/721:50:217
446924992222,0cyclictest0-21swapper/720:25:127
44692499220,22cyclictest0-21swapper/722:15:027
44692499220,22cyclictest0-21swapper/721:45:007
44692499220,22cyclictest0-21swapper/700:00:087
44692499220,21cyclictest560136-21apt-get22:20:137
44692499220,21cyclictest0-21swapper/720:00:197
44692499220,21cyclictest0-21swapper/719:25:127
44692499220,1cyclictest471644-21apt-get19:50:137
44692499220,1cyclictest471644-21apt-get19:50:137
44692499220,1cyclictest0-21swapper/722:35:007
44692499220,1cyclictest0-21swapper/719:20:117
44692499220,1cyclictest0-21swapper/719:15:197
446921992222,0cyclictest0-21swapper/623:40:116
446921992222,0cyclictest0-21swapper/623:40:116
446921992222,0cyclictest0-21swapper/622:10:126
446921992221,1cyclictest623343-21ntpq00:05:236
446921992221,1cyclictest0-21swapper/623:00:006
446921992220,1cyclictest0-21swapper/621:20:016
44692199220,21cyclictest0-21swapper/623:30:126
44692199220,21cyclictest0-21swapper/623:25:126
44692199220,21cyclictest0-21swapper/623:20:136
44692199220,21cyclictest0-21swapper/622:40:126
44692199220,21cyclictest0-21swapper/621:55:136
44692199220,21cyclictest0-21swapper/621:35:116
44692199220,21cyclictest0-21swapper/621:25:116
44692199220,21cyclictest0-21swapper/620:25:126
44692199220,21cyclictest0-21swapper/619:35:136
44692199220,21cyclictest0-21swapper/619:35:136
44692199220,21cyclictest0-21swapper/619:20:036
44692199220,21cyclictest0-21swapper/619:15:006
44692199220,21cyclictest0-21swapper/600:35:126
44692199220,0cyclictest0-21swapper/623:05:116
44692199220,0cyclictest0-21swapper/620:40:126
446914992222,0cyclictest0-21swapper/520:10:155
446914992221,0cyclictest0-21swapper/500:10:135
44691499220,21cyclictest701rcuc/523:10:005
44691499220,21cyclictest0-21swapper/522:05:015
44691499220,21cyclictest0-21swapper/521:00:115
44691499220,1cyclictest0-21swapper/500:20:145
446910992221,1cyclictest0-21swapper/423:05:114
446910992221,1cyclictest0-21swapper/400:15:104
446910992220,1cyclictest618670-21munin-run00:00:014
44691099220,22cyclictest0-21swapper/423:50:004
44691099220,22cyclictest0-21swapper/422:45:004
44691099220,22cyclictest0-21swapper/422:00:134
44691099220,21cyclictest563075-21apt-get22:25:114
44691099220,21cyclictest0-21swapper/422:05:134
44691099220,21cyclictest0-21swapper/421:10:124
44691099220,0cyclictest0-21swapper/423:40:114
44691099220,0cyclictest0-21swapper/423:40:114
446908992222,0cyclictest0-21swapper/323:50:013
446908992221,1cyclictest497761-21basename20:35:003
446908992221,1cyclictest0-21swapper/319:20:003
44690899220,22cyclictest595051-21turbostat23:20:003
44690899220,22cyclictest551257-21apt-get22:05:133
44690899220,21cyclictest619130-21apt-get00:00:143
44690899220,21cyclictest607292-21apt-get23:40:103
44690899220,21cyclictest607292-21apt-get23:40:103
44690899220,21cyclictest0-21swapper/322:30:113
44690899220,21cyclictest0-21swapper/319:50:143
44690899220,21cyclictest0-21swapper/319:50:133
446905992222,0cyclictest0-21swapper/221:50:132
446905992222,0cyclictest0-21swapper/200:35:202
446905992221,1cyclictest0-21swapper/220:35:002
446905992220,1cyclictest0-21swapper/200:25:022
44690599220,22cyclictest633567-21latency_hist00:25:002
44690599220,22cyclictest524700-21apt-get21:20:122
44690599220,22cyclictest0-21swapper/223:15:142
44690599220,22cyclictest0-21swapper/222:15:042
44690599220,21cyclictest568962-21apt-get22:35:122
44690599220,21cyclictest0-21swapper/223:40:102
44690599220,21cyclictest0-21swapper/223:40:102
44690599220,21cyclictest0-21swapper/223:05:112
44690599220,21cyclictest0-21swapper/222:30:112
44690599220,21cyclictest0-21swapper/220:00:122
44690599220,21cyclictest0-21swapper/219:45:122
44690599220,21cyclictest0-21swapper/219:45:122
44690599220,1cyclictest459398-21munin-run19:30:002
446903992222,0cyclictest0-21swapper/120:25:111
446903992222,0cyclictest0-21swapper/120:15:001
446903992222,0cyclictest0-21swapper/100:35:121
446903992221,1cyclictest530584-21apt-get21:30:121
446903992221,1cyclictest512492-21awk21:00:001
44690399220,22cyclictest636839-21apt-get00:30:121
44690399220,22cyclictest0-21swapper/123:55:151
44690399220,22cyclictest0-21swapper/123:20:181
44690399220,22cyclictest0-21swapper/122:00:201
44690399220,21cyclictest622076-21apt-get00:05:171
44690399220,21cyclictest604325-21apt-get23:35:121
44690399220,21cyclictest556774-21appstreamcli22:15:021
44690399220,21cyclictest468703-21apt-get19:45:121
44690399220,21cyclictest468703-21apt-get19:45:121
44690399220,21cyclictest456879-21apt-get19:25:111
44690399220,21cyclictest0-21swapper/122:45:121
44690399220,21cyclictest0-21swapper/122:40:171
44690399220,21cyclictest0-21swapper/122:35:121
44690399220,21cyclictest0-21swapper/120:05:131
44690399220,21cyclictest0-21swapper/120:00:121
44690399220,21cyclictest0-21swapper/119:20:031
44690399220,1cyclictest556700-21idleruntime-cro22:15:001
44690399220,1cyclictest0-21swapper/123:30:111
446898992222,0cyclictest0-21swapper/021:35:110
446898992221,1cyclictest0-21swapper/020:35:180
446898992221,0cyclictest0-21swapper/022:10:000
44689899220,22cyclictest0-21swapper/019:50:120
44689899220,22cyclictest0-21swapper/019:50:120
44689899220,22cyclictest0-21swapper/019:40:120
44689899220,21cyclictest613211-21apt-get23:50:120
44689899220,21cyclictest0-21swapper/022:55:110
44689899220,21cyclictest0-21swapper/021:40:120
44689899220,21cyclictest0-21swapper/021:15:150
44689899220,21cyclictest0-21swapper/021:10:120
44689899220,21cyclictest0-21swapper/020:30:130
44689899220,21cyclictest0-21swapper/019:15:120
44689899220,0cyclictest0-21swapper/021:45:150
44689899220,0cyclictest0-21swapper/000:10:120
446924992121,0cyclictest577802-21apt-get22:50:127
446924992121,0cyclictest0-21swapper/723:25:117
446924992121,0cyclictest0-21swapper/722:15:007
446924992121,0cyclictest0-21swapper/721:10:127
446924992121,0cyclictest0-21swapper/720:55:117
446924992121,0cyclictest0-21swapper/700:05:177
446924992120,1cyclictest0-21swapper/723:50:007
446924992120,1cyclictest0-21swapper/723:40:117
446924992120,1cyclictest0-21swapper/723:40:117
446924992120,1cyclictest0-21swapper/723:10:107
446924992120,1cyclictest0-21swapper/721:00:127
446924992120,1cyclictest0-21swapper/700:35:137
446924992120,0cyclictest0-21swapper/719:40:027
44692499210,1cyclictest0-21swapper/700:10:207
44692499210,0cyclictest0-21swapper/719:35:127
44692499210,0cyclictest0-21swapper/719:35:127
446921992121,0cyclictest0-21swapper/621:50:136
446921992121,0cyclictest0-21swapper/619:25:186
446921992120,1cyclictest0-21swapper/623:35:196
446921992120,1cyclictest0-21swapper/621:40:136
446921992120,0cyclictest566016-21apt-get22:30:116
44692199210,20cyclictest0-21swapper/620:15:186
44692199210,0cyclictest0-21swapper/622:45:126
44692199210,0cyclictest0-21swapper/622:15:026
44692199210,0cyclictest0-21swapper/619:55:126
446914992121,0cyclictest0-21swapper/522:10:005
446914992121,0cyclictest0-21swapper/521:20:115
446914992120,1cyclictest598441-21apt-get23:25:125
446914992120,1cyclictest0-21swapper/522:15:135
446914992120,1cyclictest0-21swapper/520:35:185
446914992120,1cyclictest0-21swapper/519:55:125
446914992120,1cyclictest0-21swapper/519:45:125
446914992120,1cyclictest0-21swapper/519:45:125
446914992120,1cyclictest0-21swapper/500:00:085
446914992120,0cyclictest0-21swapper/520:20:115
446914992119,1cyclictest0-21swapper/519:40:115
44691499210,21cyclictest0-21swapper/519:50:125
44691499210,21cyclictest0-21swapper/519:50:125
44691499210,20cyclictest446776-21appstreamcli19:10:025
44691499210,20cyclictest0-21swapper/521:10:125
44691499210,20cyclictest0-21swapper/519:15:125
44691499210,0cyclictest0-21swapper/521:15:145
446910992121,0cyclictest0-21swapper/422:30:114
446910992121,0cyclictest0-21swapper/422:10:124
446910992121,0cyclictest0-21swapper/420:10:144
446910992121,0cyclictest0-21swapper/419:45:124
446910992121,0cyclictest0-21swapper/419:45:124
446910992121,0cyclictest0-21swapper/419:20:174
446910992120,1cyclictest0-21swapper/421:20:184
44691099210,21cyclictest0-21swapper/423:25:194
44691099210,21cyclictest0-21swapper/423:00:164
44691099210,21cyclictest0-21swapper/422:50:194
44691099210,21cyclictest0-21swapper/400:25:004
44691099210,20cyclictest0-21swapper/421:35:124
44691099210,1cyclictest615712-21cron23:55:004
44691099210,0cyclictest0-21swapper/420:35:114
446908992121,0cyclictest589593-21apt-get23:10:113
446908992121,0cyclictest0-21swapper/322:55:163
446908992121,0cyclictest0-21swapper/321:05:123
446908992121,0cyclictest0-21swapper/319:30:113
446908992121,0cyclictest0-21swapper/300:30:133
446908992120,1cyclictest606843-21turbostat23:40:003
446908992120,1cyclictest465330-21http19:40:013
446908992120,1cyclictest465330-21http19:40:003
446908992120,1cyclictest0-21swapper/323:30:123
44690899210,21cyclictest618720-21sendmail00:00:003
44690899210,21cyclictest474583-21apt-get19:55:113
44690899210,21cyclictest0-21swapper/323:50:113
44690899210,21cyclictest0-21swapper/322:50:133
44690899210,21cyclictest0-21swapper/321:40:123
44690899210,21cyclictest0-21swapper/319:40:123
44690899210,21cyclictest0-21swapper/319:10:153
44690899210,21cyclictest0-21swapper/300:25:183
44690899210,0cyclictest0-21swapper/321:35:123
44690899210,0cyclictest0-21swapper/319:25:123
446905992121,0cyclictest574862-21apt-get22:45:112
446905992121,0cyclictest539474-21apt-get21:45:142
446905992121,0cyclictest0-21swapper/220:45:122
446905992121,0cyclictest0-21swapper/219:40:122
446905992121,0cyclictest0-21swapper/219:20:112
446905992121,0cyclictest0-21swapper/200:00:142
446905992120,1cyclictest486375-21apt-get20:15:122
44690599210,21cyclictest630476-21munin-run00:20:002
44690599210,21cyclictest625012-21apt-get00:10:122
44690599210,21cyclictest514246-21ntpq21:00:182
44690599210,21cyclictest0-21swapper/223:20:122
44690599210,21cyclictest0-21swapper/223:00:162
44690599210,21cyclictest0-21swapper/200:30:122
44690599210,20cyclictest0-21swapper/222:25:112
44690599210,0cyclictest462765-21apt-get19:35:132
44690599210,0cyclictest462765-21apt-get19:35:132
44690599210,0cyclictest0-21swapper/223:10:112
44690599210,0cyclictest0-21swapper/221:35:182
44690599210,0cyclictest0-21swapper/220:10:142
446903992121,0cyclictest0-21swapper/123:45:121
446903992121,0cyclictest0-21swapper/121:15:141
446903992121,0cyclictest0-21swapper/119:10:211
446903992121,0cyclictest0-21swapper/100:25:021
446903992120,1cyclictest536488-21apt-get21:40:121
446903992120,1cyclictest0-21swapper/120:50:121
44690399210,20cyclictest0-21swapper/122:25:121
44690399210,0cyclictest0-21swapper/122:30:111
44690399210,0cyclictest0-21swapper/119:15:131
446898992121,0cyclictest447239-21apt-get19:10:150
446898992121,0cyclictest0-21swapper/021:20:110
446898992120,1cyclictest0-21swapper/000:35:130
446898992118,2cyclictest17-21ksoftirqd/000:25:120
44689899210,0cyclictest0-21swapper/022:15:030
44689899210,0cyclictest0-21swapper/020:40:180
446924992020,0cyclictest0-21swapper/721:55:117
446924992020,0cyclictest0-21swapper/721:35:117
446924992020,0cyclictest0-21swapper/719:10:167
446924992020,0cyclictest0-21swapper/700:20:147
446924992020,0cyclictest0-21swapper/700:15:127
446924992019,1cyclictest574436-21munin-run22:45:007
446924992019,1cyclictest0-21swapper/723:55:007
446924992019,1cyclictest0-21swapper/723:05:117
446924992019,1cyclictest0-21swapper/721:15:147
446924992019,1cyclictest0-21swapper/720:50:127
44692499200,20cyclictest0-21swapper/720:15:127
44692499200,0cyclictest0-21swapper/700:30:197
446921992020,0cyclictest0-21swapper/623:15:146
446921992020,0cyclictest0-21swapper/622:20:126
446921992020,0cyclictest0-21swapper/622:05:136
446921992020,0cyclictest0-21swapper/621:45:156
446921992020,0cyclictest0-21swapper/620:50:126
446921992020,0cyclictest0-21swapper/619:50:136
446921992020,0cyclictest0-21swapper/619:50:136
446921992020,0cyclictest0-21swapper/600:00:136
446921992019,1cyclictest0-21swapper/623:55:106
446921992019,1cyclictest0-21swapper/621:00:116
446921992018,1cyclictest0-21swapper/620:35:186
44692199200,0cyclictest0-21swapper/600:30:126
446914992020,0cyclictest0-21swapper/523:50:035
446914992020,0cyclictest0-21swapper/500:35:135
446914992019,1cyclictest616150-21apt-get23:55:105
446914992019,1cyclictest0-21swapper/520:55:115
446914992018,1cyclictest0-21swapper/522:50:125
44691499200,0cyclictest0-21swapper/520:40:175
44691099202,1cyclictest547860-21idleruntime-cro22:00:004
446910992020,0cyclictest0-21swapper/423:35:124
446910992020,0cyclictest0-21swapper/423:30:114
446910992020,0cyclictest0-21swapper/423:15:144
446910992020,0cyclictest0-21swapper/422:35:184
446910992020,0cyclictest0-21swapper/421:15:144
446910992020,0cyclictest0-21swapper/419:15:124
446910992020,0cyclictest0-21swapper/419:10:024
446910992020,0cyclictest0-21swapper/400:00:134
446910992019,0cyclictest0-21swapper/420:55:124
44691099200,0cyclictest0-21swapper/421:00:194
44691099200,0cyclictest0-21swapper/419:55:124
44691099200,0cyclictest0-21swapper/400:30:204
446908992020,0cyclictest0-21swapper/322:45:123
446908992020,0cyclictest0-21swapper/322:15:023
446908992020,0cyclictest0-21swapper/322:10:133
446908992020,0cyclictest0-21swapper/321:45:033
446908992020,0cyclictest0-21swapper/321:20:123
446908992020,0cyclictest0-21swapper/320:40:123
446908992020,0cyclictest0-21swapper/320:00:123
446908992020,0cyclictest0-21swapper/300:10:003
446908992019,1cyclictest0-21swapper/300:15:003
44690899200,20cyclictest0-21swapper/320:05:133
44690899200,20cyclictest0-21swapper/300:20:143
44690899200,0cyclictest0-21swapper/323:00:113
446905992020,0cyclictest0-21swapper/223:55:102
446905992020,0cyclictest0-21swapper/223:30:122
446905992019,1cyclictest0-21swapper/222:10:122
446903992020,0cyclictest630920-21apt-get00:20:141
446903992020,0cyclictest0-21swapper/123:40:121
446903992020,0cyclictest0-21swapper/123:40:111
446903992020,0cyclictest0-21swapper/123:05:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional