You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 09:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jan 05, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2188399250,24cyclictest0-21swapper/123:21:111
2187999240,23cyclictest10358-21latency_hist22:05:010
2188999230,22cyclictest774-21runrttasks22:05:013
2188499232,1cyclictest9363-21idleruntime-cro00:15:002
21883992321,1cyclictest31708-21awk23:55:011
21883992321,1cyclictest3161-21wc21:50:001
2188399230,22cyclictest29405-21apt-get19:26:121
2188399230,22cyclictest21771-21sh00:40:011
21879992321,1cyclictest13470-21sendmail-msp20:00:010
2187999230,22cyclictest5908-21munin-plugin-st20:50:010
2187999230,22cyclictest29053-21dump-pmu-power19:25:000
21889992220,1cyclictest11051-21apt-get21:01:113
21889992220,1cyclictest0-21swapper/320:10:003
21889992219,2cyclictest29067-21latency_hist19:25:003
2188999220,21cyclictest32053-21apt-get23:56:113
2188999220,21cyclictest30741-21cron21:40:013
2188999220,21cyclictest19043-21apt-get20:11:113
2188999220,21cyclictest0-21swapper/300:11:123
2188999220,1cyclictest28291-21idleruntime-cro20:30:013
2188999220,1cyclictest16291-21apt-get21:11:113
2188999220,1cyclictest0-21swapper/321:45:003
2188999220,0cyclictest0-21swapper/320:36:113
21884992220,1cyclictest2749-21apt-get22:56:162
21884992220,1cyclictest1443-21apt-get20:41:112
21884992220,1cyclictest12723-21cron22:10:012
2188499220,21cyclictest24592-21apt-get19:16:112
2188499220,21cyclictest19996-21apt-get23:31:112
2188499220,21cyclictest14607-21turbostat00:25:002
2188499220,21cyclictest0-21swapper/222:36:102
21883992221,0cyclictest0-21swapper/120:41:111
21883992220,1cyclictest606-21dbus-daemon23:45:011
21883992220,1cyclictest29289-21cron23:50:011
21883992220,1cyclictest11057-21munin-run19:55:011
21883992220,1cyclictest0-21swapper/122:45:001
2188399220,21cyclictest15941-21latency_hist21:10:001
2188399220,21cyclictest0-21swapper/122:46:121
2188399220,21cyclictest0-21swapper/121:41:111
2188399220,21cyclictest0-21swapper/100:26:131
2188399220,1cyclictest3849-21apt-get20:46:121
2188399220,1cyclictest22045-21awk23:35:001
2188399220,1cyclictest0-21swapper/121:25:011
2188399220,1cyclictest0-21swapper/121:25:011
21879992222,0cyclictest0-21swapper/022:51:130
21879992221,1cyclictest0-21swapper/000:26:120
21879992221,0cyclictest23901-21apt-get21:26:120
21879992220,1cyclictest20748-21munin-run21:20:010
21879992220,1cyclictest1447-21perf19:35:010
2187999220,21cyclictest672-21idleruntime-cro20:40:010
2187999220,21cyclictest1087-21apt-get21:46:120
2187999220,21cyclictest0-21swapper/023:31:110
2187999220,21cyclictest0-21swapper/021:41:110
2187999220,21cyclictest0-21swapper/020:31:090
21889992121,0cyclictest24817-21apt-get23:41:123
21889992121,0cyclictest0-21swapper/321:56:133
21889992120,1cyclictest17341-21apt-get00:31:123
21889992120,1cyclictest13840-21apt-get21:06:123
21889992119,1cyclictest28363-21basename21:35:013
21889992119,1cyclictest20407-21perf22:25:013
21889992119,1cyclictest13463-21awk20:00:013
2188999210,21cyclictest0-21swapper/320:21:113
2188999210,20cyclictest3492-21apt-get21:51:103
2188999210,20cyclictest23162-21apt-get21:25:023
2188999210,20cyclictest0-21swapper/323:35:003
2188999210,20cyclictest0-21swapper/322:56:163
2188999210,20cyclictest0-21swapper/322:41:093
2188999210,0cyclictest13093-21apt-get22:11:123
2188999210,0cyclictest0-21swapper/320:01:143
2188999210,0cyclictest0-21swapper/319:26:123
21884992120,1cyclictest23901-21apt-get21:26:112
21884992118,2cyclictest25216-21idleruntime-cro22:35:002
2188499210,20cyclictest8635-21apt-get20:56:112
2188499210,20cyclictest0-21swapper/222:41:092
2188499210,20cyclictest0-21swapper/221:51:102
2188499210,20cyclictest0-21swapper/221:21:122
2188499210,20cyclictest0-21swapper/221:21:122
2188499210,20cyclictest0-21swapper/200:26:132
2188499210,0cyclictest0-21swapper/223:36:112
21883992121,0cyclictest0-21swapper/122:26:131
21883992121,0cyclictest0-21swapper/122:06:111
21883992121,0cyclictest0-21swapper/120:01:141
21883992119,1cyclictest17623-21munin-run22:20:011
21883992118,2cyclictest14396-21apt23:20:011
2188399210,21cyclictest0-21swapper/119:16:111
2188399210,20cyclictest7337-21apt-get00:11:121
2188399210,20cyclictest25545-21apt-get22:36:101
2188399210,20cyclictest0-21swapper/123:36:111
2188399210,0cyclictest0-21swapper/121:01:111
2188399210,0cyclictest0-21swapper/120:11:111
21879992121,0cyclictest16649-21apt-get20:06:130
21879992121,0cyclictest0-21swapper/021:21:120
21879992121,0cyclictest0-21swapper/021:21:120
21879992121,0cyclictest0-21swapper/021:01:110
21879992121,0cyclictest0-21swapper/019:41:120
21879992121,0cyclictest0-21swapper/000:01:120
21879992120,1cyclictest30360-21apt-get22:46:120
2187999210,21cyclictest0-21swapper/021:05:020
2187999210,21cyclictest0-21swapper/019:26:120
2187999210,20cyclictest0-21swapper/020:01:140
2187999210,0cyclictest20750-21apt-get22:26:130
2187999210,0cyclictest12555-21apt-get00:21:140
2187999210,0cyclictest0-21swapper/023:06:130
2187999210,0cyclictest0-21swapper/020:21:110
21889992020,0cyclictest6247-21apt-get20:51:163
21889992020,0cyclictest4208-21apt-get19:41:123
21889992020,0cyclictest0-21swapper/323:20:023
21889992020,0cyclictest0-21swapper/321:16:113
21889992020,0cyclictest0-21swapper/319:36:163
21889992018,1cyclictest3149-21basename21:50:003
2188999200,20cyclictest0-21swapper/322:26:133
2188999200,20cyclictest0-21swapper/300:05:023
2188999200,19cyclictest22200-21apt-get19:11:143
2188999200,0cyclictest10697-21apt-get22:06:113
2188999200,0cyclictest0-21swapper/300:26:133
21884992020,0cyclictest0-21swapper/223:41:122
21884992020,0cyclictest0-21swapper/221:46:122
21884992020,0cyclictest0-21swapper/221:45:002
21884992020,0cyclictest0-21swapper/220:36:112
21884992020,0cyclictest0-21swapper/220:31:092
21884992019,1cyclictest8994-21apt-get19:51:112
21884992018,1cyclictest1716-40mandb00:00:012
2188499200,0cyclictest1794-21apt-get19:36:152
2188499200,0cyclictest10127-21apt-get00:16:132
2188499200,0cyclictest0-21swapper/221:36:122
2188499200,0cyclictest0-21swapper/221:11:112
2188499200,0cyclictest0-21swapper/221:06:122
21883992020,0cyclictest0-21swapper/123:11:131
21883992020,0cyclictest0-21swapper/122:31:121
21883992020,0cyclictest0-21swapper/122:01:101
21883992020,0cyclictest0-21swapper/121:51:101
21883992020,0cyclictest0-21swapper/121:36:121
21883992020,0cyclictest0-21swapper/119:36:161
21883992018,1cyclictest5890-21apt-get21:56:131
21879992020,0cyclictest9386-21perf00:15:000
21879992020,0cyclictest0-21swapper/023:56:110
21879992020,0cyclictest0-21swapper/023:46:140
21879992020,0cyclictest0-21swapper/022:36:100
21879992020,0cyclictest0-21swapper/020:11:110
21879992020,0cyclictest0-21swapper/019:16:110
21879992018,1cyclictest18331-21cron21:15:000
21879992017,2cyclictest0-21swapper/000:06:120
2187999200,20cyclictest0-21swapper/000:16:130
2187999200,0cyclictest0-21swapper/022:56:160
2187999200,0cyclictest0-21swapper/022:31:120
2187999200,0cyclictest0-21swapper/022:21:120
2187999200,0cyclictest0-21swapper/019:11:140
21889991919,0cyclictest0-21swapper/323:51:113
21889991919,0cyclictest0-21swapper/322:46:123
21889991919,0cyclictest0-21swapper/322:16:113
21889991919,0cyclictest0-21swapper/320:40:023
21889991919,0cyclictest0-21swapper/319:31:083
21884991919,0cyclictest4942-21apt-get00:06:122
21884991919,0cyclictest0-21swapper/223:51:122
21884991919,0cyclictest0-21swapper/223:26:132
21884991919,0cyclictest0-21swapper/222:01:102
21884991919,0cyclictest0-21swapper/221:01:112
21884991919,0cyclictest0-21swapper/220:46:122
21884991919,0cyclictest0-21swapper/220:26:122
21884991919,0cyclictest0-21swapper/219:41:122
21884991919,0cyclictest0-21swapper/200:36:142
21884991918,1cyclictest0-21swapper/223:11:142
21884991918,1cyclictest0-21swapper/220:51:162
21884991917,1cyclictest32421-21sleep22:50:002
2188499190,0cyclictest26297-21apt-get21:31:112
21883991919,0cyclictest0-21swapper/100:05:021
21883991918,1cyclictest23862-21apt-get20:21:111
21883991917,1cyclictest18233-21apt-get22:20:021
21883991914,1cyclictest0-21swapper/121:25:011
21879991919,0cyclictest0-21swapper/023:16:100
21879991919,0cyclictest0-21swapper/020:51:150
21879991919,0cyclictest0-21swapper/019:36:150
21879991918,0cyclictest8635-21apt-get20:56:100
21879991917,1cyclictest606-21dbus-daemon21:35:010
21879991917,1cyclictest0-21swapper/020:45:010
2187999190,19cyclictest0-21swapper/023:41:120
21889991818,0cyclictest0-21swapper/322:51:133
21889991818,0cyclictest0-21swapper/319:16:113
2188999180,17cyclictest0-21swapper/319:46:123
21884991818,0cyclictest14396-21apt-get23:20:022
21884991818,0cyclictest0-21swapper/219:11:142
21884991817,1cyclictest2153-21apt-get00:01:122
21884991816,1cyclictest18708-21munin-run20:10:002
21884991816,1cyclictest18356-21apt-get22:21:122
2188499180,0cyclictest0-21swapper/223:48:532
21883991818,0cyclictest0-21swapper/120:05:021
21883991818,0cyclictest0-21swapper/119:46:121
21883991818,0cyclictest0-21swapper/119:21:111
21879991818,0cyclictest0-21swapper/021:36:120
21889991717,0cyclictest22399-21apt-get23:36:113
21889991717,0cyclictest0-21swapper/323:16:103
21889991717,0cyclictest0-21swapper/323:06:133
21889991716,1cyclictest23152-21apt-get22:31:123
21889991715,1cyclictest3849-21apt-get20:46:123
21889991715,1cyclictest10690-21turbostat.cron21:00:003
21884991717,0cyclictest32757-21apt-get22:51:122
21884991717,0cyclictest0-21swapper/200:31:122
21884991715,1cyclictest606-21dbus-daemon20:05:002
21883991717,0cyclictest0-21swapper/121:31:101
21883991717,0cyclictest0-21swapper/121:16:111
21883991717,0cyclictest0-21swapper/119:31:081
21883991717,0cyclictest0-21swapper/100:16:131
21883991716,1cyclictest0-21swapper/100:31:121
21883991715,1cyclictest0-21swapper/122:51:131
2188399170,2cyclictest622-21gdbus19:15:001
2188399170,16cyclictest4187-21latency_hist00:05:011
21879991717,0cyclictest0-21swapper/022:11:120
21879991717,0cyclictest0-21swapper/020:20:000
21889991615,1cyclictest21104-21apt-get21:21:123
21889991615,1cyclictest21104-21apt-get21:21:123
21889991614,1cyclictest607-21in:imuxsock19:55:013
21884991616,0cyclictest0-21swapper/223:06:132
21884991616,0cyclictest0-21swapper/219:46:122
21884991616,0cyclictest0-21swapper/219:26:122
21884991614,1cyclictest19234-21perl21:16:132
21884991614,1cyclictest0-21swapper/223:16:202
2188499160,15cyclictest22614-21pmu-power20:16:192
21883991616,0cyclictest31050-21apt-get20:36:111
21883991616,0cyclictest0-21swapper/123:06:131
21883991616,0cyclictest0-21swapper/123:01:111
21883991616,0cyclictest0-21swapper/120:31:091
21883991616,0cyclictest0-21swapper/119:56:131
21879991616,0cyclictest0-21swapper/023:21:110
21879991616,0cyclictest0-21swapper/022:16:110
21879991614,1cyclictest622-21gdbus00:35:010
21879991614,1cyclictest24455-21apt23:40:000
2188999150,14cyclictest25545-21apt-get22:36:093
21884991515,0cyclictest27011-21apt-get19:21:112
21884991515,0cyclictest0-21swapper/222:26:132
21884991515,0cyclictest0-21swapper/219:35:012
2188499150,8cyclictest0-21swapper/220:21:112
2188499150,5cyclictest0-21swapper/222:11:122
21883991515,0cyclictest21436-21apt-get20:16:121
21883991515,0cyclictest0-21swapper/122:11:121
21883991515,0cyclictest0-21swapper/120:51:161
21879991514,0cyclictest0-21swapper/021:56:220
21879991513,1cyclictest6206-21ntp_states23:01:200
21889991414,0cyclictest0-21swapper/323:11:033
21889991414,0cyclictest0-21swapper/323:01:113
21889991414,0cyclictest0-21swapper/320:30:443
2188999140,14cyclictest0-21swapper/323:47:263
2188999140,14cyclictest0-21swapper/320:15:163
2188999140,14cyclictest0-21swapper/300:20:403
2188999140,14cyclictest0-21swapper/300:15:133
2188999140,14cyclictest0-21swapper/300:00:443
21884991414,0cyclictest0-21swapper/220:10:042
21884991414,0cyclictest0-21swapper/219:57:042
2188499140,14cyclictest0-21swapper/223:01:142
2188499140,14cyclictest0-21swapper/222:15:112
2188499140,14cyclictest0-21swapper/221:55:112
21883991414,0cyclictest0-21swapper/122:55:131
2188399140,14cyclictest0-21swapper/123:26:351
2188399140,0cyclictest0-21swapper/121:10:441
2188399140,0cyclictest0-21swapper/120:55:421
2188399140,0cyclictest0-21swapper/120:25:301
2188399140,0cyclictest0-21swapper/119:40:141
21879991414,0cyclictest0-21swapper/023:50:050
2187999140,14cyclictest0-21swapper/023:25:020
2187999140,14cyclictest0-21swapper/023:10:390
2187999140,14cyclictest0-21swapper/022:40:300
2187999140,14cyclictest0-21swapper/022:05:400
2187999140,14cyclictest0-21swapper/021:50:180
2187999140,14cyclictest0-21swapper/019:50:290
2187999140,14cyclictest0-21swapper/000:35:370
2187999140,0cyclictest0-21swapper/020:26:110
2187999140,0cyclictest0-21swapper/019:45:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional