You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 22:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sat Dec 27, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
446829765,9sleep00-21swapper/007:07:260
446829765,9sleep00-21swapper/007:07:250
436329671,9sleep20-21swapper/207:06:032
436329671,9sleep20-21swapper/207:06:032
435928961,9sleep30-21swapper/307:06:003
435928961,9sleep30-21swapper/307:06:003
449127767,6sleep10-21swapper/107:07:431
449127767,6sleep10-21swapper/107:07:431
474799280,25cyclictest0-21swapper/109:25:121
474799230,2cyclictest4483-21tail08:15:171
475399210,20cyclictest0-21swapper/208:57:302
475399191,14cyclictest0-21swapper/209:45:152
474799182,5cyclictest0-21swapper/110:45:121
475399171,15cyclictest0-21swapper/208:25:142
4753991611,4cyclictest22803-21cron08:55:002
4747991514,1cyclictest0-21swapper/111:15:171
4747991513,1cyclictest0-21swapper/108:10:211
4757991411,2cyclictest16260-21wc09:45:233
4757991410,3cyclictest3045-21grep08:10:283
4757991410,3cyclictest19783-21grep09:55:153
4757991410,3cyclictest11280-21wc09:35:223
4747991412,1cyclictest0-21swapper/108:30:211
4747991410,3cyclictest875-21grep11:30:171
4747991410,3cyclictest25711-21cat07:50:251
474799140,9cyclictest15215-21fschecks_time07:30:171
474399146,7cyclictest9550-21munin-run07:20:000
474399140,7cyclictest0-21swapper/010:00:140
475799137,2cyclictest225-21systemd-journal12:30:003
4757991310,2cyclictest9550-21grep08:25:173
4757991310,2cyclictest5469-21tr09:25:143
4757991310,2cyclictest4441-21taskset08:15:163
4757991310,2cyclictest22125-21wc11:05:253
4757991310,2cyclictest17062-21grep08:40:203
4757991310,2cyclictest16223-21grep10:55:163
4757991310,2cyclictest14460-21turbostat.cron12:00:003
4757991310,2cyclictest13373-21wc10:50:003
475799130,5cyclictest225-21systemd-journal11:40:003
475399135,3cyclictest1398-21apt-get08:10:152
475399132,10cyclictest32596-21ls09:14:592
4753991310,2cyclictest4098-21wc11:35:272
474799139,3cyclictest20166-21uniq12:10:171
474799138,3cyclictest16691-21head08:40:171
474799132,4cyclictest225-21systemd-journal11:00:001
4747991310,2cyclictest9562-21awk07:20:001
4747991310,2cyclictest7223-21sed08:20:171
4747991310,2cyclictest20629-21cat11:05:001
4747991310,2cyclictest1360-21sh10:24:591
474799130,12cyclictest9069-21grep10:40:151
474399136,5cyclictest10026-21apt-get09:35:140
474399131,8cyclictest0-21swapper/011:55:130
4743991310,2cyclictest19017-21grep09:50:260
475799129,2cyclictest9944-21wc09:35:013
475799129,2cyclictest7675-21grep08:20:223
475799129,2cyclictest5712-21grep07:10:173
475799129,2cyclictest3288-21tail10:25:263
475799129,2cyclictest32125-21sed12:35:173
475799129,2cyclictest29366-21wc11:20:283
475799129,2cyclictest28887-21taskset09:05:173
475799129,2cyclictest27897-21tr07:55:213
475799129,2cyclictest26198-21grep11:15:203
475799129,2cyclictest2545-21cron09:20:003
475799129,2cyclictest24243-21cron10:05:003
475799129,2cyclictest20042-21grep07:40:173
475799129,2cyclictest18362-21wc09:50:183
475799129,2cyclictest18222-21head12:05:213
475799129,2cyclictest1820-21tail11:30:263
475799129,2cyclictest16235-21sed07:30:263
475799129,2cyclictest13808-21tr10:50:153
475799129,2cyclictest10097-21tr07:20:163
475799128,3cyclictest29819-21cut08:00:183
4757991210,1cyclictest23054-21/usr/sbin/munin11:10:213
475799120,11cyclictest9085-21grep11:45:313
475399129,2cyclictest8355-21seq10:37:492
475399129,2cyclictest4660-21sshd09:21:292
475399129,2cyclictest32521-21ntpq12:35:202
475399129,2cyclictest31888-21tr10:20:182
475399129,2cyclictest30647-21expr11:25:162
475399129,2cyclictest29818-21sed10:15:162
475399129,2cyclictest26877-21cat10:10:132
475399129,2cyclictest26613-21cat11:15:242
475399129,2cyclictest24280-21cat07:50:122
475399129,2cyclictest23578-21grep07:45:282
475399129,2cyclictest23513-21grep12:15:282
475399129,2cyclictest23170-21wc10:00:202
475399129,2cyclictest21382-21unixbench_multi09:55:272
475399129,2cyclictest1866-21head11:30:262
475399129,2cyclictest16340-21grep12:00:262
475399129,2cyclictest14615-21date12:00:002
475399129,2cyclictest14025-21grep09:40:282
475399129,2cyclictest11780-21taskset08:30:172
475399129,2cyclictest10131-21cat07:20:162
475399122,6cyclictest22613-21sshd11:07:302
474799129,2cyclictest9747-21cron09:35:011
474799129,2cyclictest7030-21cut10:35:171
474799129,2cyclictest6293-21gzip07:10:211
474799129,2cyclictest31952-21sed11:25:281
474799129,2cyclictest29740-21grep12:30:161
474799129,2cyclictest27369-21tr07:55:171
474799129,2cyclictest27351-21grep09:00:261
474799129,2cyclictest24319-21cat10:05:001
474799129,2cyclictest12453-21tr07:25:151
474799128,3cyclictest31698-21ls09:10:221
474799128,2cyclictest13806-21cut08:35:131
474799127,4cyclictest16389-21grep12:00:261
4747991210,1cyclictest23217-21tr08:55:161
474399129,2cyclictest8717-21wc11:45:260
474399129,2cyclictest4421-21expr10:30:160
474399129,2cyclictest3496-21cron08:15:000
474399129,2cyclictest3375-21basename11:35:190
474399129,2cyclictest29759-21sed12:30:160
474399129,2cyclictest25652-21taskset11:15:170
474399129,2cyclictest25617-21cut12:20:250
474399129,2cyclictest24971-21cut07:50:170
474399129,2cyclictest23860-21sed08:55:190
474399129,2cyclictest21847-21cron10:00:000
474399129,2cyclictest2090-21expr10:25:150
474399129,2cyclictest20235-21cat07:40:180
474399129,2cyclictest18819-21chrt11:00:160
474399129,2cyclictest18338-21taskset08:45:120
474399129,2cyclictest15513-21expr12:00:170
474399129,2cyclictest13601-21grep08:35:120
474399129,2cyclictest11254-21basename08:30:150
474399129,2cyclictest10534-21grep08:25:260
474399128,3cyclictest17153-21cut12:05:150
474399120,7cyclictest2315-21perf11:35:010
474399120,5cyclictest0-21swapper/010:15:140
474399120,11cyclictest28336-21wc10:10:260
475799119,1cyclictest24041-21awk07:50:003
475799119,1cyclictest19042-21grep11:00:193
475799118,2cyclictest9194-21chrt07:15:463
475799118,2cyclictest595-21systemctl10:20:263
475799118,2cyclictest5728-21cut11:40:173
475799118,2cyclictest4725-21grep10:30:173
475799118,2cyclictest29956-21grep10:15:173
475799118,2cyclictest27834-21sh09:05:003
475799118,2cyclictest27660-21grep10:10:183
475799118,2cyclictest25382-21grep07:50:203
475799118,2cyclictest24172-21grep08:55:213
475799118,2cyclictest10933-21idleruntime-cro10:45:003
475799117,3cyclictest30587-21grep09:10:133
475799117,3cyclictest14346-21cut08:35:153
475799117,3cyclictest13285-21cut07:25:213
475799117,2cyclictest13018-21sort09:40:193
475799116,3cyclictest17617-21cut07:35:153
475799113,5cyclictest6351-21apache208:45:123
475399119,2cyclictest26190-21expr09:00:152
475399119,2cyclictest1831-21python09:15:252
475399119,1cyclictest8573-21grep09:30:192
475399119,1cyclictest6903-21taskset07:11:542
475399119,1cyclictest5272-21aten2_r7power_e09:25:132
475399119,1cyclictest4435-21ls10:30:162
475399119,1cyclictest4343-21df_inode08:15:152
475399119,1cyclictest314352sleep208:05:132
475399119,1cyclictest308652sleep208:01:132
475399119,1cyclictest29398-21cat12:30:132
475399119,1cyclictest28202-21expr11:20:172
475399119,1cyclictest26418-21sshd10:07:282
475399119,1cyclictest24783-21sed11:10:272
475399119,1cyclictest24267-21apt12:20:152
475399119,1cyclictest21636-21cut07:45:012
475399119,1cyclictest202272sleep211:02:232
475399119,1cyclictest19926-21expr12:10:152
475399119,1cyclictest19402-21cat08:45:202
475399119,1cyclictest190112sleep212:07:252
475399119,1cyclictest16896-21date07:35:002
475399119,1cyclictest15916-21taskset08:40:022
475399119,1cyclictest15616-21sed07:30:192
475399119,1cyclictest14190-21chrt07:28:432
475399119,1cyclictest10112-21grep11:50:132
475399118,2cyclictest9275-21chrt07:16:492
475399118,2cyclictest5088-21basename11:40:142
475399118,2cyclictest2574-21wc10:25:192
475399118,2cyclictest11657-21tail09:35:262
475399117,1cyclictest4741-21cyclictest09:50:142
475399112,7cyclictest0-21swapper/210:40:142
475399110,2cyclictest13948-21cstates10:50:152
474799118,2cyclictest598-21sed12:35:261
474799118,2cyclictest5697-21head11:40:161
474799118,2cyclictest4544-21grep09:20:271
474799118,2cyclictest3270-21grep10:25:261
474799118,2cyclictest31705-21tr08:05:161
474799118,2cyclictest30906-21grep10:15:271
474799118,2cyclictest25226-21tail10:05:181
474799118,2cyclictest23729-21cut11:10:171
474799118,2cyclictest22375-21sed08:50:261
474799118,2cyclictest17921-21df09:50:151
474799118,2cyclictest17743-21sort12:05:171
474799118,2cyclictest12090-21munin-run11:55:001
474799117,3cyclictest8449-21cat11:45:231
474799113,4cyclictest225-21systemd-journal12:00:001
474799110,10cyclictest10147-21mailstats08:25:221
474799110,10cyclictest0-21swapper/109:05:131
474399119,2cyclictest6902-21cat08:20:150
474399119,2cyclictest12641-21cat07:25:140
474399119,1cyclictest9763-21sh09:35:010
474399119,1cyclictest656-21grep08:05:270
474399119,1cyclictest6242-21wc07:10:220
474399119,1cyclictest56222sleep008:16:450
474399119,1cyclictest5178-21sort11:40:130
474399119,1cyclictest32119-21expr10:20:180
474399119,1cyclictest3197-21expr09:20:150
474399119,1cyclictest27099-21expr12:25:140
474399119,1cyclictest26157-21cat09:00:140
474399119,1cyclictest22509-21chrt08:51:150
474399119,1cyclictest21864-21apache_volume12:15:140
474399119,1cyclictest21096-21sed12:10:260
474399119,1cyclictest20894-21egrep11:05:140
474399119,1cyclictest15369-21sed07:30:170
474399119,1cyclictest143302sleep009:42:390
474399119,1cyclictest11912-21grep10:45:170
474399118,2cyclictest793-21expr09:15:150
474399118,2cyclictest30598-21cut09:10:150
474399118,2cyclictest30551-21expr11:25:170
474399118,2cyclictest28561-21expr09:05:140
474399118,2cyclictest28297-21expr11:20:170
474399118,2cyclictest25338-21wc11:15:010
474399118,2cyclictest22668-21grep07:45:190
474399118,2cyclictest17648-21grep08:40:260
474399118,2cyclictest17034-21cut07:35:140
474399118,2cyclictest15353-21chrt10:50:590
474399118,2cyclictest15021-21cut09:45:150
475799108,1cyclictest9202sleep308:07:393
475799108,1cyclictest8182-21taskset10:35:353
475799108,1cyclictest3281-21expr09:20:163
475799108,1cyclictest25096-21taskset10:05:183
475799108,1cyclictest20780-21aten2_r7power_p08:50:143
475799108,1cyclictest19447-21chrt12:10:043
475799108,1cyclictest12848-21sed08:30:273
475799108,1cyclictest12252-21cat11:54:593
475799107,2cyclictest29276-21tr12:30:123
475799100,9cyclictest30542-21wc11:25:173
475799100,9cyclictest236482sleep312:16:013
475399108,2cyclictest27291-21grep12:25:162
475399108,2cyclictest27124-21expr07:55:152
475399108,1cyclictest8171-21uptime08:20:272
475399108,1cyclictest73472sleep211:45:032
475399108,1cyclictest16673-21tail10:55:182
475399108,1cyclictest15517-21taskset08:38:102
475399107,2cyclictest28326-21tr09:05:142
475399107,2cyclictest11439-21grep10:45:132
474799108,2cyclictest13717-21uname09:40:241
474799108,1cyclictest26627-21apache_accesses12:25:111
474799108,1cyclictest25260-21cat12:20:211
474799108,1cyclictest18563-21expr08:45:141
474799108,1cyclictest17260-21expr07:35:141
474799108,1cyclictest15424-21expr09:45:161
474799108,1cyclictest10828-21cat07:20:211
474799107,2cyclictest27194-21cat10:10:161
474799107,2cyclictest23657-21taskset12:16:061
474799107,2cyclictest20474-21ntpq07:40:211
474799107,2cyclictest19745-21taskset09:55:131
474799107,2cyclictest13795-21grep10:50:151
474799107,2cyclictest11127-21cut09:35:201
474799100,9cyclictest5059-21ls10:30:211
474399109,1cyclictest30109-21cat08:00:210
474399109,1cyclictest10942-21sed11:50:180
474399108,2cyclictest25740-21awk10:05:230
474399108,1cyclictest8940-21cut10:40:140
474399108,1cyclictest6248-21sort09:25:190
474399108,1cyclictest17339-21taskset10:55:260
474399108,1cyclictest10201-21expr07:20:160
474399103,4cyclictest31955-21/usr/sbin/munin12:35:160
47579997,1cyclictest25567-21awk12:20:253
47479997,1cyclictest29369-21cat08:00:161
47479997,1cyclictest28059-21cat11:20:171
47479997,1cyclictest21824-21dpkg07:45:011
47479997,1cyclictest21089-21expr11:05:141
47479997,1cyclictest1291-21if_enp0s31f609:15:181
47439998,1cyclictest8238-21taskset10:36:170
47439998,1cyclictest27038-21cat07:55:140
47579983,3cyclictest516-21gdbus12:00:223
47479985,2cyclictest2621-21cut11:35:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional