You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 10:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Jun 20, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70299250,24cyclictest20061-21diskstats00:35:103
69799250,24cyclictest4063-21ssh23:49:442
69799250,24cyclictest0-21swapper/200:39:402
69799250,23cyclictest27574-21diskmemload21:11:332
69499250,25cyclictest0-21swapper/122:54:301
69499250,24cyclictest0-21swapper/123:12:431
692992523,1cyclictest0-21swapper/000:17:490
70299240,24cyclictest27574-21diskmemload22:39:063
70299240,24cyclictest0-21swapper/323:49:333
70299240,23cyclictest27574-21diskmemload21:42:453
70299240,0cyclictest27574-21diskmemload22:44:543
697992424,0cyclictest0-21swapper/223:52:462
69799240,23cyclictest27574-21diskmemload23:36:582
69799240,23cyclictest0-21swapper/222:51:222
69799240,23cyclictest0-21swapper/222:36:052
694992422,1cyclictest10279-21cron19:30:011
694992422,1cyclictest0-21swapper/121:39:111
69499241,22cyclictest20731-21cstates00:05:111
69499240,24cyclictest0-21swapper/100:31:531
69499240,23cyclictest5515-21munin-run19:20:011
69499240,23cyclictest29800-21sh23:42:401
69499240,23cyclictest25111-21cron20:00:011
69499240,23cyclictest0-21swapper/122:14:301
69499240,0cyclictest27574-21diskmemload23:58:361
69499240,0cyclictest0-21swapper/119:35:021
692992423,1cyclictest14289-21ssh22:27:220
692992423,1cyclictest0-21swapper/021:30:340
692992420,3cyclictest25378-21diskmemload23:39:330
69299240,24cyclictest0-21swapper/022:09:560
69299240,23cyclictest30055-21ssh22:11:250
69299240,23cyclictest27574-21diskmemload21:16:580
69299240,23cyclictest23213-21ssh00:37:550
69299240,23cyclictest0-21swapper/022:57:240
69299240,23cyclictest0-21swapper/022:16:360
69299240,1cyclictest25425-21apt-get20:00:080
702992323,0cyclictest27574-21diskmemload21:54:043
702992323,0cyclictest27574-21diskmemload00:25:223
702992323,0cyclictest0-21swapper/323:25:213
702992323,0cyclictest0-21swapper/323:04:423
702992322,1cyclictest27574-21diskmemload00:04:213
702992322,1cyclictest0-21swapper/323:39:163
702992321,1cyclictest31281-21sh21:13:013
702992320,2cyclictest18553-21sh00:33:543
702992320,2cyclictest12290-21ssh22:25:153
70299230,23cyclictest27574-21diskmemload22:34:453
70299230,23cyclictest24502-21ssh21:36:273
70299230,23cyclictest0-21swapper/321:31:083
70299230,23cyclictest0-21swapper/300:11:443
70299230,22cyclictest25037-21seq23:08:413
70299230,22cyclictest17996-21ssh23:31:223
70299230,22cyclictest1560-21ssh23:16:083
70299230,1cyclictest15262-21sh22:59:453
70299230,0cyclictest27574-21diskmemload21:18:033
70299230,0cyclictest0-21swapper/323:14:213
70299230,0cyclictest0-21swapper/322:22:503
697992323,0cyclictest0-21swapper/223:08:212
697992323,0cyclictest0-21swapper/222:13:152
697992323,0cyclictest0-21swapper/221:52:152
697992323,0cyclictest0-21swapper/221:42:492
697992323,0cyclictest0-21swapper/221:20:302
697992320,2cyclictest20598-21sh22:34:002
697992320,2cyclictest18287-21sh21:30:352
69799230,23cyclictest0-21swapper/223:10:292
69799230,23cyclictest0-21swapper/222:57:172
69799230,23cyclictest0-21swapper/222:42:452
69799230,23cyclictest0-21swapper/221:38:172
69799230,23cyclictest0-21swapper/200:29:562
69799230,23cyclictest0-21swapper/200:22:212
69799230,22cyclictest25188-21turbostat21:05:012
69799230,22cyclictest20036-21ssh23:04:002
69799230,22cyclictest19121-21ssh23:33:062
69799230,1cyclictest0-21swapper/223:16:202
69799230,0cyclictest0-21swapper/222:27:412
69799230,0cyclictest0-21swapper/221:48:532
69799230,0cyclictest0-21swapper/200:11:452
694992323,0cyclictest0-21swapper/123:25:371
694992323,0cyclictest0-21swapper/123:16:571
694992323,0cyclictest0-21swapper/122:21:571
694992323,0cyclictest0-21swapper/122:04:001
694992323,0cyclictest0-21swapper/121:17:471
694992322,0cyclictest0-21swapper/122:55:101
694992321,1cyclictest7594-21ssh21:50:181
694992321,1cyclictest32505-21apt-get21:45:081
694992321,1cyclictest0-21swapper/121:27:041
694992321,1cyclictest0-21swapper/120:40:001
694992320,2cyclictest2326-21sendmail20:20:001
69499230,2cyclictest32345-21perf20:15:011
69499230,23cyclictest0-21swapper/123:20:561
69499230,23cyclictest0-21swapper/122:31:011
69499230,22cyclictest4727-21awk00:20:131
69499230,22cyclictest0-21swapper/123:33:551
69499230,1cyclictest0-21swapper/122:47:341
69499230,1cyclictest0-21swapper/100:25:101
69499230,0cyclictest27574-21diskmemload23:51:111
69499230,0cyclictest27574-21diskmemload21:20:281
69499230,0cyclictest0-21swapper/123:47:331
69499230,0cyclictest0-21swapper/123:03:081
69499230,0cyclictest0-21swapper/122:15:171
69499230,0cyclictest0-21swapper/100:37:451
692992323,0cyclictest27574-21diskmemload21:11:430
692992323,0cyclictest0-21swapper/023:50:390
692992323,0cyclictest0-21swapper/023:43:350
692992323,0cyclictest0-21swapper/023:07:320
692992323,0cyclictest0-21swapper/000:27:090
692992323,0cyclictest0-21swapper/000:20:490
692992321,2cyclictest0-21swapper/023:22:190
692992321,1cyclictest0-21swapper/000:32:500
692992321,0cyclictest0-21swapper/022:20:110
69299230,2cyclictest26321-21ssh22:39:410
69299230,23cyclictest0-21swapper/000:04:460
69299230,22cyclictest9820-21sh21:23:480
69299230,22cyclictest30588-21turbostat.cron00:15:000
69299230,22cyclictest30578-21sh23:14:040
69299230,22cyclictest27574-21diskmemload23:46:370
69299230,22cyclictest0-21swapper/023:00:080
69299230,22cyclictest0-21swapper/022:51:240
69299230,22cyclictest0-21swapper/022:40:330
69299230,1cyclictest27574-21diskmemload22:00:080
69299230,1cyclictest0-21swapper/023:29:300
69299230,0cyclictest0-21swapper/023:30:190
69299230,0cyclictest0-21swapper/021:46:080
69299230,0cyclictest0-21swapper/021:38:160
702992222,0cyclictest0-21swapper/322:12:123
702992222,0cyclictest0-21swapper/322:03:053
702992220,1cyclictest12225-21ssh23:56:103
702992220,1cyclictest0-21swapper/321:25:113
70299220,22cyclictest6322-21ssh00:21:063
70299220,22cyclictest0-21swapper/323:42:013
70299220,22cyclictest0-21swapper/322:51:333
70299220,22cyclictest0-21swapper/300:05:053
70299220,21cyclictest6689-21ssh23:20:593
70299220,1cyclictest9944-21basename20:35:003
70299220,1cyclictest5650-21sh21:20:053
70299220,1cyclictest4071-21sh21:48:263
70299220,1cyclictest27574-21diskmemload23:54:353
70299220,1cyclictest22504-21hddtemp_smartct22:05:123
70299220,0cyclictest27574-21diskmemload22:15:383
70299220,0cyclictest0-21swapper/321:56:173
697992222,0cyclictest27574-21diskmemload00:15:122
697992222,0cyclictest0-21swapper/200:00:262
697992221,1cyclictest2348-1kworker/u9:000:05:202
697992220,2cyclictest21708-21ssh22:05:022
697992220,1cyclictest13239-21ssh21:55:342
697992220,1cyclictest0-21swapper/222:15:442
69799220,21cyclictest4404-21apt-get23:20:092
69799220,21cyclictest313-21systemd-journal20:45:012
69799220,21cyclictest13078-21ssh23:27:032
69799220,21cyclictest12883-21ssh21:25:242
69799220,21cyclictest11643-21kworker/u8:000:30:232
69799220,1cyclictest5085-21ssh21:19:402
69799220,1cyclictest0-21swapper/220:00:012
69799220,0cyclictest27574-21diskmemload22:02:392
69799220,0cyclictest0-21swapper/223:57:332
694992222,0cyclictest0-21swapper/121:58:111
694992221,1cyclictest0-21swapper/100:00:141
694992220,1cyclictest22800-21sh22:35:131
694992220,1cyclictest0-21swapper/123:35:211
694992220,1cyclictest0-21swapper/121:30:081
69499220,22cyclictest27574-21diskmemload21:40:531
69499220,21cyclictest27819-21apt-get20:05:091
69499220,21cyclictest12731-21apt-get19:35:001
69499220,21cyclictest0-21swapper/123:06:101
69499220,21cyclictest0-21swapper/121:10:471
69499220,21cyclictest0-21swapper/120:55:091
69499220,21cyclictest0-21swapper/100:10:231
69499220,1cyclictest18216-21apt-get19:45:081
69499220,1cyclictest13360-21diskmemload22:26:001
69499220,1cyclictest0-21swapper/100:15:111
69499220,0cyclictest0-21swapper/122:40:461
69499220,0cyclictest0-21swapper/122:06:331
692992220,1cyclictest17579-21sh20:50:010
692992220,1cyclictest0-21swapper/021:40:070
69299220,22cyclictest0-21swapper/021:52:190
69299220,21cyclictest23313-21sh00:06:500
69299220,21cyclictest13290-21ssh21:55:390
69299220,21cyclictest11386-21ssh21:25:080
69299220,21cyclictest0-21swapper/023:55:050
69299220,21cyclictest0-21swapper/022:45:010
69299220,1cyclictest7139-21apt-get20:30:000
69299220,1cyclictest2701-21sh23:17:500
69299220,1cyclictest17043-21tail22:30:100
69299220,1cyclictest15824-21apt-get19:40:090
70299210,21cyclictest27574-21diskmemload00:15:343
70299210,20cyclictest5019-21apt-get20:25:083
70299210,20cyclictest18216-21apt-get19:45:083
697992120,1cyclictest0-21swapper/222:21:452
69799210,0cyclictest0-21swapper/223:40:492
69499210,21cyclictest0-21swapper/120:45:091
69299210,0cyclictest0-21swapper/021:00:090
69299210,0cyclictest0-21swapper/020:55:090
69299210,0cyclictest0-21swapper/020:05:090
69299210,0cyclictest0-21swapper/019:20:080
702992020,0cyclictest30211-21apt-get20:10:083
702992019,1cyclictest23009-21apt-get19:55:083
70299200,0cyclictest0-21swapper/319:10:073
70299200,0cyclictest0-21swapper/319:10:073
697992020,0cyclictest0-21swapper/220:15:092
69799200,19cyclictest0-21swapper/221:05:092
69799200,0cyclictest2625-21apt-get20:20:092
694992020,0cyclictest0-21swapper/121:00:021
694992020,0cyclictest0-21swapper/120:40:081
694992020,0cyclictest0-21swapper/120:30:091
692992020,0cyclictest0-21swapper/020:35:080
69299200,0cyclictest0-21swapper/019:50:070
702991919,0cyclictest3352-21apt-get19:15:083
702991919,0cyclictest0-21swapper/320:50:073
702991919,0cyclictest0-21swapper/320:45:093
702991919,0cyclictest0-21swapper/320:35:023
702991918,1cyclictest13368-21apt-get19:35:023
702991917,1cyclictest29950-21grep20:10:013
697991919,0cyclictest8166-21apt-get19:25:082
697991919,0cyclictest0-21swapper/220:50:072
697991919,0cyclictest0-21swapper/220:30:022
697991919,0cyclictest0-21swapper/219:45:082
694991919,0cyclictest0-21swapper/120:25:081
692991919,0cyclictest0-21swapper/020:20:090
692991919,0cyclictest0-21swapper/020:15:090
692991919,0cyclictest0-21swapper/019:25:080
692991919,0cyclictest0-21swapper/019:10:070
692991919,0cyclictest0-21swapper/019:10:070
692991917,1cyclictest19983-21wc20:55:010
692991917,1cyclictest0-21swapper/020:00:010
69299190,18cyclictest9958-21munin-plugin-st20:35:000
702991818,0cyclictest0-21swapper/320:20:093
702991818,0cyclictest0-21swapper/319:25:083
697991818,0cyclictest0-21swapper/220:25:082
694991818,0cyclictest0-21swapper/121:05:091
694991818,0cyclictest0-21swapper/119:40:091
702991717,0cyclictest0-21swapper/321:00:093
702991717,0cyclictest0-21swapper/320:15:093
702991717,0cyclictest0-21swapper/320:00:083
702991717,0cyclictest0-21swapper/319:20:083
697991717,0cyclictest0-21swapper/220:35:022
697991717,0cyclictest0-21swapper/220:10:082
697991717,0cyclictest0-21swapper/219:30:082
697991717,0cyclictest0-21swapper/219:10:072
697991717,0cyclictest0-21swapper/219:10:072
697991716,0cyclictest0-21swapper/220:05:082
694991717,0cyclictest0-21swapper/119:20:081
694991717,0cyclictest0-21swapper/119:10:071
694991717,0cyclictest0-21swapper/119:10:071
694991716,0cyclictest17855-21apt-get20:50:071
702991616,0cyclictest10560-21apt-get19:30:083
702991614,1cyclictest0-21swapper/321:00:013
697991616,0cyclictest0-21swapper/219:40:092
697991614,1cyclictest22410-21munin-run21:00:012
697991613,2cyclictest5739-21/usr/sbin/munin19:20:332
694991613,2cyclictest25428-21chrt20:00:081
69499160,15cyclictest21230-21sed19:50:091
692991616,0cyclictest0-21swapper/019:35:070
692991614,1cyclictest25461-21apt-get21:05:090
692991614,1cyclictest0-21swapper/019:30:140
702991515,0cyclictest0-21swapper/320:40:083
697991513,1cyclictest21009-21cstates19:50:082
69799150,1cyclictest0-21swapper/220:05:012
69299157,7cyclictest62550irq/127-eno120:10:090
692991515,0cyclictest0-21swapper/020:40:080
702991414,0cyclictest0-21swapper/321:05:183
70299140,14cyclictest0-21swapper/319:54:253
70299140,14cyclictest0-21swapper/319:40:133
69799140,14cyclictest0-21swapper/219:35:072
692991414,0cyclictest0-21swapper/019:45:080
692991414,0cyclictest0-21swapper/019:15:070
69799130,0cyclictest0-21swapper/220:47:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional