You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 19:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Mon Apr 27, 2026 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30167210148,48sleep20-21swapper/207:05:512
2919229273,14sleep30-21swapper/307:05:193
3026728875,9sleep00-21swapper/007:07:100
3027828265,13sleep10-21swapper/107:07:181
3056999272,24cyclictest23786-21diskmemload09:41:421
3056999270,26cyclictest0-21swapper/109:50:241
3056999261,25cyclictest23786-21diskmemload09:20:291
3056999261,24cyclictest23786-21diskmemload12:35:011
3056999260,25cyclictest0-21swapper/112:14:511
3056999260,25cyclictest0-21swapper/111:54:101
3056999260,25cyclictest0-21swapper/108:30:131
3056999260,24cyclictest0-21swapper/109:25:111
3056999260,24cyclictest0-21swapper/108:20:141
3056999260,1cyclictest23786-21diskmemload10:01:161
3056999257,17cyclictest23786-21diskmemload11:48:281
3056999257,17cyclictest23786-21diskmemload11:48:281
3056999252,22cyclictest23786-21diskmemload12:22:471
3056999251,23cyclictest23786-21diskmemload11:20:251
3056999250,23cyclictest0-21swapper/110:17:341
3056999241,22cyclictest23786-21diskmemload11:19:271
3056999240,24cyclictest0-21swapper/110:45:141
3056999240,23cyclictest0-21swapper/112:34:241
3056999240,23cyclictest0-21swapper/111:35:171
3056999240,22cyclictest0-21swapper/111:41:501
3056999240,22cyclictest0-21swapper/110:21:011
3056999240,16cyclictest23786-21diskmemload09:30:031
3056499242,2cyclictest141rcu_preempt12:08:050
3057399230,22cyclictest0-21swapper/211:52:192
3056999232,20cyclictest24879-21cat11:25:271
3056999232,15cyclictest25313-21cut12:05:141
3056999231,21cyclictest23786-21diskmemload10:38:321
30569992311,6cyclictest455-21dbus-daemon08:40:011
3056999230,2cyclictest23786-21diskmemload09:12:251
3056999230,22cyclictest0-21swapper/111:31:221
3056999230,20cyclictest23786-21diskmemload11:56:031
3056999230,1cyclictest23786-21diskmemload10:13:051
3056499230,17cyclictest0-21swapper/010:51:540
3056999220,22cyclictest0-21swapper/110:33:591
3056999220,20cyclictest0-21swapper/109:35:141
3056999220,19cyclictest0-21swapper/110:56:261
3056999220,15cyclictest0-21swapper/110:05:161
3057399210,0cyclictest0-21swapper/209:49:572
3056999211,18cyclictest0-21swapper/110:25:181
3056999211,17cyclictest25377-21aten2_r7power_v08:05:141
3056999210,19cyclictest23786-21diskmemload09:45:161
3056999210,19cyclictest0-21swapper/112:15:171
3056499211,19cyclictest0-21swapper/011:25:130
3056499211,16cyclictest0-21swapper/007:10:130
3056999202,18cyclictest23786-21diskmemload11:01:251
3056999201,18cyclictest23786-21diskmemload12:26:571
3056999200,19cyclictest0-21swapper/111:09:551
3056999200,18cyclictest0-21swapper/109:56:291
3057399190,3cyclictest0-21swapper/210:59:342
3056999192,15cyclictest9519-21apt-get08:40:141
3056999190,19cyclictest0-21swapper/110:41:181
3056999190,17cyclictest0-21swapper/112:01:581
3056999190,17cyclictest0-21swapper/109:00:001
3056999190,16cyclictest0-21swapper/107:55:241
3057399180,18cyclictest0-21swapper/210:02:162
3057399180,18cyclictest0-21swapper/209:53:212
3057399180,17cyclictest0-21swapper/211:35:062
3057399180,14cyclictest0-21swapper/211:07:102
3056999182,15cyclictest0-21swapper/109:15:051
3056999181,13cyclictest31077-21missed_timers08:15:201
3056999180,1cyclictest0-21swapper/110:52:311
3056999180,1cyclictest0-21swapper/107:20:251
3056999180,18cyclictest0-21swapper/111:11:181
3056999180,17cyclictest0-21swapper/107:50:001
3056499185,8cyclictest10390-21/usr/sbin/munin10:00:280
3057899170,17cyclictest0-21swapper/311:17:043
3057399174,8cyclictest3349-21awk09:55:192
3057399171,1cyclictest0-21swapper/209:41:032
3057399170,16cyclictest0-21swapper/211:21:462
3056999170,16cyclictest0-21swapper/109:10:001
3056999170,16cyclictest0-21swapper/108:25:221
3056499173,9cyclictest3348-21ntpq09:55:200
3056499170,1cyclictest0-21swapper/012:31:560
326322160,1sleep30-21swapper/312:09:503
30573991614,1cyclictest0-21swapper/210:38:142
3057399161,11cyclictest6870-21sed11:15:142
3057399160,2cyclictest0-21swapper/208:55:152
3057399160,16cyclictest0-21swapper/209:26:522
3057399160,15cyclictest0-21swapper/210:22:452
3057399160,15cyclictest0-21swapper/210:09:072
3057399160,13cyclictest15687-21apt-get11:40:132
3056999160,13cyclictest0-21swapper/107:50:121
3056999160,13cyclictest0-21swapper/107:35:121
3056499160,2cyclictest0-21swapper/009:52:170
3057899153,4cyclictest225-21systemd-journal08:40:003
3057899150,1cyclictest0-21swapper/311:58:223
3057399152,12cyclictest6526-21sh11:34:472
30573991513,1cyclictest0-21swapper/210:43:172
3056999151,13cyclictest2919-21sendmail-msp07:20:001
3056999151,13cyclictest0-21swapper/108:45:271
3056999150,11cyclictest0-21swapper/107:25:161
30564991514,1cyclictest0-21swapper/010:55:460
3056499150,2cyclictest0-21swapper/012:29:350
30578991411,2cyclictest22641-21sed11:05:153
30578991410,2cyclictest30552-21ssh11:10:143
3057899140,1cyclictest0-21swapper/311:29:053
3057899140,1cyclictest0-21swapper/310:42:163
3057899140,1cyclictest0-21swapper/310:12:573
3057899140,13cyclictest0-21swapper/307:20:123
3057399149,4cyclictest22853-21/usr/sbin/munin08:00:182
3057399146,8cyclictest1235-21ntpd12:30:372
3057399143,4cyclictest0-21swapper/210:29:372
30573991412,1cyclictest0-21swapper/211:29:092
3056999148,5cyclictest32727-21taskset07:12:441
3056999148,5cyclictest14486-21cut08:50:161
30564991413,1cyclictest0-21swapper/011:00:140
3056499141,1cyclictest0-21swapper/011:53:240
3056499140,3cyclictest0-21swapper/008:15:140
3057899139,3cyclictest7865-21perf11:55:003
3057899137,4cyclictest21515-21df10:45:163
3057899132,3cyclictest0-21swapper/312:25:113
30578991310,2cyclictest9705-21cat09:20:193
30578991310,2cyclictest5775-21cat08:30:203
30578991310,2cyclictest2822-21uniq09:55:153
30578991310,2cyclictest26967-21grep09:50:173
30578991310,2cyclictest22405-21grep09:05:173
30578991310,2cyclictest19029-21ssh12:20:193
30578991310,2cyclictest14452-21head11:00:173
30578991310,2cyclictest10612-21grep08:40:213
3057899130,12cyclictest17523-21sort09:45:003
3057899130,12cyclictest10938-21grep07:35:143
3057899130,12cyclictest10815-21cron10:20:003
3057399135,6cyclictest0-21swapper/208:10:132
3057399133,9cyclictest0-21swapper/207:30:112
3057399133,5cyclictest23786-21diskmemload09:30:112
3057399131,10cyclictest0-21swapper/209:11:152
3057399130,13cyclictest0-21swapper/212:23:102
3057399130,12cyclictest0-21swapper/210:50:492
3056999138,4cyclictest29312-21grep08:10:261
3056999137,5cyclictest13103-21taskset07:40:131
3056999130,0cyclictest0-21swapper/108:05:001
3056499133,9cyclictest21670-21apache_accesses09:05:120
3056499133,2cyclictest475-21in:imuxsock08:55:000
30564991312,1cyclictest0-21swapper/009:41:030
30564991310,2cyclictest1550-21grep09:35:150
3057899129,2cyclictest7628-21cut11:35:163
3057899129,2cyclictest4846-21grep10:35:163
3057899129,2cyclictest3962-21ssh11:32:453
3057899129,2cyclictest32525-21grep08:20:153
3057899129,2cyclictest30750-21grep08:15:183
3057899129,2cyclictest29188-21sort08:10:253
3057899129,2cyclictest24578-21grep09:10:163
3057899129,2cyclictest21634-21tr07:55:213
3057899129,2cyclictest19753-21if_err_enp0s31f10:05:203
3057899129,2cyclictest18135-21grep07:50:153
3057899129,2cyclictest1523-21cut07:15:173
3057899129,2cyclictest13831-21grep07:40:163
3057899128,3cyclictest6121-21grep10:55:183
3057899128,2cyclictest2460-21gzip12:10:213
3057899128,2cyclictest15577-21grep07:45:133
3057899128,2cyclictest13526-21grep08:45:283
3057899128,1cyclictest19747-21ssh12:01:173
3057899123,2cyclictest3361-21ntp_states12:30:203
3057899120,10cyclictest0-21swapper/311:43:343
3057899120,10cyclictest0-21swapper/309:47:183
3057399129,2cyclictest32-21ksoftirqd/209:20:182
3057399129,2cyclictest26400-21tr08:05:202
3057399129,2cyclictest15739-21tr07:45:132
3057399129,2cyclictest12314-21sed07:35:262
3057399129,1cyclictest9514-21uname11:55:202
30573991210,2cyclictest32-21ksoftirqd/210:34:372
30573991210,1cyclictest20942-21grep09:00:252
30573991210,1cyclictest1961-21sed07:15:212
30573991210,1cyclictest17867-21head12:00:202
30573991210,1cyclictest12204-21cat12:35:242
30573991210,1cyclictest11218-21grep08:40:272
3057399120,3cyclictest141rcu_preempt12:12:022
3057399120,2cyclictest0-21swapper/210:12:252
3057399120,1cyclictest0-21swapper/211:46:292
3057399120,1cyclictest0-21swapper/211:46:292
3057399120,1cyclictest0-21swapper/209:05:142
3057399120,12cyclictest0-21swapper/209:15:032
3056999120,1cyclictest0-21swapper/107:31:451
3056999120,0cyclictest0-21swapper/109:00:271
3056499129,2cyclictest9476-21grep09:20:170
3056499129,2cyclictest691-21taskset11:11:010
3056499129,2cyclictest5494-21grep08:30:170
3056499129,2cyclictest29610-21ssh10:30:210
3056499129,2cyclictest27176-21grep09:30:250
3056499129,2cyclictest26016-21grep08:05:160
3056499129,2cyclictest23676-21head08:00:150
3056499129,2cyclictest22063-21rm10:45:190
3056499129,2cyclictest20809-21ssh10:25:200
3056499129,2cyclictest19243-21cron10:25:010
30564991210,1cyclictest4913-21grep10:15:260
3056499120,1cyclictest0-21swapper/011:38:130
3057899118,2cyclictest5540-21ssh09:37:163
3057899118,2cyclictest5535-21apache_processe07:25:143
3057899118,2cyclictest31348-21ssh10:50:283
3057899118,2cyclictest28662-21ssh11:47:273
3057899118,2cyclictest28662-21ssh11:47:263
3057899118,2cyclictest27974-21ssh10:30:093
3057899118,2cyclictest26981-21cat09:30:243
3057899118,2cyclictest23152-21tr08:00:133
3057899118,2cyclictest19734-21ssh09:26:013
3057899118,2cyclictest19719-21expr09:00:143
3057899118,2cyclictest16040-21pluginstate11:20:213
3057899118,2cyclictest13699-21ssh10:20:433
3057899118,2cyclictest11748-21ssh12:15:463
3057899118,2cyclictest11510-21ssh10:00:193
3057899118,2cyclictest11083-21sort12:35:153
3057899117,2cyclictest16883-21grep08:55:163
3057899116,4cyclictest1-21systemd07:34:033
3057899115,5cyclictest4480-21sh08:30:003
3057899114,3cyclictest225-21systemd-journal10:25:333
3057899110,10cyclictest4838-21ssh09:17:273
3057399119,2cyclictest3578-21grep10:15:152
3057399119,1cyclictest6532-21ssh09:38:032
3057399119,1cyclictest14003-21perf08:50:012
3057399118,2cyclictest7561-21ls08:35:132
3057399118,2cyclictest6312-21sed07:25:192
3057399118,2cyclictest3609-21ssh11:13:182
3057399118,2cyclictest3604-21ls07:20:142
3057399118,2cyclictest28604-21sh12:25:492
3057399118,2cyclictest24980-21rm12:05:112
3057399118,2cyclictest20691-21sh10:45:032
3057399118,2cyclictest15270-21sh11:00:262
3057399118,2cyclictest14697-21tr08:50:172
30573991110,1cyclictest31253-21tr08:15:222
3056499119,1cyclictest32332-21sort09:15:000
3056499118,2cyclictest9087-21ssh12:15:020
3056499118,2cyclictest8913-21taskset08:36:050
3056499118,2cyclictest8210-21grep07:30:120
3056499118,2cyclictest8117-21ssh11:55:030
3056499118,2cyclictest32512-21aten2_r7power_p08:20:150
3056499118,2cyclictest25485-21ls11:45:220
3056499118,2cyclictest25485-21ls11:45:220
3056499118,2cyclictest21971-21ssh11:05:110
3056499118,2cyclictest20619-21ssh11:42:420
3056499118,2cyclictest18027-21tr12:20:140
3056499118,2cyclictest17570-21cron07:50:000
3056499118,2cyclictest16406-21ssh10:42:050
3056499118,2cyclictest12213-21cat08:45:160
3056499118,2cyclictest10541-21cat08:40:200
3056499117,3cyclictest12320-21grep07:35:260
3056499114,3cyclictest1235-21ntpd10:05:210
30564991110,1cyclictest0-21swapper/007:15:030
3056499110,9cyclictest0-21swapper/012:04:140
3056499110,1cyclictest0-21swapper/012:39:210
3056499110,11cyclictest0-21swapper/012:12:310
3056499110,10cyclictest27192-21cut10:10:130
3056499110,10cyclictest21595-21grep07:55:210
3056499110,10cyclictest14845-21taskset07:40:300
3057899108,1cyclictest30863-21cut07:10:143
3057899108,1cyclictest25673-21expr08:05:153
3057899100,9cyclictest16335-21chrt08:51:583
3057399109,1cyclictest31052-21grep07:10:152
3057399108,1cyclictest9330-21rm12:15:132
3057399108,1cyclictest7010-21sed08:35:002
3057399108,1cyclictest2702-21cat08:25:162
3057399107,2cyclictest18345-21expr07:50:142
3057399107,2cyclictest1713-21head08:20:272
3057399105,2cyclictest13106-21apt-get07:40:132
3057399102,4cyclictest225-21systemd-journal07:55:112
3056499108,1cyclictest638-21expr09:15:160
3056499108,1cyclictest49882sleep007:21:310
3056499108,1cyclictest19312-21ssh09:25:410
3056499108,1cyclictest19307-21aten2_r7power_c09:00:140
3056499108,1cyclictest15366-21grep11:20:160
3056499107,2cyclictest4204-21cut10:35:150
3056499107,2cyclictest32279-21grep11:30:170
3056499100,9cyclictest6799-21df11:15:150
3056499100,9cyclictest5681-21grep07:25:150
3056499100,9cyclictest29614-21taskset08:13:250
3056499100,9cyclictest17939-21tr08:55:210
3056499100,9cyclictest17737-21rm09:45:070
305649997,1cyclictest2344-21taskset08:25:110
305649996,2cyclictest18093-21grep07:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional