You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 14:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Fri Jun 19, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1106929683,9sleep00-21swapper/007:07:100
1094229272,9sleep20-21swapper/207:05:302
1096529164,9sleep30-21swapper/307:05:483
1109728864,13sleep10-21swapper/107:07:311
269312710,1sleep0161rcuc/010:20:270
140212480,0sleep20-21swapper/210:32:352
1138499260,1cyclictest0-21swapper/311:36:583
11374992523,2cyclictest0-21swapper/011:48:050
1138199240,24cyclictest0-21swapper/210:21:232
11379992418,2cyclictest4171-21diskmemload09:50:591
1137499240,24cyclictest0-21swapper/012:18:100
1138499231,0cyclictest0-21swapper/312:23:343
11381992321,1cyclictest0-21swapper/210:54:102
1137499233,1cyclictest7126-21apt-get09:50:140
1137499230,2cyclictest0-21swapper/010:58:250
1137499230,0cyclictest0-21swapper/009:48:080
11384992222,0cyclictest0-21swapper/312:27:023
1138499220,3cyclictest0-21swapper/311:45:093
1138499220,1cyclictest0-21swapper/312:39:503
1138499220,1cyclictest0-21swapper/311:43:433
1137999220,2cyclictest0-21swapper/111:14:491
11374992222,0cyclictest0-21swapper/009:22:350
1138499210,1cyclictest0-21swapper/311:21:463
1138499210,0cyclictest0-21swapper/312:16:213
1138499200,0cyclictest0-21swapper/309:22:483
1138199200,20cyclictest0-21swapper/212:17:322
1138199200,20cyclictest0-21swapper/211:15:302
1137999205,10cyclictest0-21swapper/111:30:121
11374992019,1cyclictest0-21swapper/011:28:430
1137499200,19cyclictest0-21swapper/012:39:330
1138499190,7cyclictest0-21swapper/310:42:073
1138499190,4cyclictest0-21swapper/309:30:323
1138499190,1cyclictest0-21swapper/311:00:233
11381991917,1cyclictest0-21swapper/212:14:082
1138199190,2cyclictest0-21swapper/207:45:142
1138199190,1cyclictest0-21swapper/209:12:072
1138199190,19cyclictest0-21swapper/210:56:552
1137999193,15cyclictest4171-21diskmemload12:25:041
1137499190,0cyclictest0-21swapper/009:43:330
1137499190,0cyclictest0-21swapper/009:43:320
1138499180,1cyclictest0-21swapper/311:11:593
1138199180,17cyclictest0-21swapper/210:06:192
11379991818,0cyclictest0-21swapper/111:46:141
11379991814,3cyclictest94-21kswapd009:37:321
1137999180,18cyclictest0-21swapper/111:39:111
11374991818,0cyclictest0-21swapper/011:51:460
1137499180,1cyclictest0-21swapper/011:02:180
203962170,0sleep30-21swapper/309:19:393
1138499170,2cyclictest0-21swapper/309:42:313
1138499170,2cyclictest0-21swapper/309:42:313
1138499170,16cyclictest0-21swapper/310:15:053
1138499170,14cyclictest31375-21/usr/sbin/munin09:25:253
1138499170,14cyclictest0-21swapper/311:34:543
1138199170,17cyclictest0-21swapper/210:45:552
11374991716,1cyclictest0-21swapper/010:40:130
11374991712,3cyclictest12135-21ls10:50:250
1138499161,1cyclictest0-21swapper/310:39:443
1138499160,3cyclictest0-21swapper/309:37:183
1138499160,1cyclictest0-21swapper/312:12:373
1138499160,1cyclictest0-21swapper/310:53:273
1138499160,1cyclictest0-21swapper/309:53:003
1138499160,1cyclictest0-21swapper/309:13:413
1138199162,6cyclictest4171-21diskmemload11:30:012
11381991613,2cyclictest5106-21sh12:04:232
11379991615,1cyclictest38150irq/131-snd_hda09:40:131
11379991615,1cyclictest38150irq/131-snd_hda09:40:131
11379991613,2cyclictest0-21swapper/110:00:201
1137999160,16cyclictest0-21swapper/112:21:121
1137999160,14cyclictest0-21swapper/109:22:561
1137499162,2cyclictest0-21swapper/009:33:340
11374991615,1cyclictest0-21swapper/009:56:280
11374991612,1cyclictest0-21swapper/008:15:110
1137499160,1cyclictest0-21swapper/010:46:360
181422150,0chrt0-21swapper/109:56:001
1138499150,2cyclictest0-21swapper/311:54:123
1138499150,1cyclictest0-21swapper/310:22:563
1138499150,0cyclictest0-21swapper/310:04:523
1138199150,15cyclictest0-21swapper/211:48:412
1138199150,15cyclictest0-21swapper/210:28:332
1137999150,1cyclictest0-21swapper/111:05:121
1137999150,1cyclictest0-21swapper/111:05:111
11374991514,1cyclictest0-21swapper/012:00:290
1137499150,1cyclictest0-21swapper/009:10:130
1137499150,14cyclictest0-21swapper/010:16:590
1138499147,7cyclictest729-21apache210:11:533
11384991410,3cyclictest2983-21sh08:00:003
1138499140,1cyclictest0-21swapper/312:09:263
1138499140,1cyclictest0-21swapper/311:08:363
1138499140,1cyclictest0-21swapper/311:08:363
1138499140,1cyclictest0-21swapper/309:45:433
1138499140,0cyclictest0-21swapper/310:47:263
11381991413,1cyclictest0-21swapper/209:57:102
11381991411,2cyclictest21151-21cat07:30:002
11381991411,2cyclictest11767-21systemctl08:15:222
11381991410,3cyclictest6378-21cron09:50:002
11381991410,3cyclictest5752-21cut08:05:142
1138199140,1cyclictest0-21swapper/209:27:192
1138199140,14cyclictest0-21swapper/210:37:462
1137999149,1cyclictest17156-21wc10:35:001
11379991413,1cyclictest0-21swapper/109:10:271
11379991410,3cyclictest15202-21tr11:50:221
1137999140,14cyclictest0-21swapper/112:31:571
1137499146,7cyclictest25443-21munin-run10:40:000
11374991410,2cyclictest31766-21cat10:05:010
1137499140,13cyclictest0-21swapper/009:35:090
1138499137,5cyclictest537-21snmpd10:25:243
1138499134,4cyclictest4171-21diskmemload12:00:173
11384991310,2cyclictest32097-21awk07:50:223
11384991310,2cyclictest32097-21awk07:50:223
11384991310,2cyclictest30785-21cat07:50:013
11384991310,2cyclictest28218-21cron07:45:003
11384991310,2cyclictest27843-21cat11:20:013
11384991310,2cyclictest23232-21cron10:00:003
11384991310,2cyclictest22241-21grep11:55:143
11384991310,2cyclictest21594-21grep08:35:273
11384991310,2cyclictest16230-21wc07:20:003
1138499130,1cyclictest0-21swapper/310:34:153
1138199139,3cyclictest28252-21tr11:00:202
1138199137,3cyclictest225-21systemd-journal07:39:552
1138199135,3cyclictest0-21swapper/212:20:142
1138199134,9cyclictest4171-21diskmemload10:01:362
11381991310,2cyclictest5413-21cat08:04:592
11381991310,2cyclictest21944-21http09:40:002
11381991310,2cyclictest13074-21sort11:10:242
1138199130,8cyclictest0-21swapper/210:20:002
1137999139,3cyclictest31874-21grep12:00:231
1137999139,3cyclictest29351-21chrt10:41:321
1137999139,3cyclictest14474-21grep08:20:271
1137999132,3cyclictest4171-21diskmemload11:58:401
11379991312,1cyclictest0-21swapper/112:07:361
11379991310,2cyclictest7284-21grep08:05:261
11379991310,2cyclictest32618-21tr10:05:141
11379991310,2cyclictest21819-21grep11:15:271
11379991310,2cyclictest13551-21turbostat.cron09:34:591
1137999130,12cyclictest26306-21sed08:45:251
1137499139,3cyclictest7268-21grep08:05:260
1137499139,3cyclictest20585-21grep07:25:230
1137499139,3cyclictest15725-21grep08:25:150
1137499139,2cyclictest9117-21grep10:10:170
1137499139,2cyclictest29900-21turbostat12:00:000
1137499134,8cyclictest5403-21perf08:05:000
11374991312,1cyclictest0-21swapper/008:55:130
11374991310,2cyclictest9143-21wc12:25:200
11374991310,2cyclictest3777-21ls11:25:000
11374991310,2cyclictest26792-21cron08:50:000
11374991310,2cyclictest22824-21sed11:35:250
11374991310,2cyclictest19193-21cron11:15:000
11374991310,2cyclictest14127-21tr11:30:210
1138499129,2cyclictest6414-21head08:05:173
1138499129,2cyclictest24940-21ls07:35:233
1138499129,2cyclictest23978-21grep08:40:273
1138499129,2cyclictest21090-21apt07:30:003
1138499128,2cyclictest16381-21bc07:20:123
1138199129,2cyclictest6541-21cut09:30:172
1138199129,2cyclictest526-21cron07:55:002
1138199129,2cyclictest526-21cron07:55:002
1138199129,2cyclictest3503-21cat09:05:272
1138199129,2cyclictest3152-21cat08:00:012
1138199129,2cyclictest22584-21cut11:35:212
1138199129,2cyclictest17037-21grep07:20:172
1138199129,2cyclictest13286-21tr09:15:152
1138199125,6cyclictest537-21snmpd11:34:442
1138199120,1cyclictest0-21swapper/212:29:162
1138199120,1cyclictest0-21swapper/210:43:232
1138199120,11cyclictest14223-21grep07:15:142
1138199120,10cyclictest0-21swapper/208:55:132
1137999129,2cyclictest9788-21cron10:50:001
1137999129,2cyclictest5644-21head11:25:191
1137999129,2cyclictest28505-21basename07:45:141
1137999129,2cyclictest26496-21sort11:00:001
1137999129,2cyclictest13897-21head09:15:181
1137999129,2cyclictest13319-21grep07:10:271
1137999128,3cyclictest28408-21rm10:21:331
1137999128,2cyclictest28292-21tr08:50:221
1137999127,3cyclictest4917-21turbostat.cron11:45:001
1137999124,4cyclictest16817-21ssh12:10:281
1137999120,11cyclictest26374-21grep12:35:271
1137499129,2cyclictest4184-21perf09:10:000
1137499129,2cyclictest31113-21tr07:50:150
1137499129,2cyclictest31113-21tr07:50:150
1137499128,2cyclictest8459-21awk12:05:290
1137499128,2cyclictest4647-21ssh11:05:240
1137499128,2cyclictest4647-21ssh11:05:240
11374991211,1cyclictest0-21swapper/010:32:370
1137499120,12cyclictest0-21swapper/008:35:140
1138499119,1cyclictest223522sleep312:33:463
1138499118,2cyclictest8754-21grep08:10:173
1138499118,2cyclictest8432-21ssh11:27:083
1138499118,2cyclictest6805-21ssh10:09:153
1138499118,2cyclictest30543-21cut08:55:193
1138499118,2cyclictest25950-21wc08:45:213
1138499118,2cyclictest23175-21taskset07:31:323
1138499118,2cyclictest20154-21sh10:55:223
1138499118,2cyclictest15906-21grep08:25:173
1138499118,2cyclictest12235-21sort07:10:183
1138499117,3cyclictest4778-21cat08:00:273
1138199119,1cyclictest4460-21wc11:05:212
1138199119,1cyclictest4460-21wc11:05:212
1138199119,1cyclictest25319-21grep12:35:182
1138199118,2cyclictest8937-21ssh09:50:272
1138199118,2cyclictest28624-21cstates11:20:142
1138199118,2cyclictest26907-21cat08:50:002
1138199118,2cyclictest23317-21chrt07:33:232
1138199118,2cyclictest22909-21head11:55:172
1138199118,2cyclictest22367-21cut08:40:142
1138199118,2cyclictest21731-21chrt08:36:192
1138199118,2cyclictest21316-21ssh09:20:102
1138199118,2cyclictest17278-21cat12:30:182
1138199118,2cyclictest15908-21ssh11:50:322
1138199118,2cyclictest13900-21sed08:20:212
1138199118,2cyclictest12215-21ssh10:11:562
1138199118,2cyclictest10361-21ssh12:06:582
1138199116,4cyclictest1660-21ssh11:42:272
11381991110,1cyclictest0-21swapper/209:41:082
11381991110,1cyclictest0-21swapper/209:41:082
1137999119,1cyclictest31533-21taskset08:59:591
1137999118,2cyclictest3813-21ssh10:26:061
1137999118,2cyclictest30663-21ssh11:01:451
1137999118,2cyclictest29679-21ssh09:25:111
1137999118,2cyclictest24451-21head07:35:181
1137999118,2cyclictest24207-21cut12:15:171
1137999118,2cyclictest22875-21sed08:40:161
1137999118,2cyclictest21188-21cut08:35:231
1137999118,2cyclictest20897-21ssh10:36:281
1137999118,2cyclictest19733-21cut07:25:141
1137999118,2cyclictest18543-21grep10:15:261
1137999118,2cyclictest18106-21head07:20:271
1137999118,2cyclictest10605-21cut10:50:141
1137999118,2cyclictest10232-21sed10:10:271
1137999116,4cyclictest2136-21ssh09:46:401
1137999114,5cyclictest25-21ksoftirqd/107:15:131
1137999114,2cyclictest225-21systemd-journal08:35:001
1137499118,2cyclictest732-21ssh10:25:030
1137499118,2cyclictest4460-21ssh10:07:240
1137499118,2cyclictest32767-21uname09:00:210
1137499118,2cyclictest29661-21ssh09:25:110
1137499118,2cyclictest28225-21ntpq08:50:210
1137499118,2cyclictest27147-21wc07:40:190
1137499118,2cyclictest18964-21ssh09:18:320
1137499118,2cyclictest17701-21taskset12:30:230
1137499118,2cyclictest16687-21sed12:10:260
1137499118,2cyclictest12133-21sed07:10:160
1137499111,4cyclictest225-21systemd-journal07:18:300
1137499110,6cyclictest10151-21awk08:15:000
1137499110,10cyclictest3066-21ssh11:43:340
1137499110,0cyclictest0-21swapper/012:21:380
1138499108,1cyclictest27951-21cat08:50:183
1138499108,1cyclictest10751-21expr08:15:143
1138499107,2cyclictest32441-21cut09:00:183
1138499107,2cyclictest2248-21egrep09:05:153
1138499107,2cyclictest18655-21grep08:30:243
1138199108,1cyclictest32627-21sh09:00:192
1138199108,1cyclictest27548-21sh08:50:142
1138199108,1cyclictest18426-21cat08:30:222
1138199108,1cyclictest11915-21cat07:10:162
1138199107,2cyclictest26875-21head07:40:162
1138199107,2cyclictest16152-21cat08:25:182
1137999108,1cyclictest976-21aten2_r7power_v07:55:131
1137999107,2cyclictest4040-21cut08:00:161
1137999107,2cyclictest30908-21aten2_r7power_e07:50:141
1137999107,2cyclictest30908-21aten2_r7power_e07:50:141
1137999107,2cyclictest30829-21ssh11:20:521
1137999107,2cyclictest26901-21cut07:40:161
1137999107,2cyclictest2297-21cut09:05:161
1137999107,2cyclictest16243-21cat08:25:191
1137999107,2cyclictest11120-21tail08:15:161
1137999106,3cyclictest22458-21uname07:30:211
1137499108,1cyclictest30368-21chrt07:47:120
1137499108,1cyclictest25596-21taskset07:37:080
1137499108,1cyclictest23359-21cat08:40:200
1137499108,1cyclictest18660-21grep08:30:240
1137499107,2cyclictest22326-21ssh11:15:460
1137499107,2cyclictest18239-21taskset07:21:510
1137499107,2cyclictest1124-21cut07:55:140
113849997,1cyclictest12949-21egrep08:20:153
113819997,2cyclictest8350-21expr08:10:152
113799996,2cyclictest1485-21chrt09:03:551
113799990,3cyclictest8294-21cpuspeed_turbos08:10:151
113749996,2cyclictest23233-21chrt07:32:180
113749990,5cyclictest225-21systemd-journal08:25:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional