You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-23 - 10:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Sun Aug 23, 2026 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2136729476,13sleep20-21swapper/219:06:072
2163829279,9sleep00-21swapper/019:09:380
2150229267,9sleep30-21swapper/319:07:543
2137628878,6sleep10-21swapper/119:06:141
88002530,0sleep30-21swapper/300:00:003
2175199351,2cyclictest32648-21munin-run23:55:001
21751993019,10cyclictest7011-21aten2_r7power_p23:20:141
21751992826,1cyclictest14545-21diskmemload22:26:021
2174799270,18cyclictest0-21swapper/022:06:580
2175199261,5cyclictest358-21ps19:30:211
2174799260,1cyclictest0-21swapper/023:11:260
2175199255,18cyclictest3400-21apt-get00:35:151
2175199242,2cyclictest14545-21diskmemload23:02:321
21751992421,2cyclictest0-21swapper/123:45:131
2175199240,3cyclictest0-21swapper/100:25:121
2175199240,22cyclictest0-21swapper/121:15:431
2174799241,1cyclictest21738-21cyclictest00:32:090
2174799240,0cyclictest0-21swapper/021:42:390
21751992313,9cyclictest132222sleep121:05:191
21751992312,10cyclictest38150irq/131-snd_hda20:10:231
2174799230,1cyclictest0-21swapper/022:39:350
21758992221,1cyclictest0-21swapper/322:05:343
2175899220,21cyclictest0-21swapper/322:47:073
2175199221,3cyclictest14545-21diskmemload22:16:061
2175199220,3cyclictest0-21swapper/121:45:061
2175199220,21cyclictest0-21swapper/119:55:211
2175199220,0cyclictest0-21swapper/100:33:221
2174799220,1cyclictest0-21swapper/000:10:170
2175699210,19cyclictest0-21swapper/223:05:012
2175199216,6cyclictest22232-21ssh21:52:481
2175199211,19cyclictest14545-21diskmemload00:11:011
2175199210,4cyclictest0-21swapper/122:10:191
2175199210,4cyclictest0-21swapper/122:00:571
2175199206,6cyclictest30494-21rm23:15:041
2175199206,6cyclictest30494-21rm23:15:041
2175199203,2cyclictest14545-21diskmemload21:43:481
2175199202,2cyclictest0-21swapper/121:23:051
2175199201,18cyclictest0-21swapper/121:28:431
2175199200,3cyclictest0-21swapper/120:45:281
2175199200,2cyclictest0-21swapper/123:14:131
2175199200,2cyclictest0-21swapper/122:57:551
2175199200,1cyclictest0-21swapper/120:35:141
2174799200,1cyclictest0-21swapper/000:36:480
2175899190,18cyclictest0-21swapper/323:13:463
2175199197,6cyclictest16598-21ssh21:10:231
2175199192,1cyclictest14545-21diskmemload22:08:231
2175199191,2cyclictest14545-21diskmemload23:05:151
2175199191,1cyclictest14545-21diskmemload00:09:161
2174799190,3cyclictest0-21swapper/021:15:500
2174799190,1cyclictest0-21swapper/022:28:530
2174799190,1cyclictest0-21swapper/021:35:180
2174799190,19cyclictest0-21swapper/022:21:150
2174799190,19cyclictest0-21swapper/022:10:480
2174799190,0cyclictest0-21swapper/023:45:500
2174799190,0cyclictest0-21swapper/022:16:060
2175899189,7cyclictest55650irq/127-enp2s0-22:25:173
2175199187,5cyclictest27951-21chrt19:20:211
2175199187,4cyclictest31577-21rm22:36:321
2175199184,13cyclictest14545-21diskmemload21:30:531
2175199182,3cyclictest20080-21cstates22:30:141
2175199182,1cyclictest25776-21ssh21:55:131
2175199182,1cyclictest14545-21diskmemload23:41:541
2175199181,4cyclictest29415-21sh23:33:251
2175199180,1cyclictest0-21swapper/122:46:131
2174799180,1cyclictest0-21swapper/023:41:200
2175699170,17cyclictest0-21swapper/200:03:542
2175199177,5cyclictest25454-21if_enp0s31f621:35:191
2175199172,3cyclictest14545-21diskmemload22:50:021
2175199172,2cyclictest910-21cpu23:55:121
2175199171,2cyclictest0-21swapper/122:20:011
2175199170,1cyclictest0-21swapper/100:16:451
2175199170,16cyclictest0-21swapper/123:37:251
2174799170,0cyclictest0-21swapper/023:07:190
2175699161,14cyclictest0-21swapper/200:06:372
2175699160,14cyclictest0-21swapper/221:46:232
2175199163,1cyclictest9147-21apt-get00:00:141
2175199161,14cyclictest0-21swapper/119:45:251
2175199160,2cyclictest0-21swapper/100:24:221
2175199160,1cyclictest0-21swapper/122:43:111
2174799165,8cyclictest29948-21cups-browsed20:35:240
2174799162,8cyclictest31991-21apt-get23:35:120
2174799161,2cyclictest0-21swapper/023:00:450
2174799160,1cyclictest0-21swapper/021:24:140
2175899158,2cyclictest28719-21cron22:55:013
21756991513,1cyclictest0-21swapper/223:10:062
2175699150,14cyclictest0-21swapper/221:30:092
2175199158,6cyclictest5560-21cat19:40:241
2175199158,6cyclictest30988-21chrt19:26:061
2175199158,6cyclictest17921-21taskset20:07:271
2174799150,0cyclictest0-21swapper/000:18:340
2175899143,0cyclictest0-21swapper/300:04:013
21758991412,1cyclictest0-21swapper/323:45:413
2175899141,1cyclictest0-21swapper/323:39:123
2175899140,1cyclictest0-21swapper/323:52:193
2175699144,8cyclictest6160-21ssh23:20:012
2175699144,8cyclictest6160-21ssh23:20:002
21756991411,2cyclictest27249-21uname00:10:202
21756991411,2cyclictest17738-21grep20:05:272
2175699140,12cyclictest0-21swapper/221:56:492
2175199146,7cyclictest24168-21cat20:20:181
2175199141,2cyclictest27929-21apt-get20:30:121
2175199140,4cyclictest10890-21sshd19:53:561
2175199140,13cyclictest15736-21expr23:25:151
2174799147,3cyclictest225-21systemd-journal19:40:010
2174799141,1cyclictest0-21swapper/000:23:290
21747991410,3cyclictest13680-21grep20:00:150
21747991410,3cyclictest13680-21grep20:00:140
2174799140,1cyclictest0-21swapper/021:45:130
2174799140,0cyclictest0-21swapper/000:28:070
2175899139,3cyclictest24484-21uname21:15:203
2175899139,3cyclictest20729-21ssh22:30:183
2175899139,2cyclictest24403-21grep19:15:143
2175899139,2cyclictest21738-21cyclictest21:31:053
2175899136,5cyclictest26103-21df_abs20:25:153
2175899136,5cyclictest11728-21ssh21:46:093
21758991311,2cyclictest39-21ksoftirqd/323:01:413
21758991310,2cyclictest9327-21tail20:55:263
21758991310,2cyclictest8429-21cat21:45:013
21758991310,2cyclictest5276-21sed00:35:263
21758991310,2cyclictest5099-21grep22:40:203
21758991310,2cyclictest31578-21ssh23:15:173
21758991310,2cyclictest31578-21ssh23:15:163
21758991310,2cyclictest29427-21sh21:56:443
21758991310,2cyclictest26381-21grep21:35:273
21758991310,2cyclictest22932-21basename20:20:003
21758991310,2cyclictest17502-21cut21:50:143
2175699139,3cyclictest727-21cat23:35:192
2175699139,3cyclictest27044-21grep22:15:132
21756991310,2cyclictest16035-21grep23:25:172
2175699130,12cyclictest18072-21cat23:45:252
2175699130,0cyclictest0-21swapper/200:33:492
2175199139,3cyclictest26608-21wc19:20:001
2175199139,3cyclictest21370-21grep20:15:161
2175199137,5cyclictest8416-21head20:55:171
2175199137,5cyclictest1605-21cut19:35:161
2175199136,6cyclictest5885-21forks20:50:161
2175199131,2cyclictest225-21systemd-journal19:15:001
2175199130,4cyclictest25809-21cpuspeed_turbos20:25:161
2174799139,3cyclictest27425-21wc21:55:240
2174799139,3cyclictest2578-21sed23:55:250
2174799139,3cyclictest22498-21sed20:15:260
2174799139,2cyclictest21155-21sh00:06:470
2174799135,4cyclictest225-21systemd-journal23:54:590
21747991310,2cyclictest8761-21grep23:20:260
21747991310,2cyclictest32274-21grep19:30:170
21747991310,2cyclictest31942-21grep23:15:200
21747991310,2cyclictest31942-21grep23:15:190
21747991310,2cyclictest23958-21cron21:35:010
21747991310,2cyclictest12308-21wc19:55:190
2174799130,12cyclictest30390-21wc22:55:200
2175899129,2cyclictest9684-21grep21:25:263
2175899129,2cyclictest30284-21grep19:25:203
2175899129,2cyclictest30134-21grep22:35:273
2175899129,2cyclictest23659-21grep23:30:133
2175899129,2cyclictest23651-21sed19:10:263
2175899129,2cyclictest16484-21head21:10:223
2175899129,2cyclictest11496-21tr19:55:133
2175899129,2cyclictest11171-21cat19:55:003
2175899129,2cyclictest10685-21grep21:00:193
2175899127,3cyclictest28864-21cron19:25:003
2175899120,2cyclictest0-21swapper/300:25:233
2175699129,2cyclictest8609-21rm23:20:262
2175699129,2cyclictest7408-21munin-plugin-st20:55:002
2175699129,2cyclictest665-21ssh23:55:092
2175699129,2cyclictest32345-21expr21:20:162
2175699129,2cyclictest26466-21sh22:15:012
2175699129,2cyclictest23931-21sed20:20:172
2175699129,2cyclictest2131-21sh21:40:252
2175699129,2cyclictest18536-21cut20:10:152
2175699129,2cyclictest17994-21grep21:50:162
2175699129,2cyclictest15907-21grep21:10:172
2175699129,2cyclictest13324-21head22:45:162
2175699129,2cyclictest11045-21head22:05:182
2175699128,2cyclictest21640-21ssh22:50:192
2175699122,10cyclictest10655-21munin-node22:36:332
2175699121,1cyclictest0-21swapper/200:28:562
21756991210,1cyclictest8318-21grep23:40:162
2175199125,6cyclictest10455-21expr21:00:161
2175199121,2cyclictest225-21systemd-journal20:41:041
2175199121,1cyclictest225-21systemd-journal20:05:011
2175199121,1cyclictest225-21systemd-journal20:05:011
2174799129,2cyclictest7546-21wc20:55:000
2174799129,2cyclictest22681-21cut19:10:180
2174799129,2cyclictest10566-21grep00:00:240
2174799128,3cyclictest15551-21tr23:25:150
2174799128,2cyclictest27722-21wc19:20:180
2174799121,10cyclictest0-21swapper/021:12:060
21747991210,1cyclictest13-21ksoftirqd/021:25:010
21747991210,1cyclictest13-21ksoftirqd/020:40:030
2174799120,0cyclictest0-21swapper/022:52:080
2175899118,2cyclictest9917-21ssh23:21:153
2175899118,2cyclictest7398-21ssh22:22:183
2175899118,2cyclictest7050-21df19:45:163
2175899118,2cyclictest5996-21sh22:02:083
2175899118,2cyclictest4978-21ssh00:16:003
2175899118,2cyclictest3302-21expr20:45:173
2175899118,2cyclictest32476-21ls20:40:013
2175899118,2cyclictest31712-21ssh21:20:063
2175899118,2cyclictest29074-21ssh22:15:303
2175899118,2cyclictest28956-21ssh22:55:013
2175899118,2cyclictest28793-21cut00:30:223
2175899118,2cyclictest18499-21ssh22:10:103
2175899118,2cyclictest17493-21ssh23:25:393
2175899118,2cyclictest17430-21ssh00:05:133
2175899118,2cyclictest1537-21cut19:35:153
2175899118,2cyclictest14657-21ssh00:21:593
2175899118,2cyclictest13615-21ssh23:05:103
2175899118,2cyclictest11021-21ssh23:41:123
2175899117,3cyclictest7404-21basename20:55:003
2175899117,3cyclictest13204-21cut21:05:183
2175699118,2cyclictest9650-21head19:50:182
2175699118,2cyclictest8762-21ssh21:25:172
2175699118,2cyclictest8451-21head20:55:172
2175699118,2cyclictest5997-21ssh22:02:082
2175699118,2cyclictest4947-21sort22:40:192
2175699118,2cyclictest4510-21expr19:40:132
2175699118,2cyclictest28593-21sh23:51:532
2175699118,2cyclictest28548-21grep20:30:152
2175699118,2cyclictest27928-21ssh21:36:342
2175699118,2cyclictest26077-21sed19:15:262
2175699118,2cyclictest22239-21grep19:10:162
2175699118,2cyclictest20811-21uname22:30:192
2175699118,2cyclictest15748-21cron20:05:012
2175699118,2cyclictest15748-21cron20:05:002
2175699118,2cyclictest15243-21fgrep23:05:252
2175699118,2cyclictest1143-21sort20:40:172
2175699118,2cyclictest11094-21ssh00:39:542
2175699118,2cyclictest10809-21grep21:00:202
2175699117,3cyclictest28425-21tail19:20:262
2175699117,3cyclictest1248-21cron19:35:002
2175699116,3cyclictest25372-21grep21:15:272
2175699115,5cyclictest24829-21grep23:30:192
2175699114,3cyclictest0-21swapper/222:25:142
2175699110,10cyclictest0-21swapper/222:22:032
2174799118,2cyclictest8133-21ssh22:03:500
2174799118,2cyclictest4534-21sh22:40:180
2174799118,2cyclictest2932-21basename20:45:150
2174799118,2cyclictest27854-21ssh23:32:120
2174799118,2cyclictest25656-21grep20:25:150
2174799118,2cyclictest25080-21grep19:15:170
2174799118,2cyclictest20017-21cut22:30:140
2174799118,2cyclictest18438-21grep21:50:190
2174799118,2cyclictest14942-21ssh22:45:460
2174799118,2cyclictest10871-21chrt19:53:420
2174799117,3cyclictest8107-21grep19:45:250
2174799115,2cyclictest225-21systemd-journal20:15:010
2174799110,10cyclictest6130-21taskset19:43:450
2175899108,1cyclictest27113-21ls00:10:193
2175899108,1cyclictest2034-21cat20:40:273
2175899108,1cyclictest20314-21taskset20:12:423
2175899107,2cyclictest4826-21perl19:40:153
2175899107,2cyclictest28672-21sed20:30:163
2175899107,2cyclictest16672-21cut20:05:183
2175699108,1cyclictest3837-21interrupts20:45:202
2175699108,1cyclictest2649-21ntp_kernel_pll_19:35:222
2175699108,1cyclictest21145-21expr20:15:152
2175699108,1cyclictest12213-21ls19:55:182
2175699107,2cyclictest3331-21uname00:15:192
2175699107,2cyclictest32457-21cron20:40:012
2175699107,2cyclictest30158-21head22:55:182
2175699107,2cyclictest26314-21grep20:25:182
2175699107,2cyclictest11394-21ssh00:20:182
2174799108,1cyclictest17784-21chrt20:05:430
2174799107,2cyclictest9546-21taskset20:57:150
2174799107,2cyclictest30108-21munin-run20:35:000
2174799107,2cyclictest23572-21expr20:20:140
2174799107,2cyclictest13771-21systemd-cgroups21:05:240
2174799107,2cyclictest10072-21cut21:00:150
217589997,1cyclictest31705-21wget19:30:143
217589997,1cyclictest24536-21sendmail_mailtr20:20:233
217589997,1cyclictest13667-21aten2_r7power_c20:00:153
217589997,1cyclictest13667-21aten2_r7power_c20:00:143
217569997,1cyclictest83812sleep219:47:102
217569997,1cyclictest310592sleep219:26:582
217569996,2cyclictest12733-21cat21:05:152
217479997,1cyclictest29279-21grep19:25:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional