You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 22:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 09, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10672992524,1cyclictest606-21dbus-daemon07:20:012
10672992522,1cyclictest5594-21diskmemload09:59:232
10672992522,1cyclictest305122sleep210:36:342
1067299250,24cyclictest9814-21ssh10:17:362
1066899250,24cyclictest5594-21diskmemload12:13:191
1066899250,1cyclictest25152-21sh11:02:241
1066599250,24cyclictest0-21swapper/012:16:490
10677992424,0cyclictest0-21swapper/312:18:433
1067799240,24cyclictest0-21swapper/311:41:533
1067799240,23cyclictest5594-21diskmemload11:34:313
10672992422,1cyclictest30948-21apt-get08:59:112
10672992422,1cyclictest26440-21rm12:37:282
10672992420,2cyclictest313-21systemd-journal08:05:012
1067299240,3cyclictest0-21swapper/210:57:092
1067299240,23cyclictest5594-21diskmemload10:32:212
1067299240,23cyclictest3224-21sh10:41:302
1067299240,23cyclictest25160-21cron08:45:002
10668992423,1cyclictest8379-21perf08:10:011
10668992422,1cyclictest0-21swapper/111:10:011
1066899240,23cyclictest5594-21diskmemload11:50:141
1066899240,23cyclictest24761-21ssh11:34:111
1066899240,23cyclictest0-21swapper/111:55:271
1066899240,23cyclictest0-21swapper/109:45:561
1066899240,23cyclictest0-21swapper/109:11:401
1066599241,22cyclictest5594-21diskmemload10:24:350
1066599240,24cyclictest5594-21diskmemload11:08:070
1066599240,23cyclictest2838-21munin-plugin-st09:05:010
1066599240,23cyclictest0-21swapper/009:40:460
1066599240,23cyclictest0-21swapper/009:37:540
1066599240,22cyclictest3662-21ssh10:10:530
10677992323,0cyclictest5594-21diskmemload12:00:553
10677992323,0cyclictest0-21swapper/312:13:543
10677992323,0cyclictest0-21swapper/311:57:163
10677992323,0cyclictest0-21swapper/310:58:493
10677992323,0cyclictest0-21swapper/310:32:513
10677992323,0cyclictest0-21swapper/310:05:423
10677992323,0cyclictest0-21swapper/309:59:333
10677992321,1cyclictest5594-21diskmemload10:51:463
10677992321,1cyclictest0-21swapper/311:21:173
10677992320,2cyclictest14369-21ssh12:25:503
1067799230,2cyclictest28081-21unixbench_singl11:04:203
1067799230,2cyclictest15732-21ssh09:19:493
1067799230,23cyclictest0-21swapper/312:37:193
1067799230,23cyclictest0-21swapper/310:44:343
1067799230,23cyclictest0-21swapper/309:49:433
1067799230,22cyclictest606-21dbus-daemon10:25:003
1067799230,22cyclictest29902-21ssh11:06:453
1067799230,22cyclictest26598-21sh10:02:193
1067799230,22cyclictest17269-21ssh11:25:273
1067799230,22cyclictest12790-21perf10:50:013
1067799230,22cyclictest1200-21ssh09:38:213
1067799230,0cyclictest5594-21diskmemload12:07:593
1067799230,0cyclictest0-21swapper/312:21:523
10672992323,0cyclictest0-21swapper/212:15:182
10672992323,0cyclictest0-21swapper/210:51:072
10672992323,0cyclictest0-21swapper/210:45:402
10672992323,0cyclictest0-21swapper/210:04:102
10672992323,0cyclictest0-21swapper/209:30:032
10672992321,1cyclictest5605-21sh09:42:122
10672992320,2cyclictest9036-21ssh12:20:282
10672992320,2cyclictest16499-21ssh09:52:322
1067299230,23cyclictest0-21swapper/209:36:552
1067299230,23cyclictest0-21swapper/209:27:472
1067299230,22cyclictest5594-21diskmemload11:57:522
1067299230,22cyclictest5594-21diskmemload10:25:242
1067299230,22cyclictest15514-21ssh09:19:292
1067299230,0cyclictest0-21swapper/211:53:402
1067299230,0cyclictest0-21swapper/211:18:372
1067299230,0cyclictest0-21swapper/209:46:542
10668992323,0cyclictest0-21swapper/112:25:431
10668992323,0cyclictest0-21swapper/111:06:291
10668992323,0cyclictest0-21swapper/110:40:451
10668992323,0cyclictest0-21swapper/110:36:391
10668992323,0cyclictest0-21swapper/110:17:321
10668992323,0cyclictest0-21swapper/110:05:341
10668992321,1cyclictest0-21swapper/109:35:141
10668992320,2cyclictest22128-21cat10:59:161
1066899230,2cyclictest5775-21sh11:46:011
1066899230,2cyclictest25840-21ssh10:01:061
1066899230,2cyclictest13761-21apt-get08:24:091
1066899230,22cyclictest5981-21latency_hist08:05:011
1066899230,22cyclictest5594-21diskmemload10:31:221
1066899230,22cyclictest27489-21ssh12:39:101
1066899230,22cyclictest26439-21ssh09:30:041
1066899230,22cyclictest22774-21awk08:40:001
1066899230,22cyclictest17256-21ssh09:21:511
1066899230,22cyclictest0-21swapper/112:21:101
1066899230,22cyclictest0-21swapper/111:35:581
1066899230,22cyclictest0-21swapper/111:17:481
1066899230,22cyclictest0-21swapper/109:16:401
1066899230,1cyclictest20533-21sh09:55:471
10665992323,0cyclictest5594-21diskmemload12:20:490
10665992323,0cyclictest5594-21diskmemload12:11:200
10665992323,0cyclictest5594-21diskmemload11:35:350
10665992323,0cyclictest5594-21diskmemload11:02:200
10665992323,0cyclictest0-21swapper/012:31:360
10665992323,0cyclictest0-21swapper/011:55:160
10665992323,0cyclictest0-21swapper/011:52:010
10665992323,0cyclictest0-21swapper/011:13:070
10665992323,0cyclictest0-21swapper/010:30:500
10665992321,1cyclictest0-21swapper/012:25:280
10665992321,1cyclictest0-21swapper/012:06:140
10665992321,1cyclictest0-21swapper/010:55:260
10665992321,1cyclictest0-21swapper/010:07:590
10665992320,2cyclictest28337-21idleruntime-cro07:45:000
1066599230,2cyclictest11406-21sh09:15:420
1066599230,23cyclictest0-21swapper/009:10:540
1066599230,22cyclictest5594-21diskmemload10:52:080
1066599230,22cyclictest24883-21apt-get12:35:020
1066599230,22cyclictest2008-21ssh11:43:100
1066599230,22cyclictest15437-21diskmemload09:50:480
1066599230,22cyclictest0-21swapper/011:15:300
1066599230,22cyclictest0-21swapper/010:45:540
1066599230,0cyclictest5594-21diskmemload11:22:170
1066599230,0cyclictest5594-21diskmemload09:29:580
1066599230,0cyclictest0-21swapper/010:43:140
1066599230,0cyclictest0-21swapper/010:37:230
1066599230,0cyclictest0-21swapper/010:25:290
1066599230,0cyclictest0-21swapper/010:03:330
1066599230,0cyclictest0-21swapper/009:45:160
10677992222,0cyclictest5594-21diskmemload09:29:123
10677992222,0cyclictest0-21swapper/311:52:263
10677992220,1cyclictest5594-21diskmemload09:52:193
10677992220,1cyclictest29008-21ssh09:34:093
1067799220,22cyclictest9250-21ssh11:18:583
1067799220,22cyclictest5009-21rm10:13:003
1067799220,21cyclictest3894-21sh11:13:433
1067799220,21cyclictest15554-21cron08:25:003
1067799220,21cyclictest0-21swapper/309:20:043
1067799220,21cyclictest0-21swapper/308:45:023
1067799220,1cyclictest7729-21ssh09:13:053
1067799220,1cyclictest6905-21rm11:47:513
1067799220,1cyclictest4944-21ssh09:41:043
1067799220,1cyclictest32172-21rm11:39:573
1067799220,1cyclictest0-21swapper/310:25:403
10672992222,0cyclictest0-21swapper/211:21:412
10672992221,1cyclictest0-21swapper/208:09:102
10672992220,1cyclictest1741-21ssh11:10:162
10672992220,1cyclictest0-21swapper/212:25:152
10672992220,1cyclictest0-21swapper/211:02:232
10672992220,1cyclictest0-21swapper/208:20:012
1067299221,1cyclictest18539-1kworker/u9:111:46:062
1067299220,22cyclictest0-21swapper/212:01:202
1067299220,22cyclictest0-21swapper/211:28:092
1067299220,21cyclictest32505-21diskmemload11:40:022
1067299220,21cyclictest31306-21ssh11:08:562
1067299220,21cyclictest31239-21ssh12:10:412
1067299220,21cyclictest23139-21ssh11:31:382
1067299220,21cyclictest0-21swapper/212:30:052
1067299220,21cyclictest0-21swapper/210:05:222
1067299220,21cyclictest0-21swapper/209:10:322
1067299220,1cyclictest26158-21apt-get08:49:112
1067299220,1cyclictest25727-21ssh12:05:022
1067299220,1cyclictest17413-21ssh09:22:062
1067299220,1cyclictest0-21swapper/211:38:402
10668992222,0cyclictest5594-21diskmemload12:00:471
10668992222,0cyclictest0-21swapper/110:49:071
10668992222,0cyclictest0-21swapper/110:22:471
10668992221,0cyclictest0-21swapper/107:54:101
10668992220,1cyclictest0-21swapper/109:51:141
1066899220,22cyclictest0-21swapper/110:25:181
1066899220,21cyclictest879-21ssh11:41:231
1066899220,21cyclictest4616-21ssh09:40:351
1066899220,21cyclictest11346-21apt-get08:19:111
1066899220,21cyclictest0-21swapper/112:15:481
1066899220,1cyclictest6817-21ntp_states10:14:141
1066899220,1cyclictest19418-21ssh12:30:021
1066899220,1cyclictest12709-21ssh11:21:221
1066899220,1cyclictest0-21swapper/111:26:121
1066899220,0cyclictest0-21swapper/109:25:331
10665992220,1cyclictest0-21swapper/012:00:150
10665992220,1cyclictest0-21swapper/008:00:010
1066599220,22cyclictest5594-21diskmemload11:48:110
1066599220,22cyclictest23025-21perf07:35:000
1066599220,21cyclictest20651-21perf07:30:010
1066599220,21cyclictest0-21swapper/010:15:420
1066599220,21cyclictest0-21swapper/009:55:500
1066599220,21cyclictest0-21swapper/009:31:320
1066599220,21cyclictest0-21swapper/009:05:020
1066599220,1cyclictest0-21swapper/008:25:000
10677992120,0cyclictest0-21swapper/312:30:023
1067799210,21cyclictest0-21swapper/310:35:233
1067799210,21cyclictest0-21swapper/309:09:103
1067799210,21cyclictest0-21swapper/308:09:103
1067799210,1cyclictest1154-21munin-run07:55:003
10672992121,0cyclictest0-21swapper/208:34:092
10672992120,1cyclictest13716-21ssh10:20:302
10672992119,1cyclictest22761-21turbostat.cron08:40:002
10672992119,1cyclictest1732-21apt-get07:59:102
1067299210,21cyclictest0-21swapper/210:12:152
1067299210,20cyclictest2814-21apt-get09:05:022
1067299210,20cyclictest0-21swapper/208:29:102
10668992121,0cyclictest0-21swapper/108:29:101
10668992120,1cyclictest0-21swapper/112:06:351
10668992119,1cyclictest25190-21apt-get08:45:021
1066899210,21cyclictest0-21swapper/110:50:041
1066899210,0cyclictest0-21swapper/107:39:101
10665992121,0cyclictest0-21swapper/008:59:110
10665992120,1cyclictest0-21swapper/008:04:090
10665992119,1cyclictest8381-21munin-run08:10:010
1066599210,20cyclictest0-21swapper/011:30:060
1066599210,0cyclictest0-21swapper/007:19:080
10677992020,0cyclictest0-21swapper/307:40:023
10677992019,0cyclictest0-21swapper/307:59:103
1067799200,20cyclictest0-21swapper/308:59:113
1067799200,0cyclictest0-21swapper/307:49:103
10672992017,2cyclictest30369-21ls08:55:012
1067299200,0cyclictest0-21swapper/207:54:102
10668992020,0cyclictest0-21swapper/107:40:021
10668992018,1cyclictest388-21awk09:00:011
1066899200,20cyclictest0-21swapper/109:05:021
1066899200,20cyclictest0-21swapper/107:29:091
10665992020,0cyclictest0-21swapper/007:24:090
10665992020,0cyclictest0-21swapper/007:10:020
10665992020,0cyclictest0-21swapper/007:10:020
10677991919,0cyclictest0-21swapper/309:04:103
10677991919,0cyclictest0-21swapper/308:04:103
10677991917,1cyclictest15817-21latency_hist07:20:013
10677991917,1cyclictest0-21swapper/307:40:003
10668991919,0cyclictest13995-21apt-get07:19:081
10668991917,1cyclictest10755-21cron08:15:011
10665991919,0cyclictest0-21swapper/008:14:090
10665991918,1cyclictest0-21swapper/008:54:090
1066599190,0cyclictest0-21swapper/008:29:100
10672991818,0cyclictest0-21swapper/208:14:092
10668991818,0cyclictest0-21swapper/107:49:101
10668991817,0cyclictest16419-21apt-get07:24:091
10668991816,1cyclictest25198-21munin-run08:45:001
10665991815,2cyclictest20367-21turbostat.cron08:35:000
10677991717,0cyclictest0-21swapper/308:29:093
10672991717,0cyclictest0-21swapper/209:04:102
10672991717,0cyclictest0-21swapper/207:40:022
10665991715,1cyclictest22803-21tr08:40:000
10677991616,0cyclictest0-21swapper/308:19:113
10677991616,0cyclictest0-21swapper/307:29:093
10672991614,1cyclictest21214-21apt-get07:34:112
1067299160,3cyclictest0-21swapper/208:24:092
10668991616,0cyclictest0-21swapper/107:34:111
10668991616,0cyclictest0-21swapper/107:14:081
10668991616,0cyclictest0-21swapper/107:14:081
1066899160,15cyclictest29758-21grep08:54:161
1066599160,15cyclictest0-21swapper/007:39:140
1067799157,3cyclictest0-21swapper/307:34:113
10677991513,1cyclictest25175-21sh08:45:003
10668991515,0cyclictest0-21swapper/108:34:101
10668991512,2cyclictest2837-21perf09:05:011
1066599155,9cyclictest424-21pmu-power07:54:160
10665991515,0cyclictest0-21swapper/007:45:020
10677991414,0cyclictest0-21swapper/308:54:233
1067799140,14cyclictest0-21swapper/308:10:423
1067799140,14cyclictest0-21swapper/307:20:463
1067799140,0cyclictest0-21swapper/308:36:133
1067799140,0cyclictest0-21swapper/308:30:113
10672991414,0cyclictest0-21swapper/207:25:392
10672991414,0cyclictest0-21swapper/207:20:252
1067299140,14cyclictest0-21swapper/207:10:012
1067299140,14cyclictest0-21swapper/207:10:012
1067299140,0cyclictest0-21swapper/207:35:072
1066899140,14cyclictest0-21swapper/107:55:291
10665991414,0cyclictest0-21swapper/008:46:000
10665991414,0cyclictest0-21swapper/008:40:490
1066599140,14cyclictest0-21swapper/008:15:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional