You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 12:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sun May 10, 2026 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
645321740,3sleep03004799cyclictest08:24:210
3255321550,6sleep13004899cyclictest08:56:021
2634221520,5sleep03004799cyclictest07:30:220
30047991196,80cyclictest0-21swapper/008:11:070
3004799918,66cyclictest0-21swapper/004:46:230
3004799895,44cyclictest25823-21unixbench_multi05:46:250
78132870,2sleep00-21swapper/006:26:240
293322870,2sleep20-21swapper/204:26:242
3004799862,75cyclictest13198-21latency_hist09:50:570
3004799861,74cyclictest0-21swapper/008:48:280
3004799851,7cyclictest13440-21fschecks_count06:36:140
3004799851,7cyclictest13440-21fschecks_count06:36:140
3004799841,5cyclictest8205-21/usr/sbin/munin08:26:170
3004799841,5cyclictest1072-21latency_hist04:40:560
30047998323,47cyclictest24855-21grep08:06:270
3004799831,67cyclictest19066-21perl07:21:150
3004799823,64cyclictest2175-21ps06:11:210
3004799821,6cyclictest3305-21grep07:01:270
3004799814,59cyclictest0-21swapper/007:11:060
3004799811,66cyclictest32699-21wget08:56:100
30047998114,47cyclictest3206-21latency_hist08:20:570
3004799801,7cyclictest18813-21grep09:56:260
30047998012,55cyclictest15007-21grep05:16:240
3004799798,61cyclictest0-21swapper/009:27:320
3004799789,49cyclictest9550irq/80-mmc007:37:570
3004799786,36cyclictest0-21swapper/007:41:170
3004799781,6cyclictest22782-21wc05:40:570
3004799772,58cyclictest18707-21rm09:17:250
3004799772,58cyclictest18707-21rm09:17:250
3004799771,6cyclictest29627-21/usr/sbin/munin09:31:130
3004799761,64cyclictest22519-21ssh08:43:150
3004799761,57cyclictest9534-21ssh07:48:400
3004799752,6cyclictest1795-21latency04:41:160
3004799751,61cyclictest12273-21ssh08:31:140
3004799751,61cyclictest0-21swapper/007:06:190
3004799751,61cyclictest0-21swapper/007:06:190
3004799741,6cyclictest30431-21aten_rbpower_vo06:56:100
3004799741,56cyclictest23264-21ssh09:23:130
3004799741,4cyclictest0-21swapper/009:06:100
3004799735,57cyclictest0-21swapper/009:14:200
30047997211,53cyclictest8593-21ssh09:45:210
3004799711,8cyclictest13673-21fschecks_count09:51:130
3004799711,55cyclictest0-21swapper/009:02:250
30047997111,49cyclictest0-21swapper/006:43:500
3004799703,60cyclictest29904-21ssh08:51:380
3004799702,4cyclictest0-21swapper/006:53:010
30047997016,43cyclictest7850irq/56-dwc_otg_06:31:090
3004799701,53cyclictest25577-21systemd-journal04:35:560
3004799701,53cyclictest0-21swapper/005:41:220
3004799701,4cyclictest123112sleep005:11:130
3004799695,49cyclictest0-21swapper/007:16:380
3004799692,8cyclictest0-21swapper/004:57:110
3004799691,56cyclictest2559-21ssh09:36:560
3004799689,46cyclictest0-21swapper/006:03:060
3004799682,4cyclictest0-21swapper/007:52:150
3004799681,55cyclictest18048-21ssh08:37:390
3004799681,52cyclictest18977-21runrttasks08:00:470
3004799672,53cyclictest32261-21/usr/sbin/munin06:06:120
3004799672,52cyclictest0-21swapper/008:01:090
3004799671,7cyclictest5536-21latency06:21:170
3004799671,52cyclictest16319-21ls05:21:160
3004999662,5cyclictest8521-21proc_pri08:26:212
3004799662,44cyclictest28252-21grep07:31:270
30047996610,46cyclictest0-21swapper/006:50:180
3004999651,6cyclictest27900-21df08:11:092
3004999651,48cyclictest0-21swapper/206:45:332
3004799656,3cyclictest0-21swapper/005:10:570
3004799656,3cyclictest0-21swapper/005:10:570
3004799651,5cyclictest917-21snmpd04:51:470
3005099647,26cyclictest0-21swapper/306:41:103
3004999646,38cyclictest7850irq/56-dwc_otg_09:05:572
3004799641,48cyclictest0-21swapper/005:01:210
3004999638,42cyclictest0-21swapper/209:18:502
3004999638,42cyclictest0-21swapper/209:18:502
30047996310,42cyclictest0-21swapper/005:30:260
3004999624,4cyclictest7950irq/56-dwc_otg_08:19:452
3004799621,4cyclictest917-21snmpd05:51:590
3004799621,47cyclictest3831-21grep06:16:190
3004799621,46cyclictest19415-21wget05:31:100
30047996214,35cyclictest0-21swapper/006:00:420
25412620,1sleep30-21swapper/307:01:183
3004999613,54cyclictest10370-21sh07:11:062
3004899611,5cyclictest7750irq/56-dwc_otg08:36:101
3004999601,6cyclictest7950irq/56-dwc_otg_09:06:002
3004999599,35cyclictest0-21swapper/207:09:112
3004999599,35cyclictest0-21swapper/207:09:112
3004999591,5cyclictest7950irq/56-dwc_otg_06:56:192
3004899594,10cyclictest7950irq/56-dwc_otg_07:56:091
3004999582,3cyclictest7950irq/56-dwc_otg_09:40:082
3004999581,4cyclictest30150-21awk09:31:212
3005099575,38cyclictest7950irq/56-dwc_otg_07:51:103
3004999577,38cyclictest0-21swapper/208:38:422
3004999577,34cyclictest0-21swapper/209:50:562
3004999573,4cyclictest0-21swapper/208:24:512
3004999571,7cyclictest12664-21wc05:11:172
3004899571,8cyclictest0-21swapper/105:11:071
3004999565,4cyclictest7950irq/56-dwc_otg_08:46:112
3004999561,9cyclictest0-21swapper/207:01:232
30049995616,36cyclictest9111-21ssh06:31:132
173102560,2sleep30-21swapper/307:19:053
3005099555,10cyclictest7850irq/56-dwc_otg_07:21:093
3004999558,31cyclictest0-21swapper/208:54:512
3004999556,37cyclictest7950irq/56-dwc_otg_05:51:592
3004999554,5cyclictest7950irq/56-dwc_otg_06:55:572
3004999552,6cyclictest0-21swapper/208:06:272
3004999552,42cyclictest0-21swapper/209:11:572
3004999551,5cyclictest15015-21awk05:16:242
3005099542,8cyclictest7750irq/56-dwc_otg07:36:103
3004999541,6cyclictest0-21swapper/205:35:562
3004999541,5cyclictest7950irq/56-dwc_otg_07:41:102
3004999541,5cyclictest4217-21grep04:46:252
3004999541,4cyclictest7950irq/56-dwc_otg_09:51:232
3004999541,10cyclictest2581-21awk06:11:252
3004899542,25cyclictest7750irq/56-dwc_otg06:56:071
3004999537,30cyclictest0-21swapper/208:31:502
3004999531,6cyclictest15588-1kworker/u9:107:21:182
3004999531,5cyclictest0-21swapper/205:26:072
30049995313,37cyclictest4792-21cron06:20:562
30048995319,10cyclictest0-21swapper/105:26:231
3004999527,31cyclictest7750irq/56-dwc_otg09:41:122
3004999525,4cyclictest0-21swapper/207:47:202
3004999522,8cyclictest24560-21latency_hist05:45:572
3004999521,6cyclictest11856-21latency_hist05:10:572
3004999521,6cyclictest11856-21latency_hist05:10:572
3004999521,4cyclictest30374-21ssh07:35:102
3004999521,40cyclictest0-21swapper/204:54:342
30049995211,37cyclictest24118-21grep07:26:252
174482520,2sleep10-21swapper/106:41:101
30050995131,17cyclictest7950irq/56-dwc_otg_06:46:053
3004999513,7cyclictest2196-21grep04:41:222
3004999513,5cyclictest0-21swapper/205:56:082
3004999512,8cyclictest25656-21timerandwakeup05:46:232
3004999511,7cyclictest32363-21cut06:06:152
3004999511,38cyclictest7850irq/56-dwc_otg_08:42:042
3004999502,5cyclictest0-21swapper/208:01:092
3004999502,4cyclictest0-21swapper/205:05:482
3004999501,6cyclictest7850irq/56-dwc_otg_07:38:172
3004999501,4cyclictest7950irq/56-dwc_otg_07:59:342
3004999501,4cyclictest7750irq/56-dwc_otg06:50:572
3004999501,4cyclictest0-21swapper/206:36:452
3004999501,4cyclictest0-21swapper/206:36:452
3004999498,25cyclictest7850irq/56-dwc_otg_07:51:082
3004999497,32cyclictest7950irq/56-dwc_otg_06:02:302
3004999492,4cyclictest0-21swapper/207:16:172
3004999491,9cyclictest30417-21fschecks_time04:31:172
3004999491,5cyclictest0-21swapper/209:25:572
3004999485,4cyclictest0-21swapper/205:21:122
3004999482,5cyclictest0-21swapper/209:27:402
3004999481,8cyclictest7950irq/56-dwc_otg_04:57:182
3004999481,7cyclictest1428-21unixbench_multi08:56:252
3004999481,6cyclictest22679-21latency_hist05:40:562
3004999481,4cyclictest0-21swapper/209:56:332
3004899488,22cyclictest7950irq/56-dwc_otg_09:51:101
3004899483,6cyclictest7750irq/56-dwc_otg07:31:081
30050994735,10cyclictest0-21swapper/307:06:033
30050994735,10cyclictest0-21swapper/307:06:033
30050994721,6cyclictest23696-21aten_rbpower_vo08:06:123
3004999471,6cyclictest7096-21grep06:26:142
3004999471,6cyclictest32480-21missed_timers04:36:192
3004999463,3cyclictest7950irq/56-dwc_otg_06:25:152
3004899463,5cyclictest0-21swapper/109:46:091
3005099451,9cyclictest7750irq/56-dwc_otg08:56:083
3005099447,23cyclictest0-21swapper/306:11:103
30050994418,6cyclictest13930-21aten_rbpower_cu05:16:103
3005099437,23cyclictest0-21swapper/309:36:103
3005099431,7cyclictest7850irq/56-dwc_otg_06:56:093
3005099431,12cyclictest0-21swapper/304:31:263
3004899436,25cyclictest0-21swapper/107:06:111
3004899436,25cyclictest0-21swapper/107:06:111
3004899433,5cyclictest7950irq/56-dwc_otg_08:31:071
295542432,13sleep00-21swapper/004:28:090
3005099428,24cyclictest0-21swapper/307:46:093
3005099427,23cyclictest11847-21ssh08:31:023
3004899427,26cyclictest0-21swapper/104:31:121
3004899427,25cyclictest0-21swapper/104:41:091
3004899422,9cyclictest7950irq/56-dwc_otg_08:01:211
30048994222,4cyclictest3308-21unixbench_singl07:01:271
3005099412,8cyclictest7750irq/56-dwc_otg07:56:083
30048994119,5cyclictest1881050wget07:21:111
30048994118,5cyclictest3089-21/usr/sbin/munin07:41:121
3004899407,23cyclictest0-21swapper/105:06:101
3004899407,23cyclictest0-21swapper/105:06:101
30048994034,4cyclictest221ktimersoftd/107:51:081
30048994018,8cyclictest17231-21latency_hist06:40:571
30048994018,8cyclictest17231-21latency_hist06:40:571
3005099399,6cyclictest7850irq/56-dwc_otg_08:41:273
30050993923,5cyclictest7850irq/56-dwc_otg_08:26:143
3004899397,19cyclictest0-21swapper/104:51:091
3004899393,30cyclictest7950irq/56-dwc_otg_09:16:061
3004899393,30cyclictest7950irq/56-dwc_otg_09:16:061
30048993919,4cyclictest19331-21aten_rbpower_cu05:31:091
3005099388,18cyclictest0-21swapper/305:31:093
30050993819,4cyclictest31933-21aten_rbpower_po08:16:123
3004899387,25cyclictest8577-21ssh09:06:101
3004899382,7cyclictest15750-21grep07:16:251
30048993818,6cyclictest12706-21sh09:11:081
30048993815,4cyclictest908-21runrttasks09:21:181
3005099377,5cyclictest7850irq/56-dwc_otg_06:31:123
30050993714,6cyclictest4557-21cpu09:01:093
3004899376,13cyclictest7950irq/56-dwc_otg_09:45:001
177592370,4sleep317722-21ssh09:56:123
3005099364,15cyclictest37-21rcuc/309:31:143
3005099361,4cyclictest0-21swapper/305:51:103
3004899367,7cyclictest0-21swapper/105:40:571
3004899366,5cyclictest7750irq/56-dwc_otg04:36:091
3004899366,21cyclictest4358-21ssh09:01:031
3004899366,18cyclictest0-21swapper/107:26:221
3004899364,20cyclictest7750irq/56-dwc_otg08:41:521
30048993614,5cyclictest27212-21sh09:27:521
3004899361,25cyclictest3096-21ls06:15:571
3004899361,24cyclictest3580-21ls06:16:161
3004899361,17cyclictest0-21swapper/108:11:081
3005099357,20cyclictest0-21swapper/304:46:103
3005099351,8cyclictest0-21swapper/305:21:073
30050993515,11cyclictest39-21ksoftirqd/306:30:573
3005099351,23cyclictest13201-21ls09:50:573
3005099351,18cyclictest39-21ksoftirqd/305:11:093
3005099351,16cyclictest5355-21ssh09:41:133
3004899357,15cyclictest7950irq/56-dwc_otg_05:56:091
3004899357,15cyclictest0-21swapper/106:01:101
3004899356,14cyclictest7950irq/56-dwc_otg_08:46:221
3004899355,21cyclictest29261-21ssh09:31:091
3004899354,18cyclictest8472-21/usr/sbin/munin05:01:171
30048993519,4cyclictest4765-21unixbench_multi08:21:241
3004899351,20cyclictest22292-21ssh06:46:161
3005099344,3cyclictest0-21swapper/309:51:073
30050993412,13cyclictest37-21rcuc/306:25:053
3004899349,10cyclictest0-21swapper/108:06:201
3004899345,14cyclictest0-21swapper/106:21:181
3004899344,9cyclictest0-21swapper/108:27:031
30048993413,5cyclictest8415-21diskmemload06:51:011
30048993412,4cyclictest10351-21/usr/sbin/munin07:11:201
3005099336,15cyclictest0-21swapper/306:06:113
3005099333,5cyclictest7850irq/56-dwc_otg_04:40:563
30050993316,5cyclictest27749-21sh06:52:173
30050993312,13cyclictest20789-21cat09:20:583
30050993312,13cyclictest20789-21cat09:20:583
3004899339,5cyclictest7950irq/56-dwc_otg_04:50:571
3004899337,16cyclictest0-21swapper/105:21:091
30048993328,3cyclictest0-21swapper/108:51:101
30048993316,5cyclictest2217-21sh07:40:241
30048993310,12cyclictest0-21swapper/107:46:161
3005099328,6cyclictest37-21rcuc/305:46:253
3005099328,4cyclictest2024-21wc04:41:203
3005099327,14cyclictest0-21swapper/305:01:103
3005099326,14cyclictest0-21swapper/309:11:093
3005099324,4cyclictest7950irq/56-dwc_otg_07:26:153
3005099323,17cyclictest4667-21cat08:21:233
3005099323,17cyclictest0-21swapper/308:11:073
30050993225,5cyclictest21106-21ssh08:02:073
3005099322,4cyclictest7850irq/56-dwc_otg_08:46:193
3005099321,8cyclictest6634-21ssh07:45:563
30050993215,4cyclictest20940-21/usr/sbin/munin09:21:173
30050993214,8cyclictest8415-21diskmemload08:39:083
3005099321,24cyclictest29160-21ssh07:32:573
3005099321,14cyclictest30310-21wget06:01:113
3004899325,5cyclictest7850irq/56-dwc_otg_05:46:141
30048993222,7cyclictest0-21swapper/109:56:091
12052320,2sleep10-21swapper/109:36:131
3005099317,6cyclictest39-21ksoftirqd/306:36:083
3005099317,6cyclictest39-21ksoftirqd/306:36:083
3005099317,15cyclictest0-21swapper/304:56:163
3005099313,9cyclictest7950irq/56-dwc_otg_09:26:113
3005099311,16cyclictest0-21swapper/308:52:183
3005099311,13cyclictest7850irq/56-dwc_otg_09:07:133
3004899317,4cyclictest23-21ksoftirqd/106:10:561
3004899317,15cyclictest0-21swapper/108:16:111
3004899317,15cyclictest0-21swapper/105:51:101
3004899312,5cyclictest0-21swapper/104:57:261
30048993120,5cyclictest8765-21sh06:31:011
297122313,20sleep30-21swapper/304:30:073
3005099309,12cyclictest0-21swapper/306:00:313
3005099307,14cyclictest0-21swapper/307:15:283
30050993015,5cyclictest23189-21fschecks_count05:41:133
3005099301,16cyclictest7750irq/56-dwc_otg05:06:223
3005099301,16cyclictest7750irq/56-dwc_otg05:06:223
3004899305,5cyclictest23-21ksoftirqd/106:26:131
3005099294,5cyclictest7950irq/56-dwc_otg_06:20:573
3005099293,13cyclictest7950irq/56-dwc_otg_04:54:103
3004899295,5cyclictest13888-21/usr/sbin/munin05:16:201
30048992911,6cyclictest23111-21cpuspeed05:41:111
3005099285,13cyclictest7950irq/56-dwc_otg_05:36:173
3005099271,13cyclictest7950irq/56-dwc_otg_05:28:373
295202276,14sleep10-21swapper/104:27:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional