You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 04:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Wed Apr 22, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2193321010,4sleep3381ktimersoftd/309:51:003
633299841,33cyclictest0-21swapper/207:25:532
6330997139,22cyclictest101ktimersoftd/006:41:010
98112660,2sleep30-21swapper/309:36:073
6330996236,10cyclictest7950irq/56-dwc_otg_09:56:030
633099592,32cyclictest9824-21unixbench_singl08:56:170
6330995810,22cyclictest28577-21aten_rbpower_po08:41:020
6330995810,22cyclictest28577-21aten_rbpower_po08:41:020
6330995735,5cyclictest7950irq/56-dwc_otg_09:46:040
633099563,33cyclictest21770-21wc05:11:110
633099561,36cyclictest0-21swapper/007:30:580
205402560,2sleep020544-21if_err_wlan008:31:060
6330995527,13cyclictest2794-21memory06:51:090
633099552,32cyclictest453-21fschecks_time08:46:040
633099552,29cyclictest0-21swapper/009:31:020
6330995515,23cyclictest908-21runrttasks06:59:000
633099541,49cyclictest0-21swapper/005:16:100
633099541,30cyclictest18408-21ssh07:10:470
6330995329,12cyclictest7850irq/56-dwc_otg_07:36:050
6330995328,5cyclictest13794-21fschecks_count09:41:050
6330995325,6cyclictest0-21swapper/009:22:460
633099524,29cyclictest13-21rcuc/006:20:470
633099524,22cyclictest0-21swapper/004:31:150
6330995232,6cyclictest7850irq/56-dwc_otg_07:01:160
6330995210,23cyclictest30253-21aten_rbpower_vo05:36:020
6330995142,3cyclictest0-21swapper/009:15:590
633099512,3cyclictest983-21ssh09:25:590
633099512,31cyclictest24413-21aten_rbpower_en08:36:020
6330995121,5cyclictest7750irq/56-dwc_otg08:30:470
6330995121,5cyclictest7750irq/56-dwc_otg08:30:470
633099511,31cyclictest8947-21grep08:16:170
633099511,25cyclictest22597-21ssh07:15:470
633099511,24cyclictest9567-21fschecks_time09:36:040
58702513,41sleep20-21swapper/204:28:202
6330995034,3cyclictest0-21swapper/008:00:480
6330995026,5cyclictest30818-21latency_hist07:25:470
6330995026,5cyclictest30818-21latency_hist07:25:470
6330995026,12cyclictest7950irq/56-dwc_otg_08:01:010
6330995023,14cyclictest0-21swapper/006:36:030
6330995020,4cyclictest5496-21grep08:51:150
633099501,25cyclictest15943-21aten_rbpower_en06:26:010
633099501,14cyclictest24871-21cut05:21:040
6333994931,11cyclictest7950irq/56-dwc_otg_08:45:593
6333994920,6cyclictest17444-21sh06:30:473
6331994930,3cyclictest7850irq/56-dwc_otg_06:50:591
633099497,40cyclictest0-21swapper/005:25:530
6330994925,11cyclictest7850irq/56-dwc_otg_04:51:150
6330994923,7cyclictest1354-21cut05:46:010
6330994914,11cyclictest0-21swapper/006:05:590
633099491,25cyclictest0-21swapper/004:56:050
633299487,25cyclictest0-21swapper/205:56:022
633099489,20cyclictest0-21swapper/009:11:020
633099486,4cyclictest0-21swapper/008:11:080
6330994830,5cyclictest22141-21fschecks_count09:51:040
633099482,27cyclictest11522-21grep07:41:060
633099481,25cyclictest16302-21ls07:46:140
633299477,24cyclictest0-21swapper/205:06:002
6330994729,2cyclictest0-21swapper/005:55:590
6330994722,6cyclictest7750irq/56-dwc_otg06:47:130
633099472,24cyclictest0-21swapper/005:41:010
633099472,24cyclictest0-21swapper/004:36:050
633099472,21cyclictest0-21swapper/007:16:210
6330994719,18cyclictest23185-21latency_hist07:55:470
6330994714,5cyclictest730-21users08:06:160
60092473,37sleep00-21swapper/004:30:090
6330994622,5cyclictest28592-21fschecks_count05:31:040
633099462,20cyclictest0-21swapper/008:21:010
633099461,25cyclictest19108-21wc05:05:470
243572460,1sleep10-21swapper/106:37:571
633399457,24cyclictest0-21swapper/305:46:013
6333994521,13cyclictest381ktimersoftd/308:56:103
633299451,33cyclictest0-21swapper/208:11:042
6330994527,10cyclictest7850irq/56-dwc_otg_07:26:000
6330994519,17cyclictest0-21swapper/006:11:260
97672440,1sleep10-21swapper/107:38:531
633399446,24cyclictest0-21swapper/305:06:003
633299441,27cyclictest8007-21apt-config04:35:472
6331994421,7cyclictest26626-21cron07:20:471
6331994415,8cyclictest15173-21sh09:03:271
633099449,17cyclictest19639-21if_wlan005:06:050
633099447,18cyclictest12796-21grep09:01:030
6330994417,12cyclictest0-21swapper/004:46:560
633099441,25cyclictest0-21swapper/006:00:570
139602440,29sleep10-21swapper/104:51:021
633299437,23cyclictest0-21swapper/207:51:002
633299436,25cyclictest0-21swapper/206:41:022
633299436,24cyclictest0-21swapper/204:41:002
633099437,15cyclictest0-21swapper/009:06:130
633099432,22cyclictest0-21swapper/006:20:480
6330994317,18cyclictest0-21swapper/005:51:010
633099431,21cyclictest0-21swapper/004:40:590
633399427,21cyclictest0-21swapper/305:56:023
633199427,23cyclictest0-21swapper/105:06:001
6331994213,4cyclictest32564-21/usr/sbin/munin08:46:151
633199421,27cyclictest18370-21ssh07:10:471
6330994216,11cyclictest0-21swapper/006:32:020
6330994216,11cyclictest0-21swapper/006:32:020
6333994126,7cyclictest23390-21rm09:13:253
6332994120,5cyclictest7324-21kernelversion06:01:072
6331994120,9cyclictest29480-21sh06:44:381
6331994113,6cyclictest20997-21awk08:31:121
6331994112,14cyclictest0-21swapper/106:46:161
6331994111,14cyclictest17448-21ssh09:45:481
158802410,1sleep30-21swapper/309:04:463
633399404,24cyclictest0-21swapper/309:06:013
6333994018,5cyclictest19620-21sh09:47:213
633299406,24cyclictest0-21swapper/207:16:012
633299406,22cyclictest0-21swapper/205:46:012
633299401,14cyclictest11521-21fschecks_time07:41:062
633199407,19cyclictest825-21dhclient04:30:491
633199406,24cyclictest24253-21ssh08:35:521
6331994019,4cyclictest24943-21fschecks_time05:21:051
633199401,3cyclictest0-21swapper/108:00:581
312692400,1sleep20-21swapper/208:05:192
291432400,2sleep20-21swapper/209:20:482
6333993917,4cyclictest25044-21sh09:15:513
6333993915,7cyclictest0-21swapper/307:11:013
633299395,26cyclictest9426-21ls09:36:022
633299392,16cyclictest7850irq/56-dwc_otg_08:05:592
6332993917,5cyclictest14797-21open_files06:21:112
633199392,5cyclictest30114-21ps09:21:121
6331993916,4cyclictest18900-21sh09:07:451
6331993914,4cyclictest19007-21fschecks_count07:11:051
301402391,33sleep230137-21apt-get05:36:002
633399384,6cyclictest0-21swapper/308:25:473
633399381,7cyclictest0-21swapper/304:31:123
6332993814,17cyclictest0-21swapper/209:45:112
633199389,15cyclictest0-21swapper/108:10:031
633199383,4cyclictest13145-21chrt08:21:161
6331993811,18cyclictest0-21swapper/109:40:471
6331993810,4cyclictest0-21swapper/108:52:321
6331993810,4cyclictest0-21swapper/107:26:041
633399372,7cyclictest0-21swapper/307:35:593
6333993721,9cyclictest381ktimersoftd/307:01:073
6333993718,4cyclictest16438-21sh09:44:153
6333993717,5cyclictest3526-21sh09:28:293
633399371,5cyclictest28525-21sh08:41:013
633399371,5cyclictest28525-21sh08:41:013
633399371,4cyclictest0-21swapper/306:10:473
6333993713,4cyclictest2441050wget08:36:023
633299377,18cyclictest0-21swapper/209:06:012
633299372,12cyclictest935950ssh06:59:272
633199377,6cyclictest23-21ksoftirqd/109:26:011
633199377,4cyclictest0-21swapper/109:33:181
6331993710,3cyclictest0-21swapper/107:45:531
223932370,1sleep20-21swapper/209:11:342
633399368,11cyclictest0-21swapper/306:46:053
633399362,19cyclictest0-21swapper/307:35:483
6333993615,13cyclictest29483-21sh06:44:393
633399361,4cyclictest0-21swapper/307:56:023
6333993610,4cyclictest0-21swapper/307:19:013
633299364,7cyclictest0-21swapper/209:46:002
6332993621,8cyclictest301ktimersoftd/205:35:072
6332993620,4cyclictest27525-21latency07:21:072
6332993620,4cyclictest27525-21latency07:21:072
633299361,18cyclictest0-21swapper/205:25:592
633299361,17cyclictest0-21swapper/207:58:582
633199365,21cyclictest7750irq/56-dwc_otg08:41:051
633199365,21cyclictest7750irq/56-dwc_otg08:41:051
6331993631,3cyclictest0-21swapper/107:40:591
633199362,7cyclictest2555850ssh07:57:341
633199361,4cyclictest7950irq/56-dwc_otg_09:15:571
633399355,19cyclictest6323-21ssh06:56:013
633399354,5cyclictest7950irq/56-dwc_otg_06:00:583
633399354,14cyclictest7850irq/56-dwc_otg_04:45:473
633399351,5cyclictest23133-21grep05:16:053
633399351,3cyclictest0-21swapper/308:11:043
633299352,17cyclictest15545-21cat07:06:132
6332993514,4cyclictest16937-21ssh08:26:152
6332993514,4cyclictest16937-21ssh08:26:152
633299351,24cyclictest13620-21ls04:50:482
633299351,22cyclictest24374-21latency_hist05:20:472
633299351,16cyclictest13603-21sh09:01:142
633199359,4cyclictest0-21swapper/109:46:241
633199359,19cyclictest7750irq/56-dwc_otg08:11:081
633199358,6cyclictest27182-21grep09:56:171
633199357,5cyclictest7850irq/56-dwc_otg_06:59:121
633199351,7cyclictest26561-21cut05:26:021
6331993517,4cyclictest923-21sshd09:52:011
6331993515,5cyclictest23280-21uname05:16:071
633199351,25cyclictest3480-21ls05:51:051
6331993511,3cyclictest0-21swapper/107:20:591
6331993511,3cyclictest0-21swapper/107:20:591
248142350,1sleep20-21swapper/208:36:072
633399342,7cyclictest6574-21ssh09:31:313
6333993427,5cyclictest7950irq/56-dwc_otg_07:51:113
633399341,5cyclictest11458-21ssh07:41:053
6333993415,12cyclictest18328-21sh07:10:413
633399341,24cyclictest0-21swapper/308:04:173
633299346,10cyclictest0-21swapper/206:50:592
6332993423,8cyclictest14361-21sh08:23:282
633299341,8cyclictest1976650ssh07:11:152
6332993417,10cyclictest10565-21rm07:40:212
633299341,15cyclictest9292-21ntpq08:56:112
633299341,15cyclictest23535-21ssh08:35:092
633299341,13cyclictest4234-21unixbench_multi05:51:152
633199346,20cyclictest7850irq/56-dwc_otg_08:16:141
633199345,18cyclictest7750irq/56-dwc_otg08:56:021
633199344,5cyclictest0-21swapper/109:15:471
633199341,6cyclictest11747-21wc04:45:471
6331993415,5cyclictest7656-21rt-features06:01:121
6331993413,3cyclictest0-21swapper/105:56:131
6331993410,4cyclictest0-21swapper/107:32:181
633399335,16cyclictest7850irq/56-dwc_otg_08:07:313
633399331,7cyclictest23388-21ssh06:36:183
633399331,5cyclictest0-21swapper/306:32:193
633399331,5cyclictest0-21swapper/306:32:193
6333993312,5cyclictest27879-21taskset09:57:213
6333993312,5cyclictest17439-21diskmemload08:50:543
6333993311,5cyclictest10871-21if_eth006:11:063
633299334,12cyclictest0-21swapper/209:28:212
6332993321,8cyclictest17927-21aten_rbpower_vo06:31:032
6332993321,8cyclictest17927-21aten_rbpower_vo06:31:032
633299332,14cyclictest0-21swapper/206:30:482
633299332,13cyclictest0-21swapper/209:56:092
633299332,13cyclictest0-21swapper/206:06:412
6332993316,11cyclictest11160-21sh08:20:112
6332993315,9cyclictest301ktimersoftd/208:51:302
633299331,3cyclictest7750irq/56-dwc_otg06:36:012
6332993313,5cyclictest21806-21/usr/sbin/munin09:51:062
633299331,21cyclictest14053-21grep04:51:042
633299331,13cyclictest12514-21fschecks_count06:16:042
633199338,3cyclictest0-21swapper/108:30:301
633199338,3cyclictest0-21swapper/108:30:301
633199337,14cyclictest0-21swapper/105:46:011
633199335,5cyclictest14574-21latency06:21:071
633199332,20cyclictest7750irq/56-dwc_otg07:55:471
633199331,5cyclictest12090-21latency_hist06:15:471
633399329,5cyclictest4003-21switchtime05:51:133
633399327,5cyclictest7850irq/56-dwc_otg_08:16:123
633399324,13cyclictest31162-21ssh07:25:563
633399322,16cyclictest0-21swapper/304:56:013
633399321,5cyclictest24702-21wget05:21:023
6333993213,5cyclictest21108-21switchtime08:31:143
6333993211,6cyclictest14203-21egrep06:21:013
633399321,12cyclictest12308-21wget06:16:013
633299328,12cyclictest5670-21ssh09:31:082
633299327,5cyclictest488-21cut08:46:042
633299323,5cyclictest28524-21cut08:41:012
633299323,5cyclictest28524-21cut08:41:012
633299321,18cyclictest545-21sed05:41:152
633299321,12cyclictest908-21runrttasks09:16:112
633199327,11cyclictest7950irq/56-dwc_otg_05:11:131
6331993215,5cyclictest3022350wget05:36:011
6331993214,9cyclictest908-21runrttasks04:50:371
184842321,4sleep20-21swapper/207:49:462
633399314,17cyclictest0-21swapper/307:50:323
633399314,13cyclictest8434-21/usr/sbin/munin04:36:033
6333993122,6cyclictest16117-21aten_rbpower_vo08:26:033
6333993122,6cyclictest16117-21aten_rbpower_vo08:26:033
633399311,5cyclictest2264-21sh06:51:023
6333993114,5cyclictest17439-21diskmemload07:25:013
6333993114,5cyclictest17439-21diskmemload07:25:013
633299315,19cyclictest7850irq/56-dwc_otg_05:21:042
633299315,12cyclictest0-21swapper/206:15:482
633299311,16cyclictest8356-21grep04:36:022
633199313,17cyclictest7750irq/56-dwc_otg07:01:131
6331993112,10cyclictest18518-21netstat06:31:111
6331993112,10cyclictest18518-21netstat06:31:111
6331993110,11cyclictest15940-21aten_rbpower_en06:26:011
633399306,15cyclictest381ktimersoftd/305:03:363
633299309,13cyclictest0-21swapper/207:03:172
633299309,10cyclictest0-21swapper/207:31:402
6332993022,6cyclictest16668-21grep04:56:152
633299301,12cyclictest0-21swapper/206:45:592
633199304,7cyclictest8652-21/usr/sbin/munin06:06:111
633199301,4cyclictest7850irq/56-dwc_otg_05:40:591
61372305,11sleep36096-21ls04:30:483
633399297,13cyclictest13279-21seq04:48:483
633399292,18cyclictest0-21swapper/309:23:223
633399291,4cyclictest7950irq/56-dwc_otg_05:26:023
633299292,12cyclictest0-21swapper/205:14:572
633299291,18cyclictest0-21swapper/205:05:412
633199299,12cyclictest8457-21cat04:36:031
633199294,17cyclictest7750irq/56-dwc_otg06:16:091
633199291,5cyclictest15683-21cut04:56:021
226992280,2sleep30-21swapper/305:15:483
6333992720,5cyclictest381ktimersoftd/305:41:003
633399271,13cyclictest13779-21munin-node04:50:583
633399271,11cyclictest0-21swapper/305:38:433
633199275,7cyclictest28825-21wc05:31:071
633199274,6cyclictest18212-21/usr/sbin/munin05:01:121
44842273,12sleep10-21swapper/104:25:491
633399261,21cyclictest0-21swapper/305:31:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional