You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 15:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Apr 14, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17367211595,15sleep00-21swapper/007:09:190
17347211594,15sleep20-21swapper/207:09:052
17329211397,11sleep10-21swapper/107:08:521
17126211190,16sleep30-21swapper/307:06:143
14932740,1sleep31494-21sh11:23:403
103712730,1sleep30-21swapper/311:32:143
83452710,1sleep38346-21cpuspeed_turbos09:50:133
305122690,1sleep121-21rcuc/111:53:321
216362630,4sleep01744599cyclictest11:10:180
222392230,0sleep0101ktimersoftd/010:04:570
17448992218,2cyclictest0-21swapper/309:10:113
1744899221,19cyclictest0-21swapper/311:45:123
1744899221,19cyclictest0-21swapper/309:35:133
1744899221,19cyclictest0-21swapper/309:05:123
1744899211,18cyclictest4933-21kworker/u8:112:35:143
1744899210,19cyclictest0-21swapper/311:05:113
1744699210,19cyclictest0-21swapper/109:40:131
1744799200,3cyclictest0-21swapper/211:48:042
17448991914,3cyclictest805-21ssh12:30:133
17447991916,2cyclictest18436-21kworker/u8:011:08:042
17447991916,2cyclictest11938-21kworker/u8:110:38:042
17445991916,2cyclictest28943-21kworker/u8:009:21:040
110402190,0sleep00-21swapper/011:00:080
17447991815,2cyclictest8580-21kworker/u8:109:30:042
17447991815,2cyclictest6542-21kworker/u8:009:51:042
17447991815,2cyclictest5664-21kworker/u8:011:37:042
17447991815,2cyclictest3938-21kworker/u8:111:31:042
17447991815,2cyclictest3938-21kworker/u8:111:29:042
17447991815,2cyclictest27295-21kworker/u8:110:19:042
17447991815,2cyclictest24734-21kworker/u8:007:52:042
17447991815,2cyclictest24734-21kworker/u8:007:49:042
17447991815,2cyclictest21327-21kworker/u8:107:22:042
17447991815,2cyclictest19346-21kworker/u8:112:19:042
17447991815,2cyclictest14150-21kworker/u8:209:23:042
17447991815,2cyclictest10385-21kworker/u8:211:02:052
17448991711,4cyclictest0-21swapper/308:01:013
17447991714,2cyclictest6088-21kworker/u8:210:24:042
17447991714,2cyclictest5664-21kworker/u8:011:41:042
17447991714,2cyclictest3938-21kworker/u8:111:21:042
17447991714,2cyclictest32272-21kworker/u8:010:29:042
17447991714,2cyclictest31673-21kworker/u8:012:33:042
17447991714,2cyclictest29810-21kworker/u8:108:02:042
17447991714,2cyclictest28956-21kworker/u8:010:58:042
17447991714,2cyclictest28943-21kworker/u8:009:06:052
17447991714,2cyclictest26995-21kworker/u8:209:40:042
17447991714,2cyclictest18814-21kworker/u8:210:41:042
17447991714,2cyclictest15739-21kworker/u8:210:10:042
17447991714,2cyclictest11289-21kworker/u8:108:21:042
17445991714,2cyclictest11392-21kworker/u8:211:48:040
17447991613,2cyclictest8580-21kworker/u8:110:00:042
17447991613,2cyclictest8580-21kworker/u8:109:29:042
17447991613,2cyclictest5501-21kworker/u8:208:06:052
17447991613,2cyclictest3938-21kworker/u8:110:54:042
17447991613,2cyclictest32272-21kworker/u8:010:34:012
17447991613,2cyclictest31130-21kworker/u8:007:17:042
17447991613,2cyclictest30925-21kworker/u8:211:59:042
17447991613,2cyclictest30925-21kworker/u8:211:59:042
17447991613,2cyclictest28943-21kworker/u8:009:19:042
17447991613,2cyclictest25054-21kworker/u8:211:16:042
17447991613,2cyclictest21952-21kworker/u8:208:54:042
17447991613,2cyclictest19904-21kworker/u8:012:22:042
17447991613,2cyclictest17759-21kworker/u8:207:11:042
17447991613,2cyclictest15990-21kworker/u8:208:26:042
17446991613,2cyclictest6542-21kworker/u8:009:48:041
17446991613,2cyclictest29810-21kworker/u8:107:58:041
17446991613,2cyclictest1305-21diskmemload11:15:041
17446991611,3cyclictest0-21swapper/107:45:121
1744899152,7cyclictest0-21swapper/307:15:003
17448991512,2cyclictest0-21swapper/311:25:483
17448991512,2cyclictest0-21swapper/310:31:073
1744899151,12cyclictest22820-21wc09:31:023
1744899151,12cyclictest13125-21seq11:01:123
1744899151,12cyclictest0-21swapper/309:45:253
17448991510,3cyclictest21259-21ssh10:03:263
17447991512,2cyclictest26995-21kworker/u8:209:45:042
17447991512,2cyclictest25474-21kworker/u8:011:50:042
17447991512,2cyclictest24734-21kworker/u8:007:30:042
17447991512,2cyclictest17759-21kworker/u8:207:39:042
17447991512,2cyclictest15990-21kworker/u8:208:30:042
17447991512,2cyclictest13523-21kworker/u8:008:39:042
17446991512,2cyclictest8580-21kworker/u8:110:01:051
17446991512,2cyclictest21139-21kworker/u8:009:33:041
17446991512,2cyclictest20977-21kworker/u8:010:05:041
17446991512,2cyclictest19346-21kworker/u8:112:17:041
17446991512,2cyclictest19346-21kworker/u8:111:42:011
17446991512,2cyclictest13961-21kworker/u8:212:13:041
17445991512,2cyclictest6542-21kworker/u8:009:57:040
17445991512,2cyclictest19904-21kworker/u8:012:16:010
17445991511,3cyclictest26549-21kworker/u8:212:30:050
1744899149,3cyclictest992-21ssh11:56:023
1744899149,3cyclictest992-21ssh11:56:023
1744899141,7cyclictest14208-21ssh10:30:003
17448991411,2cyclictest381ktimersoftd/310:22:433
1744899141,12cyclictest381ktimersoftd/308:11:053
17448991411,2cyclictest0-21swapper/309:25:353
17448991411,2cyclictest0-21swapper/309:16:353
1744899141,11cyclictest37-21rcuc/310:45:123
1744899140,3cyclictest0-21swapper/311:19:033
1744899140,13cyclictest0-21swapper/308:35:163
1744899140,12cyclictest28827-21ssh10:10:513
1744899140,12cyclictest1305-21diskmemload12:14:233
1744899140,12cyclictest1305-21diskmemload10:56:283
1744899140,12cyclictest0-21swapper/311:50:163
1744899140,12cyclictest0-21swapper/310:05:233
1744899140,12cyclictest0-21swapper/308:31:043
17447991411,2cyclictest31673-21kworker/u8:012:28:042
17447991411,2cyclictest28943-21kworker/u8:008:57:042
17447991411,2cyclictest24734-21kworker/u8:007:44:042
17447991411,2cyclictest23713-21apt-get07:25:122
17447991411,2cyclictest19491-21kworker/u8:108:47:042
17447991411,2cyclictest19491-21kworker/u8:108:47:042
17447991411,2cyclictest19346-21kworker/u8:112:10:042
17447991411,2cyclictest0-21swapper/210:47:342
1744799140,2cyclictest0-21swapper/212:01:042
1744799140,2cyclictest0-21swapper/210:05:112
1744799140,13cyclictest0-21swapper/209:10:142
1744799140,12cyclictest0-21swapper/209:35:442
17446991411,2cyclictest4933-21kworker/u8:112:39:041
17446991411,2cyclictest3938-21kworker/u8:111:23:041
17446991411,2cyclictest30925-21kworker/u8:212:01:031
17446991411,2cyclictest26549-21kworker/u8:212:24:041
17446991411,2cyclictest19346-21kworker/u8:111:58:041
17446991411,2cyclictest19346-21kworker/u8:111:58:041
17446991411,2cyclictest14150-21kworker/u8:209:24:041
17446991411,2cyclictest1281-21kworker/u8:209:12:051
17446991411,2cyclictest0-21swapper/108:40:121
1744699141,11cyclictest8820-21apt-get12:05:061
17446991410,2cyclictest0-21swapper/109:50:201
1744699140,2cyclictest21705-21apt-get07:20:121
1744699140,2cyclictest0-21swapper/109:00:121
1744699140,13cyclictest0-21swapper/110:41:021
1744699140,12cyclictest0-21swapper/111:00:501
1744699140,12cyclictest0-21swapper/107:31:021
1744599141,2cyclictest3441-21iostat_ios11:25:170
1744599141,2cyclictest26961-21apt-get11:50:110
17445991410,3cyclictest8820-21apt-get12:05:070
17445991410,2cyclictest0-21swapper/012:25:170
17445991410,2cyclictest0-21swapper/007:55:000
109042140,3sleep10-21swapper/111:33:051
71572130,2sleep00-21swapper/009:49:030
1744899138,4cyclictest1305-21diskmemload10:40:513
1744899138,4cyclictest0-21swapper/312:20:533
1744899131,2cyclictest381ktimersoftd/312:29:033
1744899131,11cyclictest0-21swapper/307:41:013
17448991310,2cyclictest381ktimersoftd/311:40:203
17448991310,2cyclictest381ktimersoftd/307:45:143
17448991310,2cyclictest0-21swapper/312:03:393
17448991310,2cyclictest0-21swapper/311:35:533
17448991310,2cyclictest0-21swapper/311:12:033
17448991310,2cyclictest0-21swapper/310:37:553
17448991310,2cyclictest0-21swapper/308:51:013
1744899130,2cyclictest0-21swapper/312:18:123
1744899130,2cyclictest0-21swapper/309:55:033
1744899130,2cyclictest0-21swapper/307:51:013
1744899130,12cyclictest0-21swapper/309:00:123
17447991310,2cyclictest0-21swapper/212:05:152
17447991310,2cyclictest0-21swapper/209:55:142
1744799130,2cyclictest0-21swapper/211:13:532
17446991310,2cyclictest8580-21kworker/u8:109:26:051
17446991310,2cyclictest28956-21kworker/u8:010:57:041
17446991310,2cyclictest28943-21kworker/u8:009:18:041
17446991310,2cyclictest28943-21kworker/u8:009:09:041
17446991310,2cyclictest26549-21kworker/u8:212:30:011
17446991310,2cyclictest1305-21diskmemload10:30:251
17446991310,2cyclictest0-21swapper/110:47:521
17446991310,2cyclictest0-21swapper/110:25:001
17446991310,2cyclictest0-21swapper/110:15:121
17446991310,2cyclictest0-21swapper/109:35:121
17446991310,2cyclictest0-21swapper/107:40:121
17446991310,2cyclictest0-21swapper/107:15:471
1744699130,3cyclictest15853-21runrttasks11:05:091
1744699130,3cyclictest0-21swapper/108:00:291
1744699130,12cyclictest0-21swapper/111:48:121
1744699130,11cyclictest24401-21kernelversion07:25:161
1744699130,11cyclictest0-21swapper/111:37:271
1744699130,11cyclictest0-21swapper/108:25:181
17445991310,2cyclictest27295-21kworker/u8:110:14:010
17445991310,2cyclictest16961-21apt-get11:40:070
17445991310,2cyclictest14150-21kworker/u8:209:25:040
17445991310,2cyclictest0-21swapper/012:11:270
17445991310,2cyclictest0-21swapper/012:04:070
17445991310,2cyclictest0-21swapper/011:55:230
17445991310,2cyclictest0-21swapper/011:55:230
17445991310,2cyclictest0-21swapper/011:22:200
17445991310,2cyclictest0-21swapper/010:53:090
17445991310,2cyclictest0-21swapper/010:07:280
1744599130,12cyclictest7939-21ssh12:36:230
1744599130,12cyclictest0-21swapper/011:16:420
1744599130,12cyclictest0-21swapper/010:41:070
1744599130,12cyclictest0-21swapper/008:15:170
147862130,2sleep01305-21diskmemload11:36:370
70462120,2sleep20-21swapper/212:35:392
1744899129,2cyclictest0-21swapper/310:15:183
1744899129,2cyclictest0-21swapper/309:41:523
1744899129,2cyclictest0-21swapper/308:45:013
1744899129,2cyclictest0-21swapper/308:45:013
1744899129,2cyclictest0-21swapper/308:15:163
1744899127,4cyclictest0-21swapper/307:20:133
1744899122,7cyclictest0-21swapper/307:31:023
1744899120,2cyclictest0-21swapper/310:51:193
1744899120,11cyclictest381ktimersoftd/309:20:173
1744899120,11cyclictest0-21swapper/307:56:033
1744899120,11cyclictest0-21swapper/307:15:163
1744799129,2cyclictest0-21swapper/209:00:122
1744799120,11cyclictest0-21swapper/208:41:022
1744699129,2cyclictest8580-21kworker/u8:109:55:041
1744699129,2cyclictest18814-21kworker/u8:210:50:061
1744699129,2cyclictest0-21swapper/112:25:161
1744699129,2cyclictest0-21swapper/111:11:151
1744699122,7cyclictest0-21swapper/107:36:011
1744699121,9cyclictest0-21swapper/108:10:171
1744699120,2cyclictest0-21swapper/111:25:081
1744699120,2cyclictest0-21swapper/110:25:091
1744699120,2cyclictest0-21swapper/108:50:301
1744699120,11cyclictest0-21swapper/110:35:101
1744699120,11cyclictest0-21swapper/110:12:501
1744599129,2cyclictest0-21swapper/011:30:520
1744599129,2cyclictest0-21swapper/010:32:500
1744599129,2cyclictest0-21swapper/009:41:380
1744599129,2cyclictest0-21swapper/009:16:590
1744599129,2cyclictest0-21swapper/009:10:200
1744599129,2cyclictest0-21swapper/009:00:170
1744599129,2cyclictest0-21swapper/007:21:050
1744599128,3cyclictest27949-21aten2.4_r3power08:55:130
1744599120,3cyclictest8061-21ssh09:50:070
1744599120,2cyclictest18283-21ssh11:06:460
1744599120,2cyclictest0-21swapper/010:25:270
1744599120,2cyclictest0-21swapper/009:32:080
1744599120,11cyclictest0-21swapper/012:20:130
1744599120,11cyclictest0-21swapper/010:45:560
1744599120,11cyclictest0-21swapper/010:36:180
1744599120,11cyclictest0-21swapper/010:20:460
1744599120,11cyclictest0-21swapper/010:18:390
1744599120,11cyclictest0-21swapper/009:35:180
1744599120,10cyclictest0-21swapper/010:56:560
1744899112,6cyclictest0-21swapper/312:06:023
1744899110,2cyclictest0-21swapper/308:21:073
1744699118,2cyclictest0-21swapper/108:55:171
1744699117,2cyclictest0-21swapper/108:45:151
1744699117,2cyclictest0-21swapper/108:45:141
1744699112,6cyclictest0-21swapper/108:17:021
1744699112,6cyclictest0-21swapper/107:12:581
1744699110,9cyclictest17717-21copy08:30:021
1744699110,9cyclictest0-21swapper/108:05:161
1744699110,3cyclictest0-21swapper/108:20:181
36582100,2sleep20-21swapper/207:55:132
1744899107,2cyclictest0-21swapper/307:35:153
1744899105,3cyclictest29919-21ls09:00:013
1744899102,7cyclictest0-21swapper/308:44:023
1744899102,6cyclictest0-21swapper/307:26:013
1744899101,7cyclictest16680-21cut08:25:153
1744899100,6cyclictest0-21swapper/308:06:003
1744699100,8cyclictest19886-21munin-node1
1744699100,2cyclictest0-21swapper/107:50:111
1744599107,2cyclictest13523-21kworker/u8:008:36:040
1744599107,2cyclictest0-21swapper/008:25:160
1744599100,2cyclictest0-21swapper/007:10:110
174479994,3cyclictest13064-21cat08:16:042
174459996,2cyclictest24734-21kworker/u8:007:26:050
174459995,3cyclictest4003-21df_abs07:55:130
174459995,3cyclictest14311-21grep08:20:150
174459994,3cyclictest6162-21diskstats08:00:140
174459994,3cyclictest32173-21cpu09:05:130
174459994,3cyclictest26068-21df_abs07:30:130
174479981,5cyclictest11219-21unixbench_singl08:11:042
174459985,2cyclictest8139-21df_abs08:05:130
174459985,2cyclictest0-21swapper/008:45:150
174459985,2cyclictest0-21swapper/008:45:150
174459984,3cyclictest30676-21grep07:40:170
174459984,3cyclictest28720-21pluginstate07:35:190
174459984,2cyclictest32764-21proc_pri07:45:180
174459984,2cyclictest3151-21nscd07:15:090
174459984,2cyclictest25983-21aten2.4_r3power08:50:130
174459983,3cyclictest22147-21tr08:40:130
11297280,1sleep00-21swapper/008:11:330
174459974,2cyclictest22150irq/25-ahci[00008:30:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional