You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 10:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Mar 17, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5787211796,16sleep20-21swapper/219:05:452
6515211091,14sleep10-21swapper/119:09:571
6343210887,16sleep00-21swapper/019:07:440
5703210088,6sleep30-21swapper/319:05:183
80552930,0sleep10-21swapper/122:35:171
5182840,0sleep30-21swapper/321:54:493
129152820,1sleep30-21swapper/300:21:013
113772750,0sleep00-21swapper/022:39:250
289512740,0sleep30-21swapper/300:38:043
194262740,0sleep00-21swapper/022:14:030
279692550,1sleep229-21rcuc/200:36:312
6548994223,17cyclictest0-21swapper/121:35:121
29972240,1sleep10-21swapper/121:56:091
29972240,1sleep10-21swapper/121:56:081
655099210,2cyclictest0-21swapper/322:35:113
654999210,19cyclictest0-21swapper/200:05:092
654799211,18cyclictest0-21swapper/020:25:110
654799210,19cyclictest0-21swapper/000:15:140
654999201,17cyclictest19596-21ssh23:55:112
654899200,18cyclictest0-21swapper/119:10:121
654899190,17cyclictest0-21swapper/100:35:121
654999180,16cyclictest0-21swapper/220:10:122
654799180,16cyclictest0-21swapper/020:55:100
6550991714,2cyclictest0-21swapper/321:35:123
654799161,13cyclictest5223-21ssh22:32:190
6547991611,3cyclictest0-21swapper/021:10:150
655099150,3cyclictest1985-21munin-run22:30:003
654999151,12cyclictest0-21swapper/221:30:222
6549991510,3cyclictest3649-21snmpd22:15:322
6549991510,3cyclictest24419-21ssh00:00:122
6549991510,3cyclictest21585-21sh23:23:132
6549991510,3cyclictest18485-21sh21:39:442
6549991510,3cyclictest0-21swapper/221:26:102
654999150,13cyclictest22007-21taskset00:30:202
654999150,13cyclictest0-21swapper/222:43:122
6548991510,3cyclictest0-21swapper/121:25:141
654899150,3cyclictest0-21swapper/123:36:031
654899150,10cyclictest0-21swapper/123:41:041
654799151,12cyclictest8961-21ssh21:29:520
6547991510,3cyclictest0-21swapper/021:47:080
654799150,13cyclictest9447-21ssh22:03:270
654799150,13cyclictest16923-21ssh23:18:270
655099142,7cyclictest19283-21ssh23:54:593
655099141,3cyclictest21636-21irqstats00:30:163
654999149,3cyclictest3649-21snmpd23:25:462
654999149,3cyclictest0-21swapper/219:50:012
6549991411,2cyclictest0-21swapper/223:36:332
6549991411,2cyclictest0-21swapper/222:11:512
6549991410,2cyclictest0-21swapper/221:45:172
654999140,2cyclictest3383-21ssh21:23:522
654999140,2cyclictest0-21swapper/223:16:112
654999140,2cyclictest0-21swapper/222:02:212
654999140,13cyclictest0-21swapper/223:09:522
654999140,13cyclictest0-21swapper/222:48:522
654999140,12cyclictest3822-21ssh21:57:212
654999140,12cyclictest3822-21ssh21:57:212
654999140,12cyclictest0-21swapper/223:48:052
654899149,3cyclictest0-21swapper/122:40:161
654899142,6cyclictest0-21swapper/122:45:011
654899141,3cyclictest0-21swapper/120:36:051
654899141,11cyclictest0-21swapper/119:40:161
654899140,13cyclictest0-21swapper/122:10:181
654899140,13cyclictest0-21swapper/119:35:161
654899140,12cyclictest22432-21diskmemload23:10:121
654899140,12cyclictest22432-21diskmemload21:46:041
654899140,12cyclictest0-21swapper/121:21:031
654799142,7cyclictest0-21swapper/000:15:010
654799141,2cyclictest0-21swapper/023:47:320
6547991411,2cyclictest0-21swapper/021:42:080
654799140,2cyclictest0-21swapper/023:54:180
654799140,2cyclictest0-21swapper/021:39:380
654799140,12cyclictest22432-21diskmemload22:42:470
654799140,12cyclictest0-21swapper/022:55:190
655099138,3cyclictest0-21swapper/321:49:523
6550991310,2cyclictest0-21swapper/322:15:303
655099130,2cyclictest20275-21ssh00:29:303
655099130,2cyclictest0-21swapper/319:30:193
6549991310,2cyclictest323-21ssh22:27:252
6549991310,2cyclictest0-21swapper/223:42:102
6549991310,2cyclictest0-21swapper/223:03:242
6549991310,2cyclictest0-21swapper/221:00:172
654999130,2cyclictest0-21swapper/223:51:252
654999130,2cyclictest0-21swapper/222:53:192
654999130,2cyclictest0-21swapper/222:37:402
654999130,2cyclictest0-21swapper/222:30:322
654999130,2cyclictest0-21swapper/200:17:042
654999130,12cyclictest0-21swapper/222:24:522
654999130,12cyclictest0-21swapper/221:52:512
654999130,12cyclictest0-21swapper/219:40:122
654999130,12cyclictest0-21swapper/200:25:152
654999130,11cyclictest22432-21diskmemload23:30:372
654899138,4cyclictest207150irq/24-eth123:27:301
654899133,8cyclictest30979-21dpkg20:10:111
654899132,7cyclictest22432-21diskmemload21:45:001
654899131,6cyclictest0-21swapper/123:09:591
654899131,3cyclictest0-21swapper/122:15:171
654899131,10cyclictest0-21swapper/123:30:061
6548991310,2cyclictest24552-21kworker/u8:100:03:051
6548991310,2cyclictest0-21swapper/123:55:171
6548991310,2cyclictest0-21swapper/120:15:201
654899130,12cyclictest0-21swapper/123:45:131
654899130,11cyclictest0-21swapper/121:10:121
654899130,11cyclictest0-21swapper/100:10:401
6547991310,2cyclictest20055-21ssh22:47:580
6547991310,2cyclictest0-21swapper/023:26:180
6547991310,2cyclictest0-21swapper/023:05:470
6547991310,2cyclictest0-21swapper/023:03:080
6547991310,2cyclictest0-21swapper/022:25:290
6547991310,2cyclictest0-21swapper/021:55:180
6547991310,2cyclictest0-21swapper/021:55:170
6547991310,2cyclictest0-21swapper/021:05:290
6547991310,2cyclictest0-21swapper/019:30:170
6547991310,2cyclictest0-21swapper/000:25:190
654799130,2cyclictest22432-21diskmemload22:05:580
654799130,2cyclictest0-21swapper/023:44:170
654799130,2cyclictest0-21swapper/023:20:140
654799130,2cyclictest0-21swapper/000:06:470
654799130,1cyclictest0-21swapper/000:01:480
654799130,12cyclictest0-21swapper/023:10:480
654799130,12cyclictest0-21swapper/022:50:370
654799130,12cyclictest0-21swapper/021:52:480
654799130,12cyclictest0-21swapper/020:35:190
654799130,12cyclictest0-21swapper/000:35:380
654799130,11cyclictest24550-21kworker/u8:123:30:040
654799130,11cyclictest0-21swapper/022:17:490
654799130,11cyclictest0-21swapper/021:21:570
300762130,2sleep20-21swapper/221:17:302
206742130,2sleep00-21swapper/023:55:200
175162130,2sleep30-21swapper/323:19:243
94362120,1sleep00-21swapper/021:30:090
655099122,6cyclictest0-21swapper/323:25:003
655099122,6cyclictest0-21swapper/320:29:593
655099122,5cyclictest0-21swapper/320:20:003
655099122,5cyclictest0-21swapper/320:04:593
655099121,6cyclictest0-21swapper/322:35:013
655099120,2cyclictest22432-21diskmemload00:12:503
655099120,2cyclictest0-21swapper/321:31:003
655099120,2cyclictest0-21swapper/300:19:353
655099120,11cyclictest0-21swapper/321:25:383
655099120,10cyclictest0-21swapper/321:23:403
654999129,2cyclictest26503-21apt-get22:55:122
654999129,2cyclictest0-21swapper/220:21:012
654999129,2cyclictest0-21swapper/200:21:132
654999128,2cyclictest0-21swapper/220:01:012
654999123,6cyclictest0-21swapper/220:40:112
654999120,2cyclictest0-21swapper/222:05:132
654999120,2cyclictest0-21swapper/220:15:142
654999120,2cyclictest0-21swapper/220:05:122
654999120,2cyclictest0-21swapper/219:21:052
654999120,2cyclictest0-21swapper/200:11:012
654999120,11cyclictest0-21swapper/223:10:412
654999120,11cyclictest0-21swapper/221:40:152
654999120,11cyclictest0-21swapper/221:10:162
654999120,11cyclictest0-21swapper/220:56:002
654999120,11cyclictest0-21swapper/220:50:172
654999120,11cyclictest0-21swapper/220:30:142
654999120,11cyclictest0-21swapper/219:55:202
654999120,11cyclictest0-21swapper/219:45:502
654899129,2cyclictest0-21swapper/121:31:211
654899129,2cyclictest0-21swapper/120:55:121
654899129,2cyclictest0-21swapper/119:30:191
654899121,9cyclictest20909-21apt-get00:30:111
654899121,9cyclictest13429-21apt-get23:15:111
654899121,9cyclictest0-21swapper/120:05:141
654899121,3cyclictest0-21swapper/119:16:011
654899121,2cyclictest0-21swapper/120:45:171
654899120,2cyclictest0-21swapper/120:00:491
654899120,11cyclictest0-21swapper/123:23:581
654899120,11cyclictest0-21swapper/122:20:181
654899120,11cyclictest0-21swapper/120:50:151
654899120,11cyclictest0-21swapper/119:55:301
654899120,11cyclictest0-21swapper/100:05:131
654899120,10cyclictest0-21swapper/121:15:051
654799129,2cyclictest0-21swapper/000:20:580
654799122,7cyclictest0-21swapper/021:18:020
654799120,2cyclictest0-21swapper/023:36:010
654799120,11cyclictest0-21swapper/022:20:380
654799120,11cyclictest0-21swapper/020:41:010
654799120,11cyclictest0-21swapper/019:55:510
654799120,11cyclictest0-21swapper/019:40:110
654799120,11cyclictest0-21swapper/000:30:010
306982120,2sleep10-21swapper/122:59:351
302962120,2sleep330307-21ssh21:17:513
115732120,2sleep00-21swapper/019:20:180
655099118,2cyclictest0-21swapper/323:40:193
655099118,2cyclictest0-21swapper/322:52:183
655099118,2cyclictest0-21swapper/319:40:193
655099116,3cyclictest0-21swapper/320:51:023
655099116,3cyclictest0-21swapper/319:25:113
655099112,5cyclictest0-21swapper/320:11:003
655099112,5cyclictest0-21swapper/320:00:003
655099111,8cyclictest28685-21ssh00:04:423
655099111,8cyclictest22432-21diskmemload21:12:593
655099111,5cyclictest22731-21copy19:49:593
655099110,9cyclictest29681-21timerandwakeup23:31:053
655099110,9cyclictest0-21swapper/323:56:273
655099110,9cyclictest0-21swapper/321:55:133
655099110,9cyclictest0-21swapper/321:55:133
655099110,2cyclictest22432-21diskmemload22:09:103
655099110,2cyclictest0-21swapper/322:57:583
655099110,10cyclictest0-21swapper/322:47:483
655099110,10cyclictest0-21swapper/321:42:173
654999118,2cyclictest0-21swapper/219:11:022
654999113,5cyclictest0-21swapper/219:31:022
654999111,5cyclictest0-21swapper/221:10:002
654999110,10cyclictest0-21swapper/220:39:352
654899118,2cyclictest22432-21diskmemload22:05:101
654899118,2cyclictest21209-21kworker/u8:022:51:041
654899118,2cyclictest0-21swapper/119:45:131
654899116,3cyclictest0-21swapper/121:05:161
654899111,8cyclictest0-21swapper/121:51:031
654899111,8cyclictest0-21swapper/121:00:161
654899111,8cyclictest0-21swapper/119:50:191
654899111,8cyclictest0-21swapper/119:20:171
654899111,8cyclictest0-21swapper/100:20:121
654899111,3cyclictest0-21swapper/123:01:041
654899111,3cyclictest0-21swapper/122:30:151
654899111,2cyclictest0-21swapper/119:25:101
654899110,7cyclictest0-21swapper/120:25:081
654899110,3cyclictest6891-21df_abs00:15:161
654899110,2cyclictest0-21swapper/120:40:161
654899110,10cyclictest0-21swapper/123:52:171
654899110,10cyclictest0-21swapper/122:25:171
654799118,2cyclictest0-21swapper/020:10:140
654799118,2cyclictest0-21swapper/019:50:160
654799111,6cyclictest0-21swapper/020:50:150
654799110,10cyclictest0-21swapper/021:00:140
63402111,7sleep16513-21perl22:00:141
655099107,2cyclictest0-21swapper/322:21:493
655099106,2cyclictest22432-21diskmemload22:03:113
655099105,3cyclictest5414-21mailstats23:06:013
655099105,3cyclictest24131-1kworker/u9:223:02:143
655099105,3cyclictest22026-21grep21:06:043
655099101,7cyclictest0-21swapper/323:26:013
655099100,8cyclictest22432-21diskmemload23:10:233
655099100,6cyclictest0-21swapper/319:11:003
654999107,2cyclictest0-21swapper/219:25:012
654999107,2cyclictest0-21swapper/219:15:022
654999102,6cyclictest0-21swapper/220:45:102
654899107,2cyclictest0-21swapper/120:30:161
654899101,3cyclictest0-21swapper/120:20:151
654899100,2cyclictest0-21swapper/100:25:121
654799105,3cyclictest18040-21sort19:36:030
654799104,4cyclictest10633-21wc19:20:000
654799102,7cyclictest0-21swapper/019:11:590
654799102,5cyclictest0-21swapper/020:01:010
654799101,6cyclictest6785-21apt-get20:30:100
654799100,9cyclictest0-21swapper/020:48:590
654799100,9cyclictest0-21swapper/019:29:560
146552100,2sleep30-21swapper/322:42:013
7789290,2sleep30-21swapper/320:30:243
65509994,3cyclictest9955-21ssh23:45:053
65509994,3cyclictest8803-21tr20:35:133
65509994,3cyclictest396-21egrep23:35:143
65509994,3cyclictest29683-21fschecks_time00:05:113
65509994,3cyclictest29191-21cpuspeed_turbos20:05:123
65509994,3cyclictest23187-21cpuspeed_turbos19:50:143
65509994,3cyclictest18232-21grep19:36:033
65509994,3cyclictest15577-21aten2.4_r3power22:10:103
65509994,3cyclictest12582-21cron19:25:003
65509994,3cyclictest12121-21sshd20:42:153
65509990,6cyclictest0-21swapper/321:01:003
65499994,3cyclictest5617-21needreboot20:25:152
65499994,3cyclictest17561-21latency19:35:162
65479994,3cyclictest29092-21tail20:05:100
65479990,8cyclictest0-21swapper/020:16:090
65479990,8cyclictest0-21swapper/019:46:590
4403290,2sleep00-21swapper/020:23:280
65509985,2cyclictest0-21swapper/319:15:113
65509983,3cyclictest16702-21aten2.4-expect20:55:123
65509983,3cyclictest12686-21tail20:45:133
65509981,5cyclictest0-21swapper/320:20:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional