You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 10:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Fri Mar 13, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21799211596,14sleep10-21swapper/119:06:201
21972211296,11sleep30-21swapper/319:08:343
21912210479,6sleep00-21swapper/019:07:470
21800210379,6sleep20-21swapper/219:06:212
146002850,0sleep20-21swapper/223:29:242
270902760,0sleep10-21swapper/119:20:131
131852710,0sleep00-21swapper/021:16:030
111422290,0sleep10-21swapper/122:52:201
2211299200,2cyclictest0-21swapper/019:40:110
2211299190,18cyclictest0-21swapper/019:30:120
22118991815,2cyclictest14142-21kworker/u8:220:47:043
2211299180,16cyclictest0-21swapper/023:35:100
22116991714,2cyclictest24699-21kworker/u8:121:34:042
2211699171,13cyclictest3247-21apt-get22:45:122
22113991712,4cyclictest3134-21kworker/u8:223:07:041
88702160,1sleep121-21rcuc/121:11:591
22118991613,2cyclictest25914-21kworker/u8:020:42:043
22116991613,2cyclictest3725-21kworker/u8:022:18:042
22116991613,2cyclictest3134-21kworker/u8:222:58:042
22116991613,2cyclictest31060-21kworker/u8:221:42:042
22116991613,2cyclictest24174-21kworker/u8:122:42:042
22116991613,2cyclictest18562-21kworker/u8:122:04:042
2211699161,13cyclictest0-21swapper/222:36:522
2211699160,2cyclictest0-21swapper/219:40:122
2211299160,11cyclictest0-21swapper/023:46:040
2211899151,3cyclictest5371-21ssh22:46:043
2211899151,3cyclictest0-21swapper/300:00:183
22118991512,2cyclictest31060-21kworker/u8:221:36:013
2211899151,12cyclictest3799-21ssh00:23:453
2211699151,3cyclictest0-21swapper/221:00:132
2211699151,3cyclictest0-21swapper/219:55:142
22116991512,2cyclictest5560-21kworker/u8:021:49:042
22116991512,2cyclictest3545-21kworker/u8:121:10:042
22116991512,2cyclictest3545-21kworker/u8:121:08:042
22116991512,2cyclictest3545-21kworker/u8:121:08:042
22116991512,2cyclictest30125-21kworker/u8:020:54:042
22116991512,2cyclictest25914-21kworker/u8:020:43:042
22116991512,2cyclictest13001-21kworker/u8:321:51:042
22116991512,2cyclictest1033-21kworker/u8:019:47:042
22116991512,2cyclictest1033-21kworker/u8:019:36:042
2211699151,12cyclictest22355-21apt-get19:10:102
2211699151,12cyclictest10738-21ssh22:51:432
22116991510,3cyclictest857-21ssh22:10:072
22116991510,3cyclictest0-21swapper/221:28:472
22113991512,2cyclictest18665-21kworker/u8:222:30:041
2211399150,14cyclictest0-21swapper/119:25:171
2211299151,12cyclictest26158-21apt-get19:20:060
22118991411,2cyclictest0-21swapper/323:40:003
22118991411,2cyclictest0-21swapper/323:21:193
2211899140,13cyclictest0-21swapper/323:51:303
2211899140,13cyclictest0-21swapper/323:16:003
2211899140,12cyclictest16132-21ssh21:51:583
2211899140,12cyclictest0-21swapper/323:55:113
2211899140,12cyclictest0-21swapper/323:40:173
2211899140,12cyclictest0-21swapper/322:31:023
2211899140,12cyclictest0-21swapper/300:15:043
2211699149,3cyclictest21153-21ssh00:08:262
22116991411,2cyclictest7753-21ssh00:27:082
22116991411,2cyclictest5560-21kworker/u8:022:05:042
22116991411,2cyclictest27560-21kworker/u8:100:21:042
22116991411,2cyclictest22299-21kworker/u8:120:37:042
22116991411,2cyclictest14142-21kworker/u8:220:49:042
22116991411,2cyclictest14142-21kworker/u8:220:29:042
22116991411,2cyclictest11855-21kworker/u8:020:13:042
22116991411,2cyclictest11855-21kworker/u8:020:04:042
22116991411,2cyclictest1033-21kworker/u8:019:53:042
22116991410,2cyclictest11163-21ssh21:15:072
2211699140,2cyclictest9808-21ssh23:24:382
2211699140,2cyclictest5945-21diskmemload23:40:282
2211699140,13cyclictest0-21swapper/200:00:182
2211699140,12cyclictest2773-21ssh23:16:472
2211699140,12cyclictest0-21swapper/223:11:052
2211699140,12cyclictest0-21swapper/200:12:232
22113991411,2cyclictest5945-21diskmemload22:29:071
22113991411,2cyclictest20569-21kworker/u8:000:08:051
22113991411,2cyclictest0-21swapper/121:21:571
22113991411,2cyclictest0-21swapper/120:50:101
22113991411,2cyclictest0-21swapper/120:15:111
2211399141,11cyclictest3728-21runrttasks23:56:531
2211399140,2cyclictest0-21swapper/120:47:041
2211399140,12cyclictest24684-21ssh21:28:251
2211399140,12cyclictest18486-21apt-get21:55:111
2211399140,12cyclictest0-21swapper/122:14:361
2211399140,12cyclictest0-21swapper/121:05:141
2211399140,12cyclictest0-21swapper/121:05:131
2211399140,12cyclictest0-21swapper/119:40:511
2211399140,12cyclictest0-21swapper/100:15:111
22112991411,2cyclictest0-21swapper/000:14:480
2211299140,2cyclictest0-21swapper/023:51:480
2211299140,2cyclictest0-21swapper/022:50:180
2211299140,2cyclictest0-21swapper/000:20:380
2211299140,12cyclictest0-21swapper/022:31:040
2211299140,12cyclictest0-21swapper/021:46:000
204192140,2sleep00-21swapper/023:01:460
2211899139,2cyclictest9795-21rm21:45:293
2211899139,2cyclictest2193-21tr21:00:133
2211899131,3cyclictest15795-21ssh21:19:573
22118991310,2cyclictest0-21swapper/323:31:043
22118991310,2cyclictest0-21swapper/323:25:343
22118991310,2cyclictest0-21swapper/300:28:543
22118991310,2cyclictest0-21swapper/300:10:293
2211899130,2cyclictest0-21swapper/322:55:513
2211899130,2cyclictest0-21swapper/322:43:003
2211899130,2cyclictest0-21swapper/300:32:113
2211899130,2cyclictest0-21swapper/300:32:103
2211899130,12cyclictest0-21swapper/323:05:403
2211899130,12cyclictest0-21swapper/323:02:103
2211899130,12cyclictest0-21swapper/322:53:393
2211899130,12cyclictest0-21swapper/321:24:593
22116991310,2cyclictest23956-21kworker/u8:219:25:042
22116991310,2cyclictest22190-21kworker/u8:200:32:042
22116991310,2cyclictest22190-21kworker/u8:200:32:042
22116991310,2cyclictest19891-21ssh21:55:472
22116991310,2cyclictest17124-21kworker/u8:000:38:042
22116991310,2cyclictest14142-21kworker/u8:220:15:042
22116991310,2cyclictest0-21swapper/223:51:502
22116991310,2cyclictest0-21swapper/223:30:462
22116991310,2cyclictest0-21swapper/223:08:122
22116991310,2cyclictest0-21swapper/223:01:082
22116991310,2cyclictest0-21swapper/220:31:042
2211699130,3cyclictest23033-21rm22:31:222
2211699130,2cyclictest5945-21diskmemload00:16:032
2211699130,12cyclictest0-21swapper/223:49:282
2211699130,12cyclictest0-21swapper/223:36:482
2211699130,12cyclictest0-21swapper/222:21:582
2211399132,9cyclictest12626-21smartctl22:21:001
2211399131,3cyclictest30722-21apt-get22:40:111
22113991310,2cyclictest0-21swapper/123:37:461
22113991310,2cyclictest0-21swapper/123:30:291
22113991310,2cyclictest0-21swapper/122:35:151
22113991310,2cyclictest0-21swapper/122:04:471
22113991310,2cyclictest0-21swapper/121:15:161
22113991310,2cyclictest0-21swapper/119:55:191
22113991310,2cyclictest0-21swapper/100:35:471
22113991310,2cyclictest0-21swapper/100:30:141
22113991310,2cyclictest0-21swapper/100:30:141
2211399130,2cyclictest0-21swapper/123:26:051
2211399130,2cyclictest0-21swapper/123:00:411
2211399130,2cyclictest0-21swapper/119:30:161
2211399130,2cyclictest0-21swapper/100:12:111
2211399130,12cyclictest5945-21diskmemload22:55:521
2211399130,12cyclictest5945-21diskmemload00:21:011
2211399130,12cyclictest0-21swapper/123:47:541
2211399130,12cyclictest0-21swapper/123:44:551
2211399130,12cyclictest0-21swapper/122:48:461
2211399130,12cyclictest0-21swapper/122:15:111
2211399130,12cyclictest0-21swapper/121:51:021
2211399130,12cyclictest0-21swapper/121:40:271
22112991310,2cyclictest0-21swapper/023:55:130
22112991310,2cyclictest0-21swapper/022:48:280
22112991310,2cyclictest0-21swapper/022:37:020
22112991310,2cyclictest0-21swapper/022:20:000
22112991310,2cyclictest0-21swapper/022:11:500
22112991310,2cyclictest0-21swapper/022:00:590
22112991310,2cyclictest0-21swapper/021:52:480
22112991310,2cyclictest0-21swapper/021:42:540
22112991310,2cyclictest0-21swapper/021:35:490
22112991310,2cyclictest0-21swapper/021:12:570
2211299130,2cyclictest0-21swapper/023:30:160
2211299130,2cyclictest0-21swapper/023:14:380
2211299130,2cyclictest0-21swapper/022:56:280
2211299130,2cyclictest0-21swapper/022:25:200
2211299130,2cyclictest0-21swapper/021:27:480
2211299130,2cyclictest0-21swapper/021:20:350
2211299130,2cyclictest0-21swapper/000:05:080
2211299130,12cyclictest0-21swapper/023:29:170
2211299130,12cyclictest0-21swapper/023:21:380
2211299130,12cyclictest0-21swapper/022:07:130
2211299130,12cyclictest0-21swapper/021:57:100
2211299130,12cyclictest0-21swapper/000:30:380
2211299130,12cyclictest0-21swapper/000:30:380
2211299130,12cyclictest0-21swapper/000:26:280
2211299130,11cyclictest27133-21apt-get00:15:050
11102130,2sleep10-21swapper/121:36:571
287962120,2sleep02211299cyclictest20:45:140
2211899129,2cyclictest881-21kworker/u8:119:31:043
2211899129,2cyclictest10953-21ssh22:20:093
2211899129,2cyclictest0-21swapper/323:11:563
2211899129,2cyclictest0-21swapper/322:02:283
2211899120,3cyclictest10303-21diskmemload21:14:093
2211899120,2cyclictest0-21swapper/322:35:463
2211899120,2cyclictest0-21swapper/300:35:023
2211899120,2cyclictest0-21swapper/300:05:413
2211899120,11cyclictest18665-21kworker/u8:222:28:043
2211899120,11cyclictest0-21swapper/323:45:053
2211899120,10cyclictest4592-21diskstats19:45:133
2211699129,2cyclictest3545-21kworker/u8:121:20:042
2211699129,2cyclictest0-21swapper/223:55:132
2211699122,7cyclictest0-21swapper/220:22:592
2211699120,11cyclictest26296-21copy19:20:012
2211699120,11cyclictest0-21swapper/222:25:502
2211699120,11cyclictest0-21swapper/221:36:382
2211399129,2cyclictest0-21swapper/122:05:151
2211399129,2cyclictest0-21swapper/121:49:131
2211399122,9cyclictest26820-21kworker/1:021:00:141
2211399120,2cyclictest0-21swapper/121:34:401
2211399120,2cyclictest0-21swapper/100:25:431
2211399120,2cyclictest0-21swapper/100:00:031
2211399120,11cyclictest0-21swapper/123:51:011
2211399120,11cyclictest0-21swapper/123:23:071
2211399120,11cyclictest0-21swapper/123:15:131
2211399120,11cyclictest0-21swapper/120:55:171
2211399120,11cyclictest0-21swapper/120:55:171
2211299129,2cyclictest22327-21munin-node0
2211299129,2cyclictest14914-21apt-get00:35:120
2211299129,2cyclictest0-21swapper/023:40:010
2211299129,2cyclictest0-21swapper/023:15:530
2211299129,2cyclictest0-21swapper/022:41:450
2211299129,2cyclictest0-21swapper/021:30:060
2211299122,7cyclictest0-21swapper/023:06:590
2211299122,7cyclictest0-21swapper/019:18:590
2211299120,7cyclictest0-21swapper/000:00:040
2211299120,2cyclictest0-21swapper/020:40:140
2211299120,2cyclictest0-21swapper/020:15:150
2211299120,2cyclictest0-21swapper/019:25:090
2211299120,11cyclictest0-21swapper/022:15:540
2211299120,11cyclictest0-21swapper/021:00:070
2211299120,11cyclictest0-21swapper/020:51:050
2211299120,11cyclictest0-21swapper/019:55:190
2211899118,2cyclictest0-21swapper/322:13:583
2211899118,2cyclictest0-21swapper/322:07:283
2211899118,2cyclictest0-21swapper/321:56:393
2211899110,3cyclictest0-21swapper/319:40:123
2211699118,2cyclictest881-21kworker/u8:119:32:042
2211699118,2cyclictest0-21swapper/219:16:002
2211699110,10cyclictest0-21swapper/220:59:212
2211699110,10cyclictest0-21swapper/220:59:212
2211399118,2cyclictest0-21swapper/120:05:291
2211399118,2cyclictest0-21swapper/119:50:001
2211399118,2cyclictest0-21swapper/119:45:111
2211399110,9cyclictest0-21swapper/120:25:111
2211399110,3cyclictest0-21swapper/120:35:151
2211399110,3cyclictest0-21swapper/120:20:141
2211299118,2cyclictest0-21swapper/020:39:210
2211299118,2cyclictest0-21swapper/020:05:130
289582100,2sleep30-21swapper/321:32:263
2211899104,4cyclictest274-21jbd2/sda1-819:35:153
2211899100,9cyclictest0-21swapper/321:28:203
2211899100,8cyclictest5865-21ssh21:41:243
2211399106,3cyclictest28197-21cat20:45:001
2211399100,9cyclictest12-21rcu_preempt20:10:101
2211399100,9cyclictest0-21swapper/119:35:131
2211399100,9cyclictest0-21swapper/119:10:111
2211399100,8cyclictest0-21swapper/119:15:131
2211399100,3cyclictest28242-21df_inode23:10:121
2211399100,2cyclictest0-21swapper/120:30:131
2211399100,2cyclictest0-21swapper/120:00:111
2211299100,8cyclictest0-21swapper/020:25:000
2211299100,7cyclictest0-21swapper/019:12:590
7959290,2sleep30-21swapper/319:54:383
221189996,2cyclictest25630-21cat20:36:043
221189990,7cyclictest0-21swapper/319:10:113
221189990,2cyclictest0-21swapper/320:27:193
221169994,3cyclictest3158-21dbus-daemon20:05:302
221129996,2cyclictest0-21swapper/020:00:160
221129994,3cyclictest5948-21apt21:10:000
221129994,3cyclictest5948-21apt21:10:000
221129992,6cyclictest0-21swapper/019:48:590
221129991,6cyclictest0-21swapper/020:10:310
15797290,2sleep30-21swapper/320:11:523
221189985,2cyclictest28484-21basename19:25:123
221189985,2cyclictest0-21swapper/320:34:493
221189985,2cyclictest0-21swapper/320:04:593
221189985,2cyclictest0-21swapper/319:21:013
221189984,3cyclictest25052-21kernelversion19:15:163
221189984,3cyclictest16835-21gltestperf20:15:153
221189983,3cyclictest8360-21cut19:55:133
221189981,3cyclictest30571-21munin-node3
221189980,7cyclictest0-21swapper/322:15:073
221189980,6cyclictest758-21sed20:55:173
221189980,6cyclictest758-21sed20:55:163
221189980,2cyclictest0-21swapper/320:22:593
221189980,2cyclictest0-21swapper/320:05:133
221129985,2cyclictest0-21swapper/019:35:250
221129983,3cyclictest1027-21mailstats20:56:010
221129983,3cyclictest1027-21mailstats20:56:010
221129980,6cyclictest0-21swapper/020:27:590
221189970,6cyclictest4038-21chrt21:05:043
221189970,6cyclictest4038-21chrt21:05:043
221129970,2cyclictest0-21swapper/019:50:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional