You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sat Apr 04, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
81712115104,6sleep20-21swapper/219:09:472
8029211099,6sleep00-21swapper/019:07:560
8172210796,6sleep30-21swapper/319:09:483
6402210796,6sleep10-21swapper/119:05:091
296382880,0sleep10-21swapper/123:29:401
250242720,0sleep10-21swapper/119:50:141
265482700,1sleep011-21rcuc/000:00:020
143152680,0sleep10-21swapper/122:40:011
246222530,1sleep30-21swapper/319:50:133
822099381,35cyclictest23171-21ssh00:30:112
822199360,2cyclictest0-21swapper/322:15:113
8218992925,2cyclictest0-21swapper/021:35:100
821899221,19cyclictest0-21swapper/021:00:110
822099210,2cyclictest0-21swapper/220:40:102
822099210,19cyclictest0-21swapper/223:55:112
821899210,19cyclictest0-21swapper/023:55:100
191282210,1sleep10-21swapper/122:45:031
821899200,2cyclictest0-21swapper/021:05:100
821899180,16cyclictest0-21swapper/019:10:120
8220991714,2cyclictest0-21swapper/219:40:122
821899170,12cyclictest0-21swapper/021:57:050
8221991612,3cyclictest13145-21kworker/u8:222:27:043
8221991611,3cyclictest0-21swapper/320:20:173
822099162,12cyclictest13317-21switchtime21:31:032
8220991611,3cyclictest1804-21ssh21:20:122
8219991612,2cyclictest207150irq/24-eth122:50:111
821999160,3cyclictest4808-21ssh22:30:111
821899161,3cyclictest0-21swapper/022:58:190
821899161,13cyclictest0-21swapper/020:30:130
821899160,14cyclictest0-21swapper/021:43:510
8221991512,2cyclictest0-21swapper/319:35:593
822199151,12cyclictest10779-21ssh21:29:123
822199150,13cyclictest18030-21egrep22:10:133
822099150,13cyclictest5790-21sed20:21:042
822099150,13cyclictest0-21swapper/221:50:112
822099150,13cyclictest0-21swapper/221:50:102
821999151,3cyclictest30898-21sed20:05:151
8219991510,3cyclictest24244-21diskmemload00:06:061
8219991510,3cyclictest18062-21switchtime21:36:011
8219991510,3cyclictest0-21swapper/123:14:201
821899151,12cyclictest28362-21fschecks_count00:35:150
821899151,12cyclictest18997-21ssh00:25:150
8218991510,3cyclictest21980-21awk19:41:020
8218991510,3cyclictest13208-21sendmail_mailtr21:31:000
8218991510,3cyclictest0-21swapper/023:19:400
8218991510,3cyclictest0-21swapper/021:18:130
83842140,2sleep00-21swapper/022:33:370
822199149,3cyclictest2533-21ssh00:08:333
822199142,7cyclictest0-21swapper/319:35:003
8221991411,2cyclictest0-21swapper/323:55:013
822199141,11cyclictest32364-21ssh21:17:343
822199140,12cyclictest25554-21ssh21:44:393
822199140,12cyclictest0-21swapper/321:50:133
822199140,12cyclictest0-21swapper/321:50:123
822199140,12cyclictest0-21swapper/300:25:103
822099140,13cyclictest24244-21diskmemload23:38:582
822099140,12cyclictest0-21swapper/200:20:172
822099140,12cyclictest0-21swapper/200:03:542
821999149,3cyclictest3626-21sh23:01:451
821999143,3cyclictest2850-21rsyslogd20:14:591
821999141,2cyclictest0-21swapper/122:15:101
8219991411,2cyclictest0-21swapper/123:52:251
8219991411,2cyclictest0-21swapper/100:28:061
821999140,2cyclictest0-21swapper/123:21:061
821899149,3cyclictest1797-21ssh21:20:100
8218991411,2cyclictest6922-21kworker/u8:223:49:050
8218991411,2cyclictest25698-21kworker/u8:022:23:050
8218991411,2cyclictest0-21swapper/023:26:020
8218991410,2cyclictest12472-21apt-get19:20:120
821899140,3cyclictest27221-21ssh22:53:030
821899140,3cyclictest24270-21switchtime22:16:010
821899140,12cyclictest0-21swapper/021:47:390
821899140,12cyclictest0-21swapper/000:10:590
822199138,3cyclictest19237-21sed20:55:163
822199138,3cyclictest16687-21ssh22:08:463
8221991310,2cyclictest0-21swapper/323:30:273
8221991310,2cyclictest0-21swapper/321:23:103
8221991310,2cyclictest0-21swapper/319:10:123
8221991310,2cyclictest0-21swapper/300:30:123
822199130,2cyclictest0-21swapper/323:46:043
822199130,12cyclictest24244-21diskmemload22:55:193
822199130,12cyclictest0-21swapper/322:42:503
822199130,12cyclictest0-21swapper/322:30:103
822199130,12cyclictest0-21swapper/322:22:133
822199130,12cyclictest0-21swapper/321:30:143
822199130,12cyclictest0-21swapper/321:00:133
822199130,12cyclictest0-21swapper/300:00:123
822199130,11cyclictest0-21swapper/323:41:373
822199130,11cyclictest0-21swapper/323:11:513
8220991310,2cyclictest0-21swapper/223:49:132
8220991310,2cyclictest0-21swapper/223:43:332
8220991310,2cyclictest0-21swapper/223:22:392
8220991310,2cyclictest0-21swapper/222:55:142
8220991310,2cyclictest0-21swapper/222:44:522
8220991310,2cyclictest0-21swapper/221:10:342
8220991310,2cyclictest0-21swapper/221:05:172
822099130,6cyclictest0-21swapper/220:18:582
822099130,2cyclictest0-21swapper/223:05:072
822099130,2cyclictest0-21swapper/222:05:152
822099130,2cyclictest0-21swapper/221:17:112
822099130,2cyclictest0-21swapper/219:45:112
822099130,2cyclictest0-21swapper/219:25:142
822099130,11cyclictest24244-21diskmemload00:15:042
821999138,3cyclictest9600-21dpkg22:35:111
821999138,3cyclictest0-21swapper/119:15:161
821999137,4cyclictest274-21jbd2/sda1-819:10:121
821999131,3cyclictest0-21swapper/121:06:021
8219991311,1cyclictest207150irq/24-eth123:40:451
8219991310,2cyclictest0-21swapper/122:26:181
8219991310,2cyclictest0-21swapper/122:05:161
8219991310,2cyclictest0-21swapper/121:18:551
8219991310,2cyclictest0-21swapper/120:35:161
8219991310,2cyclictest0-21swapper/100:12:161
821999130,2cyclictest24244-21diskmemload22:57:311
821999130,2cyclictest24244-21diskmemload00:19:301
821999130,12cyclictest0-21swapper/123:07:071
821999130,12cyclictest0-21swapper/122:13:361
821999130,12cyclictest0-21swapper/121:57:061
821999130,12cyclictest0-21swapper/121:40:181
821999130,12cyclictest0-21swapper/121:13:211
821999130,11cyclictest24244-21diskmemload00:01:401
821999130,11cyclictest0-21swapper/121:32:251
821899138,3cyclictest10603-21munin-node0
821899132,6cyclictest0-21swapper/022:00:000
821899132,6cyclictest0-21swapper/020:25:000
821899131,6cyclictest0-21swapper/020:15:000
8218991310,2cyclictest0-21swapper/023:52:070
8218991310,2cyclictest0-21swapper/023:41:010
8218991310,2cyclictest0-21swapper/023:07:340
8218991310,2cyclictest0-21swapper/021:10:190
821899130,2cyclictest0-21swapper/019:56:020
821899130,2cyclictest0-21swapper/000:06:570
821899130,12cyclictest0-21swapper/022:36:420
821899130,12cyclictest0-21swapper/000:33:410
821899130,12cyclictest0-21swapper/000:22:110
821899130,11cyclictest12950-21ssh23:11:040
821899130,11cyclictest0-21swapper/023:30:020
231202130,2sleep10-21swapper/123:55:391
191402130,2sleep20-21swapper/223:18:152
822199129,2cyclictest0-21swapper/323:16:023
822199129,2cyclictest0-21swapper/323:05:053
822199129,2cyclictest0-21swapper/321:55:353
822199129,2cyclictest0-21swapper/321:35:303
822199129,2cyclictest0-21swapper/320:41:033
822199127,3cyclictest11010-21ethtool20:35:153
822199122,7cyclictest0-21swapper/320:01:013
822199120,2cyclictest0-21swapper/323:50:573
822199120,2cyclictest0-21swapper/323:35:213
822199120,2cyclictest0-21swapper/323:00:043
822199120,2cyclictest0-21swapper/321:10:153
822199120,2cyclictest0-21swapper/319:16:023
822199120,2cyclictest0-21swapper/300:20:113
822199120,2cyclictest0-21swapper/300:15:163
822199120,1cyclictest0-21swapper/322:00:493
822199120,11cyclictest0-21swapper/323:24:153
822199120,11cyclictest0-21swapper/322:50:013
822199120,11cyclictest0-21swapper/322:48:433
822199120,11cyclictest0-21swapper/321:45:143
822199120,11cyclictest0-21swapper/320:15:113
822199120,11cyclictest0-21swapper/300:10:593
822099129,2cyclictest24244-21diskmemload21:27:452
822099129,2cyclictest20100-21ssh23:52:462
822099129,2cyclictest0-21swapper/223:30:212
822099129,2cyclictest0-21swapper/223:00:052
822099129,2cyclictest0-21swapper/222:51:122
822099129,2cyclictest0-21swapper/222:36:252
822099129,2cyclictest0-21swapper/222:26:112
822099129,2cyclictest0-21swapper/222:11:462
822099129,2cyclictest0-21swapper/222:02:142
822099129,2cyclictest0-21swapper/221:55:142
822099129,2cyclictest0-21swapper/220:05:142
822099129,2cyclictest0-21swapper/200:05:572
822099128,3cyclictest26853-21ssh23:25:542
822099122,7cyclictest0-21swapper/219:39:582
822099120,2cyclictest8217-21cyclictest21:35:162
822099120,2cyclictest0-21swapper/223:11:322
822099120,2cyclictest0-21swapper/222:48:352
822099120,2cyclictest0-21swapper/222:21:352
822099120,11cyclictest0-21swapper/222:30:132
822099120,11cyclictest0-21swapper/222:17:442
822099120,11cyclictest0-21swapper/221:45:232
822099120,11cyclictest0-21swapper/221:44:112
822099120,11cyclictest0-21swapper/200:37:252
822099120,11cyclictest0-21swapper/200:25:542
822099120,11cyclictest0-21swapper/200:11:012
821999129,2cyclictest24244-21diskmemload23:16:101
821999129,2cyclictest0-21swapper/121:45:191
821999129,2cyclictest0-21swapper/121:27:561
821999122,5cyclictest0-21swapper/120:29:591
821999121,9cyclictest0-21swapper/123:45:121
821999121,9cyclictest0-21swapper/119:36:021
821999121,9cyclictest0-21swapper/119:20:141
821999121,3cyclictest18204-21munin-run20:54:591
821999121,3cyclictest14472-21munin-node1
821999121,3cyclictest0-21swapper/123:35:151
821999120,3cyclictest0-21swapper/120:55:151
821999120,2cyclictest0-21swapper/123:30:371
821999120,11cyclictest0-21swapper/122:20:131
821999120,11cyclictest0-21swapper/122:00:381
821999120,11cyclictest0-21swapper/121:51:511
821999120,11cyclictest0-21swapper/121:51:501
821999120,11cyclictest0-21swapper/121:24:591
821999120,11cyclictest0-21swapper/100:39:411
821999120,11cyclictest0-21swapper/100:31:001
821999120,10cyclictest0-21swapper/120:40:281
821899129,2cyclictest31916-21kworker/u8:119:27:040
821899129,2cyclictest0-21swapper/023:35:030
821899129,2cyclictest0-21swapper/023:22:100
821899129,2cyclictest0-21swapper/022:45:090
821899129,2cyclictest0-21swapper/020:46:030
821899129,2cyclictest0-21swapper/019:50:110
821899127,3cyclictest1711-21perl23:00:140
821899120,2cyclictest0-21swapper/022:25:060
821899120,2cyclictest0-21swapper/022:05:160
821899120,2cyclictest0-21swapper/020:50:150
821899120,2cyclictest0-21swapper/019:30:110
821899120,11cyclictest0-21swapper/022:41:070
821899120,11cyclictest0-21swapper/022:10:190
821899120,11cyclictest0-21swapper/021:50:180
821899120,11cyclictest0-21swapper/021:50:170
821899120,11cyclictest0-21swapper/020:25:190
821899120,11cyclictest0-21swapper/000:15:070
821899120,10cyclictest0-21swapper/020:36:050
234372120,2sleep00-21swapper/019:45:180
822199118,2cyclictest0-21swapper/320:46:113
822199118,2cyclictest0-21swapper/319:55:123
822199118,2cyclictest0-21swapper/319:25:173
822199116,3cyclictest27591-21latency_hist00:35:013
822199116,3cyclictest0-21swapper/319:20:163
822199110,9cyclictest0-21swapper/320:54:543
822199110,2cyclictest0-21swapper/323:27:403
822199110,2cyclictest0-21swapper/322:35:043
822199110,10cyclictest28205-21kworker/u8:220:27:043
822099118,2cyclictest12511-21cut19:20:132
822099118,2cyclictest0-21swapper/221:00:112
822099118,2cyclictest0-21swapper/219:15:112
822099110,10cyclictest31916-21kworker/u8:119:51:042
821999118,2cyclictest24244-21diskmemload00:21:201
821999117,2cyclictest22873-21df_abs19:45:131
821999117,2cyclictest0-21swapper/119:55:151
821999116,3cyclictest0-21swapper/119:40:161
821999111,8cyclictest14399-21munin-node1
821999111,8cyclictest0-21swapper/120:20:131
821999110,9cyclictest0-21swapper/120:30:181
821999110,9cyclictest0-21swapper/120:01:001
821999110,9cyclictest0-21swapper/119:31:011
821899118,2cyclictest30742-21kworker/u8:120:09:040
821899113,6cyclictest8432-21python21:26:030
114042110,2sleep20-21swapper/220:35:402
822199105,3cyclictest22303-21cron19:45:003
822199100,5cyclictest0-21swapper/320:10:003
822199100,3cyclictest0-21swapper/320:35:003
822099107,2cyclictest0-21swapper/219:55:112
822099102,7cyclictest0-21swapper/220:26:582
822099102,5cyclictest0-21swapper/219:10:472
821999100,8cyclictest32580-21munin-node1
821999100,2cyclictest0-21swapper/121:00:391
821899107,2cyclictest4291-21kworker/u8:020:40:040
821899107,2cyclictest0-21swapper/020:00:500
821899102,6cyclictest0-21swapper/020:59:590
821899102,5cyclictest0-21swapper/019:36:020
821899101,6cyclictest0-21swapper/020:15:590
82219994,3cyclictest23159-21if_eth019:45:143
82219994,3cyclictest1537-21unixbench_singl20:11:013
82219992,5cyclictest22511-21aten2.4_r3power21:05:123
82209996,2cyclictest0-21swapper/220:55:452
82209994,3cyclictest0-21swapper/220:45:592
82209984,3cyclictest3728-21runrttasks19:32:352
82209983,3cyclictest8725-21df20:30:132
82209983,3cyclictest3127-21nscd20:15:002
82209980,2cyclictest0-21swapper/220:00:002
82209970,6cyclictest4291-21kworker/u8:020:50:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional