You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 02:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sat Jan 10, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1600021340,1sleep316001-21sh23:22:413
9295211895,18sleep00-21swapper/019:09:520
8099211895,15sleep30-21swapper/319:05:133
9303211694,16sleep20-21swapper/219:09:582
8975211296,11sleep10-21swapper/119:05:441
1244021060,1sleep012438-21ssh00:30:190
203692680,1sleep30-21swapper/322:15:143
933599232,18cyclictest0-21swapper/221:03:012
933599229,11cyclictest9643-21ssh22:40:102
9333992217,3cyclictest0-21swapper/021:25:100
287212220,1sleep20-21swapper/222:25:112
933599212,14cyclictest0-21swapper/200:22:052
68772210,1sleep1221ktimersoftd/122:35:571
933599201,14cyclictest0-21swapper/223:37:052
933599200,15cyclictest0-21swapper/223:54:042
933599200,15cyclictest0-21swapper/220:26:042
933599200,15cyclictest0-21swapper/219:58:042
933599190,14cyclictest0-21swapper/223:42:042
933599190,14cyclictest0-21swapper/220:11:042
933399193,14cyclictest0-21swapper/023:05:100
933399191,16cyclictest0-21swapper/022:10:100
933399180,4cyclictest0-21swapper/023:51:050
933599173,2cyclictest0-21swapper/221:28:042
933599172,14cyclictest0-21swapper/200:14:052
933599172,14cyclictest0-21swapper/200:14:042
9335991714,2cyclictest9678-21kworker/u8:122:46:052
933599171,2cyclictest0-21swapper/223:25:042
933599171,2cyclictest0-21swapper/221:20:052
933599170,12cyclictest0-21swapper/222:30:052
933399170,2cyclictest9-21ksoftirqd/022:40:100
293022170,1sleep10-21swapper/119:57:481
933699161,3cyclictest0-21swapper/321:00:233
933699161,13cyclictest0-21swapper/320:05:163
933599161,2cyclictest0-21swapper/222:13:052
933499161,3cyclictest7458-21runrttasks23:35:281
933499161,3cyclictest0-21swapper/100:35:011
9334991611,3cyclictest0-21swapper/120:00:131
9334991611,3cyclictest0-21swapper/100:20:001
933499160,2cyclictest0-21swapper/122:23:061
9333991611,3cyclictest14044-21needreboot23:20:160
9333991611,3cyclictest11742-21ssh21:30:120
933399161,13cyclictest0-21swapper/020:50:150
40762160,0sleep30-21swapper/300:20:533
933699151,12cyclictest512-21seq00:17:373
933699150,13cyclictest25453-21diskmemload23:16:443
933699150,13cyclictest0-21swapper/323:44:343
933699150,13cyclictest0-21swapper/321:35:243
933699150,13cyclictest0-21swapper/320:35:123
9335991512,2cyclictest3905-21kworker/u8:223:16:042
933599151,12cyclictest13331-21apt-get20:40:052
933599150,6cyclictest0-21swapper/219:45:042
933599150,2cyclictest0-21swapper/223:22:052
933599150,2cyclictest0-21swapper/219:10:042
933599150,14cyclictest0-21swapper/219:52:052
933599150,13cyclictest0-21swapper/221:30:072
933599150,12cyclictest6318-21Xorg20:48:582
933499151,3cyclictest32054-21munin-node1
9334991510,3cyclictest9896-21python23:15:251
933499150,3cyclictest30069-21taskset23:02:181
933499150,13cyclictest0-21swapper/121:45:171
933499150,13cyclictest0-21swapper/121:17:461
933399151,12cyclictest18240-21munin-run22:50:000
933699149,3cyclictest1771-21cut21:55:113
933699149,3cyclictest0-21swapper/321:12:203
933699142,7cyclictest0-21swapper/319:30:003
9336991411,2cyclictest0-21swapper/322:53:243
9336991411,2cyclictest0-21swapper/322:40:183
9336991411,2cyclictest0-21swapper/322:37:233
9336991411,2cyclictest0-21swapper/322:05:243
9336991411,2cyclictest0-21swapper/319:54:443
933699140,2cyclictest0-21swapper/300:28:143
933699140,12cyclictest16833-21ssh22:47:333
933699140,12cyclictest0-21swapper/321:50:033
933599140,2cyclictest0-21swapper/222:00:042
933599140,2cyclictest0-21swapper/221:37:032
933599140,2cyclictest0-21swapper/221:09:052
933599140,2cyclictest0-21swapper/220:59:052
933599140,2cyclictest0-21swapper/220:35:042
933599140,2cyclictest0-21swapper/220:21:042
933599140,2cyclictest0-21swapper/200:31:042
933599140,13cyclictest0-21swapper/221:50:042
933499149,3cyclictest21897-21apt-get23:30:051
933499149,3cyclictest17788-21sh21:35:261
933499141,2cyclictest25453-21diskmemload00:10:051
933499141,2cyclictest25453-21diskmemload00:10:051
9334991411,2cyclictest0-21swapper/100:04:481
933499140,3cyclictest4232-21diskmemload00:21:091
933499140,2cyclictest25453-21diskmemload23:51:081
933499140,2cyclictest0-21swapper/122:48:081
933499140,2cyclictest0-21swapper/121:26:361
933499140,13cyclictest0-21swapper/121:52:361
933499140,12cyclictest32581-21ssh22:29:411
933499140,12cyclictest25453-21diskmemload23:13:181
933499140,12cyclictest25453-21diskmemload22:55:311
933499140,12cyclictest25453-21diskmemload21:20:061
933499140,12cyclictest0-21swapper/123:25:121
933399143,7cyclictest0-21swapper/019:55:510
9333991411,2cyclictest0-21swapper/023:39:370
9333991411,2cyclictest0-21swapper/000:10:170
9333991411,2cyclictest0-21swapper/000:10:160
9333991410,2cyclictest9-21ksoftirqd/019:50:230
933399140,2cyclictest0-21swapper/022:00:170
933399140,2cyclictest0-21swapper/000:02:470
933399140,12cyclictest5785-21ssh21:23:230
933399140,12cyclictest0-21swapper/023:33:240
933399140,12cyclictest0-21swapper/023:03:180
933399140,12cyclictest0-21swapper/019:20:100
933399140,12cyclictest0-21swapper/000:35:050
314002140,2sleep30-21swapper/323:04:413
281422140,2sleep00-21swapper/021:47:390
214972140,2sleep00-21swapper/023:29:200
9336991310,2cyclictest0-21swapper/323:55:493
9336991310,2cyclictest0-21swapper/322:00:543
9336991310,2cyclictest0-21swapper/321:45:203
9336991310,2cyclictest0-21swapper/320:00:163
9336991310,2cyclictest0-21swapper/319:45:153
9336991310,2cyclictest0-21swapper/300:10:153
9336991310,2cyclictest0-21swapper/300:10:143
9336991310,2cyclictest0-21swapper/300:07:043
933699130,2cyclictest0-21swapper/323:26:193
933699130,2cyclictest0-21swapper/322:34:443
933699130,2cyclictest0-21swapper/321:05:153
933699130,1cyclictest0-21swapper/300:35:243
933699130,12cyclictest0-21swapper/323:05:143
933699130,12cyclictest0-21swapper/322:25:293
933699130,12cyclictest0-21swapper/321:21:433
933599131,9cyclictest7427-21metacity20:52:582
933599131,11cyclictest0-21swapper/221:15:042
9335991310,2cyclictest22862-21kworker/u8:119:17:052
9335991310,2cyclictest19381-21kworker/u8:222:15:042
9335991310,2cyclictest1210-21kworker/u8:123:58:042
933599130,12cyclictest0-21swapper/221:10:152
933599130,12cyclictest0-21swapper/200:06:562
9334991310,2cyclictest0-21swapper/123:58:051
9334991310,2cyclictest0-21swapper/123:40:211
9334991310,2cyclictest0-21swapper/123:20:021
9334991310,2cyclictest0-21swapper/122:32:451
9334991310,2cyclictest0-21swapper/122:15:131
9334991310,2cyclictest0-21swapper/122:00:271
9334991310,2cyclictest0-21swapper/121:10:391
9334991310,2cyclictest0-21swapper/100:37:381
9334991310,2cyclictest0-21swapper/100:05:161
933499130,2cyclictest0-21swapper/122:50:151
933499130,12cyclictest0-21swapper/122:40:071
933499130,12cyclictest0-21swapper/122:07:331
933499130,11cyclictest0-21swapper/122:10:071
9333991310,2cyclictest9-21ksoftirqd/020:25:100
9333991310,2cyclictest0-21swapper/022:55:250
9333991310,2cyclictest0-21swapper/021:42:460
933399130,2cyclictest25453-21diskmemload22:33:320
933399130,2cyclictest0-21swapper/021:50:130
933399130,2cyclictest0-21swapper/021:15:260
933399130,2cyclictest0-21swapper/019:35:220
933399130,2cyclictest0-21swapper/000:20:190
933399130,12cyclictest0-21swapper/022:20:170
66482130,2sleep00-21swapper/023:48:390
292922130,2sleep30-21swapper/323:37:253
268792130,2sleep00-21swapper/021:10:230
196342130,2sleep319635-21munin-node3
112722130,1sleep011275-21fschecks_count22:05:130
933699129,2cyclictest11824-21ssh21:30:133
933699129,2cyclictest0-21swapper/323:31:353
933699129,2cyclictest0-21swapper/322:55:303
933699129,2cyclictest0-21swapper/322:20:253
933699129,2cyclictest0-21swapper/321:42:143
933699129,2cyclictest0-21swapper/321:26:053
933699127,3cyclictest28053-21sed19:55:133
933699121,8cyclictest0-21swapper/320:48:013
933699120,2cyclictest25453-21diskmemload23:49:573
933699120,2cyclictest0-21swapper/323:52:523
933699120,11cyclictest0-21swapper/321:15:063
933699120,11cyclictest0-21swapper/319:30:153
933699120,11cyclictest0-21swapper/300:32:113
933699120,11cyclictest0-21swapper/300:04:543
933699120,10cyclictest0-21swapper/323:10:423
933599129,2cyclictest30714-21kworker/u8:222:51:042
933599129,2cyclictest11619-21kworker/u8:219:35:032
933599129,2cyclictest0-21swapper/222:57:572
933599129,2cyclictest0-21swapper/222:35:172
933599129,2cyclictest0-21swapper/221:41:212
933599122,7cyclictest0-21swapper/221:47:592
933599122,7cyclictest0-21swapper/220:15:592
933599120,2cyclictest3639-21apt-get23:10:052
933599120,11cyclictest0-21swapper/223:02:062
933599120,11cyclictest0-21swapper/220:30:132
933499129,2cyclictest0-21swapper/123:45:311
933499129,2cyclictest0-21swapper/121:40:401
933499129,2cyclictest0-21swapper/121:31:331
933499129,2cyclictest0-21swapper/120:25:191
933499129,2cyclictest0-21swapper/119:15:221
933499128,2cyclictest0-21swapper/120:35:101
933499127,3cyclictest7832-21needreboot00:25:151
933499122,6cyclictest0-21swapper/119:14:591
933499121,9cyclictest19391-21apt-get19:35:041
933499120,2cyclictest0-21swapper/119:30:111
933499120,11cyclictest25453-21diskmemload21:55:091
933499120,11cyclictest0-21swapper/120:55:581
933499120,11cyclictest0-21swapper/120:40:061
933499120,11cyclictest0-21swapper/120:20:171
933499120,11cyclictest0-21swapper/119:20:101
933499120,10cyclictest0-21swapper/121:05:211
933399129,2cyclictest25453-21diskmemload21:35:270
933399129,2cyclictest0-21swapper/000:25:210
933399122,7cyclictest7497-21gdm-simple-gree19:27:580
933399122,7cyclictest0-21swapper/019:31:590
933399122,6cyclictest0-21swapper/020:20:010
933399120,2cyclictest0-21swapper/023:17:460
933399120,2cyclictest0-21swapper/023:10:250
933399120,2cyclictest0-21swapper/022:18:500
933399120,2cyclictest0-21swapper/020:30:160
933399120,1cyclictest0-21swapper/000:05:160
933399120,11cyclictest9-21ksoftirqd/023:57:480
933399120,11cyclictest0-21swapper/023:43:140
933399120,11cyclictest0-21swapper/022:39:140
933399120,11cyclictest0-21swapper/022:28:250
933399120,11cyclictest0-21swapper/020:55:120
933399120,11cyclictest0-21swapper/019:15:140
933399120,11cyclictest0-21swapper/000:16:580
196542120,2sleep025453-21diskmemload22:50:230
933699118,2cyclictest0-21swapper/320:30:133
933599118,2cyclictest25898-21ssh23:34:112
933599118,2cyclictest25453-21diskmemload21:56:132
933599118,2cyclictest25453-21diskmemload00:36:392
933599118,2cyclictest11619-21kworker/u8:219:23:042
933599113,6cyclictest0-21swapper/220:00:512
933599110,2cyclictest0-21swapper/200:00:402
933599110,10cyclictest0-21swapper/222:20:072
933599110,10cyclictest0-21swapper/222:06:182
933499118,2cyclictest0-21swapper/120:10:221
933499118,2cyclictest0-21swapper/119:40:171
933499116,3cyclictest9977-21cut20:30:151
933499110,9cyclictest0-21swapper/120:50:221
933499110,3cyclictest0-21swapper/120:05:151
933499110,3cyclictest0-21swapper/119:25:161
933499110,10cyclictest0-21swapper/120:45:211
933399118,2cyclictest0-21swapper/021:55:330
933399118,2cyclictest0-21swapper/020:05:140
933399118,2cyclictest0-21swapper/019:40:140
933399112,6cyclictest0-21swapper/021:08:020
933399111,8cyclictest0-21swapper/020:46:000
933399110,6cyclictest0-21swapper/019:50:000
135802111,6sleep00-21swapper/020:40:050
933699107,2cyclictest0-21swapper/320:20:213
933699107,2cyclictest0-21swapper/320:10:163
933699105,3cyclictest17624-21ssh22:11:463
933699101,7cyclictest19614-21packagekitd19:40:103
933599107,2cyclictest11619-21kworker/u8:219:34:052
933599107,2cyclictest0-21swapper/200:27:332
933599107,2cyclictest0-21swapper/200:15:062
933599102,6cyclictest0-21swapper/223:06:012
933599102,5cyclictest0-21swapper/220:06:022
933599101,6cyclictest0-21swapper/219:25:272
933599100,9cyclictest0-21swapper/223:45:082
933499100,8cyclictest0-21swapper/119:45:121
933499100,3cyclictest21997-21df_abs21:00:121
933399105,3cyclictest1794-21tune2fs20:10:130
933399102,6cyclictest0-21swapper/020:35:220
93369994,3cyclictest3708-21fschecks_count20:15:143
93369994,3cyclictest20957-21grep20:55:243
93369994,3cyclictest17962-21sed20:50:133
93369994,3cyclictest13714-21aten2.4-expect20:40:113
93369994,3cyclictest11809-21cpuspeed_turbos19:15:123
93369991,6cyclictest0-21swapper/320:25:233
93359992,3cyclictest23088-21vmstat19:40:252
93349994,3cyclictest25711-21aten2.4-expect19:50:121
93349990,7cyclictest0-21swapper/120:15:151
93339994,3cyclictest29987-21cpuspeed_turbos20:00:130
93339994,3cyclictest21919-21cpuspeed_turbos21:00:120
93339990,7cyclictest0-21swapper/019:12:580
13571290,2sleep30-21swapper/319:20:043
93369983,3cyclictest0-21swapper/319:10:133
93339983,3cyclictest3412-21cut20:15:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional