You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 17:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Jul 06, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27861210796,6sleep30-21swapper/307:07:023
27915210678,6sleep00-21swapper/007:07:420
28062210486,12sleep20-21swapper/207:09:372
28004210286,11sleep10-21swapper/107:08:521
323682870,0sleep10-21swapper/110:40:381
52362820,1sleep00-21swapper/010:11:020
164412740,0sleep20-21swapper/211:33:412
248472670,0sleep00-21swapper/012:18:330
28125993616,19cyclictest5528-1kworker/u9:212:00:143
156862300,1sleep10-21swapper/109:48:021
2812499231,20cyclictest0-21swapper/210:10:102
28125992117,2cyclictest27533-21kworker/u8:011:11:053
28124992118,2cyclictest8494-21kworker/u8:009:10:042
2812499210,16cyclictest0-21swapper/210:28:052
2812499210,16cyclictest0-21swapper/210:28:052
2812499210,16cyclictest0-21swapper/210:09:052
2812399211,18cyclictest12167-21diskmemload12:15:121
2812299211,18cyclictest12167-21diskmemload12:25:120
2812299210,19cyclictest0-21swapper/009:20:120
219272210,3sleep1221ktimersoftd/109:55:121
28125992017,2cyclictest8107-21kworker/u8:012:22:063
28125992016,3cyclictest26406-21kworker/u8:210:01:053
28124992017,2cyclictest8107-21kworker/u8:012:15:052
28124992017,2cyclictest30225-21kworker/u8:010:45:042
28124992017,2cyclictest16327-21kworker/u8:108:11:052
28124992017,2cyclictest13960-21kworker/u8:110:23:042
2812499200,2cyclictest0-21swapper/210:40:102
2812399200,18cyclictest0-21swapper/108:00:101
28125991916,2cyclictest26414-21kworker/u8:110:14:063
28125991916,2cyclictest15521-21kworker/u8:110:58:053
28125991916,2cyclictest13898-21kworker/u8:112:11:053
28125991916,2cyclictest12852-21kworker/u8:111:34:063
28125991916,2cyclictest11904-21kworker/u8:008:03:053
28124991916,2cyclictest8236-21kworker/u8:207:44:002
28124991916,2cyclictest5836-21kworker/u8:208:52:012
28124991916,2cyclictest27533-21kworker/u8:011:16:052
28124991916,2cyclictest26406-21kworker/u8:209:36:042
28124991916,2cyclictest20457-21kworker/u8:211:35:042
28124991916,2cyclictest12852-21kworker/u8:111:40:052
2812499191,2cyclictest0-21swapper/211:27:052
2812499190,2cyclictest0-21swapper/209:45:032
28125991815,2cyclictest8107-21kworker/u8:012:32:043
28125991815,2cyclictest4159-21kworker/u8:107:41:043
28125991815,2cyclictest13960-21kworker/u8:110:48:053
28124991815,2cyclictest8236-21kworker/u8:207:57:042
28124991815,2cyclictest5836-21kworker/u8:208:59:042
28124991815,2cyclictest4159-21kworker/u8:107:34:012
28124991815,2cyclictest28467-21kworker/u8:007:19:032
28124991815,2cyclictest20517-21kworker/u8:009:57:052
28124991815,2cyclictest19560-21kworker/u8:009:28:042
28124991815,2cyclictest19256-21kworker/u8:210:35:042
28124991815,2cyclictest16327-21kworker/u8:108:44:012
28124991815,2cyclictest12537-21kworker/u8:109:53:042
28124991815,2cyclictest11904-21kworker/u8:008:02:042
2812499180,2cyclictest0-21swapper/211:09:042
28125991714,2cyclictest30225-21kworker/u8:010:40:053
28125991714,2cyclictest26406-21kworker/u8:209:37:043
28125991714,2cyclictest19606-21kworker/u8:212:18:053
28125991714,2cyclictest19560-21kworker/u8:009:26:043
28125991714,2cyclictest16327-21kworker/u8:108:31:053
28125991714,2cyclictest1128-21kworker/u8:109:34:003
2812599170,2cyclictest0-21swapper/311:27:053
28124991714,2cyclictest5850-21kworker/u8:112:33:042
28124991714,2cyclictest5836-21kworker/u8:209:00:042
28124991714,2cyclictest28467-21kworker/u8:007:26:042
28124991714,2cyclictest2468-21kworker/u8:010:18:052
28124991714,2cyclictest2220-21kworker/u8:008:48:042
28124991714,2cyclictest16327-21kworker/u8:108:26:012
28124991714,2cyclictest11904-21kworker/u8:007:51:042
2812499170,2cyclictest0-21swapper/209:19:042
2812399171,14cyclictest3631-21munin-node1
2812599161,3cyclictest22567-21iostat_ios09:55:163
28125991613,2cyclictest5836-21kworker/u8:209:16:043
28125991613,2cyclictest4159-21kworker/u8:107:47:043
28125991613,2cyclictest31687-21kworker/u8:212:28:023
28125991613,2cyclictest27533-21kworker/u8:011:18:043
28125991613,2cyclictest26406-21kworker/u8:209:43:053
28125991613,2cyclictest22325-21kworker/u8:011:46:053
28125991613,2cyclictest13898-21kworker/u8:112:08:013
28125991613,2cyclictest12852-21kworker/u8:111:36:063
28125991613,2cyclictest10285-21kworker/u8:011:02:053
2812599161,13cyclictest0-21swapper/307:15:193
2812599160,11cyclictest0-21swapper/308:39:053
28124991613,2cyclictest8494-21kworker/u8:009:07:052
28124991613,2cyclictest8107-21kworker/u8:012:28:062
28124991613,2cyclictest5850-21kworker/u8:112:37:052
28124991613,2cyclictest4159-21kworker/u8:107:38:042
2812499161,2cyclictest31479-21smartctl09:30:152
2812499160,2cyclictest0-21swapper/212:20:012
2812499160,11cyclictest0-21swapper/207:21:042
2812399161,13cyclictest22337-21iostat_ios09:20:161
2812399161,13cyclictest12861-21df_inode12:05:151
2812399160,14cyclictest0-21swapper/109:11:031
28125991512,2cyclictest5836-21kworker/u8:209:12:043
28125991512,2cyclictest5836-21kworker/u8:209:01:053
28125991512,2cyclictest5836-21kworker/u8:208:58:043
28125991512,2cyclictest28677-21kworker/u8:111:59:043
28125991512,2cyclictest22325-21kworker/u8:011:41:043
28125991512,2cyclictest20457-21kworker/u8:211:08:043
28125991512,2cyclictest19256-21kworker/u8:210:36:053
28125991512,2cyclictest16327-21kworker/u8:108:13:053
28125991512,2cyclictest16327-21kworker/u8:108:08:013
28125991512,2cyclictest13960-21kworker/u8:110:25:043
28125991512,2cyclictest13960-21kworker/u8:110:25:043
2812599151,12cyclictest1964-21ssh11:53:193
2812599150,3cyclictest8470-21fschecks_time10:15:133
2812599150,13cyclictest0-21swapper/310:50:183
28124991510,3cyclictest12791-21hostname10:55:122
2812499150,2cyclictest0-21swapper/211:53:052
2812499150,2cyclictest0-21swapper/211:14:052
2812499150,2cyclictest0-21swapper/210:54:052
2812399151,3cyclictest8851-21sed07:40:151
28123991511,2cyclictest0-21swapper/107:30:181
28123991510,3cyclictest30552-21latency_hist09:30:001
2812399150,13cyclictest0-21swapper/107:36:031
2812299152,7cyclictest0-21swapper/012:20:000
2812299152,12cyclictest101ktimersoftd/011:32:140
2812299151,3cyclictest9838-21users09:41:030
2812299151,12cyclictest6214-21apt-get07:35:120
28122991510,3cyclictest0-21swapper/008:02:560
28122991510,3cyclictest0-21swapper/007:50:190
2812299150,13cyclictest0-21swapper/012:31:540
2812599142,6cyclictest0-21swapper/308:30:003
28125991411,2cyclictest4159-21kworker/u8:107:33:043
28125991411,2cyclictest31687-21kworker/u8:212:35:053
28125991411,2cyclictest16327-21kworker/u8:108:42:033
28125991411,2cyclictest13960-21kworker/u8:110:32:053
2812599140,12cyclictest2422-21fschecks_time07:25:143
2812599140,12cyclictest0-21swapper/309:46:273
2812499141,2cyclictest0-21swapper/208:30:102
28124991411,2cyclictest2045-21kworker/u8:111:23:042
28124991411,2cyclictest0-21swapper/209:43:252
28124991411,2cyclictest0-21swapper/208:06:022
2812499140,2cyclictest0-21swapper/212:13:052
2812499140,13cyclictest0-21swapper/209:20:112
2812499140,12cyclictest3649-21snmpd11:58:302
2812499140,12cyclictest0-21swapper/212:06:062
2812499140,11cyclictest0-21swapper/210:34:052
2812499140,11cyclictest0-21swapper/208:19:052
28123991411,2cyclictest8157-21apt-get10:50:121
28123991411,2cyclictest0-21swapper/111:35:161
28123991411,2cyclictest0-21swapper/111:02:561
28123991411,2cyclictest0-21swapper/110:14:451
2812399140,12cyclictest0-21swapper/111:45:381
2812399140,12cyclictest0-21swapper/111:21:041
2812299142,6cyclictest0-21swapper/009:00:000
2812299142,6cyclictest0-21swapper/008:45:000
28122991411,2cyclictest0-21swapper/011:55:140
2812299141,11cyclictest20799-21ssh09:53:490
2812299140,13cyclictest0-21swapper/009:19:040
2812299140,12cyclictest0-21swapper/011:40:110
2812299140,12cyclictest0-21swapper/010:36:540
2812299140,12cyclictest0-21swapper/010:16:350
2812299140,12cyclictest0-21swapper/010:03:110
253602140,2sleep00-21swapper/011:08:310
95592130,1sleep00-21swapper/010:50:520
28125991310,2cyclictest8494-21kworker/u8:009:06:033
28125991310,2cyclictest4159-21kworker/u8:107:35:043
28125991310,2cyclictest28467-21kworker/u8:007:20:013
28125991310,2cyclictest22607-21kworker/u8:208:22:043
2812599130,9cyclictest0-21swapper/307:11:043
2812599130,2cyclictest0-21swapper/310:08:053
2812599130,11cyclictest0-21swapper/309:53:463
28124991310,2cyclictest0-21swapper/207:11:042
2812499130,2cyclictest0-21swapper/212:00:172
2812399139,2cyclictest0-21swapper/111:30:191
2812399139,2cyclictest0-21swapper/107:45:191
2812399138,4cyclictest0-21swapper/108:05:181
2812399133,8cyclictest18733-21grep12:11:031
2812399132,6cyclictest0-21swapper/110:00:011
2812399131,9cyclictest0-21swapper/112:25:121
2812399131,10cyclictest0-21swapper/108:17:441
28123991310,2cyclictest0-21swapper/111:56:151
28123991310,2cyclictest0-21swapper/110:48:261
28123991310,2cyclictest0-21swapper/110:25:191
28123991310,2cyclictest0-21swapper/110:25:191
2812399130,2cyclictest0-21swapper/109:35:181
2812399130,2cyclictest0-21swapper/108:55:191
2812399130,12cyclictest0-21swapper/111:50:151
2812399130,12cyclictest0-21swapper/109:00:121
2812399130,11cyclictest0-21swapper/112:35:511
2812399130,11cyclictest0-21swapper/112:20:451
2812399130,11cyclictest0-21swapper/112:04:081
2812399130,11cyclictest0-21swapper/108:35:501
2812299138,3cyclictest20287-21ssh12:13:320
2812299132,7cyclictest0-21swapper/007:18:590
2812299132,6cyclictest0-21swapper/007:30:010
28122991310,2cyclictest0-21swapper/012:05:240
28122991310,2cyclictest0-21swapper/011:20:500
28122991310,2cyclictest0-21swapper/011:15:570
28122991310,2cyclictest0-21swapper/011:04:300
28122991310,2cyclictest0-21swapper/010:40:200
28122991310,2cyclictest0-21swapper/010:30:130
28122991310,2cyclictest0-21swapper/010:23:590
28122991310,2cyclictest0-21swapper/010:05:330
28122991310,2cyclictest0-21swapper/009:37:320
28122991310,2cyclictest0-21swapper/008:49:590
2812299130,2cyclictest0-21swapper/011:51:280
2812299130,2cyclictest0-21swapper/011:14:230
2812299130,2cyclictest0-21swapper/009:06:040
2812299130,12cyclictest9448-21ssh12:01:040
2812299130,12cyclictest0-21swapper/010:27:470
2812299130,12cyclictest0-21swapper/010:27:470
2812299130,12cyclictest0-21swapper/008:25:180
2812299130,11cyclictest12167-21diskmemload09:55:520
2812299130,11cyclictest0-21swapper/009:12:410
2812599129,2cyclictest2220-21kworker/u8:008:51:053
2812599129,2cyclictest0-21swapper/311:20:463
2812599129,2cyclictest0-21swapper/310:20:113
2812599122,6cyclictest0-21swapper/308:00:013
2812599120,2cyclictest0-21swapper/309:20:043
2812599120,2cyclictest0-21swapper/308:16:043
2812499129,2cyclictest0-21swapper/211:01:352
2812499120,2cyclictest0-21swapper/210:01:462
2812499120,2cyclictest0-21swapper/207:49:042
2812399129,2cyclictest0-21swapper/111:40:181
2812399129,2cyclictest0-21swapper/110:39:001
2812399129,2cyclictest0-21swapper/108:30:121
2812399129,2cyclictest0-21swapper/108:21:031
2812399121,9cyclictest8890-21perl11:25:151
2812399121,9cyclictest7890-21munin-node1
2812399121,3cyclictest28336-21munin-node1
2812399120,3cyclictest0-21swapper/107:56:031
2812399120,2cyclictest0-21swapper/111:16:001
2812399120,2cyclictest0-21swapper/110:15:151
2812399120,2cyclictest0-21swapper/110:06:241
2812399120,2cyclictest0-21swapper/109:16:151
2812399120,2cyclictest0-21swapper/108:45:301
2812399120,11cyclictest0-21swapper/110:31:491
2812399120,11cyclictest0-21swapper/110:22:081
2812399120,11cyclictest0-21swapper/107:50:121
2812399120,10cyclictest0-21swapper/109:06:021
2812399120,10cyclictest0-21swapper/107:21:001
2812299129,2cyclictest0-21swapper/012:35:210
2812299129,2cyclictest0-21swapper/010:45:140
2812299129,2cyclictest0-21swapper/009:30:260
2812299129,2cyclictest0-21swapper/009:25:140
2812299129,2cyclictest0-21swapper/008:50:120
2812299122,6cyclictest0-21swapper/008:36:010
2812299120,2cyclictest0-21swapper/007:45:180
2812299120,2cyclictest0-21swapper/007:20:120
2812299120,11cyclictest0-21swapper/011:45:130
2812299120,11cyclictest0-21swapper/011:36:520
2812299120,11cyclictest0-21swapper/011:27:300
2812299120,11cyclictest0-21swapper/010:55:120
2812299120,11cyclictest0-21swapper/009:47:040
2812299120,11cyclictest0-21swapper/007:40:140
9832110,1sleep10-21swapper/109:32:081
2812599118,2cyclictest0-21swapper/307:55:013
2812599110,2cyclictest0-21swapper/308:46:063
2812499118,2cyclictest0-21swapper/211:46:552
2812399117,2cyclictest30703-21sed07:15:141
2812399116,3cyclictest27224-21iostat_ios08:25:171
2812399116,3cyclictest0-21swapper/107:25:131
2812399114,6cyclictest28121-21cyclictest08:42:491
2812399111,8cyclictest0-21swapper/110:56:031
2812399111,2cyclictest0-21swapper/108:50:161
2812399110,3cyclictest0-21swapper/111:10:131
2812399110,10cyclictest0-21swapper/111:05:021
2812399110,10cyclictest0-21swapper/109:52:141
2812299118,2cyclictest0-21swapper/007:30:120
2812299111,6cyclictest0-21swapper/008:07:420
2812299111,6cyclictest0-21swapper/007:12:310
212362110,1sleep00-21swapper/008:10:170
2812499107,2cyclictest0-21swapper/208:35:172
2812499101,5cyclictest0-21swapper/208:25:002
2812399105,3cyclictest0-21swapper/108:15:001
281229994,3cyclictest6606-21cpuspeed_turbos08:55:140
281229993,2cyclictest28561-21munin-node0
281229991,5cyclictest0-21swapper/007:55:120
281229983,3cyclictest24543-21aten2.4_r3power08:20:120
281229983,3cyclictest22641-21aten2.4_r3power08:15:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional