You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 13:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun May 31, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304822116105,6sleep20-21swapper/219:07:042
304732115104,6sleep30-21swapper/319:06:573
29915210879,6sleep10-21swapper/119:05:191
2998629684,6sleep00-21swapper/019:05:500
162162820,1sleep231-21ksoftirqd/221:45:182
85832740,2sleep2301ktimersoftd/222:11:032
45992700,0sleep30-21swapper/322:07:153
327172660,0sleep10-21swapper/122:36:401
35432230,0sleep10-21swapper/122:40:161
200772230,1sleep30-21swapper/323:30:453
141672230,1sleep30-21swapper/323:58:513
315162220,0sleep031519-21gltestperf19:10:140
3074099221,2cyclictest0-21swapper/119:15:101
215512220,1sleep10-21swapper/121:51:021
3074299200,19cyclictest0-21swapper/321:30:103
3074299200,18cyclictest0-21swapper/319:45:113
30741991815,2cyclictest14667-21kworker/u8:120:04:032
3074099180,16cyclictest0-21swapper/100:05:111
30741991714,2cyclictest947-21kworker/u8:220:45:042
30741991714,2cyclictest24892-21kworker/u8:020:39:042
30741991714,2cyclictest2123-21kworker/u8:121:33:042
30741991714,2cyclictest14667-21kworker/u8:120:28:032
30741991714,2cyclictest1271-21kworker/u8:000:26:052
30741991714,2cyclictest11250-21kworker/u8:221:04:012
3074299161,13cyclictest0-21swapper/320:10:123
30742991611,3cyclictest0-21swapper/319:20:163
30741991613,2cyclictest29168-21kworker/u8:222:35:042
30741991613,2cyclictest14667-21kworker/u8:120:33:042
30741991613,2cyclictest13379-21kworker/u8:019:25:042
30741991613,2cyclictest10703-21kworker/u8:221:42:052
3074199160,14cyclictest0-21swapper/222:15:042
3074099161,3cyclictest0-21swapper/123:05:121
3073999160,14cyclictest0-21swapper/022:16:580
52412151,3sleep05251-21ssh00:23:100
30742991510,3cyclictest5718-21cut21:35:113
30742991510,3cyclictest25341-21hddtemp_smartct00:10:153
3074299150,3cyclictest13501-21diskmemload22:52:553
30741991512,2cyclictest13501-21diskmemload00:04:052
3074199151,12cyclictest3127-21nscd23:57:052
3074199150,3cyclictest11153-21apt-get00:30:072
3074099159,4cyclictest18405-21ssh00:03:001
3074099158,5cyclictest0-21swapper/122:55:351
3074099151,12cyclictest21-21rcuc/123:23:011
3074099151,12cyclictest16332-21munin-run19:55:001
3074099150,13cyclictest0-21swapper/119:21:011
30739991510,3cyclictest24259-21kernelversion21:20:170
3073999150,13cyclictest20843-21ssh23:31:180
187832153,8sleep218793-21rm22:55:542
3074299140,3cyclictest0-21swapper/300:28:153
3074299140,12cyclictest0-21swapper/322:25:123
30741991411,2cyclictest9176-21kworker/u8:021:10:042
3074199141,12cyclictest29165-21ssh23:06:262
30741991410,2cyclictest17087-21memory00:35:172
30741991410,2cyclictest17087-21memory00:35:162
3074199140,3cyclictest0-21swapper/223:17:152
3074199140,2cyclictest0-21swapper/223:49:302
3074199140,2cyclictest0-21swapper/221:37:302
3074199140,2cyclictest0-21swapper/221:27:102
3074199140,2cyclictest0-21swapper/221:27:102
3074199140,12cyclictest0-21swapper/223:41:252
3074099148,4cyclictest0-21swapper/121:15:151
3074099142,6cyclictest0-21swapper/121:05:001
30740991411,2cyclictest221ktimersoftd/123:10:131
30740991411,2cyclictest221ktimersoftd/100:30:071
3074099140,3cyclictest20328-21sensors23:31:001
3074099140,2cyclictest0-21swapper/121:25:121
3074099140,2cyclictest0-21swapper/121:25:121
3074099140,12cyclictest0-21swapper/121:10:141
30739991411,2cyclictest4164-21kworker/u8:119:29:030
30739991411,2cyclictest14667-21kworker/u8:119:59:040
30739991411,2cyclictest0-21swapper/023:18:470
30739991411,2cyclictest0-21swapper/023:08:480
30739991411,2cyclictest0-21swapper/023:02:380
30739991411,2cyclictest0-21swapper/022:55:260
30739991411,2cyclictest0-21swapper/020:45:130
3073999140,2cyclictest0-21swapper/022:37:480
3073999140,13cyclictest13501-21diskmemload22:54:180
3073999140,13cyclictest13501-21diskmemload00:06:480
3073999140,13cyclictest0-21swapper/021:59:380
3073999140,12cyclictest7802-21ssh21:36:170
3073999140,12cyclictest17705-21ssh22:20:460
3073999140,12cyclictest14631-21sh00:32:550
3073999140,12cyclictest0-21swapper/021:00:140
3073999140,12cyclictest0-21swapper/000:01:030
246242140,1sleep3381ktimersoftd/323:01:503
234362140,3sleep00-21swapper/021:53:470
3074299133,6cyclictest0-21swapper/322:41:013
3074299132,9cyclictest0-21swapper/300:16:353
3074299131,2cyclictest10256-21apt-get19:40:073
30742991310,2cyclictest11198-21ssh23:21:163
30742991310,2cyclictest0-21swapper/323:35:393
3074299130,12cyclictest0-21swapper/320:15:173
3074299130,12cyclictest0-21swapper/319:35:123
3074299130,11cyclictest0-21swapper/300:39:043
3074299130,11cyclictest0-21swapper/300:39:043
30741991310,2cyclictest13501-21diskmemload22:45:282
30741991310,2cyclictest0-21swapper/223:51:302
30741991310,2cyclictest0-21swapper/223:36:312
30741991310,2cyclictest0-21swapper/223:10:142
30741991310,2cyclictest0-21swapper/222:32:302
30741991310,2cyclictest0-21swapper/222:26:412
30741991310,2cyclictest0-21swapper/221:21:152
30741991310,2cyclictest0-21swapper/220:55:152
30741991310,2cyclictest0-21swapper/220:40:112
3074199130,2cyclictest4398-21ssh22:06:582
3074199130,2cyclictest0-21swapper/221:51:042
3074199130,2cyclictest0-21swapper/219:45:092
3074199130,2cyclictest0-21swapper/200:15:112
3074199130,12cyclictest13501-21diskmemload00:05:192
3074199130,12cyclictest0-21swapper/223:30:042
3074199130,12cyclictest0-21swapper/223:26:142
3074199130,12cyclictest0-21swapper/223:21:402
3074199130,12cyclictest0-21swapper/223:00:252
3074199130,12cyclictest0-21swapper/222:52:472
3074199130,12cyclictest0-21swapper/222:20:542
3074199130,12cyclictest0-21swapper/221:58:042
3074199130,12cyclictest0-21swapper/221:17:192
3074199130,12cyclictest0-21swapper/221:05:172
3074199130,12cyclictest0-21swapper/200:14:272
3074199130,11cyclictest0-21swapper/222:00:012
3074099138,4cyclictest0-21swapper/121:00:121
3074099138,3cyclictest11822sleep122:04:401
3074099138,3cyclictest0-21swapper/119:45:171
3074099132,9cyclictest29253-21missed_timers23:40:151
3074099132,6cyclictest0-21swapper/119:15:001
3074099132,2cyclictest0-21swapper/120:05:171
3074099132,10cyclictest221ktimersoftd/121:41:331
30740991310,2cyclictest221ktimersoftd/100:19:361
30740991310,2cyclictest0-21swapper/122:50:111
30740991310,2cyclictest0-21swapper/122:22:221
3074099130,11cyclictest0-21swapper/123:37:211
30739991310,2cyclictest6531-21kworker/u8:220:54:040
30739991310,2cyclictest18830-21ssh21:15:160
30739991310,2cyclictest14667-21kworker/u8:120:32:040
30739991310,2cyclictest14667-21kworker/u8:120:01:040
30739991310,2cyclictest14667-21kworker/u8:119:52:030
30739991310,2cyclictest13501-21diskmemload23:35:030
30739991310,2cyclictest0-21swapper/023:55:350
30739991310,2cyclictest0-21swapper/023:50:090
30739991310,2cyclictest0-21swapper/022:40:260
30739991310,2cyclictest0-21swapper/022:32:350
30739991310,2cyclictest0-21swapper/022:05:560
30739991310,2cyclictest0-21swapper/022:03:090
30739991310,2cyclictest0-21swapper/021:41:020
30739991310,2cyclictest0-21swapper/021:27:320
30739991310,2cyclictest0-21swapper/021:27:310
30739991310,2cyclictest0-21swapper/021:10:120
30739991310,2cyclictest0-21swapper/000:15:270
3073999130,2cyclictest4460-21ssh21:33:370
3073999130,2cyclictest17194-21ssh21:46:320
3073999130,2cyclictest0-21swapper/023:41:140
3073999130,2cyclictest0-21swapper/022:46:160
3073999130,2cyclictest0-21swapper/021:06:010
3073999130,12cyclictest13501-21diskmemload00:35:390
3073999130,12cyclictest13501-21diskmemload00:35:390
3073999130,12cyclictest0-21swapper/023:25:170
3073999130,12cyclictest0-21swapper/023:13:140
3073999130,12cyclictest0-21swapper/022:26:180
3073999130,12cyclictest0-21swapper/020:55:150
3073999130,12cyclictest0-21swapper/020:15:100
3073999130,11cyclictest26053-21ssh00:10:420
3074299129,2cyclictest0-21swapper/323:44:313
3074299129,2cyclictest0-21swapper/323:16:443
3074299129,2cyclictest0-21swapper/323:09:493
3074299129,2cyclictest0-21swapper/321:52:243
3074299129,2cyclictest0-21swapper/321:25:583
3074299129,2cyclictest0-21swapper/321:25:573
3074299129,2cyclictest0-21swapper/300:22:493
3074299129,2cyclictest0-21swapper/300:05:593
3074299121,9cyclictest15306-21ssh22:18:563
3074299120,3cyclictest2957-21sh23:13:403
3074299120,2cyclictest0-21swapper/321:57:433
3074299120,2cyclictest0-21swapper/321:20:193
3074299120,2cyclictest0-21swapper/321:15:213
3074299120,2cyclictest0-21swapper/319:10:173
3074299120,11cyclictest11228-21copy00:30:033
3074299120,11cyclictest0-21swapper/322:55:593
3074299120,11cyclictest0-21swapper/322:33:153
3074299120,11cyclictest0-21swapper/319:31:013
3074299120,10cyclictest32394-21ssh22:02:433
3074199129,2cyclictest0-21swapper/219:50:172
3074199120,2cyclictest4014-21ssh22:40:312
3074199120,2cyclictest0-21swapper/200:20:312
3074199120,1cyclictest0-21swapper/219:35:162
3074099129,2cyclictest221ktimersoftd/121:56:331
3074099129,2cyclictest0-21swapper/123:56:501
3074099129,2cyclictest0-21swapper/119:55:121
3074099129,2cyclictest0-21swapper/119:30:141
3074099129,2cyclictest0-21swapper/100:25:121
3074099129,2cyclictest0-21swapper/100:12:351
3074099128,2cyclictest207150irq/24-eth123:45:381
3074099128,2cyclictest0-21swapper/120:00:151
3074099127,3cyclictest23525-21munin-node1
3074099122,8cyclictest10517-21munin-node1
3074099122,7cyclictest0-21swapper/120:18:591
3074099121,9cyclictest8054-21df22:45:141
3074099121,9cyclictest21236-21tune2fs22:25:131
3074099121,9cyclictest0-21swapper/122:30:191
3074099121,9cyclictest0-21swapper/120:25:001
3074099121,5cyclictest0-21swapper/122:05:011
3074099121,3cyclictest16395-21aten2.4-expect00:35:131
3074099121,3cyclictest16395-21aten2.4-expect00:35:121
3074099121,2cyclictest221ktimersoftd/123:01:261
3074099120,2cyclictest0-21swapper/120:30:171
3074099120,11cyclictest0-21swapper/123:51:111
3074099120,11cyclictest0-21swapper/123:25:301
3074099120,11cyclictest0-21swapper/122:10:181
3074099120,11cyclictest0-21swapper/121:36:001
3074099120,11cyclictest0-21swapper/121:33:311
3074099120,11cyclictest0-21swapper/120:35:181
3073999129,2cyclictest14667-21kworker/u8:120:27:040
3073999129,2cyclictest0-21swapper/023:45:170
3073999129,2cyclictest0-21swapper/019:21:000
3073999120,2cyclictest0-21swapper/022:11:230
3073999120,11cyclictest0-21swapper/023:20:070
3073999120,11cyclictest0-21swapper/019:15:590
3073999120,10cyclictest8911-21ssh00:26:260
129882120,2sleep313501-21diskmemload21:41:513
3074299118,2cyclictest0-21swapper/323:50:103
3074299118,2cyclictest0-21swapper/323:47:153
3074299118,2cyclictest0-21swapper/322:37:093
3074299118,2cyclictest0-21swapper/322:21:553
3074299118,2cyclictest0-21swapper/321:11:553
3074299118,2cyclictest0-21swapper/320:30:103
3074299116,3cyclictest15833-21grep00:00:143
3074299112,6cyclictest0-21swapper/321:08:023
3074299111,6cyclictest0-21swapper/320:25:123
3074299110,9cyclictest13501-21diskmemload22:11:273
3074299110,9cyclictest0-21swapper/321:45:323
3074299110,2cyclictest0-21swapper/320:35:163
3074199118,2cyclictest530-21kworker/u8:219:20:042
3074199118,2cyclictest0-21swapper/220:20:092
3074199118,2cyclictest0-21swapper/219:16:022
3074199110,2cyclictest0-21swapper/220:54:032
3074099118,2cyclictest0-21swapper/123:15:311
3074099117,3cyclictest0-21swapper/120:50:141
3074099116,3cyclictest11492-21munin-node1
3074099111,8cyclictest0-21swapper/119:25:131
3074099111,7cyclictest0-21swapper/120:29:591
3074099110,9cyclictest0-21swapper/120:45:151
3074099110,2cyclictest0-21swapper/100:20:101
3074099110,10cyclictest0-21swapper/120:55:161
3073999118,2cyclictest0-21swapper/020:05:400
3073999118,2cyclictest0-21swapper/019:45:120
3074299105,3cyclictest20852-21grep20:05:133
3074299105,3cyclictest0-21swapper/320:45:003
3074299104,4cyclictest18137-21sshd19:57:333
3074299100,9cyclictest0-21swapper/322:47:273
3074299100,6cyclictest0-21swapper/319:51:013
3074299100,2cyclictest0-21swapper/323:25:323
3074199107,2cyclictest24892-21kworker/u8:020:19:042
3074099107,2cyclictest0-21swapper/120:40:121
3074099106,2cyclictest0-21swapper/119:35:111
3074099105,3cyclictest16060-21iostat_ios21:45:171
3074099100,8cyclictest22777-21smartctl20:10:141
3073999100,9cyclictest0-21swapper/019:40:030
307429994,3cyclictest7992-21df_abs20:55:143
307429994,3cyclictest6147-21fschecks_time20:50:143
307429994,3cyclictest39-21ksoftirqd/319:25:093
307429994,3cyclictest3883-21df_abs20:45:143
307429994,3cyclictest3728-21runrttasks19:16:203
307429994,3cyclictest20257-21taskset20:03:423
307429990,2cyclictest0-21swapper/320:23:593
307419996,2cyclictest13379-21kworker/u8:019:32:042
307419996,2cyclictest0-21swapper/219:10:102
307419994,3cyclictest22791-21hwlatdetect20:10:142
307419990,2cyclictest0-21swapper/219:43:042
307399993,2cyclictest0-21swapper/020:40:030
307399990,8cyclictest0-21swapper/020:36:050
307399990,8cyclictest0-21swapper/019:35:340
307429983,3cyclictest9744-21cut21:00:123
307419984,3cyclictest16935-21df_inode19:55:132
307419983,3cyclictest20831-21cut20:05:132
307399985,2cyclictest0-21swapper/020:10:180
307399983,3cyclictest6480-21aten2.4-expect19:30:120
307399983,3cyclictest26317-21expr20:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional