You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 01:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Mon Aug 17, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11842211694,16sleep10-21swapper/119:07:451
11777211695,16sleep30-21swapper/319:06:543
11774211086,18sleep00-21swapper/019:06:520
11816210796,6sleep20-21swapper/219:07:262
971121020,1sleep09709-21ssh21:23:530
199652910,1sleep10-21swapper/123:46:531
12842830,1sleep0101ktimersoftd/022:55:170
81252720,1sleep20-21swapper/220:20:132
167282700,0sleep20-21swapper/220:40:172
51742220,1sleep10-21swapper/122:25:191
12046992219,2cyclictest1574-21kworker/u8:222:29:053
1204399222,18cyclictest101ktimersoftd/023:15:130
12046992118,2cyclictest442-21kworker/u8:121:17:053
12046992118,2cyclictest442-21kworker/u8:121:17:053
12046992118,2cyclictest2846-21kworker/u8:021:52:063
12046992118,2cyclictest20256-21kworker/u8:221:22:043
12043992112,7cyclictest0-21swapper/022:04:020
1204399210,19cyclictest12484-21ssh00:12:340
12046992017,2cyclictest4082-21kworker/u8:123:32:053
12046992017,2cyclictest28445-21kworker/u8:022:20:013
12046992017,2cyclictest28085-21kworker/u8:121:43:043
12046992017,2cyclictest20256-21kworker/u8:222:13:043
1204699200,17cyclictest0-21swapper/322:49:043
1204399201,4cyclictest0-21swapper/023:30:000
1204399200,2cyclictest0-21swapper/000:30:180
1204399200,11cyclictest890-21ssh00:00:350
1204399200,11cyclictest0-21swapper/022:14:100
12046991916,2cyclictest8900-21kworker/u8:122:37:043
12046991916,2cyclictest29711-21kworker/u8:023:50:053
12046991916,2cyclictest24332-21kworker/u8:223:29:053
12046991916,2cyclictest22649-21kworker/u8:021:39:053
12046991916,2cyclictest18338-21kworker/u8:123:13:043
12046991916,2cyclictest1574-21kworker/u8:222:32:043
12046991916,2cyclictest15562-21kworker/u8:022:56:043
12046991916,2cyclictest15562-21kworker/u8:022:50:063
12046991916,2cyclictest14071-21kworker/u8:022:07:043
12046991916,2cyclictest14071-21kworker/u8:022:02:053
1204499190,2cyclictest0-21swapper/121:49:041
1204499190,2cyclictest0-21swapper/100:15:121
1204499190,2cyclictest0-21swapper/100:15:111
1204399190,2cyclictest0-21swapper/023:14:030
1204399190,2cyclictest0-21swapper/021:47:250
1204399190,17cyclictest27992-21diskmemload22:06:130
1204399190,11cyclictest27992-21diskmemload00:27:380
1204399190,11cyclictest20065-21ssh23:47:030
12046991815,2cyclictest6238-21kworker/u8:200:12:053
12046991815,2cyclictest29711-21kworker/u8:000:23:043
12046991815,2cyclictest29711-21kworker/u8:000:09:073
12046991815,2cyclictest28085-21kworker/u8:121:47:043
12046991815,2cyclictest25181-21kworker/u8:223:58:023
12046991815,2cyclictest23463-21kworker/u8:019:34:013
12046991815,2cyclictest14768-21kworker/u8:121:32:043
12046991815,2cyclictest14480-21kworker/u8:100:39:053
12046991815,2cyclictest14480-21kworker/u8:100:17:053
12046991815,2cyclictest14480-21kworker/u8:100:17:043
1204399188,8cyclictest0-21swapper/022:30:020
1204399187,2cyclictest0-21swapper/022:54:350
1204399186,3cyclictest3960-21ssh21:50:230
12043991810,6cyclictest10820-21ssh21:25:150
1204399180,2cyclictest0-21swapper/023:05:200
1204399180,17cyclictest0-21swapper/023:43:370
1204399180,17cyclictest0-21swapper/022:28:470
1204399180,17cyclictest0-21swapper/021:37:320
1204399180,11cyclictest11874-21ssh21:59:130
12046991714,2cyclictest4661-21kworker/u8:120:14:043
12046991714,2cyclictest23463-21kworker/u8:019:10:013
12046991714,2cyclictest20375-21kworker/u8:219:45:043
12046991714,2cyclictest18338-21kworker/u8:123:21:043
12046991714,2cyclictest1783-21kworker/u8:223:07:053
12046991714,2cyclictest1566-21kworker/u8:020:04:053
12046991714,2cyclictest14299-21kworker/u8:119:24:053
12046991714,2cyclictest11539-21kworker/u8:020:44:053
12046991713,3cyclictest24379-21kworker/u8:119:54:053
1204399179,7cyclictest0-21swapper/023:23:500
1204399179,7cyclictest0-21swapper/021:42:580
1204399179,7cyclictest0-21swapper/000:24:300
1204399176,2cyclictest0-21swapper/000:15:480
1204399176,2cyclictest0-21swapper/000:15:470
1204399175,3cyclictest5690-1kworker/u9:023:00:210
1204399171,4cyclictest0-21swapper/019:50:000
1204399170,2cyclictest0-21swapper/020:20:130
1204399170,16cyclictest0-21swapper/022:17:190
1204399170,15cyclictest0-21swapper/023:38:470
12046991613,2cyclictest7156-21kworker/u8:323:02:013
12046991613,2cyclictest31737-21kworker/u8:220:07:053
12046991613,2cyclictest28445-21kworker/u8:022:16:053
12046991613,2cyclictest20375-21kworker/u8:219:44:053
12046991613,2cyclictest20256-21kworker/u8:220:57:053
12046991613,2cyclictest14480-21kworker/u8:100:25:053
12046991613,2cyclictest14299-21kworker/u8:119:25:053
12046991613,2cyclictest11539-21kworker/u8:021:12:043
12046991613,2cyclictest11539-21kworker/u8:020:33:053
12046991613,2cyclictest11084-21kworker/u8:223:43:053
1204699160,2cyclictest0-21swapper/323:49:043
1204699160,2cyclictest0-21swapper/323:38:043
1204699160,2cyclictest0-21swapper/300:33:043
1204699160,14cyclictest0-21swapper/321:30:013
12045991611,3cyclictest0-21swapper/223:40:002
1204599161,13cyclictest0-21swapper/221:36:372
12044991613,2cyclictest15562-21kworker/u8:022:49:041
1204399169,6cyclictest0-21swapper/023:50:090
1204399165,2cyclictest22150irq/25-ahci[00021:34:190
1204399164,3cyclictest4410-21fschecks_count20:10:160
1204399164,3cyclictest21949-21sendmail-mta19:34:320
1204399164,2cyclictest17232-21sh22:38:350
1204399163,3cyclictest406-21wc22:20:180
1204399162,3cyclictest0-21swapper/020:00:000
1204399161,6cyclictest27992-21diskmemload23:57:300
1204399161,4cyclictest460-21gpgv21:15:010
1204399161,4cyclictest3501-21grep00:36:040
1204399161,4cyclictest23861-21ssh22:45:160
1204399161,4cyclictest19513-21proc_pri22:40:190
1204399161,3cyclictest6382-21ssh23:33:340
1204399160,15cyclictest0-21swapper/000:06:290
1204399160,10cyclictest0-21swapper/021:18:100
1204399160,10cyclictest0-21swapper/021:18:090
12046991512,2cyclictest8900-21kworker/u8:122:41:053
1204699150,13cyclictest0-21swapper/300:03:043
12045991510,3cyclictest2965-21ssh22:23:492
1204599150,2cyclictest0-21swapper/200:36:072
1204599150,13cyclictest12320-21runrttasks00:12:172
1204599150,13cyclictest0-21swapper/222:59:062
1204599150,13cyclictest0-21swapper/222:45:062
1204599150,13cyclictest0-21swapper/221:40:152
1204499150,13cyclictest0-21swapper/119:50:171
1204399154,3cyclictest23425-21mailstats19:35:590
1204399154,2cyclictest10689-21if_eth020:25:160
1204399154,2cyclictest0-21swapper/019:54:000
1204399153,3cyclictest7138-21tr20:16:000
1204399153,3cyclictest24894-21cut19:40:150
1204399153,3cyclictest22684-21fschecks_time20:55:160
1204399153,3cyclictest20165-21cut20:50:110
1204399153,3cyclictest12077-21munin-node0
1204399153,2cyclictest0-21swapper/019:15:130
1204399152,3cyclictest18371-21cpuspeed_turbos20:45:140
1204399152,3cyclictest0-21swapper/021:05:130
1204399151,4cyclictest32453-21aten2.4_r3power20:00:140
1204399151,4cyclictest16544-21cpuspeed_turbos19:20:150
1204399151,3cyclictest3157-21lldpd20:40:160
7582140,2sleep20-21swapper/223:27:422
173172140,1sleep2301ktimersoftd/219:20:302
12046991411,2cyclictest7053-21kworker/u8:220:23:043
12046991411,2cyclictest23463-21kworker/u8:019:18:053
12046991411,2cyclictest11539-21kworker/u8:020:53:053
12046991411,2cyclictest11539-21kworker/u8:020:27:053
1204699140,2cyclictest0-21swapper/321:57:043
12045991411,2cyclictest0-21swapper/223:05:172
12045991411,2cyclictest0-21swapper/221:47:262
12045991410,2cyclictest0-21swapper/223:00:172
1204599140,3cyclictest19645-21ssh23:46:232
1204599140,2cyclictest0-21swapper/221:57:062
1204599140,2cyclictest0-21swapper/221:53:572
1204599140,13cyclictest22320-21ssh00:22:362
1204599140,13cyclictest20943-21ssh22:41:472
1204599140,13cyclictest0-21swapper/222:31:172
1204599140,13cyclictest0-21swapper/222:27:472
1204599140,12cyclictest27992-21diskmemload21:12:362
12044991411,2cyclictest27992-21diskmemload00:24:161
12044991411,2cyclictest0-21swapper/123:23:171
12044991411,2cyclictest0-21swapper/123:18:361
12044991411,2cyclictest0-21swapper/122:36:361
12044991411,2cyclictest0-21swapper/121:24:061
1204499141,11cyclictest30635-21diskstats23:25:171
12044991410,2cyclictest0-21swapper/122:54:031
1204499140,3cyclictest6369-21fschecks_time23:00:161
1204499140,2cyclictest0-21swapper/122:32:271
1204499140,13cyclictest0-21swapper/123:56:271
1204499140,13cyclictest0-21swapper/122:13:561
1204499140,12cyclictest0-21swapper/123:42:091
1204499140,12cyclictest0-21swapper/121:41:021
1204499140,12cyclictest0-21swapper/100:39:491
1204399143,2cyclictest0-21swapper/021:04:050
1204399141,3cyclictest3860-21cat20:10:010
1204399141,3cyclictest3728-21runrttasks20:38:000
1204399141,3cyclictest12350-21aten2.4-expect19:10:120
1204399140,3cyclictest19722-21grep19:26:040
126662130,2sleep20-21swapper/222:00:052
12046991310,2cyclictest23463-21kworker/u8:019:37:053
12046991310,2cyclictest11539-21kworker/u8:021:06:023
1204699130,12cyclictest0-21swapper/320:38:043
1204599132,6cyclictest0-21swapper/219:55:012
12045991311,1cyclictest0-21swapper/221:28:372
12045991310,2cyclictest2469-21ssh23:30:012
12045991310,2cyclictest0-21swapper/223:55:572
12045991310,2cyclictest0-21swapper/223:22:062
12045991310,2cyclictest0-21swapper/223:10:152
12045991310,2cyclictest0-21swapper/222:50:352
12045991310,2cyclictest0-21swapper/222:35:112
12045991310,2cyclictest0-21swapper/221:21:122
12045991310,2cyclictest0-21swapper/221:15:372
12045991310,2cyclictest0-21swapper/221:15:362
12045991310,2cyclictest0-21swapper/200:31:442
12045991310,2cyclictest0-21swapper/200:00:282
1204599130,2cyclictest0-21swapper/223:51:242
1204599130,2cyclictest0-21swapper/223:42:372
1204599130,2cyclictest0-21swapper/223:16:382
1204599130,2cyclictest0-21swapper/222:05:092
1204599130,2cyclictest0-21swapper/200:15:472
1204599130,2cyclictest0-21swapper/200:15:462
1204599130,12cyclictest0-21swapper/222:17:472
1204599130,12cyclictest0-21swapper/222:10:562
1204599130,12cyclictest0-21swapper/220:36:042
12044991310,2cyclictest32007-21apt-get22:20:121
12044991310,2cyclictest29711-21kworker/u8:023:33:051
12044991310,2cyclictest27992-21diskmemload21:34:571
12044991310,2cyclictest0-21swapper/123:35:531
12044991310,2cyclictest0-21swapper/122:18:571
12044991310,2cyclictest0-21swapper/121:50:271
12044991310,2cyclictest0-21swapper/119:30:141
12044991310,2cyclictest0-21swapper/100:30:031
12044991310,2cyclictest0-21swapper/100:10:271
1204499130,2cyclictest0-21swapper/123:14:061
1204499130,2cyclictest0-21swapper/122:55:271
1204499130,2cyclictest0-21swapper/121:15:561
1204499130,2cyclictest0-21swapper/121:15:551
1204499130,2cyclictest0-21swapper/119:25:181
1204499130,12cyclictest0-21swapper/122:05:311
1204499130,12cyclictest0-21swapper/122:00:121
1204499130,12cyclictest0-21swapper/121:10:281
1204499130,12cyclictest0-21swapper/120:55:011
1204499130,12cyclictest0-21swapper/120:45:311
1204499130,11cyclictest3728-21runrttasks23:51:561
1204599129,2cyclictest0-21swapper/221:30:062
1204599129,2cyclictest0-21swapper/221:00:142
1204599129,2cyclictest0-21swapper/220:31:072
1204599129,2cyclictest0-21swapper/220:13:282
1204599123,5cyclictest0-21swapper/219:16:002
1204599122,7cyclictest0-21swapper/220:45:012
1204599120,2cyclictest0-21swapper/220:00:402
1204599120,11cyclictest0-21swapper/220:05:132
1204599120,11cyclictest0-21swapper/219:41:032
1204599120,11cyclictest0-21swapper/219:30:142
1204599120,11cyclictest0-21swapper/200:25:202
1204599120,11cyclictest0-21swapper/200:05:202
1204499129,2cyclictest594-21iostat20:00:171
1204499129,2cyclictest0-21swapper/121:55:321
1204499129,2cyclictest0-21swapper/100:00:291
1204499120,2cyclictest0-21swapper/121:35:441
1204499120,2cyclictest0-21swapper/121:25:391
1204499120,2cyclictest0-21swapper/121:05:511
1204499120,2cyclictest0-21swapper/119:35:381
1204499120,11cyclictest0-21swapper/123:05:331
1204499120,11cyclictest0-21swapper/122:40:131
1204499120,11cyclictest0-21swapper/120:40:131
1204499120,11cyclictest0-21swapper/120:33:111
1204499120,11cyclictest0-21swapper/120:26:011
1204499120,11cyclictest0-21swapper/119:55:131
1204499120,11cyclictest0-21swapper/119:20:201
1204499120,11cyclictest0-21swapper/100:26:101
1204499120,11cyclictest0-21swapper/100:05:101
70742110,1sleep10-21swapper/120:15:441
1204699118,2cyclictest11539-21kworker/u8:020:45:043
1204699110,10cyclictest0-21swapper/320:15:443
1204699110,10cyclictest0-21swapper/319:56:013
1204599118,2cyclictest0-21swapper/220:51:002
1204599118,2cyclictest0-21swapper/220:16:052
1204599113,4cyclictest0-21swapper/219:46:022
1204599112,6cyclictest0-21swapper/219:39:012
1204599110,2cyclictest0-21swapper/219:14:392
1204499118,2cyclictest0-21swapper/120:24:401
1204499110,9cyclictest26349-21munin-node1
1204499110,9cyclictest0-21swapper/119:40:191
1204499110,3cyclictest12257-21munin-node1
1204499110,2cyclictest0-21swapper/120:05:201
50642100,1sleep10-21swapper/120:10:431
227962100,2sleep30-21swapper/323:16:423
1204599105,3cyclictest26773-21grep21:05:162
1204499100,8cyclictest24192-21munin-node1
1204499100,8cyclictest0-21swapper/120:50:151
1204499100,2cyclictest3728-21runrttasks19:15:141
120459996,2cyclictest0-21swapper/220:55:182
120459994,3cyclictest29999-21sendmail-mta19:54:262
120459994,3cyclictest18543-21grep19:25:152
120459994,3cyclictest10641-21sh20:25:152
120449990,8cyclictest0-21swapper/120:35:111
120469983,3cyclictest24431-21cut21:00:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional