You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 20:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Mon May 04, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1838221660,3sleep02607299cyclictest09:53:110
259252115104,6sleep30-21swapper/307:08:283
25885211099,6sleep00-21swapper/007:07:550
25794210998,6sleep10-21swapper/107:06:441
25892210484,15sleep20-21swapper/207:08:022
43932850,1sleep00-21swapper/012:35:120
209602780,0sleep30-21swapper/309:20:273
50082760,1sleep30-21swapper/310:13:543
174432710,0sleep00-21swapper/012:14:320
137132700,2sleep012-21rcu_preempt11:35:040
209032530,1sleep20-21swapper/211:06:202
2607599330,2cyclictest0-21swapper/311:30:113
2607499213,17cyclictest0-21swapper/210:34:042
2607399210,2cyclictest0-21swapper/111:30:111
2607299211,18cyclictest10143-21diskmemload11:10:110
2607599200,2cyclictest0-21swapper/311:20:113
2607499203,2cyclictest0-21swapper/211:34:042
26074992017,2cyclictest2843-21kworker/u8:212:39:042
2607299200,2cyclictest0-21swapper/007:25:110
2607299200,15cyclictest0-21swapper/011:32:040
183782200,1sleep118379-21df12:15:141
26074991916,2cyclictest19807-21kworker/u8:010:13:042
26074991916,2cyclictest14798-21kworker/u8:109:20:042
26074991815,2cyclictest533-21kworker/u8:110:58:042
26074991815,2cyclictest3247-21kworker/u8:012:05:042
26074991815,2cyclictest27093-21kworker/u8:209:52:052
26074991815,2cyclictest24531-21kworker/u8:108:30:042
26074991815,2cyclictest22840-21kworker/u8:311:11:042
26074991815,2cyclictest22386-21kworker/u8:207:11:042
26074991815,2cyclictest19807-21kworker/u8:010:18:062
26074991815,2cyclictest17575-21kworker/u8:011:04:052
26074991815,2cyclictest14096-21kworker/u8:109:57:042
26074991815,2cyclictest10097-21kworker/u8:009:10:042
2607299180,13cyclictest0-21swapper/011:21:040
26074991714,2cyclictest533-21kworker/u8:110:53:042
26074991714,2cyclictest4097-21kworker/u8:111:29:052
26074991714,2cyclictest28056-21kworker/u8:008:50:042
26074991714,2cyclictest27093-21kworker/u8:209:34:052
26074991714,2cyclictest22386-21kworker/u8:207:36:042
26074991714,2cyclictest19807-21kworker/u8:010:06:042
26074991714,2cyclictest1944-21kworker/u8:007:48:022
26074991714,2cyclictest14513-21kworker/u8:210:29:042
26074991714,2cyclictest12082-21kworker/u8:211:23:042
2607499170,15cyclictest0-21swapper/208:14:052
2607299170,16cyclictest0-21swapper/011:28:010
2607599165,8cyclictest4556-21metacity07:11:583
2607499161,3cyclictest24990-21perl08:25:132
26074991613,2cyclictest3247-21kworker/u8:012:10:012
26074991613,2cyclictest27093-21kworker/u8:209:38:042
26074991613,2cyclictest25961-21kworker/u8:210:02:012
26074991613,2cyclictest25347-21kworker/u8:012:33:042
26074991613,2cyclictest25132-21kworker/u8:211:55:042
26074991613,2cyclictest22386-21kworker/u8:207:25:042
26074991613,2cyclictest14096-21kworker/u8:109:49:042
26074991613,2cyclictest11133-21kworker/u8:011:46:042
2607499161,13cyclictest18018-21latency_hist11:40:002
2607399161,13cyclictest31866-21munin-node1
26073991611,3cyclictest0-21swapper/109:40:111
2607399160,3cyclictest0-21swapper/111:13:361
2607399160,14cyclictest0-21swapper/110:47:581
2607599150,3cyclictest13463-21cat12:10:003
2607599150,14cyclictest0-21swapper/307:34:553
2607599150,13cyclictest0-21swapper/311:41:013
26074991512,2cyclictest30568-21kworker/u8:109:00:052
26074991512,2cyclictest28056-21kworker/u8:008:55:042
26074991512,2cyclictest27561-21kworker/u8:010:41:052
26074991512,2cyclictest27561-21kworker/u8:010:41:042
26074991512,2cyclictest22386-21kworker/u8:207:32:042
26074991512,2cyclictest19028-21kworker/u8:110:37:042
26074991510,3cyclictest0-21swapper/208:35:062
2607499150,13cyclictest0-21swapper/210:20:132
2607499150,13cyclictest0-21swapper/207:24:052
2607499150,13cyclictest0-21swapper/207:24:042
2607399152,7cyclictest0-21swapper/109:45:001
2607399151,3cyclictest19031-21iostat11:40:141
2607399151,12cyclictest16180-21ssh10:25:241
26073991510,3cyclictest6826-21sh07:40:151
26073991510,3cyclictest6561-21diskmemload11:26:161
26073991510,3cyclictest0-21swapper/112:23:581
2607399150,3cyclictest14060-21ssh10:23:461
2607399150,13cyclictest0-21swapper/107:55:111
2607299150,13cyclictest0-21swapper/010:45:120
2607599146,5cyclictest0-21swapper/308:48:583
26075991411,2cyclictest0-21swapper/312:15:223
26075991410,2cyclictest0-21swapper/309:25:063
2607599140,13cyclictest0-21swapper/307:50:123
2607599140,12cyclictest0-21swapper/310:57:163
2607499140,3cyclictest0-21swapper/208:16:052
2607499140,2cyclictest0-21swapper/210:49:042
2607499140,2cyclictest0-21swapper/207:55:042
2607499140,13cyclictest0-21swapper/209:25:182
2607499140,10cyclictest0-21swapper/211:41:042
2607399142,7cyclictest0-21swapper/108:20:001
2607399142,7cyclictest0-21swapper/107:50:001
26073991411,2cyclictest0-21swapper/111:48:461
26073991411,2cyclictest0-21swapper/110:15:271
2607399140,3cyclictest0-21swapper/112:28:431
2607399140,13cyclictest0-21swapper/110:35:161
2607399140,13cyclictest0-21swapper/109:25:071
2607399140,12cyclictest0-21swapper/109:30:121
26072991411,2cyclictest0-21swapper/011:46:020
26072991411,2cyclictest0-21swapper/009:20:120
26072991410,2cyclictest23289-21hostname12:20:150
2607299140,13cyclictest0-21swapper/007:55:220
2607299140,12cyclictest0-21swapper/011:44:000
176622140,2sleep017672-21ssh11:03:390
2607599139,2cyclictest15635-21entropy09:50:153
2607599132,8cyclictest4556-21metacity07:27:583
2607599132,8cyclictest0-21swapper/309:17:013
2607599131,10cyclictest18142-21ssh11:04:253
26075991310,2cyclictest29031-21munin-node3
26075991310,2cyclictest0-21swapper/307:40:143
2607599130,3cyclictest9632-21ssh09:43:533
2607599130,2cyclictest12344-21popularity-cont07:55:083
2607599130,2cyclictest0-21swapper/310:34:003
2607599130,2cyclictest0-21swapper/310:00:133
2607599130,12cyclictest0-21swapper/312:30:173
2607599130,12cyclictest0-21swapper/312:24:523
2607599130,12cyclictest0-21swapper/311:50:063
2607599130,12cyclictest0-21swapper/309:47:343
2607599130,11cyclictest24823-21ssh11:10:533
2607599130,11cyclictest0-21swapper/312:04:143
26074991310,2cyclictest28056-21kworker/u8:008:42:042
26074991310,2cyclictest0-21swapper/212:04:342
26074991310,2cyclictest0-21swapper/208:00:142
26074991310,2cyclictest0-21swapper/207:40:132
2607499130,2cyclictest0-21swapper/208:46:042
2607499130,2cyclictest0-21swapper/207:54:012
2607499130,2cyclictest0-21swapper/207:18:012
2607499130,2cyclictest0-21swapper/207:18:012
2607499130,12cyclictest0-21swapper/212:21:472
2607499130,12cyclictest0-21swapper/208:21:032
2607499130,11cyclictest0-21swapper/212:25:452
2607499130,11cyclictest0-21swapper/209:19:572
2607399139,2cyclictest8023-21ssh12:39:221
2607399139,2cyclictest0-21swapper/112:11:021
2607399138,3cyclictest32664-21cut11:20:141
2607399138,3cyclictest28583-21sshd11:50:231
2607399138,3cyclictest0-21swapper/108:00:181
2607399138,3cyclictest0-21swapper/107:26:031
2607399133,7cyclictest0-21swapper/107:24:581
2607399133,7cyclictest0-21swapper/107:24:581
2607399132,6cyclictest0-21swapper/109:05:001
26073991310,2cyclictest0-21swapper/111:56:061
26073991310,2cyclictest0-21swapper/109:51:411
26073991310,2cyclictest0-21swapper/109:36:361
26073991310,2cyclictest0-21swapper/109:22:401
26073991310,2cyclictest0-21swapper/109:05:361
26073991310,2cyclictest0-21swapper/107:15:181
26073991310,2cyclictest0-21swapper/107:15:171
2607399130,2cyclictest0-21swapper/107:10:141
2607399130,1cyclictest0-21swapper/111:06:061
2607399130,12cyclictest0-21swapper/111:16:161
2607399130,12cyclictest0-21swapper/110:01:211
2607399130,11cyclictest10143-21diskmemload12:07:101
2607399130,11cyclictest0-21swapper/111:00:491
2607399130,11cyclictest0-21swapper/109:55:501
26072991310,2cyclictest13070-21ssh12:09:330
26072991310,2cyclictest12345-21timerandwakeup09:46:030
26072991310,2cyclictest0-21swapper/012:15:120
26072991310,2cyclictest0-21swapper/011:56:000
26072991310,2cyclictest0-21swapper/011:50:130
26072991310,2cyclictest0-21swapper/010:21:590
2607299130,2cyclictest26180-21ssh10:36:320
2607299130,2cyclictest10143-21diskmemload09:40:150
2607299130,2cyclictest0-21swapper/012:30:080
2607299130,2cyclictest0-21swapper/010:51:030
2607299130,2cyclictest0-21swapper/010:40:080
2607299130,2cyclictest0-21swapper/010:40:080
2607299130,2cyclictest0-21swapper/009:25:180
2607299130,2cyclictest0-21swapper/008:56:000
2607299130,12cyclictest0-21swapper/012:26:590
2607299130,12cyclictest0-21swapper/009:30:110
2607299130,11cyclictest0-21swapper/009:16:190
2607599129,2cyclictest0-21swapper/312:27:263
2607599129,2cyclictest0-21swapper/308:55:133
2607599129,2cyclictest0-21swapper/307:36:003
2607599127,3cyclictest0-21swapper/308:10:173
2607599122,7cyclictest0-21swapper/309:58:013
2607599120,2cyclictest14944-21ssh11:35:263
2607599120,2cyclictest0-21swapper/312:10:163
2607599120,2cyclictest0-21swapper/311:55:563
2607599120,2cyclictest0-21swapper/310:45:003
2607599120,2cyclictest0-21swapper/308:35:153
2607599120,11cyclictest14402-21ssh10:24:223
2607599120,11cyclictest0-21swapper/309:35:143
2607599120,10cyclictest0-21swapper/310:39:163
2607499129,2cyclictest0-21swapper/209:42:432
2607499120,11cyclictest0-21swapper/212:16:412
2607499120,11cyclictest0-21swapper/211:53:062
2607499120,11cyclictest0-21swapper/211:20:002
2607499120,11cyclictest0-21swapper/209:07:042
2607499120,11cyclictest0-21swapper/208:05:042
2607399129,2cyclictest10143-21diskmemload10:55:191
2607399129,2cyclictest0-21swapper/112:04:221
2607399129,2cyclictest0-21swapper/110:05:201
2607399121,9cyclictest0-21swapper/110:30:141
2607399121,9cyclictest0-21swapper/108:45:171
2607399121,9cyclictest0-21swapper/108:20:121
2607399121,6cyclictest0-21swapper/108:40:001
26073991210,1cyclictest0-21swapper/107:35:171
2607399120,2cyclictest0-21swapper/109:12:021
2607399120,11cyclictest0-21swapper/111:35:311
2607399120,11cyclictest0-21swapper/110:44:481
2607399120,11cyclictest0-21swapper/110:44:481
2607399120,11cyclictest0-21swapper/110:10:401
2607399120,11cyclictest0-21swapper/109:16:401
2607399120,11cyclictest0-21swapper/108:50:131
2607399120,11cyclictest0-21swapper/108:25:151
2607399120,10cyclictest0-21swapper/110:50:401
2607299129,2cyclictest13312-21ssh09:12:330
2607299129,2cyclictest0-21swapper/012:01:100
2607299129,2cyclictest0-21swapper/011:15:160
2607299129,2cyclictest0-21swapper/010:55:080
2607299129,2cyclictest0-21swapper/010:17:120
2607299129,2cyclictest0-21swapper/009:35:080
2607299129,2cyclictest0-21swapper/009:05:000
2607299129,2cyclictest0-21swapper/008:30:030
2607299120,2cyclictest0-21swapper/010:29:380
2607299120,2cyclictest0-21swapper/010:05:220
2607299120,2cyclictest0-21swapper/008:00:160
2607299120,2cyclictest0-21swapper/007:31:030
2607299120,11cyclictest10143-21diskmemload10:00:090
2607299120,11cyclictest0-21swapper/011:05:480
2607299120,11cyclictest0-21swapper/010:30:500
2607299120,11cyclictest0-21swapper/010:10:410
2607299120,11cyclictest0-21swapper/009:57:090
2607599118,2cyclictest0-21swapper/312:35:533
2607599118,2cyclictest0-21swapper/310:26:063
2607599118,2cyclictest0-21swapper/310:17:203
2607599118,2cyclictest0-21swapper/310:05:163
2607599118,2cyclictest0-21swapper/309:10:433
2607599118,2cyclictest0-21swapper/309:05:173
2607599118,2cyclictest0-21swapper/308:51:023
2607599118,2cyclictest0-21swapper/307:21:043
2607599118,2cyclictest0-21swapper/307:21:033
2607599117,3cyclictest0-21swapper/311:16:553
2607599112,7cyclictest0-21swapper/308:31:583
2607599112,7cyclictest0-21swapper/308:22:583
2607599112,7cyclictest0-21swapper/308:00:013
2607599110,9cyclictest0-21swapper/311:25:393
2607599110,10cyclictest0-21swapper/311:45:393
2607599110,10cyclictest0-21swapper/311:05:203
2607599110,10cyclictest0-21swapper/307:45:513
2607399117,2cyclictest0-21swapper/108:40:141
2607399117,2cyclictest0-21swapper/108:10:141
2607399117,2cyclictest0-21swapper/107:30:161
2607399111,8cyclictest0-21swapper/108:05:131
2607399110,9cyclictest26264-21apt-get08:30:041
2607399110,9cyclictest0-21swapper/107:45:151
2607399110,3cyclictest0-21swapper/108:55:111
2607299118,2cyclictest0-21swapper/008:50:120
2607299118,2cyclictest0-21swapper/007:40:190
2607299118,2cyclictest0-21swapper/007:10:170
2607299113,5cyclictest0-21swapper/008:26:590
2607299112,6cyclictest0-21swapper/007:39:020
317022100,1sleep00-21swapper/008:41:020
2607599107,2cyclictest0-21swapper/310:41:163
2607599107,2cyclictest0-21swapper/310:41:163
2607599107,2cyclictest0-21swapper/308:05:123
2607599102,5cyclictest0-21swapper/309:01:013
2607599100,9cyclictest0-21swapper/310:50:253
2607299107,2cyclictest0-21swapper/008:15:010
2607299100,8cyclictest28304-21apt-get08:35:060
29846290,6sleep00-21swapper/007:17:020
29846290,6sleep00-21swapper/007:17:010
260759990,2cyclictest0-21swapper/308:15:053
260729996,2cyclictest0-21swapper/007:45:160
260729995,2cyclictest3728-21runrttasks07:22:240
260729995,2cyclictest3728-21runrttasks07:22:240
260729990,8cyclictest0-21swapper/007:50:210
260729990,7cyclictest0-21swapper/008:46:020
260729990,6cyclictest0-21swapper/008:12:580
16460290,1sleep00-21swapper/008:05:130
260759984,2cyclictest28567-21grep07:15:133
260759984,2cyclictest28567-21grep07:15:133
260759983,3cyclictest30842-21cut08:40:143
260759983,3cyclictest24620-21aten2.4-expect08:25:123
260729985,2cyclictest0-21swapper/008:20:280
260729980,5cyclictest0-21swapper/009:00:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional