You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 09:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sun Jun 28, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51772116104,6sleep20-21swapper/219:05:132
5148211494,15sleep10-21swapper/119:05:041
5150211291,16sleep30-21swapper/319:05:063
6686210888,15sleep00-21swapper/019:06:430
97022950,0sleep10-21swapper/121:30:111
697299360,34cyclictest0-21swapper/320:15:113
136242240,0sleep20-21swapper/200:30:132
697299221,19cyclictest0-21swapper/321:20:123
697099211,2cyclictest0-21swapper/100:20:121
696999190,18cyclictest0-21swapper/020:25:110
696999190,14cyclictest0-21swapper/022:44:040
696999190,14cyclictest0-21swapper/022:20:040
79652170,1sleep00-21swapper/022:38:120
6971991714,2cyclictest17690-21kworker/u8:022:36:042
697199161,3cyclictest21015-21munin-run21:05:012
697199161,3cyclictest0-21swapper/223:50:512
6971991613,2cyclictest31976-21kworker/u8:021:24:042
6971991613,2cyclictest21264-21kworker/u8:121:40:042
697199161,13cyclictest3821-21runrttasks00:19:552
697199160,3cyclictest0-21swapper/223:08:562
697199160,3cyclictest0-21swapper/200:01:052
697199160,3cyclictest0-21swapper/200:01:042
697199160,2cyclictest0-21swapper/221:28:022
697199160,14cyclictest0-21swapper/222:11:002
6970991611,3cyclictest0-21swapper/122:11:381
697099161,13cyclictest0-21swapper/121:05:171
697099160,14cyclictest17356-21aten2.4-expect20:55:121
71212151,3sleep07253-21hostname20:30:120
697299151,3cyclictest5374-21wc22:35:153
697299151,3cyclictest0-21swapper/322:26:053
697299151,12cyclictest3158-21dbus-daemon23:40:053
6972991510,3cyclictest0-21swapper/323:31:013
697299150,13cyclictest18133-21sort22:50:003
6971991512,2cyclictest27046-21kworker/u8:221:14:012
6971991512,2cyclictest26726-21kworker/u8:023:57:042
6971991511,2cyclictest29414-21sh00:11:162
697199151,12cyclictest12396-21ssh21:32:362
6971991510,3cyclictest0-21swapper/222:05:192
697099151,2cyclictest8087-21diskmemload23:13:581
697099151,12cyclictest0-21swapper/119:50:131
6970991510,3cyclictest14365-21diskmemload23:20:151
697099150,13cyclictest0-21swapper/122:05:491
6969991512,2cyclictest3152-21nscd22:51:410
6969991511,2cyclictest0-21swapper/020:05:150
696999150,13cyclictest0-21swapper/021:49:010
696999150,13cyclictest0-21swapper/000:15:160
140072151,3sleep00-21swapper/019:25:190
697299149,3cyclictest9387-21latency_hist21:30:013
697299149,3cyclictest601-21sed23:05:163
6972991410,2cyclictest10174-21ssh00:25:423
697299140,12cyclictest0-21swapper/322:40:143
697299140,12cyclictest0-21swapper/319:30:093
697199141,2cyclictest18101-21apt-get00:35:102
6971991411,2cyclictest8808-21kworker/u8:020:34:042
6971991411,2cyclictest6687-21kworker/u8:019:11:052
6971991411,2cyclictest23021-21diskmemload23:35:182
6971991411,2cyclictest21264-21kworker/u8:121:45:042
6971991411,2cyclictest18382-21kworker/u8:219:29:042
6971991411,2cyclictest17690-21kworker/u8:022:17:052
6971991411,2cyclictest0-21swapper/223:17:352
6971991411,2cyclictest0-21swapper/222:24:352
697199140,3cyclictest0-21swapper/222:26:222
697199140,2cyclictest0-21swapper/223:41:462
697199140,13cyclictest0-21swapper/222:54:052
697199140,12cyclictest28639-21smartctl21:50:162
697199140,12cyclictest0-21swapper/222:00:102
697199140,12cyclictest0-21swapper/221:35:572
697199140,12cyclictest0-21swapper/221:15:132
697099149,3cyclictest28323-21diskstats22:25:141
6970991411,2cyclictest0-21swapper/123:57:391
697099141,11cyclictest0-21swapper/121:55:191
6970991410,2cyclictest17553-21sh19:35:141
697099140,2cyclictest0-21swapper/121:50:291
697099140,2cyclictest0-21swapper/100:02:281
697099140,2cyclictest0-21swapper/100:02:281
697099140,13cyclictest0-21swapper/122:47:081
697099140,12cyclictest19875-21modprobe21:00:151
696999149,3cyclictest6177-21timerandwakeup23:11:020
6969991410,2cyclictest32430-21munin-node0
696999140,2cyclictest0-21swapper/023:53:110
696999140,2cyclictest0-21swapper/000:27:410
696999140,13cyclictest0-21swapper/020:15:120
696999140,12cyclictest24755-21runrttasks23:31:080
696999140,12cyclictest23021-21diskmemload22:25:120
696999140,12cyclictest18416-21latency_hist22:15:000
696999140,12cyclictest14824-21ssh23:55:430
696999140,12cyclictest0-21swapper/023:01:440
696999140,12cyclictest0-21swapper/022:45:160
696999140,12cyclictest0-21swapper/022:15:100
696999140,12cyclictest0-21swapper/000:04:370
696999140,12cyclictest0-21swapper/000:04:370
15282140,2sleep00-21swapper/021:20:490
697299138,3cyclictest10178-21ssh23:50:313
697299132,6cyclictest0-21swapper/321:10:003
6972991310,2cyclictest0-21swapper/323:21:033
697299130,2cyclictest0-21swapper/321:55:003
697299130,2cyclictest0-21swapper/300:06:213
697299130,12cyclictest0-21swapper/323:11:013
697299130,12cyclictest0-21swapper/322:03:023
697299130,11cyclictest30651-21ssh00:13:213
697199131,10cyclictest0-21swapper/220:25:122
6971991310,2cyclictest26775-21kworker/u8:220:05:042
6971991310,2cyclictest0-21swapper/223:22:352
6971991310,2cyclictest0-21swapper/223:00:352
6971991310,2cyclictest0-21swapper/222:55:192
6971991310,2cyclictest0-21swapper/219:55:152
697199130,8cyclictest0-21swapper/220:36:052
697199130,12cyclictest0-21swapper/223:26:212
697199130,12cyclictest0-21swapper/200:21:042
697199130,11cyclictest0-21swapper/223:32:552
697099139,2cyclictest0-21swapper/122:55:301
697099138,3cyclictest0-21swapper/122:55:001
697099131,2cyclictest24634-21ssh21:10:391
6970991310,2cyclictest0-21swapper/123:43:181
6970991310,2cyclictest0-21swapper/121:25:111
6970991310,2cyclictest0-21swapper/121:15:171
6970991310,2cyclictest0-21swapper/100:05:191
697099130,2cyclictest0-21swapper/123:26:281
697099130,2cyclictest0-21swapper/123:16:291
697099130,2cyclictest0-21swapper/123:05:061
697099130,2cyclictest0-21swapper/122:40:491
697099130,2cyclictest0-21swapper/122:35:111
697099130,2cyclictest0-21swapper/100:25:391
697099130,12cyclictest31991-21kworker/u8:123:45:041
697099130,12cyclictest23021-21diskmemload21:20:121
697099130,12cyclictest0-21swapper/123:36:281
697099130,12cyclictest0-21swapper/122:15:091
697099130,12cyclictest0-21swapper/119:35:001
697099130,11cyclictest0-21swapper/123:00:121
6969991310,2cyclictest0-21swapper/023:37:560
6969991310,2cyclictest0-21swapper/023:09:410
6969991310,2cyclictest0-21swapper/022:59:420
6969991310,2cyclictest0-21swapper/022:01:030
6969991310,2cyclictest0-21swapper/021:56:410
6969991310,2cyclictest0-21swapper/021:11:250
6969991310,2cyclictest0-21swapper/000:39:130
6969991310,2cyclictest0-21swapper/000:11:030
696999130,2cyclictest0-21swapper/023:46:440
696999130,2cyclictest0-21swapper/023:18:410
696999130,2cyclictest0-21swapper/021:33:310
696999130,2cyclictest0-21swapper/021:26:010
696999130,2cyclictest0-21swapper/021:17:420
696999130,2cyclictest0-21swapper/019:40:500
696999130,12cyclictest0-21swapper/021:41:120
696999130,11cyclictest0-21swapper/023:20:050
696999130,11cyclictest0-21swapper/022:05:380
696999130,11cyclictest0-21swapper/000:30:540
247382130,2sleep10-21swapper/121:45:391
697299128,2cyclictest0-21swapper/323:45:063
697299122,6cyclictest0-21swapper/322:35:003
697299122,6cyclictest0-21swapper/319:50:013
697299121,6cyclictest0-21swapper/320:15:013
697299120,2cyclictest0-21swapper/321:47:313
697299120,2cyclictest0-21swapper/321:31:003
697299120,11cyclictest0-21swapper/323:57:313
697299120,11cyclictest0-21swapper/300:15:173
697299120,10cyclictest18022-21sh00:00:033
697299120,10cyclictest18022-21sh00:00:023
697299120,10cyclictest0-21swapper/321:35:213
697199129,2cyclictest2605-21kworker/u8:220:43:042
697199129,2cyclictest23271-21kworker/u8:222:40:052
697199129,2cyclictest21264-21kworker/u8:121:55:042
697199129,2cyclictest18382-21kworker/u8:219:45:042
697199129,2cyclictest0-21swapper/222:45:182
697199129,2cyclictest0-21swapper/200:06:382
697199120,7cyclictest0-21swapper/219:38:052
697199120,2cyclictest0-21swapper/223:45:022
697199120,2cyclictest0-21swapper/219:15:002
697199120,11cyclictest0-21swapper/222:31:172
697199120,11cyclictest0-21swapper/220:46:022
697199120,10cyclictest0-21swapper/223:11:522
697099129,2cyclictest0-21swapper/123:30:591
697099129,2cyclictest0-21swapper/121:40:301
697099128,2cyclictest0-21swapper/120:05:161
697099121,9cyclictest9670-21taskset19:15:141
697099121,9cyclictest21-21rcuc/120:45:131
697099121,9cyclictest0-21swapper/119:20:171
697099121,3cyclictest0-21swapper/122:20:181
697099121,3cyclictest0-21swapper/100:36:011
697099121,3cyclictest0-21swapper/100:11:051
697099120,2cyclictest0-21swapper/122:02:091
697099120,11cyclictest0-21swapper/122:33:491
697099120,11cyclictest0-21swapper/120:25:121
697099120,11cyclictest0-21swapper/120:00:291
697099120,11cyclictest0-21swapper/119:45:161
697099120,11cyclictest0-21swapper/100:17:201
696999129,2cyclictest0-21swapper/000:20:150
696999123,5cyclictest0-21swapper/020:23:040
696999120,2cyclictest16271-21ssh21:36:190
696999120,2cyclictest0-21swapper/019:10:190
696999120,11cyclictest0-21swapper/023:40:570
696999120,11cyclictest0-21swapper/023:26:220
696999120,11cyclictest0-21swapper/021:51:590
696999120,11cyclictest0-21swapper/000:09:020
130952120,2sleep10-21swapper/123:54:501
697299118,2cyclictest29235-21ssh21:15:303
697299118,2cyclictest0-21swapper/323:36:073
697299118,2cyclictest0-21swapper/322:20:123
697299118,2cyclictest0-21swapper/322:15:473
697299118,2cyclictest0-21swapper/322:05:143
697299118,2cyclictest0-21swapper/300:35:173
697299116,3cyclictest19474-21grep21:00:133
697299116,3cyclictest0-21swapper/320:55:173
697299114,3cyclictest26519-21cat19:56:023
697299112,7cyclictest0-21swapper/320:37:593
697299112,5cyclictest0-21swapper/320:31:013
697299110,2cyclictest0-21swapper/323:03:323
697299110,2cyclictest0-21swapper/321:41:323
697299110,2cyclictest0-21swapper/300:31:223
697199118,2cyclictest26775-21kworker/u8:220:02:052
697199118,2cyclictest0-21swapper/219:50:482
697199118,2cyclictest0-21swapper/200:25:272
697199112,7cyclictest0-21swapper/220:59:012
697199110,10cyclictest0-21swapper/219:44:242
697099119,1cyclictest0-21swapper/119:55:191
697099117,2cyclictest0-21swapper/120:30:121
697099116,3cyclictest3198-21cpuspeed_turbos20:20:131
697099114,5cyclictest0-21swapper/121:35:141
697099112,5cyclictest0-21swapper/119:10:011
697099111,2cyclictest31338-21apt-get20:10:101
697099110,9cyclictest0-21swapper/120:35:041
697099110,3cyclictest19272-21munin-node1
697099110,1cyclictest0-21swapper/100:30:201
697099110,10cyclictest11177-21kworker/u8:120:50:021
696999118,2cyclictest0-21swapper/020:50:140
696999118,2cyclictest0-21swapper/020:45:140
696999118,2cyclictest0-21swapper/019:55:140
696999118,2cyclictest0-21swapper/019:33:240
696999116,3cyclictest28506-21expr20:01:010
697299107,2cyclictest0-21swapper/322:10:163
697299107,2cyclictest0-21swapper/321:51:073
697299107,2cyclictest0-21swapper/321:10:383
697299105,3cyclictest15475-21grep20:50:113
697299105,3cyclictest10322-21mailstats19:16:023
697299104,4cyclictest18094-21head19:35:183
697299100,9cyclictest0-21swapper/323:25:333
697299100,9cyclictest0-21swapper/323:19:093
697299100,9cyclictest0-21swapper/322:55:013
697299100,9cyclictest0-21swapper/320:00:093
697299100,6cyclictest0-21swapper/319:10:363
697299100,5cyclictest0-21swapper/319:30:003
697299100,2cyclictest0-21swapper/322:52:353
697299100,2cyclictest0-21swapper/300:21:373
697199107,2cyclictest15836-21kworker/u8:021:07:042
697199107,2cyclictest0-21swapper/220:20:172
697199100,6cyclictest0-21swapper/219:31:042
697099106,2cyclictest0-21swapper/119:25:171
697099100,8cyclictest0-21swapper/120:40:121
697099100,8cyclictest0-21swapper/120:15:121
696999105,3cyclictest3728-21runrttasks19:53:240
696999105,3cyclictest17686-21uniq20:55:140
696999100,2cyclictest0-21swapper/020:40:020
15562100,2sleep20-21swapper/220:15:162
69729996,2cyclictest0-21swapper/320:20:183
69729994,3cyclictest3187-21ntpd20:05:173
69729994,3cyclictest24730-21grep19:51:013
69729994,3cyclictest19550-21tr19:40:133
69729994,3cyclictest12068-21grep19:20:183
69719996,2cyclictest0-21swapper/220:50:102
69719996,2cyclictest0-21swapper/219:20:162
69719991,3cyclictest0-21swapper/220:10:152
69699996,2cyclictest0-21swapper/021:05:140
69699996,2cyclictest0-21swapper/021:00:010
69699996,2cyclictest0-21swapper/020:35:050
69699996,2cyclictest0-21swapper/020:13:010
69699992,6cyclictest0-21swapper/019:20:370
69729983,3cyclictest5310-21cpuspeed_turbos20:25:123
69729983,3cyclictest13270-21aten2.4_r3power20:45:123
69729983,3cyclictest11261-21aten2.4_r3power20:40:123
69699985,2cyclictest0-21swapper/019:17:030
69699980,2cyclictest0-21swapper/019:46:350
69699970,2cyclictest0-21swapper/019:35:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional