You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 03:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sat Jul 18, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22850211091,14sleep10-21swapper/119:05:201
23396210988,16sleep20-21swapper/219:06:572
23427210695,6sleep30-21swapper/319:07:223
23324210677,6sleep00-21swapper/019:06:030
249472810,0sleep00-21swapper/000:12:400
187452710,1sleep229-21rcuc/200:40:002
192112690,0sleep00-21swapper/023:00:180
195002670,0sleep00-21swapper/021:21:040
23662993633,2cyclictest0-21swapper/223:00:112
314452340,1sleep20-21swapper/200:20:012
2366399222,18cyclictest0-21swapper/320:50:123
2366299221,19cyclictest0-21swapper/219:15:132
2366399211,18cyclictest0-21swapper/320:05:113
2366399211,18cyclictest0-21swapper/320:05:103
2366099210,2cyclictest0-21swapper/019:50:110
23662992017,2cyclictest32578-21kworker/u8:022:22:042
2366199200,2cyclictest0-21swapper/120:05:101
2366199200,2cyclictest0-21swapper/120:05:101
2366099200,18cyclictest0-21swapper/021:50:130
23663991916,2cyclictest27579-21kworker/u8:222:07:043
23663991915,2cyclictest32578-21kworker/u8:022:16:043
23662991916,2cyclictest29987-21kworker/u8:123:46:042
23662991916,2cyclictest16423-21kworker/u8:322:52:052
58002180,0sleep30-21swapper/300:25:593
23663991815,2cyclictest29987-21kworker/u8:123:48:023
23662991815,2cyclictest31634-21kworker/u8:119:31:042
23662991815,2cyclictest27579-21kworker/u8:222:06:042
23662991815,2cyclictest25063-21kworker/u8:221:27:042
23662991815,2cyclictest11492-21kworker/u8:122:34:042
23662991814,2cyclictest8097-21kworker/u8:123:22:042
23662991714,2cyclictest4356-21kworker/u8:021:50:012
23662991714,2cyclictest32578-21kworker/u8:022:17:042
23662991714,2cyclictest19366-21kworker/u8:123:09:042
23662991714,2cyclictest15843-21kworker/u8:019:24:052
23662991714,2cyclictest15281-21kworker/u8:223:52:052
2366199171,2cyclictest0-21swapper/121:45:151
23660991710,6cyclictest60-21kswapd023:35:070
2366399161,3cyclictest0-21swapper/319:35:153
23663991613,2cyclictest21832-21kworker/u8:121:59:053
23663991613,2cyclictest19813-21kworker/u8:220:24:043
23663991613,2cyclictest10775-21kworker/u8:121:24:043
2366399161,13cyclictest7446-21diskmemload23:25:183
2366399161,13cyclictest31881-21munin-run21:35:003
2366399161,13cyclictest10725-21ps21:45:193
2366299161,3cyclictest0-21swapper/223:35:152
23662991613,2cyclictest3225-21kworker/u8:019:48:052
23662991613,2cyclictest25999-21kworker/u8:222:35:052
23662991613,2cyclictest23388-21kworker/u8:020:48:042
23662991613,2cyclictest19813-21kworker/u8:220:25:042
23662991613,2cyclictest15281-21kworker/u8:223:41:042
2366299161,13cyclictest0-21swapper/223:26:052
23662991611,3cyclictest0-21swapper/221:50:012
23662991610,4cyclictest28890-21munin-node2
2366299160,12cyclictest0-21swapper/223:33:042
217522160,0sleep20-21swapper/221:56:342
23663991512,2cyclictest5672-21kworker/u8:222:14:053
23663991512,2cyclictest24107-21kworker/u8:300:32:013
23663991512,2cyclictest13733-21kworker/u8:120:14:013
2366399151,12cyclictest30291-21ssh00:18:223
2366399151,12cyclictest26228-21ssh21:28:493
2366399151,12cyclictest17437-21ssh21:52:243
2366399150,13cyclictest6578-21ssh23:20:223
2366399150,13cyclictest28193-21sed20:40:143
2366399150,13cyclictest0-21swapper/322:50:113
23662991512,2cyclictest6978-21kworker/u8:300:03:042
23662991512,2cyclictest3616-21kworker/u8:000:26:052
23662991512,2cyclictest24003-21kworker/u8:219:11:052
23662991512,2cyclictest19366-21kworker/u8:123:13:052
23662991512,2cyclictest19366-21kworker/u8:123:13:042
23662991512,2cyclictest13733-21kworker/u8:120:12:042
2366299150,13cyclictest5508-21latency_hist21:05:002
2366299150,11cyclictest0-21swapper/222:14:022
2366199152,2cyclictest207150irq/24-eth121:12:061
2366199151,12cyclictest7446-21diskmemload23:00:191
23661991510,3cyclictest0-21swapper/121:53:191
2366199150,14cyclictest0-21swapper/121:26:261
2366199150,13cyclictest0-21swapper/100:34:451
2366199150,13cyclictest0-21swapper/100:29:351
2366099152,2cyclictest19587-21diskmemload21:55:130
23660991511,2cyclictest0-21swapper/023:56:020
2366099150,13cyclictest0-21swapper/019:25:000
34892140,2sleep20-21swapper/222:45:062
2366399149,3cyclictest18902-21ssh23:33:423
2366399142,7cyclictest0-21swapper/321:00:013
2366399142,7cyclictest0-21swapper/300:25:003
23663991411,2cyclictest25063-21kworker/u8:221:42:043
23663991411,2cyclictest23388-21kworker/u8:020:38:013
23663991411,2cyclictest15843-21kworker/u8:019:20:053
23663991411,2cyclictest13733-21kworker/u8:120:16:043
23663991411,2cyclictest0-21swapper/322:23:133
23663991411,2cyclictest0-21swapper/319:10:123
2366399141,11cyclictest32200-21ssh22:40:203
2366399141,11cyclictest25367-21ssh22:34:123
2366399140,3cyclictest28508-21fschecks_time23:10:163
2366399140,3cyclictest28508-21fschecks_time23:10:153
2366399140,2cyclictest0-21swapper/319:40:143
2366399140,13cyclictest0-21swapper/322:47:133
2366399140,12cyclictest0-21swapper/300:12:223
23662991411,2cyclictest9792-21ssh21:11:092
23662991411,2cyclictest3226-21kworker/u8:319:42:012
23662991411,2cyclictest15281-21kworker/u8:200:11:042
2366299141,11cyclictest20413-21ssh00:08:112
2366199149,3cyclictest0-21swapper/121:16:051
23661991411,2cyclictest0-21swapper/121:39:241
2366199141,11cyclictest29245-21sh23:44:321
2366199141,11cyclictest17643-21cut22:25:291
23661991410,2cyclictest0-21swapper/120:33:051
2366199140,2cyclictest7446-21diskmemload22:20:151
2366199140,2cyclictest0-21swapper/122:34:241
2366199140,2cyclictest0-21swapper/119:55:141
2366199140,13cyclictest16874-21kworker/u8:021:20:051
2366199140,13cyclictest0-21swapper/122:49:141
2366199140,13cyclictest0-21swapper/122:12:351
2366199140,12cyclictest7446-21diskmemload23:51:201
2366199140,12cyclictest0-21swapper/123:31:081
2366199140,12cyclictest0-21swapper/123:11:541
2366199140,12cyclictest0-21swapper/123:11:541
23660991411,2cyclictest0-21swapper/021:36:030
2366099140,2cyclictest0-21swapper/020:05:130
2366099140,2cyclictest0-21swapper/020:05:130
2366099140,2cyclictest0-21swapper/000:25:120
2366099140,13cyclictest0-21swapper/022:15:120
2366099140,12cyclictest8330-21ssh22:50:000
2366099140,12cyclictest13463-21sh22:55:140
2366099140,12cyclictest0-21swapper/000:23:540
2366099140,12cyclictest0-21swapper/000:03:130
82052130,2sleep00-21swapper/023:22:150
47372130,2sleep10-21swapper/121:40:021
2366399138,3cyclictest17232-21wc00:05:133
2366399132,6cyclictest0-21swapper/319:30:003
23663991310,2cyclictest8097-21kworker/u8:123:36:043
23663991310,2cyclictest5829-21ssh23:53:143
23663991310,2cyclictest3225-21kworker/u8:019:49:053
23663991310,2cyclictest31936-21kworker/u8:223:15:043
23663991310,2cyclictest31936-21kworker/u8:223:15:043
23663991310,2cyclictest25889-21kworker/u8:221:18:053
23663991310,2cyclictest25889-21kworker/u8:221:14:043
23663991310,2cyclictest19366-21kworker/u8:123:05:043
23663991310,2cyclictest15843-21kworker/u8:019:18:043
23663991310,2cyclictest15281-21kworker/u8:223:56:043
23663991310,2cyclictest0-21swapper/322:55:223
23663991310,2cyclictest0-21swapper/300:02:323
2366399130,8cyclictest0-21swapper/321:05:053
2366399130,2cyclictest0-21swapper/323:00:173
2366399130,2cyclictest0-21swapper/322:35:243
2366399130,11cyclictest14422-21munin-node3
2366299131,7cyclictest9520-21ssh21:45:002
2366299131,3cyclictest20126-21df20:20:132
23662991310,2cyclictest9237-21kworker/u8:100:31:042
23662991310,2cyclictest15843-21kworker/u8:019:25:042
23662991310,2cyclictest0-21swapper/223:55:392
2366299130,2cyclictest0-21swapper/221:36:052
2366299130,2cyclictest0-21swapper/200:20:012
2366299130,11cyclictest0-21swapper/221:15:202
2366299130,10cyclictest0-21swapper/222:03:042
2366199131,2cyclictest7446-21diskmemload23:16:341
2366199131,2cyclictest7446-21diskmemload23:16:331
23661991310,2cyclictest0-21swapper/123:57:091
23661991310,2cyclictest0-21swapper/123:45:061
23661991310,2cyclictest0-21swapper/123:21:181
23661991310,2cyclictest0-21swapper/122:41:271
23661991310,2cyclictest0-21swapper/122:37:251
23661991310,2cyclictest0-21swapper/122:16:281
23661991310,2cyclictest0-21swapper/121:55:071
23661991310,2cyclictest0-21swapper/121:33:141
23661991310,2cyclictest0-21swapper/120:16:041
23661991310,2cyclictest0-21swapper/119:15:141
23661991310,2cyclictest0-21swapper/100:35:371
23661991310,2cyclictest0-21swapper/100:21:181
23661991310,2cyclictest0-21swapper/100:06:081
2366199130,2cyclictest0-21swapper/123:25:191
2366199130,2cyclictest0-21swapper/123:05:041
2366199130,2cyclictest0-21swapper/122:57:181
2366199130,2cyclictest0-21swapper/100:00:071
2366199130,12cyclictest0-21swapper/122:01:451
2366199130,12cyclictest0-21swapper/120:25:191
2366199130,12cyclictest0-21swapper/100:16:461
2366199130,12cyclictest0-21swapper/100:14:151
2366199130,11cyclictest30252-21cut22:05:171
2366099131,10cyclictest8692-21ssh21:43:580
23660991310,2cyclictest21416-21ssh00:09:450
23660991310,2cyclictest1481-21apt-get19:35:110
23660991310,2cyclictest0-21swapper/023:53:240
23660991310,2cyclictest0-21swapper/022:53:540
23660991310,2cyclictest0-21swapper/022:43:130
23660991310,2cyclictest0-21swapper/022:25:190
23660991310,2cyclictest0-21swapper/019:15:170
2366099130,2cyclictest24392-21fschecks_time20:30:130
2366099130,2cyclictest0-21swapper/023:40:120
2366099130,12cyclictest25999-21kworker/u8:222:36:040
2366099130,12cyclictest12634-21ssh00:33:240
269322120,2sleep00-21swapper/020:36:020
2366399129,2cyclictest21832-21kworker/u8:122:00:053
2366399128,3cyclictest0-21swapper/321:01:013
2366399127,3cyclictest0-21swapper/323:40:133
2366399121,6cyclictest0-21swapper/320:35:013
2366399120,2cyclictest0-21swapper/322:26:583
2366399120,2cyclictest0-21swapper/321:35:163
2366399120,2cyclictest0-21swapper/319:25:003
2366299129,2cyclictest0-21swapper/221:24:422
2366299122,7cyclictest0-21swapper/223:20:002
2366299122,7cyclictest0-21swapper/223:20:002
2366299122,7cyclictest0-21swapper/220:35:012
2366299122,7cyclictest0-21swapper/220:33:022
2366299122,7cyclictest0-21swapper/220:19:012
2366299122,7cyclictest0-21swapper/219:39:022
2366299121,6cyclictest4562-21gdm-simple-gree19:53:582
2366299120,2cyclictest0-21swapper/220:00:102
2366299120,11cyclictest0-21swapper/222:28:412
2366199129,2cyclictest0-21swapper/120:10:141
2366199122,7cyclictest4562-21gdm-simple-gree19:27:581
2366199122,7cyclictest0-21swapper/119:41:581
2366199121,9cyclictest5656-21apt-get21:05:121
2366199121,9cyclictest0-21swapper/120:00:131
2366199120,2cyclictest0-21swapper/120:50:311
2366199120,2cyclictest0-21swapper/119:45:191
2366199120,2cyclictest0-21swapper/119:30:111
2366199120,11cyclictest0-21swapper/123:35:351
2366199120,11cyclictest0-21swapper/122:50:251
2366199120,10cyclictest13733-21kworker/u8:120:20:051
2366099129,2cyclictest27311-21fschecks_time00:15:150
2366099129,2cyclictest19820-21apt-get20:20:120
2366099129,2cyclictest0-21swapper/022:22:310
2366099129,2cyclictest0-21swapper/022:05:150
2366099129,2cyclictest0-21swapper/022:00:190
2366099129,2cyclictest0-21swapper/020:46:040
2366099129,2cyclictest0-21swapper/000:35:120
2366099120,2cyclictest0-21swapper/023:46:230
2366099120,2cyclictest0-21swapper/023:15:110
2366099120,2cyclictest0-21swapper/023:15:100
2366099120,2cyclictest0-21swapper/022:32:190
2366099120,11cyclictest0-21swapper/023:30:130
2366099120,11cyclictest0-21swapper/023:10:130
2366099120,11cyclictest0-21swapper/023:10:130
2366099120,11cyclictest0-21swapper/020:55:130
2366099120,11cyclictest0-21swapper/020:00:140
2366099120,11cyclictest0-21swapper/019:40:110
138312120,2sleep00-21swapper/023:28:240
283332110,0sleep00-21swapper/021:30:180
2366399118,2cyclictest3225-21kworker/u8:019:58:043
2366399118,2cyclictest3225-21kworker/u8:019:52:013
2366299116,3cyclictest684-21cat20:51:042
2366299112,6cyclictest0-21swapper/220:10:012
2366299112,6cyclictest0-21swapper/220:10:002
2366299110,2cyclictest0-21swapper/222:40:042
2366299110,10cyclictest0-21swapper/222:55:172
2366199112,6cyclictest0-21swapper/120:39:581
2366199111,2cyclictest0-21swapper/119:51:021
2366199110,9cyclictest0-21swapper/120:55:161
2366199110,3cyclictest28196-21expr19:20:121
2366199110,3cyclictest0-21swapper/120:40:161
2366099118,2cyclictest0-21swapper/022:11:540
2366099118,2cyclictest0-21swapper/019:13:040
2366099112,7cyclictest0-21swapper/020:12:580
2366099112,6cyclictest22984-21sensors20:26:010
2366099112,6cyclictest0-21swapper/019:46:010
2366099110,2cyclictest0-21swapper/021:19:540
2366099110,10cyclictest0-21swapper/021:45:260
2366099110,10cyclictest0-21swapper/021:11:260
2366399101,6cyclictest0-21swapper/320:01:003
2366299103,4cyclictest1741-21tr20:55:162
2366199107,2cyclictest0-21swapper/121:01:031
2366199101,7cyclictest0-21swapper/119:36:031
2366199100,8cyclictest0-21swapper/120:45:121
2366199100,4cyclictest0-21swapper/119:10:051
2366099107,2cyclictest0-21swapper/021:05:160
2366099103,6cyclictest0-21swapper/021:25:540
2366099102,7cyclictest0-21swapper/021:01:580
2366099102,6cyclictest0-21swapper/019:25:330
2366099100,9cyclictest0-21swapper/023:05:060
2366099100,7cyclictest0-21swapper/020:51:580
236639994,3cyclictest22005-21cpu20:25:133
236639993,4cyclictest31101-21grep20:46:033
236629994,3cyclictest3728-21runrttasks21:06:342
236629992,5cyclictest0-21swapper/219:57:582
236609994,3cyclictest28349-21fschecks_count20:40:140
236609992,5cyclictest0-21swapper/020:15:420
236629983,3cyclictest28090-21cpuspeed_turbos20:40:132
236609981,6cyclictest0-21swapper/019:55:010
236609972,3cyclictest32005-21aten2.4_r3power19:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional