You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 23:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Wed May 06, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6396211894,16sleep20-21swapper/207:05:012
8155211694,16sleep30-21swapper/307:08:223
8126210886,16sleep10-21swapper/107:08:001
8103210887,16sleep00-21swapper/007:07:430
209712670,0sleep10-21swapper/112:00:501
8313994316,10cyclictest0-21swapper/312:30:103
831199250,7cyclictest0-21swapper/107:25:111
38092240,0sleep20-21swapper/211:42:242
831299231,17cyclictest0-21swapper/210:18:042
831099231,19cyclictest0-21swapper/007:15:130
40212230,0sleep10-21swapper/109:21:381
831199220,20cyclictest207150irq/24-eth110:45:121
8313992117,2cyclictest9535-21kworker/u8:210:29:043
8313992117,2cyclictest32478-21kworker/u8:311:59:043
8312992116,3cyclictest28799-21ssh11:35:132
831199210,2cyclictest0-21swapper/112:30:111
831299204,2cyclictest10195-21copy11:50:052
8312992017,2cyclictest4086-21kworker/u8:212:19:052
8312992017,2cyclictest22723-21kworker/u8:007:47:052
8312992017,2cyclictest18708-21kworker/u8:111:20:062
8312992017,2cyclictest18708-21kworker/u8:111:20:052
8312992017,2cyclictest18708-21kworker/u8:110:49:052
8312992017,2cyclictest10604-21kworker/u8:208:21:042
8312992017,2cyclictest10604-21kworker/u8:207:22:052
831299200,18cyclictest0-21swapper/207:15:132
831299200,15cyclictest0-21swapper/210:10:052
831099200,18cyclictest0-21swapper/008:05:110
831099200,18cyclictest0-21swapper/008:05:100
8313991916,2cyclictest17294-21kworker/u8:211:29:053
8312991916,2cyclictest7753-21kworker/u8:109:26:042
8312991916,2cyclictest2560-21kworker/u8:108:26:052
8312991916,2cyclictest22723-21kworker/u8:007:58:042
8312991916,2cyclictest15422-21kworker/u8:009:41:052
8312991916,2cyclictest15422-21kworker/u8:009:37:042
8312991916,2cyclictest14064-21kworker/u8:007:27:052
831299190,17cyclictest0-21swapper/211:31:042
831199190,2cyclictest0-21swapper/111:10:121
831099190,5cyclictest0-21swapper/012:15:120
19162190,0sleep10-21swapper/112:15:501
8313991815,2cyclictest10725-21kworker/u8:108:36:043
831399180,2cyclictest0-21swapper/307:25:103
8312991815,2cyclictest9535-21kworker/u8:210:25:042
8312991815,2cyclictest659-21kworker/u8:209:34:052
8312991815,2cyclictest659-21kworker/u8:209:20:022
8312991815,2cyclictest5009-21kworker/u8:111:46:042
8312991815,2cyclictest28208-21kworker/u8:109:17:052
8312991815,2cyclictest2560-21kworker/u8:108:19:052
8312991815,2cyclictest23473-21kworker/u8:109:50:042
8312991815,2cyclictest22723-21kworker/u8:008:00:052
8312991815,2cyclictest18708-21kworker/u8:111:27:052
8312991815,2cyclictest18708-21kworker/u8:111:02:052
8312991815,2cyclictest12595-21kworker/u8:011:19:052
8312991815,2cyclictest12595-21kworker/u8:011:19:042
831299180,3cyclictest0-21swapper/209:59:052
831299180,12cyclictest0-21swapper/210:52:052
8312991714,2cyclictest32478-21kworker/u8:311:57:042
8312991714,2cyclictest16761-21kworker/u8:108:56:062
831199170,15cyclictest0-21swapper/111:50:141
8310991714,2cyclictest0-21swapper/007:40:110
312992170,0sleep10-21swapper/108:05:121
312992170,0sleep10-21swapper/108:05:121
8313991613,2cyclictest4086-21kworker/u8:212:20:053
8313991613,2cyclictest29421-21kworker/u8:009:54:043
831399161,13cyclictest24781-21iostat_ios12:05:153
831399160,14cyclictest0-21swapper/311:15:113
831399160,14cyclictest0-21swapper/311:15:103
8312991613,2cyclictest5009-21kworker/u8:112:10:052
8312991613,2cyclictest13764-21kworker/u8:209:08:022
8312991613,2cyclictest13764-21kworker/u8:208:44:052
8312991611,3cyclictest0-21swapper/212:00:122
831299160,12cyclictest0-21swapper/211:06:012
831099161,13cyclictest0-21swapper/011:40:160
831099160,14cyclictest0-21swapper/012:00:000
831399152,7cyclictest0-21swapper/309:35:003
8313991512,2cyclictest29291-21kworker/u8:211:38:053
8313991512,2cyclictest0-21swapper/311:40:173
831399151,12cyclictest9249-21ssh10:37:473
8312991512,2cyclictest20347-21kworker/u8:010:21:052
8312991512,2cyclictest10725-21kworker/u8:108:39:042
831299150,2cyclictest0-21swapper/211:10:052
831299150,2cyclictest0-21swapper/210:57:052
831299150,2cyclictest0-21swapper/208:30:052
831199151,3cyclictest0-21swapper/110:39:301
8311991512,2cyclictest0-21swapper/111:36:531
8311991510,3cyclictest207150irq/24-eth109:46:091
8311991510,3cyclictest0-21swapper/111:20:161
8311991510,3cyclictest0-21swapper/111:20:151
831199150,13cyclictest0-21swapper/109:52:211
831099151,2cyclictest24956-21apt-get09:10:120
831099151,12cyclictest11102-21apt-get09:30:120
831099150,13cyclictest20444-21latency_hist07:40:010
831099150,13cyclictest0-21swapper/007:55:130
831399148,4cyclictest0-21swapper/312:10:123
831399142,6cyclictest0-21swapper/308:45:013
8313991411,2cyclictest9535-21kworker/u8:210:40:053
8313991411,2cyclictest23473-21kworker/u8:110:02:043
8313991411,2cyclictest18708-21kworker/u8:111:20:013
8313991411,2cyclictest18708-21kworker/u8:111:20:013
8313991411,2cyclictest18708-21kworker/u8:110:50:043
8313991411,2cyclictest16761-21kworker/u8:109:00:043
8313991411,2cyclictest15422-21kworker/u8:009:40:053
8313991411,2cyclictest14593-21kworker/u8:110:09:053
8313991411,2cyclictest0-21swapper/311:00:173
831399141,11cyclictest18690-21ssh10:48:373
831399140,12cyclictest24641-21diskmemload09:45:113
8312991411,2cyclictest16671-21kworker/u8:107:43:042
8312991410,2cyclictest0-21swapper/212:20:172
831299140,2cyclictest0-21swapper/212:28:052
831299140,2cyclictest0-21swapper/212:05:042
831299140,2cyclictest0-21swapper/210:08:052
831299140,2cyclictest0-21swapper/210:00:012
831299140,2cyclictest0-21swapper/208:52:052
831299140,13cyclictest0-21swapper/207:33:042
831299140,12cyclictest16427-21ssh12:31:212
831299140,12cyclictest0-21swapper/209:45:112
8311991411,2cyclictest0-21swapper/110:42:331
8311991411,2cyclictest0-21swapper/109:15:331
8311991410,3cyclictest0-21swapper/111:58:231
831199140,3cyclictest20293-21taskset10:50:131
831199140,2cyclictest0-21swapper/111:09:531
831199140,12cyclictest24641-21diskmemload12:11:021
831199140,12cyclictest207150irq/24-eth110:15:241
831199140,12cyclictest0-21swapper/110:33:141
8310991411,2cyclictest29084-21apt-get10:25:070
831099140,3cyclictest9065-21ssh10:37:250
831099140,2cyclictest0-21swapper/010:55:470
178762140,0sleep00-21swapper/010:47:150
92152130,2sleep00-21swapper/011:13:210
831399132,6cyclictest0-21swapper/309:24:593
831399131,6cyclictest0-21swapper/308:25:003
831399131,10cyclictest0-21swapper/312:35:323
8313991310,2cyclictest5009-21kworker/u8:111:53:053
8313991310,2cyclictest3998-21kworker/u8:007:14:053
8313991310,2cyclictest29421-21kworker/u8:009:57:053
8313991310,2cyclictest22723-21kworker/u8:007:52:043
8313991310,2cyclictest22723-21kworker/u8:007:48:053
8313991310,2cyclictest15422-21kworker/u8:009:38:043
8313991310,2cyclictest0-21swapper/312:16:583
8313991310,2cyclictest0-21swapper/311:30:593
8313991310,2cyclictest0-21swapper/309:16:073
831399130,9cyclictest0-21swapper/310:17:043
831399130,2cyclictest0-21swapper/312:29:053
831399130,2cyclictest0-21swapper/312:00:123
831399130,2cyclictest0-21swapper/311:12:173
831399130,2cyclictest0-21swapper/311:07:043
831399130,2cyclictest0-21swapper/310:24:283
831399130,2cyclictest0-21swapper/307:55:163
831399130,12cyclictest0-21swapper/308:30:123
831399130,11cyclictest3728-21runrttasks09:28:153
831399130,11cyclictest0-21swapper/310:11:313
831299132,6cyclictest0-21swapper/209:05:002
8312991310,2cyclictest0-21swapper/212:37:192
831299130,2cyclictest0-21swapper/210:30:052
831299130,1cyclictest0-21swapper/209:11:042
831199139,3cyclictest0-21swapper/108:10:101
831199139,3cyclictest0-21swapper/108:10:091
831199138,3cyclictest0-21swapper/110:00:151
8311991310,2cyclictest0-21swapper/112:36:071
8311991310,2cyclictest0-21swapper/112:23:151
8311991310,2cyclictest0-21swapper/112:05:261
8311991310,2cyclictest0-21swapper/111:42:341
8311991310,2cyclictest0-21swapper/111:29:401
8311991310,2cyclictest0-21swapper/109:40:031
831199130,2cyclictest0-21swapper/110:08:031
831199130,12cyclictest0-21swapper/111:31:131
831199130,12cyclictest0-21swapper/110:23:041
831199130,12cyclictest0-21swapper/109:35:231
831199130,11cyclictest0-21swapper/112:26:161
831199130,11cyclictest0-21swapper/108:40:391
831099139,2cyclictest0-21swapper/010:41:030
831099138,3cyclictest31437-21rm11:37:170
831099132,6cyclictest0-21swapper/009:25:000
831099131,6cyclictest0-21swapper/008:50:000
8310991310,2cyclictest14762-21apt-get08:45:110
8310991310,2cyclictest0-21swapper/010:50:170
8310991310,2cyclictest0-21swapper/007:45:110
831099130,3cyclictest0-21swapper/009:19:430
831099130,2cyclictest32532-21ssh12:14:470
831099130,2cyclictest0-21swapper/012:26:030
831099130,12cyclictest0-21swapper/009:00:070
831099130,11cyclictest0-21swapper/012:31:090
831099130,11cyclictest0-21swapper/010:24:180
269432130,2sleep30-21swapper/309:11:103
157932130,2sleep015955-21telnet09:35:130
831399129,2cyclictest22723-21kworker/u8:008:10:043
831399129,2cyclictest22723-21kworker/u8:008:10:043
831399129,2cyclictest10604-21kworker/u8:207:32:013
831399129,2cyclictest0-21swapper/308:45:103
831399129,2cyclictest0-21swapper/307:40:143
831399128,2cyclictest0-21swapper/310:30:583
831399128,2cyclictest0-21swapper/308:55:193
831399120,2cyclictest0-21swapper/311:45:363
831399120,2cyclictest0-21swapper/307:15:173
831399120,11cyclictest0-21swapper/310:55:583
831299129,2cyclictest0-21swapper/207:11:032
831299122,5cyclictest0-21swapper/208:50:002
831299120,2cyclictest0-21swapper/208:05:052
831299120,2cyclictest0-21swapper/208:05:042
831299120,11cyclictest0-21swapper/210:43:512
831299120,11cyclictest0-21swapper/210:35:162
831199129,2cyclictest0-21swapper/111:47:481
831199129,2cyclictest0-21swapper/109:57:581
831199129,2cyclictest0-21swapper/109:10:121
831199129,2cyclictest0-21swapper/108:16:041
831199129,2cyclictest0-21swapper/107:20:141
831199128,2cyclictest0-21swapper/108:01:561
831199127,3cyclictest6461-21aten2.4_r3power09:25:101
831199127,3cyclictest3728-21runrttasks07:40:581
831199122,5cyclictest0-21swapper/108:35:001
831199121,3cyclictest9049-21perl07:10:151
831199121,3cyclictest19338-21perl08:55:161
831199120,4cyclictest16761-21kworker/u8:109:00:051
831199120,2cyclictest0-21swapper/110:26:461
831199120,11cyclictest0-21swapper/111:01:071
831199120,11cyclictest0-21swapper/110:55:391
831199120,11cyclictest0-21swapper/110:12:231
831199120,11cyclictest0-21swapper/109:31:561
831199120,11cyclictest0-21swapper/107:30:291
831199120,10cyclictest15760-21cut08:45:171
831199120,10cyclictest10849-21grep11:15:121
831199120,10cyclictest10849-21grep11:15:121
831199120,10cyclictest0-21swapper/107:45:121
831099129,2cyclictest0-21swapper/012:20:100
831099129,2cyclictest0-21swapper/010:09:150
831099129,2cyclictest0-21swapper/009:05:150
831099129,2cyclictest0-21swapper/008:35:170
831099129,2cyclictest0-21swapper/008:10:590
831099129,2cyclictest0-21swapper/008:10:580
831099128,2cyclictest6407-21munin-node0
831099127,3cyclictest10379-21ssh11:50:020
831099127,3cyclictest0-21swapper/010:10:120
831099122,7cyclictest0-21swapper/007:13:590
831099122,6cyclictest0-21swapper/010:35:000
831099122,5cyclictest0-21swapper/008:05:010
831099121,7cyclictest0-21swapper/008:34:050
831099121,3cyclictest0-21swapper/011:47:570
831099121,2cyclictest0-21swapper/008:25:100
831099120,2cyclictest0-21swapper/011:06:100
831099120,2cyclictest0-21swapper/011:01:280
831099120,2cyclictest0-21swapper/010:15:460
831099120,2cyclictest0-21swapper/009:28:450
831099120,11cyclictest0-21swapper/011:30:310
831099120,11cyclictest0-21swapper/011:29:360
831099120,10cyclictest24641-21diskmemload09:52:370
831099120,10cyclictest0-21swapper/012:05:060
831099120,10cyclictest0-21swapper/011:21:520
831099120,10cyclictest0-21swapper/011:21:510
831099120,10cyclictest0-21swapper/009:47:530
257712120,8sleep20-21swapper/207:51:012
831399118,2cyclictest22723-21kworker/u8:008:08:023
831399118,2cyclictest22723-21kworker/u8:008:08:013
831399118,2cyclictest13764-21kworker/u8:209:09:053
831399118,2cyclictest10604-21kworker/u8:208:25:053
831399118,2cyclictest10604-21kworker/u8:208:15:053
831399118,2cyclictest10604-21kworker/u8:207:35:053
831399116,3cyclictest17248-21fschecks_time08:50:143
831199118,2cyclictest0-21swapper/107:55:131
831199116,3cyclictest0-21swapper/108:20:171
831199111,8cyclictest0-21swapper/107:15:191
831199111,2cyclictest17294-21perl08:50:141
831199110,9cyclictest0-21swapper/109:05:171
831099118,2cyclictest0-21swapper/012:39:090
831099118,2cyclictest0-21swapper/012:00:170
831099118,2cyclictest0-21swapper/007:20:140
831099117,2cyclictest0-21swapper/008:55:190
831099111,7cyclictest24641-21diskmemload11:20:010
831099111,7cyclictest24641-21diskmemload11:20:000
831099110,1cyclictest0-21swapper/009:40:150
831099110,10cyclictest0-21swapper/009:56:070
831099110,10cyclictest0-21swapper/007:25:130
831399105,3cyclictest13835-21wc07:21:033
831199107,2cyclictest0-21swapper/107:50:171
831199106,2cyclictest0-21swapper/107:35:121
831199100,8cyclictest0-21swapper/108:30:031
831199100,8cyclictest0-21swapper/108:25:141
831099105,3cyclictest26537-21cat07:55:010
831099105,3cyclictest18050-21sed07:31:020
83139994,3cyclictest28499-21latency_hist08:00:013
83129990,6cyclictest0-21swapper/208:10:592
83129990,6cyclictest0-21swapper/208:10:582
83109994,3cyclictest4815-21tail08:20:130
83109994,3cyclictest2472-21aten2.4_r3power08:15:120
83129983,3cyclictest18941-21tr07:35:122
83109983,3cyclictest3728-21runrttasks08:40:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional