You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 22:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Wed Mar 25, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24671211997,17sleep30-21swapper/307:09:273
24003211693,18sleep00-21swapper/007:05:550
22926211595,14sleep10-21swapper/107:05:081
247052113102,6sleep20-21swapper/207:09:542
14662830,0sleep20-21swapper/209:35:172
255792790,1sleep011-21rcuc/009:26:130
115042770,1sleep20-21swapper/210:20:142
35472740,0sleep0101ktimersoftd/012:27:230
73942200,1sleep37396-21unixbench_multi12:31:023
199302200,0sleep30-21swapper/312:10:183
90162190,0sleep00-21swapper/009:43:330
24744991915,2cyclictest391-21kworker/u8:110:50:053
24743991916,2cyclictest25596-21kworker/u8:010:39:052
24744991815,2cyclictest15492-21kworker/u8:111:08:053
2474499181,15cyclictest28384-21sed11:11:023
24744991714,2cyclictest19806-21kworker/u8:010:02:053
24743991714,2cyclictest29304-21kworker/u8:009:17:042
24743991714,2cyclictest23537-21kworker/u8:009:28:052
24742991714,2cyclictest29304-21kworker/u8:009:14:051
24742991714,2cyclictest19806-21kworker/u8:010:06:021
24741991714,2cyclictest4264-21kworker/u8:010:21:050
24744991613,2cyclictest4264-21kworker/u8:010:13:043
2474499161,13cyclictest372-21ssh10:41:583
24743991613,2cyclictest3713-21kworker/u8:011:33:052
24743991613,2cyclictest18929-21kworker/u8:112:12:052
24743991613,2cyclictest17357-21kworker/u8:211:38:052
24743991613,2cyclictest15492-21kworker/u8:111:12:062
24743991613,2cyclictest13574-21kworker/u8:212:32:052
24743991613,2cyclictest10884-21kworker/u8:210:29:042
2474199160,14cyclictest4944-21apt-get09:00:120
2474499151,3cyclictest2535-21ssh10:45:043
24744991512,2cyclictest4264-21kworker/u8:010:15:053
24744991512,2cyclictest3713-21kworker/u8:011:34:053
24744991512,2cyclictest23537-21kworker/u8:009:45:053
24744991512,2cyclictest23537-21kworker/u8:009:45:043
24744991512,2cyclictest19806-21kworker/u8:009:56:023
2474499151,12cyclictest28039-21sh10:36:543
2474499150,3cyclictest28283-21latency_hist12:20:003
2474499150,13cyclictest0-21swapper/312:04:533
24743991512,2cyclictest4431-21kworker/u8:108:58:022
24743991512,2cyclictest4264-21kworker/u8:010:16:052
24743991512,2cyclictest391-21kworker/u8:110:43:052
24743991512,2cyclictest24931-21kworker/u8:012:27:052
24743991512,2cyclictest15492-21kworker/u8:110:59:052
2474399150,13cyclictest9030-21apt-get07:50:122
2474299150,13cyclictest8383-21missed_timers10:50:151
2474299150,13cyclictest0-21swapper/110:15:111
2474199150,13cyclictest4154-21timerwakeupswit08:56:020
24744991411,2cyclictest9065-21kworker/u8:007:58:053
24744991411,2cyclictest7984-21kworker/u8:109:42:043
24744991411,2cyclictest4431-21kworker/u8:109:00:053
24744991411,2cyclictest4264-21kworker/u8:010:22:063
24744991411,2cyclictest19581-21ssh10:28:333
24744991411,2cyclictest0-21swapper/311:44:333
24744991411,2cyclictest0-21swapper/311:37:023
24744991411,2cyclictest0-21swapper/311:25:513
24744991411,2cyclictest0-21swapper/311:18:503
24744991411,2cyclictest0-21swapper/309:52:483
24744991411,2cyclictest0-21swapper/309:30:123
24744991411,2cyclictest0-21swapper/308:10:123
2474499140,3cyclictest30455-21ssh10:05:263
2474499140,2cyclictest0-21swapper/312:20:433
2474499140,2cyclictest0-21swapper/311:46:233
2474499140,2cyclictest0-21swapper/311:01:513
2474499140,2cyclictest0-21swapper/308:55:143
2474499140,2cyclictest0-21swapper/307:36:013
2474499140,2cyclictest0-21swapper/307:16:023
2474499140,13cyclictest0-21swapper/309:15:213
2474499140,12cyclictest3219-21ssh11:53:253
2474499140,11cyclictest0-21swapper/310:59:543
24743991411,2cyclictest5081-21kworker/u8:107:48:052
24743991411,2cyclictest4806-21kworker/u8:112:01:052
24743991411,2cyclictest391-21kworker/u8:110:47:052
24743991411,2cyclictest32697-21kworker/u8:208:13:052
2474399141,12cyclictest301ktimersoftd/212:24:592
24743991411,2cyclictest28575-21kworker/u8:007:26:052
24743991411,2cyclictest19806-21kworker/u8:009:58:052
24743991411,2cyclictest16854-21kworker/u8:108:18:052
24743991411,2cyclictest16364-21kworker/u8:107:22:052
24743991411,2cyclictest15492-21kworker/u8:111:48:062
24743991411,2cyclictest15492-21kworker/u8:111:26:042
24743991411,2cyclictest15492-21kworker/u8:111:09:052
24743991411,2cyclictest12821-21kworker/u8:309:48:022
24743991411,2cyclictest12821-21kworker/u8:309:48:022
24743991411,2cyclictest10884-21kworker/u8:210:30:052
24743991411,2cyclictest0-21swapper/212:09:282
24743991410,2cyclictest0-21swapper/208:30:132
2474399140,3cyclictest528-21ssh10:08:482
2474399140,3cyclictest12676-21ssh09:13:402
2474399140,2cyclictest0-21swapper/209:06:032
2474399140,12cyclictest0-21swapper/211:51:042
2474399140,12cyclictest0-21swapper/209:30:172
24742991411,2cyclictest4806-21kworker/u8:111:56:051
24742991411,2cyclictest13574-21kworker/u8:212:06:041
24742991411,2cyclictest0-21swapper/110:40:151
24742991410,2cyclictest6763-21cut09:05:001
2474299140,12cyclictest9090-21apt-get12:00:071
2474299140,12cyclictest18952-21apt-get12:10:111
2474299140,12cyclictest0-21swapper/110:21:051
2474299140,12cyclictest0-21swapper/109:25:191
2474299140,12cyclictest0-21swapper/108:35:501
2474299140,12cyclictest0-21swapper/108:19:591
24741991411,2cyclictest0-21swapper/011:25:120
24741991411,2cyclictest0-21swapper/010:07:520
2474199140,12cyclictest0-21swapper/011:56:210
2474199140,12cyclictest0-21swapper/011:09:590
2474199140,12cyclictest0-21swapper/010:37:190
186082140,2sleep20-21swapper/209:53:422
66882130,2sleep00-21swapper/010:49:110
24744991310,2cyclictest24931-21kworker/u8:012:38:053
24744991310,2cyclictest21931-21ssh10:30:243
24744991310,2cyclictest0-21swapper/312:25:173
24744991310,2cyclictest0-21swapper/309:35:113
24744991310,2cyclictest0-21swapper/309:10:153
24744991310,2cyclictest0-21swapper/308:31:033
2474499130,2cyclictest22929-21ssh09:24:373
2474499130,2cyclictest0-21swapper/312:05:013
2474499130,2cyclictest0-21swapper/311:55:583
2474499130,1cyclictest0-21swapper/309:27:013
2474499130,12cyclictest0-21swapper/311:20:223
2474499130,12cyclictest0-21swapper/307:40:003
2474499130,12cyclictest0-21swapper/307:30:153
24743991310,2cyclictest8745-21diskmemload09:20:332
24743991310,2cyclictest26587-21kworker/u8:211:20:052
24743991310,2cyclictest17357-21kworker/u8:211:40:012
24743991310,2cyclictest16364-21kworker/u8:107:15:052
24743991310,2cyclictest0-21swapper/208:20:192
24743991310,2cyclictest0-21swapper/207:10:172
2474399130,2cyclictest0-21swapper/211:04:032
2474399130,2cyclictest0-21swapper/209:41:062
2474399130,2cyclictest0-21swapper/208:00:142
2474399130,12cyclictest0-21swapper/212:15:152
2474299131,10cyclictest0-21swapper/109:55:121
24742991310,2cyclictest8745-21diskmemload09:35:141
24742991310,2cyclictest25596-21kworker/u8:011:01:051
24742991310,2cyclictest10884-21kworker/u8:210:28:041
24742991310,2cyclictest0-21swapper/110:10:131
24742991310,2cyclictest0-21swapper/109:41:011
24742991310,2cyclictest0-21swapper/107:15:151
2474299130,2cyclictest0-21swapper/111:08:041
2474299130,2cyclictest0-21swapper/110:35:131
2474299130,12cyclictest0-21swapper/112:35:151
2474299130,11cyclictest29689-21ssh09:30:511
24741991310,2cyclictest8745-21diskmemload10:16:480
24741991310,2cyclictest0-21swapper/012:13:510
24741991310,2cyclictest0-21swapper/012:02:120
24741991310,2cyclictest0-21swapper/011:46:010
24741991310,2cyclictest0-21swapper/011:30:090
24741991310,2cyclictest0-21swapper/010:25:140
24741991310,2cyclictest0-21swapper/009:56:210
24741991310,2cyclictest0-21swapper/009:36:030
24741991310,2cyclictest0-21swapper/009:22:420
24741991310,2cyclictest0-21swapper/009:05:130
24741991310,2cyclictest0-21swapper/007:38:160
2474199130,2cyclictest8745-21diskmemload11:24:120
2474199130,2cyclictest0-21swapper/010:10:150
2474199130,2cyclictest0-21swapper/008:30:010
2474199130,12cyclictest0-21swapper/011:50:130
2474199130,11cyclictest0-21swapper/011:40:100
2474199130,11cyclictest0-21swapper/011:39:420
2474199130,11cyclictest0-21swapper/009:10:510
79292120,2sleep10-21swapper/111:24:401
2474499129,2cyclictest32697-21kworker/u8:208:08:053
2474499129,2cyclictest0-21swapper/308:26:033
2474399129,2cyclictest9065-21kworker/u8:007:55:052
2474399129,2cyclictest32697-21kworker/u8:208:52:012
2474399129,2cyclictest32697-21kworker/u8:208:46:052
2474399129,2cyclictest32697-21kworker/u8:208:42:052
2474399129,2cyclictest32697-21kworker/u8:208:07:052
2474399129,2cyclictest28575-21kworker/u8:007:30:022
2474399129,2cyclictest16854-21kworker/u8:108:29:042
2474399129,2cyclictest0-21swapper/211:18:412
2474399129,2cyclictest0-21swapper/210:10:532
2474399120,2cyclictest0-21swapper/210:00:062
2474399120,11cyclictest0-21swapper/211:55:022
2474399120,11cyclictest0-21swapper/210:50:202
2474299129,2cyclictest8745-21diskmemload11:10:561
2474299129,2cyclictest5081-21kworker/u8:107:46:051
2474299129,2cyclictest32697-21kworker/u8:208:10:051
2474299129,2cyclictest30924-21kworker/u8:211:53:051
2474299129,2cyclictest29304-21kworker/u8:009:15:041
2474299129,2cyclictest28575-21kworker/u8:007:20:021
2474299129,2cyclictest26587-21kworker/u8:211:16:041
2474299129,2cyclictest19806-21kworker/u8:010:00:051
2474299129,2cyclictest15492-21kworker/u8:111:37:051
2474299129,2cyclictest15492-21kworker/u8:111:30:021
2474299129,2cyclictest13574-21kworker/u8:212:25:051
2474299129,2cyclictest0-21swapper/110:48:151
2474299129,2cyclictest0-21swapper/108:00:391
2474299129,2cyclictest0-21swapper/107:40:161
2474299129,2cyclictest0-21swapper/107:25:101
2474299128,2cyclictest8745-21diskmemload11:40:131
2474299125,6cyclictest21-21rcuc/111:45:131
2474299121,3cyclictest12290-21apt-get10:55:111
2474299120,2cyclictest0-21swapper/111:25:441
2474299120,2cyclictest0-21swapper/110:31:361
2474299120,2cyclictest0-21swapper/109:52:041
2474299120,2cyclictest0-21swapper/108:05:411
2474299120,11cyclictest0-21swapper/109:46:161
2474299120,11cyclictest0-21swapper/109:46:161
2474299120,10cyclictest8745-21diskmemload09:21:581
2474299120,10cyclictest5686-21aten2.4_r3power12:30:111
2474299120,10cyclictest207150irq/24-eth112:16:151
2474199129,2cyclictest391-21kworker/u8:110:44:040
2474199129,2cyclictest23537-21kworker/u8:009:32:040
2474199129,2cyclictest0-21swapper/010:01:000
2474199129,2cyclictest0-21swapper/008:10:190
2474199129,2cyclictest0-21swapper/007:46:010
2474199129,2cyclictest0-21swapper/007:15:120
2474199120,2cyclictest0-21swapper/012:15:300
2474199120,2cyclictest0-21swapper/011:15:130
2474199120,2cyclictest0-21swapper/010:56:410
2474199120,2cyclictest0-21swapper/008:41:010
2474199120,11cyclictest0-21swapper/012:36:390
2474199120,11cyclictest0-21swapper/012:31:120
2474199120,11cyclictest0-21swapper/012:20:100
2474199120,11cyclictest0-21swapper/012:05:390
2474199120,11cyclictest0-21swapper/011:11:190
2474199120,11cyclictest0-21swapper/011:01:020
2474199120,11cyclictest0-21swapper/010:53:320
2474199120,11cyclictest0-21swapper/010:31:590
2474199120,11cyclictest0-21swapper/009:45:420
2474199120,11cyclictest0-21swapper/009:45:420
2474199120,11cyclictest0-21swapper/009:16:510
222852121,8sleep122360-21awk08:21:041
2474499118,2cyclictest28575-21kworker/u8:007:29:053
2474499118,2cyclictest16854-21kworker/u8:108:40:053
2474499118,2cyclictest0-21swapper/309:05:173
2474499118,2cyclictest0-21swapper/308:50:123
2474499118,2cyclictest0-21swapper/308:01:013
2474499110,2cyclictest0-21swapper/307:50:063
2474399110,1cyclictest0-21swapper/212:36:072
2474299118,2cyclictest32697-21kworker/u8:208:25:051
2474299118,2cyclictest29304-21kworker/u8:009:05:041
2474299111,3cyclictest28858-21df_inode12:20:121
2474299110,9cyclictest0-21swapper/107:50:121
2474299110,9cyclictest0-21swapper/107:35:121
2474299110,3cyclictest0-21swapper/108:56:011
2474199118,2cyclictest0-21swapper/009:50:180
2474199118,2cyclictest0-21swapper/007:50:180
2474499107,2cyclictest32697-21kworker/u8:208:45:053
2474499107,2cyclictest16854-21kworker/u8:108:35:053
2474499107,2cyclictest16364-21kworker/u8:107:13:043
2474499107,2cyclictest0-21swapper/308:15:393
2474399107,2cyclictest0-21swapper/208:36:032
2474399105,3cyclictest6774-21latency_hist07:45:002
2474299107,2cyclictest9065-21kworker/u8:007:57:051
2474299107,2cyclictest0-21swapper/108:50:161
2474299106,2cyclictest0-21swapper/108:45:131
2474299100,9cyclictest0-21swapper/108:30:141
2474299100,9cyclictest0-21swapper/107:30:121
2474299100,9cyclictest0-21swapper/107:10:001
2474299100,8cyclictest0-21swapper/108:40:101
2474199107,2cyclictest0-21swapper/008:45:410
2474199107,2cyclictest0-21swapper/008:25:150
2474199105,3cyclictest27270-21head08:35:120
247449996,2cyclictest32697-21kworker/u8:208:23:053
247449996,2cyclictest0-21swapper/307:45:123
247449996,2cyclictest0-21swapper/307:21:023
247439994,3cyclictest4971-21aten2.4-expect09:00:122
247439994,3cyclictest2652-21aten2.4_r3power07:35:112
247419996,2cyclictest28575-21kworker/u8:007:31:050
247419996,2cyclictest0-21swapper/007:10:140
247419994,3cyclictest750-21aten2.4_r3power08:50:130
247419994,3cyclictest5246-21cpuspeed_turbos07:40:120
247419994,3cyclictest32288-21cat07:26:000
247419994,3cyclictest19645-21grep08:15:130
247419994,3cyclictest15136-21head08:05:130
247419985,2cyclictest29091-21aten2.4-expect07:20:130
247419985,2cyclictest13289-21cpuspeed_turbos08:00:120
247419985,2cyclictest0-21swapper/007:55:160
247419983,3cyclictest21266-21cut08:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional