You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 19:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Wed Jul 01, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
211872120110,6sleep30-21swapper/307:07:213
21204211592,18sleep00-21swapper/007:07:340
19914211186,18sleep10-21swapper/107:05:151
20540210684,16sleep20-21swapper/207:05:202
300772880,0sleep20-21swapper/211:20:172
280962840,1sleep00-21swapper/007:25:150
263402750,1sleep1221ktimersoftd/110:06:321
319412700,0sleep00-21swapper/008:55:140
158282700,1sleep3381ktimersoftd/311:40:153
13682670,1sleep20-21swapper/207:40:122
21420993717,18cyclictest0-21swapper/009:05:110
2142099290,27cyclictest0-21swapper/012:20:120
134972260,0sleep10-21swapper/112:12:431
220472250,1sleep30-21swapper/310:36:463
2142099222,18cyclictest0-21swapper/011:40:110
2142099210,19cyclictest0-21swapper/011:00:110
2142099210,19cyclictest0-21swapper/008:30:120
2142099210,19cyclictest0-21swapper/008:10:120
21420992017,2cyclictest22275-21kworker/u8:112:37:040
2142299190,2cyclictest0-21swapper/208:40:132
21421991916,2cyclictest27504-21kworker/u8:209:57:051
21420991916,2cyclictest3597-21kworker/u8:109:30:040
2142099190,12cyclictest0-21swapper/010:57:040
21421991815,2cyclictest28923-21kworker/u8:010:12:051
21421991815,2cyclictest27732-21kworker/u8:111:17:051
2142199181,15cyclictest0-21swapper/111:40:161
21420991815,2cyclictest29141-21kworker/u8:212:34:050
21422991712,3cyclictest19401-21cat10:00:012
21421991713,2cyclictest207150irq/24-eth109:48:021
21420991714,2cyclictest3597-21kworker/u8:109:22:050
21420991714,2cyclictest2422-21kworker/u8:012:12:040
21420991714,2cyclictest23469-21kworker/u8:011:15:050
21420991714,2cyclictest18403-21kworker/u8:211:49:040
179342170,0sleep20-21swapper/211:07:222
2142199160,2cyclictest0-21swapper/111:13:051
2142199160,2cyclictest0-21swapper/110:59:041
2142199160,1cyclictest5443-21diskmemload12:00:061
21420991613,2cyclictest5753-21kworker/u8:210:40:060
21420991613,2cyclictest27504-21kworker/u8:209:58:040
21420991613,2cyclictest23904-21kworker/u8:208:36:050
21420991613,2cyclictest23065-21kworker/u8:310:07:040
2142099160,2cyclictest0-21swapper/012:00:060
21423991512,2cyclictest24276-21kworker/u8:311:50:053
21423991511,2cyclictest0-21swapper/310:40:113
2142399150,3cyclictest28538-21ssh09:35:023
2142399150,13cyclictest26436-21ssh10:06:423
2142399150,13cyclictest0-21swapper/310:32:373
21422991510,3cyclictest0-21swapper/210:28:132
2142299150,13cyclictest0-21swapper/209:10:172
21421991512,2cyclictest5753-21kworker/u8:210:40:021
21421991512,2cyclictest3597-21kworker/u8:109:23:051
21421991512,2cyclictest27732-21kworker/u8:111:28:051
21421991512,2cyclictest10353-21kworker/u8:211:06:051
2142199150,2cyclictest0-21swapper/109:13:051
2142099152,7cyclictest0-21swapper/009:50:010
21420991512,2cyclictest30938-21kworker/u8:209:01:050
21420991512,2cyclictest1023-21kworker/u8:211:29:050
21420991510,3cyclictest0-21swapper/011:37:310
2142099150,2cyclictest0-21swapper/011:13:040
2142099150,2cyclictest0-21swapper/009:13:050
2142099150,14cyclictest0-21swapper/012:07:120
2142099150,10cyclictest0-21swapper/011:34:050
21423991411,2cyclictest3507-21kworker/u8:009:43:053
21423991411,2cyclictest27903-21apt-get08:45:123
21423991411,2cyclictest23444-21ssh09:29:013
2142399140,13cyclictest12970-21ssh10:27:023
2142399140,12cyclictest8642-21ssh09:12:433
2142399140,12cyclictest0-21swapper/311:56:013
2142399140,12cyclictest0-21swapper/311:25:053
2142399140,12cyclictest0-21swapper/309:49:513
2142299140,12cyclictest6015-21munin-node2
2142299140,12cyclictest3703-21sshd10:21:112
2142299140,12cyclictest13445-21ssh11:02:332
2142299140,12cyclictest0-21swapper/211:50:342
2142299140,12cyclictest0-21swapper/210:15:042
2142299140,12cyclictest0-21swapper/209:51:422
2142299140,12cyclictest0-21swapper/209:32:372
2142299140,12cyclictest0-21swapper/209:20:162
2142299140,12cyclictest0-21swapper/207:45:192
21421991411,2cyclictest29845-21kworker/u8:207:59:051
21421991411,2cyclictest29845-21kworker/u8:207:54:051
21421991411,2cyclictest29128-21apt-get11:20:091
21421991411,2cyclictest2422-21kworker/u8:012:24:051
21421991411,2cyclictest0-21swapper/109:40:121
2142199140,2cyclictest0-21swapper/112:27:051
2142199140,12cyclictest0-21swapper/110:00:191
2142199140,12cyclictest0-21swapper/109:50:521
2142099148,5cyclictest21419-21cyclictest10:00:060
21420991411,2cyclictest9316-21kworker/u8:109:50:060
21420991411,2cyclictest7633-21kworker/u8:008:02:050
21420991411,2cyclictest29845-21kworker/u8:207:49:040
21420991411,2cyclictest29845-21kworker/u8:207:41:050
21420991411,2cyclictest27732-21kworker/u8:111:05:050
21420991411,2cyclictest27504-21kworker/u8:209:38:060
21420991411,2cyclictest24276-21kworker/u8:311:53:050
21420991411,2cyclictest19409-21kworker/u8:108:43:040
21420991411,2cyclictest19409-21kworker/u8:108:23:040
21420991411,2cyclictest11647-21kworker/u8:010:38:020
2142099140,2cyclictest0-21swapper/012:27:050
2142099140,2cyclictest0-21swapper/009:41:560
2142099140,12cyclictest13121-21ssh10:27:170
73712131,2sleep30-21swapper/310:55:513
72432130,2sleep10-21swapper/110:20:571
311382130,2sleep00-21swapper/011:56:240
225152130,2sleep00-21swapper/009:27:290
21423991310,2cyclictest9316-21kworker/u8:109:50:013
21423991310,2cyclictest27732-21kworker/u8:110:45:053
21423991310,2cyclictest0-21swapper/312:34:583
21423991310,2cyclictest0-21swapper/311:18:103
21423991310,2cyclictest0-21swapper/310:52:503
21423991310,2cyclictest0-21swapper/310:20:323
21423991310,2cyclictest0-21swapper/310:16:433
21423991310,2cyclictest0-21swapper/310:02:173
21423991310,2cyclictest0-21swapper/309:55:423
21423991310,2cyclictest0-21swapper/309:22:083
21423991310,2cyclictest0-21swapper/308:20:163
21423991310,2cyclictest0-21swapper/308:06:043
21423991310,2cyclictest0-21swapper/308:00:123
21423991310,2cyclictest0-21swapper/307:40:193
2142399130,2cyclictest13549-21apt-get08:10:053
2142399130,2cyclictest0-21swapper/311:47:123
2142399130,2cyclictest0-21swapper/311:38:393
2142399130,2cyclictest0-21swapper/311:08:313
2142399130,12cyclictest25811-21ssh12:25:493
2142399130,12cyclictest0-21swapper/312:37:193
2142399130,12cyclictest0-21swapper/312:05:393
2142399130,12cyclictest0-21swapper/310:10:023
2142399130,12cyclictest0-21swapper/309:30:323
2142399130,12cyclictest0-21swapper/307:20:123
2142399130,12cyclictest0-21swapper/307:15:133
2142399130,11cyclictest0-21swapper/312:20:143
2142299138,3cyclictest0-21swapper/212:37:182
21422991310,2cyclictest5443-21diskmemload09:35:122
21422991310,2cyclictest21419-21cyclictest12:22:402
21422991310,2cyclictest0-21swapper/212:02:442
21422991310,2cyclictest0-21swapper/211:47:472
21422991310,2cyclictest0-21swapper/211:11:012
21422991310,2cyclictest0-21swapper/210:56:532
21422991310,2cyclictest0-21swapper/209:25:022
21422991310,2cyclictest0-21swapper/208:35:182
2142299130,2cyclictest31816-21ssh10:13:032
2142299130,2cyclictest0-21swapper/212:16:172
2142299130,2cyclictest0-21swapper/210:34:462
2142299130,12cyclictest32020-21ssh12:32:562
2142299130,12cyclictest0-21swapper/211:58:332
2142299130,12cyclictest0-21swapper/211:35:362
2142299130,12cyclictest0-21swapper/211:25:162
2142299130,12cyclictest0-21swapper/208:50:192
2142299130,12cyclictest0-21swapper/208:26:012
2142199131,10cyclictest13549-21apt-get08:10:061
21421991310,2cyclictest18403-21kworker/u8:211:46:011
21421991310,2cyclictest17080-21kworker/u8:107:14:031
21421991310,2cyclictest1023-21kworker/u8:211:32:051
21421991310,2cyclictest0-21swapper/111:00:041
21421991310,2cyclictest0-21swapper/110:50:171
2142199130,3cyclictest0-21swapper/111:37:171
2142199130,2cyclictest0-21swapper/110:45:051
2142199130,2cyclictest0-21swapper/108:15:121
2142199130,12cyclictest0-21swapper/107:40:121
2142199130,11cyclictest0-21swapper/110:30:501
2142099138,3cyclictest7433-21latency_hist07:54:590
2142099138,3cyclictest29697-21cut11:20:130
2142099132,6cyclictest0-21swapper/007:15:000
21420991310,2cyclictest7058-21kworker/u8:209:17:040
21420991310,2cyclictest29845-21kworker/u8:207:37:050
21420991310,2cyclictest26726-21kworker/u8:007:24:010
21420991310,2cyclictest19228-21kworker/u8:110:17:050
21420991310,2cyclictest11647-21kworker/u8:010:31:040
2142099130,11cyclictest0-21swapper/012:15:180
2142399129,2cyclictest0-21swapper/312:11:273
2142399129,2cyclictest0-21swapper/312:00:423
2142399129,2cyclictest0-21swapper/311:31:273
2142399129,2cyclictest0-21swapper/311:11:193
2142399129,2cyclictest0-21swapper/307:45:393
2142399120,11cyclictest10309-21copy11:00:043
2142399120,11cyclictest0-21swapper/312:17:293
2142399120,11cyclictest0-21swapper/311:20:313
2142399120,11cyclictest0-21swapper/309:15:523
2142399120,11cyclictest0-21swapper/309:00:123
2142399120,11cyclictest0-21swapper/307:55:173
2142399120,11cyclictest0-21swapper/307:31:013
2142299129,2cyclictest10255-21ssh09:15:022
2142299129,2cyclictest0-21swapper/212:06:082
2142299129,2cyclictest0-21swapper/211:40:342
2142299129,2cyclictest0-21swapper/210:42:232
2142299129,2cyclictest0-21swapper/209:00:112
2142299122,6cyclictest0-21swapper/208:01:012
2142299120,2cyclictest31957-21ssh10:47:542
2142299120,2cyclictest0-21swapper/212:25:372
2142299120,2cyclictest0-21swapper/211:15:342
2142299120,2cyclictest0-21swapper/209:40:442
2142299120,2cyclictest0-21swapper/208:20:162
2142299120,2cyclictest0-21swapper/208:05:182
2142299120,2cyclictest0-21swapper/207:15:132
2142299120,11cyclictest0-21swapper/212:11:372
2142299120,11cyclictest0-21swapper/210:50:532
2142299120,11cyclictest0-21swapper/210:35:052
2142299120,11cyclictest0-21swapper/210:05:182
2142299120,11cyclictest0-21swapper/210:00:562
2142299120,11cyclictest0-21swapper/209:45:052
2142299120,11cyclictest0-21swapper/208:10:142
2142199129,2cyclictest30938-21kworker/u8:208:57:041
2142199129,2cyclictest29845-21kworker/u8:207:39:041
2142199129,2cyclictest26726-21kworker/u8:007:25:051
2142199129,2cyclictest17080-21kworker/u8:107:31:051
2142199129,2cyclictest13835-21kworker/u8:208:20:021
2142199129,2cyclictest11534-21kworker/u8:108:08:021
2142199121,9cyclictest29908-21munin-node1
2142199121,9cyclictest1125-21head12:35:111
2142199121,9cyclictest0-21swapper/110:35:181
2142199121,3cyclictest0-21swapper/111:55:161
2142199121,3cyclictest0-21swapper/108:35:191
2142199120,2cyclictest0-21swapper/112:06:071
2142199120,2cyclictest0-21swapper/109:35:051
2142199120,2cyclictest0-21swapper/107:45:181
2142199120,11cyclictest0-21swapper/109:31:481
2142099129,2cyclictest17080-21kworker/u8:107:15:050
2142099129,2cyclictest13835-21kworker/u8:208:15:040
2142099129,2cyclictest11534-21kworker/u8:108:09:040
2142099129,2cyclictest0-21swapper/010:50:270
2142099123,6cyclictest0-21swapper/010:11:010
2142099121,10cyclictest28966-21ssh10:45:120
2142099120,7cyclictest0-21swapper/007:57:050
2142099120,3cyclictest28329-21fschecks_count08:45:140
2142099120,2cyclictest0-21swapper/007:30:120
2142099120,11cyclictest0-21swapper/010:22:270
20282120,2sleep10-21swapper/110:15:241
198132120,2sleep10-21swapper/109:25:141
2142399118,2cyclictest0-21swapper/308:50:013
2142399118,2cyclictest0-21swapper/307:35:133
2142399110,10cyclictest19409-21kworker/u8:108:27:053
2142299118,2cyclictest0-21swapper/207:20:142
2142299113,5cyclictest0-21swapper/207:56:032
2142299112,6cyclictest0-21swapper/208:58:392
2142299112,5cyclictest31528-21apt-get07:35:002
2142199111,3cyclictest3524-21munin-node1
2142199111,3cyclictest0-21swapper/112:15:141
2142199111,2cyclictest0-21swapper/112:31:031
2142199110,9cyclictest0-21swapper/108:00:181
2142199110,9cyclictest0-21swapper/107:20:181
2142199110,3cyclictest21858-21munin-node1
2142199110,3cyclictest0-21swapper/108:40:161
2142199110,10cyclictest0-21swapper/110:28:051
2142399107,2cyclictest7633-21kworker/u8:008:31:043
2142399107,2cyclictest0-21swapper/308:55:183
2142399105,3cyclictest26434-21grep08:40:163
2142399100,2cyclictest0-21swapper/307:11:593
2142299107,2cyclictest0-21swapper/207:50:162
2142299107,2cyclictest0-21swapper/207:38:232
2142299100,7cyclictest0-21swapper/208:32:592
2142199107,2cyclictest5443-21diskmemload11:52:361
2142199105,3cyclictest25097-21head07:16:041
2142199100,8cyclictest0-21swapper/108:45:121
2142199100,2cyclictest0-21swapper/109:15:041
2142099104,4cyclictest20140-21tr08:25:140
214239996,2cyclictest3597-21kworker/u8:109:06:063
214239994,3cyclictest5687-21telnet07:50:133
214229994,3cyclictest28423-21fschecks_time08:45:142
214229994,3cyclictest22485-21needreboot07:10:162
214229994,3cyclictest15833-21aten2.4-expect08:15:102
214219990,2cyclictest0-21swapper/109:00:051
214219990,2cyclictest0-21swapper/108:25:041
214209994,3cyclictest30476-21tr08:50:160
214239985,2cyclictest0-21swapper/308:35:173
214239980,7cyclictest0-21swapper/308:19:563
214239980,2cyclictest0-21swapper/307:25:213
214229984,2cyclictest3728-21runrttasks09:05:252
214229983,3cyclictest28468-21cat07:25:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional