You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 21:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Wed Nov 26, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20433211996,17sleep00-21swapper/007:08:140
20260211596,14sleep10-21swapper/107:06:031
20219211595,15sleep30-21swapper/307:05:343
20261211496,12sleep20-21swapper/207:06:042
154122790,0sleep30-21swapper/311:05:013
35542590,0sleep20-21swapper/207:45:222
20599993717,18cyclictest0-21swapper/009:10:130
2059999371,34cyclictest24851-21ssh11:15:120
204192320,1sleep30-21swapper/310:35:153
2060199281,19cyclictest0-21swapper/209:10:132
72722260,1sleep1221ktimersoftd/109:45:591
2060199250,18cyclictest0-21swapper/209:30:122
2059999256,2cyclictest12-21rcu_preempt09:30:110
209272210,1sleep09-21ksoftirqd/012:20:050
20599992118,2cyclictest32501-21kworker/u8:211:05:060
20599992118,2cyclictest25414-21kworker/u8:112:00:050
20599992118,2cyclictest24547-21kworker/u8:012:32:050
139732210,0sleep10-21swapper/110:28:361
2060199202,7cyclictest0-21swapper/211:10:002
2060099202,2cyclictest0-21swapper/110:36:051
20599992017,2cyclictest8563-21kworker/u8:009:52:050
20599992017,2cyclictest31910-21kworker/u8:210:21:040
2059999201,17cyclictest0-21swapper/012:26:020
20602991914,3cyclictest993-21ssh10:15:113
2060299190,18cyclictest0-21swapper/308:10:103
2059999190,2cyclictest0-21swapper/010:10:020
2059999190,14cyclictest0-21swapper/011:37:040
20601991813,3cyclictest29164-21ssh10:45:122
20600991813,4cyclictest6064-21kworker/u8:012:39:041
2060099180,2cyclictest4518-21diskmemload09:14:021
20599991815,2cyclictest15171-21kworker/u8:211:53:050
20600991714,2cyclictest6593-21kworker/u8:111:35:051
20600991714,2cyclictest18592-21kworker/u8:010:40:041
20599991714,2cyclictest26633-21kworker/u8:107:42:020
20599991714,2cyclictest24506-21kworker/u8:110:42:050
20599991714,2cyclictest17076-21kworker/u8:108:25:050
20599991714,2cyclictest15078-21kworker/u8:110:18:020
20599991714,2cyclictest15078-21kworker/u8:110:03:050
20599991714,2cyclictest14490-21kworker/u8:209:21:050
2059999170,2cyclictest0-21swapper/011:04:050
2059999170,12cyclictest0-21swapper/008:22:020
2060199161,13cyclictest9810-21seq08:00:182
20601991611,3cyclictest0-21swapper/212:10:172
20601991611,3cyclictest0-21swapper/207:15:162
2060199160,14cyclictest0-21swapper/209:00:062
20600991613,2cyclictest31910-21kworker/u8:210:23:051
2060099160,2cyclictest4518-21diskmemload09:51:041
20599991613,2cyclictest8691-21kworker/u8:009:18:040
20599991613,2cyclictest32501-21kworker/u8:210:55:040
20599991613,2cyclictest30368-21kworker/u8:007:32:040
20599991613,2cyclictest22156-21kworker/u8:111:20:050
20599991613,2cyclictest19973-21kworker/u8:011:47:040
20599991613,2cyclictest10658-21kworker/u8:008:42:040
20599991612,2cyclictest20346-21kworker/u8:007:12:060
2059999160,2cyclictest0-21swapper/009:36:020
2059999160,14cyclictest0-21swapper/010:53:050
2060299151,3cyclictest5192-21sh09:45:053
2060299151,3cyclictest4078-21ssh12:01:053
2060299151,12cyclictest20915-21irqstats11:10:163
2060299150,3cyclictest0-21swapper/309:58:573
2060299150,3cyclictest0-21swapper/308:00:013
2060299150,2cyclictest0-21swapper/311:53:173
2060299150,13cyclictest0-21swapper/310:30:213
2060299150,13cyclictest0-21swapper/307:52:033
2060299150,13cyclictest0-21swapper/307:52:023
2060199152,7cyclictest0-21swapper/212:35:002
20601991510,3cyclictest22121-21ssh09:28:022
20601991510,2cyclictest0-21swapper/208:50:102
20600991512,2cyclictest25414-21kworker/u8:111:59:041
20600991512,2cyclictest19935-21kworker/u8:009:32:041
20600991512,2cyclictest16425-21kworker/u8:212:16:021
20600991512,2cyclictest15171-21kworker/u8:211:45:041
20600991512,2cyclictest15078-21kworker/u8:110:04:061
20600991510,3cyclictest10016-21df_inode09:15:141
2060099150,3cyclictest0-21swapper/111:15:141
20599991512,2cyclictest804-21kworker/u8:109:09:040
20599991512,2cyclictest7045-21kworker/u8:107:57:050
20599991512,2cyclictest29196-21kworker/u8:208:54:040
20599991512,2cyclictest25875-21kworker/u8:207:26:050
20599991512,2cyclictest25414-21kworker/u8:111:58:040
20599991512,2cyclictest17076-21kworker/u8:108:49:050
20599991512,2cyclictest0-21swapper/010:05:140
20599991510,3cyclictest24630-21munin-run07:20:010
20602991411,2cyclictest0-21swapper/311:25:173
20602991411,2cyclictest0-21swapper/311:09:363
20602991410,2cyclictest4518-21diskmemload11:15:253
20602991410,2cyclictest0-21swapper/312:24:373
2060299140,2cyclictest0-21swapper/312:11:083
2060299140,2cyclictest0-21swapper/310:49:173
2060299140,2cyclictest0-21swapper/309:24:523
2060299140,13cyclictest0-21swapper/311:43:563
2060299140,13cyclictest0-21swapper/309:35:073
2060299140,12cyclictest4518-21diskmemload11:55:063
2060299140,12cyclictest0-21swapper/312:15:253
2060299140,12cyclictest0-21swapper/311:38:543
2060299140,12cyclictest0-21swapper/311:21:323
2060299140,12cyclictest0-21swapper/309:51:113
2060299140,12cyclictest0-21swapper/309:16:013
2060199149,3cyclictest0-21swapper/212:09:522
2060199149,3cyclictest0-21swapper/210:17:332
20601991411,2cyclictest0-21swapper/210:00:472
2060199141,11cyclictest8753-21ssh09:48:222
2060199140,2cyclictest0-21swapper/210:42:452
2060199140,13cyclictest0-21swapper/212:20:262
2060199140,12cyclictest0-21swapper/210:54:192
2060199140,12cyclictest0-21swapper/209:21:172
2060099149,3cyclictest15888-21ssh11:40:131
2060099142,7cyclictest0-21swapper/109:00:011
2060099142,7cyclictest0-21swapper/107:25:011
2060099142,6cyclictest0-21swapper/107:30:001
20600991411,2cyclictest5405-21kworker/u8:012:09:051
20600991411,2cyclictest24506-21kworker/u8:110:56:041
2060099140,9cyclictest0-21swapper/107:16:041
2060099140,3cyclictest0-21swapper/111:01:561
2060099140,2cyclictest20497-21unixbench_singl09:25:301
2060099140,12cyclictest4518-21diskmemload11:29:491
2060099140,12cyclictest4518-21diskmemload11:08:011
2060099140,12cyclictest14055-21swap08:10:251
2060099140,12cyclictest0-21swapper/111:23:201
2059999141,2cyclictest20137-21ssh11:10:060
20599991411,2cyclictest10658-21kworker/u8:008:10:050
20599991411,2cyclictest0-21swapper/012:06:350
2059999140,2cyclictest0-21swapper/012:10:140
2059999140,2cyclictest0-21swapper/011:44:550
2059999140,2cyclictest0-21swapper/010:50:000
2059999140,2cyclictest0-21swapper/010:29:050
2059999140,2cyclictest0-21swapper/009:42:040
106302140,2sleep00-21swapper/011:34:370
20602991310,2cyclictest0-21swapper/312:25:253
20602991310,2cyclictest0-21swapper/312:05:183
20602991310,2cyclictest0-21swapper/310:55:083
20602991310,2cyclictest0-21swapper/310:52:163
20602991310,2cyclictest0-21swapper/310:10:133
20602991310,2cyclictest0-21swapper/310:01:023
20602991310,2cyclictest0-21swapper/309:40:273
20602991310,2cyclictest0-21swapper/309:05:163
2060299130,2cyclictest0-21swapper/312:30:113
2060299130,2cyclictest0-21swapper/311:31:463
2060299130,2cyclictest0-21swapper/310:22:173
2060299130,2cyclictest0-21swapper/309:26:093
2060299130,2cyclictest0-21swapper/309:10:183
2060299130,12cyclictest4518-21diskmemload10:41:433
2060299130,12cyclictest20970-21ssh11:45:153
2060299130,12cyclictest0-21swapper/308:30:173
2060199132,7cyclictest6696-21copy12:05:012
2060199132,6cyclictest0-21swapper/212:20:012
2060199131,9cyclictest21751-21ssh11:45:232
20601991310,2cyclictest0-21swapper/212:25:172
20601991310,2cyclictest0-21swapper/211:44:162
20601991310,2cyclictest0-21swapper/210:05:412
20601991310,2cyclictest0-21swapper/209:35:142
2060199130,2cyclictest0-21swapper/211:15:112
2060199130,2cyclictest0-21swapper/211:11:182
2060199130,2cyclictest0-21swapper/209:56:272
2060199130,12cyclictest0-21swapper/211:25:132
2060199130,12cyclictest0-21swapper/210:30:192
2060199130,12cyclictest0-21swapper/207:51:512
2060199130,12cyclictest0-21swapper/207:51:502
2060199130,12cyclictest0-21swapper/207:20:192
2060199130,11cyclictest0-21swapper/210:14:172
2060099138,3cyclictest21889-21ssh11:10:401
2060099138,3cyclictest0-21swapper/109:40:131
2060099132,6cyclictest0-21swapper/110:10:001
20600991310,2cyclictest32501-21kworker/u8:210:51:051
20600991310,2cyclictest30368-21kworker/u8:007:36:051
20600991310,2cyclictest14490-21kworker/u8:209:59:051
20600991310,2cyclictest0-21swapper/112:10:191
20600991310,2cyclictest0-21swapper/109:20:071
20600991310,2cyclictest0-21swapper/108:50:481
20600991310,2cyclictest0-21swapper/108:20:141
2060099130,2cyclictest0-21swapper/110:45:231
2060099130,2cyclictest0-21swapper/107:45:141
2060099130,11cyclictest0-21swapper/112:01:431
2059999131,2cyclictest7166-21ssh09:45:480
20599991310,2cyclictest20346-21kworker/u8:007:22:010
20599991310,2cyclictest0-21swapper/012:15:150
20599991310,2cyclictest0-21swapper/010:36:250
20599991310,2cyclictest0-21swapper/009:27:550
2059999130,2cyclictest0-21swapper/010:31:040
2059999130,12cyclictest0-21swapper/012:35:040
2059999130,11cyclictest4518-21diskmemload09:57:250
2059999130,11cyclictest0-21swapper/011:26:200
281282120,0sleep20-21swapper/211:52:382
2060299129,2cyclictest0-21swapper/309:30:463
2060299122,6cyclictest0-21swapper/308:20:013
2060299120,11cyclictest0-21swapper/312:35:213
2060299120,11cyclictest0-21swapper/310:25:243
2060299120,11cyclictest0-21swapper/310:07:443
2060299120,11cyclictest0-21swapper/308:55:143
2060299120,11cyclictest0-21swapper/308:25:213
2060299120,11cyclictest0-21swapper/307:40:133
2060199129,2cyclictest4518-21diskmemload10:57:012
2060199129,2cyclictest0-21swapper/212:35:162
2060199129,2cyclictest0-21swapper/211:33:182
2060199129,2cyclictest0-21swapper/210:36:032
2060199129,2cyclictest0-21swapper/210:25:182
2060199129,2cyclictest0-21swapper/209:51:362
2060199129,2cyclictest0-21swapper/208:40:292
2060199122,7cyclictest0-21swapper/211:20:012
2060199122,7cyclictest0-21swapper/208:07:592
2060199120,2cyclictest0-21swapper/211:56:212
2060199120,2cyclictest0-21swapper/210:21:022
2060199120,2cyclictest0-21swapper/209:15:012
2060199120,11cyclictest0-21swapper/211:00:182
2060199120,11cyclictest0-21swapper/209:40:142
2060199120,10cyclictest13800-21diskmemload11:37:102
2060099129,2cyclictest2566-21kworker/u8:208:05:051
2060099129,2cyclictest0-21swapper/110:15:221
2060099129,2cyclictest0-21swapper/110:10:471
2060099129,2cyclictest0-21swapper/109:00:111
2060099129,2cyclictest0-21swapper/108:35:251
2060099129,2cyclictest0-21swapper/108:25:161
2060099121,9cyclictest25048-21munin-node1
2060099121,9cyclictest0-21swapper/108:15:181
2060099120,2cyclictest4518-21diskmemload12:33:491
2060099120,11cyclictest0-21swapper/112:20:071
2060099120,11cyclictest0-21swapper/111:30:191
2060099120,11cyclictest0-21swapper/110:32:071
2060099120,11cyclictest0-21swapper/109:35:061
2060099120,10cyclictest0-21swapper/111:50:151
2059999129,2cyclictest0-21swapper/007:35:110
2059999121,9cyclictest24820-21munin-run08:40:010
2059999120,2cyclictest0-21swapper/009:02:050
2059999120,2cyclictest0-21swapper/008:32:020
2059999120,2cyclictest0-21swapper/008:00:180
2060299111,5cyclictest0-21swapper/308:40:003
2060299110,10cyclictest0-21swapper/309:01:473
2060299110,10cyclictest0-21swapper/308:40:303
2060199118,2cyclictest0-21swapper/207:55:272
2060199112,6cyclictest0-21swapper/207:33:582
2060199110,2cyclictest0-21swapper/208:25:142
2060099118,2cyclictest30368-21kworker/u8:007:50:051
2060099118,2cyclictest30368-21kworker/u8:007:50:041
2060099118,2cyclictest17076-21kworker/u8:108:31:051
2060099116,3cyclictest0-21swapper/108:00:261
2060099116,3cyclictest0-21swapper/107:10:241
2060099111,8cyclictest0-21swapper/108:45:171
2060099110,9cyclictest25648-21munin-node1
2060099110,9cyclictest0-21swapper/109:05:101
2060099110,9cyclictest0-21swapper/107:40:121
2060099110,2cyclictest0-21swapper/107:20:191
2059999110,2cyclictest0-21swapper/008:09:040
2060299107,2cyclictest0-21swapper/308:20:273
2060299107,2cyclictest0-21swapper/307:20:153
2060299105,3cyclictest11771-21needreboot08:05:183
2060299102,6cyclictest0-21swapper/307:45:253
2060199105,3cyclictest31540-21awk07:35:152
2060199105,3cyclictest22801-21latency_hist08:35:012
2060199102,5cyclictest5911-21gdm-simple-gree09:07:592
2060199100,7cyclictest0-21swapper/208:37:012
2059999105,3cyclictest278-21jbd2/sda1-807:50:000
2059999100,2cyclictest0-21swapper/007:53:050
2059999100,2cyclictest0-21swapper/007:53:040
206029996,2cyclictest0-21swapper/307:33:583
206029994,3cyclictest10047-21cat08:00:253
206029992,6cyclictest0-21swapper/307:10:263
206029991,6cyclictest0-21swapper/307:15:133
206029990,8cyclictest0-21swapper/307:35:033
206029990,2cyclictest0-21swapper/307:28:563
206019996,2cyclictest0-21swapper/208:10:112
206019994,3cyclictest5129-21runrttasks08:49:492
206019994,3cyclictest31586-21fschecks_time08:55:152
206019994,3cyclictest28048-21switchtime07:25:232
206019994,3cyclictest1745-21cat07:40:252
206019994,3cyclictest0-21swapper/208:20:152
206019994,3cyclictest0-21swapper/207:10:152
206009994,3cyclictest7174-21tr07:55:131
205999990,5cyclictest0-21swapper/008:16:040
14939290,1sleep20-21swapper/208:15:112
206029985,2cyclictest0-21swapper/308:45:143
206029983,3cyclictest29114-21aten2.4_r3power08:50:113
205999983,3cyclictest0-21swapper/008:55:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional