You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 15:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 18, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11365212094,19sleep20-21swapper/207:05:012
11568211695,16sleep00-21swapper/007:05:030
13219211396,11sleep10-21swapper/107:08:081
2245021060,0sleep00-21swapper/011:36:080
13078210579,6sleep30-21swapper/307:06:183
35332700,1sleep0101ktimersoftd/009:15:590
319222670,5sleep01339099cyclictest11:48:350
1339099290,20cyclictest0-21swapper/011:40:130
1339099290,11cyclictest0-21swapper/008:10:110
1339399273,22cyclictest0-21swapper/309:35:113
1339399231,20cyclictest0-21swapper/310:20:093
260082220,1sleep20-21swapper/207:40:132
1339399221,3cyclictest0-21swapper/309:15:173
1339399220,3cyclictest0-21swapper/309:00:133
1339399220,3cyclictest0-21swapper/307:10:083
1339199220,20cyclictest29745-21diskmemload11:40:141
1339399211,18cyclictest0-21swapper/307:40:113
1339399210,3cyclictest0-21swapper/311:15:183
1339399210,3cyclictest0-21swapper/310:50:143
1339399210,3cyclictest0-21swapper/310:50:133
1339399210,3cyclictest0-21swapper/310:35:173
1339399210,3cyclictest0-21swapper/307:30:173
1339399210,19cyclictest0-21swapper/309:13:593
1339199210,2cyclictest0-21swapper/110:35:111
1339399201,3cyclictest3174-21apt-get08:05:023
1339399201,3cyclictest28622-21iostat09:05:163
1339399200,3cyclictest9111-21sh10:01:533
1339399200,3cyclictest523-21munin-node3
1339399200,3cyclictest30545-21ssh10:28:333
1339399200,3cyclictest26022-21taskset09:44:103
1339399200,3cyclictest26000-21mktemp12:20:173
1339399200,3cyclictest21318-21users08:45:253
1339399200,3cyclictest20303-21sed10:15:213
1339399200,3cyclictest11230-21ssh12:02:053
1339399200,3cyclictest0-21swapper/312:12:293
1339399200,3cyclictest0-21swapper/311:30:133
1339399200,3cyclictest0-21swapper/311:07:133
1339399200,3cyclictest0-21swapper/311:02:333
1339399200,3cyclictest0-21swapper/308:10:183
1339399200,3cyclictest0-21swapper/307:55:213
1339399200,18cyclictest0-21swapper/312:29:093
1339299200,2cyclictest0-21swapper/207:45:142
1339199200,2cyclictest0-21swapper/109:35:111
1339199200,18cyclictest0-21swapper/110:25:111
1339099203,15cyclictest0-21swapper/011:05:050
1339399190,3cyclictest3721-21ssh11:53:543
1339399190,3cyclictest3501-21ssh12:32:053
1339399190,3cyclictest29745-21diskmemload11:45:173
1339399190,3cyclictest24316-21diskstats08:55:133
1339399190,3cyclictest22948-21ssh10:58:293
1339399190,3cyclictest21975-21munin-node3
1339399190,3cyclictest20489-21cat07:25:173
1339399190,3cyclictest14975-21ssh11:27:373
1339399190,3cyclictest13319-21ssh10:45:413
1339399190,3cyclictest12021-21sh11:24:573
1339399190,3cyclictest0-21swapper/312:36:453
1339399190,3cyclictest0-21swapper/311:41:543
1339399190,3cyclictest0-21swapper/307:18:293
1339399190,2cyclictest0-21swapper/311:57:093
1339399190,2cyclictest0-21swapper/311:35:173
1339399190,2cyclictest0-21swapper/309:53:473
13390991916,2cyclictest29574-21kworker/u8:012:32:040
13391991815,2cyclictest6947-21kworker/u8:211:23:031
13390991815,2cyclictest3273-21kworker/u8:110:55:050
1339399171,3cyclictest0-21swapper/309:25:143
1339399170,3cyclictest13320-21cut12:05:133
1339399170,2cyclictest0-21swapper/307:45:263
1339399170,15cyclictest0-21swapper/310:32:463
13391991714,2cyclictest14319-21kworker/u8:009:32:041
13390991714,2cyclictest3273-21kworker/u8:110:41:030
13390991714,2cyclictest28937-21kworker/u8:011:56:050
13390991714,2cyclictest25159-21kworker/u8:010:25:030
13390991714,2cyclictest21729-21kworker/u8:110:02:040
13390991714,2cyclictest17105-21kworker/u8:212:25:040
1339399164,3cyclictest9203-21ssh09:23:403
13392991612,2cyclictest0-21swapper/209:33:212
13391991613,2cyclictest462-21kworker/u8:209:26:041
13390991613,2cyclictest28217-21kworker/u8:111:13:030
13390991613,2cyclictest19174-21kworker/u8:110:18:040
1339399154,3cyclictest30819-21pzem_energy07:50:203
1339399154,3cyclictest18788-21ntp_offset08:40:193
1339399153,3cyclictest6477-21nscd09:30:123
1339399153,3cyclictest18501-21grep07:20:173
1339399153,3cyclictest10917-21mailstats08:20:213
1339399151,4cyclictest13639-21cron08:30:003
1339399151,3cyclictest11580-21http_loadtime10:05:153
1339399151,3cyclictest0-21swapper/310:40:063
1339399151,3cyclictest0-21swapper/310:10:143
1339399151,3cyclictest0-21swapper/309:55:123
1339399151,3cyclictest0-21swapper/309:45:143
1339399151,3cyclictest0-21swapper/308:30:173
1339399151,3cyclictest0-21swapper/307:35:183
13392991512,2cyclictest29745-21diskmemload12:19:102
1339299150,2cyclictest0-21swapper/210:38:202
1339299150,13cyclictest29745-21diskmemload11:30:302
1339299150,13cyclictest29745-21diskmemload11:10:302
1339299150,13cyclictest29745-21diskmemload09:46:002
1339299150,13cyclictest0-21swapper/212:13:052
1339299150,13cyclictest0-21swapper/210:58:502
1339199151,12cyclictest328750irq/24-eth109:55:331
1339199150,13cyclictest29745-21diskmemload10:03:521
1339199150,13cyclictest2240-21sed12:30:221
1339199150,13cyclictest0-21swapper/110:54:021
1339199150,13cyclictest0-21swapper/110:54:021
1339199150,13cyclictest0-21swapper/109:54:451
13390991512,2cyclictest462-21kworker/u8:209:30:040
13390991512,2cyclictest25159-21kworker/u8:010:49:030
13390991512,2cyclictest22688-21kworker/u8:007:30:040
13390991512,2cyclictest21729-21kworker/u8:109:53:040
1339099151,12cyclictest10787-21ssh11:22:280
1339099151,12cyclictest0-21swapper/007:25:130
1339099150,13cyclictest32551-21ssh09:12:220
1339099150,13cyclictest0-21swapper/009:40:010
32222140,2sleep20-21swapper/211:52:552
182772140,2sleep10-21swapper/111:31:021
1339399141,3cyclictest7903-21aten2.4_r3power08:15:123
1339399141,3cyclictest7903-21aten2.4_r3power08:15:113
1339399141,3cyclictest21918-21sshd08:50:113
1339399141,3cyclictest0-21swapper/308:35:133
1339399141,3cyclictest0-21swapper/308:00:103
13392991411,2cyclictest0-21swapper/210:42:302
13392991411,2cyclictest0-21swapper/210:03:202
1339299141,10cyclictest0-21swapper/212:34:022
1339299140,3cyclictest5233-21sh12:35:092
1339299140,2cyclictest29745-21diskmemload10:28:572
1339299140,2cyclictest29745-21diskmemload09:51:002
1339299140,2cyclictest0-21swapper/212:00:402
1339299140,2cyclictest0-21swapper/210:33:002
1339299140,13cyclictest0-21swapper/210:07:102
1339299140,12cyclictest0-21swapper/211:47:502
1339299140,12cyclictest0-21swapper/209:35:132
1339199149,3cyclictest19536-21cat07:25:001
13391991411,2cyclictest0-21swapper/111:17:321
13391991410,2cyclictest0-21swapper/111:35:171
1339199140,2cyclictest0-21swapper/110:30:281
1339199140,2cyclictest0-21swapper/110:22:331
1339199140,12cyclictest29745-21diskmemload12:00:151
1339199140,12cyclictest29745-21diskmemload11:10:031
1339199140,12cyclictest29745-21diskmemload09:45:321
1339199140,12cyclictest29745-21diskmemload09:20:191
1339199140,12cyclictest221ktimersoftd/110:15:521
1339199140,12cyclictest0-21swapper/112:26:191
1339199140,12cyclictest0-21swapper/112:22:411
1339199140,12cyclictest0-21swapper/111:28:311
1339199140,12cyclictest0-21swapper/111:00:461
1339199140,12cyclictest0-21swapper/110:48:581
1339199140,12cyclictest0-21swapper/110:41:091
1339199140,12cyclictest0-21swapper/108:30:111
1339099142,7cyclictest0-21swapper/007:50:000
1339099142,6cyclictest0-21swapper/009:30:000
1339099141,2cyclictest5575-21ssh10:37:040
13390991411,2cyclictest462-21kworker/u8:209:35:040
13390991410,2cyclictest26263-21missed_timers12:20:200
1339099140,2cyclictest29745-21diskmemload12:15:410
1339099140,13cyclictest0-21swapper/010:31:210
1339099140,12cyclictest29745-21diskmemload11:01:080
1339099140,12cyclictest0-21swapper/012:35:280
1339099140,12cyclictest0-21swapper/012:10:460
1339099140,12cyclictest0-21swapper/011:54:180
1339099140,12cyclictest0-21swapper/009:46:390
13392991310,2cyclictest29745-21diskmemload10:53:292
13392991310,2cyclictest29745-21diskmemload10:53:282
13392991310,2cyclictest0-21swapper/212:25:302
13392991310,2cyclictest0-21swapper/212:20:512
13392991310,2cyclictest0-21swapper/211:25:122
1339299130,2cyclictest0-21swapper/211:19:112
1339299130,2cyclictest0-21swapper/210:47:512
1339299130,2cyclictest0-21swapper/209:42:102
1339299130,2cyclictest0-21swapper/207:35:192
1339299130,12cyclictest0-21swapper/212:05:442
1339299130,12cyclictest0-21swapper/211:56:272
1339299130,12cyclictest0-21swapper/211:36:302
1339299130,12cyclictest0-21swapper/211:06:182
1339299130,12cyclictest0-21swapper/209:57:112
1339299130,12cyclictest0-21swapper/208:05:182
1339299130,11cyclictest29745-21diskmemload11:40:482
1339299130,11cyclictest29745-21diskmemload10:15:052
1339299130,11cyclictest29745-21diskmemload09:16:542
1339299130,11cyclictest0-21swapper/211:20:472
1339299130,11cyclictest0-21swapper/211:01:032
1339199132,9cyclictest17471-21df_abs12:10:141
13391991310,2cyclictest23340-21kworker/u8:207:39:051
13391991310,2cyclictest0-21swapper/112:37:561
13391991310,2cyclictest0-21swapper/111:51:461
13391991310,2cyclictest0-21swapper/109:40:121
1339199130,2cyclictest0-21swapper/112:06:261
1339199130,2cyclictest0-21swapper/111:56:131
1339199130,1cyclictest0-21swapper/110:10:531
1339199130,12cyclictest0-21swapper/111:05:041
1339199130,12cyclictest0-21swapper/109:10:261
1339099132,8cyclictest0-21swapper/008:52:580
13390991310,2cyclictest18052-21ssh10:51:550
13390991310,2cyclictest18052-21ssh10:51:550
13390991310,2cyclictest0-21swapper/012:00:410
13390991310,2cyclictest0-21swapper/011:25:310
13390991310,2cyclictest0-21swapper/011:17:350
13390991310,2cyclictest0-21swapper/009:21:240
13390991310,2cyclictest0-21swapper/007:20:130
1339099130,2cyclictest19946-21aten2.4_r3power08:45:120
1339099130,2cyclictest0-21swapper/009:55:270
1339099130,2cyclictest0-21swapper/008:30:160
1339099130,2cyclictest0-21swapper/008:05:110
1339099130,12cyclictest0-21swapper/012:05:110
1339099130,11cyclictest0-21swapper/010:20:440
1339299129,2cyclictest0-21swapper/210:20:032
1339299129,2cyclictest0-21swapper/210:10:102
1339299129,2cyclictest0-21swapper/208:00:112
1339299129,2cyclictest0-21swapper/207:30:042
1339299129,2cyclictest0-21swapper/207:20:242
1339299120,2cyclictest0-21swapper/209:10:312
1339299120,2cyclictest0-21swapper/208:10:222
1339299120,11cyclictest29745-21diskmemload09:26:192
1339299120,11cyclictest0-21swapper/209:20:012
1339299120,11cyclictest0-21swapper/209:05:232
1339299120,11cyclictest0-21swapper/208:50:012
1339299120,11cyclictest0-21swapper/208:20:202
1339299120,11cyclictest0-21swapper/208:15:252
1339299120,11cyclictest0-21swapper/208:15:252
1339199129,2cyclictest7458-21runrttasks09:00:111
1339199122,7cyclictest0-21swapper/108:59:021
1339199121,3cyclictest4207-21iostat_ios08:05:141
1339199120,3cyclictest29745-21diskmemload12:15:041
1339199120,2cyclictest22932-21cut08:50:211
1339199120,2cyclictest0-21swapper/110:05:361
1339199120,2cyclictest0-21swapper/107:55:171
1339199120,2cyclictest0-21swapper/107:45:251
1339199120,11cyclictest0-21swapper/111:45:351
1339199120,11cyclictest0-21swapper/109:15:131
1339199120,11cyclictest0-21swapper/108:25:141
1339199120,11cyclictest0-21swapper/107:30:151
1339099129,2cyclictest27904-21kworker/u8:108:01:050
1339099129,2cyclictest23618-21kworker/u8:009:08:040
1339099129,2cyclictest0-21swapper/007:15:230
1339099128,2cyclictest0-21swapper/007:10:150
1339099122,6cyclictest0-21swapper/008:40:000
1339099120,11cyclictest15099-21ssh10:10:120
1339099120,11cyclictest0-21swapper/011:31:090
1339099120,11cyclictest0-21swapper/010:05:590
1339099120,11cyclictest0-21swapper/008:40:170
1339099120,11cyclictest0-21swapper/007:35:180
1339299118,2cyclictest0-21swapper/208:40:212
1339299113,6cyclictest0-21swapper/207:25:242
1339299111,6cyclictest0-21swapper/209:03:122
1339199118,2cyclictest23340-21kworker/u8:207:42:041
1339199118,2cyclictest13279-21kworker/u8:108:46:041
1339199118,2cyclictest0-21swapper/109:05:141
1339199112,6cyclictest0-21swapper/108:19:581
1339199112,6cyclictest0-21swapper/108:19:581
1339199112,6cyclictest0-21swapper/107:11:591
1339199110,9cyclictest3183-21copy08:05:011
1339199110,9cyclictest21059-21grep10:55:211
1339199110,3cyclictest0-21swapper/108:10:051
1339199110,2cyclictest0-21swapper/107:25:211
1339099118,2cyclictest23618-21kworker/u8:008:58:040
1339099118,2cyclictest13279-21kworker/u8:108:28:040
1339099110,10cyclictest0-21swapper/007:50:280
1339299105,3cyclictest20777-21tr08:45:162
1339299105,3cyclictest16252-21ethtool07:15:132
1339299102,6cyclictest0-21swapper/207:12:542
1339299102,5cyclictest0-21swapper/208:29:582
1339199106,2cyclictest15872-21munin-node1
1339199102,7cyclictest0-21swapper/108:44:581
1339199100,9cyclictest0-21swapper/107:50:151
1339199100,8cyclictest0-21swapper/107:15:211
1339099102,7cyclictest0-21swapper/007:59:580
1339099101,7cyclictest25825-21head07:40:120
1339099100,9cyclictest0-21swapper/009:03:130
133929994,3cyclictest31818-21munin-node2
133929994,3cyclictest25720-21munin-run09:00:012
133929994,3cyclictest17652-21cron08:40:002
133929991,2cyclictest0-21swapper/208:30:052
133929990,6cyclictest0-21swapper/207:54:582
133919996,2cyclictest0-21swapper/108:20:141
133909996,2cyclictest0-21swapper/008:20:130
133909994,3cyclictest8816-21pzem_energy08:15:190
133909994,3cyclictest8816-21pzem_energy08:15:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional