You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 00:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Dec 13, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2082211897,16sleep00-21swapper/007:08:500
19772117106,6sleep30-21swapper/307:07:283
1867211092,12sleep20-21swapper/207:06:032
204829680,11sleep10-21swapper/107:08:231
217652750,1sleep121768-21pzem_current07:55:171
217652750,1sleep121768-21pzem_current07:55:171
238352700,0sleep30-21swapper/312:36:583
142332670,0sleep00-21swapper/012:26:530
45572660,0sleep30-21swapper/308:35:013
220099251,15cyclictest12162-21timerwakeupswit08:50:261
220099220,3cyclictest30153-21sh10:28:591
220099211,12cyclictest0-21swapper/109:58:031
2200992014,4cyclictest0-21swapper/109:40:281
220099200,18cyclictest0-21swapper/110:04:081
220099200,18cyclictest0-21swapper/109:11:021
220099199,8cyclictest14681-21ssh10:12:111
220099190,2cyclictest0-21swapper/112:02:481
220099190,2cyclictest0-21swapper/110:15:551
220099190,12cyclictest18680-21diskmemload11:18:521
220099190,12cyclictest0-21swapper/109:39:081
220099190,11cyclictest0-21swapper/112:31:441
220099190,11cyclictest0-21swapper/111:29:541
220099190,11cyclictest0-21swapper/109:46:361
168492190,2sleep337-21rcuc/309:40:403
220099185,3cyclictest0-21swapper/110:50:181
220099181,7cyclictest0-21swapper/111:45:131
220099180,3cyclictest13207-21munin-node1
220099180,2cyclictest0-21swapper/107:35:131
220099180,1cyclictest0-21swapper/111:07:511
220099180,16cyclictest0-21swapper/111:40:181
220099180,16cyclictest0-21swapper/111:40:181
220099178,2cyclictest0-21swapper/111:22:461
220099178,2cyclictest0-21swapper/111:10:411
220099178,2cyclictest0-21swapper/110:36:461
220099177,2cyclictest0-21swapper/109:30:121
220099171,3cyclictest0-21swapper/109:25:141
220099171,3cyclictest0-21swapper/109:19:521
2200991710,6cyclictest0-21swapper/108:40:381
220099170,3cyclictest697-21date09:25:001
220099170,3cyclictest0-21swapper/108:35:181
220099170,2cyclictest0-21swapper/112:37:241
220099170,2cyclictest0-21swapper/111:35:121
220099170,2cyclictest0-21swapper/110:43:451
220099170,2cyclictest0-21swapper/108:30:231
220099170,16cyclictest0-21swapper/111:59:241
220099170,15cyclictest0-21swapper/108:45:131
220099170,15cyclictest0-21swapper/107:15:221
220099170,10cyclictest0-21swapper/110:21:161
2202991612,2cyclictest19641-21ssh10:50:373
220299160,3cyclictest23636-21wc08:00:173
220299160,3cyclictest23636-21wc08:00:173
220099169,6cyclictest0-21swapper/108:00:141
220099169,6cyclictest0-21swapper/108:00:141
220099167,2cyclictest0-21swapper/112:15:071
220099167,2cyclictest0-21swapper/110:34:391
220099166,2cyclictest0-21swapper/111:50:571
220099164,3cyclictest27636-21aten2.4-expect11:00:121
220099164,3cyclictest27307-21sh09:51:261
220099164,3cyclictest15555-21sh09:00:161
220099163,3cyclictest240032sleep110:55:251
220099162,4cyclictest0-21swapper/107:40:001
220099161,7cyclictest27014-21munin-node1
220099161,6cyclictest0-21swapper/107:30:001
220099161,3cyclictest10712-21taskset10:08:281
220099161,3cyclictest0-21swapper/108:15:161
2200991610,5cyclictest0-21swapper/112:20:121
220099160,6cyclictest0-21swapper/112:11:461
220099160,3cyclictest2407-21munin-node1
220099160,2cyclictest0-21swapper/112:29:291
219999161,3cyclictest0-21swapper/009:41:380
219999161,3cyclictest0-21swapper/008:55:240
219999161,13cyclictest27314-21cpuspeed_turbos08:10:130
2202991512,2cyclictest0-21swapper/309:55:173
2202991511,2cyclictest13082-21ssh11:18:373
2202991510,3cyclictest30193-21ssh11:02:133
220299150,13cyclictest18680-21diskmemload10:40:073
220199150,2cyclictest0-21swapper/210:11:192
220099155,2cyclictest0-21swapper/112:05:141
220099154,2cyclictest0-21swapper/107:20:131
220099152,4cyclictest0-21swapper/107:35:001
220099151,5cyclictest0-21swapper/111:30:111
220099151,2cyclictest594-21apt-get08:25:131
220099150,7cyclictest0-21swapper/108:20:151
220099150,3cyclictest0-21swapper/107:50:141
219999151,3cyclictest28572-21ssh09:20:070
219999151,3cyclictest0-21swapper/009:45:540
2199991512,2cyclictest0-21swapper/010:40:180
219999151,12cyclictest8441-21ssh11:47:110
219999150,3cyclictest7030-21pzem_voltage09:30:220
219999150,2cyclictest0-21swapper/010:55:480
219999150,13cyclictest744-21ssh12:13:340
219999150,13cyclictest0-21swapper/007:35:250
142532150,0sleep30-21swapper/309:38:313
2202991411,2cyclictest0-21swapper/310:25:193
220299141,11cyclictest940-21ssh10:31:313
220299141,11cyclictest19886-21ssh10:17:523
2202991410,3cyclictest17709-21munin-node3
220299140,2cyclictest18680-21diskmemload11:40:133
220299140,2cyclictest18680-21diskmemload11:40:133
220299140,13cyclictest0-21swapper/312:00:263
220299140,12cyclictest18680-21diskmemload11:45:363
220299140,12cyclictest0-21swapper/312:12:043
220299140,12cyclictest0-21swapper/310:56:233
220299140,12cyclictest0-21swapper/310:20:143
220299140,12cyclictest0-21swapper/308:20:233
220199142,11cyclictest0-21swapper/209:18:512
2201991411,2cyclictest0-21swapper/212:27:292
2201991411,2cyclictest0-21swapper/210:31:492
220199140,13cyclictest0-21swapper/211:03:192
220199140,13cyclictest0-21swapper/210:25:592
220199140,13cyclictest0-21swapper/210:22:392
220199140,12cyclictest18680-21diskmemload10:02:282
220099144,3cyclictest17236-21fschecks_count07:45:151
220099143,3cyclictest13272-21grep08:55:151
219999141,12cyclictest18091-21ssh11:24:000
2199991411,2cyclictest0-21swapper/012:30:070
2199991411,2cyclictest0-21swapper/010:21:370
2199991411,2cyclictest0-21swapper/009:58:480
2199991410,2cyclictest0-21swapper/011:10:120
219999140,13cyclictest0-21swapper/012:21:270
219999140,13cyclictest0-21swapper/011:09:380
219999140,13cyclictest0-21swapper/010:19:380
219999140,13cyclictest0-21swapper/010:10:380
219999140,13cyclictest0-21swapper/009:37:080
220299138,3cyclictest5002-21ssh12:17:403
2202991310,2cyclictest0-21swapper/311:21:093
2202991310,2cyclictest0-21swapper/309:20:293
2202991310,2cyclictest0-21swapper/309:10:193
220299130,2cyclictest15049-21copy11:55:033
220299130,2cyclictest0-21swapper/312:31:013
220299130,2cyclictest0-21swapper/312:05:223
220299130,2cyclictest0-21swapper/311:35:533
220299130,2cyclictest0-21swapper/309:45:183
220299130,2cyclictest0-21swapper/309:16:163
220299130,12cyclictest0-21swapper/310:35:113
220299130,11cyclictest0-21swapper/311:10:033
220299130,11cyclictest0-21swapper/309:50:323
220299130,11cyclictest0-21swapper/308:55:163
220199131,2cyclictest27167-21ssh11:33:202
2201991310,2cyclictest1565-21ssh11:05:452
2201991310,2cyclictest0-21swapper/211:19:262
2201991310,2cyclictest0-21swapper/211:14:002
2201991310,2cyclictest0-21swapper/210:46:432
2201991310,2cyclictest0-21swapper/210:44:362
2201991310,2cyclictest0-21swapper/210:15:272
2201991310,2cyclictest0-21swapper/209:48:042
2201991310,2cyclictest0-21swapper/209:44:092
2201991310,2cyclictest0-21swapper/209:10:422
220199130,2cyclictest6332-21sh10:37:262
220199130,2cyclictest0-21swapper/212:12:542
220199130,2cyclictest0-21swapper/212:07:382
220199130,2cyclictest0-21swapper/211:58:452
220199130,2cyclictest0-21swapper/209:20:192
220199130,12cyclictest23639-21ssh10:55:172
220199130,12cyclictest0-21swapper/211:42:152
220199130,12cyclictest0-21swapper/211:42:142
220199130,12cyclictest0-21swapper/210:51:052
220199130,12cyclictest0-21swapper/209:58:562
220199130,12cyclictest0-21swapper/209:52:292
220199130,12cyclictest0-21swapper/209:31:102
220199130,12cyclictest0-21swapper/207:35:132
220199130,11cyclictest18680-21diskmemload12:21:432
220199130,11cyclictest0-21swapper/209:29:552
220099133,3cyclictest25924-21open_inodes08:05:181
2199991310,2cyclictest0-21swapper/012:16:580
2199991310,2cyclictest0-21swapper/011:18:050
2199991310,2cyclictest0-21swapper/010:32:100
2199991310,2cyclictest0-21swapper/010:25:290
2199991310,2cyclictest0-21swapper/009:28:580
2199991310,2cyclictest0-21swapper/008:50:140
219999130,2cyclictest0-21swapper/012:05:150
219999130,2cyclictest0-21swapper/011:40:140
219999130,2cyclictest0-21swapper/011:40:140
219999130,2cyclictest0-21swapper/009:51:280
219999130,1cyclictest0-21swapper/011:35:580
219999130,1cyclictest0-21swapper/011:26:380
219999130,1cyclictest0-21swapper/008:25:180
219999130,12cyclictest24749-21ssh12:38:250
219999130,12cyclictest20092-21ssh10:51:200
219999130,12cyclictest0-21swapper/010:45:130
219999130,12cyclictest0-21swapper/010:36:380
219999130,12cyclictest0-21swapper/010:00:240
136792130,2sleep30-21swapper/311:52:583
103792130,2sleep20-21swapper/210:07:562
274292120,2sleep00-21swapper/011:00:050
220299129,2cyclictest0-21swapper/310:47:093
220299129,2cyclictest0-21swapper/309:32:003
220299129,2cyclictest0-21swapper/309:25:233
220299129,2cyclictest0-21swapper/309:05:183
220299129,2cyclictest0-21swapper/308:40:313
220299122,5cyclictest0-21swapper/307:40:003
220299120,2cyclictest0-21swapper/311:30:153
220299120,2cyclictest0-21swapper/310:00:323
220299120,2cyclictest0-21swapper/308:50:223
220299120,1cyclictest0-21swapper/308:45:163
220299120,11cyclictest18680-21diskmemload11:25:533
220299120,11cyclictest0-21swapper/312:28:003
220299120,11cyclictest0-21swapper/312:23:273
220299120,11cyclictest0-21swapper/311:05:303
220299120,11cyclictest0-21swapper/310:14:243
220299120,11cyclictest0-21swapper/310:05:163
220299120,11cyclictest0-21swapper/309:00:123
220299120,11cyclictest0-21swapper/308:15:183
220299120,11cyclictest0-21swapper/307:20:203
220199129,2cyclictest18680-21diskmemload11:35:342
220199129,2cyclictest0-21swapper/212:15:502
220199129,2cyclictest0-21swapper/211:49:542
220199129,2cyclictest0-21swapper/211:21:312
220199129,2cyclictest0-21swapper/209:36:332
220199129,2cyclictest0-21swapper/208:20:122
220199120,2cyclictest0-21swapper/212:32:452
220199120,2cyclictest0-21swapper/211:52:522
220199120,11cyclictest0-21swapper/212:36:222
220199120,11cyclictest0-21swapper/212:03:472
220199120,11cyclictest0-21swapper/211:25:552
220099129,2cyclictest0-21swapper/109:05:111
219999129,2cyclictest0-21swapper/012:02:480
219999129,2cyclictest0-21swapper/011:50:240
219999129,2cyclictest0-21swapper/009:00:230
219999120,2cyclictest0-21swapper/009:15:030
219999120,2cyclictest0-21swapper/007:55:170
219999120,2cyclictest0-21swapper/007:55:170
219999120,2cyclictest0-21swapper/007:50:270
219999120,11cyclictest0-21swapper/011:57:050
219999120,11cyclictest0-21swapper/011:31:260
219999120,11cyclictest0-21swapper/010:09:240
219999120,11cyclictest0-21swapper/009:11:570
219999120,11cyclictest0-21swapper/008:15:140
219999120,11cyclictest0-21swapper/007:40:160
220299112,5cyclictest0-21swapper/307:20:003
220199118,2cyclictest0-21swapper/208:00:252
220199118,2cyclictest0-21swapper/208:00:252
219999110,3cyclictest277-21jbd2/sda1-808:35:180
219999110,1cyclictest0-21swapper/008:20:130
220299105,3cyclictest4209-21cron07:15:003
220299102,6cyclictest0-21swapper/307:50:253
219999100,9cyclictest277-21jbd2/sda1-807:15:130
219999100,9cyclictest16985-21kworker/u8:009:06:040
159852100,2sleep20-21swapper/209:00:252
22029994,3cyclictest7458-21runrttasks07:31:183
22029994,3cyclictest27296-21cpuspeed_turbos08:10:133
22019996,2cyclictest6431-21nscd08:40:312
22019996,2cyclictest29024-21apt-get08:15:122
22019996,2cyclictest0-21swapper/207:50:182
22019996,2cyclictest0-21swapper/207:45:122
21999995,3cyclictest8851-21sshd08:45:130
21999994,3cyclictest9221-21gltestperf07:25:160
21999994,3cyclictest7458-21runrttasks07:47:540
21999994,3cyclictest23358-21fschecks_time08:00:140
21999994,3cyclictest23358-21fschecks_time08:00:140
21999991,7cyclictest12474-21munin-run07:35:000
8171280,1sleep20-21swapper/207:21:462
22029984,2cyclictest0-21swapper/307:25:143
22029983,3cyclictest4624-21taskset08:35:103
22029983,3cyclictest25441-21grep08:05:143
22029983,3cyclictest14838-21basename07:40:133
22029983,3cyclictest1382-21missed_timers08:25:183
22029980,7cyclictest6574-21kworker/u8:207:55:043
22029980,7cyclictest6574-21kworker/u8:207:55:043
22019985,2cyclictest0-21swapper/208:45:222
22019985,2cyclictest0-21swapper/208:31:582
22019985,2cyclictest0-21swapper/208:11:082
22019985,2cyclictest0-21swapper/207:30:182
22019985,2cyclictest0-21swapper/207:20:002
22019984,2cyclictest15032-21grep07:40:132
22019983,3cyclictest2407-21munin-node2
22019983,3cyclictest21646-21ntp_kernel_pll_07:55:152
22019983,3cyclictest21646-21ntp_kernel_pll_07:55:152
22019983,3cyclictest13311-21fschecks_count08:55:152
22019983,3cyclictest0-21swapper/208:25:142
22019980,2cyclictest0-21swapper/208:35:262
22019980,2cyclictest0-21swapper/207:25:372
21999983,3cyclictest7458-21runrttasks08:40:160
21999983,3cyclictest3336-21wc08:30:180
21999983,3cyclictest2727-21df_abs07:10:090
21999983,3cyclictest25070-21aten2.4-expect08:05:120
21999981,3cyclictest7414-21cat07:20:170
18432280,1sleep20-21swapper/209:06:572
22019974,2cyclictest0-21swapper/208:05:112
22019973,3cyclictest11092-21grep08:50:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional