You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 18:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Jul 06, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3229399270,26cyclictest0-21swapper/309:42:583
32293992623,3cyclictest0-21swapper/310:07:283
32293992623,3cyclictest0-21swapper/309:11:363
3229399260,22cyclictest26032-21diskmemload12:31:453
3229399260,0cyclictest0-21swapper/309:51:473
3228999260,25cyclictest9879-21ssh09:52:172
3228299260,24cyclictest26032-21diskmemload12:24:210
3229399252,1cyclictest2992-21sh12:39:183
3229399250,25cyclictest0-21swapper/310:27:363
3229399250,25cyclictest0-21swapper/309:28:413
3229399250,24cyclictest26032-21diskmemload12:21:363
3229399250,24cyclictest0-21swapper/311:01:203
3229399250,24cyclictest0-21swapper/310:32:443
3229399250,24cyclictest0-21swapper/309:33:193
3229399250,24cyclictest0-21swapper/309:24:283
3229399250,21cyclictest0-21swapper/310:10:523
3229399250,0cyclictest0-21swapper/310:21:193
3228999250,24cyclictest0-21swapper/211:06:502
32285992524,1cyclictest21376-21ssh11:00:321
32285992522,2cyclictest27558-21cron11:35:001
3228599250,24cyclictest26032-21diskmemload10:21:581
32293992424,0cyclictest0-21swapper/310:01:003
32293992420,4cyclictest0-21swapper/307:51:303
32293992420,3cyclictest6407-21ssh11:16:223
32293992420,3cyclictest27038-21ssh11:05:343
32293992420,3cyclictest0-21swapper/312:01:013
3229399240,23cyclictest0-21swapper/311:46:033
3229399240,23cyclictest0-21swapper/311:20:093
3229399240,21cyclictest0-21swapper/312:11:543
3229399240,0cyclictest26032-21diskmemload10:45:573
3229399240,0cyclictest0-21swapper/311:32:133
3229399240,0cyclictest0-21swapper/310:40:053
3229399240,0cyclictest0-21swapper/309:35:063
3228999240,23cyclictest21280-21lockfile-remove09:00:002
3228999240,1cyclictest26032-21diskmemload10:29:272
32285992424,0cyclictest0-21swapper/111:12:101
3228599240,24cyclictest0-21swapper/112:12:371
3228599240,24cyclictest0-21swapper/111:36:141
3228599240,24cyclictest0-21swapper/111:23:521
3228599240,24cyclictest0-21swapper/110:05:211
3228599240,24cyclictest0-21swapper/110:00:451
3228599240,23cyclictest4293-21ssh10:16:331
3228599240,23cyclictest31041-21rm12:35:351
3228599240,23cyclictest16676-21rm09:59:001
3228599240,23cyclictest16202-21ssh11:53:041
3228599240,23cyclictest0-21swapper/110:48:281
3228599240,23cyclictest0-21swapper/109:28:501
3228599240,0cyclictest0-21swapper/109:39:301
3228599240,0cyclictest0-21swapper/109:10:371
32282992423,1cyclictest26032-21diskmemload11:00:120
32282992423,1cyclictest0-21swapper/012:27:450
32282992423,1cyclictest0-21swapper/010:07:130
32282992422,1cyclictest62550irq/127-eno112:16:330
3228299240,2cyclictest19192-21diskmemload10:30:260
3228299240,24cyclictest26032-21diskmemload10:54:180
3228299240,23cyclictest31638-21runrttasks12:36:290
3228299240,23cyclictest26032-21diskmemload10:45:150
3228299240,0cyclictest0-21swapper/009:51:010
32293992321,2cyclictest0-21swapper/312:15:013
32293992320,3cyclictest0-21swapper/310:36:223
32293992318,4cyclictest17228-21ssh11:25:493
3229399230,23cyclictest0-21swapper/312:07:393
3229399230,23cyclictest0-21swapper/311:59:393
3229399230,22cyclictest4690-21rm11:42:333
3229399230,22cyclictest0-21swapper/310:18:083
3229399230,0cyclictest26032-21diskmemload12:25:363
3229399230,0cyclictest0-21swapper/310:57:473
3229399230,0cyclictest0-21swapper/309:55:093
32289992323,0cyclictest26032-21diskmemload11:23:232
32289992323,0cyclictest0-21swapper/211:57:572
32289992323,0cyclictest0-21swapper/209:37:022
32289992321,2cyclictest30922-21ssh12:35:262
32289992321,1cyclictest8978-21/usr/sbin/munin11:46:362
32289992321,1cyclictest0-21swapper/211:13:112
32289992320,2cyclictest26032-21diskmemload11:41:482
3228999230,2cyclictest31523-21ssh09:42:582
3228999230,23cyclictest26032-21diskmemload10:48:352
3228999230,23cyclictest0-21swapper/211:32:502
3228999230,23cyclictest0-21swapper/210:57:172
3228999230,23cyclictest0-21swapper/210:51:182
3228999230,23cyclictest0-21swapper/209:49:292
3228999230,23cyclictest0-21swapper/209:19:112
3228999230,22cyclictest9276-21sh12:16:292
3228999230,22cyclictest29357-21diskstats11:36:292
3228999230,22cyclictest26032-21diskmemload12:05:002
3228999230,22cyclictest26032-21diskmemload10:40:412
3228999230,22cyclictest24387-21apt-get10:06:292
3228999230,22cyclictest22088-21rm10:03:432
3228999230,22cyclictest17748-21sh12:22:582
3228999230,22cyclictest17594-21ssh11:26:272
3228999230,22cyclictest14336-21/usr/sbin/munin09:56:372
3228999230,22cyclictest13018-21ssh11:50:572
3228999230,0cyclictest9222-21apt-get08:36:302
3228999230,0cyclictest0-21swapper/211:19:212
32285992323,0cyclictest26032-21diskmemload11:55:171
32285992323,0cyclictest0-21swapper/112:17:101
32285992323,0cyclictest0-21swapper/111:28:411
32285992323,0cyclictest0-21swapper/111:15:501
32285992322,1cyclictest211rcuc/112:31:341
32285992321,1cyclictest6229-21/usr/sbin/munin09:21:391
32285992321,1cyclictest4355-21ssh09:47:241
32285992321,1cyclictest0-21swapper/112:21:311
32285992320,2cyclictest7118-21ssh11:45:381
3228599230,2cyclictest13473-21sh10:25:101
3228599230,23cyclictest26032-21diskmemload12:28:451
3228599230,23cyclictest26032-21diskmemload10:50:501
3228599230,22cyclictest31209-21diskmemload09:42:351
3228599230,22cyclictest30761-21ssh10:40:501
3228599230,22cyclictest28884-21ssh10:10:031
3228599230,22cyclictest2741-21ssh09:17:071
3228599230,22cyclictest2347-21turbostat.cron12:10:001
3228599230,22cyclictest18598-21sh10:57:071
3228599230,22cyclictest0-21swapper/111:40:531
32282992323,0cyclictest26032-21diskmemload10:26:310
32282992323,0cyclictest0-21swapper/012:05:410
32282992322,1cyclictest26032-21diskmemload10:21:120
32282992321,1cyclictest18809-21apt-get10:01:290
32282992321,1cyclictest0-21swapper/011:32:520
32282992321,1cyclictest0-21swapper/010:15:590
32282992321,1cyclictest0-21swapper/009:45:430
32282992321,1cyclictest0-21swapper/009:27:030
32282992321,1cyclictest0-21swapper/009:15:260
32282992321,1cyclictest0-21swapper/008:05:000
3228299231,21cyclictest17677-21apt-get11:26:310
3228299230,2cyclictest22297-21ssh09:35:230
3228299230,23cyclictest26032-21diskmemload09:12:000
3228299230,23cyclictest0-21swapper/011:46:030
3228299230,23cyclictest0-21swapper/010:42:270
3228299230,23cyclictest0-21swapper/009:55:090
3228299230,22cyclictest32462-21ssh11:10:320
3228299230,22cyclictest26032-21diskmemload11:15:530
3228299230,22cyclictest0-21swapper/012:32:190
3228299230,22cyclictest0-21swapper/010:55:010
3228299230,0cyclictest26032-21diskmemload12:13:260
32293992222,0cyclictest26032-21diskmemload11:36:363
32293992221,1cyclictest0-21swapper/311:11:373
32293992221,0cyclictest0-21swapper/309:16:253
32293992220,2cyclictest0-21swapper/311:50:373
32293992220,1cyclictest5072-21apt-get07:21:283
32293992220,1cyclictest0-21swapper/307:20:003
3229399220,22cyclictest891-21rm09:45:133
3229399220,21cyclictest7467-21apt-get07:26:293
32289992221,1cyclictest24607-21ssh11:02:322
32289992220,2cyclictest0-21swapper/209:10:022
32289992219,3cyclictest0-21swapper/210:30:072
32289992219,2cyclictest7958-21ssh10:20:142
3228999221,0cyclictest0-21swapper/210:15:212
3228999220,22cyclictest0-21swapper/212:12:032
3228999220,22cyclictest0-21swapper/210:14:232
3228999220,21cyclictest19531-21ssh12:25:102
3228999220,21cyclictest0-21swapper/209:30:492
3228999220,21cyclictest0-21swapper/207:56:312
3228999220,1cyclictest5911-21ssh09:20:562
3228999220,1cyclictest13667-21perf08:45:012
3228999220,0cyclictest0-21swapper/212:30:142
3228999220,0cyclictest0-21swapper/209:28:492
32285992222,0cyclictest0-21swapper/111:05:281
32285992222,0cyclictest0-21swapper/110:30:111
32285992220,1cyclictest18862-21munin-run08:55:001
3228599220,21cyclictest21269-21perf09:00:001
3228599220,21cyclictest0-21swapper/107:26:291
3228599220,1cyclictest6636-21ssh09:50:151
3228599220,1cyclictest26055-21apt09:10:001
3228599220,1cyclictest23917-21ssh12:00:441
3228599220,1cyclictest20748-21rm09:33:331
32282992222,0cyclictest26032-21diskmemload09:20:320
32282992222,0cyclictest0-21swapper/010:11:590
32282992221,1cyclictest0-21swapper/011:35:290
32282992220,1cyclictest27175-21apt-get08:06:290
32282992220,1cyclictest0-21swapper/008:50:000
32282992219,2cyclictest4070-21munin-plugin-st08:25:000
32282992218,3cyclictest9863-21apt-get07:31:280
3228299220,22cyclictest0-21swapper/011:52:120
3228299220,22cyclictest0-21swapper/011:05:120
3228299220,21cyclictest22368-21apt-get07:56:310
3228299220,21cyclictest21951-21/usr/sbin/munin09:35:010
3228299220,21cyclictest14384-21latency_hist07:40:010
3228299220,21cyclictest0-21swapper/012:00:380
3228299220,21cyclictest0-21swapper/008:56:300
3228299220,21cyclictest0-21swapper/008:51:300
3228299220,1cyclictest0-21swapper/011:56:080
3228299220,1cyclictest0-21swapper/011:41:230
3228299220,1cyclictest0-21swapper/011:22:240
32293992118,2cyclictest2218-21ls07:15:003
32293992117,4cyclictest0-21swapper/307:36:303
3229399210,0cyclictest0-21swapper/308:31:293
3228999210,20cyclictest0-21swapper/207:50:022
3228999210,20cyclictest0-21swapper/207:11:332
3228999210,1cyclictest0-21swapper/212:05:382
32285992121,0cyclictest0-21swapper/107:41:281
32285992120,1cyclictest16433-21sh08:50:001
32285992119,1cyclictest0-21swapper/108:05:001
32285992118,2cyclictest11246-21latency_hist08:40:011
3228599210,21cyclictest0-21swapper/110:35:031
3228599210,0cyclictest29568-21apt-get08:11:291
3228599210,0cyclictest12258-21apt-get07:36:301
32282992119,1cyclictest31589-21latency_hist08:15:000
3228299210,20cyclictest0-21swapper/008:36:300
3228299210,0cyclictest0-21swapper/008:26:300
3229399200,20cyclictest0-21swapper/308:46:303
32289992020,0cyclictest0-21swapper/207:31:282
32289992020,0cyclictest0-21swapper/207:26:292
32289992019,1cyclictest29171-21cron08:10:002
32289992017,2cyclictest16786-21awk07:45:012
3228999200,0cyclictest17172-21apt-get07:46:302
3228999200,0cyclictest0-21swapper/207:21:282
32285992020,0cyclictest0-21swapper/108:41:301
32285992020,0cyclictest0-21swapper/107:31:281
3228599200,0cyclictest0-21swapper/107:50:021
3228299200,0cyclictest0-21swapper/009:01:290
32293991919,0cyclictest0-21swapper/308:26:303
32293991919,0cyclictest0-21swapper/308:06:303
32285991919,0cyclictest0-21swapper/109:01:291
32285991919,0cyclictest0-21swapper/107:16:311
32285991917,1cyclictest8853-21latency_hist08:35:011
32285991818,0cyclictest0-21swapper/108:06:291
32282991818,0cyclictest0-21swapper/009:06:290
32282991818,0cyclictest0-21swapper/007:46:300
32282991816,1cyclictest8869-21perf08:35:010
32293991717,0cyclictest0-21swapper/308:36:303
32293991712,4cyclictest0-21swapper/308:51:303
32289991717,0cyclictest21632-21apt-get09:01:292
32289991716,0cyclictest0-21swapper/208:31:292
3228599170,6cyclictest0-21swapper/108:21:301
32282991716,0cyclictest2599-21apt-get07:16:310
32282991715,1cyclictest19198-21apt-get07:50:020
32293991614,1cyclictest606-21dbus-daemon09:05:003
32293991614,1cyclictest0-21swapper/307:56:333
32293991614,1cyclictest0-21swapper/307:50:013
32293991611,4cyclictest31964-21apt-get08:16:313
3229399160,16cyclictest0-21swapper/308:22:023
3229399160,15cyclictest0-21swapper/309:06:303
3229399160,0cyclictest0-21swapper/307:40:333
32289991614,1cyclictest14426-21apt-get08:46:302
3228999160,15cyclictest14418-21perf07:40:012
32285991616,0cyclictest0-21swapper/107:21:281
32285991613,2cyclictest2222-21perf07:15:001
32282991615,1cyclictest0-21swapper/007:26:290
32282991614,1cyclictest13676-21munin-run08:45:010
3228299160,1cyclictest2227-21latency_hist07:15:000
32293991514,1cyclictest0-21swapper/308:40:393
3229399150,1cyclictest11897-21perf07:35:003
3228999158,6cyclictest611-21irqbalance08:29:352
32289991515,0cyclictest18849-21perf08:55:002
32289991515,0cyclictest0-21swapper/209:06:302
32289991515,0cyclictest0-21swapper/208:21:302
32282991515,0cyclictest0-21swapper/007:41:290
32293991413,1cyclictest0-21swapper/308:12:463
3229399140,14cyclictest0-21swapper/308:55:213
3229399140,0cyclictest0-21swapper/308:00:113
32289991414,0cyclictest0-21swapper/208:15:072
3228999140,14cyclictest0-21swapper/208:10:442
3228999140,0cyclictest0-21swapper/208:01:112
32285991414,0cyclictest0-21swapper/107:45:561
3228599140,0cyclictest0-21swapper/107:55:271
32282991414,0cyclictest0-21swapper/007:20:170
3228299140,14cyclictest0-21swapper/008:15:450
32289991313,0cyclictest0-21swapper/207:15:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional