You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 19:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Tue Jul 28, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1609999270,27cyclictest9395-21diskmemload10:52:000
1609999270,27cyclictest9395-21diskmemload10:48:470
1609999270,26cyclictest9395-21diskmemload12:22:410
1609999270,26cyclictest27154-21sed09:53:280
1609999270,26cyclictest20744-21ssh11:13:510
1609999270,26cyclictest20744-21ssh11:13:510
16111992623,2cyclictest17031-21wc10:13:273
1610999260,2cyclictest16713-21ssh10:42:392
16099992623,3cyclictest9395-21diskmemload10:07:100
1609999260,3cyclictest0-21swapper/009:48:400
1609999260,25cyclictest0-21swapper/011:40:030
1609999260,25cyclictest0-21swapper/010:33:190
1609999260,25cyclictest0-21swapper/009:24:280
1609999260,25cyclictest0-21swapper/009:19:380
1609999260,24cyclictest9395-21diskmemload12:10:410
1609999260,0cyclictest0-21swapper/012:29:010
1611199250,24cyclictest9395-21diskmemload10:03:563
1611199250,24cyclictest19991-21ssh11:42:433
1611199250,24cyclictest14132-21apt-get09:43:183
16104992523,1cyclictest606-21dbus-daemon09:15:001
1610499250,24cyclictest9395-21diskmemload12:37:201
1610499250,24cyclictest0-21swapper/110:51:201
16099992523,1cyclictest0-21swapper/010:10:100
16099992521,3cyclictest9395-21diskmemload11:28:500
1609999250,4cyclictest7341-21sh09:36:460
1609999250,4cyclictest0-21swapper/011:24:240
1609999250,25cyclictest9395-21diskmemload12:18:060
1609999250,24cyclictest9395-21diskmemload11:05:480
1609999250,24cyclictest9395-21diskmemload10:56:570
1609999250,24cyclictest17099-21ssh10:43:180
1609999250,24cyclictest13906-21ssh09:42:560
1609999250,24cyclictest0-21swapper/012:30:450
1609999250,24cyclictest0-21swapper/011:39:510
1609999250,24cyclictest0-21swapper/011:33:420
1609999250,24cyclictest0-21swapper/011:15:100
1609999250,24cyclictest0-21swapper/008:58:190
1611199240,23cyclictest9395-21diskmemload10:35:373
16109992423,1cyclictest9395-21diskmemload09:19:582
16109992422,1cyclictest9409-21idleruntime-cro09:10:012
16109992422,1cyclictest0-21swapper/211:33:082
1610999240,23cyclictest9395-21diskmemload09:39:202
1610999240,23cyclictest0-21swapper/209:50:262
1610999240,0cyclictest0-21swapper/211:45:422
16104992422,1cyclictest0-21swapper/111:13:441
16104992422,1cyclictest0-21swapper/111:13:441
16104992421,2cyclictest13697-21cron12:05:011
1610499241,22cyclictest9395-21diskmemload10:28:261
1610499240,24cyclictest9395-21diskmemload09:41:561
1610499240,24cyclictest0-21swapper/109:31:481
1610499240,23cyclictest15475-21ssh12:07:111
1610499240,0cyclictest0-21swapper/110:41:411
16099992423,1cyclictest0-21swapper/010:28:130
1609999240,3cyclictest9395-21diskmemload11:55:100
1609999240,24cyclictest9395-21diskmemload11:46:160
1609999240,23cyclictest20261-21ssh12:39:120
1609999240,23cyclictest0-21swapper/010:38:060
1609999240,23cyclictest0-21swapper/010:15:180
1609999240,23cyclictest0-21swapper/009:56:470
1609999240,0cyclictest9395-21diskmemload10:20:210
1609999240,0cyclictest0-21swapper/012:03:020
1609999240,0cyclictest0-21swapper/007:18:180
16111992323,0cyclictest9395-21diskmemload11:09:103
16111992323,0cyclictest15730-21ssh09:15:253
16111992323,0cyclictest0-21swapper/312:26:453
16111992323,0cyclictest0-21swapper/311:36:133
16111992323,0cyclictest0-21swapper/310:25:483
16111992322,1cyclictest9395-21diskmemload12:11:423
16111992322,1cyclictest20592-21ssh10:17:193
16111992321,1cyclictest0-21swapper/312:37:103
16111992320,2cyclictest5947-21ssh11:01:253
1611199230,2cyclictest8496-21ssh12:00:173
1611199230,23cyclictest0-21swapper/312:32:193
1611199230,23cyclictest0-21swapper/312:15:503
1611199230,23cyclictest0-21swapper/311:50:353
1611199230,23cyclictest0-21swapper/311:34:453
1611199230,23cyclictest0-21swapper/309:51:563
1611199230,23cyclictest0-21swapper/309:25:393
1611199230,22cyclictest9831-21ssh09:10:153
1611199230,22cyclictest9395-21diskmemload11:11:273
1611199230,22cyclictest9395-21diskmemload11:11:273
1611199230,22cyclictest7727-21sh10:05:193
1611199230,22cyclictest1805-21ssh09:32:243
1611199230,22cyclictest17425-21perf08:20:013
1611199230,22cyclictest0-21swapper/309:55:133
1611199230,0cyclictest0-21swapper/312:24:213
1611199230,0cyclictest0-21swapper/310:56:513
1611199230,0cyclictest0-21swapper/310:31:013
1611199230,0cyclictest0-21swapper/309:46:343
16109992323,0cyclictest9395-21diskmemload11:51:522
16109992323,0cyclictest0-21swapper/212:16:112
16109992323,0cyclictest0-21swapper/212:01:522
16109992323,0cyclictest0-21swapper/211:11:412
16109992323,0cyclictest0-21swapper/211:11:412
16109992323,0cyclictest0-21swapper/211:09:182
16109992323,0cyclictest0-21swapper/210:38:472
16109992322,1cyclictest1060-21apt-get07:48:172
16109992321,1cyclictest30589-21ssh10:25:382
16109992320,3cyclictest0-21swapper/212:05:142
16109992320,2cyclictest32460-21/usr/sbin/munin09:58:242
16109992320,2cyclictest27293-21idleruntime-cro11:20:012
16109992320,2cyclictest21463-21memory11:43:242
16109992320,2cyclictest13745-21sh10:10:402
16109992320,0cyclictest0-21swapper/209:42:062
1610999230,23cyclictest9395-21diskmemload12:12:432
1610999230,23cyclictest29244-21ssh10:24:072
1610999230,23cyclictest0-21swapper/212:31:292
1610999230,23cyclictest0-21swapper/212:27:332
1610999230,23cyclictest0-21swapper/209:45:122
1610999230,22cyclictest9885-21ssh09:10:192
1610999230,22cyclictest9395-21diskmemload11:38:162
1610999230,22cyclictest3669-21ssh10:30:232
1610999230,22cyclictest2104-21ssh10:00:122
1610999230,22cyclictest15723-21sh12:35:262
1610999230,0cyclictest9395-21diskmemload10:17:342
1610999230,0cyclictest0-21swapper/212:21:022
16104992323,0cyclictest9395-21diskmemload10:03:021
16104992323,0cyclictest27651-21ssh12:18:191
16104992323,0cyclictest0-21swapper/112:33:171
16104992323,0cyclictest0-21swapper/111:32:481
16104992323,0cyclictest0-21swapper/109:26:451
16104992323,0cyclictest0-21swapper/109:16:191
16104992322,0cyclictest10969-21ssh11:05:411
16104992321,1cyclictest16565-21apt-get07:13:171
16104992321,1cyclictest0-21swapper/111:18:571
16104992320,2cyclictest28546-21cat09:55:011
1610499230,2cyclictest18334-21ssh10:14:421
1610499230,23cyclictest0-21swapper/112:26:211
1610499230,23cyclictest0-21swapper/112:10:491
1610499230,23cyclictest0-21swapper/111:28:481
1610499230,23cyclictest0-21swapper/109:57:031
1610499230,22cyclictest9395-21diskmemload11:36:431
1610499230,22cyclictest606-21dbus-daemon11:50:001
1610499230,22cyclictest3508-21sh10:30:111
1610499230,22cyclictest32239-21ssh10:55:441
1610499230,22cyclictest31582-21rm12:21:041
1610499230,22cyclictest24320-21perf10:20:001
1610499230,22cyclictest0-21swapper/110:24:291
1610499230,0cyclictest0-21swapper/111:50:101
1610499230,0cyclictest0-21swapper/110:47:001
1610499230,0cyclictest0-21swapper/109:21:151
16099992323,0cyclictest0-21swapper/011:50:290
16099992322,1cyclictest9395-21diskmemload11:00:170
1609999230,3cyclictest0-21swapper/010:01:100
1609999230,2cyclictest7778-21perf08:00:000
1609999230,22cyclictest1422-21grep08:53:240
1609999230,22cyclictest0-21swapper/012:05:570
1609999230,21cyclictest0-21swapper/009:10:060
16111992222,0cyclictest0-21swapper/311:16:283
16111992222,0cyclictest0-21swapper/310:40:323
16111992220,1cyclictest30570-21apt07:40:003
16111992220,1cyclictest22227-21munin-plugin-st08:30:003
16111992219,2cyclictest6244-21sed11:30:013
1611199220,2cyclictest509-21idleruntime-cro07:45:003
1611199220,22cyclictest0-21swapper/309:37:413
1611199220,22cyclictest0-21swapper/309:20:283
1611199220,21cyclictest13122-21apt-get08:13:183
1611199220,21cyclictest0-21swapper/312:08:303
1611199220,21cyclictest0-21swapper/311:20:093
1611199220,1cyclictest9395-21diskmemload11:46:083
1611199220,1cyclictest7303-21sh11:59:093
1611199220,1cyclictest12571-21awk08:10:013
1611199220,1cyclictest0-21swapper/310:20:063
16109992222,0cyclictest0-21swapper/211:56:432
16109992220,1cyclictest9395-21diskmemload11:25:552
16109992219,0cyclictest0-21swapper/209:20:202
1610999220,22cyclictest9395-21diskmemload11:20:422
1610999220,21cyclictest5541-21ssh11:00:552
1610999220,21cyclictest31881-21ssh10:55:182
1610999220,21cyclictest27637-21ssh09:26:082
1610999220,21cyclictest2720-21apt-get08:58:192
1610999220,21cyclictest26403-21ssh10:50:312
1610999220,21cyclictest0-21swapper/209:30:252
1610999220,21cyclictest0-21swapper/208:48:192
1610999220,1cyclictest7992-21rm10:05:392
16104992222,0cyclictest0-21swapper/110:37:361
1610499220,21cyclictest28566-21sh11:21:291
1610499220,21cyclictest0-21swapper/110:05:281
1610499220,21cyclictest0-21swapper/109:35:041
1610499220,21cyclictest0-21swapper/108:58:191
1610499220,21cyclictest0-21swapper/107:48:171
1610499220,0cyclictest0-21swapper/111:00:011
16099992218,4cyclictest0-21swapper/007:38:190
16099992215,6cyclictest231342sleep008:33:180
1609999220,21cyclictest22211-21perf08:30:000
1609999220,21cyclictest0-21swapper/008:43:220
16111992121,0cyclictest0-21swapper/307:33:183
16111992120,1cyclictest0-21swapper/308:58:193
1611199210,20cyclictest0-21swapper/307:28:183
16109992121,0cyclictest26171-21apt-get07:33:182
1610999210,21cyclictest0-21swapper/208:13:192
1610999210,20cyclictest23130-21apt-get08:33:182
1610999210,20cyclictest0-21swapper/207:23:182
1610999210,0cyclictest0-21swapper/208:28:192
16104992120,1cyclictest25526-21apt-get08:38:181
16104992120,0cyclictest17939-21apt-get08:23:171
16104992120,0cyclictest15520-21apt-get08:18:201
16104992119,1cyclictest8280-21apt-get08:03:181
16104992119,1cyclictest7779-21munin-run08:00:001
1610499210,21cyclictest0-21swapper/108:33:191
1610499210,20cyclictest0-21swapper/109:08:211
1610499210,20cyclictest0-21swapper/108:53:181
1610499210,0cyclictest0-21swapper/111:40:021
16099992120,0cyclictest0-21swapper/008:08:180
1609999210,1cyclictest0-21swapper/009:25:090
1609999210,0cyclictest0-21swapper/007:53:190
16111992020,0cyclictest0-21swapper/307:18:183
16111992019,0cyclictest3470-21apt-get07:53:193
1611199200,0cyclictest0-21swapper/308:38:183
1611199200,0cyclictest0-21swapper/307:48:173
16109992020,0cyclictest7030-21perf09:05:012
16109992020,0cyclictest0-21swapper/208:38:182
16109992018,1cyclictest23773-21apt-get07:28:192
16104992020,0cyclictest0-21swapper/108:08:181
16104992019,0cyclictest0-21swapper/107:33:181
16104992017,2cyclictest20877-21sendmail-msp07:20:011
1609999200,19cyclictest30341-21apt-get08:48:190
1609999200,12cyclictest0-21swapper/007:43:180
16111991919,0cyclictest0-21swapper/308:48:193
1611199190,0cyclictest0-21swapper/308:33:183
16109991919,0cyclictest32737-21apt-get08:53:182
16109991919,0cyclictest0-21swapper/207:13:182
16109991916,2cyclictest29818-21sh08:45:002
16104991919,0cyclictest0-21swapper/108:43:201
1609999194,14cyclictest6550-21sed09:03:290
1609999190,19cyclictest0-21swapper/009:08:260
1609999190,18cyclictest21379-21apt-get07:23:180
16111991818,0cyclictest0-21swapper/309:03:203
16111991818,0cyclictest0-21swapper/308:53:183
16109991818,0cyclictest0-21swapper/207:43:182
16109991818,0cyclictest0-21swapper/207:38:192
16104991818,0cyclictest0-21swapper/108:13:181
16099991818,0cyclictest0-21swapper/008:13:180
1609999180,17cyclictest0-21swapper/008:03:270
1609999180,17cyclictest0-21swapper/007:48:170
16111991717,0cyclictest0-21swapper/308:03:183
16111991717,0cyclictest0-21swapper/307:58:193
16111991717,0cyclictest0-21swapper/307:13:173
16104991717,0cyclictest0-21swapper/107:28:181
16104991715,1cyclictest20337-21apt-get08:28:181
1609999171,15cyclictest16906-21sensors08:18:290
16111991616,0cyclictest0-21swapper/307:23:183
16111991615,0cyclictest0-21swapper/308:23:173
16109991616,0cyclictest0-21swapper/208:08:182
16109991615,1cyclictest0-21swapper/208:03:182
16109991615,0cyclictest0-21swapper/208:00:002
1610999160,15cyclictest0-21swapper/208:18:302
16104991616,0cyclictest0-21swapper/107:23:181
16099991616,0cyclictest0-21swapper/007:28:190
16099991614,1cyclictest25714-21tr08:38:190
16111991513,1cyclictest313-21systemd-journal09:10:013
16104991515,0cyclictest0-21swapper/107:43:181
1611199140,0cyclictest0-21swapper/308:40:153
16109991414,0cyclictest0-21swapper/208:20:212
1610999140,14cyclictest0-21swapper/207:50:122
1610999140,14cyclictest0-21swapper/207:15:232
16104991414,0cyclictest0-21swapper/107:35:031
1610499140,14cyclictest0-21swapper/109:01:351
1610499140,0cyclictest0-21swapper/107:50:281
16099991414,0cyclictest0-21swapper/007:30:470
1609999140,14cyclictest0-21swapper/007:11:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional