You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 18:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Jul 07, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2617599260,25cyclictest23774-21runrttasks10:10:163
2617399260,25cyclictest17519-21cron09:05:012
2617599250,24cyclictest19908-21diskmemload12:11:243
2617599250,1cyclictest0-21swapper/312:33:513
2617399250,24cyclictest19908-21diskmemload11:48:032
2617399250,24cyclictest0-21swapper/212:01:492
2617399250,1cyclictest0-21swapper/211:40:012
2616999250,1cyclictest0-21swapper/109:28:161
2616599250,1cyclictest19908-21diskmemload09:31:270
26175992422,1cyclictest26192-21sh10:40:583
2617599240,2cyclictest14298-21ssh12:24:143
2617599240,23cyclictest4291-21ssh10:49:413
2617599240,23cyclictest32163-21ssh09:20:513
2617599240,23cyclictest19908-21diskmemload11:05:373
26173992423,1cyclictest0-21swapper/211:22:502
26173992423,0cyclictest0-21swapper/212:23:022
26173992422,1cyclictest0-21swapper/212:32:572
2617399240,23cyclictest21592-21ssh11:33:182
2617399240,23cyclictest19908-21diskmemload09:41:002
2617399240,23cyclictest19908-21diskmemload09:22:592
2617399240,23cyclictest0-21swapper/211:57:142
2617399240,0cyclictest0-21swapper/212:36:512
2617399240,0cyclictest0-21swapper/209:49:322
2616999243,20cyclictest19908-21diskmemload09:51:491
26169992422,1cyclictest0-21swapper/112:10:141
2616999240,24cyclictest0-21swapper/110:30:331
2616999240,23cyclictest0-21swapper/111:29:071
2616999240,1cyclictest0-21swapper/110:36:411
2616999240,0cyclictest19908-21diskmemload11:34:511
2616999240,0cyclictest0-21swapper/111:51:511
2616999240,0cyclictest0-21swapper/110:08:411
2616599240,24cyclictest19908-21diskmemload10:30:330
2616599240,24cyclictest0-21swapper/011:32:110
2616599240,24cyclictest0-21swapper/009:11:100
2616599240,23cyclictest8179-21sh11:50:070
2616599240,23cyclictest21975-21ssh11:05:270
2616599240,23cyclictest19908-21diskmemload11:01:180
2616599240,23cyclictest12635-21ssh12:22:000
2616599240,1cyclictest20156-21ssh10:35:250
26175992323,0cyclictest19908-21diskmemload09:38:243
26175992323,0cyclictest0-21swapper/311:58:483
26175992323,0cyclictest0-21swapper/310:22:493
26175992323,0cyclictest0-21swapper/310:06:193
26175992323,0cyclictest0-21swapper/309:56:203
26175992323,0cyclictest0-21swapper/309:43:583
26175992322,1cyclictest0-21swapper/311:27:443
26175992321,1cyclictest19908-21diskmemload10:36:283
26175992321,1cyclictest0-21swapper/310:31:363
26175992320,2cyclictest13770-21cstates10:01:373
2617599230,23cyclictest19908-21diskmemload11:42:153
2617599230,23cyclictest0-21swapper/310:28:343
2617599230,22cyclictest5576-21sh10:51:063
2617599230,22cyclictest28894-21ssh12:08:043
2617599230,22cyclictest27745-21sh11:38:513
2617599230,22cyclictest19908-21diskmemload11:15:533
2617599230,22cyclictest0-21swapper/311:46:313
2617599230,1cyclictest0-21swapper/311:20:483
2617599230,0cyclictest19908-21diskmemload11:34:083
2617599230,0cyclictest0-21swapper/312:00:013
26173992323,0cyclictest0-21swapper/211:28:312
26173992323,0cyclictest0-21swapper/211:18:112
26173992321,1cyclictest0-21swapper/210:50:022
26173992321,1cyclictest0-21swapper/210:41:422
26173992321,1cyclictest0-21swapper/210:10:022
26173992321,1cyclictest0-21swapper/209:51:202
26173992321,1cyclictest0-21swapper/209:39:402
26173992321,1cyclictest0-21swapper/209:12:472
2617399230,23cyclictest0-21swapper/212:08:542
2617399230,23cyclictest0-21swapper/211:10:182
2617399230,23cyclictest0-21swapper/210:05:322
2617399230,22cyclictest7937-21dump-pmu-power08:45:002
2617399230,22cyclictest19908-21diskmemload11:42:572
2617399230,22cyclictest19908-21diskmemload11:07:112
2617399230,22cyclictest0-21swapper/211:52:022
2617399230,1cyclictest19652-21ssh12:28:522
2617399230,0cyclictest0-21swapper/212:10:532
2617399230,0cyclictest0-21swapper/211:02:192
26169992323,0cyclictest0-21swapper/111:13:191
26169992321,1cyclictest606-21dbus-daemon09:00:001
26169992321,1cyclictest0-21swapper/112:16:091
26169992321,1cyclictest0-21swapper/111:45:001
26169992321,1cyclictest0-21swapper/110:01:161
26169992321,1cyclictest0-21swapper/109:40:221
26169992320,2cyclictest17540-21wc09:05:011
2616999230,2cyclictest31622-21sh09:20:111
2616999230,2cyclictest28887-21sh09:46:241
2616999230,23cyclictest0-21swapper/112:33:591
2616999230,23cyclictest0-21swapper/112:22:001
2616999230,22cyclictest3401-21ssh10:21:131
2616999230,22cyclictest32191-21sh11:42:131
2616999230,22cyclictest28780-21rm12:07:561
2616999230,22cyclictest27000-21/usr/sbin/munin09:16:401
2616999230,22cyclictest2289-21dump-pmu-power10:20:001
2616999230,22cyclictest22437-21sh11:06:091
2616999230,22cyclictest17920-21ssh11:58:301
2616999230,0cyclictest19908-21diskmemload11:35:101
2616999230,0cyclictest0-21swapper/111:01:181
2616999230,0cyclictest0-21swapper/110:58:321
2616999230,0cyclictest0-21swapper/110:45:151
2616999230,0cyclictest0-21swapper/110:28:271
2616999230,0cyclictest0-21swapper/110:13:571
26165992323,0cyclictest19908-21diskmemload12:19:490
26165992323,0cyclictest19908-21diskmemload09:20:220
26165992323,0cyclictest0-21swapper/011:47:130
26165992323,0cyclictest0-21swapper/011:35:100
26165992323,0cyclictest0-21swapper/010:07:300
26165992323,0cyclictest0-21swapper/009:17:370
26165992321,1cyclictest0-21swapper/010:16:370
2616599230,23cyclictest25399-21ssh12:33:590
2616599230,23cyclictest19908-21diskmemload10:45:150
2616599230,23cyclictest19908-21diskmemload09:55:500
2616599230,23cyclictest0-21swapper/009:42:530
2616599230,22cyclictest738-21ssh11:15:160
2616599230,22cyclictest4888-21sh09:25:120
2616599230,22cyclictest20944-21ssh09:38:360
2616599230,22cyclictest17662-21ssh10:04:510
2616599230,22cyclictest10781-21runrttasks10:55:290
2616599230,22cyclictest0-21swapper/012:38:160
2616599230,22cyclictest0-21swapper/011:11:360
2616599230,1cyclictest0-21swapper/010:21:570
2616599230,0cyclictest19908-21diskmemload10:13:570
2616599230,0cyclictest0-21swapper/011:29:070
26175992222,0cyclictest19908-21diskmemload09:31:183
26175992222,0cyclictest0-21swapper/309:10:233
26175992221,1cyclictest27994-21ssh09:45:173
26175992221,1cyclictest0-21swapper/311:10:033
26175992220,1cyclictest1298-21ssh09:50:273
26175992220,1cyclictest10682-21apt07:45:013
26175992220,1cyclictest0-21swapper/311:00:043
26175992219,2cyclictest26780-21ssh12:35:333
2617599220,2cyclictest26764-21sh09:16:173
2617599220,21cyclictest8978-21sh11:51:153
2617599220,21cyclictest4183-21rm12:15:403
2617599220,21cyclictest26508-21apt-get07:11:353
2617599220,21cyclictest19908-21diskmemload12:25:213
2617599220,21cyclictest19908-21diskmemload09:25:183
2617599220,21cyclictest0-21swapper/308:41:363
2617599220,21cyclictest0-21swapper/308:31:363
2617599220,1cyclictest16246-21apt-get07:56:343
2617599220,1cyclictest10637-21rm10:55:193
26173992222,0cyclictest0-21swapper/210:21:212
26173992221,1cyclictest0-21swapper/210:45:172
26173992221,0cyclictest0-21swapper/210:15:342
26173992220,1cyclictest28674-21apt-get08:21:362
26173992220,1cyclictest0-21swapper/212:17:362
26173992220,1cyclictest0-21swapper/210:55:062
2617399220,21cyclictest20234-21ssh10:35:312
2617399220,21cyclictest19908-21diskmemload10:25:432
2617399220,21cyclictest12481-21ssh09:31:392
2617399220,21cyclictest0-21swapper/210:30:022
2617399220,21cyclictest0-21swapper/210:00:512
2617399220,21cyclictest0-21swapper/209:55:032
2617399220,21cyclictest0-21swapper/209:26:402
2617399220,1cyclictest0-21swapper/209:00:002
2617399220,0cyclictest0-21swapper/208:11:342
26169992221,0cyclictest0-21swapper/112:28:021
26169992220,1cyclictest10452-21ssh09:30:021
2616999220,22cyclictest0-21swapper/112:38:161
2616999220,22cyclictest0-21swapper/109:55:501
2616999220,21cyclictest8294-21latency_hist07:40:011
2616999220,21cyclictest6272-21ssh11:20:081
2616999220,21cyclictest26457-21ssh10:41:171
2616999220,21cyclictest19908-21diskmemload10:50:311
2616999220,21cyclictest15490-21munin-run07:55:001
2616999220,21cyclictest0-21swapper/109:10:121
2616999220,21cyclictest0-21swapper/109:06:351
2616999220,1cyclictest19908-21diskmemload12:00:011
2616999220,1cyclictest17720-21apt-get09:36:351
2616999220,0cyclictest0-21swapper/108:31:361
26165992222,0cyclictest0-21swapper/012:03:400
26165992222,0cyclictest0-21swapper/010:53:530
26165992222,0cyclictest0-21swapper/010:44:440
26165992221,1cyclictest62550irq/127-eno109:45:010
26165992220,1cyclictest30670-21ssh12:10:080
26165992219,2cyclictest29001-21ssh11:40:160
2616599220,2cyclictest10679-21turbostat.cron07:45:010
2616599220,21cyclictest15476-21apt-get07:55:000
2616599220,21cyclictest13772-21ssh11:55:130
2616599220,21cyclictest0-21swapper/012:05:060
2616599220,21cyclictest0-21swapper/010:27:030
2616599220,21cyclictest0-21swapper/009:06:350
26175992120,1cyclictest23851-21apt-get08:11:343
2617599210,21cyclictest0-21swapper/310:15:043
2617599210,20cyclictest0-21swapper/308:16:323
2617599210,20cyclictest0-21swapper/307:36:343
26173992120,0cyclictest0-21swapper/207:21:342
26173992119,1cyclictest0-21swapper/207:41:352
2617399210,1cyclictest17911-21apt-get09:06:352
2617399210,0cyclictest0-21swapper/208:06:352
26169992120,1cyclictest0-21swapper/107:31:371
26169992119,1cyclictest0-21swapper/108:45:001
2616999210,1cyclictest0-21swapper/108:36:351
26165992119,1cyclictest7938-21ls08:45:000
2616599210,21cyclictest0-21swapper/012:25:290
2616599210,20cyclictest8295-21latency_hist07:40:010
2616599210,0cyclictest1039-21apt-get08:31:360
26175992020,0cyclictest31066-21apt-get08:26:353
26175992019,1cyclictest15145-21munin-run09:00:003
2617599200,0cyclictest0-21swapper/307:46:353
26173992020,0cyclictest0-21swapper/208:31:362
26169992020,0cyclictest0-21swapper/108:46:361
2616999200,20cyclictest21457-21apt-get08:06:351
26165992020,0cyclictest0-21swapper/008:46:360
26165992020,0cyclictest0-21swapper/008:36:340
26165992019,1cyclictest0-21swapper/009:01:340
26175991919,0cyclictest0-21swapper/309:06:353
26175991919,0cyclictest0-21swapper/308:05:023
26175991919,0cyclictest0-21swapper/308:01:343
26175991918,1cyclictest0-21swapper/309:01:343
26173991918,1cyclictest3444-21apt-get08:36:352
26169991919,0cyclictest0-21swapper/108:11:341
26169991918,1cyclictest31320-21apt-get07:21:341
26169991917,1cyclictest31066-21apt-get08:26:351
26165991919,0cyclictest0-21swapper/008:11:340
26165991919,0cyclictest0-21swapper/007:31:370
26173991818,0cyclictest0-21swapper/207:56:332
26173991818,0cyclictest0-21swapper/207:51:332
26173991818,0cyclictest0-21swapper/207:16:352
26173991816,1cyclictest0-21swapper/207:50:002
2617399180,9cyclictest313-21systemd-journal07:15:002
26165991818,0cyclictest0-21swapper/008:21:370
26165991816,1cyclictest0-21swapper/008:00:000
26175991717,0cyclictest0-21swapper/308:51:353
2617599170,9cyclictest1291-21apt-get07:26:333
26173991717,0cyclictest6096-21apt-get07:36:352
26169991717,0cyclictest0-21swapper/108:21:371
26169991717,0cyclictest0-21swapper/108:01:341
26169991717,0cyclictest0-21swapper/107:55:021
26169991717,0cyclictest0-21swapper/107:26:331
26165991717,0cyclictest18664-21apt-get08:01:340
26165991717,0cyclictest0-21swapper/008:51:350
26165991717,0cyclictest0-21swapper/008:26:350
26165991717,0cyclictest0-21swapper/007:26:330
26165991717,0cyclictest0-21swapper/007:21:340
26175991616,0cyclictest3702-21apt-get07:31:363
26175991616,0cyclictest0-21swapper/307:16:353
26175991615,0cyclictest8311-21apt-get08:46:363
26173991614,1cyclictest0-21swapper/208:26:352
26169991616,0cyclictest0-21swapper/108:51:351
26169991615,0cyclictest28903-21apt-get07:16:351
26165991615,0cyclictest0-21swapper/008:16:330
26175991515,0cyclictest0-21swapper/308:21:363
26175991513,1cyclictest580-21users07:21:433
26173991514,1cyclictest0-21swapper/208:47:532
26169991515,0cyclictest26249-21apt-get08:16:331
26165991515,0cyclictest0-21swapper/007:16:350
26165991514,1cyclictest15107-21cron09:00:000
2617599140,14cyclictest0-21swapper/308:35:083
2617599140,14cyclictest0-21swapper/307:50:033
2617399140,14cyclictest0-21swapper/208:51:112
2617399140,0cyclictest0-21swapper/208:15:052
2617399140,0cyclictest0-21swapper/207:30:132
2616999140,14cyclictest0-21swapper/107:46:131
2616999140,14cyclictest0-21swapper/107:11:021
26165991414,0cyclictest0-21swapper/007:11:080
2616599140,14cyclictest0-21swapper/008:05:030
2616599140,14cyclictest0-21swapper/007:46:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional