You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 21:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun Aug 30, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2528299263,22cyclictest20978-21cron11:35:002
25283992522,2cyclictest20946-21sh12:03:093
2527999250,24cyclictest0-21swapper/109:26:041
25276992519,5cyclictest25943-21cron09:45:000
2527699250,24cyclictest29094-21grep10:16:080
2527699250,24cyclictest27534-21sh12:37:570
2527699250,24cyclictest19025-21diskmemload10:32:380
2527699250,24cyclictest1305-21kworker/u8:209:31:520
2527699250,1cyclictest0-21swapper/012:03:590
2527699250,1cyclictest0-21swapper/010:05:360
25283992421,2cyclictest19025-21diskmemload11:10:093
2528399240,0cyclictest0-21swapper/312:16:423
25282992422,1cyclictest32716-21rt-features09:21:092
25282992422,1cyclictest32716-21rt-features09:21:092
2528299240,23cyclictest19025-21diskmemload09:58:362
2528299240,23cyclictest0-21swapper/212:16:022
2528299240,23cyclictest0-21swapper/210:21:032
2528299240,1cyclictest28435-21sh10:45:072
25279992424,0cyclictest0-21swapper/111:37:141
25279992422,1cyclictest0-21swapper/111:25:001
25279992422,1cyclictest0-21swapper/110:41:241
2527999240,23cyclictest28464-21ssh12:39:201
2527999240,23cyclictest26804-21pmu-power11:11:081
2527999240,23cyclictest2439-21sh09:52:071
2527999240,23cyclictest22-21ksoftirqd/109:59:291
2527999240,23cyclictest1757-21cat10:21:041
2527999240,23cyclictest14902-21cron09:35:011
2527999240,23cyclictest0-21swapper/111:41:581
2527999240,23cyclictest0-21swapper/110:51:021
2527999240,23cyclictest0-21swapper/109:20:051
2527999240,23cyclictest0-21swapper/109:20:051
2527999240,1cyclictest16776-21sh11:31:031
2527999240,0cyclictest0-21swapper/112:03:531
2527999240,0cyclictest0-21swapper/111:29:151
25276992423,1cyclictest0-21swapper/009:46:250
25276992422,1cyclictest16491-21cpuspeed_turbos11:31:030
25276992422,1cyclictest0-21swapper/010:42:570
25276992422,1cyclictest0-21swapper/009:36:590
25276992421,2cyclictest0-21swapper/010:28:190
2527699240,24cyclictest19025-21diskmemload11:46:160
2527699240,24cyclictest0-21swapper/011:42:150
2527699240,24cyclictest0-21swapper/009:27:120
2527699240,23cyclictest19025-21diskmemload12:21:180
2527699240,23cyclictest19025-21diskmemload11:20:370
2527699240,23cyclictest0-21swapper/011:01:400
2527699240,23cyclictest0-21swapper/009:52:260
2527699240,1cyclictest30433-21apt-get07:20:000
2527699240,1cyclictest19025-21diskmemload10:36:470
2527699240,0cyclictest0-21swapper/012:26:470
2527699240,0cyclictest0-21swapper/012:09:340
25283992323,0cyclictest19025-21diskmemload12:12:003
25283992323,0cyclictest0-21swapper/311:57:063
25283992323,0cyclictest0-21swapper/311:45:583
25283992323,0cyclictest0-21swapper/311:31:183
25283992322,1cyclictest19025-21diskmemload10:42:023
25283992322,1cyclictest19025-21diskmemload10:34:263
25283992321,1cyclictest6461-21rm10:54:263
25283992321,1cyclictest0-21swapper/312:35:503
25283992320,1cyclictest0-21swapper/310:30:013
2528399230,2cyclictest9590-21ssh11:53:003
2528399230,2cyclictest7808-21ssh10:55:583
2528399230,2cyclictest7808-21ssh10:55:583
2528399230,23cyclictest3692-21ssh09:53:543
2528399230,23cyclictest0-21swapper/311:41:313
2528399230,23cyclictest0-21swapper/309:12:103
2528399230,22cyclictest8982-21sh11:24:313
2528399230,22cyclictest4804-21sh09:55:093
2528399230,22cyclictest32437-21sh11:16:093
2528399230,22cyclictest25949-21sh10:13:543
2528399230,22cyclictest19025-21diskmemload12:26:483
2528399230,22cyclictest10181-21ssh12:22:093
2528399230,22cyclictest0-21swapper/311:25:513
2528399230,0cyclictest0-21swapper/312:05:323
25282992323,0cyclictest0-21swapper/212:13:272
25282992323,0cyclictest0-21swapper/209:27:102
25282992322,1cyclictest28365-21apt-get07:16:022
25282992321,1cyclictest32423-21awk10:20:012
25282992321,1cyclictest23199-21/usr/sbin/munin09:41:112
25282992321,1cyclictest19110-21ssh11:05:222
25282992321,1cyclictest0-21swapper/212:26:022
25282992321,1cyclictest0-21swapper/211:01:082
25282992321,1cyclictest0-21swapper/210:06:032
25282992319,4cyclictest0-21swapper/211:17:482
2528299230,2cyclictest18069-21ssh12:30:032
2528299230,2cyclictest14474-21sh10:31:542
2528299230,23cyclictest19025-21diskmemload12:08:472
2528299230,23cyclictest0-21swapper/210:37:062
2528299230,23cyclictest0-21swapper/209:49:282
2528299230,22cyclictest22572-21dump-pmu-power08:10:002
2528299230,22cyclictest19025-21diskmemload11:25:342
2528299230,22cyclictest19025-21diskmemload10:42:512
2528299230,22cyclictest12115-21ssh10:59:272
2528299230,22cyclictest12115-21ssh10:59:272
2528299230,0cyclictest23431-21ssh09:13:202
2528299230,0cyclictest19025-21diskmemload11:53:272
2528299230,0cyclictest0-21swapper/212:22:392
2528299230,0cyclictest0-21swapper/211:45:082
2528299230,0cyclictest0-21swapper/210:01:272
25279992323,0cyclictest0-21swapper/112:05:131
25279992323,0cyclictest0-21swapper/110:16:511
25279992323,0cyclictest0-21swapper/110:10:241
25279992323,0cyclictest0-21swapper/110:04:271
25279992323,0cyclictest0-21swapper/109:12:111
25279992321,1cyclictest0-21swapper/109:15:391
25279992319,0cyclictest22-21ksoftirqd/110:50:001
2527999231,21cyclictest22-21ksoftirqd/111:00:451
2527999230,2cyclictest19025-21diskmemload12:11:521
2527999230,23cyclictest0-21swapper/111:45:151
2527999230,23cyclictest0-21swapper/109:36:161
2527999230,22cyclictest7761-21kworker/u8:010:58:181
2527999230,22cyclictest7761-21kworker/u8:010:58:181
2527999230,22cyclictest19705-21sh10:36:151
2527999230,22cyclictest0-21swapper/112:20:351
2527999230,0cyclictest19025-21diskmemload10:32:221
2527999230,0cyclictest0-21swapper/110:26:591
25276992323,0cyclictest19025-21diskmemload12:15:310
25276992323,0cyclictest19025-21diskmemload11:36:010
25276992323,0cyclictest19025-21diskmemload10:56:440
25276992323,0cyclictest19025-21diskmemload10:56:440
25276992323,0cyclictest0-21swapper/012:11:110
25276992323,0cyclictest0-21swapper/009:16:010
25276992321,1cyclictest19025-21diskmemload11:05:050
25276992321,1cyclictest0-21swapper/012:30:040
25276992321,1cyclictest0-21swapper/010:10:130
25276992321,1cyclictest0-21swapper/009:10:080
2527699230,23cyclictest19025-21diskmemload11:57:000
2527699230,23cyclictest0-21swapper/011:29:240
2527699230,23cyclictest0-21swapper/009:23:120
2527699230,23cyclictest0-21swapper/009:23:120
2527699230,22cyclictest19025-21diskmemload10:20:080
2527699230,1cyclictest0-21swapper/011:11:420
2527699230,0cyclictest0-21swapper/011:17:130
2527699230,0cyclictest0-21swapper/009:55:030
25283992222,0cyclictest19025-21diskmemload10:38:053
25283992222,0cyclictest19025-21diskmemload09:26:193
25283992222,0cyclictest0-21swapper/312:32:053
25283992222,0cyclictest0-21swapper/311:07:203
25283992222,0cyclictest0-21swapper/310:15:393
25283992222,0cyclictest0-21swapper/309:38:193
25283992220,1cyclictest0-21swapper/311:00:223
2528399221,1cyclictest19025-21diskmemload10:08:173
2528399220,21cyclictest705-21ssh10:20:403
2528399220,21cyclictest607-21in:imuxsock09:00:003
2528399220,21cyclictest21321-21ssh11:35:093
2528399220,21cyclictest19025-21diskmemload09:30:313
2528399220,21cyclictest10857-21ssh10:00:513
2528399220,21cyclictest0-21swapper/310:46:163
2528399220,1cyclictest30574-21sh09:20:063
2528399220,1cyclictest30574-21sh09:20:063
2528399220,1cyclictest28792-21ssh09:46:153
25282992222,0cyclictest0-21swapper/210:51:142
25282992220,1cyclictest30338-21ssh11:42:172
25282992220,1cyclictest25186-21ssh10:12:462
25282992220,1cyclictest25122-21rm09:15:082
2528299220,22cyclictest0-21swapper/209:51:152
2528299220,21cyclictest4226-21ssh11:20:102
2528299220,21cyclictest24308-21sh12:35:522
2528299220,21cyclictest21738-21ssh11:35:392
2528299220,21cyclictest11783-21latency_hist08:55:002
2528299220,21cyclictest11688-21ssh11:55:322
2528299220,1cyclictest3560-21apt-get07:31:032
2528299220,1cyclictest10045-21ssh09:30:342
2528299220,1cyclictest0-21swapper/212:00:392
2528299220,1cyclictest0-21swapper/207:30:002
25279992222,0cyclictest19025-21diskmemload09:45:311
25279992222,0cyclictest0-21swapper/108:11:021
25279992221,1cyclictest19025-21diskmemload12:30:411
25279992221,1cyclictest0-21swapper/111:50:091
25279992221,0cyclictest0-21swapper/108:31:021
25279992220,1cyclictest0-21swapper/107:20:011
2527999220,21cyclictest5955-21apt-get07:36:021
2527999220,21cyclictest23250-21diskmemload09:41:131
2527999220,21cyclictest13248-21apt-get12:26:011
2527999220,21cyclictest0-21swapper/112:15:131
2527999220,21cyclictest0-21swapper/108:01:021
2527999220,1cyclictest3231-21perf07:30:001
2527999220,1cyclictest25199-21apt-get07:10:021
2527999220,1cyclictest0-21swapper/111:55:051
2527999220,1cyclictest0-21swapper/111:07:521
2527999220,1cyclictest0-21swapper/110:06:271
2527999220,1cyclictest0-21swapper/108:16:041
2527699225,16cyclictest9359-21kworker/0:207:46:020
25276992220,1cyclictest16599-21awk09:05:000
2527699220,21cyclictest0-21swapper/010:01:030
2527699220,0cyclictest0-21swapper/011:50:030
2527699220,0cyclictest0-21swapper/010:46:300
25283992120,1cyclictest18079-21apt-get08:01:023
25283992119,1cyclictest16590-21turbostat.cron09:05:003
2528399210,21cyclictest0-21swapper/309:40:503
2528399210,21cyclictest0-21swapper/307:41:013
2528399210,20cyclictest0-21swapper/307:10:023
2528399210,0cyclictest31179-21apt-get07:21:013
2528399210,0cyclictest25079-21ssh09:15:043
2528299210,21cyclictest0-21swapper/208:11:022
2528299210,20cyclictest24289-21apt-get11:10:022
2528299210,20cyclictest0-21swapper/207:11:022
2527999210,20cyclictest0-21swapper/107:41:011
25276992121,0cyclictest0-21swapper/009:06:010
25276992121,0cyclictest0-21swapper/008:50:010
25276992121,0cyclictest0-21swapper/008:26:000
25276992120,1cyclictest0-21swapper/008:21:000
25276992119,1cyclictest0-21swapper/008:16:020
2527699210,0cyclictest0-21swapper/008:06:010
25283992020,0cyclictest0-21swapper/309:06:013
25283992020,0cyclictest0-21swapper/307:46:023
25283992020,0cyclictest0-21swapper/307:36:023
2528399200,0cyclictest32533-21apt-get08:31:023
2528299200,20cyclictest0-21swapper/208:31:022
2528299200,19cyclictest8475-21apt-get07:41:012
25279992020,0cyclictest0-21swapper/108:51:001
25279992020,0cyclictest0-21swapper/108:46:021
25279992020,0cyclictest0-21swapper/108:41:021
25279992018,1cyclictest12923-21cron07:50:011
25279992018,1cyclictest0-21swapper/109:00:001
25276992020,0cyclictest0-21swapper/008:56:020
25276992020,0cyclictest0-21swapper/007:21:040
25276992018,1cyclictest606-21dbus-daemon07:40:000
25276992018,1cyclictest5635-21munin-run07:35:000
25276992018,1cyclictest15658-21apt-get07:55:590
2527699200,1cyclictest0-21swapper/008:01:100
25283991919,0cyclictest0-21swapper/308:51:003
25283991919,0cyclictest0-21swapper/308:41:023
25282991919,0cyclictest30136-21apt-get08:26:012
25282991919,0cyclictest0-21swapper/209:01:022
25282991917,1cyclictest606-21dbus-daemon09:10:002
25282991917,1cyclictest27385-21perf08:20:002
25282991917,1cyclictest0-21swapper/207:55:592
25279991919,0cyclictest0-21swapper/109:06:021
25279991919,0cyclictest0-21swapper/107:56:001
25279991917,1cyclictest0-21swapper/107:35:001
25282991818,0cyclictest0-21swapper/208:56:022
25282991816,1cyclictest6400-21diskstats07:36:042
25276991816,1cyclictest2161-21cron08:35:000
25283991717,0cyclictest22919-21apt-get08:11:023
25283991717,0cyclictest0-21swapper/308:26:013
25283991717,0cyclictest0-21swapper/307:26:003
25282991717,0cyclictest0-21swapper/208:41:022
25279991717,0cyclictest0-21swapper/107:51:021
25279991715,2cyclictest22-21ksoftirqd/108:21:001
25276991714,2cyclictest4614-21idleruntime-cro08:40:010
25283991616,0cyclictest0-21swapper/308:16:013
25283991616,0cyclictest0-21swapper/308:06:013
2528299160,7cyclictest0-21swapper/208:01:022
2527999167,5cyclictest22-21ksoftirqd/108:10:001
25279991614,1cyclictest0-21swapper/108:26:031
25276991615,1cyclictest25967-21apt-get07:11:020
2527699160,6cyclictest0-21swapper/008:11:020
2527699160,1cyclictest0-21swapper/008:51:080
25282991515,0cyclictest0-21swapper/207:20:012
25282991513,1cyclictest0-21swapper/208:21:102
2528299150,0cyclictest0-21swapper/208:35:592
25279991515,0cyclictest0-21swapper/108:36:021
2527699150,14cyclictest0-21swapper/007:26:020
25283991414,0cyclictest0-21swapper/307:55:323
2528399140,14cyclictest0-21swapper/308:45:473
2528399140,14cyclictest0-21swapper/308:20:163
2528399140,14cyclictest0-21swapper/307:15:193
2528399140,0cyclictest0-21swapper/308:35:183
2528399140,0cyclictest0-21swapper/307:50:023
2528399140,0cyclictest0-21swapper/307:30:433
2528299140,14cyclictest0-21swapper/208:46:422
2528299140,14cyclictest0-21swapper/207:45:042
2528299140,0cyclictest0-21swapper/207:50:022
25279991414,0cyclictest0-21swapper/109:00:131
25276991414,0cyclictest0-21swapper/008:40:540
2527699140,14cyclictest0-21swapper/007:40:030
2527699140,0cyclictest0-21swapper/007:50:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional