You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 18:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Jun 30, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28878992713,14cyclictest0-21swapper/007:55:590
28882992624,1cyclictest0-21swapper/110:09:421
28878992624,1cyclictest16167-21apt-key12:25:010
2888999252,22cyclictest26244-21ssh09:11:473
2888999250,0cyclictest0-21swapper/312:17:383
28886992523,1cyclictest23018-21diskmemload11:51:022
2888699250,24cyclictest23018-21diskmemload09:57:112
2888699250,24cyclictest16807-21ssh10:59:262
2888299250,24cyclictest0-21swapper/109:53:311
2887899250,24cyclictest62550irq/127-eno109:56:570
2887899250,24cyclictest0-21swapper/009:29:470
28889992424,0cyclictest0-21swapper/312:38:073
28889992423,1cyclictest0-21swapper/311:32:503
28889992422,1cyclictest5600-21ssh09:22:043
2888999240,23cyclictest32174-21ssh10:44:073
2888999240,23cyclictest23018-21diskmemload09:39:143
2888999240,23cyclictest15622-21unixbench_multi11:26:113
2888999240,23cyclictest12554-21ssh09:28:533
2888999240,23cyclictest0-21swapper/311:02:573
2888999240,23cyclictest0-21swapper/310:14:493
2888999240,23cyclictest0-21swapper/309:51:013
2888999240,1cyclictest13857-21sh09:58:303
2888999240,0cyclictest0-21swapper/312:02:243
28886992420,3cyclictest0-21swapper/211:09:522
28886992419,4cyclictest0-21swapper/210:41:192
2888699240,23cyclictest5525-21ssh10:49:242
2888699240,23cyclictest23018-21diskmemload12:13:172
2888699240,23cyclictest23018-21diskmemload12:13:172
2888699240,23cyclictest0-21swapper/209:49:422
28882992423,1cyclictest23018-21diskmemload12:24:581
2888299241,22cyclictest0-21swapper/110:27:321
2888299240,23cyclictest27259-21ssh09:13:161
2888299240,23cyclictest0-21swapper/111:15:281
2888299240,0cyclictest23018-21diskmemload09:34:071
2888299240,0cyclictest0-21swapper/111:57:181
2888299240,0cyclictest0-21swapper/109:19:381
28878992421,3cyclictest5345-21apt-get12:15:580
28878992421,2cyclictest0-21swapper/010:45:110
2887899240,2cyclictest10582-21ssh11:21:560
2887899240,24cyclictest0-21swapper/010:37:510
2887899240,24cyclictest0-21swapper/010:28:250
2887899240,23cyclictest23018-21diskmemload11:32:420
28889992323,0cyclictest0-21swapper/311:50:483
28889992323,0cyclictest0-21swapper/310:51:343
28889992323,0cyclictest0-21swapper/310:35:323
28889992323,0cyclictest0-21swapper/309:16:273
28889992322,0cyclictest23018-21diskmemload11:20:563
28889992321,1cyclictest8662-21sh11:49:523
28889992321,1cyclictest16417-21ssh12:25:023
2888999230,23cyclictest23018-21diskmemload11:57:133
2888999230,23cyclictest0-21swapper/312:24:113
2888999230,22cyclictest8231-21sh10:21:573
2888999230,22cyclictest783-21snmpd11:06:153
2888999230,22cyclictest30331-21kworker/u8:111:40:243
2888999230,22cyclictest23018-21diskmemload09:30:063
2888999230,22cyclictest18571-21ssh10:02:113
2888999230,0cyclictest23018-21diskmemload12:05:523
2888999230,0cyclictest0-21swapper/310:16:033
28886992323,0cyclictest6946-21ssh11:19:382
28886992323,0cyclictest0-21swapper/209:34:382
28886992322,1cyclictest23018-21diskmemload09:19:172
28886992321,1cyclictest212162sleep211:02:432
28886992321,1cyclictest0-21swapper/211:11:492
28886992321,1cyclictest0-21swapper/210:51:032
28886992320,2cyclictest12428-21sh11:24:232
28886992318,4cyclictest0-21swapper/211:43:482
2888699231,21cyclictest0-21swapper/210:30:422
2888699230,23cyclictest26377-21ssh12:33:462
2888699230,23cyclictest23018-21diskmemload10:16:262
2888699230,23cyclictest0-21swapper/212:28:382
2888699230,22cyclictest9494-21ssh12:19:192
2888699230,22cyclictest5380-21ssh09:21:382
2888699230,22cyclictest26340-21ssh12:05:332
2888699230,22cyclictest25916-21ssh09:11:222
2888699230,22cyclictest23018-21diskmemload11:55:412
2888699230,22cyclictest13819-21ssh11:25:592
2888699230,22cyclictest13344-21ssh12:21:422
2888699230,22cyclictest0-21swapper/210:35:552
2888699230,22cyclictest0-21swapper/209:52:302
2888699230,0cyclictest0-21swapper/211:32:252
2888699230,0cyclictest0-21swapper/210:04:282
28882992323,0cyclictest23018-21diskmemload11:12:051
28882992323,0cyclictest0-21swapper/111:20:591
28882992323,0cyclictest0-21swapper/110:52:201
28882992321,1cyclictest32270-21sh10:15:281
28882992321,1cyclictest31496-21apt-get09:46:001
28882992321,1cyclictest20995-21latency_hist08:00:001
28882992321,1cyclictest0-21swapper/112:36:341
28882992321,1cyclictest0-21swapper/110:41:031
28882992321,1cyclictest0-21swapper/109:37:331
28882992321,1cyclictest0-21swapper/109:25:421
2888299231,21cyclictest0-21swapper/110:04:591
2888299230,2cyclictest404-21sed11:41:111
2888299230,2cyclictest26234-21sh11:06:571
2888299230,2cyclictest23018-21diskmemload12:16:071
2888299230,23cyclictest0-21swapper/111:34:291
2888299230,22cyclictest864-21rm10:45:191
2888299230,22cyclictest8568-21ssh10:22:231
2888299230,22cyclictest17117-21apt-get12:26:011
2888299230,22cyclictest12648-21ssh09:56:491
2888299230,22cyclictest0-21swapper/110:30:351
2888299230,0cyclictest0-21swapper/112:31:491
2888299230,0cyclictest0-21swapper/112:10:521
2888299230,0cyclictest0-21swapper/112:10:521
2888299230,0cyclictest0-21swapper/110:55:201
2888299230,0cyclictest0-21swapper/110:11:041
28878992323,0cyclictest23018-21diskmemload09:45:190
28878992323,0cyclictest23018-21diskmemload09:14:370
28878992323,0cyclictest0-21swapper/012:10:030
28878992323,0cyclictest0-21swapper/012:10:030
28878992323,0cyclictest0-21swapper/011:18:030
28878992323,0cyclictest0-21swapper/010:11:460
28878992323,0cyclictest0-21swapper/010:01:300
28878992323,0cyclictest0-21swapper/009:31:370
28878992322,1cyclictest0-21swapper/009:51:060
28878992321,1cyclictest606-21dbus-daemon08:40:000
28878992321,1cyclictest1997-21ssh11:43:240
28878992321,1cyclictest0-21swapper/010:44:190
28878992320,2cyclictest23547-21ssh11:05:360
2887899230,23cyclictest0-21swapper/011:10:500
2887899230,23cyclictest0-21swapper/010:56:040
2887899230,23cyclictest0-21swapper/010:20:180
2887899230,22cyclictest29860-21ssh12:08:070
2887899230,22cyclictest23018-21diskmemload11:51:210
2887899230,22cyclictest15430-21idleruntime-cro08:55:000
2887899230,22cyclictest0-21swapper/012:26:020
2887899230,21cyclictest0-21swapper/011:00:020
2887899230,1cyclictest23018-21diskmemload10:07:170
2887899230,0cyclictest23018-21diskmemload12:32:120
2887899230,0cyclictest0-21swapper/012:00:270
28889992221,1cyclictest9158-21apt-get07:36:003
28889992221,1cyclictest23018-21diskmemload12:30:343
28889992221,0cyclictest0-21swapper/308:16:003
28889992220,1cyclictest0-21swapper/309:05:013
2888999220,22cyclictest23018-21diskmemload10:33:293
2888999220,22cyclictest14242-21ssh10:27:263
2888999220,22cyclictest0-21swapper/309:40:323
2888999220,21cyclictest8448-21apt-get07:35:013
2888999220,21cyclictest31341-21ssh09:45:503
2888999220,21cyclictest21396-21ssh10:05:453
2888999220,21cyclictest20951-21cron08:00:003
2888999220,21cyclictest0-21swapper/311:35:133
2888999220,21cyclictest0-21swapper/311:10:343
2888999220,21cyclictest0-21swapper/310:55:513
2888999220,21cyclictest0-21swapper/310:45:543
2888999220,21cyclictest0-21swapper/307:16:003
2888999220,0cyclictest0-21swapper/311:16:093
28886992222,0cyclictest0-21swapper/211:36:502
28886992222,0cyclictest0-21swapper/210:25:222
28886992222,0cyclictest0-21swapper/209:41:392
28886992220,1cyclictest28318-21ssh12:36:012
28886992220,1cyclictest13057-21munin-run08:50:002
28886992220,1cyclictest0-21swapper/209:35:542
2888699220,22cyclictest0-21swapper/210:23:132
2888699220,21cyclictest0-21swapper/210:06:022
2888699220,21cyclictest0-21swapper/209:25:302
2888699220,21cyclictest0-21swapper/207:51:002
2888699220,21cyclictest0-21swapper/207:16:002
2888699220,1cyclictest23314-21sh12:01:462
2888699220,1cyclictest14128-21apt-get07:46:002
2888699220,1cyclictest0-21swapper/207:10:592
28882992222,0cyclictest0-21swapper/111:28:001
28882992221,1cyclictest0-21swapper/111:50:351
28882992220,1cyclictest23018-21diskmemload09:20:261
28882992220,1cyclictest0-21swapper/111:49:541
28882992219,2cyclictest15450-21latency_hist08:55:001
2888299220,22cyclictest0-21swapper/109:41:361
2888299220,21cyclictest0-21swapper/111:35:521
2888299220,21cyclictest0-21swapper/111:01:011
2888299220,21cyclictest0-21swapper/107:35:021
2888299220,1cyclictest7764-21cron08:40:001
2888299220,1cyclictest5404-21basename08:35:001
2888299220,1cyclictest22059-21sh10:35:111
2888299220,1cyclictest20979-21apt-get09:06:021
2888299220,0cyclictest0-21swapper/112:05:361
28878992222,0cyclictest0-21swapper/011:36:110
2887899220,22cyclictest23018-21diskmemload10:15:540
2887899220,22cyclictest0-21swapper/011:45:390
2887899220,22cyclictest0-21swapper/010:52:250
2887899220,21cyclictest619-21polkitd07:55:000
2887899220,21cyclictest27769-21ssh12:35:200
2887899220,21cyclictest23018-21diskmemload09:40:210
2887899220,21cyclictest0-21swapper/011:25:450
2887899220,21cyclictest0-21swapper/009:15:060
2887899220,21cyclictest0-21swapper/008:25:590
2887899220,1cyclictest3613-21/usr/sbin/munin09:21:020
2887899220,1cyclictest23018-21diskmemload10:33:440
2887899220,1cyclictest20746-21ssh09:36:030
28889992118,2cyclictest10569-21cron08:45:003
2888999210,20cyclictest23018-21diskmemload12:10:093
2888999210,20cyclictest23018-21diskmemload12:10:093
2888999210,20cyclictest0-21swapper/308:15:013
28886992121,0cyclictest0-21swapper/207:31:002
28886992118,2cyclictest15428-21apt-get08:55:022
2888699210,20cyclictest0-21swapper/209:01:002
28882992119,1cyclictest28516-21apt-get08:16:001
2888299210,0cyclictest0-21swapper/108:06:001
2888299210,0cyclictest0-21swapper/108:00:591
28878992120,0cyclictest16168-21apt-get08:56:010
28878992119,1cyclictest6368-21apt-get07:31:000
28878992119,1cyclictest0-21swapper/007:15:000
2887899210,21cyclictest0-21swapper/011:55:270
2887899210,1cyclictest0-21swapper/008:45:590
28889992020,0cyclictest0-21swapper/307:51:013
28889992019,0cyclictest16058-21apt-get08:55:023
2888999200,20cyclictest0-21swapper/308:30:593
2888999200,1cyclictest0-21swapper/307:30:013
2888999200,0cyclictest0-21swapper/307:41:003
28886992019,0cyclictest23727-21apt-get08:06:002
28886992018,1cyclictest7779-21apt-get08:40:002
28886992017,2cyclictest23384-21cron08:05:002
2888699200,0cyclictest0-21swapper/207:41:002
28882992020,0cyclictest8532-21apt-get08:41:001
28882992020,0cyclictest0-21swapper/108:21:001
28882992020,0cyclictest0-21swapper/107:41:001
28882992019,0cyclictest0-21swapper/108:56:011
28878992020,0cyclictest0-21swapper/008:16:010
28878992020,0cyclictest0-21swapper/007:46:000
28878992020,0cyclictest0-21swapper/007:26:000
28878992019,0cyclictest1566-21apt-get07:21:000
2887899200,20cyclictest0-21swapper/007:36:000
28889991919,0cyclictest0-21swapper/308:25:593
28889991918,0cyclictest0-21swapper/308:21:003
2888999190,19cyclictest0-21swapper/308:36:003
28886991917,1cyclictest606-21dbus-daemon07:40:012
28882991919,0cyclictest0-21swapper/108:10:581
28878991918,0cyclictest0-21swapper/008:21:000
28878991917,1cyclictest23372-21cron08:05:000
28889991816,1cyclictest3641-21dump-pmu-power07:25:013
28886991818,0cyclictest0-21swapper/208:25:592
28886991817,0cyclictest26117-21apt-get08:10:582
28878991818,0cyclictest0-21swapper/009:06:020
28878991818,0cyclictest0-21swapper/008:40:020
28889991716,0cyclictest0-21swapper/309:06:023
28886991717,0cyclictest0-21swapper/209:06:022
28886991716,0cyclictest18917-21apt-get07:55:592
28882991717,0cyclictest0-21swapper/107:31:001
28882991717,0cyclictest0-21swapper/107:21:001
28882991716,0cyclictest0-21swapper/107:46:001
2887899170,0cyclictest0-21swapper/008:10:580
28889991616,0cyclictest0-21swapper/308:06:003
28889991616,0cyclictest0-21swapper/307:10:593
28886991616,0cyclictest0-21swapper/207:26:002
28886991615,1cyclictest13377-21apt-get08:51:002
2888699160,15cyclictest3298-21users07:21:102
28882991616,0cyclictest0-21swapper/107:16:001
28882991614,1cyclictest16521-21apt-get07:51:001
28882991614,1cyclictest0-21swapper/107:12:291
28878991616,0cyclictest0-21swapper/008:06:000
2887899160,15cyclictest13454-21users07:41:100
28889991515,0cyclictest0-21swapper/308:00:593
28886991513,1cyclictest10607-21awk08:45:002
28889991414,0cyclictest0-21swapper/308:50:203
28889991414,0cyclictest0-21swapper/308:45:273
2888999140,14cyclictest0-21swapper/307:48:283
28886991411,2cyclictest28520-21taskset08:16:002
2888699140,0cyclictest0-21swapper/208:30:282
28882991414,0cyclictest0-21swapper/107:25:241
28882991412,1cyclictest2339-21sed08:26:081
2888299140,0cyclictest0-21swapper/108:46:161
28878991414,0cyclictest0-21swapper/009:00:040
2887899140,0cyclictest0-21swapper/008:30:340
2887899140,0cyclictest0-21swapper/007:15:090
28886991313,0cyclictest0-21swapper/208:20:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional