You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 06:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue Aug 18, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7365993634,1cyclictest0-21swapper/320:05:013
7365993230,1cyclictest34-21ksoftirqd/319:25:013
7360992725,0cyclictest0-21swapper/223:47:042
7360992623,0cyclictest0-21swapper/223:05:482
7357992626,0cyclictest0-21swapper/119:15:011
7357992624,1cyclictest10994-21cron20:25:011
7360992522,0cyclictest537-21diskmemload23:59:332
7357992523,2cyclictest10048-21ssh22:42:561
735799250,24cyclictest0-21swapper/121:48:171
735599250,24cyclictest537-21diskmemload23:21:480
735599250,24cyclictest537-21diskmemload21:25:150
735599250,24cyclictest0-21swapper/021:45:420
7365992423,1cyclictest0-21swapper/322:25:463
736599240,23cyclictest537-21diskmemload22:38:023
736599240,23cyclictest537-21diskmemload00:01:533
736599240,1cyclictest0-21swapper/322:52:323
7360992424,0cyclictest0-21swapper/223:26:042
7360992420,4cyclictest0-21swapper/221:46:252
736099241,22cyclictest1312-21apt-get20:05:002
736099240,3cyclictest2615-21ssh21:40:012
736099240,23cyclictest20900-21ssh22:24:272
736099240,23cyclictest0-21swapper/223:41:432
736099240,23cyclictest0-21swapper/223:41:432
736099240,0cyclictest0-21swapper/222:28:102
7357992423,1cyclictest0-21swapper/123:50:491
7357992423,1cyclictest0-21swapper/121:16:591
7357992421,2cyclictest22015-21ssh23:21:461
735799240,24cyclictest0-21swapper/121:23:041
735799240,23cyclictest537-21diskmemload23:29:461
735799240,23cyclictest2342-21apt-get21:40:011
735799240,23cyclictest15938-21cat20:35:001
735799240,23cyclictest0-21swapper/121:27:281
735799240,1cyclictest537-21diskmemload22:59:421
735799240,1cyclictest0-21swapper/100:34:051
7355992421,2cyclictest1427-21latency_hist20:05:010
735599241,22cyclictest3336-21ssh22:36:270
735599240,24cyclictest0-21swapper/023:04:290
735599240,24cyclictest0-21swapper/000:32:300
735599240,24cyclictest0-21swapper/000:14:510
735599240,23cyclictest537-21diskmemload21:50:500
735599240,23cyclictest537-21diskmemload00:09:060
735599240,23cyclictest0-21swapper/000:03:000
735599240,1cyclictest14974-21ssh22:19:240
735599240,0cyclictest0-21swapper/023:44:160
735599240,0cyclictest0-21swapper/023:44:160
7365992323,0cyclictest537-21diskmemload23:51:493
7365992323,0cyclictest537-21diskmemload00:13:303
7365992323,0cyclictest0-21swapper/323:35:443
7365992323,0cyclictest0-21swapper/323:26:223
7365992323,0cyclictest0-21swapper/322:00:503
7365992323,0cyclictest0-21swapper/321:46:413
7365992323,0cyclictest0-21swapper/321:28:463
7365992323,0cyclictest0-21swapper/320:05:013
7365992323,0cyclictest0-21swapper/320:05:013
7365992321,1cyclictest3406-21ssh21:11:003
7365992321,1cyclictest0-21swapper/321:20:073
7365992321,1cyclictest0-21swapper/300:35:333
736599230,2cyclictest6169-21apt-get20:15:013
736599230,23cyclictest537-21diskmemload23:44:153
736599230,23cyclictest537-21diskmemload23:44:153
736599230,23cyclictest0-21swapper/323:12:183
736599230,23cyclictest0-21swapper/323:04:563
736599230,23cyclictest0-21swapper/322:15:233
736599230,23cyclictest0-21swapper/321:57:393
736599230,23cyclictest0-21swapper/321:52:413
736599230,23cyclictest0-21swapper/321:35:103
736599230,23cyclictest0-21swapper/321:19:133
736599230,22cyclictest537-21diskmemload23:24:373
736599230,22cyclictest537-21diskmemload21:30:283
736599230,22cyclictest537-21diskmemload00:05:293
736599230,22cyclictest3255-21apt-get21:40:023
736599230,22cyclictest29147-21ssh00:25:073
736599230,22cyclictest26399-21sh00:23:113
736599230,22cyclictest18232-21sh23:19:143
736599230,22cyclictest16793-21ssh22:20:033
736599230,22cyclictest15941-21sh22:48:313
736599230,22cyclictest0-21swapper/319:40:013
736599230,1cyclictest9550-21ssh22:14:383
736599230,0cyclictest0-21swapper/323:05:113
736599230,0cyclictest0-21swapper/322:05:403
736599230,0cyclictest0-21swapper/320:55:013
736599230,0cyclictest0-21swapper/300:33:003
7360992323,0cyclictest537-21diskmemload00:05:082
7360992323,0cyclictest0-21swapper/222:45:282
7360992323,0cyclictest0-21swapper/222:41:142
7360992322,0cyclictest23382-21apt-get20:50:002
7360992322,0cyclictest0-21swapper/221:53:222
7360992321,1cyclictest24132-21apt-get19:45:002
7360992321,1cyclictest13288-21hddtemp_smartct21:20:032
7360992321,1cyclictest12281-21apt-get00:40:012
7360992321,1cyclictest0-21swapper/221:55:382
7360992321,1cyclictest0-21swapper/200:27:022
7360992320,2cyclictest5405-21expr00:05:002
7360992320,2cyclictest32745-21cron22:35:012
7360992320,0cyclictest0-21swapper/222:37:382
736099230,23cyclictest537-21diskmemload23:34:122
736099230,23cyclictest0-21swapper/223:50:292
736099230,23cyclictest0-21swapper/223:03:302
736099230,23cyclictest0-21swapper/221:17:122
736099230,23cyclictest0-21swapper/200:24:102
736099230,22cyclictest6177-21sh23:36:112
736099230,22cyclictest25184-21sh22:55:252
736099230,1cyclictest16926-21apt-get19:30:012
7357992323,0cyclictest0-21swapper/123:08:551
7357992323,0cyclictest0-21swapper/122:47:171
7357992323,0cyclictest0-21swapper/122:25:131
7357992323,0cyclictest0-21swapper/100:22:501
7357992321,2cyclictest12061-21ssh00:39:461
735799230,2cyclictest2719-21gpgv21:40:011
735799230,2cyclictest22978-21awk22:55:001
735799230,2cyclictest21033-21munin-run20:45:001
735799230,2cyclictest19119-21sh23:48:321
735799230,23cyclictest0-21swapper/122:31:231
735799230,22cyclictest606-21dbus-daemon20:05:001
735799230,22cyclictest524-21apt-get21:10:011
735799230,22cyclictest32263-21rm00:28:301
735799230,22cyclictest31375-21apt-get00:00:011
735799230,22cyclictest2027-21sh23:33:171
735799230,22cyclictest13758-21rm00:11:231
735799230,22cyclictest0-21swapper/123:05:011
735799230,1cyclictest19799-21ssh00:16:521
735799230,1cyclictest0-21swapper/119:45:001
735799230,0cyclictest0-21swapper/123:56:071
735799230,0cyclictest0-21swapper/122:20:381
7355992323,0cyclictest537-21diskmemload23:56:190
7355992323,0cyclictest537-21diskmemload23:31:380
7355992323,0cyclictest0-21swapper/023:15:340
7355992323,0cyclictest0-21swapper/021:36:140
7355992323,0cyclictest0-21swapper/000:37:420
7355992322,1cyclictest62550irq/127-eno121:18:200
7355992321,1cyclictest19322-21apt-get19:34:590
7355992321,1cyclictest0-21swapper/022:30:320
7355992321,1cyclictest0-21swapper/000:17:390
7355992320,2cyclictest0-21swapper/022:52:370
7355992320,2cyclictest0-21swapper/022:20:330
735599230,23cyclictest0-21swapper/023:26:200
735599230,23cyclictest0-21swapper/023:05:100
735599230,23cyclictest0-21swapper/021:57:580
735599230,23cyclictest0-21swapper/000:22:410
735599230,22cyclictest5817-21ssh23:35:440
735599230,22cyclictest30732-21diskmemload00:26:210
735599230,22cyclictest15612-21ssh21:21:470
735599230,22cyclictest15038-21awk19:25:010
735599230,22cyclictest14346-21ssh22:46:050
735599230,1cyclictest1950-21ntp_states21:10:070
735599230,1cyclictest11507-21sh22:44:540
735599230,1cyclictest0-21swapper/023:10:310
735599230,0cyclictest537-21diskmemload22:55:480
735599230,0cyclictest537-21diskmemload22:26:030
7365992221,1cyclictest20989-21apt-get20:45:003
7365992220,1cyclictest18430-21munin-run20:40:003
7365992220,1cyclictest0-21swapper/323:30:013
7365992220,1cyclictest0-21swapper/319:30:013
7365992220,1cyclictest0-21swapper/300:15:043
736599220,2cyclictest31335-21run-parts20:00:003
736599220,22cyclictest0-21swapper/322:32:093
736599220,21cyclictest6763-21perl22:40:023
736599220,21cyclictest0-21swapper/319:54:583
736599220,1cyclictest19692-21sh23:49:253
736599220,0cyclictest0-21swapper/323:55:443
7360992222,0cyclictest537-21diskmemload22:05:142
7360992222,0cyclictest0-21swapper/221:26:152
7360992222,0cyclictest0-21swapper/221:10:412
7360992221,1cyclictest8543-21ssh22:13:212
7360992220,1cyclictest9727-21cron19:15:002
7360992220,1cyclictest21001-21idleruntime-cro20:45:002
7360992220,1cyclictest19795-21munin-run19:35:012
7360992220,1cyclictest0-21swapper/222:50:022
7360992217,4cyclictest13481-21ssh00:10:562
736099220,22cyclictest537-21diskmemload21:30:162
736099220,22cyclictest20853-21sh23:20:102
736099220,22cyclictest0-21swapper/223:15:382
736099220,22cyclictest0-21swapper/222:15:102
736099220,21cyclictest6208-21apt20:15:012
736099220,21cyclictest0-21swapper/220:09:592
736099220,21cyclictest0-21swapper/220:09:592
736099220,1cyclictest31432-21munin-run20:00:002
736099220,1cyclictest20905-21ssh00:18:222
736099220,1cyclictest0-21swapper/222:00:112
736099220,1cyclictest0-21swapper/219:40:012
736099220,0cyclictest0-21swapper/221:42:322
736099220,0cyclictest0-21swapper/200:31:312
735799222,2cyclictest21683-21/usr/sbin/munin19:40:011
7357992221,1cyclictest0-21swapper/122:09:031
7357992220,1cyclictest0-21swapper/121:55:011
7357992220,1cyclictest0-21swapper/100:05:021
735799220,21cyclictest23757-21apt-get21:30:021
735799220,21cyclictest12872-21ssh23:42:371
735799220,21cyclictest12872-21ssh23:42:371
735799220,21cyclictest1103-21ssh22:35:031
735799220,21cyclictest0-21swapper/121:00:011
735799220,21cyclictest0-21swapper/120:15:011
735799220,1cyclictest537-21diskmemload23:11:571
735799220,1cyclictest4207-21idleruntime-cro20:10:011
735799220,1cyclictest4207-21idleruntime-cro20:10:011
735799220,1cyclictest28829-21ssh22:02:051
735799220,1cyclictest14530-21apt-get19:24:591
735799220,1cyclictest1366-21fschecks_time21:10:031
735799220,1cyclictest0-21swapper/123:35:101
7355992220,1cyclictest0-21swapper/023:50:050
7355992220,1cyclictest0-21swapper/022:00:160
735599220,21cyclictest6871-21sh22:11:000
735599220,21cyclictest684-21munin-run21:10:010
735599220,21cyclictest6184-21awk20:15:010
735599220,21cyclictest2646-21apt-get21:40:010
735599220,21cyclictest0-21swapper/021:30:020
735599220,21cyclictest0-21swapper/020:00:000
735599220,21cyclictest0-21swapper/019:45:000
735599220,1cyclictest28920-21apt-get19:54:570
735599220,1cyclictest26525-21apt-get19:49:580
735599220,1cyclictest21018-21turbostat20:45:000
7365992119,1cyclictest551-21awk21:10:013
736599210,1cyclictest0-21swapper/322:55:483
736599210,1cyclictest0-21swapper/319:35:013
736599210,0cyclictest0-21swapper/321:00:023
7360992121,0cyclictest0-21swapper/219:54:582
736099210,21cyclictest0-21swapper/223:10:462
736099210,1cyclictest30843-21apt-get21:05:022
7357992121,0cyclictest0-21swapper/120:50:001
7357992119,1cyclictest0-21swapper/119:30:011
735799210,1cyclictest6277-21ssh22:10:151
735799210,0cyclictest0-21swapper/120:00:001
7355992121,0cyclictest0-21swapper/020:35:000
7355992121,0cyclictest0-21swapper/019:39:590
7355992119,1cyclictest9754-21perf19:15:000
7355992118,2cyclictest4210-21awk20:10:010
7355992118,2cyclictest4210-21awk20:10:010
735599210,1cyclictest16959-21turbostat19:30:010
735599210,0cyclictest0-21swapper/019:19:590
7365992018,1cyclictest9766-21awk19:15:003
7365992018,1cyclictest13374-21perf20:30:003
736599200,1cyclictest16004-21munin-run20:35:003
736599200,0cyclictest0-21swapper/319:45:003
7360992019,1cyclictest11147-21latency_hist20:25:012
7360992018,1cyclictest15783-21apt-get20:35:002
7360992018,1cyclictest0-21swapper/219:20:002
736099200,19cyclictest0-21swapper/220:39:592
7355992020,0cyclictest0-21swapper/020:15:010
7365991919,0cyclictest0-21swapper/319:20:003
7360991917,1cyclictest0-21swapper/220:20:012
7357991917,1cyclictest8988-21munin-plugin-st20:20:011
7355991919,0cyclictest0-21swapper/020:50:000
7355991917,1cyclictest30589-21perf21:05:010
7355991917,1cyclictest18460-21cstates20:40:000
7360991816,1cyclictest0-21swapper/219:50:002
7357991817,0cyclictest0-21swapper/119:49:581
7365991717,0cyclictest0-21swapper/320:50:003
7357991717,0cyclictest7576-21apt-get19:10:011
7357991716,0cyclictest0-21swapper/120:40:001
735599170,16cyclictest13426-21latency_hist20:30:000
7365991612,3cyclictest11085-21cpu20:25:013
7360991614,1cyclictest15023-21perf19:25:012
735799160,15cyclictest18808-21unixbench_multi19:30:111
7360991515,0cyclictest0-21swapper/220:55:022
735799150,1cyclictest29104-21tr19:54:591
7355991515,0cyclictest0-21swapper/021:00:010
736599140,14cyclictest0-21swapper/320:51:573
736599140,14cyclictest0-21swapper/320:51:573
736599140,0cyclictest0-21swapper/320:15:203
736599140,0cyclictest0-21swapper/319:45:423
736099140,14cyclictest0-21swapper/221:00:292
736099140,14cyclictest0-21swapper/220:25:392
736099140,0cyclictest0-21swapper/220:51:312
736099140,0cyclictest0-21swapper/220:51:312
7357991414,0cyclictest0-21swapper/120:51:041
7357991414,0cyclictest0-21swapper/120:51:041
735799140,14cyclictest0-21swapper/120:25:191
735799140,0cyclictest0-21swapper/120:56:561
7355991414,0cyclictest0-21swapper/020:24:100
735599140,0cyclictest0-21swapper/020:51:100
735599140,0cyclictest0-21swapper/020:51:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional