You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 22:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Tue Sep 01, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2593999260,25cyclictest0-21swapper/309:30:573
25935992519,4cyclictest26482-21packagekitd09:15:012
2593599250,24cyclictest21165-21ssh10:07:012
2593599250,24cyclictest0-21swapper/209:48:412
2593199250,24cyclictest0-21swapper/112:19:391
2593199250,24cyclictest0-21swapper/110:00:421
2592899250,24cyclictest19747-21diskmemload12:35:580
2592899250,24cyclictest16468-21taskset11:30:100
25939992423,1cyclictest26262-21apt-get07:11:123
2593999240,23cyclictest29685-21ssh12:11:133
2593999240,23cyclictest19747-21diskmemload11:16:533
25935992423,1cyclictest19747-21diskmemload12:30:422
25935992420,1cyclictest0-21swapper/210:19:092
25935992420,0cyclictest0-21swapper/209:42:432
2593599240,24cyclictest0-21swapper/210:47:572
2593599240,24cyclictest0-21swapper/210:37:332
2593599240,23cyclictest19747-21diskmemload11:05:072
2593599240,23cyclictest0-21swapper/211:55:242
2593599240,23cyclictest0-21swapper/211:43:372
2593599240,23cyclictest0-21swapper/209:35:312
25931992422,1cyclictest0-21swapper/112:04:451
2593199241,1cyclictest0-21swapper/109:35:001
2593199240,24cyclictest0-21swapper/111:54:181
2593199240,24cyclictest0-21swapper/109:11:291
2593199240,23cyclictest19747-21diskmemload11:34:041
2593199240,23cyclictest19657-21diskmemload09:37:051
2593199240,1cyclictest0-21swapper/111:43:531
2593199240,0cyclictest0-21swapper/112:27:451
25928992422,1cyclictest28462-21sh10:42:000
2592899242,21cyclictest28171-21latency_hist08:20:010
2592899242,21cyclictest27699-21sh11:40:010
25928992422,1cyclictest0-21swapper/009:16:030
2592899240,24cyclictest19747-21diskmemload11:17:530
25939992323,0cyclictest0-21swapper/311:56:123
25939992323,0cyclictest0-21swapper/309:21:173
25939992322,1cyclictest19747-21diskmemload09:13:463
25939992321,1cyclictest522-21munin-run08:30:013
25939992321,1cyclictest0-21swapper/309:00:003
2593999230,2cyclictest22508-21sh11:35:383
2593999230,23cyclictest0-21swapper/312:17:203
2593999230,23cyclictest0-21swapper/310:51:123
2593999230,23cyclictest0-21swapper/309:51:583
2593999230,23cyclictest0-21swapper/309:26:133
2593999230,22cyclictest9724-21ssh11:23:533
2593999230,22cyclictest31336-21rm11:42:423
2593999230,22cyclictest27647-21ssh12:08:513
2593999230,22cyclictest23736-21ssh11:06:363
2593999230,22cyclictest19747-21diskmemload12:25:263
2593999230,22cyclictest19747-21diskmemload10:37:043
2593999230,22cyclictest1139-21idleruntime-cro07:25:003
2593999230,0cyclictest10524-21apt-get10:56:123
2593999230,0cyclictest0-21swapper/311:32:103
2593999230,0cyclictest0-21swapper/310:30:393
2593999230,0cyclictest0-21swapper/310:07:283
2593999230,0cyclictest0-21swapper/309:56:373
25935992323,0cyclictest0-21swapper/212:22:062
25935992323,0cyclictest0-21swapper/210:40:032
25935992323,0cyclictest0-21swapper/210:14:052
25935992321,1cyclictest0-21swapper/211:22:272
25935992321,1cyclictest0-21swapper/211:16:132
25935992321,1cyclictest0-21swapper/210:24:022
25935992320,0cyclictest0-21swapper/209:13:442
2593599230,2cyclictest28371-21awk07:15:002
2593599230,23cyclictest0-21swapper/212:26:102
2593599230,23cyclictest0-21swapper/211:48:532
2593599230,22cyclictest17746-21ssh12:00:162
2593599230,22cyclictest14336-21ssh10:59:052
2593599230,22cyclictest1-21systemd09:30:002
2593599230,22cyclictest0-21swapper/211:53:402
2593599230,0cyclictest19747-21diskmemload11:25:152
2593599230,0cyclictest0-21swapper/212:07:122
2593599230,0cyclictest0-21swapper/211:14:522
2593599230,0cyclictest0-21swapper/208:15:022
25931992323,0cyclictest0-21swapper/112:32:151
25931992323,0cyclictest0-21swapper/112:14:361
25931992323,0cyclictest0-21swapper/110:08:041
25931992323,0cyclictest0-21swapper/109:50:171
25931992323,0cyclictest0-21swapper/109:23:061
25931992322,1cyclictest0-21swapper/111:02:031
25931992321,1cyclictest0-21swapper/112:06:361
25931992321,1cyclictest0-21swapper/110:50:031
25931992321,1cyclictest0-21swapper/110:37:331
25931992321,1cyclictest0-21swapper/110:21:121
25931992321,1cyclictest0-21swapper/109:15:031
2593199230,23cyclictest0-21swapper/112:36:451
2593199230,23cyclictest0-21swapper/111:09:251
2593199230,22cyclictest9055-21sh11:22:531
2593199230,22cyclictest31755-21munin-run11:15:001
2593199230,22cyclictest15554-21sh11:57:301
2593199230,22cyclictest11907-21sh10:28:031
2593199230,22cyclictest0-21swapper/111:19:331
2593199230,22cyclictest0-21swapper/109:56:421
2593199230,0cyclictest0-21swapper/110:32:591
2593199230,0cyclictest0-21swapper/110:16:491
2593199230,0cyclictest0-21swapper/110:11:121
2593199230,0cyclictest0-21swapper/109:25:561
25928992323,0cyclictest0-21swapper/012:27:090
25928992323,0cyclictest0-21swapper/011:20:550
25928992323,0cyclictest0-21swapper/010:57:250
25928992323,0cyclictest0-21swapper/009:29:140
25928992322,1cyclictest62550irq/127-eno109:36:160
25928992322,1cyclictest32423-21ssh09:49:030
25928992322,1cyclictest17720-21apt-get09:06:100
25928992322,1cyclictest16559-21ssh10:03:210
25928992321,1cyclictest14986-21wc10:31:130
25928992321,1cyclictest0-21swapper/011:05:510
25928992321,1cyclictest0-21swapper/010:51:110
25928992320,2cyclictest4464-21nvmesmart_nvme010:21:180
25928992320,2cyclictest22870-21sh08:10:000
2592899230,23cyclictest19747-21diskmemload12:12:170
2592899230,23cyclictest18186-21ssh10:05:160
2592899230,23cyclictest0-21swapper/011:59:520
2592899230,23cyclictest0-21swapper/011:52:110
2592899230,22cyclictest9680-21ssh09:56:300
2592899230,22cyclictest24730-21ssh11:36:260
2592899230,22cyclictest0-21swapper/009:53:430
2592899230,0cyclictest19747-21diskmemload10:46:350
2592899230,0cyclictest0-21swapper/012:17:430
2592899230,0cyclictest0-21swapper/011:25:030
25939992222,0cyclictest0-21swapper/312:00:493
25939992222,0cyclictest0-21swapper/311:50:383
25939992222,0cyclictest0-21swapper/311:04:203
25939992222,0cyclictest0-21swapper/310:47:573
25939992222,0cyclictest0-21swapper/310:40:443
25939992222,0cyclictest0-21swapper/309:46:293
25939992221,1cyclictest0-21swapper/310:01:443
25939992221,0cyclictest0-21swapper/307:56:123
25939992220,1cyclictest22261-21taskset12:32:363
2593999220,22cyclictest20819-21apt-get08:06:123
2593999220,21cyclictest22417-21ssh09:40:283
2593999220,21cyclictest19772-21latency_hist09:10:013
2593999220,21cyclictest19747-21diskmemload12:35:453
2593999220,21cyclictest0-21swapper/310:15:023
2593999220,1cyclictest7542-21ssh12:20:023
2593999220,1cyclictest27306-21sh10:12:463
2593999220,0cyclictest19747-21diskmemload09:38:443
2593999220,0cyclictest0-21swapper/311:10:553
2593999220,0cyclictest0-21swapper/310:25:443
2593999220,0cyclictest0-21swapper/310:20:333
2593999220,0cyclictest0-21swapper/309:17:343
25935992222,0cyclictest19747-21diskmemload12:15:532
25935992221,0cyclictest0-21swapper/210:00:312
25935992220,1cyclictest25193-21rm11:37:012
25935992220,1cyclictest0-21swapper/211:31:002
25935992220,1cyclictest0-21swapper/210:26:102
2593599220,22cyclictest0-21swapper/209:52:222
2593599220,21cyclictest0-21swapper/212:35:062
2593599220,21cyclictest0-21swapper/212:11:192
2593599220,21cyclictest0-21swapper/210:30:092
2593599220,21cyclictest0-21swapper/209:56:332
2593599220,21cyclictest0-21swapper/209:30:232
2593599220,21cyclictest0-21swapper/207:46:112
2593599220,1cyclictest0-21swapper/211:01:102
2593599220,1cyclictest0-21swapper/209:21:322
25931992222,0cyclictest0-21swapper/110:40:051
25931992221,0cyclictest0-21swapper/108:15:021
25931992220,1cyclictest28374-21grep07:15:001
2593199220,21cyclictest19747-21diskmemload12:20:111
2593199220,21cyclictest15675-21munin-run07:55:001
2593199220,21cyclictest0-21swapper/109:48:491
2593199220,21cyclictest0-21swapper/108:21:131
2593199220,21cyclictest0-21swapper/107:41:121
2593199220,1cyclictest19747-21diskmemload10:56:141
2593199220,1cyclictest0-21swapper/111:45:481
2593199220,1cyclictest0-21swapper/111:25:181
2593199220,1cyclictest0-21swapper/110:46:061
2593199220,1cyclictest0-21swapper/109:42:001
25928992222,0cyclictest19747-21diskmemload12:01:480
25928992222,0cyclictest19747-21diskmemload10:10:490
25928992221,1cyclictest3904-21apt-get07:31:110
25928992221,1cyclictest13684-21ssh09:31:240
25928992220,1cyclictest606-21dbus-daemon07:15:000
25928992220,1cyclictest19669-21ssh10:35:030
25928992220,1cyclictest0-21swapper/009:23:170
2592899220,22cyclictest28423-21ssh11:11:190
2592899220,22cyclictest23238-21ssh12:33:560
2592899220,22cyclictest20525-21rm11:04:570
2592899220,22cyclictest0-21swapper/012:20:110
2592899220,21cyclictest23223-21ssh12:05:100
2592899220,21cyclictest0-21swapper/009:41:180
2592899220,1cyclictest19747-21diskmemload10:19:310
2592899220,0cyclictest8284-21ssh10:25:240
2593999210,1cyclictest10844-21sh11:25:063
25935992121,0cyclictest0-21swapper/208:26:122
25935992121,0cyclictest0-21swapper/207:16:112
25935992120,1cyclictest0-21swapper/208:21:132
2593599210,0cyclictest0-21swapper/208:36:122
25931992120,1cyclictest0-21swapper/109:06:101
2593199210,0cyclictest0-21swapper/108:11:111
2593199210,0cyclictest0-21swapper/108:01:101
25928992121,0cyclictest0-21swapper/007:36:120
25928992120,1cyclictest17379-21awk09:05:000
25928992118,2cyclictest20481-21munin-plugin-st08:05:000
2592899211,16cyclictest0-21swapper/008:11:110
2592899210,20cyclictest3308-21apt-get08:36:120
2592899210,20cyclictest0-21swapper/007:26:130
2592899210,20cyclictest0-21swapper/007:26:130
25939992020,0cyclictest28357-21apt-get07:15:023
25939992019,1cyclictest0-21swapper/308:36:123
2593999200,20cyclictest0-21swapper/308:16:113
2593999200,0cyclictest0-21swapper/308:31:123
25935992019,0cyclictest8118-21apt-get08:46:122
2593599200,0cyclictest16009-21apt-get07:56:112
2593599200,0cyclictest0-21swapper/207:21:122
25931992020,0cyclictest0-21swapper/107:46:111
2593199200,0cyclictest0-21swapper/107:36:121
2593199200,0cyclictest0-21swapper/107:31:111
2593199200,0cyclictest0-21swapper/107:26:131
2593199200,0cyclictest0-21swapper/107:26:131
2592899200,0cyclictest2966-21perf08:35:000
25939991919,0cyclictest0-21swapper/308:46:123
25939991919,0cyclictest0-21swapper/307:46:113
2593999190,18cyclictest8823-21apt-get07:41:123
25935991919,0cyclictest0-21swapper/208:31:112
25935991918,0cyclictest13613-21apt-get07:51:122
25935991917,1cyclictest6301-21apt-get07:36:122
25931991919,0cyclictest0-21swapper/108:36:121
25931991918,0cyclictest0-21swapper/107:21:121
2593199190,1cyclictest517-21apt08:30:011
25939991818,0cyclictest28536-21apt-get08:21:133
25939991818,0cyclictest0-21swapper/308:51:103
25939991818,0cyclictest0-21swapper/308:41:133
25939991818,0cyclictest0-21swapper/308:01:093
25939991818,0cyclictest0-21swapper/307:26:123
25939991818,0cyclictest0-21swapper/307:26:123
25935991818,0cyclictest0-21swapper/208:56:122
25935991818,0cyclictest0-21swapper/208:06:112
25935991817,0cyclictest0-21swapper/207:31:112
2593599180,0cyclictest0-21swapper/209:01:122
25931991818,0cyclictest0-21swapper/107:56:111
2593199180,0cyclictest0-21swapper/108:06:111
25928991818,0cyclictest0-21swapper/007:51:120
25939991717,0cyclictest0-21swapper/307:51:123
25935991717,0cyclictest1498-21apt-get07:26:132
25935991717,0cyclictest1498-21apt-get07:26:132
25935991716,0cyclictest17720-21apt-get09:06:102
25931991717,0cyclictest0-21swapper/107:16:111
25931991715,1cyclictest902-21apt-get08:31:121
25928991717,0cyclictest0-21swapper/007:16:100
2593599160,15cyclictest0-21swapper/208:05:002
2593599160,11cyclictest0-21swapper/208:51:102
25931991616,0cyclictest0-21swapper/109:01:121
25931991614,1cyclictest12910-21apt-get08:56:121
25928991615,1cyclictest10512-21apt-get08:51:110
2592899160,1cyclictest18222-21munin-run08:00:000
2592899160,15cyclictest496-21cron08:30:010
2593999150,1cyclictest16584-21ps09:01:193
25931991515,0cyclictest0-21swapper/108:46:121
2593999140,14cyclictest0-21swapper/308:10:093
2593999140,14cyclictest0-21swapper/307:36:003
2593999140,14cyclictest0-21swapper/307:31:103
25935991414,0cyclictest0-21swapper/208:10:132
25935991414,0cyclictest0-21swapper/207:40:192
2593599140,0cyclictest0-21swapper/208:40:242
25931991414,0cyclictest0-21swapper/108:50:141
25928991414,0cyclictest0-21swapper/007:45:520
25928991414,0cyclictest0-21swapper/007:40:560
25928991414,0cyclictest0-21swapper/007:20:010
2592899140,14cyclictest0-21swapper/008:55:500
2592899140,14cyclictest0-21swapper/008:20:520
2592899140,0cyclictest0-21swapper/008:45:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional