You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 23:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed Sep 02, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24705992922,6cyclictest9428-21apt-get12:21:172
24705992823,5cyclictest11974-21ssh10:28:352
2470599270,0cyclictest0-21swapper/211:31:172
24705992622,3cyclictest18470-21diskmemload12:16:402
2469999260,25cyclictest18470-21diskmemload12:38:250
24705992522,3cyclictest18470-21diskmemload11:25:502
24705992522,3cyclictest0-21swapper/211:38:072
24705992521,3cyclictest0-21swapper/210:20:042
24705992520,4cyclictest3269-21ssh09:52:162
24705992520,4cyclictest32257-21ssh11:15:172
2470599250,1cyclictest28449-21ssh12:09:102
2470199250,24cyclictest18470-21diskmemload12:23:181
2470199250,1cyclictest0-21swapper/111:32:501
24699992523,1cyclictest0-21swapper/010:40:500
2469999250,24cyclictest28612-21latency_hist10:15:000
2469999250,24cyclictest0-21swapper/011:39:160
24709992422,1cyclictest0-21swapper/311:11:183
24709992422,1cyclictest0-21swapper/309:12:003
2470999240,23cyclictest18470-21diskmemload11:44:363
2470999240,23cyclictest18470-21diskmemload10:00:343
2470999240,23cyclictest18470-21diskmemload09:40:183
2470999240,23cyclictest0-21swapper/312:04:143
2470999240,23cyclictest0-21swapper/309:26:373
2470599240,23cyclictest7913-21ssh09:27:442
2470599240,23cyclictest0-21swapper/211:57:462
2470599240,23cyclictest0-21swapper/210:06:032
2470599240,21cyclictest10910-21sh09:59:292
2470599240,0cyclictest0-21swapper/212:30:482
2470599240,0cyclictest0-21swapper/211:24:402
24701992423,1cyclictest18470-21diskmemload12:12:111
24701992422,1cyclictest3746-21sh09:52:531
24701992422,1cyclictest18470-21diskmemload11:50:371
24701992422,1cyclictest0-21swapper/108:00:001
24701992421,2cyclictest10791-21ssh09:59:211
2470199240,2cyclictest30565-21sh09:47:551
2470199240,0cyclictest18470-21diskmemload10:39:351
24699992424,0cyclictest0-21swapper/009:43:330
24699992424,0cyclictest0-21swapper/009:23:560
2469999242,22cyclictest31060-21kworker/0:110:01:480
24699992422,1cyclictest18470-21diskmemload09:15:020
2469999240,24cyclictest0-21swapper/010:45:050
2469999240,24cyclictest0-21swapper/009:53:510
2469999240,23cyclictest3447-21sh11:17:530
2469999240,1cyclictest0-21swapper/012:16:220
24709992323,0cyclictest0-21swapper/311:45:033
24709992323,0cyclictest0-21swapper/310:32:083
24709992323,0cyclictest0-21swapper/310:15:573
24709992321,1cyclictest0-21swapper/310:07:353
24709992320,2cyclictest25636-21/usr/sbin/munin10:11:253
24709992320,2cyclictest21932-21ssh10:36:403
2470999230,2cyclictest25284-21taskset10:40:593
2470999230,23cyclictest6890-21apt-get09:56:173
2470999230,23cyclictest0-21swapper/312:22:093
2470999230,23cyclictest0-21swapper/311:30:573
2470999230,23cyclictest0-21swapper/311:20:133
2470999230,23cyclictest0-21swapper/309:37:453
2470999230,22cyclictest6152-21sh12:17:063
2470999230,22cyclictest32691-21timedrift10:46:253
2470999230,22cyclictest29842-21apt-get07:21:153
2470999230,22cyclictest20650-21sh12:31:063
2470999230,0cyclictest18470-21diskmemload10:26:293
2470999230,0cyclictest0-21swapper/312:06:023
24705992323,0cyclictest18470-21diskmemload10:42:172
24705992323,0cyclictest0-21swapper/212:12:182
24705992323,0cyclictest0-21swapper/210:55:012
24705992321,2cyclictest18987-21ssh09:10:202
24705992321,2cyclictest0-21swapper/212:00:092
24705992320,2cyclictest30972-21ssh11:13:482
24705992319,3cyclictest25122-21ssh09:43:082
24705992319,0cyclictest0-21swapper/210:50:042
24705992318,4cyclictest0-21swapper/210:01:292
2470599230,2cyclictest3893-21sh11:46:532
2470599230,23cyclictest0-21swapper/212:37:302
2470599230,23cyclictest0-21swapper/211:00:142
2470599230,23cyclictest0-21swapper/210:45:172
2470599230,23cyclictest0-21swapper/210:33:312
2470599230,23cyclictest0-21swapper/209:32:122
2470599230,0cyclictest27867-21ssh11:40:222
24701992323,0cyclictest18470-21diskmemload11:03:531
24701992323,0cyclictest18470-21diskmemload10:45:091
24701992323,0cyclictest18470-21diskmemload09:22:181
24701992323,0cyclictest0-21swapper/112:19:231
24701992323,0cyclictest0-21swapper/111:29:381
24701992323,0cyclictest0-21swapper/111:15:281
24701992323,0cyclictest0-21swapper/109:28:551
24701992321,1cyclictest221ksoftirqd/111:36:161
24701992321,1cyclictest17580-21sh12:27:191
24701992321,1cyclictest16924-21latency_hist10:05:011
24701992321,1cyclictest0-21swapper/112:36:561
24701992321,1cyclictest0-21swapper/112:31:311
24701992321,1cyclictest0-21swapper/109:41:131
24701992320,2cyclictest13634-21idleruntime-cro09:00:001
2470199230,2cyclictest28697-21ssh09:17:061
2470199230,23cyclictest18470-21diskmemload12:07:351
2470199230,23cyclictest0-21swapper/109:10:121
2470199230,22cyclictest28948-21rm10:15:091
2470199230,22cyclictest21271-21ssh11:05:401
2470199230,1cyclictest0-21swapper/110:10:431
2470199230,0cyclictest0-21swapper/111:46:021
24699992323,0cyclictest18470-21diskmemload11:41:490
24699992323,0cyclictest0-21swapper/010:51:030
24699992322,1cyclictest18470-21diskmemload09:25:250
24699992322,1cyclictest0-21swapper/011:55:480
24699992322,1cyclictest0-21swapper/011:31:570
24699992321,1cyclictest0-21swapper/012:20:470
24699992321,1cyclictest0-21swapper/012:06:540
24699992321,1cyclictest0-21swapper/011:00:480
24699992321,1cyclictest0-21swapper/010:28:560
24699992321,1cyclictest0-21swapper/009:58:150
24699992321,1cyclictest0-21swapper/009:31:050
24699992320,2cyclictest11241-21pmu-power10:56:240
24699992320,2cyclictest0-21swapper/009:11:420
2469999230,22cyclictest30111-21sh09:47:210
2469999230,22cyclictest13421-21awk11:26:270
2469999230,22cyclictest0-21swapper/012:13:050
2469999230,22cyclictest0-21swapper/011:46:370
2469999230,22cyclictest0-21swapper/010:05:010
2469999230,21cyclictest0-21swapper/012:00:160
2469999230,0cyclictest0-21swapper/010:36:050
2469999230,0cyclictest0-21swapper/010:16:430
2469999230,0cyclictest0-21swapper/009:35:350
24709992222,0cyclictest0-21swapper/311:35:093
24709992222,0cyclictest0-21swapper/309:46:163
24709992220,1cyclictest0-21swapper/312:26:343
24709992220,1cyclictest0-21swapper/311:00:123
24709992220,1cyclictest0-21swapper/310:50:133
2470999220,22cyclictest0-21swapper/311:25:183
2470999220,22cyclictest0-21swapper/309:51:523
2470999220,21cyclictest6836-21ssh11:50:423
2470999220,21cyclictest32239-21apt-get07:26:173
2470999220,21cyclictest31538-21ssh09:20:463
2470999220,21cyclictest24422-21sh08:15:003
2470999220,21cyclictest21213-21ssh11:05:353
2470999220,21cyclictest0-21swapper/310:21:273
2470999220,1cyclictest0-21swapper/311:16:233
2470999220,1cyclictest0-21swapper/310:56:193
2470999220,1cyclictest0-21swapper/309:32:563
24705992221,1cyclictest21463-21sh11:05:542
24705992220,2cyclictest0-21swapper/210:19:372
24705992219,3cyclictest0-21swapper/210:35:202
2470599220,22cyclictest0-21swapper/210:10:462
2470599220,22cyclictest0-21swapper/209:45:592
2470599220,21cyclictest441-21memory09:21:202
2470599220,21cyclictest29597-21apt-get08:26:162
2470599220,21cyclictest27424-21apt-get07:16:152
2470599220,21cyclictest18470-21diskmemload11:50:072
2470599220,21cyclictest0-21swapper/209:36:242
2470599220,21cyclictest0-21swapper/208:36:162
2470599220,21cyclictest0-21swapper/208:15:002
2470599220,0cyclictest0-21swapper/212:26:242
24701992222,0cyclictest0-21swapper/109:36:461
24701992220,1cyclictest10245-21ssh09:30:391
2470199220,21cyclictest31656-21awk08:30:011
2470199220,21cyclictest2247-21ssh10:20:121
2470199220,21cyclictest11967-21apt-get07:50:011
2470199220,21cyclictest0-21swapper/110:40:321
2470199220,21cyclictest0-21swapper/110:05:201
2470199220,21cyclictest0-21swapper/108:21:161
2470199220,1cyclictest6793-21apt-get08:46:161
2470199220,1cyclictest6108-21ssh11:21:111
2470199220,1cyclictest30618-21ssh11:13:221
2470199220,1cyclictest20110-21sh12:01:221
2470199220,1cyclictest13652-21ssh10:30:301
2470199220,1cyclictest0-21swapper/111:40:101
2470199220,1cyclictest0-21swapper/110:51:411
2470199220,0cyclictest0-21swapper/110:28:451
24699992222,0cyclictest0-21swapper/010:20:160
24699992221,0cyclictest0-21swapper/012:30:410
24699992220,1cyclictest31635-21awk08:30:010
24699992220,1cyclictest0-21swapper/012:26:000
24699992220,1cyclictest0-21swapper/011:20:090
24699992220,1cyclictest0-21swapper/011:10:050
2469999220,21cyclictest0-21swapper/011:50:320
2469999220,21cyclictest0-21swapper/011:06:160
2469999220,1cyclictest0-21swapper/010:30:060
24709992121,0cyclictest0-21swapper/312:35:073
24709992121,0cyclictest0-21swapper/307:16:153
2470999210,20cyclictest31999-21taskset08:31:183
2470999210,20cyclictest27204-21apt-get08:21:163
2470999210,20cyclictest12105-21ssh11:55:063
24705992117,4cyclictest0-21swapper/207:26:172
2470599210,21cyclictest0-21swapper/208:16:162
2470599210,20cyclictest0-21swapper/209:06:172
2470599210,0cyclictest9187-21apt-get08:51:162
2470599210,0cyclictest2222-21apt-get07:31:162
2470599210,0cyclictest0-21swapper/208:46:162
2470599210,0cyclictest0-21swapper/208:21:162
24701992121,0cyclictest0-21swapper/111:56:041
24701992121,0cyclictest0-21swapper/108:51:161
24701992120,0cyclictest0-21swapper/108:36:161
24701992120,0cyclictest0-21swapper/108:31:181
2470199210,21cyclictest22046-21perf08:10:001
2470199210,21cyclictest0-21swapper/110:55:101
2470199210,20cyclictest0-21swapper/107:21:151
2470199210,0cyclictest0-21swapper/107:11:161
2469999212,18cyclictest11465-21kworker/0:007:37:240
24699992121,0cyclictest0-21swapper/008:31:180
24699992119,1cyclictest1848-21cron07:30:000
24709992020,0cyclictest0-21swapper/308:56:163
24709992020,0cyclictest0-21swapper/308:41:183
24705992020,0cyclictest5017-21apt-get07:36:172
24705992020,0cyclictest0-21swapper/207:56:172
24705992019,1cyclictest31995-21apt-get08:31:182
2470599200,0cyclictest0-21swapper/207:41:162
24701992020,0cyclictest22384-21apt-get08:11:171
2470199200,0cyclictest0-21swapper/107:26:171
24699992020,0cyclictest0-21swapper/008:01:170
24699992020,0cyclictest0-21swapper/007:56:160
24699992020,0cyclictest0-21swapper/007:46:160
24699992018,1cyclictest1980-21apt-get08:36:160
2469999201,19cyclictest11465-21kworker/0:007:12:360
2469999200,0cyclictest0-21swapper/007:16:150
24705991919,0cyclictest0-21swapper/207:11:162
24701991919,0cyclictest4399-21apt-get08:41:181
24701991917,1cyclictest4266-21turbostat.cron07:35:011
24699991919,0cyclictest0-21swapper/008:06:160
24699991919,0cyclictest0-21swapper/007:41:160
24699991917,1cyclictest0-21swapper/007:50:010
24699991915,4cyclictest11465-21kworker/0:008:22:120
24709991818,0cyclictest4269-21apt-get07:35:023
24709991818,0cyclictest0-21swapper/308:51:163
24709991818,0cyclictest0-21swapper/308:26:163
24709991818,0cyclictest0-21swapper/308:16:163
24709991818,0cyclictest0-21swapper/308:06:163
24705991818,0cyclictest0-21swapper/209:01:172
24705991818,0cyclictest0-21swapper/207:46:172
24701991818,0cyclictest0-21swapper/109:06:171
24701991818,0cyclictest0-21swapper/108:16:161
24701991818,0cyclictest0-21swapper/107:16:161
24709991717,0cyclictest0-21swapper/307:11:153
24709991714,2cyclictest18488-21sh09:10:013
24701991717,0cyclictest9939-21apt-get07:46:161
24701991716,0cyclictest14003-21apt-get09:01:171
24699991717,0cyclictest0-21swapper/008:51:160
24699991714,2cyclictest4268-21awk07:35:010
2469999170,1cyclictest0-21swapper/008:41:170
24709991616,0cyclictest0-21swapper/308:36:163
24709991616,0cyclictest0-21swapper/307:46:163
24709991616,0cyclictest0-21swapper/307:31:163
24709991614,1cyclictest0-21swapper/307:55:003
24705991616,0cyclictest0-21swapper/208:56:162
2470599160,2cyclictest19269-21unixbench_singl08:01:262
2470599160,16cyclictest0-21swapper/207:52:292
24699991614,1cyclictest26862-21munin-run08:20:010
24699991614,1cyclictest24441-21munin-run08:15:000
24705991513,1cyclictest31562-21users07:21:262
24699991515,0cyclictest0-21swapper/007:21:150
24709991414,0cyclictest0-21swapper/309:00:403
24709991414,0cyclictest0-21swapper/308:46:163
24709991414,0cyclictest0-21swapper/308:01:173
2470999140,14cyclictest0-21swapper/307:55:403
2470999140,0cyclictest0-21swapper/307:40:013
24705991414,0cyclictest0-21swapper/208:43:362
2470599140,14cyclictest0-21swapper/208:05:062
2470199140,14cyclictest0-21swapper/107:40:451
2470199140,0cyclictest0-21swapper/107:36:551
24699991414,0cyclictest0-21swapper/008:55:050
2469999140,14cyclictest0-21swapper/009:05:150
2469999140,14cyclictest0-21swapper/009:00:010
2469999140,0cyclictest0-21swapper/008:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional