You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 17:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri May 08, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3121399280,27cyclictest0-21swapper/110:33:401
3121299270,26cyclictest20083-21sh12:25:100
3121399260,25cyclictest4668-21sh11:41:541
3121399260,25cyclictest0-21swapper/111:24:061
3121399260,22cyclictest30369-21ssh12:33:581
3121399260,21cyclictest1106-21perf10:15:011
3121399260,21cyclictest1106-21perf10:15:011
3121399260,1cyclictest5705-21ssh09:50:211
3121599250,24cyclictest8406-21basename07:30:003
3121599250,24cyclictest0-21swapper/307:55:013
31214992523,0cyclictest0-21swapper/209:33:122
31214992520,2cyclictest0-21swapper/212:16:552
3121499250,24cyclictest0-21swapper/212:14:182
31213992520,4cyclictest923-21apt-get09:46:351
31213992520,4cyclictest18213-21ssh09:31:541
3121399250,24cyclictest24507-21diskmemload11:03:051
3121399250,24cyclictest0-21swapper/109:21:091
3121399250,21cyclictest2745-21ssh10:16:251
3121399250,0cyclictest0-21swapper/111:38:071
3121399250,0cyclictest0-21swapper/110:41:311
3121399250,0cyclictest0-21swapper/108:41:361
31212992523,1cyclictest0-21swapper/009:13:240
31212992521,3cyclictest4354-21awk12:40:010
3121299250,2cyclictest15713-21ssh10:56:060
3121299250,1cyclictest25495-21sh10:36:050
31215992423,1cyclictest0-21swapper/309:22:333
31215992422,1cyclictest2576-21sh12:37:353
3121599240,24cyclictest0-21swapper/310:34:023
3121599240,23cyclictest24530-21diskmemload11:17:043
31214992423,1cyclictest24530-21diskmemload12:04:432
31214992422,1cyclictest20504-21perf07:55:012
31214992419,2cyclictest0-21swapper/209:45:592
3121499240,24cyclictest0-21swapper/210:08:012
3121499240,23cyclictest19016-21ssh12:24:082
3121499240,23cyclictest16392-21ssh11:24:462
3121499240,23cyclictest0-21swapper/212:26:062
3121499240,1cyclictest0-21swapper/211:33:572
3121499240,0cyclictest0-21swapper/212:07:372
3121499240,0cyclictest0-21swapper/210:38:412
31213992423,1cyclictest24530-21diskmemload09:27:591
31213992423,1cyclictest0-21swapper/112:15:091
31213992422,1cyclictest0-21swapper/110:27:061
31213992421,3cyclictest0-21swapper/112:23:141
31213992420,3cyclictest25232-21ssh09:10:451
31213992420,3cyclictest24530-21diskmemload12:10:151
31213992420,3cyclictest0-21swapper/109:41:031
31213992418,5cyclictest0-21swapper/110:56:361
3121399240,23cyclictest24530-21diskmemload11:33:251
3121399240,23cyclictest0-21swapper/112:38:351
3121399240,23cyclictest0-21swapper/110:20:571
3121399240,21cyclictest24530-21diskmemload09:57:581
3121399240,0cyclictest24530-21diskmemload11:12:011
3121399240,0cyclictest24530-21diskmemload11:08:431
3121399240,0cyclictest0-21swapper/111:16:361
31212992424,0cyclictest0-21swapper/010:12:340
31212992424,0cyclictest0-21swapper/010:12:340
31212992422,1cyclictest23311-21ssh11:59:160
31212992422,1cyclictest11592-21sh10:23:250
31212992421,2cyclictest9111-21sh11:17:340
3121299241,22cyclictest1156-21ssh10:41:520
3121299240,23cyclictest2557-21ssh10:16:110
3121299240,23cyclictest24530-21diskmemload12:12:590
3121299240,23cyclictest24530-21diskmemload12:00:590
3121299240,23cyclictest22061-21ssh10:04:540
3121299240,23cyclictest0-21swapper/011:49:560
3121299240,23cyclictest0-21swapper/011:49:560
3121299240,23cyclictest0-21swapper/010:47:410
3121299240,23cyclictest0-21swapper/010:05:310
3121299240,23cyclictest0-21swapper/009:48:090
3121299240,0cyclictest24530-21diskmemload10:30:100
31215992323,0cyclictest24530-21diskmemload10:45:083
31215992323,0cyclictest0-21swapper/310:22:513
31215992322,1cyclictest29910-21diskmemload09:42:203
31215992322,1cyclictest0-21swapper/310:41:053
31215992321,1cyclictest30507-21sh11:08:293
31215992321,1cyclictest0-21swapper/312:10:553
31215992321,1cyclictest0-21swapper/311:55:303
31215992321,1cyclictest0-21swapper/309:50:553
31215992321,1cyclictest0-21swapper/309:46:153
3121599230,2cyclictest4798-21rm10:16:483
3121599230,23cyclictest0-21swapper/312:02:323
3121599230,23cyclictest0-21swapper/311:48:503
3121599230,23cyclictest0-21swapper/311:48:503
3121599230,23cyclictest0-21swapper/311:30:313
3121599230,23cyclictest0-21swapper/310:03:593
3121599230,22cyclictest0-21swapper/311:11:363
3121599230,22cyclictest0-21swapper/309:38:413
3121599230,22cyclictest0-21swapper/309:27:043
3121599230,1cyclictest30135-21ssh12:05:273
3121599230,1cyclictest0-21swapper/310:51:393
3121599230,0cyclictest0-21swapper/311:54:213
3121599230,0cyclictest0-21swapper/311:36:203
3121599230,0cyclictest0-21swapper/311:04:503
31214992321,1cyclictest8400-21perf07:30:002
31214992321,1cyclictest0-21swapper/212:35:352
31214992321,1cyclictest0-21swapper/211:46:482
31214992321,1cyclictest0-21swapper/211:46:482
31214992321,1cyclictest0-21swapper/211:36:312
31214992321,1cyclictest0-21swapper/211:25:092
31214992321,1cyclictest0-21swapper/210:15:022
31214992321,1cyclictest0-21swapper/209:11:062
31214992318,2cyclictest0-21swapper/212:34:582
3121499230,2cyclictest1165-21cron07:15:012
3121499230,23cyclictest24530-21diskmemload10:25:542
3121499230,23cyclictest0-21swapper/210:50:382
3121499230,22cyclictest3107-21ssh11:12:032
3121499230,22cyclictest24530-21diskmemload11:18:392
3121499230,22cyclictest24530-21diskmemload09:42:082
3121499230,22cyclictest24530-21diskmemload09:25:142
3121499230,22cyclictest19114-21sh10:30:362
3121499230,21cyclictest2837-21ssh10:44:142
3121499230,1cyclictest0-21swapper/209:20:042
3121499230,0cyclictest0-21swapper/210:48:002
3121499230,0cyclictest0-21swapper/210:21:082
3121499230,0cyclictest0-21swapper/210:00:562
3121499230,0cyclictest0-21swapper/209:56:592
31213992323,0cyclictest24530-21diskmemload10:52:561
31213992323,0cyclictest0-21swapper/109:17:491
31213992323,0cyclictest0-21swapper/107:51:351
31213992321,2cyclictest0-21swapper/112:29:011
31213992321,2cyclictest0-21swapper/111:45:021
31213992321,2cyclictest0-21swapper/111:45:021
31213992320,3cyclictest0-21swapper/112:05:521
31213992320,3cyclictest0-21swapper/111:29:151
31213992320,2cyclictest26403-21sh10:08:041
31213992320,2cyclictest0-21swapper/108:36:361
31213992318,4cyclictest18584-21ssh11:55:151
3121399230,23cyclictest0-21swapper/112:01:341
3121399230,22cyclictest8249-21sh10:48:551
3121399230,22cyclictest24420-21ssh09:37:381
3121399230,20cyclictest0-21swapper/111:50:171
3121399230,0cyclictest0-21swapper/110:04:301
31212992323,0cyclictest24530-21diskmemload12:33:000
31212992323,0cyclictest0-21swapper/011:35:260
3121299232,21cyclictest62550irq/127-eno109:35:100
31212992322,1cyclictest24530-21diskmemload10:50:280
31212992322,1cyclictest0-21swapper/011:27:440
31212992321,1cyclictest16204-21rm09:31:270
31212992320,2cyclictest31950-21awk09:45:010
31212992320,2cyclictest26438-21ssh11:05:210
3121299230,2cyclictest4634-21rm09:21:140
3121299230,23cyclictest0-21swapper/012:05:220
3121299230,23cyclictest0-21swapper/011:30:460
3121299230,23cyclictest0-21swapper/009:50:070
3121299230,22cyclictest24530-21diskmemload09:16:420
3121299230,22cyclictest1957-21ssh11:40:420
3121299230,22cyclictest18108-21latency_hist07:50:010
3121299230,22cyclictest16308-21ssh11:52:230
3121299230,22cyclictest14959-21latency_hist08:50:010
3121299230,22cyclictest0-21swapper/010:26:130
3121299230,22cyclictest0-21swapper/009:27:200
3121299230,1cyclictest15555-21ssh09:58:470
3121299230,0cyclictest0-21swapper/011:24:500
3121299230,0cyclictest0-21swapper/011:03:090
31215992222,0cyclictest0-21swapper/310:05:383
31215992220,1cyclictest3616-21awk07:20:013
31215992220,1cyclictest22886-21idleruntime-cro08:00:013
31215992220,1cyclictest20141-21apt-get09:01:363
31215992220,1cyclictest0-21swapper/312:16:113
31215992220,1cyclictest0-21swapper/311:21:383
31215992220,1cyclictest0-21swapper/310:35:023
3121599220,22cyclictest29566-21ssh12:32:573
3121599220,21cyclictest30645-21ssh09:15:163
3121599220,21cyclictest20304-21ssh12:25:263
3121599220,21cyclictest0-21swapper/312:20:583
3121599220,21cyclictest0-21swapper/311:40:443
3121599220,21cyclictest0-21swapper/309:55:193
3121599220,21cyclictest0-21swapper/309:10:333
3121599220,1cyclictest0-21swapper/311:25:263
3121599220,1cyclictest0-21swapper/310:10:143
3121599220,1cyclictest0-21swapper/310:10:143
3121599220,1cyclictest0-21swapper/308:21:363
3121599220,0cyclictest24530-21diskmemload10:57:243
31214992222,0cyclictest10542-21apt-get08:41:362
31214992220,1cyclictest0-21swapper/210:10:482
31214992220,1cyclictest0-21swapper/210:10:482
31214992220,1cyclictest0-21swapper/209:50:072
3121499220,22cyclictest24530-21diskmemload09:16:232
3121499220,22cyclictest0-21swapper/211:05:112
3121499220,21cyclictest18479-21ssh11:55:072
3121499220,21cyclictest0-21swapper/211:41:392
3121499220,21cyclictest0-21swapper/210:56:382
3121499220,21cyclictest0-21swapper/209:36:182
3121499220,21cyclictest0-21swapper/208:36:362
3121499220,21cyclictest0-21swapper/207:25:002
31213992221,1cyclictest0-21swapper/107:46:341
3121399220,21cyclictest24530-21diskmemload10:36:061
3121399220,1cyclictest0-21swapper/108:30:001
31212992222,0cyclictest24530-21diskmemload12:21:430
31212992222,0cyclictest0-21swapper/012:16:130
31212992222,0cyclictest0-21swapper/011:11:010
31212992220,1cyclictest0-21swapper/009:00:000
3121299220,21cyclictest22152-21basename09:05:000
3121299220,21cyclictest0-21swapper/008:06:360
31215992121,0cyclictest0-21swapper/308:36:353
31215992120,1cyclictest12933-21apt-get08:46:353
31215992119,1cyclictest0-21swapper/308:06:363
3121599210,20cyclictest0-21swapper/308:26:353
3121599210,20cyclictest0-21swapper/307:41:353
3121599210,20cyclictest0-21swapper/307:31:353
3121599210,1cyclictest0-21swapper/310:25:063
3121599210,1cyclictest0-21swapper/308:01:363
3121599210,0cyclictest0-21swapper/309:06:363
31214992121,0cyclictest0-21swapper/208:46:352
31214992121,0cyclictest0-21swapper/208:01:362
31214992120,1cyclictest921-21apt-get08:21:362
3121499210,1cyclictest22171-21munin-run09:05:002
31213992120,0cyclictest3978-21apt-get07:21:361
3121399210,21cyclictest0-21swapper/107:36:361
3121399210,20cyclictest0-21swapper/108:56:341
3121399210,0cyclictest25681-21apt-get08:06:361
3121399210,0cyclictest0-21swapper/108:51:351
3121399210,0cyclictest0-21swapper/108:46:351
31212992120,1cyclictest8771-21apt-get07:31:350
31212992120,1cyclictest10542-21apt-get08:41:360
31212992120,0cyclictest0-21swapper/007:36:350
31212992120,0cyclictest0-21swapper/007:16:350
31212992119,1cyclictest313-21systemd-journal07:30:000
31212992119,1cyclictest17347-21grep08:55:010
3121299210,20cyclictest25276-21cron08:05:010
3121299210,20cyclictest0-21swapper/008:31:360
3121299210,0cyclictest921-21apt-get08:21:350
3121299210,0cyclictest0-21swapper/007:11:350
31215992020,0cyclictest0-21swapper/308:41:363
31215992018,1cyclictest13317-21munin-run07:40:003
31214992020,0cyclictest0-21swapper/209:06:362
31214992020,0cyclictest0-21swapper/208:51:362
31214992020,0cyclictest0-21swapper/207:56:342
31214992019,0cyclictest0-21swapper/207:41:352
3121499200,20cyclictest0-21swapper/208:16:362
31213992020,0cyclictest0-21swapper/107:56:341
3121399200,20cyclictest0-21swapper/108:16:361
3121399200,20cyclictest0-21swapper/108:11:361
31212992020,0cyclictest0-21swapper/007:56:340
31215991918,1cyclictest0-21swapper/307:21:363
31214991919,0cyclictest0-21swapper/208:10:022
31214991917,1cyclictest1649-21cron07:35:002
31212991919,0cyclictest0-21swapper/008:36:360
31215991817,1cyclictest0-21swapper/308:11:363
31214991818,0cyclictest17722-21apt-get08:56:342
31214991818,0cyclictest0-21swapper/207:16:352
31214991817,0cyclictest3327-21apt-get08:26:352
31214991816,1cyclictest11271-21apt-get07:36:352
3121299180,17cyclictest0-21swapper/008:10:010
31215991717,0cyclictest0-21swapper/308:16:353
31215991716,0cyclictest15328-21apt-get08:51:363
31213991717,0cyclictest0-21swapper/109:01:361
31213991717,0cyclictest0-21swapper/107:26:361
31213991717,0cyclictest0-21swapper/107:16:351
31213991714,2cyclictest10840-21latency_hist07:35:001
31213991712,4cyclictest5725-21apt-get08:31:361
3121399170,1cyclictest0-21swapper/108:21:361
31215991616,0cyclictest0-21swapper/308:56:353
31215991616,0cyclictest0-21swapper/308:31:363
3121399160,14cyclictest0-21swapper/108:02:131
31215991514,1cyclictest31575-21apt-get07:11:353
31214991515,0cyclictest0-21swapper/208:06:362
31213991512,3cyclictest0-21swapper/107:11:351
31212991515,0cyclictest0-21swapper/007:41:350
31212991513,1cyclictest24254-21users09:06:460
3121599140,14cyclictest0-21swapper/307:45:143
3121499140,14cyclictest0-21swapper/208:31:082
3121499140,0cyclictest0-21swapper/207:46:112
31213991414,0cyclictest0-21swapper/107:40:011
31212991414,0cyclictest0-21swapper/008:15:040
3121299140,0cyclictest0-21swapper/008:25:490
3121299140,0cyclictest0-21swapper/007:50:070
3121299140,0cyclictest0-21swapper/007:20:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional