You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 22:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Aug 11, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12752992820,7cyclictest12479-21ssh09:15:011
12752992820,1cyclictest0-21swapper/109:59:301
1275299280,27cyclictest6120-21diskmemload10:36:231
1275299270,26cyclictest28342-21rm12:21:221
1275299270,26cyclictest21719-21apt-get11:19:291
1275299270,22cyclictest20119-21ssh10:49:011
1275299270,21cyclictest8368-21latency_hist11:35:001
1275499260,25cyclictest5233-21ssh11:04:303
1275399260,2cyclictest313-21systemd-journal11:35:002
12752992621,4cyclictest0-21swapper/111:35:371
12752992620,0cyclictest0-21swapper/108:59:281
1275299260,0cyclictest6120-21diskmemload12:00:541
12751992624,1cyclictest0-21swapper/010:04:310
1275499250,24cyclictest6120-21diskmemload12:17:143
1275499250,24cyclictest25289-21/usr/sbin/munin11:49:393
1275499250,24cyclictest0-21swapper/310:55:413
1275399250,24cyclictest6120-21diskmemload11:17:582
1275399250,1cyclictest15571-21ssh11:13:412
12752992522,2cyclictest12775-21ssh12:08:221
12752992521,0cyclictest0-21swapper/111:22:501
12752992521,0cyclictest0-21swapper/109:55:001
12752992520,4cyclictest14188-21sh12:38:181
12752992520,0cyclictest0-21swapper/109:39:231
1275299250,24cyclictest6120-21diskmemload11:14:571
1275299250,24cyclictest0-21swapper/111:47:141
1275299250,24cyclictest0-21swapper/111:07:151
1275299250,21cyclictest6482-21ssh10:08:461
1275299250,21cyclictest0-21swapper/110:30:081
1275299250,20cyclictest484-21ssh11:29:261
1275299250,0cyclictest0-21swapper/110:44:281
1275299250,0cyclictest0-21swapper/110:28:371
1275299250,0cyclictest0-21swapper/110:19:411
12751992523,1cyclictest567-21apt-get11:29:290
1275199250,24cyclictest25200-21ssh11:21:260
1275199250,1cyclictest6120-21diskmemload12:33:360
12754992422,1cyclictest6120-21diskmemload10:15:143
12754992422,1cyclictest0-21swapper/310:45:003
1275499241,22cyclictest606-21dbus-daemon10:55:003
1275499240,2cyclictest901-21ssh12:25:353
1275499240,24cyclictest0-21swapper/312:32:533
1275499240,23cyclictest6120-21diskmemload10:35:383
1275499240,23cyclictest6120-21diskmemload09:11:273
1275499240,23cyclictest5275-21sh12:00:453
1275499240,0cyclictest6120-21diskmemload10:23:303
12753992422,1cyclictest6120-21diskmemload11:04:292
12753992422,1cyclictest481-21ssh12:25:062
12753992422,1cyclictest168312chrt10:44:542
1275399240,23cyclictest6120-21diskmemload12:37:062
1275399240,23cyclictest6120-21diskmemload09:55:132
1275399240,23cyclictest20384-21apt-get10:49:292
1275399240,23cyclictest12334-21ssh10:13:332
12752992422,1cyclictest0-21swapper/109:31:471
12752992421,3cyclictest0-21swapper/111:56:471
1275299240,20cyclictest0-21swapper/112:13:251
1275299240,0cyclictest6120-21diskmemload11:42:531
1275299240,0cyclictest6120-21diskmemload10:01:281
1275299240,0cyclictest0-21swapper/112:27:261
1275299240,0cyclictest0-21swapper/110:22:361
1275299240,0cyclictest0-21swapper/109:27:391
12751992423,0cyclictest6120-21diskmemload10:35:040
12751992422,2cyclictest0-21swapper/010:46:490
1275199240,24cyclictest0-21swapper/010:50:430
1275199240,23cyclictest7167-21perf11:05:000
1275199240,23cyclictest6120-21diskmemload10:12:470
1275199240,23cyclictest0-21swapper/010:27:160
1275199240,23cyclictest0-21swapper/009:49:200
12754992323,0cyclictest0-21swapper/311:23:143
12754992321,1cyclictest32639-21sh12:25:003
12754992321,1cyclictest0-21swapper/311:56:133
12754992321,1cyclictest0-21swapper/309:16:103
1275499230,2cyclictest21713-21ssh09:53:173
1275499230,2cyclictest18032-21ssh10:46:093
1275499230,2cyclictest11905-21ssh12:07:083
1275499230,23cyclictest0-21swapper/311:54:183
1275499230,23cyclictest0-21swapper/311:36:153
1275499230,22cyclictest3226-21ssh09:35:583
1275499230,22cyclictest26069-21ssh09:56:323
1275499230,22cyclictest20664-21sh11:18:053
1275499230,22cyclictest18903-21sh09:21:033
1275499230,0cyclictest6120-21diskmemload10:34:223
1275499230,0cyclictest0-21swapper/311:25:103
1275499230,0cyclictest0-21swapper/309:40:093
1275499230,0cyclictest0-21swapper/309:30:393
12753992323,0cyclictest6120-21diskmemload09:15:032
12753992323,0cyclictest0-21swapper/209:36:272
12753992321,1cyclictest6120-21diskmemload12:13:022
12753992321,1cyclictest24362-21apt-get08:44:272
12753992321,1cyclictest20542-21apt-get07:29:282
12753992320,2cyclictest21860-21/usr/sbin/munin08:39:272
12753992320,2cyclictest10716-21ssh12:05:322
1275399230,23cyclictest0-21swapper/211:40:102
1275399230,22cyclictest6120-21diskmemload12:15:512
1275399230,22cyclictest32524-21ssh10:02:422
1275399230,22cyclictest29402-21ssh10:56:192
1275399230,22cyclictest21842-21sh10:21:112
1275399230,22cyclictest16084-21ssh10:15:532
1275399230,22cyclictest0-21swapper/211:51:002
1275399230,22cyclictest0-21swapper/211:07:132
1275399230,1cyclictest28342-21memory11:24:322
1275399230,0cyclictest6120-21diskmemload09:54:142
1275399230,0cyclictest6120-21diskmemload09:20:372
1275399230,0cyclictest0-21swapper/212:03:062
1275399230,0cyclictest0-21swapper/211:35:152
1275399230,0cyclictest0-21swapper/211:26:382
1275399230,0cyclictest0-21swapper/210:32:472
1275399230,0cyclictest0-21swapper/209:31:492
12752992323,0cyclictest6120-21diskmemload11:02:311
12752992322,1cyclictest6120-21diskmemload10:10:291
12752992321,1cyclictest19930-21basename07:25:011
1275299230,22cyclictest9067-21ssh12:34:001
1275299230,0cyclictest0-21swapper/109:23:191
12751992323,0cyclictest0-21swapper/011:50:020
12751992323,0cyclictest0-21swapper/009:43:100
12751992322,1cyclictest62550irq/127-eno111:18:200
12751992322,1cyclictest10411-21ssh11:37:340
12751992321,1cyclictest622-21gdbus09:25:000
12751992321,1cyclictest32698-21apt-get07:54:280
12751992321,1cyclictest1707-21ssh12:26:440
12751992321,1cyclictest0-21swapper/012:02:140
12751992321,1cyclictest0-21swapper/010:57:000
12751992320,2cyclictest12599-21ssh12:36:100
12751992320,2cyclictest0-21swapper/010:05:350
1275199230,2cyclictest21305-21ssh11:46:360
1275199230,22cyclictest6120-21diskmemload09:15:120
1275199230,22cyclictest30266-21ssh12:24:080
1275199230,22cyclictest17591-21sh12:12:130
1275199230,22cyclictest0-21swapper/009:35:070
1275199230,0cyclictest62550irq/127-eno109:13:300
1275199230,0cyclictest0-21swapper/011:58:500
1275199230,0cyclictest0-21swapper/010:21:070
12754992220,1cyclictest0-21swapper/309:05:013
1275499220,22cyclictest13675-21ssh12:37:393
1275499220,22cyclictest0-21swapper/311:10:203
1275499220,21cyclictest9784-21ssh10:10:023
1275499220,21cyclictest17867-21apt-get11:44:283
1275499220,21cyclictest0-21swapper/312:10:073
1275499220,21cyclictest0-21swapper/311:30:203
1275499220,21cyclictest0-21swapper/310:27:403
1275499220,21cyclictest0-21swapper/310:09:293
1275499220,21cyclictest0-21swapper/310:01:463
1275499220,21cyclictest0-21swapper/308:59:283
1275499220,21cyclictest0-21swapper/308:44:273
1275499220,21cyclictest0-21swapper/307:49:293
1275499220,1cyclictest0-21swapper/311:05:183
1275499220,0cyclictest6120-21diskmemload09:45:193
1275499220,0cyclictest0-21swapper/309:29:263
12753992222,0cyclictest0-21swapper/210:25:312
12753992220,1cyclictest0-21swapper/209:40:382
1275399220,22cyclictest13839-21ssh09:45:022
1275399220,22cyclictest0-21swapper/212:30:162
1275399220,22cyclictest0-21swapper/210:52:232
1275399220,22cyclictest0-21swapper/210:06:192
1275399220,21cyclictest24313-21ssh09:25:412
1275399220,21cyclictest0-21swapper/210:35:322
1275399220,1cyclictest0-21swapper/212:20:162
1275399220,0cyclictest0-21swapper/211:56:062
12752992221,1cyclictest0-21swapper/112:18:261
12752992220,2cyclictest8530-21ssh09:40:321
1275299220,21cyclictest13336-21apt-get07:14:271
1275299220,21cyclictest0-21swapper/110:56:011
1275299220,21cyclictest0-21swapper/109:46:141
1275299220,21cyclictest0-21swapper/109:05:011
1275299220,1cyclictest25218-21ssh10:53:171
1275299220,1cyclictest24778-21latency_hist07:35:001
12751992222,0cyclictest0-21swapper/011:40:350
12751992222,0cyclictest0-21swapper/008:19:270
1275199221,21cyclictest62550irq/127-eno111:05:200
1275199220,2cyclictest12647-21ssh10:41:340
1275199220,21cyclictest6120-21diskmemload12:15:150
1275199220,21cyclictest13759-21ssh11:11:020
1275199220,21cyclictest0-21swapper/012:06:330
1275199220,21cyclictest0-21swapper/011:32:300
1275199220,21cyclictest0-21swapper/010:16:300
1275199220,21cyclictest0-21swapper/008:44:270
1275199220,21cyclictest0-21swapper/007:15:010
1275199220,1cyclictest26817-21sh09:57:280
1275199220,0cyclictest6120-21diskmemload09:30:370
12754992120,1cyclictest12284-21apt-get08:19:273
12754992120,0cyclictest0-21swapper/308:04:283
12754992119,1cyclictest0-21swapper/308:15:013
1275499210,20cyclictest0-21swapper/307:54:283
12753992121,0cyclictest0-21swapper/211:45:592
12753992119,1cyclictest0-21swapper/208:35:002
12753992119,1cyclictest0-21swapper/207:25:012
1275399210,21cyclictest0-21swapper/209:09:272
1275399210,1cyclictest17106-21apt-get08:29:302
12752992120,1cyclictest9885-21apt-get08:14:281
12752992120,0cyclictest26155-21apt-get08:45:021
12752992120,0cyclictest0-21swapper/108:39:271
12752992120,0cyclictest0-21swapper/107:59:291
1275299210,21cyclictest0-21swapper/109:09:271
12751992121,0cyclictest0-21swapper/009:25:010
12751992119,1cyclictest15734-21apt-get07:19:270
1275199210,20cyclictest0-21swapper/008:45:020
12754992018,1cyclictest21310-21munin-run08:35:003
12753992020,0cyclictest27905-21apt-get07:44:252
12753992020,0cyclictest0-21swapper/209:04:282
12753992019,0cyclictest0-21swapper/208:54:272
12753992017,2cyclictest4461-21sh08:00:012
1275399200,0cyclictest0-21swapper/208:09:282
12752992020,0cyclictest0-21swapper/107:39:271
12752992018,1cyclictest31337-21cron08:55:011
12751992020,0cyclictest0-21swapper/008:34:270
12751992020,0cyclictest0-21swapper/008:29:310
12751992019,1cyclictest23758-21perf08:40:000
12751992019,1cyclictest0-21swapper/009:09:270
12751992019,1cyclictest0-21swapper/007:49:280
12751992018,1cyclictest9294-21turbostat.cron08:10:010
1275199200,20cyclictest0-21swapper/009:04:280
1275199200,0cyclictest0-21swapper/007:39:270
12754991919,0cyclictest29550-21apt-get08:54:283
12754991919,0cyclictest0-21swapper/307:24:273
12754991919,0cyclictest0-21swapper/307:14:273
1275499190,18cyclictest26155-21apt-get08:45:023
12753991919,0cyclictest0-21swapper/207:54:282
12753991919,0cyclictest0-21swapper/207:39:272
12753991919,0cyclictest0-21swapper/207:14:272
12752991919,0cyclictest0-21swapper/108:29:301
12751991919,0cyclictest0-21swapper/008:59:290
12751991919,0cyclictest0-21swapper/008:54:280
12751991919,0cyclictest0-21swapper/007:29:280
12751991917,1cyclictest18149-21apt-get07:24:270
1275499180,0cyclictest0-21swapper/307:59:293
1275499180,0cyclictest0-21swapper/307:19:273
12752991818,0cyclictest0-21swapper/107:54:281
12751991817,0cyclictest0-21swapper/008:14:280
1275199180,1cyclictest16488-21sh08:25:000
12754991717,0cyclictest0-21swapper/308:09:283
12754991717,0cyclictest0-21swapper/307:44:253
12754991716,1cyclictest25491-21apt-get07:39:273
12753991717,0cyclictest0-21swapper/208:19:272
12752991717,0cyclictest0-21swapper/108:44:271
12752991717,0cyclictest0-21swapper/107:29:281
12752991714,1cyclictest0-21swapper/107:49:281
12754991616,0cyclictest0-21swapper/309:09:273
12754991614,1cyclictest16491-21cron08:25:003
1275499160,16cyclictest0-21swapper/308:36:093
12753991616,0cyclictest0-21swapper/208:24:272
12753991614,1cyclictest32343-21expr08:59:292
12752991614,1cyclictest7490-21apt-get08:09:271
12751991613,2cyclictest29708-21dump-pmu-power07:45:000
12753991514,1cyclictest27152-21apt-get08:49:272
12751991515,0cyclictest0-21swapper/007:34:280
12754991414,0cyclictest0-21swapper/307:25:443
1275499140,14cyclictest0-21swapper/308:25:063
1275499140,14cyclictest0-21swapper/307:34:363
1275399140,14cyclictest0-21swapper/208:12:282
1275399140,14cyclictest0-21swapper/208:00:272
1275399140,14cyclictest0-21swapper/207:46:092
1275399140,14cyclictest0-21swapper/207:17:202
1275399140,0cyclictest0-21swapper/207:33:142
12752991414,0cyclictest0-21swapper/108:15:091
1275299140,14cyclictest0-21swapper/108:00:531
1275299140,14cyclictest0-21swapper/107:16:111
1275299140,0cyclictest0-21swapper/108:31:221
1275299140,0cyclictest0-21swapper/107:40:201
12751991414,0cyclictest0-21swapper/007:58:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional