You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 15:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Aug 21, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2309899270,0cyclictest0-21swapper/221:20:152
2309899270,0cyclictest0-21swapper/221:15:192
2309899260,5cyclictest18770-21ssh21:40:032
2309899260,25cyclictest21229-21ssh23:35:412
2309899260,25cyclictest14118-21ssh21:35:182
2309899260,25cyclictest0-21swapper/222:43:212
2309899260,0cyclictest0-21swapper/221:10:022
2309899260,0cyclictest0-21swapper/200:20:212
23091992624,1cyclictest0-21swapper/022:03:070
2310399250,24cyclictest26331-21ssh23:12:153
2310399250,24cyclictest16329-21diskmemload22:13:183
2310399250,24cyclictest0-21swapper/323:04:083
2309899250,24cyclictest25137-21ssh23:10:372
2309899250,24cyclictest10558-21sh23:26:572
2309899250,24cyclictest0-21swapper/223:20:152
2309899250,1cyclictest20231-21ssh23:06:432
2309899250,0cyclictest0-21swapper/222:00:202
2309399254,3cyclictest27297-21wc20:25:001
2309399250,24cyclictest16329-21diskmemload00:35:321
23091992523,1cyclictest32560-21cat00:15:150
2309199250,24cyclictest9722-21ssh00:24:000
2309199250,24cyclictest0-21swapper/023:46:370
23103992424,0cyclictest0-21swapper/323:25:443
23103992422,2cyclictest14981-21apt-get20:00:143
23103992421,2cyclictest16329-21diskmemload22:25:153
2310399240,24cyclictest0-21swapper/322:55:153
2310399240,23cyclictest19403-21ssh23:05:343
23098992420,3cyclictest0-21swapper/222:21:472
23098992419,4cyclictest23632-21ssh00:06:372
23098992419,4cyclictest16329-21diskmemload00:29:202
2309899240,23cyclictest29485-21ssh00:11:532
2309899240,23cyclictest16329-21diskmemload22:37:502
2309899240,23cyclictest0-21swapper/223:17:232
2309899240,1cyclictest6018-21ssh23:51:082
2309899240,1cyclictest25714-21apt-get19:15:132
2309899240,1cyclictest15787-21ssh23:03:232
2309899240,0cyclictest0-21swapper/223:46:272
2309899240,0cyclictest0-21swapper/222:58:492
23093992424,0cyclictest0-21swapper/123:46:031
23093992422,2cyclictest30980-21irqstats21:50:191
23093992422,1cyclictest313-21systemd-journal21:20:001
23093992422,1cyclictest0-21swapper/121:20:211
2309399242,1cyclictest16329-21diskmemload21:46:081
2309399240,24cyclictest0-21swapper/123:44:131
2309399240,24cyclictest0-21swapper/121:42:121
2309399240,24cyclictest0-21swapper/100:06:371
2309399240,23cyclictest13930-21cron21:05:011
2309399240,23cyclictest0-21swapper/123:36:431
2309399240,1cyclictest16329-21diskmemload22:48:451
2309399240,0cyclictest0-21swapper/100:18:051
23091992423,1cyclictest62550irq/127-eno100:10:490
2309199240,24cyclictest0-21swapper/023:34:110
2309199240,24cyclictest0-21swapper/022:10:190
2309199240,24cyclictest0-21swapper/000:08:450
2309199240,23cyclictest0-21swapper/022:47:510
2309199240,1cyclictest15990-21sh23:03:380
23103992323,0cyclictest16329-21diskmemload21:56:243
23103992323,0cyclictest16329-21diskmemload21:27:063
23103992323,0cyclictest0-21swapper/322:16:563
23103992323,0cyclictest0-21swapper/321:20:583
23103992323,0cyclictest0-21swapper/300:26:353
23103992321,1cyclictest0-21swapper/321:45:233
23103992321,1cyclictest0-21swapper/300:20:213
2310399230,23cyclictest0-21swapper/322:42:533
2310399230,23cyclictest0-21swapper/321:32:003
2310399230,22cyclictest22597-21rm21:42:593
2310399230,0cyclictest16329-21diskmemload23:54:343
2310399230,0cyclictest16329-21diskmemload00:17:423
2310399230,0cyclictest0-21swapper/321:18:013
2310399230,0cyclictest0-21swapper/300:34:583
23098992323,0cyclictest0-21swapper/222:47:072
23098992323,0cyclictest0-21swapper/222:32:352
23098992323,0cyclictest0-21swapper/221:46:032
23098992323,0cyclictest0-21swapper/200:00:272
23098992323,0cyclictest0-21swapper/200:00:272
23098992319,3cyclictest0-21swapper/222:27:392
23098992318,4cyclictest0-21swapper/200:19:572
2309899230,23cyclictest0-21swapper/221:55:362
2309899230,23cyclictest0-21swapper/221:27:512
2309899230,22cyclictest26963-21ssh23:40:442
2309899230,22cyclictest16412-21ssh00:30:042
2309899230,22cyclictest16329-21diskmemload23:57:322
2309899230,20cyclictest0-21swapper/221:33:482
2309899230,0cyclictest16329-21diskmemload22:10:582
2309899230,0cyclictest0-21swapper/223:30:552
2309899230,0cyclictest0-21swapper/222:15:202
2309899230,0cyclictest0-21swapper/221:51:062
23093992323,0cyclictest0-21swapper/123:00:271
23093992323,0cyclictest0-21swapper/121:55:331
23093992323,0cyclictest0-21swapper/121:30:481
23093992321,1cyclictest8851-21sh22:00:051
23093992321,1cyclictest0-21swapper/123:10:231
23093992321,1cyclictest0-21swapper/122:40:501
23093992321,1cyclictest0-21swapper/121:12:461
23093992320,2cyclictest10449-21awk00:25:001
2309399230,23cyclictest0-21swapper/122:53:171
2309399230,23cyclictest0-21swapper/122:18:041
2309399230,23cyclictest0-21swapper/121:28:231
2309399230,23cyclictest0-21swapper/100:01:481
2309399230,23cyclictest0-21swapper/100:01:481
2309399230,22cyclictest9110-21ssh23:55:091
2309399230,22cyclictest19024-21sh22:36:441
2309399230,22cyclictest18500-21sh00:30:291
2309399230,22cyclictest16329-21diskmemload00:10:231
2309399230,22cyclictest1620-21sh23:20:001
2309399230,22cyclictest13523-21cat21:35:161
2309399230,22cyclictest0-21swapper/122:10:161
2309399230,1cyclictest16329-21diskmemload23:21:451
2309399230,1cyclictest0-21swapper/123:05:341
2309399230,0cyclictest16329-21diskmemload23:30:381
2309399230,0cyclictest16329-21diskmemload22:20:091
2309399230,0cyclictest0-21swapper/122:34:211
2309399230,0cyclictest0-21swapper/122:27:271
2309399230,0cyclictest0-21swapper/122:07:431
23091992323,0cyclictest16329-21diskmemload21:15:160
23091992323,0cyclictest0-21swapper/023:53:040
23091992323,0cyclictest0-21swapper/022:43:020
23091992323,0cyclictest0-21swapper/022:22:150
23091992323,0cyclictest0-21swapper/021:46:170
23091992323,0cyclictest0-21swapper/021:30:210
23091992323,0cyclictest0-21swapper/021:10:070
23091992321,1cyclictest6076-21sh21:56:320
23091992321,1cyclictest4748-21tr22:25:160
23091992321,1cyclictest23968-21irqstats23:10:180
23091992321,1cyclictest19579-21sh00:03:460
23091992321,1cyclictest19579-21sh00:03:460
23091992320,2cyclictest0-21swapper/023:05:510
2309199230,2cyclictest9204-21/usr/sbin/munin23:55:250
2309199230,23cyclictest16329-21diskmemload00:37:190
2309199230,23cyclictest0-21swapper/021:35:570
2309199230,22cyclictest28747-21ssh21:20:020
2309199230,22cyclictest16329-21diskmemload22:17:220
2309199230,22cyclictest0-21swapper/023:15:100
2309199230,22cyclictest0-21swapper/000:31:470
2309199230,0cyclictest0-21swapper/000:25:140
23103992222,0cyclictest16185-21apt-get22:35:143
23103992222,0cyclictest0-21swapper/322:00:263
23103992222,0cyclictest0-21swapper/321:50:093
23103992222,0cyclictest0-21swapper/300:35:583
23103992221,1cyclictest0-21swapper/300:01:423
23103992221,1cyclictest0-21swapper/300:01:423
23103992220,1cyclictest9912-21munin-run19:50:003
23103992220,1cyclictest13959-21perf21:05:013
23103992220,1cyclictest0-21swapper/323:56:143
2310399220,22cyclictest0-21swapper/323:43:473
2310399220,22cyclictest0-21swapper/323:35:183
2310399220,22cyclictest0-21swapper/322:51:513
2310399220,22cyclictest0-21swapper/321:37:343
2310399220,21cyclictest4629-21apt-get20:45:153
2310399220,21cyclictest28633-21ssh23:15:063
2310399220,21cyclictest20166-21apt-get20:10:153
2310399220,21cyclictest16989-21apt-get21:10:023
2310399220,21cyclictest0-21swapper/322:20:143
2310399220,1cyclictest0-21swapper/323:49:243
2310399220,0cyclictest0-21swapper/300:10:573
23098992218,4cyclictest5380-21apt-get19:40:112
2309899220,2cyclictest25454-21latency_hist19:15:012
2309899220,21cyclictest518-21apt-get19:30:152
2309899220,21cyclictest0-21swapper/220:40:152
23093992221,1cyclictest0-21swapper/123:25:401
2309399220,21cyclictest0-21swapper/123:50:201
2309399220,21cyclictest0-21swapper/121:05:141
2309399220,21cyclictest0-21swapper/120:30:131
2309399220,21cyclictest0-21swapper/119:15:131
2309399220,1cyclictest17099-21apt-get20:05:011
2309399220,1cyclictest14699-21apt20:00:001
2309399220,1cyclictest0-21swapper/100:25:371
23091992221,0cyclictest0-21swapper/022:30:150
2309199221,0cyclictest0-21swapper/020:40:140
2309199220,22cyclictest0-21swapper/022:35:230
2309199220,21cyclictest9838-21ssh23:25:530
2309199220,21cyclictest16329-21diskmemload23:40:220
2309199220,21cyclictest16326-21cron21:10:010
2309199220,21cyclictest14651-21apt-get22:05:150
2309199220,21cyclictest0-21swapper/019:50:130
2309199220,1cyclictest16329-21diskmemload21:50:200
2309199220,0cyclictest2102-21apt-get23:20:150
2309199220,0cyclictest0-21swapper/023:35:390
2309199220,0cyclictest0-21swapper/022:50:160
2309199220,0cyclictest0-21swapper/021:40:160
23103992121,0cyclictest0-21swapper/323:21:063
23103992121,0cyclictest0-21swapper/321:05:143
2310399210,21cyclictest16329-21diskmemload22:46:473
2310399210,21cyclictest16329-21diskmemload22:07:003
2310399210,20cyclictest0-21swapper/320:35:153
2310399210,1cyclictest13468-21ssh23:30:103
2310399210,0cyclictest0-21swapper/300:07:293
23098992119,2cyclictest0-21swapper/220:35:152
2309899210,20cyclictest24955-21find20:20:122
2309899210,20cyclictest0-21swapper/220:00:142
2309899210,1cyclictest11230-21smartctl19:50:192
2309899210,1cyclictest0-21swapper/220:25:142
23093992121,0cyclictest0-21swapper/119:30:151
23093992120,0cyclictest17099-21apt-get20:05:021
23091992121,0cyclictest0-21swapper/022:55:140
2309199210,20cyclictest0-21swapper/021:25:140
2309199210,0cyclictest30272-21perf19:25:010
2309199210,0cyclictest23319-21apt-get19:10:140
23103992020,0cyclictest0-21swapper/320:55:143
23103992019,0cyclictest0-21swapper/320:05:023
2310399200,20cyclictest0-21swapper/319:35:133
23098992019,0cyclictest7775-21apt-get19:45:132
2309899200,19cyclictest9338-21ls20:55:012
2309899200,19cyclictest9338-21ls20:55:012
2309899200,19cyclictest4596-21/usr/sbin/munin20:45:192
2309899200,19cyclictest10825-21switchtime20:55:232
2309899200,0cyclictest0-21swapper/220:15:132
23093992020,0cyclictest0-21swapper/119:35:131
23093992019,1cyclictest9418-21apt-get20:55:141
2309399200,0cyclictest0-21swapper/120:25:141
2309399200,0cyclictest0-21swapper/119:20:151
2309399200,0cyclictest0-21swapper/119:10:141
23091992020,0cyclictest0-21swapper/020:45:150
23091992017,3cyclictest0-21swapper/020:35:150
2309199200,0cyclictest24986-21apt-get20:20:130
23103991919,0cyclictest27383-21apt-get20:25:143
23103991919,0cyclictest10168-21apt-get19:50:133
23103991919,0cyclictest0-21swapper/319:15:133
23098991914,4cyclictest14227-21apt-get21:05:142
2309899190,18cyclictest0-21swapper/219:55:182
2309899190,18cyclictest0-21swapper/219:25:162
2309899190,0cyclictest0-21swapper/221:00:202
23093991919,0cyclictest0-21swapper/120:10:151
23091991919,0cyclictest0-21swapper/021:00:140
23091991919,0cyclictest0-21swapper/020:25:140
23091991919,0cyclictest0-21swapper/019:25:130
23103991818,0cyclictest0-21swapper/320:30:133
23098991818,0cyclictest0-21swapper/219:20:152
2309899181,16cyclictest21158-21head20:10:202
23093991817,0cyclictest0-21swapper/119:45:131
23091991818,0cyclictest0-21swapper/020:30:130
23091991818,0cyclictest0-21swapper/019:30:150
23093991717,0cyclictest0-21swapper/120:45:141
23093991717,0cyclictest0-21swapper/119:25:131
23091991717,0cyclictest0-21swapper/020:55:140
23091991717,0cyclictest0-21swapper/020:10:150
23091991717,0cyclictest0-21swapper/020:05:140
23091991715,1cyclictest12566-21apt-get19:55:140
23091991714,2cyclictest9135-21latency_hist20:55:010
23091991714,2cyclictest9135-21latency_hist20:55:010
23103991616,0cyclictest0-21swapper/319:30:143
23098991616,0cyclictest29777-21apt-get20:30:132
23093991616,0cyclictest0-21swapper/119:50:131
23091991614,1cyclictest27861-21idleruntime-cro19:20:010
23091991613,3cyclictest0-21swapper/019:40:210
2309199160,15cyclictest4837-21chrt19:37:080
23103991513,1cyclictest30952-21diskstats19:25:143
2310399150,15cyclictest23597-21cstates19:10:153
23098991513,2cyclictest0-21swapper/220:05:512
23098991513,1cyclictest3601-21tail19:35:152
23093991515,0cyclictest0-21swapper/120:50:151
23093991515,0cyclictest0-21swapper/120:50:151
23093991515,0cyclictest0-21swapper/120:35:151
23093991515,0cyclictest0-21swapper/119:40:121
23093991514,1cyclictest0-21swapper/120:44:141
23103991414,0cyclictest2232-21apt-get20:40:143
23103991414,0cyclictest0-21swapper/320:15:143
23103991414,0cyclictest0-21swapper/319:55:143
23103991414,0cyclictest0-21swapper/319:20:073
2310399140,14cyclictest0-21swapper/320:50:173
2310399140,14cyclictest0-21swapper/320:50:173
2310399140,14cyclictest0-21swapper/320:20:273
2310399140,0cyclictest0-21swapper/319:40:203
2309199140,14cyclictest0-21swapper/020:15:570
2309199140,14cyclictest0-21swapper/020:00:180
2309199140,14cyclictest0-21swapper/019:45:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional