You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 15:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Apr 19, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27173993331,1cyclictest8765-21apt-get11:35:012
27173993230,1cyclictest0-21swapper/211:35:022
27181992921,4cyclictest0-21swapper/310:12:153
2718199270,26cyclictest0-21swapper/311:20:063
2718199260,25cyclictest27574-21cat12:25:013
2718199260,25cyclictest27574-21cat12:25:013
2718199260,22cyclictest21583-21diskmemload10:35:353
2718199260,1cyclictest0-21swapper/311:37:143
2715099260,25cyclictest32317-21cron07:20:010
2715099260,25cyclictest14853-21rm10:36:550
27181992523,2cyclictest0-21swapper/309:25:583
27181992523,1cyclictest0-21swapper/310:04:113
27181992521,4cyclictest0-21swapper/312:15:253
27181992520,4cyclictest6991-21find12:35:093
27181992520,4cyclictest21583-21diskmemload09:30:453
2718199251,23cyclictest0-21swapper/310:20:123
2718199250,24cyclictest0-21swapper/309:25:013
2718199250,21cyclictest6613-21ssh09:57:023
2717399250,21cyclictest0-21swapper/211:08:302
27155992523,1cyclictest0-21swapper/110:50:491
2715599250,24cyclictest1006-21sh11:25:351
2715599250,24cyclictest0-21swapper/112:38:491
2715599250,1cyclictest21583-21diskmemload11:02:231
2715099251,23cyclictest606-21dbus-daemon09:00:000
27181992423,1cyclictest21583-21diskmemload10:48:163
27181992423,1cyclictest19174-21apt-get09:04:593
27181992422,1cyclictest25071-21ssh09:12:223
27181992419,4cyclictest2271-21apt-get12:00:013
27181992419,4cyclictest13640-21ssh11:06:413
27181992419,4cyclictest0-21swapper/307:15:003
27181992418,5cyclictest4523-21ssh12:33:443
27181992417,6cyclictest15067-21grep10:05:073
2718199241,22cyclictest0-21swapper/310:55:013
2718199240,23cyclictest21583-21diskmemload10:25:313
2718199240,21cyclictest21583-21diskmemload12:07:373
2718199240,21cyclictest0-21swapper/310:30:463
2718199240,0cyclictest0-21swapper/311:19:283
2718199240,0cyclictest0-21swapper/310:16:573
27173992423,1cyclictest21583-21diskmemload11:25:082
27173992423,1cyclictest0-21swapper/209:00:012
27173992423,0cyclictest0-21swapper/211:52:332
27173992419,4cyclictest0-21swapper/212:24:302
27173992419,4cyclictest0-21swapper/212:24:302
27173992419,2cyclictest0-21swapper/211:40:112
27155992424,0cyclictest0-21swapper/110:11:541
27155992421,2cyclictest514-21ssh09:50:241
2715599240,2cyclictest313-21systemd-journal10:35:001
2715599240,24cyclictest0-21swapper/112:19:221
2715599240,23cyclictest27246-21sh10:17:331
2715599240,23cyclictest2105-21sendmail-msp12:00:001
2715599240,23cyclictest0-21swapper/112:21:101
2715599240,23cyclictest0-21swapper/112:21:101
2715599240,23cyclictest0-21swapper/110:35:101
27150992424,0cyclictest21583-21diskmemload09:20:010
2715099242,21cyclictest62550irq/127-eno111:05:420
27150992421,2cyclictest0-21swapper/009:58:270
2715099240,2cyclictest5779-21sort11:00:010
2715099240,24cyclictest21583-21diskmemload11:30:290
2715099240,24cyclictest0-21swapper/009:52:160
2715099240,23cyclictest3444-21sh11:29:350
2715099240,23cyclictest21583-21diskmemload11:56:030
2715099240,23cyclictest0-21swapper/010:25:240
27181992323,0cyclictest0-21swapper/311:53:043
27181992321,1cyclictest0-21swapper/308:30:003
27181992320,3cyclictest0-21swapper/309:42:563
27181992320,2cyclictest24426-21dump-pmu-power11:50:013
27181992320,2cyclictest11176-21apt-get08:50:013
27181992318,4cyclictest21583-21diskmemload10:41:393
27181992316,6cyclictest11671-21latency_hist07:45:013
27181992316,3cyclictest0-21swapper/311:29:073
2718199230,2cyclictest13462-21sh12:10:073
2718199230,23cyclictest0-21swapper/311:40:263
2718199230,22cyclictest16363-21apt-get09:00:003
2718199230,0cyclictest21583-21diskmemload11:56:573
2718199230,0cyclictest0-21swapper/310:58:333
2718199230,0cyclictest0-21swapper/309:39:453
2718199230,0cyclictest0-21swapper/309:15:053
27173992323,0cyclictest21583-21diskmemload10:01:392
27173992323,0cyclictest0-21swapper/210:29:192
27173992323,0cyclictest0-21swapper/209:47:522
27173992323,0cyclictest0-21swapper/209:38:512
27173992323,0cyclictest0-21swapper/209:25:422
27173992321,1cyclictest21583-21diskmemload09:55:002
27173992321,1cyclictest0-21swapper/211:21:382
27173992320,1cyclictest26363-21ssh10:48:292
2717399230,23cyclictest0-21swapper/212:09:272
2717399230,23cyclictest0-21swapper/210:23:512
2717399230,23cyclictest0-21swapper/209:41:162
2717399230,22cyclictest8268-21ssh09:59:412
2717399230,22cyclictest6124-21ssh12:03:222
2717399230,22cyclictest2783-21ssh09:22:162
2717399230,22cyclictest16732-21latency_hist09:00:002
2717399230,22cyclictest11589-21cut07:45:002
2717399230,22cyclictest0-21swapper/210:12:562
2717399230,1cyclictest0-21swapper/211:56:282
2717399230,0cyclictest0-21swapper/211:14:052
2717399230,0cyclictest0-21swapper/210:55:022
2717399230,0cyclictest0-21swapper/210:42:272
2717399230,0cyclictest0-21swapper/210:37:192
27155992323,0cyclictest0-21swapper/112:09:061
27155992323,0cyclictest0-21swapper/111:48:481
27155992323,0cyclictest0-21swapper/111:40:021
27155992323,0cyclictest0-21swapper/111:11:381
27155992323,0cyclictest0-21swapper/109:56:531
27155992323,0cyclictest0-21swapper/109:37:151
27155992321,1cyclictest21570-21apt-get09:10:001
27155992321,1cyclictest17577-21cut12:15:011
27155992321,1cyclictest0-21swapper/111:32:011
27155992321,1cyclictest0-21swapper/110:28:001
27155992321,1cyclictest0-21swapper/109:26:211
27155992320,2cyclictest26609-21/usr/sbin/munin09:15:051
27155992320,2cyclictest24585-21sh09:11:391
27155992320,2cyclictest22783-21gltestperf08:05:021
27155992320,2cyclictest16231-21ssh10:06:061
27155992319,3cyclictest21934-21apt-get10:45:011
2715599230,23cyclictest0-21swapper/109:47:541
2715599230,23cyclictest0-21swapper/109:41:491
2715599230,22cyclictest5585-21perf11:00:011
2715599230,22cyclictest32377-21sendmail-msp07:20:011
2715599230,22cyclictest26822-21ssh11:50:411
2715599230,22cyclictest0-21swapper/111:38:241
2715599230,22cyclictest0-21swapper/111:07:361
27150992323,0cyclictest0-21swapper/011:40:180
27150992323,0cyclictest0-21swapper/010:46:290
27150992323,0cyclictest0-21swapper/009:13:030
27150992322,1cyclictest25153-21ssh10:15:070
27150992321,2cyclictest0-21swapper/011:52:200
27150992321,1cyclictest11532-21apt-get07:45:000
27150992321,1cyclictest0-21swapper/012:30:250
2715099230,2cyclictest28046-21ssh12:25:030
2715099230,2cyclictest11266-21sh10:34:220
2715099230,23cyclictest0-21swapper/011:10:440
2715099230,23cyclictest0-21swapper/010:10:220
2715099230,22cyclictest6783-21munin-run07:35:000
2715099230,22cyclictest6458-21gltestperf11:00:030
2715099230,22cyclictest4600-21idleruntime-cro07:30:010
2715099230,22cyclictest29174-21ssh11:21:560
2715099230,22cyclictest21583-21diskmemload10:40:040
2715099230,22cyclictest21583-21diskmemload10:07:110
2715099230,22cyclictest13719-21cut10:05:010
2715099230,22cyclictest13189-21ssh11:38:160
2715099230,22cyclictest0-21swapper/012:08:450
2715099230,1cyclictest0-21swapper/011:45:020
2715099230,1cyclictest0-21swapper/010:52:020
2715099230,0cyclictest21583-21diskmemload12:35:560
2715099230,0cyclictest0-21swapper/012:20:490
2715099230,0cyclictest0-21swapper/012:20:490
27181992222,0cyclictest0-21swapper/311:00:443
27181992222,0cyclictest0-21swapper/309:45:293
27181992220,1cyclictest21829-21sh08:05:013
27181992219,3cyclictest0-21swapper/309:52:163
27181992216,5cyclictest6563-21apt-get07:35:003
27181992216,5cyclictest16574-21latency_hist07:55:013
2718199221,0cyclictest4164-21apt-get07:30:003
2718199220,21cyclictest5958-21sh11:30:213
2718199220,21cyclictest0-21swapper/311:10:193
2718199220,21cyclictest0-21swapper/309:10:003
2718199220,0cyclictest0-21swapper/312:25:103
27173992222,0cyclictest21583-21diskmemload09:10:532
27173992221,1cyclictest0-21swapper/212:10:032
27173992221,1cyclictest0-21swapper/208:40:032
27173992220,1cyclictest6608-21munin-run07:35:002
27173992220,1cyclictest6375-21sh12:35:052
27173992220,1cyclictest29877-21df_inode07:15:012
27173992220,1cyclictest24137-21ssh10:15:022
27173992220,1cyclictest21667-21munin-run09:10:002
27173992220,1cyclictest17517-21fw_packets07:55:022
27173992220,1cyclictest0-21swapper/212:15:022
2717399220,22cyclictest0-21swapper/210:50:172
2717399220,21cyclictest6881-21apt-get10:30:022
2717399220,21cyclictest606-21dbus-daemon08:50:012
2717399220,21cyclictest3917-21apt-get08:34:592
2717399220,21cyclictest31763-21apt-get07:19:592
2717399220,21cyclictest28172-21ps09:15:062
2717399220,21cyclictest19702-21apt-get11:45:022
2717399220,21cyclictest16322-21apt-get07:55:002
2717399220,21cyclictest15711-21ssh10:05:102
2717399220,21cyclictest1508-21acpi08:30:002
2717399220,21cyclictest0-21swapper/207:24:592
2717399220,1cyclictest5526-21apt-get11:00:012
2717399220,1cyclictest29648-21sh12:25:122
27155992222,0cyclictest21583-21diskmemload10:40:071
27155992222,0cyclictest0-21swapper/112:29:271
27155992222,0cyclictest0-21swapper/111:20:141
27155992221,1cyclictest0-21swapper/111:16:191
27155992220,1cyclictest0-21swapper/107:45:001
2715599220,21cyclictest21583-21diskmemload10:20:071
2715599220,21cyclictest0-21swapper/112:00:011
2715599220,21cyclictest0-21swapper/109:30:331
2715599220,1cyclictest29121-21apt-get08:20:001
2715599220,1cyclictest11226-21munin-run08:50:011
2715599220,0cyclictest0-21swapper/109:21:211
27150992222,0cyclictest21583-21diskmemload09:31:000
27150992222,0cyclictest0-21swapper/008:34:590
27150992221,1cyclictest0-21swapper/009:36:430
27150992221,1cyclictest0-21swapper/008:50:020
27150992220,1cyclictest32408-21kworker/u8:108:15:010
27150992220,1cyclictest31548-21munin-plugin-st08:25:000
2715099220,22cyclictest4503-21ssh12:00:380
2715099220,21cyclictest29363-21/usr/sbin/munin08:20:000
2715099220,21cyclictest21624-21perf09:10:000
2715099220,21cyclictest21583-21diskmemload11:15:080
2715099220,21cyclictest19387-21apt-get08:00:020
2715099220,21cyclictest0-21swapper/012:10:310
2715099220,21cyclictest0-21swapper/010:20:020
2715099220,21cyclictest0-21swapper/009:46:290
2715099220,21cyclictest0-21swapper/009:15:350
2715099220,21cyclictest0-21swapper/009:00:020
2715099220,1cyclictest2213-21cron07:25:010
2715099220,1cyclictest11197-21basename08:50:010
2715099220,1cyclictest0-21swapper/012:17:210
2715099220,1cyclictest0-21swapper/009:25:070
2718199210,20cyclictest0-21swapper/308:45:003
2718199210,1cyclictest0-21swapper/308:40:013
27173992120,1cyclictest21833-21apt-get08:05:022
27173992119,1cyclictest0-21swapper/207:30:012
2717399210,1cyclictest0-21swapper/211:16:102
27155992121,0cyclictest0-21swapper/107:45:011
2715599210,20cyclictest0-21swapper/110:00:011
2715599210,0cyclictest29121-21apt-get08:20:001
2715599210,0cyclictest0-21swapper/112:31:021
27181992018,1cyclictest6563-21apt-get07:35:003
2718199200,20cyclictest0-21swapper/307:45:013
2718199200,0cyclictest0-21swapper/308:55:013
2718199200,0cyclictest0-21swapper/308:30:013
27173992019,1cyclictest0-21swapper/208:20:002
2715599200,0cyclictest0-21swapper/108:00:021
27150992020,0cyclictest0-21swapper/007:50:000
27150992018,1cyclictest1507-21apt08:30:000
27173991919,0cyclictest0-21swapper/208:20:012
27173991919,0cyclictest0-21swapper/208:15:012
2717399190,0cyclictest0-21swapper/208:00:022
2715599190,18cyclictest0-21swapper/107:25:001
27181991818,0cyclictest0-21swapper/308:20:013
27181991814,4cyclictest0-21swapper/307:19:593
27173991816,1cyclictest0-21swapper/208:50:022
27155991818,0cyclictest0-21swapper/108:25:021
27155991818,0cyclictest0-21swapper/107:55:001
27155991816,1cyclictest9083-21munin-run07:40:001
27181991716,1cyclictest26715-21apt-get08:15:013
27181991715,1cyclictest16462-21apt-get07:55:023
27173991715,1cyclictest606-21dbus-daemon08:40:012
27155991717,0cyclictest0-21swapper/108:15:011
27155991717,0cyclictest0-21swapper/107:14:591
27155991716,0cyclictest0-21swapper/108:45:001
27155991715,1cyclictest17447-21df09:00:021
2715599170,1cyclictest16398-21munin-run09:00:001
27150991717,0cyclictest0-21swapper/008:40:030
27150991715,1cyclictest19114-21wc08:00:010
2718199160,14cyclictest0-21swapper/308:07:073
27155991616,0cyclictest0-21swapper/107:30:001
27155991614,1cyclictest0-21swapper/107:35:001
2715099164,6cyclictest6394-21perf08:40:010
27150991614,1cyclictest783-21snmpd08:08:100
27173991515,0cyclictest0-21swapper/207:50:002
27155991515,0cyclictest0-21swapper/108:55:011
2715099151,14cyclictest0-21swapper/007:37:220
2715099150,5cyclictest16682-21apt-config07:55:010
2718199140,0cyclictest0-21swapper/308:15:223
2718199140,0cyclictest0-21swapper/307:20:523
2717399140,0cyclictest0-21swapper/207:36:282
2715599140,0cyclictest0-21swapper/108:35:261
2715599140,0cyclictest0-21swapper/107:56:091
27150991414,0cyclictest0-21swapper/007:11:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional