You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 18:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Wed Jul 29, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
220802236164,24sleep20-21swapper/207:06:282
221962231161,57sleep00-21swapper/007:07:580
220492204167,24sleep30-21swapper/307:06:043
222272203167,24sleep10-21swapper/107:08:191
597621790,4sleep32245399cyclictest11:25:023
498821560,4sleep22244899cyclictest07:40:192
1847821370,4sleep22244899cyclictest10:40:022
150532570,2sleep121-21rcuc/108:05:011
326722560,4sleep339-21rcuc/307:30:163
94772500,3sleep00-21swapper/007:50:200
2243199399,14cyclictest27503-21munin-run07:20:010
2244899381,25cyclictest0-21swapper/207:55:362
2244299361,24cyclictest11193-21diskmemload12:37:341
2244899351,18cyclictest0-21swapper/211:11:322
2244299356,22cyclictest0-21swapper/112:16:021
2244299356,22cyclictest0-21swapper/112:16:021
2243199358,12cyclictest24628-21perf07:15:010
22431993510,12cyclictest16881-21perf11:50:000
2244899341,23cyclictest0-21swapper/208:24:242
2244899340,27cyclictest0-21swapper/211:58:402
2244299331,24cyclictest0-21swapper/110:01:431
22442993119,3cyclictest0-21swapper/109:37:321
2244299311,22cyclictest0-21swapper/108:38:281
2244299311,20cyclictest0-21swapper/108:26:101
2244899301,12cyclictest0-21swapper/210:13:282
2244299300,23cyclictest0-21swapper/109:46:441
2244299300,22cyclictest0-21swapper/109:25:481
2244299300,11cyclictest0-21swapper/109:10:041
2244899291,22cyclictest0-21swapper/209:51:562
2244899291,17cyclictest0-21swapper/212:36:002
2244899291,10cyclictest0-21swapper/207:20:162
2244299297,9cyclictest0-21swapper/109:04:021
2244299290,12cyclictest0-21swapper/110:16:591
2245399285,10cyclictest26911-21if_enp2s008:30:183
2244899280,16cyclictest0-21swapper/209:55:242
2244899280,16cyclictest0-21swapper/209:55:242
2244299281,18cyclictest2659-21missed_timers11:15:191
2244299281,16cyclictest0-21swapper/108:30:161
2244299281,13cyclictest0-21swapper/112:14:581
2244299281,12cyclictest0-21swapper/111:23:361
2244299281,12cyclictest0-21swapper/111:14:441
2244299281,11cyclictest0-21swapper/107:38:481
2244299281,11cyclictest0-21swapper/107:38:481
2244299281,11cyclictest0-21swapper/107:26:121
2244299280,12cyclictest0-21swapper/108:40:441
2244299280,11cyclictest0-21swapper/109:44:121
2243199289,16cyclictest28122-21munin-run08:35:010
2244899271,11cyclictest0-21swapper/210:21:082
2244899271,11cyclictest0-21swapper/208:05:082
2244899271,10cyclictest0-21swapper/211:30:482
2244299279,8cyclictest0-21swapper/112:02:311
2244299275,8cyclictest0-21swapper/111:45:041
2244299271,9cyclictest0-21swapper/111:54:111
2244299271,17cyclictest0-21swapper/109:07:441
2244299271,11cyclictest0-21swapper/110:40:281
2244299271,10cyclictest23491-21sshd08:22:121
2244299271,10cyclictest0-21swapper/110:59:521
2244299271,10cyclictest0-21swapper/108:07:311
2244299270,11cyclictest0-21swapper/111:02:001
234372260,4sleep230-21rcuc/209:35:202
2244899261,9cyclictest19008-21df10:40:112
2244899261,8cyclictest0-21swapper/210:49:592
2244899261,7cyclictest0-21swapper/212:22:512
2244899261,11cyclictest0-21swapper/211:41:482
2244899260,10cyclictest0-21swapper/210:33:122
2244899260,10cyclictest0-21swapper/209:42:562
2244299269,8cyclictest0-21swapper/108:50:001
2244299269,8cyclictest0-21swapper/108:50:001
2244299267,3cyclictest0-21swapper/108:12:351
2244299266,7cyclictest0-21swapper/111:34:121
2244299266,14cyclictest87350irq/126-enp1s0-10:14:471
2244299265,12cyclictest87350irq/126-enp1s0-07:13:201
2244299261,11cyclictest0-21swapper/109:50:221
2244299261,10cyclictest0-21swapper/111:56:431
2244299260,11cyclictest0-21swapper/108:17:271
2244299260,10cyclictest0-21swapper/111:42:041
2245399251,6cyclictest0-21swapper/312:38:143
2245399251,2cyclictest29607-21unixbench_multi12:15:273
2245399251,2cyclictest29607-21unixbench_multi12:15:273
2245399251,12cyclictest23079-21/usr/sbin/munin10:50:243
2245399251,11cyclictest17367-21sshd08:10:123
2244899256,3cyclictest0-21swapper/210:06:522
2244899251,8cyclictest0-21swapper/211:25:482
2244899251,11cyclictest0-21swapper/211:54:562
2244899251,11cyclictest0-21swapper/210:28:042
2244899251,11cyclictest0-21swapper/207:16:042
2244899251,10cyclictest0-21swapper/208:56:122
2244899251,10cyclictest0-21swapper/208:47:202
2244899251,10cyclictest0-21swapper/208:47:192
2244899251,10cyclictest0-21swapper/207:27:562
2244899250,10cyclictest0-21swapper/211:06:042
2244899250,10cyclictest0-21swapper/211:06:042
2244899250,10cyclictest0-21swapper/210:04:322
2244299256,3cyclictest0-21swapper/111:09:001
2244299256,3cyclictest0-21swapper/111:09:001
2244299256,10cyclictest954-21latency_hist10:00:011
2244299256,10cyclictest954-21latency_hist10:00:011
2244299255,12cyclictest87550irq/128-enp1s0-09:22:481
2244299255,10cyclictest0-21swapper/107:53:491
2244299251,9cyclictest0-21swapper/107:17:081
2244299251,8cyclictest0-21swapper/107:40:281
2244299251,11cyclictest0-21swapper/108:53:081
2244299251,11cyclictest0-21swapper/107:34:201
2244299251,10cyclictest0-21swapper/107:56:111
2244299251,10cyclictest0-21swapper/107:22:081
2244299250,9cyclictest0-21swapper/107:48:391
2244299250,7cyclictest0-21swapper/112:31:521
2244299250,12cyclictest0-21swapper/108:57:001
2244299250,11cyclictest0-21swapper/109:32:521
2243199251,13cyclictest8993-21idleruntime-cro09:05:010
2243199251,11cyclictest20028-21munin-run09:30:020
2245399248,4cyclictest0-21swapper/309:12:003
2245399241,5cyclictest2801-21awk11:15:213
2245399241,2cyclictest9553-21grep07:50:213
2245399241,11cyclictest9880-21/usr/sbin/munin10:20:113
2245399241,11cyclictest7020-21/usr/sbin/munin09:00:193
2245399241,11cyclictest18370-21sshd10:39:123
2244899248,3cyclictest0-21swapper/211:35:562
2244899247,3cyclictest0-21swapper/208:27:492
2244899241,9cyclictest0-21swapper/210:17:202
2244899241,9cyclictest0-21swapper/209:12:282
2244899241,8cyclictest0-21swapper/212:30:232
2244899241,8cyclictest0-21swapper/208:14:022
2244899241,11cyclictest0-21swapper/212:07:242
2244899241,10cyclictest0-21swapper/212:13:122
2244899241,10cyclictest0-21swapper/209:01:242
2244899241,10cyclictest0-21swapper/208:30:332
2244899241,10cyclictest0-21swapper/207:49:562
2244899241,10cyclictest0-21swapper/207:39:562
2244899241,10cyclictest0-21swapper/207:39:562
2244899240,9cyclictest0-21swapper/211:49:522
2244899240,9cyclictest0-21swapper/209:47:522
2244899240,10cyclictest0-21swapper/212:28:012
2244899240,10cyclictest0-21swapper/212:01:402
2244899240,10cyclictest0-21swapper/207:51:542
2244299246,8cyclictest0-21swapper/111:27:001
22442992414,3cyclictest0-21swapper/112:10:001
2244299241,11cyclictest0-21swapper/110:20:091
2244299241,10cyclictest0-21swapper/112:23:341
2245399239,3cyclictest30289-21/usr/sbin/munin12:20:143
2245399239,3cyclictest27472-21/usr/sbin/munin11:00:213
2245399232,10cyclictest3292-21/usr/sbin/munin10:05:183
2245399231,4cyclictest0-21swapper/311:30:053
2245399231,4cyclictest0-21swapper/311:12:143
2245399231,4cyclictest0-21swapper/309:36:243
2245399231,4cyclictest0-21swapper/309:26:453
2245399231,12cyclictest19667-21needreboot10:40:183
2245399231,11cyclictest21741-21/usr/sbin/munin08:20:223
2245399231,11cyclictest11193-21diskmemload10:48:343
2245399231,11cyclictest0-21swapper/311:05:273
2245399231,11cyclictest0-21swapper/311:05:263
2245399231,10cyclictest32104-21sort09:55:183
2245399231,10cyclictest32104-21sort09:55:183
2245399230,2cyclictest1907-21grep08:45:253
2245399230,2cyclictest1907-21grep08:45:253
2244899239,3cyclictest0-21swapper/209:32:242
2244899238,3cyclictest0-21swapper/209:28:502
2244899237,3cyclictest0-21swapper/208:01:462
2244899231,7cyclictest0-21swapper/210:54:512
2244899231,12cyclictest0-21swapper/212:18:072
2244899231,12cyclictest0-21swapper/212:18:072
2244899230,9cyclictest0-21swapper/210:56:322
2244899230,8cyclictest0-21swapper/208:51:402
2244899230,8cyclictest0-21swapper/208:35:152
2244899230,10cyclictest0-21swapper/209:20:322
2244899230,10cyclictest0-21swapper/207:12:472
2244299237,7cyclictest0-21swapper/110:30:131
2244299236,7cyclictest0-21swapper/109:17:301
2244299234,10cyclictest0-21swapper/112:25:101
2244299231,9cyclictest0-21swapper/110:51:021
2244299231,10cyclictest4824-21/usr/sbin/munin10:05:251
2244299230,10cyclictest0-21swapper/110:46:201
2243199236,15cyclictest29715-21perf07:25:010
2243199231,4cyclictest0-21swapper/011:27:230
2245399229,2cyclictest3826-21gzip08:50:233
2245399221,4cyclictest0-21swapper/312:32:023
2245399221,4cyclictest0-21swapper/312:10:493
2245399221,4cyclictest0-21swapper/309:54:313
2245399221,4cyclictest0-21swapper/309:41:533
2245399221,3cyclictest0-21swapper/311:46:343
2245399221,2cyclictest401ktimersoftd/310:55:183
2245399221,10cyclictest808-21snmpd12:28:273
2244899229,3cyclictest0-21swapper/211:02:042
2244899221,9cyclictest0-21swapper/208:42:452
2244899221,8cyclictest0-21swapper/209:09:282
2244299228,3cyclictest0-21swapper/111:38:281
2244299225,12cyclictest0-21swapper/110:38:361
2244299221,9cyclictest0-21swapper/110:29:541
2243199223,10cyclictest11-21rcuc/008:05:200
2243199221,5cyclictest0-21swapper/009:49:070
2243199221,5cyclictest0-21swapper/009:23:210
2245399214,8cyclictest9638-21kworker/u8:210:30:473
2245399213,3cyclictest0-21swapper/309:49:343
2245399210,13cyclictest0-21swapper/311:57:543
2245399210,11cyclictest0-21swapper/310:28:323
2244899216,3cyclictest0-21swapper/211:16:582
2244899210,10cyclictest0-21swapper/209:18:222
2243199213,9cyclictest25271-21/usr/sbin/munin10:55:150
2243199211,7cyclictest24847-21grep12:05:220
2243199211,6cyclictest3518-21grep07:35:260
2243199211,6cyclictest3518-21grep07:35:250
2243199211,5cyclictest19253-21perl10:40:140
2245399202,12cyclictest0-21swapper/311:36:153
2245399201,5cyclictest0-21swapper/311:54:453
22453992013,4cyclictest25922-40dnf08:30:013
2245399201,10cyclictest28696-21entropy08:35:143
2245399201,10cyclictest11670-21memory07:55:203
2245399201,10cyclictest11118-21sshd09:09:113
2245399200,10cyclictest22096-21tail12:00:173
2244899201,9cyclictest0-21swapper/207:31:362
2244899200,9cyclictest0-21swapper/208:19:362
2243199209,8cyclictest8254-21sshd07:49:120
2243199206,3cyclictest563-21pmu-power11:10:250
2243199206,3cyclictest232822expr10:50:130
2243199204,8cyclictest87550irq/128-enp1s0-10:10:150
2243199203,4cyclictest29049-21idleruntime08:35:170
2243199201,6cyclictest11-21rcuc/011:40:160
22431992015,2cyclictest0-21swapper/009:30:240
2243199201,11cyclictest4767-21head07:40:160
2243199201,11cyclictest14776-21sshd08:03:130
2243199201,10cyclictest30545-21/usr/sbin/munin08:40:150
2243199201,10cyclictest28109-21acpi12:15:130
2243199201,10cyclictest28109-21acpi12:15:130
2243199201,10cyclictest26506-21grep12:10:170
2243199201,10cyclictest13589-21grep10:25:250
63852190,3sleep30-21swapper/308:55:233
2245399197,3cyclictest25595-21sshd12:09:123
2245399197,3cyclictest1964-21/usr/sbin/munin07:35:163
2245399197,3cyclictest1964-21/usr/sbin/munin07:35:163
2245399191,9cyclictest13339-21fschecks_count08:00:153
2245399191,6cyclictest15835-21/usr/sbin/munin09:20:233
2245399191,3cyclictest26380-21grep07:15:183
2245399191,16cyclictest0-21swapper/311:25:283
2245399191,11cyclictest0-21swapper/310:15:143
2245399190,9cyclictest0-21swapper/310:12:223
2244899191,7cyclictest4781-21cat11:20:212
2243199195,3cyclictest87550irq/128-enp1s0-08:45:230
2243199195,3cyclictest87550irq/128-enp1s0-08:45:230
2243199195,3cyclictest29657-21gltestperf09:50:150
2243199194,8cyclictest0-21swapper/011:05:330
2243199194,8cyclictest0-21swapper/011:05:330
2243199194,3cyclictest87550irq/128-enp1s0-12:00:290
2243199194,3cyclictest15091-21irqstats10:30:190
2243199194,3cyclictest11207-21idleruntime-cro09:10:010
2243199193,9cyclictest0-21swapper/008:18:260
2243199191,9cyclictest22855-21munin-run10:50:010
2243199191,9cyclictest0-21swapper/012:22:290
2243199191,7cyclictest0-21swapper/011:50:140
2243199191,7cyclictest0-21swapper/011:18:010
2243199191,6cyclictest6479-21sshd08:56:130
2243199191,6cyclictest16476-21/usr/sbin/munin10:35:240
2243199191,6cyclictest10160-21expr10:20:120
2243199191,6cyclictest0-21swapper/010:09:370
2243199191,5cyclictest4721-21irqstats11:20:200
2243199191,4cyclictest0-21swapper/011:39:170
2245399181,5cyclictest1455-21fschecks_count10:00:163
22453991813,3cyclictest30524-21grep07:25:173
22453991812,5cyclictest22004-21kworker/u8:207:40:123
22453991812,4cyclictest24013-21timerandwakeup07:10:253
2245399181,15cyclictest0-21swapper/309:15:233
2245399181,14cyclictest6361-21/usr/sbin/munin07:45:133
2245399181,14cyclictest31776-21find08:40:263
22453991811,4cyclictest27844-21cut07:20:133
2245399181,11cyclictest0-21swapper/311:40:323
2243199187,3cyclictest9863-21unixbench_singl11:30:270
2243199187,3cyclictest29929-21/usr/sbin/munin07:25:210
2243199184,3cyclictest207672grep11:55:270
2243199183,3cyclictest87350irq/126-enp1s0-12:35:170
2243199182,9cyclictest18245-1kworker/u9:209:40:560
2243199181,9cyclictest3385-21grep12:30:230
2243199181,9cyclictest0-21swapper/009:37:240
2243199181,10cyclictest0-21swapper/008:25:260
2245399172,12cyclictest20872-21gltestperf09:30:173
2245399171,2cyclictest0-21swapper/308:15:253
2243199174,7cyclictest87550irq/128-enp1s0-09:10:490
2243199174,3cyclictest0-21swapper/009:16:330
2243199173,8cyclictest0-21swapper/010:15:160
2243199172,3cyclictest32586-21threads09:55:250
2243199172,3cyclictest32586-21threads09:55:240
2243199172,3cyclictest0-21swapper/011:00:280
2243199172,12cyclictest3735-21pmu-power08:50:230
2243199171,9cyclictest0-21swapper/010:00:020
2243199171,8cyclictest12725-21sadc08:00:010
22431991713,2cyclictest10102sleep007:30:240
22431991711,3cyclictest17546-21expr08:10:120
22431991711,3cyclictest11193-21diskmemload12:25:180
2245399161,8cyclictest0-21swapper/308:05:273
22431991612,2cyclictest21741-21/usr/sbin/munin08:20:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional