You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 09:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu Aug 13, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22141022620,3sleep0201rcuc/022:22:480
22827622610,2sleep3471rcuc/323:32:453
2021569996151,7cyclictest2342020-21latency_hist00:30:000
2021569995652,3cyclictest2276751-21kworker/u8:3+events_unbound23:42:590
2021569995645,4cyclictest2002214-21kworker/u8:1+events_unbound19:43:010
20216132550,3chrt0-21swapper/119:10:011
2021569995551,3cyclictest2257075-21kworker/u8:1+events_unbound23:28:000
2021569995450,3cyclictest2202377-21kworker/u8:3+events_unbound22:48:000
2021569995450,3cyclictest2202377-21kworker/u8:3+events_unbound22:48:000
2021569995446,6cyclictest2351941-21latency_hist00:40:010
22983912520,4chrt0-21swapper/323:47:503
2021569995242,3cyclictest2257075-21kworker/u8:1+events_unbound23:37:460
2021569995046,3cyclictest2296798-21kworker/u8:2+events_unbound23:52:580
2021569995046,3cyclictest2296798-21kworker/u8:2+events_unbound23:48:020
2021569995046,3cyclictest2016518-21kworker/u8:2+events_unbound19:22:590
2021569995045,4cyclictest2016518-21kworker/u8:2+events_unbound19:17:450
22151122490,4chrt0-21swapper/122:22:491
2021574994940,7cyclictest2276217-21ntpq23:22:561
2021569994945,3cyclictest2242532-21kworker/u8:2+events_unbound22:56:000
2021569994945,3cyclictest2073099-21kworker/u8:2+events_unbound20:12:330
2021569994844,3cyclictest2257075-21kworker/u8:1+events_unbound00:13:040
2021569994843,4cyclictest2276751-21kworker/u8:3+events_unbound00:00:010
2021569994743,3cyclictest2242532-21kworker/u8:2+events_unbound23:31:000
2021569994743,3cyclictest2073099-21kworker/u8:2+events_unbound20:23:000
2021569994743,3cyclictest2073099-21kworker/u8:2+events_unbound20:16:210
2021569994742,3cyclictest2317489-21kworker/u8:2+events_unbound00:07:510
2021569994642,3cyclictest677580-21kworker/u8:4+events_unbound20:31:230
2021569994642,3cyclictest2317489-21kworker/u8:2+events_unbound00:23:550
2021569994637,4cyclictest677580-21kworker/u8:4+events_unbound20:06:160
2021574994536,6cyclictest2287447-21/usr/sbin/munin23:37:541
2021569994541,3cyclictest2202377-21kworker/u8:3+events_unbound22:40:000
2021569994541,3cyclictest2187653-21kworker/u8:1+flush-8:021:59:590
2021569994541,3cyclictest2142055-21kworker/u8:1+events_unbound21:38:590
2021569994541,3cyclictest2113144-21kworker/u8:0+events_unbound21:06:460
2021578994437,5cyclictest275-21systemd-journal20:15:002
2021574994435,7cyclictest2033279-21latency_hist19:20:011
2021574994434,8cyclictest2211517-21ntpq22:17:531
2021574994434,7cyclictest275-21systemd-journal21:42:521
2021569994440,3cyclictest2257075-21kworker/u8:1+events_unbound00:19:540
2021569994440,3cyclictest2142055-21kworker/u8:1+flush-8:021:23:020
2021569994440,3cyclictest2073099-21kworker/u8:2+events_unbound21:04:460
2021569994437,3cyclictest2257075-21kworker/u8:1+events_unbound00:02:460
2021569994435,7cyclictest2072847-21latency_hist20:00:010
2021574994335,6cyclictest2043599-21/usr/sbin/munin19:33:001
2021569994339,3cyclictest677580-21kworker/u8:4+events_unbound20:46:250
2021569994339,3cyclictest2257075-21kworker/u8:1+events_unbound23:19:000
2021569994339,3cyclictest2187653-21kworker/u8:1+events_unbound22:12:450
2021569994339,3cyclictest2113144-21kworker/u8:0+events_unbound21:45:080
2021569994338,4cyclictest2182251-21kworker/u8:2+events_unbound22:02:560
2021569994335,3cyclictest2182251-21kworker/u8:2+events_unbound22:07:450
2021569994239,2cyclictest2002214-21kworker/u8:1+events_unbound19:37:460
2021569994238,3cyclictest2113144-21kworker/u8:0+events_unbound20:58:020
2021569994237,4cyclictest2336904-21kworker/u8:3+events_unbound00:32:450
2021569994236,2cyclictest2058265-21kworker/u8:2+events_unbound19:52:490
2021574994132,7cyclictest2093107-21apt-get20:22:421
2021574994132,6cyclictest2307486-21/usr/sbin/munin23:57:521
2021569994137,3cyclictest677580-21kworker/u8:4+events_unbound19:25:170
2021569994137,3cyclictest2113144-21kworker/u8:0+events_unbound21:17:490
2021569994134,3cyclictest2216538-21kworker/u8:0+events_unbound22:42:470
2021574994035,4cyclictest2336904-21kworker/u8:3+events_unbound00:35:581
2021574994031,7cyclictest2113336-21/usr/sbin/munin20:42:551
2021569994036,3cyclictest677580-21kworker/u8:4+events_unbound20:29:220
2021569994036,3cyclictest2113144-21kworker/u8:0+events_unbound21:43:200
2021569994030,8cyclictest2277012-21cp23:25:010
2021569993935,3cyclictest2216538-21kworker/u8:0+events_unbound23:01:000
2021569993935,3cyclictest2113144-21kworker/u8:0+events_unbound20:42:230
2021569993935,3cyclictest2073099-21kworker/u8:2+events_unbound21:25:560
2021569993935,3cyclictest2073099-21kworker/u8:2+events_unbound21:11:450
2021569993932,3cyclictest677580-21kworker/u8:4+events_unbound19:47:590
2021574993828,7cyclictest2086999-21ntpq20:12:561
2021574993811,14cyclictest573-21runrttasks00:17:431
2021569993835,2cyclictest2073099-21kworker/u8:2+events_unbound20:35:030
2021569993834,3cyclictest2073099-21kworker/u8:2+events_unbound20:02:330
2021569993834,3cyclictest2016518-21kworker/u8:2+events_unbound19:10:250
2021569993831,5cyclictest2167336-21latency_hist21:35:010
2021569993831,3cyclictest2182251-21kworker/u8:2+events_unbound22:27:450
2021574993731,4cyclictest2282536-21apt-get23:32:421
2021569993733,3cyclictest2202377-21kworker/u8:3+events_unbound22:15:590
2021569993733,3cyclictest2002214-21kworker/u8:1+events_unbound19:31:090
2021574993628,6cyclictest2072093-21ntpq19:57:541
2021574993627,6cyclictest2271940-21latency_hist23:20:011
2021574993627,6cyclictest2192287-21latency_hist22:00:011
2021574993623,9cyclictest275-21systemd-journal22:48:041
2021574993623,9cyclictest275-21systemd-journal22:48:041
2021569993632,3cyclictest677580-21kworker/u8:4+events_unbound20:52:410
2021569993632,3cyclictest2257075-21kworker/u8:1+events_unbound23:14:010
2021569993632,3cyclictest2202377-21kworker/u8:3+flush-8:022:31:590
2021574993532,2cyclictest2321430-21needreboot00:07:541
2021574993528,5cyclictest2053536-21apt-get19:42:411
2021569993532,2cyclictest2242532-21kworker/u8:2+events_unbound22:53:590
2021569993531,3cyclictest2257075-21kworker/u8:1+events_unbound23:06:060
2021569993531,3cyclictest2113144-21kworker/u8:0+events_unbound21:52:470
2021578993427,5cyclictest2277344-21base6423:25:012
2021574993328,3cyclictest2232141-21unixbench_singl22:38:011
2021574993328,3cyclictest2167332-21cron21:35:001
2021574993327,4cyclictest2058704-21cpuspeed_turbos19:47:451
2021574993323,8cyclictest2226625-21ntpq22:32:541
2021574993225,5cyclictest412-21smartd20:07:171
2021574993225,5cyclictest2098300-21apt-get20:27:421
2021574993225,5cyclictest2042404-21ntpq19:27:531
2021574993220,8cyclictest2306827-21latency_hist23:55:011
2021569993227,3cyclictest2021574-21cyclictest19:10:010
2021574993124,5cyclictest275-21systemd-journal21:23:551
20650632300,8sleep3451irq_work/319:52:523
2021578993026,3cyclictest2016518-21kworker/u8:2+flush-8:019:20:002
202157499303,7cyclictest2301984-21sort23:50:011
2021574993026,3cyclictest2053075-21systemctl19:40:011
2021574993026,2cyclictest2138773-21irqrtprio21:07:481
2021574993024,4cyclictest573-21runrttasks23:28:001
202157499301,17cyclictest2103387-21runrttasks20:32:001
202157499300,17cyclictest2256378-21ntpq23:02:531
2021578992923,4cyclictest2152217-21unixbench_singl21:18:022
202157499295,13cyclictest2182900-21cut21:52:431
202157499295,13cyclictest2064542-21cat19:52:521
2021574992925,3cyclictest2143713-21irqrtprio21:12:481
2021574992923,4cyclictest2317365-21apt-key00:05:011
2021574992920,7cyclictest2026428-21latency_hist19:15:011
2021578992825,2cyclictest2052816-21unixbench_multi19:38:022
2021578992824,2cyclictest2143207-21cpuspeed_turbos21:12:432
2021578992823,3cyclictest2291720-21unixbench_singl23:38:022
2021578992821,5cyclictest2342765-21fschecks_count00:32:462
202157499285,12cyclictest2162363-21idleruntime-cro21:30:001
2021574992824,2cyclictest2178216-21cut21:47:461
2021574992824,2cyclictest0-21swapper/120:17:481
2021574992819,6cyclictest275-21systemd-journal22:43:591
2021574992815,4cyclictest161rcu_preempt00:12:541
202157499280,11cyclictest2198407-21irqrtprio22:07:511
2021578992724,2cyclictest2026212-21unixbench_singl19:13:022
202157499273,5cyclictest2218146-21grep22:27:441
2021574992718,3cyclictest161rcu_preempt20:52:431
2021574992715,4cyclictest161rcu_preempt23:10:011
2021578992623,2cyclictest0-21swapper/219:43:002
2021578992622,3cyclictest2067882-21turbostat.cron19:55:002
2021578992621,4cyclictest2207104-21idleruntime-cro22:15:002
2021578992621,4cyclictest2102850-21base6420:30:012
202157499269,9cyclictest0-21swapper/121:00:171
202157499268,6cyclictest0-21swapper/119:22:561
202157499265,12cyclictest30-21ksoftirqd/122:11:171
202157499264,12cyclictest573-21runrttasks23:42:561
202157499264,12cyclictest2243050-21fschecks_time22:52:461
202157499264,12cyclictest2168801-21kthreadcore21:37:501
202157499264,11cyclictest2118539-21grep20:47:431
202157499262,10cyclictest2251415-21ntpq22:57:531
2021574992616,3cyclictest161rcu_preempt20:05:011
2021574992614,9cyclictest275-21systemd-journal22:02:551
202157499260,10cyclictest2151141-21kthreadcore21:17:521
202157499254,10cyclictest2108275-21runrttasks20:36:221
202157499253,11cyclictest0-21swapper/100:22:561
202157499253,10cyclictest2342478-21apt-get00:32:431
2021574992520,2cyclictest0-21swapper/123:07:461
202157499250,9cyclictest2128413-21cpuspeed_turbos20:57:441
202157499250,11cyclictest2337388-21runrttasks00:26:191
2021578992420,3cyclictest2133408-21fschecks_count21:02:472
2021578992420,2cyclictest2317914-21cpuspeed_turbos00:07:452
2021578992418,5cyclictest2192980-21cpuspeed_turbos22:02:462
2021578992417,5cyclictest2097894-21cat20:25:012
2021578992319,2cyclictest2123365-21aten2_r5power_v20:52:432
2021578992318,3cyclictest2089072-21kthreadcore20:17:492
202157899224,3cyclictest23305062grep00:17:522
2021578992219,2cyclictest2307730-21cpuspeed_turbos23:57:432
2021578992219,2cyclictest2277825-21cpuspeed_turbos23:27:452
2021578992219,2cyclictest2038950-21fschecks_count19:27:452
2021578992217,3cyclictest2242762-21aten2_r5power_c22:52:432
2021578992217,3cyclictest2207849-21aten2_r5power_e22:17:432
20997832210,11sleep3575-21kworker/3:2+mm_percpu_wq20:27:513
2021578992118,2cyclictest2302351-21aten2_r5power_c23:52:422
2021578992117,2cyclictest0-21swapper/222:22:512
2021578992117,2cyclictest0-21swapper/200:25:002
2021578992115,5cyclictest2142055-21kworker/u8:1+flush-8:021:47:562
202157899210,11cyclictest22944631kthreadcore23:42:502
20166552212,9sleep30-21swapper/319:05:023
2021578992016,3cyclictest2237882-21aten2_r5power_p22:47:442
2021578992016,3cyclictest2237882-21aten2_r5power_p22:47:442
2021578992016,2cyclictest0-21swapper/220:38:012
2021578992016,2cyclictest0-21swapper/219:32:512
2021578992015,4cyclictest2062969-21turbostat.cron19:50:002
2021578992015,3cyclictest0-21swapper/220:33:022
2021578992015,3cyclictest0-21swapper/220:05:002
2021578992013,5cyclictest275-21systemd-journal23:46:592
2021578992013,5cyclictest275-21systemd-journal00:30:002
20168042204,12sleep20-21swapper/219:06:052
2021578991916,2cyclictest2173091-21fschecks_time21:42:472
2021578991915,3cyclictest2163157-21fschecks_time21:32:482
2021578991915,2cyclictest0-21swapper/222:27:592
2021578991914,4cyclictest677580-21kworker/u8:4+flush-8:020:47:532
2021578991913,4cyclictest2247921-21tr22:57:432
2021578991912,5cyclictest2159165-21grep21:27:512
202157899189,2cyclictest0-21swapper/223:02:522
202157899184,2cyclictest20796662cat20:07:502
2021578991816,1cyclictest2073099-21kworker/u8:2+flush-8:021:07:492
2021578991815,2cyclictest2262570-21aten2_r5power_c23:12:442
2021578991814,3cyclictest2222988-21aten2_r5power_v22:32:442
2021578991814,2cyclictest0-21swapper/223:17:492
2021578991814,2cyclictest0-21swapper/200:02:462
2021578991813,3cyclictest0-21swapper/219:23:012
202157899172,11cyclictest2286334-21ntpq23:32:572
2021578991714,2cyclictest2168003-21cpuspeed_turbos21:37:452
2021578991713,2cyclictest0-21swapper/200:12:482
2021578991711,4cyclictest0-21swapper/221:57:432
202157899166,8cyclictest2132480-21awk20:58:022
2021578991613,2cyclictest2068566-21cpuspeed_turbos19:57:452
2021578991612,2cyclictest0-21swapper/223:07:452
2021578991612,2cyclictest0-21swapper/220:43:012
2021578991612,2cyclictest0-21swapper/200:37:552
2021578991611,3cyclictest0-21swapper/221:22:502
20819432152,9sleep30-21swapper/320:07:543
202157899157,6cyclictest2234916-21tr22:42:502
2021578991511,2cyclictest0-21swapper/222:07:452
202157899151,10cyclictest2227835-21apt-get22:37:422
2021578991510,3cyclictest0-21swapper/221:52:502
23262682145,6sleep30-21swapper/300:12:583
22926462132,7sleep30-21swapper/323:42:453
22136262134,5sleep30-21swapper/322:22:483
21922652132,6sleep30-21swapper/322:00:013
21533692133,7sleep30-21swapper/321:22:493
21524192132,6sleep30-21swapper/321:20:013
21221892132,7sleep30-21swapper/320:47:583
20939902132,7sleep30-21swapper/320:22:513
20629602132,6sleep30-21swapper/319:50:003
23514582122,6sleep30-21swapper/300:38:033
23469592122,6sleep30-21swapper/300:34:573
23275242122,6sleep30-21swapper/300:17:003
23122722122,5sleep30-21swapper/300:00:023
23059282122,6sleep30-21swapper/323:52:523
22917622122,6sleep30-21swapper/323:38:043
22720392122,5sleep30-21swapper/323:20:023
22681082122,5sleep30-21swapper/323:17:503
22670032123,5sleep30-21swapper/323:15:003
22586612122,6sleep30-21swapper/323:07:503
22417162122,6sleep30-21swapper/322:48:003
22417162122,6sleep30-21swapper/322:48:003
22208632122,6sleep30-21swapper/322:27:543
22016742122,6sleep30-21swapper/322:08:033
21824392122,6sleep30-21swapper/321:50:023
21770672122,6sleep30-21swapper/321:43:043
21718042122,6sleep30-21swapper/321:38:023
21574152122,6sleep30-21swapper/321:25:023
21433372122,6sleep30-21swapper/321:12:463
21375092122,6sleep30-21swapper/321:04:033
21277162122,5sleep30-21swapper/320:55:013
21171282122,6sleep30-21swapper/320:42:573
21039402122,6sleep30-21swapper/320:32:503
20679102122,6sleep30-21swapper/319:55:023
20577412122,6sleep30-21swapper/319:43:023
20375032122,6sleep30-21swapper/319:22:563
20264522122,5sleep30-21swapper/319:15:013
20244252122,5sleep30-21swapper/319:12:533
23320952112,5sleep30-21swapper/300:20:013
23175072112,6sleep30-21swapper/300:05:363
23118362112,5sleep30-21swapper/323:58:023
22775152113,5sleep30-21swapper/323:26:563
22524872112,5sleep30-21swapper/323:01:003
22521252112,6sleep30-21swapper/322:59:363
22422632112,5sleep30-21swapper/322:50:013
22324722112,5sleep30-21swapper/322:40:013
22316552112,5sleep30-21swapper/322:37:573
22226462112,5sleep30-21swapper/322:30:023
22076132112,5sleep30-21swapper/322:15:463
22024252112,5sleep30-21swapper/322:10:483
21965292112,5sleep30-21swapper/322:02:583
21777052112,5sleep30-21swapper/321:45:083
21625842112,6sleep30-21swapper/321:30:123
21378272112,6sleep30-21swapper/321:05:083
21281582112,5sleep30-21swapper/320:57:413
21081712112,5sleep30-21swapper/320:35:023
20921922112,5sleep30-21swapper/320:18:013
20835682112,5sleep30-21swapper/320:12:473
20732582112,5sleep30-21swapper/320:02:163
20483872112,6sleep30-21swapper/319:35:323
20438802112,5sleep30-21swapper/319:32:473
20425142112,5sleep30-21swapper/319:27:573
23372932102,5sleep30-21swapper/300:25:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional