You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 16:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Aug 24, 2026 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
82806199112108,3cyclictest0-21swapper/112:32:441
82806199112108,3cyclictest0-21swapper/112:32:441
828059996656,7cyclictest1072675-21latency_hist11:15:010
11318142600,4chrt0-21swapper/112:12:541
828059995953,4cyclictest854523-21kworker/u8:3+events_unbound08:40:000
828059995953,4cyclictest854523-21kworker/u8:3+events_unbound08:40:000
828061995649,5cyclictest1053405-21apt-get10:57:321
828059995443,8cyclictest1121575-21ntpq12:02:470
828061995042,6cyclictest1038146-21latency_hist10:40:001
828059995043,5cyclictest36616-21kworker/u8:2+flush-8:008:07:390
828059995034,15cyclictest0-21swapper/012:32:440
828059995034,15cyclictest0-21swapper/012:32:440
828066994637,7cyclictest1137211-21awk12:20:002
828066994433,8cyclictest903478-21ntpq08:22:462
828061994434,8cyclictest938315-21ntpq08:57:491
828061994429,5cyclictest929649-21apt-get08:52:341
828059994432,9cyclictest275-21systemd-journal11:05:010
828059994338,3cyclictest775982-21kworker/u8:1+events_unbound10:05:000
828059994337,4cyclictest275-21systemd-journal08:48:310
828066994236,3cyclictest1151194-21strings12:32:442
828066994236,3cyclictest1151194-21strings12:32:442
828066994235,5cyclictest36616-21kworker/u8:2+flush-8:008:17:392
828059994238,3cyclictest854523-21kworker/u8:3+flush-8:008:32:390
828059994238,3cyclictest854523-21kworker/u8:3+flush-8:008:32:390
828059994232,7cyclictest275-21systemd-journal08:42:400
828061994134,4cyclictest1137182-21latency_hist12:20:011
828061994130,8cyclictest275-21systemd-journal07:55:001
828059994136,4cyclictest973935-21kworker/u8:0+flush-8:009:37:520
828059994135,4cyclictest775982-21kworker/u8:1+flush-8:007:47:360
828059994131,8cyclictest973935-21kworker/u8:0+flush-8:011:20:020
828061994031,7cyclictest1111727-21ntpq11:52:471
828061993931,6cyclictest973935-21kworker/u8:0+flush-8:011:27:511
828059993934,3cyclictest36828-21kworker/u8:3+flush-8:007:20:310
828059993933,4cyclictest893650-21ntpq08:12:490
828061993830,6cyclictest275-21systemd-journal10:33:311
828061993830,6cyclictest275-21systemd-journal10:33:311
828059993827,8cyclictest1023085-21latency_hist10:25:000
82805999381,34cyclictest1-21systemd07:36:310
828066993726,8cyclictest1142131-21awk12:25:002
828061993729,6cyclictest1122334-21latency_hist12:05:011
828061993729,6cyclictest1008281-21latency_hist10:10:011
828061993723,10cyclictest1077593-21apt-get11:20:001
828059993733,3cyclictest36616-21kworker/u8:2+flush-8:008:02:380
828059993730,5cyclictest775982-21kworker/u8:1+flush-8:007:15:060
828059993729,5cyclictest993466-21latency_hist09:55:010
828059993728,7cyclictest1093356-21diskstats11:37:370
828066993630,5cyclictest36616-21kworker/u8:2+flush-8:007:12:372
828066993625,8cyclictest1027545-21ntpq10:27:472
828061993626,8cyclictest1156243-21ntpq12:37:501
828061993622,7cyclictest1117335-21latency_hist12:00:011
828059993631,4cyclictest924089-21kworker/u8:2+events_unbound08:57:430
828059993629,5cyclictest1033073-21kworker/u8:2+events_unbound11:20:000
828061993526,7cyclictest1062056-21ntpq11:02:461
828059993529,4cyclictest1106679-21kworker/u8:3+flush-8:011:52:360
828059993527,6cyclictest775982-21kworker/u8:1+flush-8:009:12:480
8277932354,9sleep10-21swapper/107:08:321
828061993430,2cyclictest836032-21irqrtprio07:17:411
828061993428,4cyclictest275-21systemd-journal09:26:301
828066993328,3cyclictest36828-21kworker/u8:3+flush-8:007:22:402
828061993328,3cyclictest1098124-21aten2_r5power_p11:42:361
828061993326,5cyclictest973713-21latency_hist09:35:011
828059993329,2cyclictest1-21systemd07:14:310
828059993327,4cyclictest854523-21kworker/u8:3+flush-8:007:52:510
828066993228,3cyclictest1127283-21cron12:10:002
828066993223,7cyclictest275-21systemd-journal11:01:302
828061993229,2cyclictest1014381-21irqrtprio10:17:411
828061993225,5cyclictest1067738-21latency_hist11:10:011
828059993227,4cyclictest854523-21kworker/u8:3+events_unbound08:27:490
828059993227,4cyclictest854523-21kworker/u8:3+events_unbound08:27:490
828059993227,3cyclictest973935-21kworker/u8:0+flush-8:011:45:310
828059993223,6cyclictest879532-21latency_hist08:00:010
828066993122,7cyclictest1077581-21cron11:20:002
828061993126,3cyclictest1082515-21unixbench_multi11:22:541
828059993127,3cyclictest1152736-21cut12:37:390
828059993126,4cyclictest775982-21kworker/u8:1+flush-8:010:12:440
828066993019,9cyclictest913462-21ntpq08:32:512
828066993019,9cyclictest913462-21ntpq08:32:512
828061993026,2cyclictest0-21swapper/108:00:001
828061993022,2cyclictest161rcu_preempt10:47:371
828061993021,7cyclictest1003355-21latency_hist10:05:011
828059993026,3cyclictest775982-21kworker/u8:1+flush-8:010:16:010
828059993026,2cyclictest1123501-21irqrtprio12:07:410
828059993024,5cyclictest844083-21kworker/u8:0+flush-8:007:27:360
828059993024,4cyclictest959139-21kworker/u8:3+flush-8:009:22:410
828059993023,5cyclictest1063248-21/usr/sbin/munin11:07:470
828059993022,6cyclictest973935-21kworker/u8:0+flush-8:010:25:020
8278712304,9sleep20-21swapper/207:09:332
828066992925,2cyclictest989052-21aten2_r5power_e09:52:362
828066992925,2cyclictest939594-21aten2_r5power_e09:02:352
828066992924,3cyclictest839801-21sendmail07:20:002
82806199296,16cyclictest918876-21sed08:37:531
82806199296,16cyclictest918876-21sed08:37:531
828061992923,4cyclictest844509-21unixbench_multi07:22:521
828061992923,4cyclictest1042902-21grep10:42:531
828061992922,5cyclictest904676-21apt-get08:27:331
828061992922,5cyclictest904676-21apt-get08:27:331
828061992922,5cyclictest275-21systemd-journal09:13:311
828061992921,2cyclictest161rcu_preempt11:37:501
828059992923,4cyclictest973935-21kworker/u8:0+flush-8:010:42:510
828059992923,4cyclictest775982-21kworker/u8:1+events_unbound10:52:330
828066992822,4cyclictest20823-21cron07:50:002
828061992824,2cyclictest979434-21cut09:42:361
828061992818,4cyclictest161rcu_preempt07:27:451
828059992822,5cyclictest775982-21kworker/u8:1+events_unbound09:02:480
828059992817,9cyclictest1043540-21/usr/sbin/munin10:47:460
82805999281,26cyclictest0-21swapper/009:42:500
828066992722,4cyclictest973935-21kworker/u8:0+flush-8:010:47:522
828066992722,4cyclictest775982-21kworker/u8:1+flush-8:009:28:192
828066992722,4cyclictest1033073-21kworker/u8:2+flush-8:012:12:442
828066992721,4cyclictest0-21swapper/210:40:002
828066992710,4cyclictest0-21swapper/212:37:482
828061992723,3cyclictest860180-21aten2_r5power_c07:42:361
828061992722,3cyclictest960241-21kthreadcore09:22:411
828061992720,5cyclictest1141403-21ntpq12:22:471
828061992719,2cyclictest161rcu_preempt08:50:011
828061992718,1cyclictest161rcu_preempt07:48:301
828061992716,8cyclictest275-21systemd-journal07:40:001
828059992721,4cyclictest973935-21kworker/u8:0+events_unbound10:37:420
828059992721,4cyclictest973935-21kworker/u8:0+events_unbound09:47:490
828059992721,4cyclictest36616-21kworker/u8:2+flush-8:008:22:480
828059992720,5cyclictest275-21systemd-journal10:57:590
828059992720,5cyclictest1033073-21kworker/u8:2+flush-8:012:17:450
828059992717,7cyclictest1033073-21kworker/u8:2+events_unbound12:22:340
828066992623,2cyclictest845447-21cpuspeed_turbos07:27:372
828066992622,3cyclictest775982-21kworker/u8:1+flush-8:008:52:422
828066992622,2cyclictest0-21swapper/211:55:002
828066992621,4cyclictest973935-21kworker/u8:0+flush-8:012:02:492
828066992619,5cyclictest1029418-21grep10:32:412
828066992619,5cyclictest1029418-21grep10:32:412
82806199267,7cyclictest997865-21find09:57:531
82806199264,9cyclictest30-21ksoftirqd/108:02:421
828061992622,2cyclictest1091533-21kthreadcore11:32:451
828061992622,2cyclictest0-21swapper/108:12:421
828061992620,4cyclictest1106679-21kworker/u8:3+flush-8:012:27:541
828061992620,4cyclictest1013232-21systemd-run10:15:001
828061992619,2cyclictest161rcu_preempt09:09:401
828061992619,2cyclictest161rcu_preempt08:42:531
828061992618,6cyclictest899745-21apt-get08:22:331
828061992618,2cyclictest161rcu_preempt11:12:481
828061992618,1cyclictest161rcu_preempt08:17:391
828059992621,4cyclictest852011-21kthreadcore07:32:430
828059992619,5cyclictest959139-21kworker/u8:3+events_unbound10:07:500
828066992522,2cyclictest870165-21aten2_r5power_e07:52:362
828066992521,3cyclictest973935-21kworker/u8:0+flush-8:011:42:422
828066992521,2cyclictest1053436-21aten2_r5power_c10:57:342
828066992520,4cyclictest775982-21kworker/u8:1+flush-8:011:47:462
828066992514,9cyclictest963093-21ntpq09:22:472
82806199258,3cyclictest161rcu_preempt07:32:341
82806199258,10cyclictest30-21ksoftirqd/109:20:001
82806199257,11cyclictest30-21ksoftirqd/108:35:001
82806199257,11cyclictest30-21ksoftirqd/108:35:001
82806199256,5cyclictest978008-21ld09:37:491
82806199256,10cyclictest0-21swapper/109:47:441
828061992516,2cyclictest161rcu_preempt07:13:351
828061992511,2cyclictest0-21swapper/112:07:411
828061992510,3cyclictest0-21swapper/109:52:531
828059992520,3cyclictest994831-21kthreadcore09:57:430
828059992520,3cyclictest1032380-21needreboot10:32:450
828059992520,3cyclictest1032380-21needreboot10:32:450
828059992520,3cyclictest0-21swapper/011:30:000
828059992519,4cyclictest973935-21kworker/u8:0+events_unbound12:27:460
82805999251,23cyclictest0-21swapper/011:32:530
8273552253,15sleep0827436-21python307:07:510
11309862250,4sleep0201rcuc/012:12:450
828066992421,2cyclictest924909-21cpuspeed_turbos08:47:362
828066992420,3cyclictest1048586-21aten2_r5power_v10:52:352
828066992420,2cyclictest0-21swapper/210:20:002
82806199247,3cyclictest161rcu_preempt10:52:331
828061992421,2cyclictest944032-21munin-run09:05:001
82806199242,11cyclictest884818-21runrttasks08:06:121
828061992410,3cyclictest1103466-21cat11:47:411
828059992420,2cyclictest0-21swapper/009:20:000
828059992419,3cyclictest849-21mta-sts-daemon11:45:000
828059992418,4cyclictest946339-21kthreadcore09:07:430
828059992417,5cyclictest775982-21kworker/u8:1+events_unbound09:27:470
82806699235,3cyclictest10393632cut10:42:412
828066992318,3cyclictest1067523-21unixbench_singl11:07:562
828066992318,3cyclictest0-21swapper/208:15:002
828066992317,4cyclictest1086889-21head11:27:452
82806199237,5cyclictest0-21swapper/110:22:351
82806199235,6cyclictest30-21ksoftirqd/110:27:411
828059992319,3cyclictest1033073-21kworker/u8:2+events_unbound11:57:400
828059992316,4cyclictest0-21swapper/008:17:350
828059992314,7cyclictest969565-21grep09:32:380
82805999230,22cyclictest934009-21sshd08:53:310
828066992218,3cyclictest973935-21kworker/u8:0+flush-8:011:25:012
828066992218,2cyclictest993991-21aten2_r5power_p09:57:362
828066992118,2cyclictest969329-21aten2_r5power_v09:32:362
828066992118,2cyclictest880260-21fschecks_count08:02:372
828066992118,2cyclictest850532-21fschecks_time07:32:392
828066992117,3cyclictest854523-21kworker/u8:3+events_unbound08:37:522
828066992117,3cyclictest854523-21kworker/u8:3+events_unbound08:37:522
828066992117,2cyclictest0-21swapper/209:45:002
828066992117,2cyclictest0-21swapper/207:57:332
828066992116,4cyclictest1117341-21sendmail12:00:002
82806699211,2cyclictest11447781kthreadcore12:27:422
828066992015,4cyclictest775982-21kworker/u8:1+events_unbound08:43:322
828066992013,5cyclictest1012278-21latency10:12:452
828059992016,3cyclictest854523-21kworker/u8:3+events_unbound07:41:310
828066991915,2cyclictest0-21swapper/211:12:352
828066991911,6cyclictest974122-21sshd09:37:312
8277472193,9sleep30-21swapper/307:07:583
82806699182,6cyclictest0-21swapper/209:13:192
828066991815,2cyclictest0-21swapper/209:50:012
828066991813,4cyclictest854523-21kworker/u8:3+flush-8:007:40:022
828066991813,4cyclictest854523-21kworker/u8:3+events_unbound08:30:002
828066991813,4cyclictest854523-21kworker/u8:3+events_unbound08:30:002
828066991813,3cyclictest1093192-21aten2_r5power_p11:37:352
828066991813,3cyclictest1019293-21irqcore10:22:382
82806699173,4cyclictest0-21swapper/211:32:512
82806699172,5cyclictest0-21swapper/209:15:592
828066991714,2cyclictest0-21swapper/210:10:002
828066991712,3cyclictest0-21swapper/209:07:422
82806699171,11cyclictest858930-21ntpq07:37:452
82806699162,13cyclictest0-21swapper/208:55:402
828066991613,2cyclictest0-21swapper/208:06:452
9889972152,8sleep30-21swapper/309:52:353
82806699152,4cyclictest0-21swapper/210:01:022
8691652143,7sleep30-21swapper/307:47:513
9985932132,6sleep30-21swapper/310:00:023
9737322132,6sleep30-21swapper/309:35:023
9192782132,7sleep30-21swapper/308:40:003
9192782132,7sleep30-21swapper/308:40:003
8904522132,7sleep30-21swapper/308:12:433
11078852132,7sleep30-21swapper/311:52:343
10632472134,5sleep30-21swapper/311:07:363
10592332132,7sleep30-21swapper/311:02:423
9884982122,6sleep30-21swapper/309:49:303
9800072122,6sleep30-21swapper/309:42:403
9732132123,5sleep30-21swapper/309:32:533
9634032122,6sleep30-21swapper/309:22:543
9583722122,6sleep30-21swapper/309:17:523
9489802122,6sleep30-21swapper/309:10:013
9392492122,5sleep30-21swapper/309:00:023
9296172122,6sleep30-21swapper/308:52:323
9084092122,6sleep30-21swapper/308:27:483
9084092122,6sleep30-21swapper/308:27:483
8948192122,6sleep30-21swapper/308:17:363
8844912122,6sleep30-21swapper/308:05:003
8746132122,5sleep30-21swapper/307:55:013
8589742122,6sleep30-21swapper/307:37:483
8537732123,6sleep30-21swapper/307:32:463
8475232122,6sleep30-21swapper/307:27:443
8284002122,6sleep30-21swapper/307:12:313
11518902124,5sleep30-21swapper/312:33:443
11518902124,5sleep30-21swapper/312:33:443
11415222122,6sleep30-21swapper/312:22:523
11225532122,5sleep30-21swapper/312:05:023
11128082123,6sleep30-21swapper/311:57:323
10978182122,6sleep30-21swapper/311:40:023
10894182122,7sleep30-21swapper/311:32:443
10570692122,6sleep30-21swapper/310:57:443
10480562122,6sleep30-21swapper/310:50:023
10425502122,6sleep30-21swapper/310:42:523
10370942122,6sleep30-21swapper/310:37:463
10285872122,6sleep30-21swapper/310:31:323
10285872122,6sleep30-21swapper/310:31:323
10152122122,6sleep30-21swapper/310:17:433
10075352122,6sleep30-21swapper/310:07:483
9943272112,5sleep30-21swapper/309:57:413
9640372112,5sleep30-21swapper/309:25:023
9442512113,5sleep30-21swapper/309:05:043
9349562112,5sleep30-21swapper/308:57:413
9245472112,6sleep30-21swapper/308:46:023
9195582112,5sleep30-21swapper/308:40:203
9136152112,5sleep30-21swapper/308:32:533
9136152112,5sleep30-21swapper/308:32:533
8997202112,6sleep30-21swapper/308:22:343
8853322112,5sleep30-21swapper/308:07:413
8699102113,5sleep30-21swapper/307:50:243
8606322112,6sleep30-21swapper/307:42:413
8398442112,5sleep30-21swapper/307:20:023
8380442112,5sleep30-21swapper/307:17:453
11522842112,6sleep30-21swapper/312:35:483
11421182112,5sleep30-21swapper/312:25:013
11323002113,5sleep30-21swapper/312:15:013
11314842112,5sleep30-21swapper/312:12:493
11211782112,5sleep30-21swapper/312:02:453
11029772112,5sleep30-21swapper/311:47:373
10930812112,5sleep30-21swapper/311:37:333
10827572112,5sleep30-21swapper/311:25:013
10728982112,5sleep30-21swapper/311:15:063
10721072111,6sleep30-21swapper/311:12:533
10435702112,5sleep30-21swapper/310:47:373
10235532112,6sleep30-21swapper/310:25:143
10189612112,5sleep30-21swapper/310:22:373
10082962112,5sleep30-21swapper/310:10:013
10780612102,5sleep30-21swapper/311:20:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional