You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 19:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Aug 13, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9397222180,2sleep3575-21kworker/3:2+events11:57:533
40555642750,3chrt575-21kworker/3:2-events08:02:513
3999895996154,5cyclictest115620-21apt-get12:20:001
41242432570,4chrt0-21swapper/109:12:511
3999892995448,4cyclictest4150542-21base6409:40:010
41613412510,2chrt575-21kworker/3:2+events09:52:453
3999892994637,6cyclictest80754-21latency_hist11:45:010
3999895994540,3cyclictest4026788-21kworker/u8:2+events_unbound08:27:451
3999895994439,4cyclictest3182930-21kworker/u8:4+events_unbound07:15:021
3999895994437,5cyclictest3182930-21kworker/u8:4+flush-8:008:38:011
3999895994437,5cyclictest131123-21apt-get12:37:401
3999895994436,6cyclictest4026788-21kworker/u8:2+flush-8:008:52:541
3999895994338,3cyclictest41288-21kworker/u8:2+events_unbound11:22:461
3999895994338,3cyclictest4026788-21kworker/u8:2+flush-8:007:52:511
3999895994338,3cyclictest3182930-21kworker/u8:4+events_unbound08:57:531
3999895994337,4cyclictest4026788-21kworker/u8:2+flush-8:008:22:561
3999895994335,7cyclictest4026788-21kworker/u8:2+flush-8:007:36:501
3999895994335,6cyclictest4004760-21latency_hist07:15:011
3999895994235,5cyclictest3967825-21kworker/u8:1+flush-8:008:32:541
3999892994236,4cyclictest4175667-21kworker/u8:0+flush-8:010:47:500
3999895994137,3cyclictest4175667-21kworker/u8:0+events_unbound11:02:541
3999895994135,5cyclictest3182930-21kworker/u8:4+flush-8:007:57:591
3999895994135,4cyclictest4180662-21kworker/u8:3+events_unbound10:42:531
3999895994135,4cyclictest3182930-21kworker/u8:4+flush-8:009:23:021
3999895994135,4cyclictest3182930-21kworker/u8:4+flush-8:009:17:591
3999892994134,5cyclictest3182930-21kworker/u8:4+flush-8:008:37:470
3999892994133,5cyclictest65878-21latency_hist11:30:010
1051842410,4sleep10-21swapper/112:08:021
3999895994033,5cyclictest4165776-21kworker/u8:2+flush-8:010:27:561
3999895994029,3cyclictest3182930-21kworker/u8:4+flush-8:009:47:491
3999892994035,4cyclictest4026788-21kworker/u8:2+flush-8:008:12:570
3999892994032,6cyclictest105492-21latency_hist12:10:010
3999892994030,7cyclictest75772-21latency_hist11:40:010
3999897993931,6cyclictest275-21systemd-journal07:30:002
3999895993935,3cyclictest4106189-21kworker/u8:0+events_unbound09:07:461
3999895993934,3cyclictest95803-21kworker/u8:3+events_unbound12:05:011
3999895993834,3cyclictest4125933-21kworker/u8:1+flush-8:009:32:591
3999895993833,4cyclictest3182930-21kworker/u8:4+flush-8:008:17:461
3999895993831,5cyclictest3967825-21kworker/u8:1+flush-8:008:07:561
3999892993834,3cyclictest4165776-21kworker/u8:2+flush-8:010:02:490
3999892993834,3cyclictest3967825-21kworker/u8:1+events_unbound08:07:450
3999895993733,3cyclictest4140796-21kworker/u8:0+flush-8:009:42:511
3999895993732,3cyclictest86384-21diskstats11:52:441
3999895993731,4cyclictest4106189-21kworker/u8:0+events_unbound09:02:561
3999895993632,3cyclictest41288-21kworker/u8:2+events_unbound11:42:431
3999895993630,4cyclictest4016666-21kworker/u8:0+flush-8:007:28:011
3999895993629,5cyclictest41288-21kworker/u8:2+flush-8:011:29:251
3999892993627,6cyclictest85686-21latency_hist11:50:010
3999895993531,3cyclictest41288-21kworker/u8:2+events_unbound11:37:481
3999895993531,3cyclictest4026788-21kworker/u8:2+events_unbound07:47:501
3999892993529,5cyclictest3182930-21kworker/u8:4+flush-8:009:17:580
3999895993430,2cyclictest4166709-21irqrtprio09:57:481
3999895993429,4cyclictest4180662-21kworker/u8:3+events_unbound10:17:461
3999895993429,3cyclictest124926-21needreboot12:27:531
3999895993426,6cyclictest26639-21/usr/sbin/munin10:53:001
3999895993425,7cyclictest70107-21ntpq11:32:551
3999895993422,9cyclictest36077-21turbostat.cron11:00:001
3999895993422,9cyclictest36077-21turbostat.cron11:00:001
3999892993430,3cyclictest3967825-21kworker/u8:1+events_unbound07:35:000
3999892993425,7cyclictest4135601-21latency_hist09:25:000
3999892993425,7cyclictest275-21systemd-journal10:00:000
3999895993329,3cyclictest4016666-21kworker/u8:0+flush-8:007:32:481
3999895993328,3cyclictest3182930-21kworker/u8:4+flush-8:007:22:451
3999895993327,5cyclictest61155-21kworker/u8:0+flush-8:012:12:561
3999895993327,4cyclictest3967825-21kworker/u8:1+flush-8:008:42:541
3999892993328,4cyclictest3182930-21kworker/u8:4+flush-8:009:48:030
3999892993327,5cyclictest61155-21kworker/u8:0+flush-8:012:22:510
40060242320,4sleep3575-21kworker/3:2-events07:15:043
3999895993227,4cyclictest4165776-21kworker/u8:2+events_unbound10:32:551
3999895993226,5cyclictest4026788-21kworker/u8:2+events_unbound09:27:581
3999895993226,5cyclictest4026788-21kworker/u8:2+events_unbound09:27:581
3999892993226,4cyclictest45763-21unixbench_multi11:08:020
3999895993126,4cyclictest36120-21kworker/u8:1+events_unbound11:12:421
3999895993125,4cyclictest3182930-21kworker/u8:4+events_unbound09:52:451
3999895993125,4cyclictest1-21systemd11:50:001
3999892993127,2cyclictest6397-21cut10:30:010
3999892993126,4cyclictest41288-21kworker/u8:2+flush-8:011:12:450
3999892993126,4cyclictest110436-21kworker/u8:1+flush-8:012:29:500
3999892993125,4cyclictest61155-21kworker/u8:0+flush-8:012:00:000
3999892993115,6cyclictest0-21swapper/012:37:580
39996042314,10sleep20-21swapper/207:08:502
3999895993025,4cyclictest41288-21kworker/u8:2+events_unbound11:07:531
3999895993024,4cyclictest36120-21kworker/u8:1+flush-8:011:18:011
3999895993023,5cyclictest61155-21kworker/u8:0+flush-8:012:32:511
3999895993023,5cyclictest275-21systemd-journal10:12:191
3999895993022,6cyclictest4052046-21apt-get08:02:401
3999892993025,3cyclictest3182930-21kworker/u8:4+flush-8:009:07:500
3999892993024,4cyclictest4140796-21kworker/u8:0+flush-8:009:43:010
3999892993023,6cyclictest3182930-21kworker/u8:4+flush-8:008:02:450
3999892993021,6cyclictest275-21systemd-journal11:20:010
3999897992925,2cyclictest60587-21unixbench_multi11:23:022
3999897992925,2cyclictest4036279-21unixbench_multi07:43:022
3999897992925,2cyclictest4036279-21unixbench_multi07:43:022
3999897992924,3cyclictest4097425-21kthreadcore08:47:492
3999897992920,7cyclictest275-21systemd-journal10:15:002
3999895992923,4cyclictest4175880-21apt-get10:07:411
3999895992922,5cyclictest61155-21kworker/u8:0+flush-8:011:57:551
3999892992919,8cyclictest4045864-21ntpq07:52:540
3999892992919,7cyclictest4016647-21latency_hist07:25:010
399989299290,26cyclictest3985054-21kworker/0:0+events08:52:540
3999897992823,4cyclictest16308-21cron10:40:002
3999897992820,6cyclictest46693-21tr11:12:432
3999895992822,4cyclictest4125933-21kworker/u8:1+events_unbound09:37:571
3999895992821,5cyclictest4165776-21kworker/u8:2+flush-8:010:02:451
3999895992816,7cyclictest4036521-21cron07:45:001
3999895992816,7cyclictest4036521-21cron07:45:001
3999892992824,3cyclictest401-21dbus-daemon07:20:010
3999892992824,3cyclictest1265-21cron10:25:000
3999892992823,4cyclictest4026788-21kworker/u8:2+flush-8:009:28:010
3999892992823,4cyclictest4026788-21kworker/u8:2+flush-8:009:28:010
3999897992722,3cyclictest4004553-21unixbench_singl07:13:022
3999897992722,3cyclictest126465-21fschecks_count12:32:462
3999895992721,3cyclictest0-21swapper/112:22:501
3999895992720,5cyclictest4165776-21kworker/u8:2+events_unbound10:22:551
3999892992723,3cyclictest4180662-21kworker/u8:3+flush-8:010:18:020
3999892992723,3cyclictest4125933-21kworker/u8:1+flush-8:009:32:460
3999892992723,3cyclictest4106189-21kworker/u8:0+flush-8:009:14:270
3999892992723,3cyclictest4016666-21kworker/u8:0+flush-8:007:28:000
3999892992723,3cyclictest3182930-21kworker/u8:4+flush-8:008:42:480
3999892992722,4cyclictest3967825-21kworker/u8:1+events_unbound07:12:240
3999892992721,4cyclictest4180662-21kworker/u8:3+events_unbound11:00:000
3999892992721,4cyclictest4180662-21kworker/u8:3+events_unbound11:00:000
3999892992721,4cyclictest12579-21tr10:37:500
3999897992621,3cyclictest125539-21unixbench_singl12:28:032
3999895992622,3cyclictest4180662-21kworker/u8:3+flush-8:010:37:501
3999895992619,5cyclictest26199-21cron10:50:001
3999892992622,2cyclictest0-21swapper/008:35:000
3999892992621,4cyclictest4165776-21kworker/u8:2+flush-8:010:32:590
3999892992621,4cyclictest4026788-21kworker/u8:2+flush-8:008:48:000
39950612263,3sleep00-21swapper/007:05:230
3999897992521,2cyclictest22022-21fschecks_count10:47:472
3999897992520,4cyclictest135640-21munin-run12:40:002
3999897992520,3cyclictest70649-21unixbench_singl11:33:022
399989799250,11cyclictest303222sort10:52:532
3999892992521,2cyclictest850-21mta-sts-daemon07:55:550
3999892992519,5cyclictest3967825-21kworker/u8:1+flush-8:007:38:000
3999892992519,4cyclictest4180662-21kworker/u8:3+flush-8:011:02:470
3999892992519,4cyclictest4175667-21kworker/u8:0+flush-8:010:07:550
3999892992516,7cyclictest4081225-21latency_hist08:30:010
3999892992516,7cyclictest21281-21latency_hist10:45:010
3999897992421,2cyclictest96380-21fschecks_time12:02:462
3999897992420,2cyclictest4077073-21fschecks_time08:27:472
3999897992420,2cyclictest31888-21fschecks_count10:57:462
3999897992420,2cyclictest31888-21fschecks_count10:57:462
3999895992420,3cyclictest4026788-21kworker/u8:2+flush-8:008:10:301
3999895992418,4cyclictest4026788-21kworker/u8:2+events_unbound08:47:411
3999892992421,2cyclictest115794-21apt-key12:20:000
3999892992421,2cyclictest0-21swapper/011:35:010
3999892992420,3cyclictest4036945-21awk07:45:000
3999892992420,3cyclictest4036945-21awk07:45:000
3999892992419,3cyclictest96293-21fschecks_count12:02:460
3999892992419,3cyclictest4037820-21irqcore07:47:500
3999892992418,5cyclictest61155-21kworker/u8:0+events_unbound12:12:580
3999892992418,4cyclictest86194-21aten2_r5power_e11:52:410
399989799232,3cyclictest1051882timerwakeupswit12:08:022
3999897992320,2cyclictest77172-21kthreadcore11:42:492
3999897992320,2cyclictest4022151-21aten2_r5power_p07:32:432
3999897992314,7cyclictest275-21systemd-journal07:17:002
399989799230,12cyclictest112629-21grep12:17:522
3999892992319,2cyclictest4070609-21sshd08:17:570
3999892992318,3cyclictest4075471-21needreboot08:22:530
3999892992317,4cyclictest4180662-21kworker/u8:3+flush-8:011:22:450
3999892992317,4cyclictest4165776-21kworker/u8:2+flush-8:010:12:570
407127522211,6sleep30-21swapper/308:20:013
3999897992219,2cyclictest95548-21idleruntime-cro12:00:002
3999897992219,2cyclictest106001-21aten2_r5power_e12:12:432
3999897992217,3cyclictest4150638-21latency_hist09:40:012
3999892992218,2cyclictest0-21swapper/012:32:440
3999897992117,2cyclictest7216-21fschecks_count10:32:462
3999897992116,4cyclictest4026788-21kworker/u8:2+flush-8:009:20:002
3999897992115,4cyclictest4120759-21cron09:10:002
3999897992112,6cyclictest4163323-21tr09:52:522
3999892992117,2cyclictest0-21swapper/009:02:550
39950872214,11sleep10-21swapper/107:05:441
3999897992017,2cyclictest4047183-21aten2_r5power_v07:57:442
3999897992016,2cyclictest4037312-21aten2_r5power_p07:47:452
3999897992015,4cyclictest0-21swapper/208:07:522
3999897992014,4cyclictest0-21swapper/209:45:002
3999897992011,7cyclictest54505-21tr11:17:512
3999897992011,7cyclictest4066053-21seq08:12:592
399989299200,10cyclictest41613432fschecks_time09:52:450
399989799196,4cyclictest0-21swapper/209:28:022
399989799196,4cyclictest0-21swapper/209:28:022
3999897991916,2cyclictest36671-21aten2_r5power_v11:02:452
3999897991915,2cyclictest4115823-21cron09:05:002
3999897991912,5cyclictest4071136-21sshd08:18:122
3999897991910,6cyclictest4177766-21tr10:07:512
3999892991915,2cyclictest851-21mta-sts-daemon08:55:570
3999892991915,2cyclictest0-21swapper/010:55:000
399989799188,8cyclictest75809-21true11:40:002
3999897991815,2cyclictest87057-21tail11:52:472
3999897991815,2cyclictest16876-21aten2_r5power_p10:42:432
3999897991814,2cyclictest1955-21cpuspeed_turbos10:27:442
3999897991812,4cyclictest4073000-21kthreadcore08:22:502
3999897991811,5cyclictest44708-21kthreadcore11:07:522
39948342182,7sleep30-21swapper/307:05:013
399989799179,6cyclictest4158940-21tr09:47:532
3999897991713,3cyclictest0-21swapper/210:00:002
3999897991713,2cyclictest120797-21cron12:25:002
3999897991713,2cyclictest0-21swapper/211:47:542
3999897991713,2cyclictest0-21swapper/208:03:002
3999897991712,3cyclictest4125693-21cron09:15:002
3999897991712,3cyclictest0-21swapper/208:37:512
3999897991711,4cyclictest0-21swapper/210:17:542
399989799170,5cyclictest40463652unixbench_multi07:53:012
399989799169,5cyclictest4102119-21sed08:52:482
399989799168,5cyclictest4085787-21cat08:33:002
399989799167,7cyclictest4031221-21grep07:38:022
399989799162,10cyclictest4171494-21ps10:02:492
3999897991613,2cyclictest0-21swapper/209:22:462
3999897991612,2cyclictest0-21swapper/211:27:482
3999897991611,3cyclictest0-21swapper/209:32:492
3999897991611,3cyclictest0-21swapper/208:42:492
3999897991610,2cyclictest0-21swapper/208:57:582
399989799156,7cyclictest4190795-21cut10:22:442
3999897991510,3cyclictest0-21swapper/207:22:512
41829392140,2sleep3575-21kworker/3:2+events10:12:523
1327082142,7sleep30-21swapper/312:37:503
807752132,6sleep30-21swapper/311:45:023
502642132,7sleep30-21swapper/311:12:553
41508542132,6sleep30-21swapper/309:40:023
40960572132,6sleep30-21swapper/308:45:013
261972132,7sleep30-21swapper/310:50:003
617272122,6sleep30-21swapper/311:27:483
554202122,6sleep30-21swapper/311:18:013
41911282122,6sleep30-21swapper/310:22:483
41853882122,5sleep30-21swapper/310:15:013
41739032122,6sleep30-21swapper/310:02:543
41659332122,6sleep30-21swapper/309:57:203
41463202122,6sleep30-21swapper/309:37:463
41409352122,6sleep30-21swapper/309:32:203
41299212122,6sleep30-21swapper/309:17:553
41250642122,6sleep30-21swapper/309:12:583
41162942122,6sleep30-21swapper/309:07:443
41013882122,6sleep30-21swapper/308:52:403
40913622122,6sleep30-21swapper/308:40:203
40863102122,6sleep30-21swapper/308:35:023
40824402123,6sleep30-21swapper/308:32:493
40720212122,6sleep30-21swapper/308:22:463
40659012123,6sleep30-21swapper/308:12:593
40599612122,6sleep30-21swapper/308:07:533
40467812122,6sleep30-21swapper/307:55:013
40323052122,6sleep30-21swapper/307:42:463
40323052122,6sleep30-21swapper/307:42:463
40309512122,6sleep30-21swapper/307:38:003
40121502122,6sleep30-21swapper/307:22:433
40000852122,6sleep30-21swapper/307:11:123
363742122,6sleep30-21swapper/311:00:403
163622122,5sleep30-21swapper/310:40:023
107712123,6sleep30-21swapper/310:32:593
1055332122,5sleep30-21swapper/312:10:013
957972112,5sleep30-21swapper/312:00:023
860122112,6sleep30-21swapper/311:51:243
807122112,6sleep30-21swapper/311:44:413
717492112,5sleep30-21swapper/311:37:473
668402111,6sleep30-21swapper/311:32:503
559372112,5sleep30-21swapper/311:20:023
41756482112,5sleep30-21swapper/310:05:023
41561012112,6sleep30-21swapper/309:47:453
41359182112,6sleep30-21swapper/309:26:183
41359182112,6sleep30-21swapper/309:26:183
41315752111,6sleep30-21swapper/309:22:493
41110932112,5sleep30-21swapper/309:00:023
410842112,5sleep30-21swapper/311:05:013
41061612112,6sleep30-21swapper/308:55:163
40766302112,6sleep30-21swapper/308:26:513
40419382112,6sleep30-21swapper/307:50:133
40379882112,5sleep30-21swapper/307:47:513
40218522112,6sleep30-21swapper/307:30:183
40169162112,6sleep30-21swapper/307:25:363
314072112,6sleep30-21swapper/310:55:143
314072112,6sleep30-21swapper/310:55:143
266382112,5sleep30-21swapper/310:52:413
19682112,5sleep30-21swapper/310:27:453
1259852112,6sleep30-21swapper/312:30:163
1210332112,5sleep30-21swapper/312:25:023
117592112,6sleep30-21swapper/310:36:443
1163362112,5sleep30-21swapper/312:22:453
1008572112,6sleep30-21swapper/312:06:203
1108612102,5sleep30-21swapper/312:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional