You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 04:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 03, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5105362700,3sleep375-21kworker/3:1+events20:25:453
443478995949,7cyclictest482072-21latency_hist20:00:010
443478995949,7cyclictest482072-21latency_hist20:00:000
6645372580,1sleep2664541-21tr23:00:462
6030342580,4sleep375-21kworker/3:1-events22:00:443
443478995528,8cyclictest615254-21ntpq22:10:470
443478995344,7cyclictest1704890-21systemd-journal22:05:010
443478995041,7cyclictest606537-21/usr/sbin/munin22:05:470
443483994939,8cyclictest541598-21/usr/sbin/munin21:00:511
443483994831,14cyclictest616702-21diskstats22:15:381
443483994733,13cyclictest401-21dbus-daemon22:45:001
443483994727,17cyclictest1704890-21systemd-journal00:22:551
443483994636,8cyclictest1704890-21systemd-journal23:25:001
443478994537,6cyclictest461089-21kworker/u8:1+flush-8:021:05:520
443483994326,14cyclictest461437-21latency_hist19:35:011
443478994338,4cyclictest461089-21kworker/u8:1+events_unbound19:50:540
443483994225,15cyclictest705732-21aten2_r5power_e23:45:371
443483994222,18cyclictest438446-21kworker/u8:2+flush-8:022:00:001
443483994124,15cyclictest578337-21kthreadcore21:35:591
443485994035,4cyclictest433375-21kworker/u8:1+flush-8:019:10:522
443483994028,9cyclictest1704890-21systemd-journal23:16:551
443483994021,17cyclictest651824-21irqrtprio22:50:431
443483994021,17cyclictest595745-21unixbench_singl21:50:551
443478994033,5cyclictest1704890-21systemd-journal21:37:460
6405582390,6sleep3451irq_work/322:35:543
443483993922,15cyclictest729699-21unixbench_multi00:05:591
443483993921,6cyclictest551476-21apt-get21:10:351
443483993920,7cyclictest556387-21/usr/sbin/munin21:15:471
443483993920,17cyclictest616161-21latency_hist22:15:011
443483993920,17cyclictest496883-21cron20:15:011
443483993917,20cyclictest631355-21aten2_r5power_c22:30:351
443478993933,4cyclictest596121-21kworker/u8:3+flush-8:000:35:570
443478993911,22cyclictest621157-21kworker/0:0+events23:50:350
443483993830,6cyclictest575853-21latency_hist21:35:021
443483993828,8cyclictest715769-21diskstats23:55:401
443483993820,2cyclictest0-21swapper/119:50:021
443483993818,3cyclictest0-21swapper/122:27:561
443483993818,2cyclictest0-21swapper/123:50:451
443478993831,5cyclictest735068-21latency_hist00:15:010
443478993830,6cyclictest631036-21latency_hist22:30:010
443483993729,6cyclictest601370-21apt-get22:00:341
443483993720,2cyclictest0-21swapper/119:30:001
443483993628,6cyclictest1704890-21systemd-journal23:11:551
443483993619,2cyclictest0-21swapper/123:38:121
443483993619,2cyclictest0-21swapper/121:25:551
443483993618,3cyclictest0-21swapper/119:15:371
443483993618,2cyclictest591224-21latency_hist21:50:011
443483993617,4cyclictest640578-21unixbench_singl22:35:551
443483993616,4cyclictest610814-21unixbench_multi22:05:571
443483993615,6cyclictest690188-21grep23:25:561
443483993614,7cyclictest505869-21ntpq20:20:491
44347899362,33cyclictest621157-21kworker/0:0+events23:09:390
443485993529,4cyclictest590937-21apt-get21:50:012
443483993529,4cyclictest661225-21apt-get23:00:351
443483993521,12cyclictest448008-21unixbench_singl19:10:571
443478993511,22cyclictest521605-21kworker/0:2+events21:15:370
443485993425,7cyclictest1704890-21systemd-journal19:29:592
443483993427,5cyclictest666159-21apt-get23:05:351
443483993420,12cyclictest650457-21unixbench_singl22:45:541
443483993419,2cyclictest481114-21needreboot19:55:451
443483993419,2cyclictest481114-21needreboot19:55:451
443483993411,9cyclictest758897-21ntpq00:35:491
443478993427,5cyclictest540965-21grep20:55:550
443478993427,5cyclictest1704890-21systemd-journal19:47:240
443478993423,9cyclictest753944-21ntpq00:30:480
443478993423,9cyclictest753944-21ntpq00:30:480
44347899342,27cyclictest460849-21kworker/0:0+events19:30:010
443483993324,6cyclictest551183-21latency_hist21:10:001
443478993326,5cyclictest565104-21ntpq21:20:480
443478993323,8cyclictest461973-21diskstats19:35:350
443478993323,8cyclictest461973-21diskstats19:35:340
4631502320,3sleep10-21swapper/119:35:391
4631502320,3sleep10-21swapper/119:35:391
443485993226,4cyclictest625767-21kworker/u8:1+events_unbound22:35:412
443483993226,4cyclictest482382-21apt-get20:00:351
443483993216,2cyclictest0-21swapper/120:30:481
443483993212,7cyclictest467037-21latency_hist19:45:011
443483993211,7cyclictest730404-21apt-get00:10:411
44347899329,21cyclictest521605-21kworker/0:2+events20:54:590
443478993227,3cyclictest674889-21kworker/u8:0+flush-8:023:19:250
44347899321,29cyclictest621157-21kworker/0:0+events23:25:530
443485993124,5cyclictest1704890-21systemd-journal21:04:552
443485993120,8cyclictest1704890-21systemd-journal19:40:002
443485993120,8cyclictest1704890-21systemd-journal19:39:592
44347899319,16cyclictest621157-21kworker/0:0+events23:40:350
443478993127,2cyclictest527099-21fschecks_count20:45:400
443478993121,7cyclictest724228-21ntpq00:00:480
443478993117,10cyclictest585768-21latency_hist21:45:010
4951842300,2sleep3481ktimers/320:10:493
443485993025,3cyclictest487407-21aten2_r5power_v20:05:372
443483993026,3cyclictest511708-21cron20:30:001
443483993025,3cyclictest754453-21unixbench_multi00:30:551
443483993025,3cyclictest754453-21unixbench_multi00:30:551
443478993025,4cyclictest407111-21kworker/u8:3+flush-8:019:30:430
443478993024,4cyclictest461089-21kworker/u8:1+flush-8:020:00:530
44347899302,26cyclictest621157-21kworker/0:0+events23:10:490
44347899302,26cyclictest621157-21kworker/0:0+events22:30:510
443478993021,7cyclictest656521-21diskstats22:55:390
44347899301,27cyclictest621157-21kworker/0:0+events23:35:390
4432332304,9sleep10-21swapper/119:09:191
443485992924,3cyclictest527731-21kthreadcore20:45:442
443483992921,6cyclictest1704890-21systemd-journal20:46:551
44347899294,20cyclictest521605-21kworker/0:2+events21:00:070
443478992925,3cyclictest506753-21cron20:25:010
443478992924,3cyclictest666055-21latency_hist23:05:000
443478992924,3cyclictest511298-21unixbench_multi20:25:550
443478992919,8cyclictest709420-21ntpq23:45:480
44347899291,27cyclictest735086-21kworker/0:2+events00:15:410
44347899291,26cyclictest715249-21kworker/0:1+events00:05:560
443478992911,16cyclictest521605-21kworker/0:2+events22:15:410
443478992910,17cyclictest406916-21kworker/0:1+events19:10:410
443483992822,4cyclictest540941-21unixbench_singl20:55:551
443478992821,5cyclictest1704890-21systemd-journal20:32:370
443478992818,9cyclictest621157-21kworker/0:0+events22:35:190
443478992811,16cyclictest621157-21kworker/0:0+events22:20:450
443485992724,2cyclictest506333-21unixbench_multi20:20:542
443485992723,3cyclictest560682-21unixbench_singl21:15:562
443485992723,3cyclictest461089-21kworker/u8:1+flush-8:021:30:532
443485992723,2cyclictest725556-21aten2_r5power_v00:05:382
443483992724,2cyclictest563526-21kthreadcore21:20:461
44347899279,16cyclictest621157-21kworker/0:0+events22:45:480
44347899278,17cyclictest521605-21kworker/0:2+events21:55:460
44347899272,24cyclictest735086-21kworker/0:2+events00:24:500
44347899272,23cyclictest621157-21kworker/0:0+events22:50:530
443478992721,4cyclictest570552-21unixbench_multi21:25:560
443485992623,2cyclictest714856-21unixbench_singl23:50:532
443485992618,6cyclictest580823-21turbostat.cron21:40:012
443485992618,6cyclictest471964-21latency_hist19:50:022
443485992617,6cyclictest522122-21diskstats20:40:392
443483992621,3cyclictest583281-21kthreadcore21:40:421
44347899269,15cyclictest521605-21kworker/0:2+events21:10:490
44347899269,15cyclictest487041-21kworker/0:0+events20:05:510
44347899269,13cyclictest735086-21kworker/0:2+events00:25:380
44347899268,16cyclictest621157-21kworker/0:0+events23:20:490
44347899268,16cyclictest521605-21kworker/0:2+events21:50:490
443485992522,2cyclictest695846-21aten2_r5power_e23:35:372
443485992522,2cyclictest641501-21fschecks_count22:40:382
443485992522,2cyclictest512230-21cpuspeed_turbos20:30:382
443485992521,3cyclictest601340-21kworker/u8:1+events_unbound22:00:532
443485992521,2cyclictest686112-21cpuspeed_turbos23:25:382
443485992520,3cyclictest685185-21unixbench_multi23:20:532
443485992520,3cyclictest496516-21unixbench_singl20:10:582
443485992516,7cyclictest1704890-21systemd-journal19:54:592
443483992521,3cyclictest476790-21unixbench_singl19:50:541
443483992518,5cyclictest656272-21apt-get22:55:351
44347899259,14cyclictest460849-21kworker/0:0+events19:42:250
44347899258,15cyclictest621157-21kworker/0:0+events23:32:540
44347899256,18cyclictest487041-21kworker/0:0+events20:20:000
44347899253,21cyclictest521605-21kworker/0:2+events21:45:070
443478992520,3cyclictest496890-21cron20:15:010
443478992519,3cyclictest521150-21unixbench_multi20:35:560
44347899251,23cyclictest621157-21kworker/0:0+events22:40:530
443483992419,3cyclictest735575-21cpuspeed_turbos00:15:391
443483992419,3cyclictest536388-21cron20:54:591
443483992417,5cyclictest720486-21apt-get00:00:351
443478992415,6cyclictest526419-21sshd20:43:550
44347899240,22cyclictest406916-21kworker/0:1+events19:15:350
44323422414,6sleep20-21swapper/219:09:212
443485992320,2cyclictest671334-21fschecks_count23:10:412
443485992319,3cyclictest759780-21sendmail00:40:002
443485992319,2cyclictest507163-21aten2_r5power_v20:25:372
443485992319,2cyclictest0-21swapper/222:54:592
443485992319,2cyclictest0-21swapper/220:39:592
443485992318,4cyclictest596121-21kworker/u8:3-ext4-rsv-conversion22:15:002
443485992316,5cyclictest739054-21head00:15:472
443483992314,7cyclictest749057-21ntpq00:25:501
44347899236,15cyclictest715249-21kworker/0:1+events23:55:370
443485992219,2cyclictest705010-21unixbench_singl23:40:542
443485992219,2cyclictest550755-21unixbench_multi21:05:562
443485992218,2cyclictest630634-21unixbench_multi22:25:562
443485992216,4cyclictest710321-21idleruntime-cro23:50:002
443485992214,6cyclictest650472-21users22:45:552
443483992217,3cyclictest0-21swapper/123:40:411
443483992215,5cyclictest695086-21unixbench_multi23:30:551
44347899228,13cyclictest406916-21kworker/0:1+events19:22:180
44347899223,17cyclictest521605-21kworker/0:2+events21:30:410
44348599213,13cyclictest621409-21apt-get22:20:372
443485992117,3cyclictest680250-21unixbench_multi23:15:552
443485992117,2cyclictest0-21swapper/200:10:502
443483992117,2cyclictest0-21swapper/120:35:531
443485992017,2cyclictest581341-21cpuspeed_turbos21:40:372
443485992016,2cyclictest0-21swapper/219:15:422
443485992015,3cyclictest0-21swapper/223:59:592
443485992011,7cyclictest1704890-21systemd-journal19:42:552
443483992016,2cyclictest0-21swapper/122:20:391
443483992016,2cyclictest0-21swapper/120:40:441
443483992016,2cyclictest0-21swapper/120:05:381
443478992016,2cyclictest0-21swapper/019:10:010
44348599192,12cyclictest606043-21apt-get22:05:032
443485991914,3cyclictest532032-21fschecks_count20:50:412
443483991915,2cyclictest0-21swapper/120:15:481
44348599182,11cyclictest740337-21apt-get00:20:382
443485991815,2cyclictest497241-21aten2_r5power_e20:15:372
443485991814,2cyclictest566361-21aten2_r5power_e21:25:372
443485991814,2cyclictest0-21swapper/223:30:542
443485991814,2cyclictest0-21swapper/222:19:592
443485991814,2cyclictest0-21swapper/200:30:552
443485991814,2cyclictest0-21swapper/200:30:552
443485991813,3cyclictest478670-21kthreadcore19:55:422
443485991813,3cyclictest478670-21kthreadcore19:55:422
443485991812,4cyclictest0-21swapper/220:00:462
44348599181,12cyclictest631324-21apt-get22:30:362
443483991811,6cyclictest448577-21munin-node19:21:311
4392432183,8sleep30-21swapper/319:05:453
44348599178,7cyclictest657057-21sed22:55:432
44348599172,10cyclictest724243-21ntpq00:00:482
443485991713,2cyclictest0-21swapper/220:55:362
443485991712,3cyclictest0-21swapper/200:25:462
443485991712,2cyclictest0-21swapper/223:05:102
44348599162,13cyclictest0-21swapper/221:20:542
443485991612,2cyclictest0-21swapper/221:50:522
44348599151,10cyclictest552198-21ps21:10:422
6470072145,5sleep30-21swapper/322:45:433
6213832144,6sleep30-21swapper/322:20:343
443485991411,2cyclictest0-21swapper/219:21:042
443485991410,2cyclictest0-21swapper/221:55:392
7167062133,6sleep30-21swapper/323:55:443
7054282132,6sleep30-21swapper/323:45:023
7007442133,6sleep30-21swapper/323:40:363
6202182132,7sleep30-21swapper/322:15:503
5909222132,7sleep30-21swapper/321:50:003
5453112132,7sleep30-21swapper/321:00:463
4727382132,7sleep30-21swapper/319:50:393
44348599139,2cyclictest4613772chrt19:34:242
7565552122,6sleep30-21swapper/300:35:463
7539542122,6sleep30-21swapper/300:30:493
7539542122,6sleep30-21swapper/300:30:483
7498142122,6sleep30-21swapper/300:28:563
7400592122,5sleep30-21swapper/300:20:013
7389722122,6sleep30-21swapper/300:15:473
7332242123,6sleep30-21swapper/300:10:503
7263692122,6sleep30-21swapper/300:05:453
7251372122,6sleep30-21swapper/300:05:003
7106092122,6sleep30-21swapper/323:50:363
6993782122,6sleep30-21swapper/323:35:473
6908332121,7sleep30-21swapper/323:30:373
6806932122,6sleep30-21swapper/323:20:023
6756982122,6sleep30-21swapper/323:15:003
6687222122,6sleep30-21swapper/323:05:453
6650522122,6sleep30-21swapper/323:00:523
6600272122,6sleep30-21swapper/322:55:503
6409612122,5sleep30-21swapper/322:40:013
6318492122,6sleep30-21swapper/322:30:423
6300862123,6sleep30-21swapper/322:25:493
6114692122,6sleep30-21swapper/322:10:363
5919102122,6sleep30-21swapper/321:50:413
5679292122,6sleep30-21swapper/321:25:463
5613412122,6sleep30-21swapper/321:20:363
5517572122,6sleep30-21swapper/321:10:413
5511662122,6sleep30-21swapper/321:10:013
5405102122,6sleep30-21swapper/320:55:513
5354962122,6sleep30-21swapper/320:50:503
5306562123,5sleep30-21swapper/320:45:533
5258912122,6sleep30-21swapper/320:40:543
5157052122,6sleep30-21swapper/320:30:483
4875432122,6sleep30-21swapper/320:05:393
4667042122,6sleep30-21swapper/319:40:553
4663722122,6sleep30-21swapper/319:39:563
4663722122,6sleep30-21swapper/319:39:563
4564112122,6sleep30-21swapper/319:25:353
4552812122,5sleep30-21swapper/319:20:013
4520642122,6sleep30-21swapper/319:15:443
4454202122,6sleep30-21swapper/319:10:453
6861352112,5sleep30-21swapper/323:25:393
6777242112,6sleep30-21swapper/323:15:453
6510392112,6sleep30-21swapper/322:50:033
6090272112,6sleep30-21swapper/322:05:453
5964002113,5sleep30-21swapper/321:55:393
5810972112,5sleep30-21swapper/321:40:343
5748042112,6sleep30-21swapper/321:30:463
5601792112,5sleep30-21swapper/321:15:503
5171822112,5sleep30-21swapper/320:35:423
5067002112,6sleep30-21swapper/320:24:263
4980662112,5sleep30-21swapper/320:15:433
4849962112,5sleep30-21swapper/320:00:463
4773942112,6sleep30-21swapper/319:55:293
4773942112,6sleep30-21swapper/319:55:283
4710882112,5sleep30-21swapper/319:45:463
4613682112,6sleep30-21swapper/319:34:183
5760942102,5sleep30-21swapper/321:35:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional