You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 05:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Jun 01, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83245523290,6sleep3451irq_work/319:30:423
10329542580,4chrt0-21swapper/322:50:453
810166995545,8cyclictest995938-21diskstats22:15:420
810166995442,9cyclictest911169-21apt-get20:50:000
810168995346,5cyclictest1044210-21ntpq23:00:481
810166995242,8cyclictest875710-21ntpq20:10:550
10251532520,3chrt0-21swapper/022:45:010
810166995146,3cyclictest790003-21kworker/u8:2+flush-8:020:00:440
810166995045,4cyclictest767441-21kworker/u8:3+events_unbound19:35:030
810166994939,8cyclictest810591-21diskstats19:10:420
10030952490,4chrt0-21swapper/022:20:460
810168994841,5cyclictest1079272-21ntpq23:35:491
810168994839,7cyclictest905440-21ntpq20:40:511
810166994839,7cyclictest1034168-21ntpq22:50:520
81016699481,45cyclictest1020157-21munin-run22:40:000
810166994742,4cyclictest1038668-21kworker/u8:1+flush-8:023:05:560
810166994742,3cyclictest892045-21kworker/u8:0+flush-8:022:30:450
810166994742,3cyclictest1100169-21kworker/u8:2+flush-8:000:35:440
810171994634,10cyclictest1704890-21systemd-journal23:12:482
810168994637,7cyclictest916629-21/usr/sbin/munin20:55:491
810166994643,1cyclictest1038668-21kworker/u8:1+events_unbound23:20:000
810166994638,6cyclictest1089119-21ntpq23:45:500
81017199451,40cyclictest932025-21irqcore21:10:442
810166994539,4cyclictest790003-21kworker/u8:2+flush-8:019:55:480
810166994538,5cyclictest852143-21apt-get19:50:370
810166994538,5cyclictest852143-21apt-get19:50:360
810166994535,7cyclictest790003-21kworker/u8:2+flush-8:019:25:510
810168994436,6cyclictest1015449-21apt-get22:35:371
810168994433,8cyclictest1054994-21latency_hist23:15:011
810168994431,9cyclictest1704890-21systemd-journal23:20:581
810166994439,4cyclictest985174-21kworker/u8:3+events_unbound22:05:010
810166994437,5cyclictest861722-21kworker/u8:1+flush-8:020:15:520
810166994434,8cyclictest1108986-21ntpq00:05:560
810168994336,5cyclictest870809-21ntpq20:05:531
810166994236,5cyclictest1069712-21kworker/u8:3+flush-8:023:40:520
810166994137,3cyclictest861722-21kworker/u8:1+events_unbound21:00:590
810166994137,3cyclictest767441-21kworker/u8:3+events_unbound19:40:590
810166994136,3cyclictest1069712-21kworker/u8:3+flush-8:000:15:460
810166994135,4cyclictest985789-21apt-get22:05:400
810166994133,6cyclictest767441-21kworker/u8:3+flush-8:019:30:510
11221562410,6sleep20-21swapper/200:25:472
810171994023,15cyclictest900914-21unixbench_singl20:35:562
810168994032,6cyclictest984635-21ntpq22:00:511
810166994035,4cyclictest861722-21kworker/u8:1+flush-8:021:05:490
810166994034,4cyclictest1069712-21kworker/u8:3+events_unbound23:50:510
810166994032,6cyclictest1100484-21diskstats00:00:410
810166994032,6cyclictest1100484-21diskstats00:00:400
810166994028,4cyclictest861722-21kworker/u8:1+events_unbound21:50:530
810168993931,6cyclictest975895-21apt-get21:55:341
810168993928,8cyclictest911265-21cp20:50:001
810166993933,4cyclictest892045-21kworker/u8:0+events_unbound23:35:550
810166993932,5cyclictest1038668-21kworker/u8:1+flush-8:023:00:500
810171993823,13cyclictest810426-21aten2_r5power_p19:10:392
810168993829,7cyclictest964873-21ntpq21:40:491
810166993834,3cyclictest767441-21kworker/u8:3+flush-8:020:30:560
810166993833,3cyclictest861722-21kworker/u8:1+flush-8:021:35:460
810166993833,3cyclictest790003-21kworker/u8:2+events_unbound19:20:570
810166993830,6cyclictest817529-21diskstats19:15:380
9661922370,6sleep10-21swapper/121:45:391
810168993726,9cyclictest1704890-21systemd-journal22:16:581
810166993735,1cyclictest767441-21kworker/u8:3+events_unbound21:10:410
810166993730,5cyclictest955740-21kworker/u8:2+flush-8:021:40:500
810166993730,5cyclictest892045-21kworker/u8:0+flush-8:022:10:490
810166993726,7cyclictest1069712-21kworker/u8:3+events_unbound00:30:370
810171993621,13cyclictest881109-21unixbench_singl20:15:592
810168993630,4cyclictest1100169-21kworker/u8:2+events_unbound00:30:461
810168993627,7cyclictest885529-21ntpq20:20:491
810166993631,3cyclictest892045-21kworker/u8:0+flush-8:020:35:450
810166993631,3cyclictest867698-21irqrtprio20:05:450
810166993629,5cyclictest892045-21kworker/u8:0+flush-8:021:15:500
810166993627,6cyclictest1040151-21latency_hist23:00:010
810171993519,14cyclictest994975-21unixbench_multi22:10:572
810168993528,5cyclictest1134596-21ntpq00:35:491
810168993526,7cyclictest1114772-21ntpq00:15:461
810168993525,7cyclictest1704890-21systemd-journal23:30:591
810166993531,3cyclictest1069712-21kworker/u8:3+events_unbound00:26:010
810166993529,4cyclictest955740-21kworker/u8:2+events_unbound21:45:400
810166993529,4cyclictest892045-21kworker/u8:0+flush-8:022:25:430
810166993529,4cyclictest1038668-21kworker/u8:1+flush-8:023:30:500
810166993529,4cyclictest1038668-21kworker/u8:1+flush-8:023:10:510
810166993528,5cyclictest955740-21kworker/u8:2+events_unbound21:55:470
81017199344,14cyclictest0-21swapper/221:05:212
810171993418,13cyclictest837181-21apt-key19:35:012
810171993418,13cyclictest1704890-21systemd-journal21:45:012
810168993429,3cyclictest1069712-21kworker/u8:3+events_unbound23:55:551
810168993428,4cyclictest901287-21latency_hist20:40:001
810168993426,6cyclictest1100235-21apt-get00:00:371
810168993426,6cyclictest1100235-21apt-get00:00:371
810168993425,7cyclictest832083-21/usr/sbin/munin19:30:561
810168993425,7cyclictest1024176-21ntpq22:40:501
810166993430,3cyclictest790003-21kworker/u8:2+events_unbound20:25:580
810166993427,5cyclictest1116056-21tr00:20:410
810166993426,6cyclictest892045-21kworker/u8:0+flush-8:023:55:420
810171993317,15cyclictest1020110-21sh22:40:002
81017199331,25cyclictest837277-21apt-get19:35:372
810168993327,4cyclictest1704890-21systemd-journal21:02:231
810168993325,6cyclictest935184-21ntpq21:10:511
810166993329,3cyclictest892045-21kworker/u8:0+events_unbound21:25:480
810166993328,4cyclictest892045-21kworker/u8:0+events_unbound20:40:550
810166993327,4cyclictest892045-21kworker/u8:0+flush-8:021:30:460
81017199322,23cyclictest861996-21apt-get20:00:372
81017199322,22cyclictest1045418-21apt-get23:05:372
810171993216,14cyclictest1065697-21fschecks_count23:25:412
810171993215,15cyclictest20977-21cron00:35:002
810168993227,4cyclictest861722-21kworker/u8:1+events_unbound21:20:491
810168993227,4cyclictest1100169-21kworker/u8:2+flush-8:000:25:441
810168993226,4cyclictest1704890-21systemd-journal22:54:591
810166993221,9cyclictest941542-21diskstats21:20:420
81017199317,16cyclictest0-21swapper/221:20:502
81017199313,22cyclictest936355-21apt-get21:15:382
81017199312,23cyclictest1055516-21apt-get23:15:372
81017199311,23cyclictest857056-21apt-get19:55:402
810168993126,4cyclictest1069712-21kworker/u8:3+flush-8:000:20:551
810168993124,5cyclictest1025381-21apt-get22:45:341
810166993125,4cyclictest892045-21kworker/u8:0+flush-8:020:55:500
81016699311,28cyclictest901323-21kworker/0:1+events20:50:460
810171993025,3cyclictest871203-21unixbench_multi20:05:592
810171993018,10cyclictest0-21swapper/223:35:002
810168993027,2cyclictest820966-21needreboot19:15:461
810168993026,3cyclictest861692-21munin-run20:00:001
810168993025,4cyclictest1038668-21kworker/u8:1+flush-8:023:05:541
810168993023,6cyclictest892045-21kworker/u8:0+flush-8:022:20:411
810168993022,6cyclictest790003-21kworker/u8:2+flush-8:019:10:431
810168993021,6cyclictest1704890-21systemd-journal19:21:581
810168993019,8cyclictest881495-21latency_hist20:20:011
810166993026,3cyclictest955740-21kworker/u8:2+events_unbound22:45:540
810166993025,4cyclictest861722-21kworker/u8:1+events_unbound20:20:430
810166993025,3cyclictest1038668-21kworker/u8:1+flush-8:023:25:460
810166993022,6cyclictest851313-21sed19:45:560
8098762303,9sleep10-21swapper/119:08:501
81017199298,19cyclictest1045131-21sh23:05:012
81017199293,21cyclictest905395-21ntpq20:40:492
81017199293,20cyclictest1115942-21apt-get00:20:392
81017199291,8cyclictest1099062-21ntpq23:55:512
810171992916,11cyclictest0-21swapper/200:09:592
810168992925,2cyclictest986517-21irqrtprio22:05:471
810168992924,3cyclictest954883-21ntpq21:30:491
810168992924,3cyclictest927244-21irqrtprio21:05:441
810168992924,3cyclictest790003-21kworker/u8:2+flush-8:020:10:501
810168992924,3cyclictest1081185-21irqrtprio23:40:441
81017199286,19cyclictest918827-21cut20:55:462
81017199286,18cyclictest952741-21kthreadcore21:30:452
810171992824,2cyclictest846521-21unixbench_singl19:40:552
81017199282,21cyclictest1114728-21ntpq00:15:452
81017199281,9cyclictest825992-21ntpq19:20:512
81017199281,9cyclictest1009372-21ntpq22:25:512
81017199281,21cyclictest906970-21if_enp3s020:45:422
81017199281,11cyclictest883817-21kthreadcore20:20:472
81017199280,4cyclictest1074987-21apt-get23:35:032
810168992820,6cyclictest895467-21ntpq20:30:511
810168992819,7cyclictest790003-21kworker/u8:2+flush-8:019:25:561
9977842270,2sleep3481ktimers/322:15:473
81017199277,17cyclictest974415-21cut21:50:472
81017199273,19cyclictest960003-21ntpq21:35:522
810171992722,3cyclictest985847-21aten2_r5power_e22:05:422
81017199271,9cyclictest1031222-21irqstats22:50:432
81017199271,8cyclictest831057-21ps19:25:542
81017199271,8cyclictest1029131-21ntpq22:45:482
810171992714,11cyclictest0-21swapper/222:15:552
810171992710,15cyclictest815747-21tr19:15:032
81017199270,9cyclictest966014-21/usr/sbin/munin21:45:362
810168992722,3cyclictest1109434-21unixbench_multi00:06:011
810168992718,6cyclictest891379-21latency_hist20:30:011
810166992723,3cyclictest1038668-21kworker/u8:1+events_unbound23:20:420
810166992722,4cyclictest1100169-21kworker/u8:2+events_unbound00:12:590
81017199265,17cyclictest976278-21/usr/sbin/munin21:55:412
81017199262,19cyclictest911169-21apt-get20:50:022
81017199261,8cyclictest850797-21/usr/sbin/munin19:45:482
81017199261,6cyclictest1100725-21/usr/sbin/munin00:00:442
81017199261,6cyclictest1100725-21/usr/sbin/munin00:00:442
81017199261,4cyclictest875779-21ntpq20:10:562
810171992614,10cyclictest0-21swapper/223:50:492
810171992613,11cyclictest0-21swapper/221:00:412
81017199261,11cyclictest889214-21kthreadcore20:25:472
81017199260,9cyclictest985146-21/usr/sbin/munin22:00:562
81017199260,9cyclictest1090189-21grep23:50:012
810168992622,2cyclictest971096-21aten2_r5power_v21:50:391
810168992621,4cyclictest1059720-21unixbench_multi23:15:561
810168992618,6cyclictest842226-21/usr/sbin/munin19:40:471
810168992615,3cyclictest421rcuog/223:50:361
81017199258,15cyclictest0-21swapper/222:40:462
81017199254,4cyclictest946463-21tr21:25:392
81017199251,4cyclictest1064269-21ntpq23:20:492
81017199250,8cyclictest895413-21taskset20:30:502
81017199250,7cyclictest1014101-21/usr/sbin/munin22:30:482
810168992522,2cyclictest847777-21irqcore19:45:431
810168992519,4cyclictest946247-21apt-get21:25:351
810168992515,7cyclictest1704890-21systemd-journal20:51:571
81017199247,15cyclictest0-21swapper/200:35:452
81017199240,7cyclictest852148-21taskset19:50:392
81017199240,7cyclictest852148-21taskset19:50:392
81017199240,7cyclictest1000906-21/usr/sbin/munin22:20:392
81017199240,6cyclictest1035564-21cut22:55:402
81017199240,5cyclictest1082660-21grep23:40:462
81017199230,7cyclictest1110381-21seq00:11:132
810168992319,3cyclictest0-21swapper/122:10:401
810168992319,2cyclictest0-21swapper/121:35:481
810168992318,3cyclictest0-21swapper/123:00:011
810168992317,4cyclictest1110691-21cron00:15:011
8098752233,3sleep00-21swapper/019:08:490
810168992218,3cyclictest1069712-21kworker/u8:3+flush-8:023:48:251
810168992218,2cyclictest940019-21needreboot21:15:481
810168992218,2cyclictest0-21swapper/123:25:391
810168992218,2cyclictest0-21swapper/122:30:491
810168992218,2cyclictest0-21swapper/122:25:561
8099502219,7sleep30-21swapper/319:09:493
810168992015,3cyclictest0-21swapper/119:50:451
810168992015,3cyclictest0-21swapper/119:50:441
810168992014,4cyclictest0-21swapper/119:35:411
810168992012,6cyclictest861993-21awk20:00:361
81017199190,3cyclictest810203-21sort19:10:012
8892102150,4sleep375-21kworker/3:1-events20:25:473
8619992142,7sleep30-21swapper/320:00:373
8570592141,8sleep30-21swapper/319:55:393
9053632132,7sleep30-21swapper/320:40:503
8372512132,7sleep30-21swapper/319:35:373
8269482132,6sleep30-21swapper/319:25:023
8237922132,7sleep30-21swapper/319:20:483
11107132132,6sleep30-21swapper/300:15:023
10859072133,7sleep30-21swapper/323:45:453
10401922132,6sleep30-21swapper/323:00:023
10291552132,7sleep30-21swapper/322:45:503
9906932122,5sleep30-21swapper/322:10:023
9808762122,6sleep30-21swapper/322:00:393
9710432122,6sleep30-21swapper/321:50:403
9663752122,6sleep30-21swapper/321:45:423
9565672121,7sleep30-21swapper/321:35:433
9502602122,6sleep30-21swapper/321:25:563
9452902122,6sleep30-21swapper/321:20:593
9262502122,5sleep30-21swapper/321:05:023
9255932120,8sleep30-21swapper/321:00:563
9111552123,5sleep30-21swapper/320:50:013
9002302122,6sleep30-21swapper/320:35:483
8818052122,6sleep30-21swapper/320:20:393
8765912122,5sleep30-21swapper/320:15:023
8520192122,6sleep30-21swapper/319:50:023
8520192122,6sleep30-21swapper/319:50:023
8477202122,6sleep30-21swapper/319:45:433
8448522120,2sleep3481ktimers/319:40:463
8181622122,6sleep30-21swapper/319:15:423
8108302122,6sleep30-21swapper/319:10:453
11351192122,6sleep30-21swapper/300:35:573
11170042122,6sleep30-21swapper/300:20:483
10925002122,6sleep30-21swapper/323:50:463
10851162122,6sleep30-21swapper/323:44:593
10798122122,6sleep30-21swapper/323:35:583
10707572122,6sleep30-21swapper/323:30:443
10691202122,6sleep30-21swapper/323:25:493
10546462122,6sleep30-21swapper/323:10:583
10456012122,6sleep30-21swapper/323:05:403
10208492122,6sleep30-21swapper/322:40:443
10200182122,6sleep30-21swapper/322:38:583
10098912122,6sleep30-21swapper/322:25:593
10003982122,5sleep30-21swapper/322:20:003
9868972112,5sleep30-21swapper/322:05:493
9758992112,5sleep30-21swapper/321:55:383
9620002112,5sleep30-21swapper/321:40:453
9515502112,6sleep30-21swapper/321:30:413
9351492112,5sleep30-21swapper/321:10:513
9165842112,5sleep30-21swapper/320:55:023
9116702112,5sleep30-21swapper/320:50:373
8915992112,5sleep30-21swapper/320:30:023
8718882112,5sleep30-21swapper/320:10:393
8668362112,5sleep30-21swapper/320:05:023
11258612112,5sleep30-21swapper/300:30:393
11208852112,5sleep30-21swapper/300:25:403
11055452112,5sleep30-21swapper/300:05:433
10999662112,5sleep30-21swapper/300:00:013
10999662112,5sleep30-21swapper/300:00:013
10956912112,6sleep30-21swapper/323:55:433
10554882112,5sleep30-21swapper/323:15:353
10354382112,5sleep30-21swapper/322:55:053
10110362112,5sleep30-21swapper/322:30:453
9365932102,5sleep30-21swapper/321:15:403
11102922102,5sleep30-21swapper/300:10:033
10603842102,5sleep30-21swapper/323:20:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional