You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 00:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue May 26, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26901521840,3sleep375-21kworker/3:1-events11:35:433
793642720,2sleep3471rcuc/308:20:533
3890996762,3cyclictest219353-21kworker/u8:3+events_unbound10:55:580
3890996659,5cyclictest184449-21kworker/u8:0+flush-8:010:11:000
3895996559,4cyclictest30318-21kworker/u8:2+events_unbound08:15:541
3890996560,4cyclictest8965-21kworker/u8:0+flush-8:007:35:580
3890996559,4cyclictest214213-21kworker/u8:1+events_unbound12:25:450
3890996358,4cyclictest3959755-21kworker/u8:1+events_unbound07:25:570
3890996357,4cyclictest3214171-21kworker/u8:3+events_unbound08:55:490
3890996256,4cyclictest75321-21latency_hist08:20:000
3890996256,4cyclictest139453-21kworker/u8:3+events_unbound10:00:010
3895996155,5cyclictest8965-21kworker/u8:0+events_unbound08:40:541
3890996156,3cyclictest3214171-21kworker/u8:3+events_unbound07:10:580
3890996054,4cyclictest174211-21kworker/u8:2+events_unbound10:00:580
3895995854,3cyclictest3214171-21kworker/u8:3+events_unbound09:00:571
3895995752,4cyclictest8965-21kworker/u8:0+events_unbound08:25:511
3895995749,6cyclictest248495-21kworker/u8:2+flush-8:011:25:561
3890995753,3cyclictest3214171-21kworker/u8:3+events_unbound07:40:590
3890995751,4cyclictest125005-21kworker/u8:1+events_unbound09:45:580
3890995750,5cyclictest283873-21kworker/u8:0+flush-8:012:00:030
3895995648,6cyclictest1704890-21systemd-journal11:10:481
3890995651,4cyclictest194663-21kworker/u8:0+events_unbound10:41:000
3890995650,4cyclictest194663-21kworker/u8:0+events_unbound11:30:570
3890995646,3cyclictest248495-21kworker/u8:2+events_unbound11:45:590
3895995445,6cyclictest313581-21latency_hist12:20:011
3890995449,3cyclictest312819-21kworker/u8:2+flush-8:012:35:500
3890995349,3cyclictest194663-21kworker/u8:0+events_unbound10:25:490
3890995348,4cyclictest8965-21kworker/u8:0+flush-8:008:41:000
3890995348,3cyclictest3959755-21kworker/u8:1+events_unbound07:20:590
3890995347,4cyclictest3214171-21kworker/u8:3+events_unbound07:15:030
3890995347,4cyclictest174211-21kworker/u8:2+events_unbound10:05:590
3890995247,3cyclictest125005-21kworker/u8:1+events_unbound09:36:010
3890995246,4cyclictest3214171-21kworker/u8:3+events_unbound08:00:430
3890995246,4cyclictest312819-21kworker/u8:2+flush-8:012:30:480
3895995147,3cyclictest312819-21kworker/u8:2+events_unbound12:20:541
3895995146,3cyclictest194663-21kworker/u8:0+flush-8:011:30:551
3895995143,5cyclictest1704890-21systemd-journal08:30:481
3890995147,3cyclictest3214171-21kworker/u8:3+flush-8:007:30:580
3890995145,4cyclictest114920-21kworker/u8:2+events_unbound09:35:000
3895995044,5cyclictest189648-21kworker/u8:1+events_unbound10:20:541
3895995043,5cyclictest174211-21kworker/u8:2+events_unbound10:35:571
3890995046,3cyclictest268322-21kworker/u8:3+events_unbound11:35:590
3890995043,5cyclictest248495-21kworker/u8:2+events_unbound11:15:450
3895994944,4cyclictest8965-21kworker/u8:0+flush-8:009:10:501
3895994944,4cyclictest174211-21kworker/u8:2+events_unbound10:30:581
3895994944,4cyclictest174211-21kworker/u8:2+events_unbound10:30:581
3890994945,3cyclictest194663-21kworker/u8:0+flush-8:010:50:580
3890994944,4cyclictest214213-21kworker/u8:1+flush-8:011:10:470
3890994942,5cyclictest139453-21kworker/u8:3+events_unbound09:25:440
3895994843,3cyclictest214213-21kworker/u8:1+events_unbound11:00:551
3895994842,5cyclictest8965-21kworker/u8:0+flush-8:008:45:541
3895994839,7cyclictest30765-21/usr/sbin/munin07:35:531
3895994743,3cyclictest174211-21kworker/u8:2+events_unbound10:15:441
3895994741,4cyclictest8965-21kworker/u8:0+flush-8:008:20:541
3895994741,4cyclictest3959755-21kworker/u8:1+events_unbound07:25:461
3895994741,4cyclictest3214171-21kworker/u8:3+events_unbound07:50:461
3890994743,3cyclictest189648-21kworker/u8:1+flush-8:010:20:570
3890994741,4cyclictest3214171-21kworker/u8:3+events_unbound07:50:440
3890994741,4cyclictest214213-21kworker/u8:1+events_unbound11:00:520
3890994741,4cyclictest194663-21kworker/u8:0+events_unbound10:45:530
3890994741,4cyclictest194663-21kworker/u8:0+events_unbound10:40:000
3890994730,4cyclictest3214171-21kworker/u8:3+events_unbound09:05:560
3895994641,4cyclictest3214171-21kworker/u8:3+events_unbound08:11:001
3895994638,6cyclictest90443-21apt-get08:35:401
3895994637,4cyclictest8965-21kworker/u8:0+flush-8:007:45:581
3890994642,3cyclictest8965-21kworker/u8:0+flush-8:008:20:570
3890994642,3cyclictest8965-21kworker/u8:0+events_unbound08:45:580
3890994641,4cyclictest30318-21kworker/u8:2+events_unbound08:05:480
3890994641,4cyclictest268322-21kworker/u8:3+events_unbound12:10:590
3890994641,3cyclictest125005-21kworker/u8:1+events_unbound09:20:580
3890994640,4cyclictest8965-21kworker/u8:0+flush-8:008:25:540
3890994640,4cyclictest268322-21kworker/u8:3+events_unbound11:50:440
3890994639,5cyclictest3214171-21kworker/u8:3+events_unbound08:10:580
3890994638,3cyclictest194663-21kworker/u8:0+events_unbound11:20:580
3895994540,4cyclictest248495-21kworker/u8:2+events_unbound11:15:571
3895994540,3cyclictest312819-21kworker/u8:2+flush-8:012:35:571
3890994541,3cyclictest268322-21kworker/u8:3+flush-8:012:15:450
3890994541,3cyclictest139453-21kworker/u8:3+flush-8:009:50:530
3890994540,3cyclictest139453-21kworker/u8:3+flush-8:010:15:540
3890994539,4cyclictest268322-21kworker/u8:3+events_unbound12:05:440
3895994440,3cyclictest184449-21kworker/u8:0+events_unbound10:15:011
3895994438,5cyclictest125005-21kworker/u8:1+events_unbound09:30:541
3895994438,4cyclictest3959755-21kworker/u8:1+flush-8:007:20:461
3895994436,3cyclictest139453-21kworker/u8:3+events_unbound10:05:481
3895994435,6cyclictest224100-21latency_hist10:50:011
3890994439,4cyclictest219353-21kworker/u8:3+events_unbound11:05:580
3895994340,2cyclictest268322-21kworker/u8:3+events_unbound11:55:591
3895994339,3cyclictest248495-21kworker/u8:2+events_unbound11:45:581
3895994339,3cyclictest214213-21kworker/u8:1+flush-8:011:40:591
3895994339,3cyclictest214213-21kworker/u8:1+flush-8:011:40:591
3895994338,3cyclictest139453-21kworker/u8:3+flush-8:009:45:501
3895994337,5cyclictest125005-21kworker/u8:1+flush-8:009:35:551
3895994336,5cyclictest1704890-21systemd-journal07:10:471
3895994333,7cyclictest29677-21ntpq07:30:561
3890994338,3cyclictest3214171-21kworker/u8:3+events_unbound08:35:590
3890994338,3cyclictest3214171-21kworker/u8:3+events_unbound07:55:480
3890994334,7cyclictest158617-21ntpq09:40:530
1102942430,6sleep20-21swapper/208:55:432
3895994237,3cyclictest268322-21kworker/u8:3+flush-8:012:05:541
3895994236,4cyclictest194663-21kworker/u8:0+flush-8:010:51:011
3895994235,5cyclictest3214171-21kworker/u8:3+flush-8:007:55:551
3890994236,4cyclictest268322-21kworker/u8:3+events_unbound11:45:000
3890994236,4cyclictest268322-21kworker/u8:3+events_unbound11:45:000
3890994135,5cyclictest8965-21kworker/u8:0+events_unbound07:45:530
3890994135,4cyclictest8965-21kworker/u8:0+events_unbound09:20:000
3890994135,4cyclictest8965-21kworker/u8:0+events_unbound09:19:590
3897994022,16cyclictest60533-21cat08:05:002
3895994036,3cyclictest3214171-21kworker/u8:3+flush-8:008:00:591
3895994036,3cyclictest174211-21kworker/u8:2+events_unbound10:40:481
3895994034,5cyclictest283873-21kworker/u8:0+flush-8:012:00:551
3895994032,4cyclictest283873-21kworker/u8:0+events_unbound12:10:491
3890994036,3cyclictest8965-21kworker/u8:0+events_unbound08:30:490
3897993932,5cyclictest3214171-21kworker/u8:3+flush-8:008:50:522
3895993935,3cyclictest139453-21kworker/u8:3+events_unbound09:50:431
3895993933,5cyclictest125005-21kworker/u8:1+flush-8:009:20:471
3895993932,5cyclictest174839-21apt-get10:00:401
3895993930,5cyclictest194663-21kworker/u8:0+flush-8:010:56:011
3890993935,3cyclictest312819-21kworker/u8:2+events_unbound12:20:590
389799389,21cyclictest0-21swapper/207:35:432
3895993834,3cyclictest189648-21kworker/u8:1+flush-8:010:25:591
3895993833,4cyclictest3214171-21kworker/u8:3+events_unbound09:05:441
3895993832,5cyclictest312819-21kworker/u8:2+flush-8:012:30:521
3895993829,6cyclictest114888-21latency_hist09:00:011
3897993724,12cyclictest203853-21unixbench_multi10:26:002
389799371,21cyclictest317796-21/usr/sbin/munin12:20:582
3895993733,3cyclictest3214171-21kworker/u8:3+flush-8:007:15:571
3895993733,3cyclictest214213-21kworker/u8:1+events_unbound12:25:491
3890993733,3cyclictest268322-21kworker/u8:3+events_unbound11:55:480
3890993733,3cyclictest204534-21kworker/u8:3+flush-8:010:30:530
3890993733,3cyclictest204534-21kworker/u8:3+flush-8:010:30:520
2531572370,3sleep375-21kworker/3:1+mm_percpu_wq11:16:013
3895993631,4cyclictest30318-21kworker/u8:2+events_unbound08:05:441
3895993631,3cyclictest8965-21kworker/u8:0+flush-8:009:15:501
3895993631,3cyclictest8965-21kworker/u8:0+flush-8:009:15:491
3895993629,6cyclictest268322-21kworker/u8:3+flush-8:011:35:551
3895993627,6cyclictest1704890-21systemd-journal08:54:591
3890993632,3cyclictest3214171-21kworker/u8:3+events_unbound09:00:590
3890993632,3cyclictest248495-21kworker/u8:2+events_unbound11:25:430
41929942352,3sleep00-21swapper/007:05:030
389799359,11cyclictest1804362sed10:05:482
389799353,24cyclictest0-21swapper/207:20:542
3895993531,3cyclictest219353-21kworker/u8:3+flush-8:011:05:461
3890993530,4cyclictest3214171-21kworker/u8:3+flush-8:008:50:560
389799342,24cyclictest294093-21apt-get12:00:412
3897993416,16cyclictest0-21swapper/211:30:522
3895993428,4cyclictest194663-21kworker/u8:0+events_unbound11:21:021
3890993428,4cyclictest8965-21kworker/u8:0+events_unbound09:10:480
3260172340,2sleep3451irq_work/312:30:483
2550002340,4sleep375-21kworker/3:1-mm_percpu_wq11:20:503
3897993325,6cyclictest1704890-21systemd-journal09:12:482
3897993319,12cyclictest60944-21aten2_r5power_v08:05:432
3897993318,13cyclictest198940-21unixbench_multi10:20:592
389799331,28cyclictest304250-21/usr/sbin/munin12:10:452
389799322,23cyclictest259017-21apt-get11:25:412
389799321,27cyclictest115439-21/usr/sbin/munin09:00:432
389799318,19cyclictest224403-21apt-get10:50:422
389799314,21cyclictest204572-21apt-get10:30:412
389799314,21cyclictest204572-21apt-get10:30:412
389799312,22cyclictest268890-21apt-get11:35:412
389799312,21cyclictest299052-21apt-get12:05:422
3897993116,13cyclictest25960-21aten2_r5power_p07:30:422
389799309,17cyclictest254748-21sed11:20:492
3897993026,2cyclictest70711-21aten2_r5power_c08:15:442
3897993026,2cyclictest289019-21aten2_r5power_v11:55:442
389799302,22cyclictest184734-21apt-get10:10:422
3897993021,7cyclictest309211-21fschecks_count12:15:462
389799301,25cyclictest46412-21/usr/sbin/munin07:50:482
389799301,25cyclictest154905-21/usr/sbin/munin09:40:432
389799301,25cyclictest120508-21/usr/sbin/munin09:05:462
3895993026,3cyclictest125005-21kworker/u8:1+events_unbound09:25:591
389799294,20cyclictest242953-21ntpq11:05:552
389799294,10cyclictest2511722grep11:15:512
389799292,25cyclictest145356-21smartctl09:30:462
3897992914,13cyclictest0-21swapper/208:11:032
389799291,24cyclictest277526-21/usr/sbin/munin11:40:532
389799291,24cyclictest277526-21/usr/sbin/munin11:40:522
389799291,24cyclictest244239-21/usr/sbin/munin11:10:442
389799291,24cyclictest229816-21/usr/sbin/munin10:55:472
389799291,24cyclictest214696-21/usr/sbin/munin10:40:452
389799291,24cyclictest130448-21if_enp3s009:15:472
389799291,24cyclictest130448-21if_enp3s009:15:472
3895992924,4cyclictest125005-21kworker/u8:1+events_unbound09:40:441
41930302283,19sleep10-21swapper/107:05:321
389799288,17cyclictest179043-21grep10:01:002
3897992824,2cyclictest41089-21aten2_r5power_e07:45:412
3897992818,8cyclictest0-21swapper/210:15:592
3897992813,13cyclictest94693-21unixbench_multi08:35:592
389799281,25cyclictest238150-21/usr/sbin/munin11:00:562
389799281,23cyclictest36752-21/usr/sbin/munin07:40:482
389799281,23cyclictest278810-21/usr/sbin/munin11:45:432
389799281,23cyclictest140416-21/usr/sbin/munin09:25:462
389799281,22cyclictest319451-21ps12:25:482
389799281,22cyclictest209925-21/usr/sbin/munin10:35:452
389799280,26cyclictest160547-21/usr/sbin/munin09:45:472
389799274,17cyclictest85528-21apt-get08:30:432
3897992714,12cyclictest20977-21cron08:50:002
389799271,24cyclictest14676-21/usr/sbin/munin07:15:512
389799271,22cyclictest4569-21/usr/sbin/munin07:10:492
389799271,22cyclictest168857-21ps09:50:562
389799271,22cyclictest154723-21latency_hist09:40:002
389799271,20cyclictest169906-21apt-get09:55:412
389799270,23cyclictest25745-21date07:30:012
389799262,19cyclictest283945-21apt-get11:50:422
389799262,19cyclictest138825-21ntpq09:20:562
3895992621,4cyclictest174113-21unixbench_multi09:56:001
3897992519,4cyclictest99640-21unixbench_multi08:41:022
389799251,22cyclictest327592-21ntpq12:30:532
389799251,21cyclictest76075-21/usr/sbin/munin08:20:462
389799251,20cyclictest80940-21/usr/sbin/munin08:25:442
389799251,20cyclictest332520-21ntpq12:35:552
389799250,21cyclictest50963-21cut07:55:422
3895992520,4cyclictest3214171-21kworker/u8:3+events_unbound07:40:451
3897992412,10cyclictest0-21swapper/210:45:492
3895992218,3cyclictest283873-21kworker/u8:0+events_unbound11:54:311
389799200,17cyclictest3920-21grep07:10:012
27632193,9sleep30-21swapper/307:05:543
526822177,6sleep30-21swapper/307:55:503
1418922176,6sleep30-21swapper/309:25:513
2293432155,6sleep30-21swapper/310:55:423
1571412154,7sleep30-21swapper/309:40:513
949912142,8sleep30-21swapper/308:38:483
891022132,7sleep30-21swapper/308:30:533
87672131,6sleep30-21swapper/307:15:013
588752132,7sleep30-21swapper/308:00:523
345922132,7sleep30-21swapper/307:35:563
3333762132,7sleep30-21swapper/312:40:003
3136272132,6sleep30-21swapper/312:20:023
2886292132,6sleep30-21swapper/311:55:013
2803032133,6sleep30-21swapper/311:45:513
2092172132,6sleep30-21swapper/310:35:013
2092172132,6sleep30-21swapper/310:35:013
1637292132,7sleep30-21swapper/309:45:533
1241342132,7sleep30-21swapper/309:06:013
808192122,6sleep30-21swapper/308:25:443
706842122,6sleep30-21swapper/308:15:453
662222121,7sleep30-21swapper/308:10:513
648222122,6sleep30-21swapper/308:06:013
459952122,6sleep30-21swapper/307:50:443
456712122,6sleep30-21swapper/307:49:563
354832122,5sleep30-21swapper/307:40:013
3226192122,6sleep30-21swapper/312:25:563
3089152122,6sleep30-21swapper/312:15:413
2995562122,6sleep30-21swapper/312:05:493
2940652122,6sleep30-21swapper/312:00:403
2779492122,6sleep30-21swapper/311:41:023
2779492122,6sleep30-21swapper/311:41:013
272292122,6sleep30-21swapper/307:30:503
2656702122,6sleep30-21swapper/311:30:503
2445412122,6sleep30-21swapper/311:10:473
2390862122,5sleep30-21swapper/311:05:023
2216042122,6sleep30-21swapper/310:45:523
2151542122,6sleep30-21swapper/310:40:513
2097752122,6sleep30-21swapper/310:35:453
2032932122,6sleep30-21swapper/310:25:533
1798032122,6sleep30-21swapper/310:05:433
1745632122,5sleep30-21swapper/310:00:023
1701522122,6sleep30-21swapper/309:55:433
1653942122,6sleep30-21swapper/309:50:473
1390032122,6sleep30-21swapper/309:21:013
1339282122,6sleep30-21swapper/309:16:003
1339282122,6sleep30-21swapper/309:16:003
1250782122,6sleep30-21swapper/309:10:413
118872122,6sleep30-21swapper/307:15:493
1092502122,6sleep30-21swapper/308:51:003
1000942122,6sleep30-21swapper/308:45:023
958452112,5sleep30-21swapper/308:40:483
3047252112,5sleep30-21swapper/312:10:513
2844482111,6sleep30-21swapper/311:50:493
2589472112,6sleep30-21swapper/311:25:093
249372112,5sleep30-21swapper/307:26:013
2381442112,5sleep30-21swapper/311:00:573
1949502112,6sleep30-21swapper/310:20:443
1896422112,5sleep30-21swapper/310:15:023
159812112,5sleep30-21swapper/307:20:433
1496322112,5sleep30-21swapper/309:35:023
1449522112,6sleep30-21swapper/309:30:403
1151252112,5sleep30-21swapper/309:00:033
1102192112,5sleep30-21swapper/308:55:403
2252892100,6sleep30-21swapper/310:50:503
1852472100,6sleep30-21swapper/310:10:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional