You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 10:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon May 25, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244493122720,3sleep375-21kworker/3:1-events19:55:533
2395820996356,5cyclictest2417752-21kworker/u8:2+flush-8:021:10:480
2395826995749,6cyclictest2685102-40logrotate00:00:002
2395820995745,9cyclictest2451189-21ntpq20:00:560
24244162550,3chrt75-21kworker/3:1-events19:35:503
2395820995446,6cyclictest2371311-21kworker/u8:4+flush-8:019:45:460
2395820995444,7cyclictest2561339-21/usr/sbin/munin21:56:000
24534132520,2sleep0201rcuc/020:05:490
2395822995246,4cyclictest2371302-21kworker/u8:0+events_unbound00:35:561
2395822995244,6cyclictest2640868-21/usr/sbin/munin23:16:001
2395820995245,4cyclictest2417752-21kworker/u8:2+flush-8:020:40:470
2395822995145,4cyclictest2371311-21kworker/u8:4+flush-8:019:35:471
2395820995143,6cyclictest2566037-21kworker/u8:3+flush-8:022:30:460
2395822995044,4cyclictest2371302-21kworker/u8:0+flush-8:020:51:001
2395822995043,5cyclictest2417752-21kworker/u8:2+flush-8:019:55:491
2395820995044,5cyclictest2417752-21kworker/u8:2+flush-8:020:10:480
2395822994739,6cyclictest2709032-21ntpq00:20:571
2395820994738,7cyclictest2422751-21/usr/sbin/munin19:35:540
2395822994639,5cyclictest2566037-21kworker/u8:3+flush-8:022:55:491
2395822994637,7cyclictest2619954-21ntpq22:50:561
2395822994540,3cyclictest2417752-21kworker/u8:2+flush-8:020:20:481
2395822994540,3cyclictest2417752-21kworker/u8:2+flush-8:020:20:481
2395822994537,5cyclictest2695337-21/usr/sbin/munin00:11:041
2395820994534,9cyclictest2500883-21ntpq20:50:580
2395822994437,5cyclictest2371311-21kworker/u8:4+flush-8:019:26:001
2395822994435,7cyclictest2685140-21kworker/u8:3+events_unbound00:25:551
2395820994437,5cyclictest2371302-21kworker/u8:0+flush-8:023:00:460
2395820994437,5cyclictest2371302-21kworker/u8:0+flush-8:021:05:470
2395820994436,7cyclictest2566037-21kworker/u8:3+flush-8:023:15:560
2395820994334,6cyclictest2470953-21ntpq20:20:560
2395820994334,6cyclictest2470953-21ntpq20:20:560
2395820994332,8cyclictest2442234-21latency_hist19:55:010
2395822994236,4cyclictest2371302-21kworker/u8:0+flush-8:020:55:471
2395820994234,6cyclictest2481712-21gpgv20:35:010
2395820994232,7cyclictest2630976-21/usr/sbin/munin23:05:560
2395820994232,7cyclictest2630976-21/usr/sbin/munin23:05:560
2395820994231,8cyclictest2674362-21ntpq23:45:560
2395822994135,5cyclictest2501722-21kworker/u8:1+flush-8:021:35:471
2395822994135,5cyclictest2371302-21kworker/u8:0+flush-8:023:35:481
2395822994032,6cyclictest2704930-21latency_hist00:20:011
2395822994031,6cyclictest1704890-21systemd-journal19:51:471
2395822993930,7cyclictest2452375-21/usr/sbin/munin20:05:531
2395820993934,3cyclictest2660089-21kworker/u8:2+events_unbound00:15:450
2395820993929,8cyclictest2580853-21apt-get22:15:010
2395822993829,6cyclictest2610945-21latency_hist22:45:011
2395822993828,8cyclictest2689257-21ntpq00:00:561
2395820993834,3cyclictest2417752-21kworker/u8:2+flush-8:021:00:590
2395820993833,4cyclictest2371311-21kworker/u8:4+flush-8:019:20:470
239582099382,30cyclictest2390648-21kworker/0:0+events20:25:040
239520623822,11sleep10-21swapper/119:06:371
2395822993732,3cyclictest2645873-21apt-get23:20:421
2395822993730,5cyclictest2551470-21apt-get21:45:411
2395822993730,5cyclictest2551470-21apt-get21:45:411
2395822993727,7cyclictest2605982-21latency_hist22:40:011
2395820993728,7cyclictest1704890-21systemd-journal20:45:460
239582099372,29cyclictest2390648-21kworker/0:0+events22:00:390
2395820993628,6cyclictest1704890-21systemd-journal21:55:000
2395820993626,7cyclictest2400771-21latency_hist19:15:000
2395820993624,9cyclictest2591523-21diskstats22:25:460
2395822993528,5cyclictest2586018-21latency_hist22:20:001
239582099352,28cyclictest2390648-21kworker/0:0+events19:25:240
2395820993518,15cyclictest1704890-21systemd-journal22:55:000
239582099350,30cyclictest2670305-21kworker/0:2+events23:55:230
25330382340,4sleep10-21swapper/121:25:521
2395822993430,3cyclictest1-21systemd00:00:001
2395822993429,4cyclictest2417752-21kworker/u8:2+flush-8:020:31:011
2395822993427,5cyclictest2482221-21apt-get20:35:431
2395822993424,8cyclictest2510814-21ntpq21:00:561
2395820993429,4cyclictest2371302-21kworker/u8:0+events_unbound22:40:000
239582099342,31cyclictest2586075-21kworker/0:2+events22:58:570
239582099342,30cyclictest2390648-21kworker/0:0+events22:07:170
239582099341,32cyclictest2586075-21kworker/0:2+events23:24:570
2395822993329,3cyclictest2566037-21kworker/u8:3+flush-8:022:30:581
2395822993328,3cyclictest2417752-21kworker/u8:2+flush-8:022:20:471
2395822993327,5cyclictest2566037-21kworker/u8:3+flush-8:023:05:481
2395822993327,5cyclictest2566037-21kworker/u8:3+flush-8:023:05:471
2395820993328,3cyclictest2660089-21kworker/u8:2+flush-8:000:00:580
239582099332,30cyclictest2390648-21kworker/0:0+events22:24:030
239582699328,12cyclictest2396085-21apt-get19:10:452
2395822993227,4cyclictest2417752-21kworker/u8:2+events_unbound22:00:591
2395822993227,3cyclictest2491478-21unixbench_singl20:41:031
2395820993227,3cyclictest2545268-21needreboot21:35:540
239582099320,31cyclictest2650531-21kworker/0:0+events23:42:310
23908522324,9sleep20-21swapper/219:05:172
239582699316,16cyclictest2507010-21http21:00:442
2395822993127,3cyclictest2417752-21kworker/u8:2+flush-8:019:41:011
2395822993127,3cyclictest2371302-21kworker/u8:0+events_unbound23:50:551
2395822993126,4cyclictest2371302-21kworker/u8:0+flush-8:021:32:421
2395822993126,3cyclictest2655468-21systemd-run23:30:011
2395822993126,3cyclictest2466897-21cron20:19:591
2395822993125,5cyclictest2417752-21kworker/u8:2+flush-8:020:01:011
2395822993125,4cyclictest2521797-21apt-get21:15:441
2395822993124,5cyclictest2660089-21kworker/u8:2+flush-8:000:05:481
2395820993126,3cyclictest2705225-21/usr/sbin/munin00:20:500
239582099312,28cyclictest2390648-21kworker/0:0+events19:32:450
2395820993122,6cyclictest1704890-21systemd-journal19:55:470
239582099310,30cyclictest2390648-21kworker/0:0+events20:17:540
239582099310,29cyclictest2390648-21kworker/0:0+events21:22:310
239582699309,8cyclictest0-21swapper/222:50:492
239582699309,11cyclictest2654817-21python323:26:002
239582699309,11cyclictest2565113-21ntpq21:55:562
2395826993024,4cyclictest2540861-21unixbench_multi21:31:022
2395826993020,5cyclictest2720036-21apt-get00:35:442
2395826993020,5cyclictest2551470-21apt-get21:45:422
2395826993020,5cyclictest2551470-21apt-get21:45:412
2395826993017,10cyclictest2501036-21/usr/sbin/munin20:51:012
2395822993024,4cyclictest2655742-21apt-get23:30:411
2395822993024,4cyclictest2521076-21unixbench_multi21:11:031
2395822993023,5cyclictest2417752-21kworker/u8:2+flush-8:022:06:001
239582099303,22cyclictest2670305-21kworker/0:2+events00:25:170
2395820993026,2cyclictest2484213-21kthreadcore20:35:520
2395820993025,3cyclictest2657894-21kthreadcore23:30:500
2395820993024,4cyclictest2699577-21grep00:11:060
2395820993024,3cyclictest0-21swapper/023:25:420
239582099302,27cyclictest2390648-21kworker/0:0+events22:16:570
239582099302,27cyclictest2390648-21kworker/0:0+events21:49:030
239582099302,27cyclictest2390648-21kworker/0:0+events21:49:020
239582099302,27cyclictest2390648-21kworker/0:0+events19:44:560
239582099302,26cyclictest2586075-21kworker/0:2+events22:48:280
239582099302,24cyclictest2650531-21kworker/0:0+events23:50:210
239582699298,6cyclictest2623719-21cut22:55:542
239582699298,5cyclictest2695363-21apt-get00:10:472
239582699296,5cyclictest2456157-21ntpq20:05:542
2395826992920,5cyclictest2664544-21ntpq23:35:582
2395826992920,4cyclictest2457336-21apt-get20:10:452
2395826992920,4cyclictest2412884-21apt-get19:25:422
2395826992919,6cyclictest2531710-21apt-get21:25:442
2395826992919,4cyclictest2640894-21apt-get23:15:442
2395826992911,13cyclictest2492234-21/usr/sbin/munin20:45:442
2395822992924,4cyclictest2371302-21kworker/u8:0+events_unbound23:00:561
2395822992924,3cyclictest2580848-21latency_hist22:15:011
239582099296,18cyclictest2390648-21kworker/0:0+events21:40:410
2395820992924,4cyclictest2371302-21kworker/u8:0+flush-8:021:25:480
239582099292,26cyclictest2670305-21kworker/0:2+events00:31:230
239582099292,26cyclictest2586075-21kworker/0:2+events23:10:210
239582099292,26cyclictest2390648-21kworker/0:0+events19:15:230
25385192280,3sleep375-21kworker/3:1+events21:30:513
2395826992822,4cyclictest1704890-21systemd-journal22:39:592
2395826992820,6cyclictest2700821-21/usr/sbin/munin00:15:492
2395826992819,4cyclictest2606305-21apt-get22:40:442
2395826992814,11cyclictest2586321-21acpi22:20:422
2395826992810,5cyclictest2480799-21ntpq20:30:542
2395822992823,3cyclictest2560659-21unixbench_multi21:51:011
2395822992823,3cyclictest2400771-21latency_hist19:15:001
2395822992822,4cyclictest2407948-21apt-get19:20:421
2395820992823,4cyclictest2502037-21aten2_r5power_c20:55:450
2395820992820,6cyclictest2525631-21ntpq21:15:590
239582099281,26cyclictest2670305-21kworker/0:2+events00:36:470
239582099280,27cyclictest2670305-21kworker/0:2+events00:05:230
2395826992723,2cyclictest2631231-21cpuspeed_turbos23:05:462
2395826992723,2cyclictest2631231-21cpuspeed_turbos23:05:462
2395826992723,2cyclictest2436918-21unixbench_singl19:46:002
2395826992722,3cyclictest2512004-21aten2_r5power_p21:05:452
2395826992716,8cyclictest2423366-21ps19:35:492
2395826992715,9cyclictest2571295-21/usr/sbin/munin22:05:442
2395826992715,8cyclictest2502259-21/usr/sbin/munin20:55:472
2395826992714,9cyclictest2675996-21/usr/sbin/munin23:50:472
2395826992714,10cyclictest2556464-21/usr/sbin/munin21:50:432
2395826992713,11cyclictest2407465-21seq19:18:012
2395822992723,2cyclictest2531407-21cron21:25:001
2395822992721,4cyclictest2660089-21kworker/u8:2+flush-8:023:41:021
2395822992721,4cyclictest2417818-21apt-get19:30:431
2395822992717,7cyclictest1704890-21systemd-journal23:10:471
239582099272,24cyclictest2650531-21kworker/0:0+events23:39:330
239582099272,24cyclictest2586075-21kworker/0:2+events22:42:110
2395820992722,4cyclictest2417752-21kworker/u8:2+flush-8:021:30:500
2395826992622,2cyclictest2636067-21aten2_r5power_v23:10:432
2395826992622,2cyclictest2591358-21aten2_r5power_p22:25:442
2395826992621,3cyclictest2576272-21aten2_r5power_e22:10:452
2395826992616,8cyclictest2527056-21/usr/sbin/munin21:20:472
2395826992616,7cyclictest2685510-21/usr/sbin/munin00:00:442
2395826992615,8cyclictest2487603-21/usr/sbin/munin20:40:492
2395826992615,8cyclictest2472582-21/usr/sbin/munin20:25:482
2395826992614,10cyclictest2615870-21apt22:50:002
2395826992612,12cyclictest2551006-21chrt21:43:022
2395822992621,3cyclictest2371311-21kworker/u8:4+events_unbound19:15:031
23953992262,6sleep00-21swapper/019:09:050
2395826992521,2cyclictest2705477-21cpuspeed_turbos00:20:462
2395826992519,3cyclictest2446353-21ntpq19:55:592
2395826992516,4cyclictest2580853-21apt-get22:15:032
2395826992515,8cyclictest2541765-21/usr/sbin/munin21:35:442
2395826992515,8cyclictest2467387-21/usr/sbin/munin20:20:452
2395826992515,8cyclictest2467387-21/usr/sbin/munin20:20:442
2395826992515,6cyclictest2437740-21/usr/sbin/munin19:50:442
2395826992512,9cyclictest2525833-21mailstats21:16:032
2395826992512,11cyclictest2466761-21chrt20:18:152
2395826992511,12cyclictest2674948-21chrt23:46:572
2395822992519,4cyclictest2417752-21kworker/u8:2+events_unbound20:10:571
2395822992518,5cyclictest2660089-21kworker/u8:2+events_unbound00:30:541
2395822992518,5cyclictest2371311-21kworker/u8:4+flush-8:019:45:561
2395822992516,7cyclictest1704890-21systemd-journal21:05:471
2395826992417,4cyclictest2408173-21tr19:20:452
2395826992415,7cyclictest2713973-21/usr/sbin/munin00:25:572
2395826992415,7cyclictest2649644-21/usr/sbin/munin23:20:562
2395826992415,7cyclictest2570905-21seq22:04:142
2395826992415,7cyclictest2431390-21/usr/sbin/munin19:40:552
2395826992413,8cyclictest2516823-21chrt21:10:362
2395826992413,7cyclictest2447677-21/usr/sbin/munin20:00:462
2395822992418,5cyclictest2371302-21kworker/u8:0+flush-8:022:45:461
2395822992418,4cyclictest2371302-21kworker/u8:0+events_unbound20:45:551
2395822992415,7cyclictest2565113-21ntpq21:55:561
239582699239,12cyclictest2670040-21chrt23:42:162
2395826992314,7cyclictest2659502-21ntpq23:30:562
2395826992311,9cyclictest2417769-21chrt19:30:232
2395822992319,2cyclictest0-21swapper/123:46:021
2395826992216,3cyclictest2715817-21ps00:30:472
2395826992213,7cyclictest2596584-21/usr/sbin/munin22:30:472
2395826992213,6cyclictest2626058-21seq23:00:402
2395826992211,9cyclictest2695116-21date00:10:002
2395826992211,9cyclictest2482189-21taskset20:35:372
2395822992118,2cyclictest2595215-21mailstats22:26:001
23906342213,8sleep30-21swapper/319:05:023
2395822992013,4cyclictest0-21swapper/121:40:491
2395822991812,3cyclictest0-21swapper/120:25:491
26917002132,6sleep30-21swapper/300:05:533
26008302132,7sleep30-21swapper/322:35:003
25800562132,7sleep30-21swapper/322:11:013
25610482132,7sleep30-21swapper/321:55:003
24677042132,7sleep30-21swapper/320:20:503
24677042132,7sleep30-21swapper/320:20:503
24516422132,7sleep30-21swapper/320:01:043
27205552122,6sleep30-21swapper/300:35:503
27049732122,5sleep30-21swapper/300:20:013
27006742122,6sleep30-21swapper/300:15:483
26801782122,5sleep30-21swapper/323:55:023
26759072122,6sleep30-21swapper/323:50:483
26704912122,5sleep30-21swapper/323:45:023
26659052122,6sleep30-21swapper/323:40:493
26606342124,5sleep30-21swapper/323:35:423
26554602122,5sleep30-21swapper/323:30:023
26536262120,3sleep375-21kworker/3:1+mm_percpu_wq23:25:513
26457432122,5sleep30-21swapper/323:20:023
26359712122,6sleep30-21swapper/323:10:443
26234842122,6sleep30-21swapper/322:55:543
26158612122,5sleep30-21swapper/322:50:013
26103162122,6sleep30-21swapper/322:41:023
26013812122,6sleep30-21swapper/322:35:453
25913712122,6sleep30-21swapper/322:25:453
25866862122,6sleep30-21swapper/322:20:473
25819662122,6sleep30-21swapper/322:15:503
25355092122,6sleep30-21swapper/321:25:593
25256222123,5sleep30-21swapper/321:16:003
25165812122,5sleep30-21swapper/321:10:023
25078942122,6sleep30-21swapper/321:00:513
24970432122,6sleep30-21swapper/320:50:433
24918512122,6sleep30-21swapper/320:45:023
24874302122,6sleep30-21swapper/320:40:483
24858172122,6sleep30-21swapper/320:35:543
24619322122,6sleep30-21swapper/320:15:003
24521172122,5sleep30-21swapper/320:05:003
24380632122,6sleep30-21swapper/319:50:483
24372632122,7sleep30-21swapper/319:50:003
24273982122,5sleep30-21swapper/319:40:013
24117972122,6sleep30-21swapper/319:20:593
24034322122,6sleep30-21swapper/319:15:503
23960592122,6sleep30-21swapper/319:10:443
27159812112,5sleep30-21swapper/300:30:493
27104342112,5sleep30-21swapper/300:25:463
26952812112,5sleep30-21swapper/300:10:013
26857682112,5sleep30-21swapper/300:00:473
26408992112,5sleep30-21swapper/323:15:453
26347742112,5sleep30-21swapper/323:05:583
26347742112,5sleep30-21swapper/323:05:573
26300722112,5sleep30-21swapper/323:01:013
26112432112,5sleep30-21swapper/322:45:443
25715382112,5sleep30-21swapper/322:05:463
25698702112,5sleep30-21swapper/322:00:543
25616172112,6sleep30-21swapper/321:55:483
25465092112,5sleep30-21swapper/321:40:433
25413062111,5sleep30-21swapper/321:35:013
25267522113,5sleep30-21swapper/321:20:283
25119212112,5sleep30-21swapper/321:05:433
25020102112,5sleep30-21swapper/320:55:453
24801392112,5sleep30-21swapper/320:30:533
24725192112,5sleep30-21swapper/320:25:483
24622532112,5sleep30-21swapper/320:15:453
24176432112,5sleep30-21swapper/319:30:023
24168832112,5sleep30-21swapper/319:26:013
25513972102,5sleep30-21swapper/321:45:053
25513972102,5sleep30-21swapper/321:45:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional