You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 00:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Mon Aug 03, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26450902770,6chrt0-21swapper/208:28:012
27269222590,5chrt0-21swapper/209:52:542
2564819995445,6cyclictest2735963-21latency_hist10:00:001
2564819994940,6cyclictest2651810-21latency_hist08:35:011
2564820994540,3cyclictest1767997-21kworker/u8:4+events_unbound08:15:022
2564820994337,4cyclictest2606878-21gpgv07:50:002
2564815994233,6cyclictest2815625-21latency_hist11:20:010
2564815994226,11cyclictest275-21systemd-journal07:40:010
2564819994131,7cyclictest2676569-21cat09:00:001
2564820994029,9cyclictest2825509-21cat11:30:002
2564815994031,6cyclictest1767997-21kworker/u8:4+flush-8:008:08:020
28044212390,6sleep30-21swapper/311:08:023
2564820993930,7cyclictest2880415-21awk12:25:002
2564815993928,8cyclictest275-21systemd-journal10:33:060
2564820993834,3cyclictest2770494-21kworker/u8:2+flush-8:010:43:132
2564820993834,3cyclictest2671619-21kworker/u8:1+flush-8:009:33:042
2564820993732,4cyclictest2701353-21kworker/u8:3+events_unbound10:08:022
2564815993732,4cyclictest2516580-21kworker/u8:1+flush-8:008:02:570
2564815993724,10cyclictest275-21systemd-journal08:45:000
2564820993631,4cyclictest2571915-21kworker/u8:0+flush-8:007:57:592
2564819993631,3cyclictest2671619-21kworker/u8:1+events_unbound10:30:011
2564815993630,4cyclictest2581818-21unin-run07:25:010
2564815993624,9cyclictest275-21systemd-journal09:40:000
2564815993622,10cyclictest2647044-21cp08:30:010
2564820993531,3cyclictest2770494-21kworker/u8:2+events_unbound11:00:002
2564819993529,4cyclictest2657771-21journal-offline08:42:541
2564819993527,6cyclictest2770638-21latency_hist10:35:011
2564819993426,6cyclictest2855870-21/usr/sbin/munin12:03:011
2564819993426,6cyclictest2831850-21sed11:37:571
2564815993427,5cyclictest2860450-21chrt12:05:000
2564815993424,8cyclictest2841026-21/usr/sbin/munin11:48:080
2564820993328,4cyclictest2621679-21kworker/u8:2+events_unbound08:52:562
2564820993322,9cyclictest2805078-21ntpq11:08:082
2564815993328,3cyclictest2632941-21irqrtprio08:17:570
2564815993326,5cyclictest2780804-21latency_hist10:45:010
256052323324,3sleep00-21swapper/007:08:020
2564819993228,3cyclictest2598012-21irqcore07:42:581
2564819993228,3cyclictest2569878-21systemctl07:15:011
2564819993227,3cyclictest2757045-21irqrtprio10:22:581
2564815993227,4cyclictest2701353-21kworker/u8:3+events_unbound10:03:080
2564815993227,3cyclictest2750904-21systemd-run10:15:010
2564820993126,4cyclictest2740937-21kworker/u8:0+flush-8:010:33:062
2564820993125,4cyclictest2800912-21base6411:05:002
2564819993128,2cyclictest850-21mta-sts-daemon07:15:031
2564819993127,3cyclictest1-21systemd07:30:001
2564819993126,3cyclictest2730247-21needreboot09:53:011
2564819993126,3cyclictest2662954-21irqrtprio08:47:571
2564815993127,3cyclictest2516580-21kworker/u8:1+flush-8:007:28:120
2564815993126,3cyclictest2745897-21systemd-run10:10:000
2564815993125,5cyclictest1767997-21kworker/u8:4+events_unbound07:15:020
2564815993125,4cyclictest2865383-21kworker/u8:2+flush-8:012:12:540
2564815993119,8cyclictest275-21systemd-journal10:51:370
2564820993026,3cyclictest2850683-21kworker/u8:3+events_unbound12:08:042
2564820993026,3cyclictest2850683-21kworker/u8:3+events_unbound12:08:042
2564820993026,3cyclictest2671619-21kworker/u8:1+events_unbound09:15:082
2564820993026,2cyclictest2676597-21sendmail09:00:012
2564820993021,7cyclictest2855441-21awk12:00:002
2564815993025,3cyclictest2825509-21cat11:30:000
2564815993022,6cyclictest2671619-21kworker/u8:1+flush-8:009:08:030
2564815993022,5cyclictest2607761-21grep07:52:550
25601192303,6sleep10-21swapper/107:06:191
2564820992923,4cyclictest2621679-21kworker/u8:2+flush-8:008:05:102
2564819992924,3cyclictest2809875-21needreboot11:13:021
2564819992921,6cyclictest2751323-21/usr/sbin/munin10:18:021
2564819992921,6cyclictest2746385-21apt-get10:12:491
2564819992919,8cyclictest2794859-21ntpq10:58:021
2564815992924,3cyclictest275-21systemd-journal11:25:000
2564815992920,6cyclictest275-21systemd-journal08:47:560
2564815992919,8cyclictest2695654-21ntpq09:18:040
2564819992824,2cyclictest2677772-21irqrtprio09:02:571
2564819992824,2cyclictest2677772-21irqrtprio09:02:571
2564819992823,4cyclictest2785558-21unixbench_singl10:48:101
2564819992822,4cyclictest2622298-21apt-get08:07:511
2564815992818,8cyclictest2891054-21diskstats12:37:540
2564820992724,2cyclictest2681324-21unixbench_singl09:03:102
2564820992724,2cyclictest2681324-21unixbench_singl09:03:102
2564819992724,2cyclictest2851507-21irqcore11:57:561
2564819992723,3cyclictest2840606-21kworker/u8:1+flush-8:011:50:081
2564819992723,3cyclictest2725913-21unixbench_singl09:48:101
2564819992722,3cyclictest2895274-21idleruntime-cro12:40:001
2564819992721,4cyclictest2801255-21apt-get11:07:511
2564819992720,4cyclictest2616897-21latency_hist08:00:001
2564819992719,6cyclictest275-21systemd-journal11:23:181
2564815992723,2cyclictest2875460-21idleruntime-cro12:20:000
2564815992721,4cyclictest2770494-21kworker/u8:2+flush-8:010:38:100
2564815992721,4cyclictest2735953-21cron10:00:000
2564815992721,3cyclictest2770494-21kworker/u8:2+events_unbound10:47:540
2564815992721,3cyclictest0-21swapper/011:55:000
2564815992721,3cyclictest0-21swapper/011:40:000
2564815992718,6cyclictest2770494-21kworker/u8:2+flush-8:011:13:090
2564815992718,5cyclictest0-21swapper/009:47:500
256482099267,2cyclictest27531931kthreadcore10:17:592
2564820992623,2cyclictest2702112-21fschecks_time09:27:532
2564819992622,2cyclictest0-21swapper/110:40:001
2564819992621,4cyclictest2691420-21turbostat.cron09:15:001
2564819992621,4cyclictest1767997-21kworker/u8:4+flush-8:007:36:371
2564819992620,4cyclictest2825306-21unixbench_singl11:28:091
256481599263,15cyclictest571-21snmpd08:57:500
2564815992622,2cyclictest2727275-21irqrtprio09:52:560
2564815992621,3cyclictest2711276-21turbostat.cron09:35:000
2564815992621,3cyclictest2641477-21unixbench_singl08:23:090
2564815992620,4cyclictest2885348-21cron12:30:000
2564820992521,3cyclictest2571915-21kworker/u8:0+flush-8:007:30:092
2564820992520,3cyclictest2836205-21aten2_r5power_v11:42:522
2564820992519,4cyclictest2572116-21apt-get07:17:492
2564819992520,3cyclictest2636726-21idleruntime-cro08:20:001
2564819992520,3cyclictest0-21swapper/111:05:001
2564819992520,3cyclictest0-21swapper/108:05:001
2564819992519,4cyclictest275-21systemd-journal11:30:361
2564819992518,5cyclictest2875932-21apt-get12:22:511
2564815992519,4cyclictest1767997-21kworker/u8:4+flush-8:007:12:540
2564815992518,5cyclictest2780820-21kworker/u8:1+flush-8:010:58:050
2564815992518,5cyclictest2671622-21cron08:55:010
2564815992513,9cyclictest8450irq/124-ahci[0000:00:12.0]09:15:000
256482099242,6cyclictest0-21swapper/212:18:042
2564820992421,2cyclictest2721658-21aten2_r5power_c09:47:512
2564820992420,3cyclictest2661753-21cron08:45:012
2564820992420,3cyclictest2571915-21kworker/u8:0+events_unbound08:03:072
2564820992419,4cyclictest2772255-21kthreadcore10:37:592
2564819992421,2cyclictest0-21swapper/108:30:001
2564819992420,2cyclictest0-21swapper/110:02:521
2564819992419,4cyclictest2671418-21unixbench_multi08:53:121
2564819992419,3cyclictest2641482-21unixbench_singl08:23:091
2564815992419,3cyclictest401-21dbus-daemon10:25:000
2564815992419,3cyclictest0-21swapper/009:30:010
2564815992418,4cyclictest2755601-21unixbench_multi10:18:090
2564815992418,4cyclictest2681515-21sh09:05:010
2564815992418,4cyclictest2681515-21sh09:05:000
2564815992418,4cyclictest2601853-21cron07:45:000
2564820992320,2cyclictest2582348-21aten2_r5power_p07:27:542
2564820992319,3cyclictest2671619-21kworker/u8:1+flush-8:009:58:112
2564820992318,4cyclictest1767997-21kworker/u8:4+flush-8:008:15:172
2564820992315,6cyclictest2810410-21unixbench_multi11:13:112
256481999239,5cyclictest0-21swapper/111:16:241
2564819992318,3cyclictest0-21swapper/108:15:011
2564819992317,4cyclictest275-21systemd-journal09:08:021
2564819992316,6cyclictest2810675-21kworker/u8:0+flush-8:012:27:541
2564819992316,5cyclictest2776312-21apt-get10:42:531
2564819992315,6cyclictest2840586-21latency_hist11:45:011
2564819992312,3cyclictest0-21swapper/110:52:141
2564819992310,2cyclictest26940502kthreadcore09:17:591
2564815992318,3cyclictest2825389-21kworker/u8:2+events_unbound11:42:590
2564815992317,4cyclictest2765524-21unixbench_singl10:28:100
2564815992317,4cyclictest2720846-21grep09:43:090
2564815992317,4cyclictest2605301-21kthreadcore07:47:570
2564815992312,3cyclictest421rcuog/207:33:050
2564820992219,2cyclictest2841137-21aten2_r5power_p11:47:532
2564820992213,7cyclictest2835812-21cut11:40:012
256481999229,4cyclictest0-21swapper/111:46:571
2564819992218,2cyclictest0-21swapper/112:08:021
2564819992218,2cyclictest0-21swapper/112:08:021
2564819992218,2cyclictest0-21swapper/109:42:541
2564819992218,2cyclictest0-21swapper/109:32:581
2564819992217,3cyclictest2875440-21idleruntime-cro12:20:001
2564819992217,3cyclictest0-21swapper/107:32:541
2564819992215,5cyclictest275-21systemd-journal08:40:001
256481599222,14cyclictest573-21runrttasks12:32:500
2564815992218,2cyclictest0-21swapper/011:05:000
2564815992217,3cyclictest1-21systemd11:10:000
256482099212,13cyclictest2761254-21apt-get10:27:522
2564820992118,2cyclictest2786252-21aten2_r5power_c10:52:502
2564820992117,2cyclictest2826287-21fschecks_time11:32:542
2564820992117,2cyclictest2656806-21idleruntime-cro08:40:002
2564819992117,3cyclictest0-21swapper/110:08:071
2564819992116,4cyclictest2886745-21kthreadcore12:32:591
2564819992116,3cyclictest0-21swapper/109:37:571
2564819992115,4cyclictest0-21swapper/109:22:551
2564819992110,3cyclictest0-21swapper/107:47:281
2564815992117,3cyclictest2850683-21kworker/u8:3+flush-8:012:07:550
2564815992117,3cyclictest2850683-21kworker/u8:3+flush-8:012:07:550
2564815992117,2cyclictest0-21swapper/008:33:090
2564815992115,4cyclictest1767997-21kworker/u8:4+flush-8:008:12:580
2564820992017,2cyclictest2601665-21unixbench_singl07:43:122
2564820992016,3cyclictest2671619-21kworker/u8:1+flush-8:010:04:202
2564820992015,3cyclictest2687127-21tr09:12:542
2564820992014,4cyclictest2641769-21grep08:25:012
256482099201,2cyclictest161rcu_preempt10:48:102
2564820992011,7cyclictest2860474-21cat12:05:002
256482099200,2cyclictest161rcu_preempt09:23:092
2564819992016,2cyclictest0-21swapper/107:52:561
2564819992016,2cyclictest0-21swapper/107:22:591
2564819992015,3cyclictest0-21swapper/112:15:001
2564815992015,3cyclictest2855541-21cat12:00:000
2564815992014,4cyclictest2698404-21kthreadcore09:22:580
2564815992013,5cyclictest2656080-21ld08:38:050
25644912204,9sleep20-21swapper/207:08:242
256482099193,5cyclictest0-21swapper/211:22:522
256482099192,9cyclictest0-21swapper/212:33:032
2564820991914,3cyclictest2621679-21kworker/u8:2+events_unbound08:45:012
2564820991910,7cyclictest2882641-21tr12:27:582
256482099190,2cyclictest161rcu_preempt09:09:432
2564815991913,4cyclictest2571915-21kworker/u8:0+events_unbound07:58:040
2564815991911,6cyclictest2810675-21kworker/u8:0+events_unbound12:23:040
256482099182,11cyclictest2746175-21apt-get10:10:502
2564820991815,2cyclictest2577897-21sed07:22:582
2564820991814,2cyclictest0-21swapper/210:23:032
2564820991814,2cyclictest0-21swapper/207:52:532
2564819991814,2cyclictest0-21swapper/109:27:511
2564815991814,2cyclictest2826195-21cpuspeed_turbos11:32:530
25605682183,8sleep30-21swapper/307:08:093
256482099176,2cyclictest521rcuop/312:13:022
256482099173,8cyclictest2894561-21ntpq12:38:032
2564820991710,5cyclictest2847137-21cut11:52:592
28509012162,9sleep30-21swapper/311:57:503
256482099162,10cyclictest2596307-21ntpq07:38:082
2564820991612,3cyclictest2565406-21cpuspeed_turbos07:12:532
2564820991612,2cyclictest0-21swapper/211:17:542
2564820991612,2cyclictest0-21swapper/209:43:002
2564820991611,4cyclictest2631591-21kworker/u8:0+events_unbound08:33:402
28446442153,9sleep30-21swapper/311:48:033
26193932150,2sleep3481ktimers/308:03:013
256482099153,7cyclictest2711739-21apt-get09:37:512
28829232140,2sleep3481ktimers/312:27:583
26577272143,7sleep30-21swapper/308:42:543
25765702142,7sleep30-21swapper/307:20:013
28754322132,7sleep30-21swapper/312:20:003
28353612132,7sleep30-21swapper/311:40:003
27751172134,5sleep30-21swapper/310:38:053
27618382132,7sleep30-21swapper/310:27:583
26808272132,7sleep30-21swapper/309:03:053
26808272132,7sleep30-21swapper/309:03:053
26317892132,6sleep30-21swapper/308:15:023
26018482132,6sleep30-21swapper/307:45:013
28903282122,5sleep30-21swapper/312:35:013
28802562122,6sleep30-21swapper/312:23:213
28658232122,6sleep30-21swapper/312:10:383
28630322122,6sleep30-21swapper/312:08:013
28630322122,6sleep30-21swapper/312:08:013
28476702122,6sleep30-21swapper/311:53:003
28255222123,5sleep30-21swapper/311:30:013
28158502122,5sleep30-21swapper/311:20:023
28116282122,6sleep30-21swapper/311:17:583
28104912122,6sleep30-21swapper/311:13:133
27857792122,5sleep30-21swapper/310:50:013
27800892122,6sleep30-21swapper/310:43:083
27692772122,6sleep30-21swapper/310:33:003
27418392122,6sleep30-21swapper/310:07:563
27400402122,6sleep30-21swapper/310:03:033
27309062122,6sleep30-21swapper/309:53:363
27165212124,5sleep30-21swapper/309:40:563
27103962122,6sleep30-21swapper/309:33:023
27022922122,7sleep30-21swapper/309:27:563
26819592122,6sleep30-21swapper/309:07:503
26718972122,6sleep30-21swapper/308:55:343
26685872122,6sleep30-21swapper/308:53:013
26666872122,5sleep30-21swapper/308:50:013
26459682122,6sleep30-21swapper/308:28:063
26416432122,5sleep30-21swapper/308:25:013
26263492122,6sleep30-21swapper/308:08:123
26139252122,6sleep30-21swapper/307:58:013
25977652122,6sleep30-21swapper/307:42:563
25920602122,6sleep30-21swapper/307:35:023
25802922122,6sleep30-21swapper/307:23:023
25654912122,6sleep30-21swapper/307:12:553
28855852113,5sleep30-21swapper/312:30:043
28603732110,7sleep30-21swapper/312:05:003
28397012112,5sleep30-21swapper/311:43:013
28251102112,5sleep30-21swapper/311:28:103
27960922112,5sleep30-21swapper/311:02:533
27914652112,6sleep30-21swapper/310:57:553
27810522112,5sleep30-21swapper/310:45:243
27564112112,5sleep30-21swapper/310:22:533
27550992112,6sleep30-21swapper/310:18:033
27463082112,6sleep30-21swapper/310:12:113
27314672112,5sleep30-21swapper/309:57:493
27211872111,5sleep30-21swapper/309:45:013
26967142112,5sleep30-21swapper/309:21:143
26959202112,5sleep30-21swapper/309:18:093
26913122113,5sleep30-21swapper/309:13:483
26476032112,5sleep30-21swapper/308:32:553
26272362112,5sleep30-21swapper/308:12:413
26072492113,5sleep30-21swapper/307:50:183
25874372112,5sleep30-21swapper/307:32:533
25822372112,5sleep30-21swapper/307:27:523
27115032102,5sleep30-21swapper/309:35:063
26520342102,5sleep30-21swapper/308:35:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional