You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 00:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun Aug 02, 2026 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
289965122280,3sleep3575-21kworker/3:2+events09:03:013
28156462700,2sleep3471rcuc/307:38:003
28908332630,5sleep30-21swapper/308:52:583
28338802620,2sleep1161rcu_preempt07:58:001
2785771995449,4cyclictest2776081-21kworker/u8:0+flush-8:007:43:091
2785769995243,7cyclictest2867305-21latency_hist08:30:010
2785771994840,6cyclictest275-21systemd-journal12:30:001
2785775994537,6cyclictest2887166-21gpgv08:50:002
2785771994540,4cyclictest2790820-21kworker/u8:3+flush-8:009:38:101
2785771994538,5cyclictest3030973-21kworker/u8:1+events_unbound11:58:121
2785771994437,5cyclictest3115956-21latency_hist12:40:001
2785771994339,3cyclictest2852329-21kworker/u8:2+events_unbound08:32:581
2785769994338,3cyclictest2951724-21kworker/u8:1+events_unbound10:37:550
2785769994135,4cyclictest1427849-21kworker/u8:1+flush-8:007:47:530
2785771994034,5cyclictest2790820-21kworker/u8:3+events_unbound07:23:101
2785769994035,3cyclictest1-21systemd07:25:000
28237062390,4sleep10-21swapper/107:47:571
2785769993932,5cyclictest3061125-21kworker/u8:2+flush-8:012:38:060
2785771993833,4cyclictest2790820-21kworker/u8:3+flush-8:008:08:131
2785771993833,4cyclictest2790820-21kworker/u8:3+events_unbound10:23:101
2785771993833,3cyclictest2961586-21kworker/u8:2+events_unbound10:15:011
2785771993832,5cyclictest2961586-21kworker/u8:2+flush-8:010:48:081
2785771993832,4cyclictest2996456-21kworker/u8:0+events_unbound11:17:541
2785771993830,6cyclictest2912462-21/usr/sbin/munin09:18:091
2785775993730,5cyclictest3091383-21cat12:15:012
2785771993731,4cyclictest2961586-21kworker/u8:2+events_unbound10:18:071
2785771993730,3cyclictest1427849-21kworker/u8:1+events_unbound08:03:101
278576999370,35cyclictest3076174-21munin-run12:00:000
27811292374,11sleep10-21swapper/107:07:331
2785771993631,4cyclictest2790820-21kworker/u8:3+flush-8:010:38:091
2785771993630,4cyclictest2790820-21kworker/u8:3+events_unbound11:13:101
2785771993529,4cyclictest2790820-21kworker/u8:3+flush-8:007:28:081
2785771993529,4cyclictest1427849-21kworker/u8:1+events_unbound08:58:041
2785771993528,5cyclictest2790820-21kworker/u8:3+flush-8:010:03:101
2785771993528,4cyclictest1427849-21kworker/u8:1+events_unbound08:18:021
2785769993526,7cyclictest3041523-21/usr/sbin/munin11:28:020
2785771993430,3cyclictest2790820-21kworker/u8:3+events_unbound09:47:561
2785771993428,4cyclictest3030973-21kworker/u8:1+flush-8:011:38:091
2785771993428,4cyclictest2793041-21apt-get07:17:521
2785771993427,5cyclictest3036638-21apt-get11:22:511
2785769993429,3cyclictest2907009-21cron09:10:000
2785769993426,6cyclictest2987164-21/usr/sbin/munin10:33:090
27811382341,27sleep00-21swapper/007:07:400
2785771993328,3cyclictest2852329-21kworker/u8:2+events_unbound08:28:111
2785771993319,10cyclictest3070966-21latency_hist11:55:021
2785771993228,3cyclictest3030973-21kworker/u8:1+events_unbound11:27:581
2785771993227,4cyclictest2790820-21kworker/u8:3+flush-8:011:07:591
2785771993227,3cyclictest3047227-21irqrtprio11:32:581
2785771993226,4cyclictest3085888-21kworker/u8:0+events_unbound12:23:051
2785771993226,4cyclictest2857903-21apt-get08:22:501
2785771993224,6cyclictest3085888-21kworker/u8:0+flush-8:012:18:071
2785771993224,6cyclictest3006941-21/usr/sbin/munin10:53:051
2785769993226,5cyclictest2790820-21kworker/u8:3+flush-8:007:28:070
27809532324,10sleep20-21swapper/207:05:172
2785771993127,3cyclictest2790820-21kworker/u8:3+events_unbound10:28:051
2785771993126,3cyclictest2951724-21kworker/u8:1+flush-8:010:07:561
2785769993127,3cyclictest2982566-21fschecks_time10:27:560
2785769993122,7cyclictest3101589-21/usr/sbin/munin12:28:090
2785769993120,8cyclictest2916300-21ntpq09:18:040
2785775993027,2cyclictest3085888-21kworker/u8:0+events_unbound12:30:132
2785775993024,4cyclictest275-21systemd-journal09:38:132
2785771993024,4cyclictest2907044-21kworker/u8:0+events_unbound09:22:571
2785771993024,4cyclictest1427849-21kworker/u8:1+events_unbound08:47:571
2785771993021,6cyclictest3030973-21kworker/u8:1+flush-8:012:08:051
2785769993027,2cyclictest3047038-21irqcore11:32:570
2785769993025,4cyclictest1427849-21kworker/u8:1+flush-8:009:28:220
2785769993025,3cyclictest2948461-21kthreadcore09:53:000
2785769993025,3cyclictest2912003-21sh09:15:000
2785775992924,4cyclictest3021324-21idleruntime-cro11:05:002
2785775992923,4cyclictest2996343-21unixbench_multi10:38:102
2785775992920,7cyclictest2972095-21cp10:15:012
2785771992924,4cyclictest1427849-21kworker/u8:1+flush-8:009:27:571
2785771992924,3cyclictest2987417-21tr10:32:541
2785771992923,4cyclictest401-21dbus-daemon08:15:001
2785771992923,4cyclictest1427849-21kworker/u8:1+flush-8:009:33:101
2785769992925,3cyclictest2790820-21kworker/u8:3+events_unbound08:08:160
2785769992924,4cyclictest1427849-21kworker/u8:1+flush-8:008:47:550
2785769992924,3cyclictest401-21dbus-daemon08:25:000
2785769992922,5cyclictest2872707-21/usr/sbin/munin08:38:110
2785769992920,7cyclictest3081083-21latency_hist12:05:010
2785775992822,4cyclictest2981531-21unixbench_multi10:23:122
2785775992818,8cyclictest275-21systemd-journal09:10:002
2785771992824,3cyclictest2996456-21kworker/u8:0+events_unbound10:57:591
2785771992824,3cyclictest2790820-21kworker/u8:3+flush-8:009:08:051
2785771992823,4cyclictest3061125-21kworker/u8:2+flush-8:012:13:031
2785771992822,4cyclictest2790820-21kworker/u8:3+flush-8:010:43:061
2785771992819,7cyclictest2951151-21ntpq09:53:051
2785771992813,10cyclictest275-21systemd-journal07:55:001
2785769992824,2cyclictest3055126-21needreboot11:38:010
2785769992822,4cyclictest2790422-21unixbench_multi07:13:130
2785769992820,6cyclictest2836848-21needreboot07:58:050
2785775992722,3cyclictest3051670-21cpuspeed_turbos11:37:532
278577599270,10cyclictest2810050-21cut07:32:592
278577599270,10cyclictest2810050-21cut07:32:592
2785771992720,5cyclictest1427849-21kworker/u8:1+flush-8:007:13:061
2785771992720,3cyclictest0-21swapper/111:02:581
2785769992722,3cyclictest3007693-21irqrtprio10:52:570
2785769992721,4cyclictest2897164-21basename09:00:000
2785769992720,5cyclictest2776081-21kworker/u8:0+events_unbound07:40:000
2785775992620,4cyclictest2897865-21cpuspeed_turbos09:02:552
2785775992616,8cyclictest2832561-21cp07:55:012
2785771992622,2cyclictest2912001-21cron09:15:001
2785771992621,2cyclictest0-21swapper/109:58:131
2785771992620,5cyclictest2852329-21kworker/u8:2+events_unbound08:52:521
2785769992621,3cyclictest2852458-21basename08:15:010
2785769992620,4cyclictest2981544-21unixbench_multi10:23:110
2785769992619,5cyclictest0-21swapper/008:05:010
278577599258,4cyclictest2813889-21cut07:37:582
278577599258,2cyclictest161rcu_preempt09:27:562
278577599256,4cyclictest0-21swapper/210:28:032
278577599254,6cyclictest275-21systemd-journal10:59:122
2785775992520,4cyclictest2857409-21idleruntime-cro08:20:012
2785775992516,7cyclictest2868088-21fschecks_time08:32:572
2785775992514,1cyclictest161rcu_preempt08:42:362
278577599250,13cyclictest2798066-21apt-get07:22:532
2785771992521,3cyclictest2776081-21kworker/u8:0+events_unbound07:33:081
2785771992521,3cyclictest2776081-21kworker/u8:0+events_unbound07:33:081
2785771992521,2cyclictest3111062-21systemd-run12:35:001
2785771992521,2cyclictest0-21swapper/111:43:081
2785771992519,4cyclictest3061125-21kworker/u8:2+events_unbound12:02:551
2785771992519,3cyclictest0-21swapper/108:38:001
2785771992518,5cyclictest2852329-21kworker/u8:2+flush-8:009:03:161
2785769992522,2cyclictest3085240-21needreboot12:08:040
2785769992522,2cyclictest2922229-21systemd-run09:25:000
2785769992521,3cyclictest2936783-21unixbench_multi09:38:110
2785769992521,2cyclictest0-21swapper/012:20:000
2785769992520,1cyclictest0-21swapper/011:53:080
2785769992519,4cyclictest2853514-21sort08:17:570
2785769992519,4cyclictest2797359-21unixbench_singl07:18:110
2785769992515,4cyclictest1427849-21kworker/u8:1+flush-8:007:33:110
2785769992515,4cyclictest1427849-21kworker/u8:1+flush-8:007:33:110
278577599242,6cyclictest0-21swapper/208:24:112
278577599242,5cyclictest0-21swapper/212:18:052
278577599242,5cyclictest0-21swapper/209:00:012
2785775992420,3cyclictest2996456-21kworker/u8:0+events_unbound10:45:082
2785775992420,2cyclictest2786151-21aten2_r5power_c07:12:552
2785775992418,4cyclictest2991440-21unixbench_multi10:33:112
278577599241,12cyclictest39-21ksoftirqd/212:05:362
278577599240,9cyclictest39-21ksoftirqd/208:00:002
278577599240,9cyclictest2818502-21cut07:42:582
2785771992420,3cyclictest3065588-21unixbench_multi11:48:111
2785771992420,3cyclictest2813087-21cpuspeed07:37:531
2785771992419,4cyclictest1427849-21kworker/u8:1+events_unbound08:43:051
2785769992421,2cyclictest851-21mta-sts-daemon11:08:000
2785769992420,3cyclictest3001333-21unixbench_multi10:43:110
2785769992420,3cyclictest1427849-21kworker/u8:1+flush-8:009:03:350
2785769992420,2cyclictest0-21swapper/009:50:000
2785769992419,3cyclictest0-21swapper/010:10:000
2785775992320,2cyclictest3101146-21awk12:25:002
2785775992320,2cyclictest3026059-21unixbench_singl11:08:112
2785775992317,4cyclictest3065841-21gpgv11:50:002
2785775992314,7cyclictest275-21systemd-journal08:50:002
278577599231,20cyclictest3037561-21sed11:22:592
278577599230,9cyclictest2841909-21ntpq08:03:092
278577599230,8cyclictest3042012-21if_enp4s0.311:27:572
278577599230,6cyclictest2966533-21grep10:08:132
278577599230,14cyclictest3067505-21kthreadcore11:52:582
278577599230,13cyclictest2791069-21selinux_avcstat07:15:022
278577599230,11cyclictest2912014-21munin-run09:15:002
2785771992318,3cyclictest2790820-21kworker/u8:3+events_unbound09:42:571
2785769992318,4cyclictest2852329-21kworker/u8:2+flush-8:008:53:050
2785769992318,3cyclictest2828224-21cpuspeed_turbos07:52:540
2785769992318,3cyclictest0-21swapper/011:48:010
2785769992316,5cyclictest0-21swapper/008:33:010
278577599227,2cyclictest161rcu_preempt10:18:082
278577599223,9cyclictest0-21swapper/212:28:022
278577599223,5cyclictest3080124-21kthreadcore12:03:022
278576999222,19cyclictest0-21swapper/011:23:090
2785769992218,3cyclictest3100398-21ntp_kernel_err12:23:040
2785769992218,2cyclictest0-21swapper/010:03:040
2785769992217,4cyclictest2941768-21unixbench_multi09:43:100
278577599219,2cyclictest161rcu_preempt08:12:592
278577599212,8cyclictest0-21swapper/209:48:012
278577599212,5cyclictest0-21swapper/211:13:112
278577599212,5cyclictest0-21swapper/209:58:092
278577599212,5cyclictest0-21swapper/209:22:582
278577599212,4cyclictest0-21swapper/207:28:032
278577599212,14cyclictest2957303-21apt-get10:02:532
278577599210,8cyclictest3007708-21sed10:52:572
278577599210,6cyclictest39-21ksoftirqd/207:47:592
278577599210,6cyclictest3076139-21munin-plugin-st12:00:012
2785769992118,2cyclictest2928141-21cut09:32:570
2785769992117,2cyclictest0-21swapper/010:58:020
2785769992117,2cyclictest0-21swapper/007:42:540
2785769992116,3cyclictest3030409-21needreboot11:13:030
2785769992116,3cyclictest0-21swapper/009:58:030
2785769992113,6cyclictest2881574-21ps08:43:090
2785769992110,8cyclictest3016855-21apt-get11:02:520
278577599207,2cyclictest161rcu_preempt09:40:392
278577599202,5cyclictest0-21swapper/211:42:512
278577599202,5cyclictest0-21swapper/211:33:002
278577599202,5cyclictest0-21swapper/211:18:042
278577599202,5cyclictest0-21swapper/209:52:572
278577599202,5cyclictest0-21swapper/209:18:062
278577599202,5cyclictest0-21swapper/208:08:042
278577599202,4cyclictest0-21swapper/209:33:052
2785775992015,3cyclictest371rcuc/210:42:042
278577599200,5cyclictest2872718-21find08:37:512
2785769992017,1cyclictest0-21swapper/010:15:010
2785769992016,2cyclictest0-21swapper/012:15:000
2785769992016,2cyclictest0-21swapper/011:43:010
2785769992016,2cyclictest0-21swapper/010:18:080
2785769992015,3cyclictest0-21swapper/010:48:000
2785769992013,5cyclictest3035151-21cut11:18:020
2785769992012,6cyclictest3110561-21grep12:33:100
27809322202,8sleep30-21swapper/307:05:033
278577599192,4cyclictest0-21swapper/212:37:542
2785775991916,2cyclictest371rcuc/208:25:302
28731702170,2sleep3471rcuc/308:37:583
29573062152,8sleep30-21swapper/310:02:533
28555912150,3sleep3575-21kworker/3:2-events08:18:003
30909602140,8sleep30-21swapper/312:15:013
31159362132,6sleep30-21swapper/312:40:003
31061392132,6sleep30-21swapper/312:30:013
30999752134,5sleep30-21swapper/312:23:033
30761152132,7sleep30-21swapper/312:00:013
30156312132,7sleep30-21swapper/310:58:053
30015912132,6sleep30-21swapper/310:45:023
29909742133,6sleep30-21swapper/310:33:063
29772912132,7sleep30-21swapper/310:22:513
29122162132,6sleep30-21swapper/309:15:023
28574592134,5sleep30-21swapper/308:20:013
28353372132,7sleep30-21swapper/307:58:033
28116832132,7sleep30-21swapper/307:33:033
28116832132,7sleep30-21swapper/307:33:033
27908632132,6sleep30-21swapper/307:15:023
31025332122,6sleep30-21swapper/312:28:013
30956462122,6sleep30-21swapper/312:18:103
30812112122,5sleep30-21swapper/312:05:023
30658312122,5sleep30-21swapper/311:50:013
30569192122,6sleep30-21swapper/311:43:003
30509592122,6sleep30-21swapper/311:35:013
30403652122,6sleep30-21swapper/311:23:053
30262782122,5sleep30-21swapper/311:10:023
30173782122,6sleep30-21swapper/311:02:593
29923942122,6sleep30-21swapper/310:37:553
29822272122,6sleep30-21swapper/310:27:523
29670962122,6sleep30-21swapper/310:11:553
29567992122,6sleep30-21swapper/310:00:003
29469092122,5sleep30-21swapper/309:50:013
29468472122,6sleep30-21swapper/309:49:133
29364382122,6sleep30-21swapper/309:38:093
29226802122,6sleep30-21swapper/309:27:543
29078672122,6sleep30-21swapper/309:12:573
28861192122,6sleep30-21swapper/308:48:023
28720492122,6sleep30-21swapper/308:33:133
28629522122,6sleep30-21swapper/308:27:563
28420432122,6sleep30-21swapper/308:03:123
28265982122,6sleep30-21swapper/307:48:043
28025912122,5sleep30-21swapper/307:25:013
28018052122,6sleep30-21swapper/307:23:043
30770002112,5sleep30-21swapper/312:02:573
30611042112,5sleep30-21swapper/311:45:163
30512872112,5sleep30-21swapper/311:36:133
30413702112,6sleep30-21swapper/311:25:553
30358932112,6sleep30-21swapper/311:18:123
30217132113,5sleep30-21swapper/311:07:123
30068852112,5sleep30-21swapper/310:52:083
29970812112,5sleep30-21swapper/310:42:533
29755782112,5sleep30-21swapper/310:18:013
29619372112,5sleep30-21swapper/310:05:013
29372132112,5sleep30-21swapper/309:40:023
29278662111,6sleep30-21swapper/309:32:563
29175842112,5sleep30-21swapper/309:21:123
29024712113,5sleep30-21swapper/309:06:493
28925002112,5sleep30-21swapper/308:55:443
28775932112,6sleep30-21swapper/308:42:003
28479992112,6sleep30-21swapper/308:12:593
28468012112,5sleep30-21swapper/308:08:103
28277662112,6sleep30-21swapper/307:50:123
28177242112,5sleep30-21swapper/307:40:583
27859062112,6sleep30-21swapper/307:10:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional