You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 22:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Sep 14, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
278708021890,1sleep375-21kworker/3:1-events08:19:083
278708021890,1sleep375-21kworker/3:1-events08:19:083
2719831995145,4cyclictest2940394-21kworker/u8:3+events_unbound12:34:041
2719831995045,4cyclictest2876113-21kworker/u8:2+flush-8:010:34:181
2719831995045,4cyclictest2876113-21kworker/u8:2+flush-8:010:34:181
2719831994943,4cyclictest2766288-21kworker/u8:1+events_unbound09:05:001
2719831994841,5cyclictest2920377-21kworker/u8:1+flush-8:011:14:191
2719831994743,3cyclictest2846295-21kworker/u8:0+flush-8:009:49:201
2719831994741,4cyclictest2940394-21kworker/u8:3+flush-8:011:44:211
2719827994736,8cyclictest2974853-21latency_hist11:25:000
2719827994725,20cyclictest3030356-21/usr/sbin/munin12:24:160
2719831994540,4cyclictest2920377-21kworker/u8:1+events_unbound11:30:001
2719831994540,4cyclictest2766288-21kworker/u8:1+flush-8:008:59:131
2719831994540,3cyclictest2940394-21kworker/u8:3+events_unbound11:09:191
2719831994538,5cyclictest2766288-21kworker/u8:1+flush-8:009:09:151
2719831994439,4cyclictest2876113-21kworker/u8:2+flush-8:010:25:001
2719831994438,5cyclictest2791212-21kworker/u8:3+flush-8:008:35:011
2719827994420,7cyclictest2815988-21latency_hist08:45:010
2719833994338,4cyclictest2781320-21kworker/u8:2+flush-8:008:34:102
2719833994337,4cyclictest2974871-21gpgv11:25:002
2719831994338,4cyclictest2840959-21kworker/u8:2+events_unbound09:14:051
2719831994236,4cyclictest2905488-21kworker/u8:3+events_unbound10:39:051
2719831994235,5cyclictest2207307-21kworker/u8:0+flush-8:008:24:161
2719827994228,12cyclictest2916702-21irqrtprio10:29:070
27722962410,4sleep00-21swapper/008:04:080
2719831994136,4cyclictest2950107-21kworker/u8:2+events_unbound11:04:051
2719831994133,6cyclictest2672359-21kworker/u8:1+flush-8:007:24:201
2719827994128,9cyclictest2724653-21latency_hist07:15:000
2719827994122,4cyclictest2810808-21apt-get08:40:010
271509924128,9sleep10-21swapper/107:06:401
271509924128,9sleep10-21swapper/107:06:401
2719833994034,4cyclictest2860860-21gpgv09:30:002
2719831994034,5cyclictest2876113-21kworker/u8:2+flush-8:010:49:141
2719831994033,5cyclictest2709846-21kworker/u8:2+flush-8:007:39:181
2719827994031,6cyclictest2940013-21grep10:49:200
2719827994021,16cyclictest3004640-21unixbench_multi11:54:190
2719827994019,4cyclictest2944976-21unixbench_multi10:54:200
2719831993933,5cyclictest2207307-21kworker/u8:0+flush-8:007:19:041
2719827993920,3cyclictest2795910-21cron08:24:590
2719827993913,6cyclictest576-21runrttasks12:34:020
2719831993833,4cyclictest2791212-21kworker/u8:3+flush-8:009:24:051
2719831993833,4cyclictest2791212-21kworker/u8:3+flush-8:009:24:051
2719831993833,4cyclictest2207307-21kworker/u8:0+events_unbound08:00:001
2719831993833,3cyclictest2207307-21kworker/u8:0+events_unbound08:09:141
2719831993831,5cyclictest2876113-21kworker/u8:2+flush-8:010:29:181
2719831993831,5cyclictest2855836-21kworker/u8:2+flush-8:009:34:161
2719827993828,8cyclictest2975886-21diskstats11:29:060
2719827993818,4cyclictest2885713-21cron09:55:000
2719827993817,9cyclictest278-21systemd-journal09:00:000
2719833993728,7cyclictest3020687-21tr12:14:032
2719831993732,4cyclictest2791212-21kworker/u8:3+flush-8:008:44:191
2719831993731,4cyclictest2999866-21kworker/u8:2+events_unbound12:39:211
2719831993729,6cyclictest2207307-21kworker/u8:0+flush-8:008:14:171
2719831993723,5cyclictest2940394-21kworker/u8:3+events_unbound11:19:031
2719827993720,3cyclictest3024863-21idleruntime-cro12:15:000
2719827993718,2cyclictest2871727-21fschecks_count09:44:060
2719831993632,3cyclictest2846295-21kworker/u8:0+flush-8:010:09:031
2719831993630,4cyclictest2999866-21kworker/u8:2+flush-8:012:04:151
2719831993630,4cyclictest2935228-21kworker/u8:0+events_unbound10:59:031
2719831993628,6cyclictest2905488-21kworker/u8:3+flush-8:010:44:181
2719827993618,3cyclictest0-21swapper/008:30:010
2719827993616,6cyclictest2866477-21/usr/sbin/munin09:39:160
2719831993530,4cyclictest2766288-21kworker/u8:1+events_unbound09:29:051
2719831993530,3cyclictest2940394-21kworker/u8:3+events_unbound11:24:061
2719831993530,3cyclictest278-21systemd-journal12:15:001
2719831993529,4cyclictest2940394-21kworker/u8:3+flush-8:012:24:061
2719831993529,4cyclictest2890695-21kworker/u8:1+flush-8:010:14:101
2719831993526,7cyclictest3000377-21/usr/sbin/munin11:54:121
2719831993525,7cyclictest2761338-21latency_hist07:50:011
2719827993525,7cyclictest278-21systemd-journal11:10:000
27152452351,6sleep30-21swapper/307:08:353
27152452351,6sleep30-21swapper/307:08:353
2719831993429,4cyclictest2940394-21kworker/u8:3+events_unbound10:54:101
2719831993429,4cyclictest2672359-21kworker/u8:1+flush-8:007:14:081
2719831993429,3cyclictest2999866-21kworker/u8:2+events_unbound12:29:201
2719831993429,3cyclictest2709846-21kworker/u8:2+flush-8:007:29:181
2719831993428,5cyclictest2876113-21kworker/u8:2+events_unbound10:04:211
2719831993428,5cyclictest2781320-21kworker/u8:2+events_unbound08:39:061
2719831993427,5cyclictest2791212-21kworker/u8:3+flush-8:009:19:201
2719831993327,5cyclictest2940394-21kworker/u8:3+flush-8:011:39:051
2719831993325,6cyclictest2870887-21latency_hist09:40:011
2719831993226,5cyclictest2746701-21kworker/u8:3+flush-8:008:04:141
2719827993227,3cyclictest2895537-21unixbench_singl10:04:230
2719827993220,9cyclictest278-21systemd-journal12:30:000
2719827993220,9cyclictest278-21systemd-journal10:15:000
2719833993123,6cyclictest278-21systemd-journal10:10:002
2719831993125,4cyclictest2940394-21kworker/u8:3+flush-8:011:59:101
2719831993125,4cyclictest2940394-21kworker/u8:3+events_unbound11:34:041
2719831993124,5cyclictest2871134-21kworker/u8:3+events_unbound09:44:221
2719831993120,9cyclictest278-21systemd-journal08:30:001
2719833993025,3cyclictest2840776-21unixbench_multi09:09:212
2719831993026,3cyclictest2781320-21kworker/u8:2+events_unbound08:19:231
2719831993026,3cyclictest2781320-21kworker/u8:2+events_unbound08:19:231
2719831993026,3cyclictest2764049-21kthreadcore07:54:101
2719827993025,3cyclictest2995688-21cpuspeed_turbos11:49:040
2719827993019,9cyclictest278-21systemd-journal07:30:000
27195982302,6sleep00-21swapper/007:09:320
27195982302,6sleep00-21swapper/007:09:320
2719833992919,8cyclictest2945113-21cron10:55:002
2719831992924,4cyclictest2791212-21kworker/u8:3+flush-8:008:49:151
2719831992924,3cyclictest2920377-21kworker/u8:1+events_unbound11:49:101
2719831992923,4cyclictest2905488-21kworker/u8:3+events_unbound10:19:151
2719831992923,4cyclictest2709846-21kworker/u8:2+flush-8:007:44:221
271982799291,25cyclictest2980052-21kworker/0:1+events12:09:010
2719833992823,4cyclictest2940394-21kworker/u8:3+flush-8:012:34:122
2719833992821,5cyclictest2815850-21grep08:44:212
2719831992824,2cyclictest3027584-21kthreadcore12:19:081
2719827992823,3cyclictest2954954-21unixbench_singl11:04:200
2719827992823,3cyclictest2790805-21unixbench_multi08:19:210
2719827992823,3cyclictest2790805-21unixbench_multi08:19:210
271982799282,25cyclictest2786049-21kworker/0:0+events08:49:090
2719827992820,5cyclictest2985006-21latency_hist11:35:000
2719833992722,4cyclictest2905488-21kworker/u8:3+events_unbound10:24:122
2719831992720,5cyclictest2766288-21kworker/u8:1+flush-8:008:54:141
2719827992720,5cyclictest2915419-21latency_hist10:25:010
2719827992718,6cyclictest2771209-21latency_hist08:00:010
271982799271,24cyclictest2786049-21kworker/0:0+events09:34:130
271982799270,25cyclictest2870925-21kworker/0:2+events10:34:130
271982799270,25cyclictest2870925-21kworker/0:2+events10:34:130
28190032260,4sleep3481ktimers/308:49:093
271983399260,13cyclictest3000029-21sed11:50:022
2719827992622,3cyclictest2856905-21sort09:29:080
271982799260,24cyclictest2980052-21kworker/0:1+events12:03:370
2719833992522,2cyclictest2861769-21cpuspeed_turbos09:34:042
2719833992520,4cyclictest2940169-21cat10:50:002
2719833992520,3cyclictest2855662-21unixbench_multi09:24:192
2719833992520,3cyclictest2855662-21unixbench_multi09:24:192
2719833992517,6cyclictest2780604-21grep08:09:182
2719831992520,4cyclictest2940394-21kworker/u8:3+events_unbound12:09:161
2719831992517,6cyclictest2876113-21kworker/u8:2+flush-8:009:59:041
2719827992521,3cyclictest390-21dbus-daemon09:50:010
2719827992520,3cyclictest2805149-21needreboot08:34:130
2719827992519,3cyclictest0-21swapper/011:00:010
29260412240,2sleep3481ktimers/310:39:023
2719833992420,2cyclictest3045548-21fschecks_count12:39:052
2719833992419,3cyclictest2800763-21unixbench_singl08:29:212
271983399240,8cyclictest28774381kthreadcore09:49:092
271982799242,15cyclictest576-21runrttasks07:24:030
2719827992420,3cyclictest1-21systemd08:55:000
2719827992419,4cyclictest2840934-21cron09:10:000
2719827992417,5cyclictest390-21dbus-daemon10:00:000
2719833992319,2cyclictest3035425-21aten2_r5power_p12:29:032
2719833992318,3cyclictest2846467-21aten2_r5power_c09:19:032
2719833992318,3cyclictest2740982-21grep07:29:182
2719833992316,2cyclictest161rcu_preempt11:34:012
271982799236,16cyclictest2870925-21kworker/0:2+events10:19:130
2719827992315,6cyclictest278-21systemd-journal08:15:000
271982799231,16cyclictest576-21runrttasks11:19:000
2719833992218,2cyclictest0-21swapper/212:00:002
2719833992216,4cyclictest2752106-21aten2_r5power_e07:44:062
2719833992215,5cyclictest2726655-21irqcore07:15:042
2719833992213,8cyclictest2736529-21cron07:25:002
2719833992213,7cyclictest2781966-21fschecks_time08:14:062
2719831992218,3cyclictest2207307-21kworker/u8:0+flush-8:007:34:071
2719831992218,2cyclictest0-21swapper/109:54:031
2719827992219,2cyclictest2746416-21cron07:35:000
2719827992218,3cyclictest845-21mta-sts-daemon07:44:190
2719827992218,2cyclictest2989934-21idleruntime-cro11:40:000
2719827992218,2cyclictest0-21swapper/012:19:100
2719827992217,3cyclictest2935106-21unixbench_singl10:44:230
2719827992217,3cyclictest2781094-21idleruntime-cro08:10:010
2719827992217,3cyclictest0-21swapper/012:39:030
271982799221,15cyclictest576-21runrttasks09:04:000
271982799220,6cyclictest2846955-21interrupts09:19:080
271983399217,2cyclictest27571861cpuspeed_turbos07:49:052
2719833992118,2cyclictest2949947-21unixbench_singl10:59:192
2719833992117,3cyclictest2826779-21aten2_r5power_v08:59:032
2719833992116,3cyclictest2795814-21unixbench_singl08:24:222
2719833992116,3cyclictest0-21swapper/208:40:012
2719833992115,4cyclictest2895475-21unixbench_multi10:04:222
2719833992112,7cyclictest3017610-21tr12:09:102
271982799214,16cyclictest2786049-21kworker/0:0+events09:14:010
2719827992118,2cyclictest2964959-21munin-plugin-st11:15:000
2719827992117,2cyclictest2747924-21kthreadcore07:39:090
2719827992117,2cyclictest0-21swapper/010:39:170
2719827992116,3cyclictest0-21swapper/012:00:020
2719827992112,7cyclictest2851663-21diskstats09:24:050
2719827992112,7cyclictest2851663-21diskstats09:24:040
271983399202,4cyclictest0-21swapper/210:19:002
2719833992017,2cyclictest0-21swapper/209:44:202
2719833992014,4cyclictest2207307-21kworker/u8:0+flush-8:007:30:062
2719833992013,6cyclictest2905390-21unixbench_singl10:14:222
271982799207,4cyclictest0-21swapper/010:06:330
2719827992016,3cyclictest2761186-21unixbench_multi07:49:210
2719827992016,2cyclictest0-21swapper/007:54:060
27152492204,12sleep20-21swapper/207:08:382
27152492204,12sleep20-21swapper/207:08:382
271983399196,3cyclictest28178601kthreadcore08:49:082
2719833991915,3cyclictest2940394-21kworker/u8:3+flush-8:011:39:202
2719833991915,2cyclictest2921000-21aten2_r5power_p10:34:032
2719833991915,2cyclictest2921000-21aten2_r5power_p10:34:032
2719833991915,2cyclictest2866794-21fschecks_count09:39:062
2719833991915,2cyclictest0-21swapper/211:30:002
2719833991915,2cyclictest0-21swapper/211:04:092
2719833991915,2cyclictest0-21swapper/210:44:082
2719833991910,7cyclictest3003256-21tr11:54:102
2719827991915,3cyclictest2994523-21mailstats11:44:220
2719827991910,7cyclictest2725071-21tr07:15:010
271983399181,7cyclictest3029799-21cron12:20:002
2719833991815,2cyclictest2916063-21aten2_r5power_p10:29:022
2719833991815,2cyclictest0-21swapper/210:39:182
2719833991813,3cyclictest3014859-21unixbench_singl12:04:222
2719833991810,6cyclictest3032850-21tr12:24:112
271983399178,7cyclictest2994005-21tr11:44:132
271983399178,7cyclictest2747853-21sed07:39:072
271983399174,11cyclictest2889226-21cut09:59:102
271983399172,14cyclictest0-21swapper/209:14:052
271983399172,11cyclictest2825479-21ntpq08:54:132
2719833991714,2cyclictest2772097-21fschecks_time08:04:062
2719833991714,2cyclictest2720620-21fschecks_time07:14:052
2719833991713,2cyclictest0-21swapper/207:59:222
2719833991712,3cyclictest2885360-21switchtime09:54:202
271983399171,12cyclictest2965510-21apt-get11:19:012
271983399171,12cyclictest2955623-21taskset11:09:032
27338572166,6sleep30-21swapper/307:24:123
271983399169,5cyclictest2787824-21cut08:19:102
271983399169,5cyclictest2787824-21cut08:19:102
2719833991612,2cyclictest0-21swapper/209:04:042
2719833991611,3cyclictest0-21swapper/211:14:112
30204392151,9sleep30-21swapper/312:14:013
271983399157,6cyclictest2762717-21sed07:54:082
27280552145,5sleep30-21swapper/307:19:103
30347692132,7sleep30-21swapper/312:25:003
29998352133,6sleep30-21swapper/311:50:013
29849862132,6sleep30-21swapper/311:35:013
29351952132,6sleep30-21swapper/310:45:013
29203722132,6sleep30-21swapper/310:30:013
29203722132,6sleep30-21swapper/310:30:013
28310872132,6sleep30-21swapper/309:00:013
28303542132,7sleep30-21swapper/308:59:143
27910092132,6sleep30-21swapper/308:20:013
27202412133,6sleep30-21swapper/307:14:013
30496462122,5sleep30-21swapper/312:40:013
30440682122,6sleep30-21swapper/312:34:163
30004062122,6sleep30-21swapper/311:54:023
29802722122,6sleep30-21swapper/311:30:273
29795272122,6sleep30-21swapper/311:29:193
29704642122,6sleep30-21swapper/311:24:053
29652082122,6sleep30-21swapper/311:15:273
29600112122,6sleep30-21swapper/311:10:013
29544512122,6sleep30-21swapper/311:04:153
29115092122,6sleep30-21swapper/310:24:073
29009002122,6sleep30-21swapper/310:11:273
28956512122,6sleep30-21swapper/310:05:013
28916592122,6sleep30-21swapper/310:04:093
28800332122,6sleep30-21swapper/309:49:123
28717202123,6sleep30-21swapper/309:44:073
28700952122,6sleep30-21swapper/309:39:133
28513882122,6sleep30-21swapper/309:24:013
28513882122,6sleep30-21swapper/309:24:013
28464402122,6sleep30-21swapper/309:19:033
28222262122,6sleep30-21swapper/308:54:073
28067652122,6sleep30-21swapper/308:39:073
28019632122,6sleep30-21swapper/308:34:093
28004962122,6sleep30-21swapper/308:29:203
27815762122,6sleep30-21swapper/308:13:273
27662942122,6sleep30-21swapper/307:55:013
27618642122,7sleep30-21swapper/307:54:013
27569172122,6sleep30-21swapper/307:48:513
27472462122,6sleep30-21swapper/307:39:043
27423432122,6sleep30-21swapper/307:34:073
27407492122,6sleep30-21swapper/307:29:133
30352412112,6sleep30-21swapper/312:28:053
30286032112,5sleep30-21swapper/312:19:103
30154682112,6sleep30-21swapper/312:08:313
30147952112,5sleep30-21swapper/312:04:223
30050612112,6sleep30-21swapper/311:55:273
29904812113,5sleep30-21swapper/311:43:593
29561082111,6sleep30-21swapper/311:09:103
29454032112,6sleep30-21swapper/310:55:453
29311972112,6sleep30-21swapper/310:44:093
29156842112,6sleep30-21swapper/310:25:313
29058142112,6sleep30-21swapper/310:16:083
28860472112,6sleep30-21swapper/309:56:223
28810982112,6sleep30-21swapper/309:50:453
28612532112,6sleep30-21swapper/309:30:353
28558432111,6sleep30-21swapper/309:25:013
28412292112,6sleep30-21swapper/309:10:533
28362032112,6sleep30-21swapper/309:05:033
28113042112,6sleep30-21swapper/308:40:283
27764992112,6sleep30-21swapper/308:06:333
27715192112,6sleep30-21swapper/308:00:593
27517382112,6sleep30-21swapper/307:40:253
29403952102,5sleep30-21swapper/310:50:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional