You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 05:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 15, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3246212994832,4cyclictest3333884-21kworker/u8:3+events_unbound23:37:153
324619999483,20cyclictest33195212chrt22:38:190
3246199994822,22cyclictest3275544-21grep20:30:240
3246199994742,3cyclictest13550irq/42-30be0000.ethernet23:40:110
3246199994715,4cyclictest0-21swapper/020:00:010
3246199994617,3cyclictest13550irq/42-30be0000.ethernet23:05:180
3246207994533,8cyclictest311ktimers/220:15:142
3246204994537,4cyclictest3247418-21unixbench_singl19:10:261
3246199994515,3cyclictest0-21swapper/020:15:260
3246212994437,4cyclictest32659712sleep320:05:133
3246212994432,9cyclictest391ktimers/320:20:123
3246207994434,7cyclictest311ktimers/221:30:152
3246199994413,4cyclictest0-21swapper/021:35:150
3246207994319,7cyclictest33012932wc21:45:242
3246207994213,10cyclictest3309543-21if_eth022:10:152
3246204994232,7cyclictest3331351-21grep23:10:251
324620799418,12cyclictest3351756-21grep00:10:262
3246207994134,4cyclictest3298562-21latency_hist21:40:002
3246207994111,12cyclictest3317403-21timerandwakeup22:30:262
3246212994032,5cyclictest3269532-21fschecks_count20:15:163
3246207994033,4cyclictest3264022-21munin-plugin-st20:00:002
3246204994028,8cyclictest0-21swapper/121:10:261
3246199994034,4cyclictest3347162-21latency_hist23:59:590
3246212993931,4cyclictest0-21swapper/300:25:003
3246212993931,4cyclictest0-21swapper/300:24:593
3246199993917,3cyclictest3261979-21kworker/u8:0-ext4-rsv-conversion20:55:020
3246199993913,5cyclictest3355492-21unixbench_singl00:20:260
3246199993913,5cyclictest3355492-21unixbench_singl00:20:260
3246207993810,9cyclictest3354638-21grep00:20:172
3246207993810,9cyclictest3354638-21grep00:20:162
3246199993816,3cyclictest0-21swapper/023:20:190
3246199993815,3cyclictest0-21swapper/022:40:210
3246212993711,7cyclictest131rcu_preempt23:05:133
3246207993729,4cyclictest3251668-21unixbench_singl19:20:262
3246199993725,8cyclictest3277890-21sendmail20:40:010
3246199993715,6cyclictest121ktimers/000:05:130
3246207993627,5cyclictest0-21swapper/219:46:322
3246207993624,8cyclictest3338209-21grep23:30:252
3246207993611,8cyclictest3275059-21ntp_states20:30:202
3246199993627,5cyclictest0-21swapper/020:05:010
3246212993529,4cyclictest3261979-21kworker/u8:0+events_unbound21:06:503
3246212993529,4cyclictest3261979-21kworker/u8:0+events_unbound21:06:503
3246212993526,5cyclictest0-21swapper/322:20:003
3246212993526,5cyclictest0-21swapper/322:20:003
3246212993524,8cyclictest3275949-21sh20:35:013
3246212993519,6cyclictest3261979-21kworker/u8:0+events_unbound20:39:253
324621299351,14cyclictest0-21swapper/300:15:113
3246204993527,5cyclictest3333112-21unixbench_singl23:15:261
3246212993427,3cyclictest0-21swapper/320:45:173
3246212993426,4cyclictest0-21swapper/321:35:163
3246212993422,5cyclictest3270627-21kworker/u8:3+events_unbound20:51:443
3246212993420,6cyclictest3301868-21kworker/u8:0+events_unbound21:56:013
3246207993425,6cyclictest3248066-21latency_hist19:15:022
3246207993423,7cyclictest3253322-21grep19:25:252
3246207993421,9cyclictest3256891-21sshd19:36:292
3246207993416,14cyclictest629-21snmpd23:45:142
3246204993427,4cyclictest3340344-21cron23:40:011
3246204993425,4cyclictest0-21swapper/120:30:151
3246204993423,7cyclictest3358891-21grep00:30:241
3246204993423,7cyclictest0-21swapper/121:00:271
3246212993326,4cyclictest0-21swapper/300:25:263
3246212993325,6cyclictest3324660-21kworker/u8:2+events_unbound23:00:073
3246212993324,6cyclictest3336513-21unixbench_singl23:25:243
3246212993316,5cyclictest3301868-21kworker/u8:0+events_unbound22:08:093
324620799339,9cyclictest3354272-21latency_hist00:20:012
3246207993323,7cyclictest3282873-21sshd20:51:112
3246207993321,9cyclictest3285761-21/usr/sbin/munin21:00:232
3246207993319,11cyclictest3290389-21/usr/sbin/munin21:15:182
3246204993326,4cyclictest3324660-21kworker/u8:2+events_unbound23:42:151
3246204993326,3cyclictest0-21swapper/121:45:171
3246204993323,6cyclictest3312206-21grep22:15:271
3246204993323,6cyclictest3312206-21grep22:15:261
3246204993323,6cyclictest0-21swapper/123:00:011
3246199993328,3cyclictest0-21swapper/020:10:110
3246199993315,3cyclictest0-21swapper/021:52:370
3246212993223,4cyclictest0-21swapper/323:20:013
3246212993222,7cyclictest3273835-21grep20:25:273
3246207993225,3cyclictest0-21swapper/223:50:142
3246207993222,7cyclictest3299880-21/usr/sbin/munin21:40:252
3246207993222,6cyclictest3328650-21apt-get23:05:122
3246207993220,9cyclictest3348444-21/usr/sbin/munin00:00:252
3246207993219,10cyclictest3341219-21/usr/sbin/munin23:40:232
3246207993218,11cyclictest3304212-21/usr/sbin/munin21:55:142
3246207993218,11cyclictest3276403-21/usr/sbin/munin20:35:282
3246207993216,12cyclictest3334552-21switchtime23:20:252
3246204993224,4cyclictest0-21swapper/119:40:001
3246199993224,4cyclictest0-21swapper/000:19:590
3246199993222,5cyclictest0-21swapper/021:00:010
324621299319,11cyclictest0-21swapper/321:17:163
3246212993125,4cyclictest3244202-21kworker/u8:1+events_unbound19:40:413
3246212993122,5cyclictest0-21swapper/323:50:013
3246212993117,6cyclictest3244202-21kworker/u8:1+events_unbound20:03:103
3246207993121,7cyclictest3288558-21sshd21:10:112
3246207993121,7cyclictest3258821-21cron19:44:012
3246207993119,9cyclictest3346033-21/usr/sbin/munin23:55:192
3246207993113,13cyclictest3254180-21grep19:30:152
3246204993123,4cyclictest0-21swapper/122:05:001
3246199993122,6cyclictest3333094-21unixbench_singl23:15:270
3246199993122,6cyclictest3252528-21tune2fs19:25:170
3246199993120,7cyclictest3295148-21cron21:30:010
3246212993023,5cyclictest3312143-21kworker/u8:3+events_unbound22:39:403
3246212993020,5cyclictest0-21swapper/322:15:003
3246212993010,12cyclictest40-21ksoftirqd/322:00:263
3246212993010,11cyclictest40-21ksoftirqd/319:35:263
3246207993020,7cyclictest3360089-21/usr/sbin/munin00:35:202
3246207993020,7cyclictest3315348-21/usr/sbin/munin22:25:212
3246207993020,7cyclictest3292331-21/usr/sbin/munin21:20:172
3246207993020,7cyclictest3284558-21cron20:56:002
3246207993020,7cyclictest3266238-21/usr/sbin/munin20:05:172
3246207993020,7cyclictest3265110-21/usr/sbin/munin20:00:242
3246207993020,7cyclictest3249988-21cron19:18:012
3246207993019,9cyclictest3303820-21sshd21:54:112
3246207993019,8cyclictest3313701-21/usr/sbin/munin22:20:232
3246207993019,8cyclictest3278857-21/usr/sbin/munin20:40:222
3246207993019,7cyclictest3271205-21/usr/sbin/munin20:20:152
3246207993018,9cyclictest3339918-21grep23:35:232
3246207993018,9cyclictest3280135-21/usr/sbin/munin20:45:162
3246207993017,10cyclictest3327963-21awk23:00:252
3246207993017,10cyclictest3268790-21cron20:11:012
3246207993016,11cyclictest3287375-21/usr/sbin/munin21:05:222
3246207993016,11cyclictest3287375-21/usr/sbin/munin21:05:222
3246207993015,10cyclictest3308005-21grep22:05:192
3246207993014,13cyclictest3318536-21uname22:35:172
3246207993013,14cyclictest3330935-21open_files23:10:212
3246204993024,4cyclictest3287942-21kworker/u8:2+events_unbound21:26:511
3246204993022,4cyclictest0-21swapper/120:45:271
3246199993022,4cyclictest0-21swapper/023:40:010
3246199993020,8cyclictest3309017-21idleruntime-cro22:10:000
3246199993020,7cyclictest3326761-21latency_hist23:00:000
3246199993020,7cyclictest0-21swapper/019:20:000
3246199993020,6cyclictest0-21swapper/000:30:250
3246199993019,7cyclictest0-21swapper/021:20:250
3246199993016,3cyclictest0-21swapper/000:36:350
324621299298,14cyclictest40-21ksoftirqd/300:10:243
3246212992923,4cyclictest3294888-21kworker/u8:1+events_unbound21:32:423
3246212992922,5cyclictest3251715-21kworker/u8:2+events_unbound19:20:433
324621299291,9cyclictest40-21ksoftirqd/322:50:123
3246212992915,6cyclictest3324660-21kworker/u8:2+events_unbound00:31:453
3246207992920,7cyclictest3311725-21/usr/sbin/munin22:15:212
3246207992920,7cyclictest3311725-21/usr/sbin/munin22:15:212
3246207992920,4cyclictest0-21swapper/220:30:002
3246207992919,7cyclictest3323767-21/usr/sbin/munin22:50:202
3246207992919,7cyclictest3322071-21/usr/sbin/munin22:45:232
3246207992919,7cyclictest3294666-21/usr/sbin/munin21:25:252
3246207992919,7cyclictest3261569-21/usr/sbin/munin19:50:222
3246207992917,10cyclictest3336596-21cron23:26:012
3246207992916,11cyclictest3332644-21/usr/sbin/munin23:15:242
3246207992913,13cyclictest3358186-21/usr/sbin/munin00:30:182
3246207992911,14cyclictest3356713-21runrttasks00:25:212
3246207992910,14cyclictest3320451-21grep22:40:202
324620499292,23cyclictest3310969-21grep22:15:011
3246204992922,3cyclictest0-21swapper/120:00:011
3246204992921,4cyclictest0-21swapper/120:20:261
3246204992921,4cyclictest0-21swapper/119:15:271
3246204992921,4cyclictest0-21swapper/100:05:261
3246204992920,6cyclictest3319194-21grep22:35:251
3246204992919,7cyclictest1-21systemd00:37:241
3246199992922,4cyclictest0-21swapper/021:00:130
3246199992922,4cyclictest0-21swapper/019:10:270
3246199992920,5cyclictest3322687-21unixbench_singl22:45:280
3246199992919,6cyclictest3306903-21grep22:00:260
324621299287,10cyclictest0-21swapper/323:44:223
3246212992822,4cyclictest3253594-21kworker/u8:3+events_unbound19:34:453
3246212992821,5cyclictest3360960-21kworker/u8:0+events_unbound00:39:383
3246207992818,7cyclictest3349109-21sshd00:05:122
3246207992811,13cyclictest3306070-21fschecks_time22:00:162
3246204992820,5cyclictest0-21swapper/119:50:241
3246204992820,5cyclictest0-21swapper/119:30:011
3246204992819,6cyclictest3336470-21grep23:25:251
3246204992819,6cyclictest0-21swapper/120:50:261
3246204992817,7cyclictest3327978-21grep23:00:251
3246199992819,5cyclictest0-21swapper/020:20:260
324621299277,6cyclictest131rcu_preempt23:10:163
3246212992721,4cyclictest3244202-21kworker/u8:1+events_unbound19:25:473
3246212992720,5cyclictest3324660-21kworker/u8:2+events_unbound23:52:543
3246212992720,5cyclictest3324660-21kworker/u8:2+events_unbound23:22:113
3246212992719,6cyclictest3321623-21kworker/u8:1+events_unbound23:31:473
3246212992719,5cyclictest3300139-21kworker/u8:1+events_unbound21:45:333
3246212992717,6cyclictest0-21swapper/321:55:013
324621299271,13cyclictest0-21swapper/321:04:413
3246207992715,8cyclictest3325141-21/usr/sbin/munin22:55:162
3246204992720,5cyclictest3261979-21kworker/u8:0+events_unbound21:06:571
3246204992720,5cyclictest3261979-21kworker/u8:0+events_unbound21:06:561
3246204992720,3cyclictest0-21swapper/122:50:181
3246204992719,4cyclictest0-21swapper/123:45:161
3246204992718,4cyclictest0-21swapper/122:25:171
3246204992717,6cyclictest0-21swapper/123:05:261
3246199992720,4cyclictest13550irq/42-30be0000.ethernet20:05:250
3246199992719,5cyclictest0-21swapper/000:00:260
3246199992717,6cyclictest0-21swapper/000:25:260
3246199992716,8cyclictest3288322-21auditctl21:10:010
3246199992716,8cyclictest3288322-21auditctl21:10:000
324619999270,25cyclictest0-21swapper/019:40:120
324621299267,11cyclictest40-21ksoftirqd/322:25:183
324621299266,10cyclictest0-21swapper/322:32:013
324621299262,3cyclictest131rcu_preempt23:55:123
3246212992621,3cyclictest3246196-21cyclictest19:15:243
3246212992620,4cyclictest3281126-21kworker/u8:1+events_unbound20:59:143
3246212992620,4cyclictest3261979-21kworker/u8:0+events_unbound20:13:483
3246212992619,5cyclictest3312143-21kworker/u8:3+events_unbound22:40:243
3246212992619,5cyclictest3261979-21kworker/u8:0+events_unbound20:40:163
3246212992618,6cyclictest3319308-21kworker/u8:0+events_unbound22:45:263
3246212992618,4cyclictest0-21swapper/321:10:163
3246212992617,6cyclictest391ktimers/319:10:123
3246212992610,10cyclictest0-21swapper/322:24:273
3246204992620,3cyclictest0-21swapper/121:55:151
3246204992618,5cyclictest0-21swapper/122:20:151
3246204992618,4cyclictest3267437-21kthreadd20:10:001
3246199992617,5cyclictest0-21swapper/020:45:260
3246199992617,5cyclictest0-21swapper/019:40:010
3246199992616,6cyclictest0-21swapper/021:16:490
324621299258,9cyclictest131rcu_preempt00:05:273
324621299258,6cyclictest40-21ksoftirqd/322:55:253
324621299258,5cyclictest131rcu_preempt19:55:003
324621299257,3cyclictest131rcu_preempt21:25:163
324621299252,11cyclictest0-21swapper/300:00:033
3246212992518,5cyclictest3291579-21kworker/u8:3+events_unbound21:20:193
3246212992510,6cyclictest40-21ksoftirqd/319:45:253
3246204992520,3cyclictest0-21swapper/120:35:051
3246204992518,3cyclictest0-21swapper/123:50:231
3246204992517,5cyclictest0-21swapper/120:10:251
3246204992516,6cyclictest3293451-21sh21:25:001
3246204992514,8cyclictest3270164-21sed20:15:251
3246204992514,6cyclictest0-21swapper/119:45:171
3246199992515,7cyclictest3335567-21wc23:25:130
3246199992514,9cyclictest151rcuc/021:50:010
3246199992514,8cyclictest3298958-21cut21:40:140
324621299242,4cyclictest131rcu_preempt21:40:223
324620499240,12cyclictest0-21swapper/122:40:251
324619999249,10cyclictest121ktimers/019:45:120
3246199992417,4cyclictest3344986-21tail23:50:220
3246199992417,3cyclictest0-21swapper/000:10:570
3246199992413,7cyclictest3296424-21grep21:30:270
324619999241,19cyclictest0-21swapper/022:34:170
324619999240,20cyclictest0-21swapper/023:03:440
324620499234,6cyclictest131rcu_preempt23:30:121
3246204992317,3cyclictest0-21swapper/122:45:251
3246204992317,3cyclictest0-21swapper/122:31:121
3246204992317,3cyclictest0-21swapper/120:25:261
3246204992317,3cyclictest0-21swapper/119:40:201
3246204992316,5cyclictest3324660-21kworker/u8:2+events_unbound23:55:321
3246204992316,5cyclictest3287942-21kworker/u8:2+events_unbound21:16:411
3246204992313,6cyclictest0-21swapper/100:15:201
324619999232,12cyclictest3310724-21grep22:15:000
3246199992317,3cyclictest0-21swapper/019:20:160
3246199992316,4cyclictest3331806-21cron23:15:010
3246199992316,3cyclictest0-21swapper/022:53:070
3246199992316,3cyclictest0-21swapper/019:30:260
3246199992313,7cyclictest3313903-21grep22:20:250
3246199992313,6cyclictest0-21swapper/020:30:010
324619999231,18cyclictest0-21swapper/020:44:560
3246204992216,3cyclictest0-21swapper/123:20:161
3246204992215,4cyclictest0-21swapper/122:05:251
3246204992215,3cyclictest0-21swapper/121:39:591
3246204992215,3cyclictest0-21swapper/100:27:221
3246199992216,2cyclictest0-21swapper/023:31:370
3246199992216,2cyclictest0-21swapper/021:13:400
3246199992213,6cyclictest121ktimers/022:25:150
324620499212,6cyclictest3348890-21munin-plugin-st00:05:001
3246204992115,3cyclictest0-21swapper/100:20:241
3246204992115,3cyclictest0-21swapper/100:20:241
3246204992114,5cyclictest3270627-21kworker/u8:3+events_unbound20:56:181
3246204992112,6cyclictest231ktimers/119:20:061
324620499211,12cyclictest0-21swapper/100:10:191
3246199992115,3cyclictest3311296-21fschecks_count22:15:170
3246199992115,3cyclictest3311296-21fschecks_count22:15:170
3246204992013,5cyclictest231ktimers/120:40:051
3246204992012,6cyclictest0-21swapper/121:50:021
3246204992010,6cyclictest0-21swapper/121:40:201
3246204991914,3cyclictest3254191-21fschecks_count19:30:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional