You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-12 - 05:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Thu Nov 12, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2924930995342,7cyclictest3009868-21grep23:10:231
2924936995140,9cyclictest391ktimers/300:10:153
2924930994737,6cyclictest2983833-21grep21:55:241
292493099471,41cyclictest2978069-21/usr/sbin/munin21:40:181
292493099470,37cyclictest0-21swapper/123:05:121
2924925994735,8cyclictest2964914-21grep21:00:270
2924932994639,4cyclictest3005207-21munin-plugin-st23:00:012
292493099461,36cyclictest0-21swapper/120:30:111
2924932994532,9cyclictest311ktimers/222:30:112
292493099451,39cyclictest2967935-21/usr/sbin/munin21:10:181
292493099443,36cyclictest2969188-21apt-get21:15:151
2924930994431,10cyclictest231ktimers/121:20:121
292493099441,40cyclictest2945129-21/usr/sbin/munin20:05:171
292493099441,37cyclictest2951711-21apt-get20:25:151
2924932994331,7cyclictest2977488-21cut21:40:012
2924932994330,7cyclictest2956170-21grep20:35:252
292493099433,37cyclictest231ktimers/122:50:131
292493099431,39cyclictest3019937-21/usr/sbin/munin23:40:221
292493099431,39cyclictest2938831-21/usr/sbin/munin19:45:241
292493099431,36cyclictest2946693-21df_inode20:10:121
2924932994235,4cyclictest2949766-21sh20:20:022
2924932994232,7cyclictest311ktimers/200:05:122
2924932994230,8cyclictest3018868-21sendmail23:39:592
2924930994222,16cyclictest0-21swapper/119:50:241
292493099421,38cyclictest2994466-21cron22:29:001
292493099421,38cyclictest2959335-21/usr/sbin/munin20:45:211
292493099421,38cyclictest2948850-21/usr/sbin/munin20:15:211
292493099421,36cyclictest2976573-21ntp_states21:35:201
292493099421,32cyclictest0-21swapper/120:35:111
292493099420,36cyclictest2979430-21apt-get21:45:111
2924932994135,4cyclictest3001438-21kworker/u8:0+events_unbound23:01:592
292493099412,36cyclictest2933850-21cron19:31:011
2924930994115,23cyclictest2935244-21sort19:35:261
292493099411,37cyclictest3033085-21irqstats00:20:181
292493099411,37cyclictest2973823-21cron21:27:001
292493099411,37cyclictest2961569-21cron20:51:011
292493099411,37cyclictest2958065-21/usr/sbin/munin20:40:251
292493099411,37cyclictest2943307-21/usr/sbin/munin20:00:171
292493099411,37cyclictest2943307-21/usr/sbin/munin20:00:161
292493099411,37cyclictest0-21swapper/121:50:121
292493099411,34cyclictest3015677-21apt-get23:30:131
292493099410,34cyclictest0-21swapper/122:55:111
2924925994134,4cyclictest2978761-21unixbench_singl21:40:240
2924932994031,4cyclictest0-21swapper/220:50:012
292493099402,35cyclictest3014814-21/usr/sbin/munin23:25:251
292493099401,36cyclictest3039134-21cron00:38:001
292493099401,36cyclictest3022174-21cron23:49:001
292493099401,36cyclictest2991904-21/usr/sbin/munin22:20:191
292493099401,36cyclictest2950680-21/usr/sbin/munin20:20:231
292493099401,36cyclictest2942439-21/usr/sbin/munin19:55:241
292493099401,36cyclictest2942439-21/usr/sbin/munin19:55:231
292493099401,36cyclictest2929170-21/usr/sbin/munin19:20:151
292493099401,36cyclictest2927511-21/usr/sbin/munin19:15:151
292493099401,35cyclictest3031175-21grep00:15:181
292493099401,34cyclictest3005556-21df23:00:111
292493099401,34cyclictest2989657-21apt-get22:15:111
292493099401,34cyclictest2931372-21/usr/sbin/munin19:25:201
2924932993929,6cyclictest0-21swapper/221:10:012
2924932993927,8cyclictest3001614-21latency_hist22:50:002
292493099395,27cyclictest0-21swapper/123:15:121
292493099391,36cyclictest53-21kcompactd022:47:151
292493099391,35cyclictest3035290-21/usr/sbin/munin00:25:251
292493099391,35cyclictest3017488-21/usr/sbin/munin23:35:131
292493099391,35cyclictest2999714-21cron22:43:011
292493099391,35cyclictest2994996-21apt-get22:30:121
292493099391,35cyclictest2989303-21sshd22:13:371
292493099391,35cyclictest2984993-21/usr/sbin/munin22:00:201
292493099391,35cyclictest2966461-21/usr/sbin/munin21:05:221
292493099391,34cyclictest2925528-21/usr/sbin/munin19:10:191
292493099391,33cyclictest3022494-21apt-get23:50:111
2924936993828,7cyclictest438-21cron21:00:013
2924936993827,8cyclictest438-21cron22:00:013
292493099381,34cyclictest3037645-21cat00:35:011
292493099381,34cyclictest3028466-21/usr/sbin/munin00:05:241
292493099381,34cyclictest2962749-21/usr/sbin/munin20:55:221
292493099381,32cyclictest2975934-21cat21:35:011
292493099381,32cyclictest2964346-21/usr/sbin/munin21:00:201
292493099381,32cyclictest2936260-21df_inode19:40:131
292493099380,34cyclictest53-21kcompactd023:20:011
292493099380,34cyclictest53-21kcompactd023:20:011
2924936993730,4cyclictest2991126-21cron22:20:003
2924936993724,10cyclictest3032492-21sh00:20:013
292493099371,33cyclictest3029324-21apt-get00:10:131
292493099371,33cyclictest2996814-21/usr/sbin/munin22:35:131
292493099371,31cyclictest3024440-21/usr/sbin/munin23:55:161
292493099371,31cyclictest2986257-21apt-get22:05:131
2924925993728,6cyclictest2965966-21fschecks_time21:05:150
2924936993626,6cyclictest2964916-21unixbench_singl21:00:273
2924936993626,6cyclictest0-21swapper/320:30:253
292493099361,32cyclictest3025918-21apt-get00:00:131
2924925993628,4cyclictest0-21swapper/019:45:010
2924925993626,7cyclictest0-21swapper/021:40:000
2924936993526,6cyclictest2968534-21unixbench_singl21:10:243
2924936993525,7cyclictest0-21swapper/320:40:013
2924936993525,6cyclictest3021836-21grep23:45:253
2924936993525,6cyclictest0-21swapper/320:00:003
2924936993525,6cyclictest0-21swapper/320:00:003
2924932993527,4cyclictest0-21swapper/223:25:262
2924932993525,7cyclictest2982141-21grep21:50:242
2924925993528,4cyclictest3032501-21munin-plugin-st00:20:000
2924925993525,7cyclictest3023961-21cron23:55:000
2924925993524,6cyclictest0-21swapper/021:35:010
2924936993426,4cyclictest0-21swapper/320:25:173
2924936993426,4cyclictest0-21swapper/319:15:013
2924936993425,5cyclictest0-21swapper/323:55:003
2924936993423,7cyclictest0-21swapper/319:55:023
2924936993423,6cyclictest0-21swapper/322:50:283
292493299346,4cyclictest131rcu_preempt00:30:092
2924932993423,7cyclictest0-21swapper/219:20:012
2924936993325,6cyclictest3016288-21proc_pri23:30:223
2924936993325,4cyclictest0-21swapper/322:05:153
2924936993324,5cyclictest0-21swapper/320:25:013
2924936993323,5cyclictest0-21swapper/323:37:083
2924932993325,4cyclictest0-21swapper/223:10:122
2924925993326,3cyclictest0-21swapper/000:40:010
292492599332,4cyclictest131rcu_preempt21:45:100
2924925993322,8cyclictest2984320-21idleruntime-cro22:00:010
2924936993224,4cyclictest0-21swapper/322:35:223
2924936993224,4cyclictest0-21swapper/321:05:263
2924936993224,4cyclictest0-21swapper/320:10:233
2924936993223,7cyclictest3035922-21cut00:30:003
2924936993222,6cyclictest0-21swapper/323:05:253
2924932993224,4cyclictest2991146-21munin-plugin-st22:20:002
2924925993224,4cyclictest0-21swapper/023:45:160
2924925993224,4cyclictest0-21swapper/019:55:140
2924925993224,4cyclictest0-21swapper/019:55:140
2924925993217,13cyclictest11-21ksoftirqd/021:15:130
2924925993216,13cyclictest11-21ksoftirqd/022:45:110
2924936993123,4cyclictest0-21swapper/322:26:523
2924936993122,6cyclictest0-21swapper/300:40:013
2924932993122,6cyclictest0-21swapper/220:10:232
2924925993123,4cyclictest0-21swapper/019:50:240
2924925993122,6cyclictest0-21swapper/020:50:000
2924936993024,3cyclictest0-21swapper/322:05:013
2924936993021,4cyclictest0-21swapper/321:46:443
2924936993020,6cyclictest0-21swapper/321:50:243
2924932993024,4cyclictest2930273-21kworker/u8:2+events_unbound19:41:162
2924932993023,4cyclictest2968953-21debian-sa121:15:012
2924932993023,4cyclictest0-21swapper/219:50:252
2924932993022,4cyclictest3039317-21cron00:40:002
2924932993022,4cyclictest0-21swapper/219:25:252
2924932993022,4cyclictest0-21swapper/219:20:272
2924925993024,4cyclictest2990873-21kworker/u8:2+events_unbound22:26:540
2924925993022,5cyclictest3029486-21fschecks_count00:10:180
2924925993020,6cyclictest0-21swapper/000:10:010
2924936992923,3cyclictest0-21swapper/320:20:013
2924936992922,4cyclictest0-21swapper/300:03:143
2924936992922,3cyclictest0-21swapper/321:30:243
2924932992923,4cyclictest3008510-21kworker/u8:0+events_unbound23:17:412
2924932992922,4cyclictest2992641-21kworker/u8:1+events_unbound22:27:072
2924932992921,4cyclictest0-21swapper/200:00:152
2924925992922,4cyclictest2991151-21idleruntime-cro22:20:010
2924925992922,3cyclictest0-21swapper/000:20:250
2924925992921,5cyclictest0-21swapper/021:00:010
2924925992921,5cyclictest0-21swapper/020:20:010
2924925992920,6cyclictest0-21swapper/022:25:010
2924925992920,5cyclictest0-21swapper/019:35:260
2924925992918,7cyclictest3005204-21sh23:00:000
2924936992820,5cyclictest0-21swapper/320:05:013
2924936992820,5cyclictest0-21swapper/320:05:003
2924936992819,6cyclictest2992418-21unixbench_singl22:20:253
2924936992818,6cyclictest0-21swapper/320:40:193
2924932992820,4cyclictest0-21swapper/220:55:162
2924932992818,6cyclictest0-21swapper/221:05:002
2924932992817,7cyclictest0-21swapper/220:25:252
292492599289,10cyclictest0-21swapper/023:40:180
2924925992822,4cyclictest3017144-21auditctl23:34:590
2924925992820,5cyclictest0-21swapper/019:10:240
2924925992820,4cyclictest0-21swapper/022:06:480
2924925992817,8cyclictest2961501-21grep20:50:240
292493699274,4cyclictest131rcu_preempt00:20:133
2924936992720,4cyclictest3037617-21cron00:35:003
2924936992720,3cyclictest0-21swapper/322:50:013
2924936992717,6cyclictest0-21swapper/320:55:003
292493299278,6cyclictest0-21swapper/221:20:102
292493299274,4cyclictest131rcu_preempt22:50:132
2924932992720,5cyclictest2941462-21kworker/u8:2+events_unbound19:56:122
2924932992720,5cyclictest2941462-21kworker/u8:2+events_unbound19:56:122
2924932992720,4cyclictest0-21swapper/219:35:262
2924932992719,4cyclictest0-21swapper/220:05:262
2924932992716,7cyclictest0-21swapper/220:50:242
2924932992714,9cyclictest2998181-21ls22:40:012
2924925992719,5cyclictest13550irq/42-30be0000.ethernet22:30:200
2924925992719,4cyclictest0-21swapper/020:25:260
2924925992714,9cyclictest11-21ksoftirqd/020:05:170
2924936992619,5cyclictest2996312-21kworker/u8:2+events_unbound23:11:593
2924936992618,5cyclictest0-21swapper/321:45:003
2924936992616,6cyclictest0-21swapper/323:15:253
2924932992620,4cyclictest2992641-21kworker/u8:1+events_unbound22:25:002
2924932992619,5cyclictest2967056-21kworker/u8:1+events_unbound21:31:552
2924932992619,4cyclictest0-21swapper/219:30:292
2924932992618,4cyclictest0-21swapper/220:00:262
2924932992618,4cyclictest0-21swapper/220:00:262
292493299261,4cyclictest131rcu_preempt23:50:122
2924925992620,3cyclictest0-21swapper/000:00:000
2924925992618,5cyclictest0-21swapper/022:35:170
2924925992617,5cyclictest0-21swapper/021:25:260
2924925992616,6cyclictest0-21swapper/000:30:230
2924925992615,8cyclictest2984729-21cut22:00:170
292492599261,22cyclictest2931572-21cat19:25:230
2924936992517,6cyclictest145-21jbd2/mmcblk1p2-820:45:053
2924936992517,5cyclictest2996312-21kworker/u8:2+events_unbound22:41:133
2924936992516,6cyclictest2977057-21grep21:35:243
2924936992515,6cyclictest204-21dbus-daemon22:31:533
2924932992518,5cyclictest3016827-21kworker/u8:1+events_unbound23:33:562
2924932992518,5cyclictest2996312-21kworker/u8:2+events_unbound22:44:422
2924932992518,5cyclictest2985669-21kworker/u8:2+events_unbound22:02:202
2924932992517,4cyclictest0-21swapper/220:40:262
2924932992516,6cyclictest0-21swapper/223:05:252
2924932992516,5cyclictest2970226-21grep21:15:262
292493299251,3cyclictest131rcu_preempt23:55:102
292493299251,13cyclictest0-21swapper/221:55:162
292493299250,7cyclictest0-21swapper/221:40:122
292492599253,6cyclictest11-21ksoftirqd/000:30:000
2924925992519,4cyclictest3023912-21kworker/u8:0+events_unbound00:03:160
2924925992518,4cyclictest2968021-21ntpq21:10:190
2924925992518,4cyclictest2956180-21unixbench_singl20:35:240
2924925992517,6cyclictest3006799-21kworker/u8:1+events_unbound23:06:580
2924925992517,5cyclictest0-21swapper/019:15:260
2924925992515,6cyclictest0-21swapper/019:20:270
292492599251,22cyclictest0-21swapper/019:30:060
292492599251,21cyclictest30118592sleep023:18:020
292492599251,20cyclictest0-21swapper/023:12:030
2924936992418,4cyclictest3014795-21switchtime23:25:243
2924936992418,3cyclictest0-21swapper/321:15:253
2924936992417,4cyclictest0-21swapper/321:25:003
2924936992417,4cyclictest0-21swapper/300:05:203
2924936992416,6cyclictest2924919-21cyclictest19:37:243
2924936992414,7cyclictest0-21swapper/321:25:253
2924936992414,6cyclictest0-21swapper/319:40:253
292493299242,8cyclictest2924919-21cyclictest00:21:012
2924932992418,4cyclictest2985669-21kworker/u8:2+events_unbound22:10:562
2924932992417,5cyclictest2985669-21kworker/u8:2+events_unbound22:06:492
2924932992417,5cyclictest2975619-21kworker/u8:0+events_unbound21:45:222
2924932992417,5cyclictest2930273-21kworker/u8:2+events_unbound19:45:402
2924932992416,5cyclictest0-21swapper/219:10:152
2924932992414,8cyclictest311ktimers/220:30:112
2924932992414,6cyclictest3021816-21grep23:45:262
2924932992412,4cyclictest3023912-21kworker/u8:0+events_unbound00:14:562
2924925992418,3cyclictest0-21swapper/022:40:230
2924925992417,5cyclictest2967056-21kworker/u8:1+events_unbound21:24:410
2924925992414,8cyclictest3017653-21if_err_eth123:35:160
292492599241,20cyclictest3006196-21sensors_temp23:00:200
292492599241,20cyclictest2951046-21head20:20:240
2924936992317,3cyclictest0-21swapper/323:00:173
2924936992316,4cyclictest438-21cron19:25:023
2924936992316,4cyclictest0-21swapper/319:25:153
2924936992316,3cyclictest0-21swapper/322:55:223
2924936992315,5cyclictest391ktimers/319:30:063
2924936992315,5cyclictest0-21swapper/300:00:003
2924932992316,3cyclictest0-21swapper/223:20:262
2924932992316,3cyclictest0-21swapper/223:20:262
2924925992317,3cyclictest0-21swapper/020:40:240
2924925992316,4cyclictest2943709-21ntpq20:00:220
2924925992316,4cyclictest2943709-21ntpq20:00:210
2924925992316,3cyclictest3012435-21fschecks_count23:20:150
2924925992316,3cyclictest3012435-21fschecks_count23:20:150
2924925992314,6cyclictest0-21swapper/021:50:160
292492599231,20cyclictest0-21swapper/022:12:110
292492599231,18cyclictest0-21swapper/022:52:320
292492599231,18cyclictest0-21swapper/020:33:020
292492599231,18cyclictest0-21swapper/020:13:060
292492599230,19cyclictest0-21swapper/019:45:370
2924936992216,3cyclictest0-21swapper/323:40:173
2924936992215,4cyclictest2928235-21timerandwakeup19:15:253
2924936992215,3cyclictest0-21swapper/320:10:013
2924932992216,3cyclictest0-21swapper/223:40:202
2924936992114,5cyclictest391ktimers/319:45:193
2924932992114,5cyclictest2968570-21kworker/u8:3+events_unbound21:28:132
292493299211,3cyclictest131rcu_preempt00:15:282
2924932992110,8cyclictest3034809-21cut00:25:172
292492599211,3cyclictest3014084-21df23:25:140
2924936992011,7cyclictest2988079-21entropy22:10:163
292493299202,4cyclictest131rcu_preempt20:20:242
292493699188,7cyclictest3012701-21cat23:20:193
292493699188,7cyclictest3012701-21cat23:20:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional