You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Sep 24, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2672763995025,20cyclictest0-21swapper/122:40:161
2672771994834,10cyclictest391ktimers/320:40:123
2672759994635,7cyclictest2771378-21grep23:50:260
2672771994534,8cyclictest391ktimers/320:35:113
2672771994534,8cyclictest391ktimers/320:35:113
2672768994537,4cyclictest2731710-21apt-get22:00:012
267276399451,41cyclictest2762873-21/usr/sbin/munin23:25:231
267276399451,38cyclictest2697795-21/usr/sbin/munin20:20:171
2672759994536,6cyclictest2759661-21sendmail23:20:000
267276399441,40cyclictest2768135-21cron23:42:011
267276399441,39cyclictest2775445-21apt-get00:05:141
267276399441,38cyclictest2777135-21munin-node00:10:081
2672759994423,17cyclictest2767955-21grep23:40:280
2672763994324,15cyclictest0-21swapper/123:50:011
267276399432,34cyclictest2716384-21apt-get21:15:131
267276399431,35cyclictest0-21swapper/123:35:131
2672763994233,4cyclictest2773507-21idleruntime-cro00:00:011
2672763994221,17cyclictest0-21swapper/122:30:251
267276399421,36cyclictest2720158-21/usr/sbin/munin21:25:191
267276399421,35cyclictest2730239-21apt-get21:55:111
267276399420,36cyclictest0-21swapper/122:25:111
2672759994232,6cyclictest2737039-21debian-sa122:15:000
2672759994232,6cyclictest0-21swapper/021:55:010
267276399412,34cyclictest2780565-21apt-get00:20:111
2672763994119,19cyclictest0-21swapper/123:50:251
267276399411,37cyclictest2782706-21/usr/sbin/munin00:25:191
267276399411,37cyclictest2712251-21/usr/sbin/munin21:00:241
267276399411,37cyclictest2709152-21cron20:53:011
267276399411,37cyclictest2687702-21/usr/sbin/munin19:50:211
267276399411,35cyclictest53-21kcompactd000:35:061
267276399411,35cyclictest2751597-21/usr/sbin/munin22:55:271
267276399411,35cyclictest2727291-21/usr/sbin/munin21:45:201
267276399411,35cyclictest2706391-21meminfo20:45:181
267276399411,35cyclictest2700826-21apt-get20:30:161
267276399411,35cyclictest2700826-21apt-get20:30:161
267276399411,33cyclictest2690597-21apt-get20:00:141
267276399410,36cyclictest2685476-21apt-get19:45:161
2672759994133,4cyclictest0-21swapper/000:30:000
267276399402,33cyclictest2710131-21ntp_states20:55:231
267276399401,36cyclictest2734504-21/usr/sbin/munin22:05:221
267276399401,36cyclictest2718355-21/usr/sbin/munin21:20:191
267276399401,36cyclictest2692430-21/usr/sbin/munin20:05:201
267276399401,36cyclictest2680460-21/usr/sbin/munin19:30:161
267276399401,36cyclictest2677726-21/usr/sbin/munin19:20:241
267276399401,34cyclictest53-21kcompactd020:15:091
267276399401,33cyclictest2778843-21apt-get00:15:111
267276399400,34cyclictest0-21swapper/119:10:121
267276399400,34cyclictest0-21swapper/119:10:111
267276399400,31cyclictest0-21swapper/119:25:111
2672759994034,3cyclictest2714452-21cron21:10:010
2672759994033,4cyclictest2738761-21munin-plugin-st22:20:000
267276399392,34cyclictest2752761-21/usr/sbin/munin23:00:161
267276399391,35cyclictest53-21kcompactd000:31:171
267276399391,35cyclictest2761104-21cron23:22:001
267276399391,35cyclictest2745481-21cron22:39:011
267276399391,35cyclictest2739114-21diskstats22:20:141
267276399391,35cyclictest2736707-21cron22:11:011
267276399391,35cyclictest2732083-21rm22:00:021
267276399391,35cyclictest2732083-21rm22:00:011
267276399391,35cyclictest2728543-21apt-get21:50:151
267276399391,35cyclictest2721807-21/usr/sbin/munin21:30:181
267276399391,35cyclictest2705622-21cron20:44:001
267276399391,35cyclictest2703659-21cron20:36:001
267276399391,35cyclictest2703659-21cron20:35:591
267276399391,35cyclictest2699986-21timerandwakeup20:25:251
2672759993932,4cyclictest2752401-21munin-plugin-st23:00:000
2672759993929,7cyclictest2676713-21sendmail19:20:000
2672759993927,9cyclictest121ktimers/020:45:100
267276399381,34cyclictest2757015-21/usr/sbin/munin23:10:281
267276399381,34cyclictest2755769-21cron23:07:001
267276399381,34cyclictest2689437-21/usr/sbin/munin19:55:211
267276399381,32cyclictest2737382-21df22:15:161
267276399380,35cyclictest53-21kcompactd019:15:371
2672759993827,6cyclictest0-21swapper/019:50:260
2672759993822,13cyclictest121ktimers/020:25:120
2672771993729,6cyclictest2745574-21munin-plugin-st22:40:013
2672771993726,7cyclictest2681409-21grep19:30:283
267276399371,34cyclictest2715709-21unixbench_singl21:10:281
267276399371,33cyclictest2773740-21apt-get00:00:111
267276399371,33cyclictest2749342-21/usr/sbin/munin22:50:191
267276399371,33cyclictest2747519-21/usr/sbin/munin22:45:261
267276399371,33cyclictest2725585-21memory21:40:191
267276399371,33cyclictest2723538-21diskstats21:35:151
267276399371,33cyclictest2694229-21perl20:10:161
267276399371,33cyclictest2684903-21cron19:41:011
267276399371,33cyclictest2683430-21cron19:39:011
267276399371,32cyclictest2765072-21wc23:35:001
267276399370,32cyclictest2712981-21apt-get21:05:141
2672759993730,4cyclictest0-21swapper/019:50:010
2672768993628,4cyclictest0-21swapper/219:45:192
2672768993626,7cyclictest2703581-21grep20:35:232
2672768993626,7cyclictest2703581-21grep20:35:222
2672768993625,7cyclictest0-21swapper/221:05:012
2672768993624,8cyclictest2755538-21grep23:05:262
267276399361,32cyclictest2758489-21/usr/sbin/munin23:15:171
2672759993626,6cyclictest0-21swapper/020:40:250
2672759993625,7cyclictest0-21swapper/023:35:260
2672759993625,7cyclictest0-21swapper/023:30:230
2672771993526,4cyclictest0-21swapper/300:00:263
2672768993527,5cyclictest2757727-21latency_hist23:15:002
2672768993525,7cyclictest311ktimers/222:10:182
2672768993525,7cyclictest2717426-21grep21:15:292
2672768993525,6cyclictest2698474-21unixbench_singl20:20:252
2672759993526,6cyclictest0-21swapper/023:15:000
2672759993523,9cyclictest2731734-21sendmail22:00:010
2672771993423,7cyclictest0-21swapper/321:40:013
2672768993424,7cyclictest2740016-21grep22:20:242
2672768993424,6cyclictest0-21swapper/222:50:002
2672768993423,7cyclictest2759166-21grep23:15:232
2672768993423,7cyclictest0-21swapper/200:15:242
2672759993424,6cyclictest0-21swapper/019:55:260
2672771993326,4cyclictest0-21swapper/320:45:243
2672771993323,6cyclictest0-21swapper/320:30:013
2672771993322,7cyclictest391ktimers/300:20:113
2672771993321,7cyclictest0-21swapper/320:20:253
2672771993318,4cyclictest131rcu_preempt20:58:393
2672768993324,4cyclictest0-21swapper/222:00:182
2672768993324,4cyclictest0-21swapper/222:00:182
2672768993323,7cyclictest2776500-21grep00:05:262
2672768993323,6cyclictest2760884-21grep23:20:242
2672768993322,7cyclictest2726147-21grep21:40:242
2672768993322,7cyclictest0-21swapper/200:00:012
2672759993324,5cyclictest0-21swapper/019:30:230
2672759993322,6cyclictest0-21swapper/022:45:250
2672771993224,4cyclictest0-21swapper/323:00:583
2672771993222,6cyclictest2717848-21cron21:19:593
2672771993222,6cyclictest0-21swapper/319:40:013
2672768993225,4cyclictest2690353-21grep20:00:012
2672768993222,7cyclictest2709739-21grep20:55:162
2672759993222,6cyclictest0-21swapper/021:30:300
267277199315,14cyclictest40-21ksoftirqd/322:25:173
2672771993123,4cyclictest0-21swapper/319:10:263
2672771993123,4cyclictest0-21swapper/319:10:263
2672771993121,7cyclictest2738768-21sendmail22:20:003
2672771993116,9cyclictest131rcu_preempt22:44:403
2672768993123,4cyclictest0-21swapper/223:25:152
2672768993122,5cyclictest0-21swapper/219:20:202
2672768993120,7cyclictest2683103-21grep19:35:262
2672759993124,3cyclictest0-21swapper/022:35:240
2672759993123,5cyclictest2717471-21kworker/u8:0+events_unbound21:20:430
2672759993123,4cyclictest0-21swapper/019:10:150
2672759993123,4cyclictest0-21swapper/019:10:150
2672759993121,6cyclictest0-21swapper/020:55:270
2672759993120,7cyclictest2717431-21grep21:15:290
2672759993120,6cyclictest0-21swapper/023:05:160
267277199307,7cyclictest40-21ksoftirqd/322:20:203
267277199306,8cyclictest2712182-21timerandwakeup21:00:243
267277199305,15cyclictest40-21ksoftirqd/322:10:013
267277199303,8cyclictest40-21ksoftirqd/323:45:013
2672771993023,4cyclictest0-21swapper/320:00:293
2672771993022,4cyclictest0-21swapper/321:20:423
2672771993017,8cyclictest0-21swapper/323:55:013
2672771993017,10cyclictest391ktimers/323:15:113
2672768993023,4cyclictest0-21swapper/221:10:282
2672768993022,6cyclictest2762974-21kworker/u8:2+events_unbound23:35:592
2672759993023,4cyclictest0-21swapper/019:40:010
2672759993020,6cyclictest0-21swapper/022:35:010
2672759993020,5cyclictest0-21swapper/020:50:270
267277199297,8cyclictest2688842-21date19:55:023
267277199297,6cyclictest40-21ksoftirqd/323:25:013
267277199296,7cyclictest380-21ntpd20:30:233
267277199296,7cyclictest380-21ntpd20:30:233
267277199296,6cyclictest40-21ksoftirqd/321:55:153
267277199294,8cyclictest40-21ksoftirqd/321:45:133
267277199294,8cyclictest40-21ksoftirqd/319:15:043
267277199294,6cyclictest40-21ksoftirqd/323:15:013
267277199294,6cyclictest40-21ksoftirqd/322:45:213
267277199294,6cyclictest40-21ksoftirqd/321:15:003
267277199293,8cyclictest40-21ksoftirqd/320:10:003
267277199293,7cyclictest40-21ksoftirqd/320:50:003
267277199293,7cyclictest40-21ksoftirqd/319:45:283
2672771992917,8cyclictest2690362-21sendmail20:00:013
2672771992915,3cyclictest131rcu_preempt21:30:163
2672771992912,10cyclictest131rcu_preempt00:25:183
2672768992919,6cyclictest2778141-21grep00:10:212
2672759992921,4cyclictest0-21swapper/023:58:060
2672759992918,7cyclictest2778606-21sh00:15:000
2672759992915,9cyclictest204-21dbus-daemon19:20:210
267277199284,6cyclictest40-21ksoftirqd/320:12:223
2672771992820,6cyclictest2679343-21fgrep19:25:233
2672771992820,4cyclictest0-21swapper/323:45:243
2672771992818,6cyclictest0-21swapper/319:20:253
2672771992817,5cyclictest2724791-21kworker/u8:0+events_unbound21:41:233
2672768992821,4cyclictest2764567-21head23:30:242
2672768992821,4cyclictest0-21swapper/220:05:292
2672759992821,3cyclictest0-21swapper/023:00:260
2672759992820,4cyclictest438-21cron20:35:010
2672759992820,4cyclictest438-21cron20:35:000
2672759992820,4cyclictest0-21swapper/021:40:230
2672759992819,6cyclictest0-21swapper/000:15:240
267277199278,4cyclictest131rcu_preempt20:18:333
267277199276,6cyclictest40-21ksoftirqd/300:08:223
267277199275,6cyclictest40-21ksoftirqd/300:10:153
267277199272,7cyclictest40-21ksoftirqd/322:05:013
267277199272,7cyclictest40-21ksoftirqd/322:05:013
2672771992720,4cyclictest2784153-21fschecks_time00:30:163
2672771992719,4cyclictest0-21swapper/323:30:153
2672771992718,7cyclictest391ktimers/323:05:213
2672771992718,6cyclictest391ktimers/321:51:013
2672771992714,6cyclictest131rcu_preempt23:56:413
2672768992720,4cyclictest0-21swapper/220:45:242
2672768992719,4cyclictest0-21swapper/221:50:292
2672768992712,10cyclictest204-21dbus-daemon22:25:512
2672759992718,5cyclictest0-21swapper/022:25:250
267277199266,4cyclictest391ktimers/319:40:083
267277199264,7cyclictest0-21swapper/300:35:243
2672771992620,3cyclictest391ktimers/322:51:323
2672771992618,4cyclictest0-21swapper/322:55:313
2672771992617,6cyclictest2736626-21unixbench_singl22:10:303
2672771992615,8cyclictest0-21swapper/323:25:123
2672771992613,4cyclictest131rcu_preempt21:07:153
2672771992612,4cyclictest131rcu_preempt22:30:223
2672771992610,3cyclictest131rcu_preempt21:25:193
2672768992618,5cyclictest0-21swapper/222:35:182
2672768992618,4cyclictest0-21swapper/220:50:272
2672768992617,6cyclictest2783727-21sh00:30:002
2672768992616,7cyclictest2771888-21date23:55:012
2672768992615,7cyclictest2705712-21debian-sa120:45:002
2672768992612,10cyclictest204-21dbus-daemon20:25:332
2672768992612,10cyclictest0-21swapper/221:25:002
2672759992618,5cyclictest0-21swapper/020:10:260
2672759992618,4cyclictest0-21swapper/020:05:000
2672759992614,8cyclictest2746870-21grep22:40:260
267277199259,9cyclictest131rcu_preempt23:35:233
2672768992519,3cyclictest0-21swapper/221:45:222
2672768992519,3cyclictest0-21swapper/219:25:162
2672768992518,4cyclictest0-21swapper/200:35:172
2672768992517,4cyclictest0-21swapper/222:30:522
2672768992517,4cyclictest0-21swapper/219:50:172
2672768992517,4cyclictest0-21swapper/200:30:252
2672759992517,4cyclictest0-21swapper/021:15:000
2672759992516,6cyclictest2734034-21cut22:05:150
2672759992515,7cyclictest1-21systemd00:39:340
267277199243,4cyclictest40-21ksoftirqd/300:15:193
2672768992418,3cyclictest0-21swapper/200:00:162
2672768992417,4cyclictest0-21swapper/222:05:252
2672768992411,9cyclictest204-21dbus-daemon20:30:332
2672768992411,9cyclictest204-21dbus-daemon20:30:332
267275999242,3cyclictest2702525-21apt-get20:35:100
267275999242,3cyclictest2702525-21apt-get20:35:100
2672759992417,5cyclictest0-21swapper/022:25:010
2672759992417,3cyclictest0-21swapper/020:21:330
2672759992416,5cyclictest0-21swapper/000:30:150
2672759992416,5cyclictest0-21swapper/000:00:250
2672759992415,6cyclictest0-21swapper/023:25:230
267275999241,19cyclictest0-21swapper/023:23:020
267275999241,19cyclictest0-21swapper/021:49:270
267275999241,19cyclictest0-21swapper/021:28:220
2672768992315,6cyclictest311ktimers/221:05:152
2672768992315,5cyclictest0-21swapper/222:40:232
267276899231,4cyclictest0-21swapper/219:30:142
2672768992314,6cyclictest0-21swapper/219:15:262
2672768992314,5cyclictest0-21swapper/223:00:262
2672759992317,4cyclictest2766446-21kworker/u8:1+events_unbound23:49:540
2672759992316,3cyclictest0-21swapper/021:35:110
2672759992316,3cyclictest0-21swapper/019:40:230
2672759992315,5cyclictest0-21swapper/021:00:240
2672759992315,5cyclictest0-21swapper/020:15:170
267275999231,4cyclictest2731710-21apt-get22:00:030
267275999231,4cyclictest2731710-21apt-get22:00:030
267275999231,3cyclictest2678649-21apt-get19:25:120
267275999231,18cyclictest0-21swapper/000:05:380
2672768992216,4cyclictest2751938-21unixbench_multi22:55:302
2672768992216,3cyclictest0-21swapper/221:30:182
2672768992215,5cyclictest2673344-21sshd19:10:202
2672768992215,5cyclictest2673344-21sshd19:10:202
2672768992215,4cyclictest0-21swapper/222:15:272
2672759992215,5cyclictest13550irq/42-30be0000.ethernet00:20:210
267275999221,19cyclictest0-21swapper/022:50:180
267275999221,17cyclictest2693345-21grep20:05:290
2672768992116,3cyclictest0-21swapper/223:40:232
2672768992115,4cyclictest145-21jbd2/mmcblk1p2-823:47:052
2672768992113,5cyclictest199-21systemd-network20:15:142
2672768992112,6cyclictest2685247-21basename19:45:012
2672768992110,8cyclictest2694746-21sensors_temp20:10:242
2672768992013,4cyclictest311ktimers/222:52:572
2672768991912,5cyclictest311ktimers/221:35:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional