You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 05:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Thu Jul 23, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2716854995547,5cyclictest2763666-21kworker/u8:1+events_unbound21:35:130
2716858995343,6cyclictest2741480-21sendmail20:20:011
2716858995245,5cyclictest2782480-21kworker/u8:1+events_unbound22:20:391
2716862995026,19cyclictest2720365-21grep19:15:262
2716862994938,7cyclictest2763465-21grep21:20:262
2716858994941,5cyclictest2748125-21kworker/u8:2+events_unbound20:40:201
2716867994838,6cyclictest2732945-21sh19:55:003
2716862994624,18cyclictest2780923-21sh22:15:012
2716867994534,8cyclictest391ktimers/323:55:143
2716867994534,8cyclictest391ktimers/323:55:143
2716867994531,10cyclictest391ktimers/321:20:123
2716862994537,5cyclictest2775815-21munin-plugin-st22:00:002
2716862994529,11cyclictest311ktimers/200:05:142
2716858994332,7cyclictest2820089-21unixbench_multi00:15:231
2716858994330,9cyclictest231ktimers/121:25:141
2716854994336,4cyclictest2827401-21munin-plugin-st00:40:010
2716867994231,8cyclictest391ktimers/321:35:143
271686299421,9cyclictest2777995-21/usr/sbin/munin22:05:162
271686299421,36cyclictest2767637-21diskstats21:35:162
2716858994233,6cyclictest2751636-21kworker/u8:2+events_unbound20:50:231
271686299411,9cyclictest2785147-21ntp_states22:25:202
271686299411,9cyclictest2770173-21/usr/sbin/munin21:40:262
271686299411,3cyclictest0-21swapper/222:15:112
271686299411,35cyclictest2787604-21/usr/sbin/munin22:40:112
2716862994033,4cyclictest2827432-21idleruntime-cro00:40:002
271686299401,9cyclictest2791792-21/usr/sbin/munin22:50:252
271686299401,9cyclictest2717612-21/usr/sbin/munin19:10:222
2716862994017,19cyclictest2790252-21grep22:45:262
271686299401,3cyclictest0-21swapper/219:25:122
271686299401,34cyclictest2792653-21/usr/sbin/munin22:55:112
271686299401,34cyclictest2750355-21df20:45:132
271686299401,34cyclictest2736796-21fschecks_time20:05:172
271686299401,10cyclictest2728804-21/usr/sbin/munin19:40:242
271686299401,10cyclictest2728804-21/usr/sbin/munin19:40:242
271686299400,3cyclictest0-21swapper/221:10:132
2716858994030,7cyclictest2778806-21unixbench_singl22:05:251
2716854994031,4cyclictest27796622sleep022:10:170
2716854994031,4cyclictest0-21swapper/000:10:390
2716867993930,6cyclictest2811403-21cron23:50:013
271686299393,32cyclictest2801536-21diskstats23:20:162
271686299392,34cyclictest2765367-21sshd21:27:262
271686299392,33cyclictest0-21swapper/219:35:152
271686299392,32cyclictest2807563-21grep23:35:272
271686299392,32cyclictest2807563-21grep23:35:272
271686299392,31cyclictest2776059-21apt-get22:00:112
271686299391,8cyclictest2753770-21diskstats20:55:152
271686299391,5cyclictest2812247-21/usr/sbin/munin23:50:232
271686299391,4cyclictest2730860-21/usr/sbin/munin19:45:272
271686299391,4cyclictest0-21swapper/221:00:112
271686299391,3cyclictest0-21swapper/220:20:112
271686299391,12cyclictest2732415-21sed19:50:242
271686299391,10cyclictest2803962-21/usr/sbin/munin23:25:262
271686299391,10cyclictest2735476-21ntp_states20:00:212
2716854993932,5cyclictest2734337-21kworker/u8:1+events_unbound20:20:170
2716854993930,6cyclictest0-21swapper/020:40:010
271686299381,7cyclictest2794482-21cstates23:00:162
271686299381,6cyclictest2748659-21df20:40:142
271686299381,5cyclictest2752062-21df20:50:182
271686299381,5cyclictest2725343-21/usr/sbin/munin19:30:242
271686299381,3cyclictest0-21swapper/223:10:112
271686299381,3cyclictest0-21swapper/220:15:112
271686299381,32cyclictest2820071-21unixbench_multi00:15:242
2716862993812,23cyclictest311ktimers/221:15:222
271686299381,11cyclictest2805107-21/usr/sbin/munin23:30:192
271686299381,10cyclictest2747360-21/usr/sbin/munin20:35:212
271686299381,10cyclictest2745129-21apt-get20:30:142
271686299380,3cyclictest0-21swapper/221:05:172
271686299380,3cyclictest0-21swapper/200:30:112
2716858993830,5cyclictest2739779-21cut20:15:011
2716854993830,4cyclictest2759777-21unixbench_multi21:10:250
2716867993729,4cyclictest2804596-21idleruntime-cro23:30:003
2716867993728,5cyclictest2775825-21sendmail22:00:003
271686299372,32cyclictest2810345-21wc23:45:182
271686299372,31cyclictest2784344-21cron22:25:002
271686299371,8cyclictest2786863-21latency_hist22:35:012
271686299371,8cyclictest2786863-21latency_hist22:35:012
271686299371,8cyclictest2771048-21df_inode21:45:142
271686299371,5cyclictest2744007-21ntp_states20:25:222
271686299371,4cyclictest2822658-21/usr/sbin/munin00:25:132
271686299371,4cyclictest2813523-21/usr/sbin/munin23:55:172
271686299371,4cyclictest2813523-21/usr/sbin/munin23:55:172
271686299371,3cyclictest0-21swapper/223:15:142
271686299371,3cyclictest0-21swapper/219:55:142
271686299371,10cyclictest2815173-21df_inode00:00:132
271686299370,3cyclictest0-21swapper/223:40:132
271686299370,3cyclictest0-21swapper/221:50:122
2716858993729,6cyclictest2751636-21kworker/u8:2+events_unbound21:00:251
2716858993726,7cyclictest0-21swapper/121:50:261
2716854993730,4cyclictest0-21swapper/022:40:000
2716854993728,6cyclictest2799454-21cron23:15:000
2716854993725,7cyclictest0-21swapper/021:45:000
271686299361,8cyclictest2738828-21/usr/sbin/munin20:10:202
271686299361,3cyclictest0-21swapper/221:30:142
271686299361,3cyclictest0-21swapper/219:20:132
271686299361,3cyclictest0-21swapper/200:20:112
2716858993627,5cyclictest2729538-21sh19:45:021
2716858993627,5cyclictest2729538-21sh19:45:011
2716854993628,4cyclictest0-21swapper/000:20:000
2716867993526,4cyclictest0-21swapper/300:25:133
2716867993523,8cyclictest2737671-21grep20:05:273
271686299351,29cyclictest629-21snmpd00:11:132
271686299351,29cyclictest2787292-21cron22:40:002
271685899355,5cyclictest131rcu_preempt22:40:111
271685899353,6cyclictest131rcu_preempt21:20:141
2716858993529,4cyclictest2780760-21kworker/u8:0+events_unbound22:15:391
2716867993426,4cyclictest0-21swapper/300:33:403
2716867993425,7cyclictest2816333-21kworker/u8:1+events_unbound00:10:423
2716858993424,5cyclictest0-21swapper/121:05:241
2716854993426,4cyclictest0-21swapper/022:55:010
2716867993322,7cyclictest2821842-21unixbench_singl00:20:253
2716858993328,3cyclictest2734337-21kworker/u8:1+events_unbound20:05:151
2716858993324,5cyclictest2801169-21cron23:20:001
2716854993325,5cyclictest0-21swapper/020:45:000
2716854993322,8cyclictest2720856-21apt-key19:20:010
2716867993221,7cyclictest0-21swapper/320:00:013
2716854993224,5cyclictest438-21cron22:20:000
2716854993224,4cyclictest0-21swapper/020:50:210
2716854993220,8cyclictest2745357-21fschecks_time20:30:170
2716867993124,3cyclictest0-21swapper/322:20:263
2716867993123,4cyclictest0-21swapper/320:15:253
2716867993122,7cyclictest391ktimers/319:45:163
271685899314,9cyclictest24-21ksoftirqd/119:15:141
2716858993123,6cyclictest2746369-21kworker/u8:0+events_unbound20:55:251
2716858993123,4cyclictest0-21swapper/100:35:231
2716858993122,5cyclictest2734243-21grep19:55:261
2716854993124,4cyclictest0-21swapper/023:30:260
2716854993124,3cyclictest0-21swapper/020:25:260
2716854993121,6cyclictest0-21swapper/019:35:260
2716867993021,6cyclictest2720813-21sendmail19:20:003
2716867993020,6cyclictest0-21swapper/321:05:003
2716854993024,3cyclictest0-21swapper/023:20:010
2716854993022,4cyclictest0-21swapper/022:40:230
2716854993021,6cyclictest0-21swapper/020:05:270
2716854993021,6cyclictest0-21swapper/000:00:240
2716854993020,7cyclictest2784346-21cron22:25:000
2716867992921,4cyclictest0-21swapper/321:10:013
2716867992920,5cyclictest0-21swapper/321:45:253
2716867992920,5cyclictest0-21swapper/300:35:183
2716867992919,6cyclictest0-21swapper/323:40:273
2716867992919,6cyclictest0-21swapper/321:30:273
2716867992918,7cyclictest2820114-21grep00:15:233
2716867992917,7cyclictest204-21dbus-daemon21:40:313
271685899292,4cyclictest131rcu_preempt21:30:141
2716858992921,4cyclictest0-21swapper/120:35:281
2716858992921,4cyclictest0-21swapper/120:25:271
2716858992920,4cyclictest0-21swapper/121:55:341
2716854992922,5cyclictest2772046-21kworker/u8:2+events_unbound21:50:340
2716854992922,4cyclictest2772412-21latency_hist21:50:000
2716854992922,4cyclictest2763414-21tail21:20:250
2716854992920,5cyclictest0-21swapper/019:10:250
2716867992819,6cyclictest2786684-21basename22:35:013
2716867992819,6cyclictest2786684-21basename22:35:003
2716867992819,4cyclictest0-21swapper/323:10:013
2716867992818,6cyclictest0-21swapper/320:10:263
2716867992817,8cyclictest2808134-21seq23:40:003
2716867992817,8cyclictest2808134-21seq23:40:003
2716867992817,7cyclictest2778825-21grep22:05:253
2716867992815,9cyclictest391ktimers/319:10:133
2716858992820,4cyclictest0-21swapper/120:20:141
2716858992819,6cyclictest2824004-21munin-plugin-st00:30:011
2716854992820,5cyclictest0-21swapper/022:00:260
2716854992820,4cyclictest0-21swapper/023:40:000
2716854992820,4cyclictest0-21swapper/023:40:000
2716854992819,6cyclictest0-21swapper/023:55:260
2716854992819,6cyclictest0-21swapper/023:55:260
2716854992818,6cyclictest0-21swapper/022:30:010
2716854992817,6cyclictest0-21swapper/021:25:260
2716867992720,4cyclictest0-21swapper/321:15:273
2716867992719,4cyclictest0-21swapper/321:15:003
2716858992721,4cyclictest2816333-21kworker/u8:1+events_unbound00:03:101
2716858992718,6cyclictest0-21swapper/123:49:591
2716858992717,5cyclictest2796237-21fschecks_count23:05:161
2716854992721,4cyclictest121ktimers/023:05:130
2716854992720,3cyclictest0-21swapper/000:10:000
2716854992719,4cyclictest0-21swapper/019:55:230
2716854992717,6cyclictest0-21swapper/020:10:260
2716867992619,3cyclictest0-21swapper/319:25:163
2716867992616,6cyclictest0-21swapper/320:50:293
2716858992619,5cyclictest2779039-21kworker/u8:1+events_unbound22:12:411
2716858992619,5cyclictest2777267-21kworker/u8:0+events_unbound22:03:251
271685899261,4cyclictest131rcu_preempt21:15:121
2716854992622,2cyclictest13550irq/42-30be0000.ethernet23:45:120
2716854992619,4cyclictest2741648-21latency_hist20:20:010
2716854992619,4cyclictest0-21swapper/023:50:250
2716854992618,5cyclictest0-21swapper/019:25:240
2716854992616,6cyclictest2778803-21grep22:05:250
2716854992616,6cyclictest0-21swapper/023:00:260
2716867992514,7cyclictest0-21swapper/322:10:263
2716858992519,4cyclictest2758230-21kworker/u8:2+events_unbound21:10:261
2716858992518,5cyclictest2801143-21kworker/u8:0+events_unbound23:28:221
2716858992517,4cyclictest0-21swapper/100:00:021
2716858992517,4cyclictest0-21swapper/100:00:011
2716858992515,6cyclictest2790253-21grep22:45:261
2716858992514,8cyclictest2807095-21ntp_states23:35:241
2716858992514,8cyclictest2807095-21ntp_states23:35:231
2716854992520,3cyclictest13550irq/42-30be0000.ethernet20:55:120
2716854992518,4cyclictest0-21swapper/019:55:000
2716854992515,7cyclictest2758120-21grep21:05:320
2716854992514,6cyclictest0-21swapper/023:20:270
2716867992418,3cyclictest2794127-21kthreadd23:00:003
2716867992417,3cyclictest0-21swapper/322:40:223
2716867992417,3cyclictest0-21swapper/322:15:243
2716867992416,5cyclictest391ktimers/319:35:153
2716867992414,6cyclictest0-21swapper/320:45:233
2716867992413,8cyclictest391ktimers/323:50:113
2716867992413,6cyclictest0-21swapper/323:30:263
271685899242,7cyclictest0-21swapper/122:55:111
2716858992418,3cyclictest0-21swapper/121:40:211
2716858992418,3cyclictest0-21swapper/100:20:251
2716858992417,5cyclictest2816333-21kworker/u8:1+events_unbound00:12:001
2716858992417,5cyclictest2784232-21kworker/u8:0+events_unbound22:25:401
2716858992417,4cyclictest0-21swapper/123:10:161
2716858992416,5cyclictest0-21swapper/121:45:161
2716858992413,4cyclictest131rcu_preempt23:30:181
2716854992418,4cyclictest2720731-21kworker/u8:2-ext4-rsv-conversion19:35:010
2716854992417,4cyclictest0-21swapper/023:40:280
2716854992417,3cyclictest0-21swapper/021:32:430
2716854992416,5cyclictest0-21swapper/023:25:190
271685499241,19cyclictest0-21swapper/021:00:560
271685499241,19cyclictest0-21swapper/020:45:340
2716867992316,3cyclictest0-21swapper/319:35:023
2716867992315,5cyclictest0-21swapper/322:55:013
2716867992311,7cyclictest0-21swapper/323:15:273
2716858992317,4cyclictest2725754-21kworker/u8:0+events_unbound19:37:361
2716858992317,4cyclictest2720731-21kworker/u8:2+events_unbound20:00:151
2716858992316,5cyclictest2729196-21kworker/u8:1+events_unbound19:50:231
2716858992316,4cyclictest2720731-21kworker/u8:2+events_unbound19:25:221
2716858992315,5cyclictest0-21swapper/119:15:011
2716858992315,4cyclictest0-21swapper/122:50:161
2716858992315,4cyclictest0-21swapper/121:35:261
2716858992314,6cyclictest164-21systemd-journal00:32:401
2716854992317,4cyclictest0-21swapper/000:25:160
2716854992316,3cyclictest0-21swapper/022:55:370
2716854992316,3cyclictest0-21swapper/020:00:200
2716854992315,4cyclictest0-21swapper/021:55:180
271685499231,18cyclictest0-21swapper/021:19:520
2716867992215,5cyclictest391ktimers/300:05:233
2716867992215,4cyclictest0-21swapper/322:25:253
2716867992213,6cyclictest0-21swapper/320:40:173
2716867992212,7cyclictest2735358-21wc20:00:193
2716867992211,8cyclictest2744185-21sensors_temp20:25:243
2716858992216,3cyclictest0-21swapper/120:45:121
2716858992213,6cyclictest2786738-21cat22:35:001
2716858992213,6cyclictest2786738-21cat22:35:001
271685899221,18cyclictest629-21snmpd20:30:131
2716854992216,4cyclictest2818098-21kworker/u8:2+events_unbound00:20:270
2716854992216,3cyclictest0-21swapper/019:45:270
2716854992216,3cyclictest0-21swapper/019:20:050
2716854992214,5cyclictest121ktimers/000:34:520
271685499221,18cyclictest0-21swapper/019:40:330
271685499221,18cyclictest0-21swapper/019:40:330
2716867992115,3cyclictest2773087-21missed_timers21:50:193
2716867992115,3cyclictest0-21swapper/323:10:283
2716867992115,3cyclictest0-21swapper/319:20:233
2716867992114,4cyclictest2795865-21idleruntime-cro23:05:003
2716867992114,4cyclictest2777532-21latency_hist22:05:023
2716867992113,4cyclictest0-21swapper/300:03:103
2716867992111,6cyclictest0-21swapper/323:20:283
2716858992115,3cyclictest0-21swapper/123:20:181
2716858992114,5cyclictest2808814-21kworker/u8:3+events_unbound23:44:411
2716858992114,5cyclictest2729196-21kworker/u8:1+events_unbound19:49:381
2716858992113,4cyclictest2722729-21idleruntime-cro19:25:001
2716858992113,4cyclictest0-21swapper/119:30:251
271685499211,16cyclictest0-21swapper/022:30:420
271685499211,16cyclictest0-21swapper/022:30:420
2716867992015,3cyclictest2754501-21timerandwakeup20:55:243
2716867992013,3cyclictest0-21swapper/320:20:163
2716867991912,4cyclictest0-21swapper/319:40:163
2716867991912,4cyclictest0-21swapper/319:40:163
2716867991910,6cyclictest0-21swapper/320:30:173
2716858991810,6cyclictest2787374-21sed22:40:001
2716867991711,4cyclictest2786659-21kworker/u8:0+events_unbound22:35:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional