You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 06:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Tue Mar 24, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3447124995121,5cyclictest0-21swapper/119:45:171
3447121995040,6cyclictest3507775-21grep22:00:260
3447124994733,8cyclictest0-21swapper/119:15:011
3447121994736,7cyclictest3537189-21idleruntime-cro23:29:590
3447121994736,7cyclictest3537189-21idleruntime-cro23:29:590
3447134994533,9cyclictest391ktimers/321:30:133
3447129994534,7cyclictest3545505-21grep23:50:282
3447121994537,6cyclictest3476736-21kworker/u8:0+events_unbound20:38:000
3447129994337,4cyclictest3535290-21kworker/u8:2+events_unbound23:28:232
3447129994337,4cyclictest3535290-21kworker/u8:2+events_unbound23:28:222
3447121994336,4cyclictest3482186-21idleruntime-cro20:50:000
3447129994228,11cyclictest3501156-21cron21:45:012
3447129994227,11cyclictest3450844-21grep19:15:262
3447124994130,6cyclictest3503520-21cut21:50:171
3447129994013,10cyclictest3484950-21/usr/sbin/munin20:55:252
3447129994012,9cyclictest3512181-21chrt22:15:192
3447121994033,4cyclictest3513301-21auditctl22:20:010
3447121994025,4cyclictest131rcu_preempt23:37:040
3447121994021,11cyclictest3543004-21kworker/u8:2-events_freezable_power_23:49:360
344712999399,10cyclictest3524321-21ntpq22:50:212
3447124993927,8cyclictest0-21swapper/122:45:011
3447129993830,3cyclictest0-21swapper/221:05:172
3447129993810,9cyclictest3463269-21sed19:55:012
3447121993830,5cyclictest3506471-21cron22:00:010
3447121993830,5cyclictest3506471-21cron22:00:000
344713499373,4cyclictest131rcu_preempt19:35:133
3447124993729,5cyclictest231ktimers/123:05:121
3447124993727,7cyclictest3547843-21sendmail00:00:001
3447121993731,4cyclictest3523310-21kworker/u8:2+events_unbound22:53:180
3447134993626,7cyclictest3479167-21fschecks_count20:40:133
3447134993626,6cyclictest3468317-21auditctl20:10:013
3447134993626,4cyclictest0-21swapper/300:40:013
3447129993626,6cyclictest3466608-21cron20:05:002
3447129993620,12cyclictest3516950-21apt-get22:30:102
3447124993627,6cyclictest3554251-21grep00:15:291
3447121993630,4cyclictest3454359-21kworker/u8:2+events_unbound19:57:570
3447121993627,6cyclictest3546543-21fschecks_count23:55:160
3447121993616,4cyclictest131rcu_preempt21:05:480
3447129993522,9cyclictest3502627-21grep21:45:292
344712199356,13cyclictest11-21ksoftirqd/019:45:170
3447121993520,4cyclictest131rcu_preempt23:22:250
3447121993520,4cyclictest131rcu_preempt19:21:300
3447121993516,3cyclictest131rcu_preempt00:33:370
3447121993515,5cyclictest0-21swapper/000:38:120
344712199351,25cyclictest11-21ksoftirqd/023:00:000
3447121993511,6cyclictest11-21ksoftirqd/021:00:010
3447134993427,4cyclictest0-21swapper/321:40:003
344713499342,4cyclictest131rcu_preempt22:45:163
3447129993427,4cyclictest0-21swapper/221:50:262
3447129993426,4cyclictest3556390-21munin-plugin-st00:25:002
3447129993410,9cyclictest3509505-21users22:05:242
3447124993425,5cyclictest0-21swapper/122:45:251
3447124993423,7cyclictest0-21swapper/122:05:251
3447124993422,9cyclictest231ktimers/121:45:131
3447124993422,8cyclictest3552536-21grep00:10:271
344712199342,24cyclictest0-21swapper/021:54:230
3447121993421,5cyclictest131rcu_preempt19:15:020
3447121993417,4cyclictest131rcu_preempt20:44:570
3447121993416,4cyclictest131rcu_preempt19:50:140
3447121993415,11cyclictest131rcu_preempt23:40:250
3447121993414,9cyclictest131rcu_preempt23:50:450
3447121993414,4cyclictest131rcu_preempt20:10:170
344712199341,25cyclictest11-21ksoftirqd/023:20:010
3447134993325,5cyclictest3545649-21kworker/u8:3+events_unbound00:10:423
3447134993325,4cyclictest0-21swapper/323:30:153
3447129993320,10cyclictest3546419-21/usr/sbin/munin23:55:132
3447129993320,10cyclictest3457447-21/usr/sbin/munin19:35:252
3447129993318,7cyclictest3474017-21/usr/sbin/munin20:25:162
3447124993322,7cyclictest3452510-21grep19:20:251
3447121993324,4cyclictest131rcu_preempt20:23:160
3447121993320,5cyclictest131rcu_preempt19:30:150
3447121993314,3cyclictest131rcu_preempt21:35:470
3447121993312,5cyclictest131rcu_preempt20:09:220
3447134993225,5cyclictest3545649-21kworker/u8:3+events_unbound00:07:193
3447134993222,6cyclictest3504315-21grep21:50:273
344713499321,5cyclictest0-21swapper/320:55:143
344712999326,9cyclictest3526033-21ntp_states22:55:192
344712999326,6cyclictest0-21swapper/219:55:262
3447129993222,7cyclictest3460370-21/usr/sbin/munin19:45:202
3447129993221,8cyclictest3522710-21/usr/sbin/munin22:45:252
3447129993219,10cyclictest3554527-21sshd00:18:332
3447129993219,10cyclictest3551751-21/usr/sbin/munin00:10:192
3447129993219,10cyclictest3520820-21/usr/sbin/munin22:40:192
3447129993213,10cyclictest311ktimers/221:30:132
3447129993210,5cyclictest3493442-21ntp_states21:20:222
3447124993223,6cyclictest0-21swapper/100:25:011
3447124993221,7cyclictest3494336-21sh21:25:011
3447121993226,4cyclictest3511322-21kworker/u8:1+events_unbound22:48:160
3447121993214,5cyclictest131rcu_preempt21:30:200
3447121993214,3cyclictest131rcu_preempt22:20:220
3447121993212,5cyclictest131rcu_preempt00:15:150
3447121993212,3cyclictest131rcu_preempt22:35:180
344713499314,5cyclictest131rcu_preempt19:50:113
3447134993125,4cyclictest3495900-21kworker/u8:2+events_unbound22:12:373
3447134993124,4cyclictest3456365-21cron19:35:003
3447134993124,4cyclictest0-21swapper/321:30:013
3447134993123,4cyclictest0-21swapper/322:40:153
3447134993121,7cyclictest391ktimers/319:10:073
3447129993123,4cyclictest0-21swapper/223:20:172
3447129993123,4cyclictest0-21swapper/219:30:012
3447129993121,7cyclictest3478582-21cron20:38:002
3447129993119,9cyclictest3559465-21sshd00:31:212
3447129993119,9cyclictest3550352-21/usr/sbin/munin00:05:232
3447129993118,10cyclictest3479345-21/usr/sbin/munin20:40:172
3447124993123,4cyclictest0-21swapper/120:35:271
3447124993120,7cyclictest0-21swapper/121:35:241
3447121993124,5cyclictest3511322-21kworker/u8:1+events_unbound23:32:420
3447121993118,5cyclictest131rcu_preempt23:10:220
3447121993115,5cyclictest131rcu_preempt22:40:170
3447121993113,11cyclictest3457774-21kworker/u8:1-events_freezable_power_20:17:430
3447121993113,11cyclictest131rcu_preempt21:15:270
3447121993112,11cyclictest131rcu_preempt21:45:280
3447121993112,11cyclictest131rcu_preempt21:40:250
3447121993111,4cyclictest131rcu_preempt20:51:470
3447121993110,4cyclictest131rcu_preempt21:14:300
344713499303,5cyclictest131rcu_preempt19:20:123
344713499302,4cyclictest131rcu_preempt22:35:123
3447134993022,4cyclictest0-21swapper/323:55:253
3447134993022,4cyclictest0-21swapper/300:20:153
344712999309,12cyclictest32-21ksoftirqd/221:39:232
3447129993023,4cyclictest3513553-21apt-get22:20:142
3447129993020,7cyclictest3490522-21cron21:13:012
3447129993020,7cyclictest3476314-21/usr/sbin/munin20:30:252
3447129993020,7cyclictest3472493-21/usr/sbin/munin20:20:192
3447129993020,7cyclictest3467411-21/usr/sbin/munin20:05:212
3447129993020,7cyclictest3459702-21cron19:44:002
3447129993019,8cyclictest3494914-21/usr/sbin/munin21:25:182
3447129993019,8cyclictest3452629-21cron19:21:012
3447129993018,9cyclictest3540968-21/usr/sbin/munin23:40:162
3447129993018,9cyclictest3510241-21df_inode22:10:152
3447129993018,9cyclictest3492389-21sshd21:17:222
3447129993018,8cyclictest3561495-21basename00:40:012
3447129993015,11cyclictest3447465-21apt-get19:10:062
3447129993014,11cyclictest3532840-21ntpq23:15:212
3447124993022,4cyclictest0-21swapper/123:35:231
3447124993022,4cyclictest0-21swapper/119:15:261
3447124993021,6cyclictest0-21swapper/122:30:001
3447124993021,5cyclictest0-21swapper/120:00:281
3447124993020,6cyclictest3543751-21grep23:45:281
3447124993019,7cyclictest3457626-21grep19:35:271
3447124993010,3cyclictest3500281-21awk21:40:231
344712199309,13cyclictest11-21ksoftirqd/019:15:210
3447121993017,5cyclictest131rcu_preempt22:05:220
3447121993015,4cyclictest131rcu_preempt22:11:200
3447121993014,5cyclictest131rcu_preempt21:30:010
3447121993013,9cyclictest131rcu_preempt00:25:190
3447121993012,4cyclictest131rcu_preempt19:35:190
3447121993012,10cyclictest131rcu_preempt20:00:230
3447121993012,10cyclictest131rcu_preempt19:40:170
3447121993011,12cyclictest11-21ksoftirqd/020:30:230
3447121993010,12cyclictest131rcu_preempt00:20:230
344713499292,5cyclictest131rcu_preempt20:20:133
3447134992923,4cyclictest3471627-21kworker/u8:3+events_unbound20:27:413
3447134992922,5cyclictest3446943-21kworker/u8:0+events_unbound19:26:433
3447134992922,4cyclictest3451259-21cron19:20:013
3447134992922,4cyclictest0-21swapper/300:30:283
3447134992921,5cyclictest3463079-21kworker/u8:0+events_unbound19:55:183
3447134992921,4cyclictest0-21swapper/321:15:273
3447129992919,7cyclictest3530592-21apt-get23:10:112
3447129992919,7cyclictest3519405-21sensors_temp22:35:232
3447129992919,7cyclictest3485944-21df_inode21:00:152
3447129992919,7cyclictest3482519-21df20:50:162
3447129992919,7cyclictest3469842-21cron20:13:012
3447129992919,7cyclictest3455535-21/usr/sbin/munin19:30:212
3447129992917,9cyclictest3529620-21/usr/sbin/munin23:05:232
3447129992916,9cyclictest3543225-21sed23:45:232
3447129992915,11cyclictest3557150-21ntpq00:25:232
3447129992914,12cyclictest3506722-21runrttasks22:00:102
3447129992912,14cyclictest3537904-21missed_timers23:30:202
3447129992911,15cyclictest3505010-21dpkg21:55:112
3447129992911,15cyclictest3505010-21dpkg21:55:102
3447124992921,4cyclictest0-21swapper/122:40:011
3447124992921,4cyclictest0-21swapper/121:15:011
344712199299,3cyclictest131rcu_preempt21:00:260
344712199299,12cyclictest11-21ksoftirqd/022:25:230
3447121992923,4cyclictest3511322-21kworker/u8:1+events_unbound22:34:060
3447121992914,9cyclictest131rcu_preempt00:01:480
3447121992912,5cyclictest131rcu_preempt20:28:180
3447121992911,11cyclictest131rcu_preempt21:20:170
3447134992822,4cyclictest3478702-21kworker/u8:3+events_unbound21:10:123
3447134992821,4cyclictest0-21swapper/320:50:303
3447134992820,4cyclictest0-21swapper/300:30:003
3447129992822,3cyclictest3515254-21apt-get22:25:132
3447129992822,3cyclictest3470461-21apt-get20:15:132
3447129992817,8cyclictest3548202-21/usr/sbin/munin00:00:132
3447129992817,8cyclictest3527921-21/usr/sbin/munin23:00:252
3447129992816,8cyclictest3480830-21/usr/sbin/munin20:45:182
344712499286,4cyclictest3477059-21ls20:35:011
3447124992819,4cyclictest0-21swapper/121:00:271
3447121992816,4cyclictest131rcu_preempt23:00:140
3447121992814,5cyclictest131rcu_preempt00:05:160
3447121992812,10cyclictest131rcu_preempt23:05:220
344712199281,15cyclictest0-21swapper/019:28:050
344712199281,15cyclictest0-21swapper/000:10:160
3447134992721,3cyclictest0-21swapper/319:50:013
3447134992719,4cyclictest0-21swapper/323:00:273
3447134992716,7cyclictest3517936-21grep22:30:223
3447124992721,3cyclictest0-21swapper/119:30:231
3447124992720,4cyclictest3488997-21sh21:10:001
3447134992620,4cyclictest3457774-21kworker/u8:1+events_unbound20:17:413
3447134992619,5cyclictest3501020-21kworker/u8:0+events_unbound21:48:083
3447134992619,4cyclictest3507266-21ntpq22:00:213
3447134992619,4cyclictest0-21swapper/322:20:273
3447134992618,6cyclictest3457774-21kworker/u8:1+events_unbound20:10:173
3447134992618,5cyclictest0-21swapper/323:40:193
3447134992617,6cyclictest3506476-21cron22:00:013
3447134992617,6cyclictest3506476-21cron22:00:013
3447134992615,8cyclictest40-21ksoftirqd/320:00:203
3447124992619,4cyclictest3561486-21munin-plugin-st00:40:001
3447124992619,3cyclictest0-21swapper/123:20:001
3447124992613,8cyclictest3545935-21dpkg23:55:011
344713499255,9cyclictest35398892sshd23:35:233
3447134992519,4cyclictest3535290-21kworker/u8:2+events_unbound23:25:573
3447134992519,4cyclictest3535290-21kworker/u8:2+events_unbound23:25:573
3447134992519,4cyclictest3511322-21kworker/u8:1+events_unbound23:09:123
3447134992518,5cyclictest3549444-21kworker/u8:2+events_unbound00:04:253
3447134992518,5cyclictest3485237-21kworker/u8:1+events_unbound21:04:093
3447134992517,5cyclictest0-21swapper/323:50:273
3447134992516,6cyclictest0-21swapper/323:20:013
344713499250,3cyclictest131rcu_preempt22:25:133
3447124992517,4cyclictest0-21swapper/123:40:161
3447124992517,4cyclictest0-21swapper/122:00:251
3447124992516,6cyclictest231ktimers/123:20:131
3447124992515,6cyclictest0-21swapper/120:25:271
3447134992418,3cyclictest0-21swapper/300:15:223
3447134992416,5cyclictest0-21swapper/322:55:223
3447124992418,3cyclictest0-21swapper/122:55:141
3447124992417,4cyclictest231ktimers/121:15:141
3447124992417,4cyclictest0-21swapper/120:15:001
3447124992417,3cyclictest0-21swapper/120:15:251
3447124992417,3cyclictest0-21swapper/119:50:241
3447124992416,5cyclictest0-21swapper/120:05:231
3447124992416,4cyclictest0-21swapper/122:30:141
3447124992416,3cyclictest0-21swapper/100:00:201
3447124992414,7cyclictest0-21swapper/121:35:001
3447134992317,4cyclictest3530217-21kworker/u8:0+events_unbound23:10:593
3447134992317,3cyclictest0-21swapper/322:50:233
3447134992317,3cyclictest0-21swapper/321:40:193
3447134992315,4cyclictest0-21swapper/320:35:013
3447134992314,7cyclictest3530217-21kworker/u8:0+events_unbound23:24:453
3447124992316,4cyclictest0-21swapper/119:55:261
3447124992312,8cyclictest3524851-21users22:50:251
3447124992312,7cyclictest0-21swapper/119:40:241
3447124992311,7cyclictest0-21swapper/123:25:251
3447124992311,7cyclictest0-21swapper/123:25:251
3447134992216,4cyclictest391ktimers/322:15:133
3447134992216,3cyclictest0-21swapper/320:45:213
3447134992215,5cyclictest3495900-21kworker/u8:2+events_unbound22:08:113
3447134992215,5cyclictest145-21jbd2/mmcblk1p2-819:40:213
3447134992215,4cyclictest3477844-21ntpq20:35:243
3447134992215,4cyclictest0-21swapper/323:45:293
3447134992213,6cyclictest40-21ksoftirqd/321:05:153
3447124992216,3cyclictest0-21swapper/123:30:141
3447124992216,3cyclictest0-21swapper/120:50:231
3447124992216,3cyclictest0-21swapper/100:25:261
3447124992215,4cyclictest3550002-21fschecks_time00:05:171
3447124992214,5cyclictest231ktimers/121:25:141
3447124992212,7cyclictest3482177-21apt20:50:011
3447124992212,7cyclictest3480009-21grep20:40:231
344712499221,18cyclictest3559438-21seq00:31:011
3447124992115,3cyclictest0-21swapper/122:15:191
3447124992113,5cyclictest0-21swapper/123:05:011
3447124992113,5cyclictest0-21swapper/122:20:161
3447124992112,4cyclictest0-21swapper/119:25:261
3447124992111,7cyclictest0-21swapper/123:10:191
3447124992013,4cyclictest0-21swapper/120:55:161
3447124991911,5cyclictest0-21swapper/121:55:141
3447124991911,5cyclictest0-21swapper/121:55:141
3447124991812,4cyclictest3472183-21/usr/sbin/munin20:20:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional