You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 09:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Jun 03, 2026 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3725570995239,9cyclictest311ktimers/200:05:162
3725561995035,12cyclictest121ktimers/023:20:130
3725574994837,7cyclictest3762363-21grep21:00:273
3725570994839,6cyclictest3731159-21cut19:30:122
3725570994738,5cyclictest3795391-21munin-plugin-st22:40:002
3725570994639,5cyclictest3745014-21kworker/u8:0+events_unbound20:27:182
372557499455,24cyclictest3730969-21cat19:30:023
3725574994535,5cyclictest3733128-21cron19:40:013
372557499451,39cyclictest0-21swapper/300:00:133
372557499451,36cyclictest0-21swapper/319:30:083
3725570994539,4cyclictest3755477-21kworker/u8:1+events_unbound20:52:232
3725565994536,5cyclictest3809445-21cron23:20:001
3725565994536,5cyclictest3809445-21cron23:19:591
3725574994417,23cyclictest0-21swapper/322:10:243
372557499441,38cyclictest3825504-21/usr/sbin/munin00:05:243
372557499441,37cyclictest3830613-21/usr/sbin/munin00:20:203
3725574994330,9cyclictest3748247-21grep20:20:263
372557499431,39cyclictest3771834-21/usr/sbin/munin21:30:313
372557499431,37cyclictest3744122-21/usr/sbin/munin20:10:173
3725565994332,7cyclictest0-21swapper/122:10:251
372557499421,38cyclictest3754870-21/usr/sbin/munin20:40:233
372557499421,38cyclictest3751767-21/usr/sbin/munin20:30:273
372557499421,38cyclictest3749284-21/usr/sbin/munin20:25:153
372557499420,32cyclictest0-21swapper/300:10:123
3725561994233,6cyclictest3788149-21unixbench_singl22:15:250
372557499413,35cyclictest3740421-21apt-get20:00:133
372557499411,37cyclictest3728681-21/usr/sbin/munin19:20:223
372557499411,35cyclictest3803184-21/usr/sbin/munin23:00:193
3725574994111,25cyclictest3783690-21/usr/sbin/munin22:05:163
3725570994134,5cyclictest3803855-21kworker/u8:2+events_unbound23:07:452
3725570994134,4cyclictest3833337-21cron00:30:002
3725570994134,4cyclictest3802423-21sendmail23:00:012
3725570994134,4cyclictest3771316-21idleruntime-cro21:30:012
3725565994130,7cyclictest0-21swapper/121:55:251
3725561994135,4cyclictest3732134-21kworker/u8:2+events_unbound19:32:030
372557499401,36cyclictest3764834-21diskstats21:10:163
372557499401,34cyclictest3808499-21/usr/sbin/munin23:15:193
372557499401,34cyclictest3808499-21/usr/sbin/munin23:15:193
372557499401,34cyclictest3776867-21/usr/sbin/munin21:45:103
372557499401,34cyclictest3763008-21apt-get21:05:123
372557499401,34cyclictest3756280-21/usr/sbin/munin20:45:193
372557499401,34cyclictest3752803-21/usr/sbin/munin20:35:173
372557499401,30cyclictest0-21swapper/321:25:123
372557499401,22cyclictest3813100-21/usr/sbin/munin23:30:173
372557499400,37cyclictest3797546-21apt-get22:45:133
3725570994033,4cyclictest3799023-21idleruntime-cro22:50:002
3725570994031,6cyclictest3809450-21auditctl23:20:002
3725570994031,6cyclictest3809450-21auditctl23:20:002
3725565994021,5cyclictest3746760-21kworker/u8:2+events_unbound20:35:251
3725561994033,4cyclictest3829940-21sendmail00:20:000
3725574993929,5cyclictest3736547-21cron19:50:013
3725574993927,8cyclictest391ktimers/323:50:133
372557499392,34cyclictest3814804-21apt-get23:35:123
372557499391,35cyclictest3818460-21/usr/sbin/munin23:45:153
372557499391,35cyclictest3774515-21/usr/sbin/munin21:35:253
372557499391,35cyclictest3745969-21/usr/sbin/munin20:15:193
372557499391,35cyclictest3739174-21/usr/sbin/munin19:55:243
372557499391,35cyclictest3733943-21ntp_states19:40:173
372557499391,34cyclictest3828572-21diskstats00:15:173
372557499391,34cyclictest3794478-21ntp_states22:35:193
372557499391,34cyclictest3766947-21/usr/sbin/munin21:15:223
372557499391,33cyclictest3832438-21/usr/sbin/munin00:25:203
372557499391,33cyclictest3806579-21/usr/sbin/munin23:10:173
372557499391,31cyclictest3742126-21apt-get20:05:163
372557499390,37cyclictest0-21swapper/322:40:123
3725570993932,5cyclictest3803855-21kworker/u8:2+events_unbound23:27:502
3725574993824,10cyclictest391ktimers/322:50:133
372557499382,30cyclictest3804425-21/usr/sbin/munin23:05:153
372557499381,34cyclictest3817195-21/usr/sbin/munin23:40:223
372557499381,34cyclictest3811612-21/usr/sbin/munin23:25:153
372557499381,34cyclictest3809937-21/usr/sbin/munin23:20:173
372557499381,34cyclictest3792844-21/usr/sbin/munin22:30:233
372557499381,34cyclictest3790618-21df22:25:133
372557499381,34cyclictest3788813-21apt-get22:20:143
372557499381,34cyclictest3781991-21apt-get22:00:133
372557499381,34cyclictest3775445-21/usr/sbin/munin21:40:163
372557499381,34cyclictest3775445-21/usr/sbin/munin21:40:163
372557499381,34cyclictest3760048-21/usr/sbin/munin20:55:203
372557499381,34cyclictest3728347-21cron19:19:003
372557499381,32cyclictest3768138-21apt-get21:20:143
372557499381,31cyclictest3801185-21/usr/sbin/munin22:55:173
372557499381,31cyclictest0-21swapper/320:50:133
3725570993832,4cyclictest3727356-21latency_hist19:15:012
3725570993831,5cyclictest3809323-21kworker/u8:0+events_unbound23:22:512
372557499371,33cyclictest3833687-21df_inode00:30:163
372557499371,33cyclictest3833687-21df_inode00:30:163
372557499371,33cyclictest3780380-21df_inode21:55:143
372557499371,33cyclictest3779177-21proc_pri21:50:243
372557499371,33cyclictest3737235-21memory19:50:183
372557499371,31cyclictest3725804-21/usr/sbin/munin19:10:133
3725570993730,5cyclictest3752209-21kworker/u8:0+events_unbound20:42:212
3725570993730,3cyclictest0-21swapper/220:05:012
3725565993729,5cyclictest3811070-21kworker/u8:1+events_unbound23:30:411
3725565993725,8cyclictest3807274-21grep23:10:251
3725565993720,13cyclictest231ktimers/100:25:141
372557499361,31cyclictest3835277-21apt-get00:35:133
372557499361,31cyclictest3835277-21apt-get00:35:133
372557499361,30cyclictest3787087-21/usr/sbin/munin22:15:113
372557499361,29cyclictest3821628-21apt-get23:55:133
3725565993626,6cyclictest0-21swapper/119:10:251
3725570993528,5cyclictest3814216-21kworker/u8:0+events_unbound23:42:412
3725570993526,5cyclictest3765782-21unixbench_singl21:10:262
3725565993529,4cyclictest3743269-21kworker/u8:1+events_unbound20:07:111
3725565993524,7cyclictest0-21swapper/119:35:011
3725561993526,6cyclictest0-21swapper/021:00:010
3725570993426,4cyclictest0-21swapper/221:55:252
3725570993424,4cyclictest3795256-21kworker/u8:2+events_unbound22:52:442
372556599347,10cyclictest3827002-21basename00:10:161
3725565993428,4cyclictest3829726-21kworker/u8:0+events_unbound00:18:031
3725565993426,5cyclictest3810390-21sendmail_mailqu23:20:241
3725565993423,8cyclictest3744829-21grep20:10:251
3725561993426,4cyclictest0-21swapper/000:28:040
3725570993322,7cyclictest0-21swapper/220:25:002
3725565993326,5cyclictest3732134-21kworker/u8:2+events_unbound19:57:081
3725565993324,4cyclictest0-21swapper/123:55:161
3725565993323,6cyclictest0-21swapper/123:45:241
3725561993327,4cyclictest3725555-21cyclictest19:40:010
3725570993225,5cyclictest3738133-21kworker/u8:1+events_unbound19:55:242
3725570993225,4cyclictest0-21swapper/220:35:162
3725570993225,4cyclictest0-21swapper/200:10:172
3725570993224,5cyclictest3788577-21sendmail22:20:012
3725570993224,4cyclictest0-21swapper/223:55:252
3725570993224,4cyclictest0-21swapper/223:40:002
3725570993223,6cyclictest3772615-21grep21:30:392
3725565993223,5cyclictest0-21swapper/120:55:151
3725565993222,7cyclictest3785167-21munin-plugin-st22:10:011
3725565993222,6cyclictest0-21swapper/121:50:261
3725565993221,7cyclictest0-21swapper/122:05:001
3725565993215,11cyclictest131rcu_preempt23:40:111
3725561993226,3cyclictest0-21swapper/022:00:000
3725561993221,6cyclictest0-21swapper/021:30:400
3725570993123,5cyclictest0-21swapper/223:50:272
3725570993112,11cyclictest32-21ksoftirqd/222:00:272
3725565993124,4cyclictest0-21swapper/123:50:271
3725565993121,7cyclictest0-21swapper/120:50:261
3725565993121,6cyclictest0-21swapper/121:30:401
3725565993121,6cyclictest0-21swapper/100:40:001
3725565993121,6cyclictest0-21swapper/100:39:591
3725565993120,7cyclictest0-21swapper/122:30:251
372557099309,12cyclictest32-21ksoftirqd/222:30:262
372557099309,11cyclictest32-21ksoftirqd/219:20:122
372557099306,8cyclictest32-21ksoftirqd/221:55:002
3725570993022,4cyclictest0-21swapper/200:30:272
3725570993022,4cyclictest0-21swapper/200:30:272
3725570993019,7cyclictest3807295-21grep23:10:242
372557099301,5cyclictest131rcu_preempt22:05:122
3725565993023,5cyclictest3760835-21kworker/u8:0+events_unbound21:12:281
3725565993023,5cyclictest3755477-21kworker/u8:1+events_unbound21:07:261
3725565993022,5cyclictest3727088-21kworker/u8:0+events_unbound19:35:421
3725565993020,6cyclictest0-21swapper/120:30:271
3725561993022,4cyclictest0-21swapper/023:10:010
3725561993021,6cyclictest0-21swapper/023:10:160
3725561993019,6cyclictest0-21swapper/022:05:010
372557099298,17cyclictest311ktimers/221:00:012
3725570992920,5cyclictest0-21swapper/221:15:272
3725570992918,3cyclictest131rcu_preempt00:35:222
3725570992918,3cyclictest131rcu_preempt00:35:222
3725565992923,4cyclictest3799235-21kworker/u8:1+events_unbound22:51:401
3725565992923,4cyclictest3727088-21kworker/u8:0+events_unbound19:16:581
3725565992922,4cyclictest0-21swapper/120:30:011
3725565992921,5cyclictest3728797-21kworker/u8:2+events_unbound19:20:161
3725565992921,4cyclictest0-21swapper/119:45:151
3725565992920,6cyclictest0-21swapper/100:25:001
3725565992919,7cyclictest0-21swapper/122:40:251
3725561992922,4cyclictest0-21swapper/022:10:250
3725561992921,4cyclictest0-21swapper/021:27:290
3725561992920,6cyclictest3824400-21unixbench_singl00:00:290
3725561992919,6cyclictest0-21swapper/023:30:250
3725561992919,6cyclictest0-21swapper/022:35:240
3725570992823,3cyclictest3828750-21if_eth000:15:192
3725570992821,5cyclictest3750488-21kworker/u8:1+events_unbound20:32:192
3725570992820,4cyclictest3733135-21cron19:40:012
3725570992816,8cyclictest3769601-21sh21:25:012
3725570992815,3cyclictest131rcu_preempt00:20:172
3725570992810,10cyclictest131rcu_preempt21:40:252
3725570992810,10cyclictest131rcu_preempt21:40:252
3725565992821,5cyclictest3783252-21kworker/u8:3+events_unbound22:27:391
3725565992818,6cyclictest0-21swapper/122:15:251
3725565992818,6cyclictest0-21swapper/121:20:271
3725565992817,7cyclictest0-21swapper/121:35:251
3725561992822,3cyclictest0-21swapper/019:45:010
3725561992821,4cyclictest13550irq/42-30be0000.ethernet22:50:260
3725561992819,6cyclictest121ktimers/019:55:120
3725561992819,6cyclictest0-21swapper/000:15:000
3725561992818,6cyclictest0-21swapper/021:10:260
372557099276,5cyclictest3756189-21grep20:45:182
372557099275,11cyclictest0-21swapper/223:31:222
3725570992718,5cyclictest0-21swapper/219:40:122
3725570992714,5cyclictest3765652-21kworker/u8:2+events_unbound21:45:162
3725565992721,4cyclictest3778340-21kthreadd21:50:001
3725565992721,4cyclictest3743269-21kworker/u8:1+events_unbound20:18:401
3725565992717,6cyclictest0-21swapper/123:05:011
3725565992716,7cyclictest0-21swapper/120:45:261
372556199272,21cyclictest3836786-21lockfile-remove00:40:000
372556199272,21cyclictest3836786-21lockfile-remove00:40:000
3725561992721,3cyclictest0-21swapper/000:20:210
3725561992720,4cyclictest0-21swapper/021:45:000
3725561992720,4cyclictest0-21swapper/021:45:000
3725561992720,4cyclictest0-21swapper/019:50:240
3725561992717,6cyclictest0-21swapper/020:05:290
372557099268,5cyclictest3736413-21kworker/u8:0-events_freezable_power_19:49:452
372557099263,4cyclictest131rcu_preempt22:25:122
372557099262,7cyclictest32-21ksoftirqd/222:40:252
3725570992620,4cyclictest3755477-21kworker/u8:1-events_unbound21:00:172
3725570992619,5cyclictest3743269-21kworker/u8:1+events_unbound20:12:472
3725570992618,4cyclictest0-21swapper/223:45:142
372557099261,13cyclictest0-21swapper/222:10:202
372557099261,12cyclictest0-21swapper/223:03:282
372557099261,12cyclictest0-21swapper/222:20:152
372556599262,6cyclictest131rcu_preempt22:20:131
3725565992619,4cyclictest0-21swapper/122:40:001
3725565992618,6cyclictest3811070-21kworker/u8:1+events_unbound23:25:191
3725565992618,5cyclictest0-21swapper/120:20:261
3725565992618,4cyclictest0-21swapper/121:25:161
3725565992618,4cyclictest0-21swapper/119:50:151
3725565992612,3cyclictest131rcu_preempt22:47:411
3725561992620,3cyclictest0-21swapper/019:10:250
3725561992619,4cyclictest0-21swapper/020:25:050
3725561992619,3cyclictest0-21swapper/020:25:000
3725561992618,6cyclictest0-21swapper/021:20:010
3725561992618,4cyclictest0-21swapper/020:40:260
3725561992617,5cyclictest0-21swapper/020:10:250
3725561992616,6cyclictest0-21swapper/022:55:270
3725561992616,6cyclictest0-21swapper/021:45:150
3725561992615,6cyclictest0-21swapper/021:35:250
372556199261,16cyclictest3751032-21fschecks_count20:30:170
372557099252,12cyclictest0-21swapper/219:51:532
3725570992519,3cyclictest0-21swapper/221:05:162
3725570992518,5cyclictest3727088-21kworker/u8:0+events_unbound19:25:142
372556599259,9cyclictest131rcu_preempt23:40:011
3725565992518,5cyclictest3817662-21kworker/u8:2+events_unbound00:03:421
3725565992518,5cyclictest3755477-21kworker/u8:1+events_unbound20:44:431
3725565992516,6cyclictest0-21swapper/100:05:291
3725561992519,3cyclictest3816295-21sendmail23:40:010
3725561992518,4cyclictest13550irq/42-30be0000.ethernet00:30:270
3725561992518,4cyclictest13550irq/42-30be0000.ethernet00:30:270
372556199251,5cyclictest3745524-21apt-get20:15:140
372557099246,3cyclictest131rcu_preempt20:05:182
3725570992412,9cyclictest311ktimers/220:15:142
372557099241,12cyclictest0-21swapper/200:00:232
372556599247,9cyclictest131rcu_preempt19:40:191
3725565992417,5cyclictest3799235-21kworker/u8:1+events_unbound22:59:121
3725565992415,6cyclictest0-21swapper/123:05:281
372556199242,18cyclictest3728444-21munin-run19:20:000
3725561992418,4cyclictest3774705-21kworker/u8:3+events_unbound21:52:340
372556199241,7cyclictest3809442-21cron23:20:000
372556199241,7cyclictest3809442-21cron23:20:000
3725561992417,3cyclictest0-21swapper/023:00:150
3725561992417,3cyclictest0-21swapper/021:03:000
3725561992415,6cyclictest0-21swapper/022:45:000
3725561992413,7cyclictest0-21swapper/023:45:190
372556199241,19cyclictest0-21swapper/021:23:290
372556199241,19cyclictest0-21swapper/020:52:300
372556199241,19cyclictest0-21swapper/020:02:510
372556199240,22cyclictest3788813-21apt-get22:20:130
3725570992316,3cyclictest0-21swapper/219:20:002
3725565992317,3cyclictest0-21swapper/100:30:181
3725565992317,3cyclictest0-21swapper/100:30:181
3725565992314,6cyclictest0-21swapper/121:05:001
372556199236,5cyclictest131rcu_preempt21:05:120
3725561992318,3cyclictest3792401-21fschecks_time22:30:160
3725561992318,3cyclictest0-21swapper/022:45:060
3725561992317,4cyclictest3825235-21fschecks_time00:05:200
3725561992316,3cyclictest3757436-21cron20:50:010
3725561992313,6cyclictest0-21swapper/023:50:160
372556199231,19cyclictest0-21swapper/019:25:420
372556199231,10cyclictest3728683-21apt19:20:080
372556199230,19cyclictest0-21swapper/022:26:040
372556199230,19cyclictest0-21swapper/022:09:450
372556199225,11cyclictest13550irq/42-30be0000.ethernet23:55:120
3725561992216,4cyclictest3817662-21kworker/u8:2+events_unbound23:42:530
372556199220,2cyclictest0-21swapper/020:35:200
372556199220,18cyclictest0-21swapper/023:26:170
3725565992116,3cyclictest0-21swapper/121:40:201
3725565992116,3cyclictest0-21swapper/121:40:191
3725565992114,5cyclictest3727088-21kworker/u8:0+events_unbound19:29:031
3725565992112,5cyclictest0-21swapper/121:15:181
3725561992115,3cyclictest3735286-21fschecks_time19:45:160
372556599207,7cyclictest131rcu_preempt20:00:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional