You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 22:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Thu Apr 02, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3499735995746,7cyclictest1-21systemd07:35:111
3499735995632,20cyclictest0-21swapper/109:35:351
3499735994923,22cyclictest0-21swapper/110:10:251
3499743994839,6cyclictest3505997-21fschecks_count07:35:113
3499735994740,4cyclictest3559346-21cron10:20:011
3499735994719,25cyclictest3529498-21unixbench_singl08:50:241
3499730994738,5cyclictest3576614-21munin-plugin-st11:10:010
3499730994735,9cyclictest121ktimers/011:15:110
3499743994638,5cyclictest3538462-21munin-plugin-st09:20:013
3499743994617,12cyclictest3581766-21date11:25:013
3499743994535,6cyclictest3531212-21grep08:55:243
3499743994521,9cyclictest3557980-21df_inode10:15:143
3499743994520,10cyclictest3568481-21wc10:45:163
3499739994531,9cyclictest311ktimers/212:05:142
3499735994526,16cyclictest3566151-21cron10:40:001
3499743994416,10cyclictest3545040-21chrt09:37:153
3499730994436,5cyclictest3555730-21munin-plugin-st10:10:010
3499739994331,8cyclictest3536741-21sh09:15:002
349973599433,6cyclictest3538114-21cron09:16:001
349973599431,7cyclictest3504637-21sshd07:25:501
349973599431,10cyclictest3578650-21/usr/sbin/munin11:15:131
3499730994337,4cyclictest3546873-21kworker/u8:2+events_unbound09:45:360
3499730994337,4cyclictest3546873-21kworker/u8:2+events_unbound09:45:360
349973599423,6cyclictest3502445-21cron07:18:011
3499735994220,18cyclictest0-21swapper/111:55:001
349973599421,5cyclictest3542768-21/usr/sbin/munin09:30:231
3499730994234,4cyclictest3521413-21idleruntime-cro08:30:010
3499730994231,7cyclictest3577884-21grep11:10:250
3499743994126,11cyclictest3603805-21/usr/sbin/munin12:25:223
349973599413,4cyclictest3539999-21cron09:23:011
3499735994128,10cyclictest231ktimers/112:05:121
349973599411,8cyclictest3590416-21cron11:46:591
349973599411,6cyclictest3581642-21sshd11:24:001
3499735994115,22cyclictest0-21swapper/111:00:261
349973599411,10cyclictest3570549-21grep10:50:231
349973599411,10cyclictest3570549-21grep10:50:231
3499743994031,6cyclictest3573416-21fschecks_time11:00:163
3499743994026,11cyclictest3548342-21/usr/sbin/munin09:45:243
3499743994026,11cyclictest3548342-21/usr/sbin/munin09:45:243
3499743994026,10cyclictest3588125-21/usr/sbin/munin11:40:233
3499743994024,11cyclictest3563327-21/usr/sbin/munin10:30:163
3499739994032,4cyclictest0-21swapper/208:40:012
3499735994030,7cyclictest3512878-21cron08:05:001
3499735994028,8cyclictest3561051-21sh10:25:001
349973599401,8cyclictest3546655-21cron09:41:011
349973599401,7cyclictest53-21kcompactd008:26:331
349973599401,6cyclictest3566748-21/usr/sbin/munin10:40:171
3499735994014,22cyclictest0-21swapper/109:25:251
3499735994010,27cyclictest0-21swapper/111:40:241
349973099400,9cyclictest11-21ksoftirqd/007:55:090
3499743993932,4cyclictest3523095-21cron08:35:013
3499743993929,7cyclictest3549187-21/usr/sbin/munin09:50:133
3499743993929,7cyclictest3549187-21/usr/sbin/munin09:50:123
3499743993929,7cyclictest3511098-21/usr/sbin/munin07:55:143
3499743993928,6cyclictest0-21swapper/308:44:593
3499743993926,10cyclictest3508603-21/usr/sbin/munin07:45:123
3499743993925,11cyclictest3589205-21apt-get11:45:113
3499743993924,11cyclictest0-21swapper/312:05:133
3499743993923,12cyclictest3526876-21/usr/sbin/munin08:45:153
3499743993923,12cyclictest3526876-21/usr/sbin/munin08:45:153
3499743993923,11cyclictest3523451-21df_inode08:35:143
3499743993920,14cyclictest3500501-21munin-node07:15:023
3499743993915,9cyclictest645-21runrttasks09:29:213
3499743993914,10cyclictest3501295-21fschecks_count07:15:123
349973599392,4cyclictest3549131-21/usr/sbin/munin09:50:201
349973599392,4cyclictest3549131-21/usr/sbin/munin09:50:201
349973599392,11cyclictest3548900-21sh09:50:001
349973599392,11cyclictest3548900-21sh09:49:591
349973599391,9cyclictest3517536-21grep08:15:241
349973599391,8cyclictest3605824-21/usr/sbin/munin12:30:251
349973599391,8cyclictest3509465-21head07:45:211
349973599391,7cyclictest3561286-21/usr/sbin/munin10:25:161
349973599391,6cyclictest3576845-21/usr/sbin/munin11:10:131
349973599391,6cyclictest3553109-21/usr/sbin/munin10:00:201
349973599391,5cyclictest3585782-21/usr/sbin/munin11:35:161
349973599391,5cyclictest3554788-21ntpq10:05:191
349973599391,5cyclictest3514155-21grep08:05:201
3499730993931,4cyclictest3601120-21sendmail12:19:590
3499730993929,4cyclictest0-21swapper/010:45:460
3499743993831,4cyclictest3564690-21apt-get10:35:123
3499743993828,6cyclictest3606796-21/usr/sbin/munin12:35:173
3499743993827,8cyclictest3560271-21/usr/sbin/munin10:20:223
3499743993826,9cyclictest3584309-21/usr/sbin/munin11:30:173
3499743993826,9cyclictest3554948-21/usr/sbin/munin10:05:233
3499743993824,11cyclictest3534871-21cron09:08:013
3499743993824,11cyclictest3503647-21/usr/sbin/munin07:25:123
3499743993820,13cyclictest3553182-21/usr/sbin/munin10:00:223
349973599386,3cyclictest0-21swapper/112:23:541
349973599382,6cyclictest3603192-21fschecks_count12:25:141
349973599381,9cyclictest3594531-21/usr/sbin/munin12:00:141
349973599381,9cyclictest3594531-21/usr/sbin/munin12:00:141
349973599381,9cyclictest3535035-21cron09:10:011
349973599381,9cyclictest3531615-21cron09:00:001
349973599381,8cyclictest3593499-21/usr/sbin/munin11:55:241
349973599381,8cyclictest3593499-21/usr/sbin/munin11:55:241
349973599381,8cyclictest3525212-21cut08:40:151
349973599381,6cyclictest3563100-21/usr/sbin/munin10:30:131
3499735993814,22cyclictest3518234-21/usr/sbin/munin08:20:211
349973599381,11cyclictest3536263-21grep09:10:271
3499743993728,4cyclictest0-21swapper/308:20:163
3499743993727,7cyclictest3570258-21/usr/sbin/munin10:50:193
3499743993727,7cyclictest3570258-21/usr/sbin/munin10:50:193
3499743993727,7cyclictest3538978-21/usr/sbin/munin09:20:163
3499743993727,6cyclictest3515052-21/usr/sbin/munin08:10:163
3499743993726,8cyclictest3586695-21/usr/sbin/munin11:35:253
3499743993725,9cyclictest3605880-21cron12:31:003
3499743993725,8cyclictest3516628-21df_inode08:15:133
3499743993724,10cyclictest3533089-21cron09:02:003
3499743993723,11cyclictest3513982-21/usr/sbin/munin08:05:203
3499743993719,15cyclictest3582981-21unixbench_multi11:25:253
349973599375,5cyclictest3585606-21latency_hist11:35:011
349973599374,4cyclictest3571645-21fschecks_count10:55:151
349973599374,4cyclictest3571645-21fschecks_count10:55:141
349973599371,9cyclictest3598046-21/usr/sbin/munin12:10:121
349973599371,9cyclictest3575582-21/usr/sbin/munin11:05:191
349973599371,9cyclictest3551068-21/usr/sbin/munin09:55:151
349973599371,8cyclictest3600773-21sshd12:16:071
349973599371,7cyclictest3527969-21cron08:47:001
349973599371,7cyclictest3527969-21cron08:47:001
349973599371,6cyclictest3515265-21memory08:10:201
349973599371,6cyclictest3510863-21df07:55:101
349973599371,5cyclictest3510442-21seq07:54:021
349973599371,10cyclictest3522672-21sed08:30:251
3499743993630,3cyclictest3594535-21apt-get12:00:113
3499743993630,3cyclictest3594535-21apt-get12:00:113
3499743993627,6cyclictest3566589-21/usr/sbin/munin10:40:153
3499743993626,7cyclictest3601873-21/usr/sbin/munin12:20:203
3499743993626,7cyclictest3593263-21/usr/sbin/munin11:55:203
3499743993626,7cyclictest3593263-21/usr/sbin/munin11:55:193
3499743993626,7cyclictest3571598-21/usr/sbin/munin10:55:143
3499743993626,7cyclictest3571598-21/usr/sbin/munin10:55:143
3499743993626,7cyclictest3556278-21df_inode10:10:153
3499743993625,8cyclictest3552127-21sshd09:57:593
3499743993625,7cyclictest3599396-21sh12:15:003
3499743993624,9cyclictest3592119-21sshd11:52:013
3499743993623,8cyclictest3546575-21unixbench_singl09:40:243
3499743993622,9cyclictest3542198-21/usr/sbin/munin09:30:123
3499743993622,8cyclictest3578536-21/usr/sbin/munin11:15:143
3499743993619,13cyclictest3536264-21grep09:10:273
3499739993628,4cyclictest0-21swapper/212:15:132
3499739993625,7cyclictest3504540-21grep07:25:212
349973599365,5cyclictest3531989-21df_inode09:00:151
349973599362,5cyclictest164-21systemd-journal07:30:091
349973599361,7cyclictest53-21kcompactd007:21:001
349973599361,6cyclictest3581962-21/usr/sbin/munin11:25:241
349973599361,10cyclictest3568294-21fschecks_time10:45:151
349973099362,6cyclictest131rcu_preempt08:05:070
3499730993625,7cyclictest3602816-21sh12:25:010
3499743993526,6cyclictest3507921-21sshd07:41:493
3499743993524,8cyclictest3577380-21ntp_kernel_pll_11:10:203
3499743993524,8cyclictest3502865-21sshd07:20:093
3499743993524,7cyclictest3599626-21/usr/sbin/munin12:15:073
3499743993523,8cyclictest3561289-21/usr/sbin/munin10:25:113
3499739993525,7cyclictest0-21swapper/208:55:002
3499739993524,7cyclictest3552782-21tune2fs10:00:152
349973599353,4cyclictest3606791-21irqstats12:35:171
349973599351,8cyclictest3500070-21seq07:12:121
349973599351,6cyclictest3523454-21diskstats08:35:151
349973599351,10cyclictest3508195-21idleruntime-cro07:45:011
3499730993528,4cyclictest3594287-21cron12:00:000
3499730993528,4cyclictest3594287-21cron12:00:000
3499730993528,3cyclictest0-21swapper/010:40:000
3499730993525,4cyclictest0-21swapper/012:05:000
3499730993525,4cyclictest0-21swapper/012:05:000
3499743993424,7cyclictest3529027-21ntp_states08:50:213
3499743993423,8cyclictest3519937-21apt-get08:25:123
3499743993419,12cyclictest3512578-21seq08:01:223
3499739993426,4cyclictest0-21swapper/210:25:392
3499739993426,4cyclictest0-21swapper/209:10:012
3499739993424,6cyclictest0-21swapper/209:59:592
3499730993427,4cyclictest3527847-21kworker/u8:1+events_unbound09:42:410
3499730993423,8cyclictest151rcuc/009:05:120
3499730993423,7cyclictest0-21swapper/011:30:000
3499730993423,6cyclictest0-21swapper/011:35:250
3499743993312,8cyclictest645-21runrttasks07:31:393
3499730993324,5cyclictest3607939-21idleruntime-cro12:40:000
3499739993224,4cyclictest0-21swapper/212:25:222
3499730993224,4cyclictest0-21swapper/007:30:010
3499730993221,6cyclictest0-21swapper/012:25:230
3499730993220,8cyclictest3507345-21sendmail07:40:010
3499730993220,8cyclictest0-21swapper/008:35:010
349973099321,5cyclictest131rcu_preempt09:30:100
3499743993111,7cyclictest645-21runrttasks07:51:193
349973999316,4cyclictest35730022basename11:00:002
349973999316,4cyclictest35730022basename11:00:002
3499739993122,5cyclictest3574294-21head11:00:262
3499739993121,7cyclictest3543572-21auditctl09:35:012
3499739993119,8cyclictest3502154-21grep07:15:202
3499730993124,3cyclictest0-21swapper/008:55:240
3499730993120,7cyclictest3541860-21cron09:30:000
3499730993119,9cyclictest0-21swapper/010:05:000
349973099311,4cyclictest35167452cut08:15:150
3499739993021,6cyclictest0-21swapper/208:45:002
3499739993021,4cyclictest0-21swapper/211:20:562
3499739993019,7cyclictest1-21systemd12:11:062
3499730993023,4cyclictest3589418-21fschecks_time11:45:160
3499730993018,5cyclictest0-21swapper/009:35:180
3499730993012,4cyclictest151rcuc/010:55:000
3499730993012,4cyclictest151rcuc/010:55:000
349973099300,5cyclictest131rcu_preempt08:40:120
3499739992922,5cyclictest3546873-21kworker/u8:2+events_unbound10:15:392
3499739992922,4cyclictest3586835-21grep11:35:252
3499739992921,4cyclictest0-21swapper/209:50:252
3499739992921,4cyclictest0-21swapper/209:50:252
3499739992920,5cyclictest0-21swapper/210:10:022
3499739992919,5cyclictest0-21swapper/209:45:352
3499739992919,5cyclictest0-21swapper/209:45:352
3499730992923,3cyclictest0-21swapper/007:45:130
349973099291,6cyclictest3606215-21cron12:35:010
349973099291,4cyclictest131rcu_preempt09:55:110
3499739992823,3cyclictest0-21swapper/210:15:012
3499739992822,3cyclictest0-21swapper/208:10:242
3499739992821,4cyclictest1-21systemd07:20:082
3499739992818,7cyclictest3567463-21grep10:40:242
3499730992820,4cyclictest0-21swapper/010:55:250
3499730992820,4cyclictest0-21swapper/010:55:250
3499730992813,7cyclictest3499283-21kworker/u8:0+events_unbound07:32:510
3499739992720,4cyclictest3518021-21idleruntime-cro08:20:002
3499739992720,4cyclictest0-21swapper/212:00:242
3499739992720,4cyclictest0-21swapper/212:00:232
3499739992718,5cyclictest0-21swapper/210:50:252
3499739992718,5cyclictest0-21swapper/210:50:242
349973099278,10cyclictest11-21ksoftirqd/011:50:210
3499739992619,3cyclictest0-21swapper/211:10:222
3499739992618,4cyclictest3544013-21fschecks_time09:35:162
3499739992617,6cyclictest3526935-21grep08:45:152
3499739992617,6cyclictest3526935-21grep08:45:152
349973099269,14cyclictest11-21ksoftirqd/011:00:130
3499730992622,2cyclictest13550irq/42-30be0000.ethernet09:00:250
3499730992620,4cyclictest3572690-21kworker/u8:1+events_unbound12:14:430
3499730992620,4cyclictest3520173-21kworker/u8:0+events_unbound10:10:040
3499730992619,5cyclictest3527847-21kworker/u8:1+events_unbound09:21:440
3499730992619,5cyclictest3499283-21kworker/u8:0+events_unbound07:11:320
3499730992619,4cyclictest3585461-21latency_hist11:35:000
3499730992619,3cyclictest13850irq/36-mmc110:20:000
3499730992617,5cyclictest3597706-21idleruntime-cro12:10:000
3499730992616,6cyclictest3588514-21grep11:40:250
3499730992610,9cyclictest3562396-21kworker/u8:3-events_freezable_power_10:40:190
3499739992518,4cyclictest0-21swapper/211:50:152
3499739992518,3cyclictest0-21swapper/212:36:102
3499739992517,4cyclictest0-21swapper/211:05:252
3499739992516,5cyclictest0-21swapper/210:45:242
3499739992512,10cyclictest311ktimers/212:20:112
3499730992519,4cyclictest3522843-21kworker/u8:3+events_unbound08:38:070
3499730992519,4cyclictest3507083-21kworker/u8:3+events_unbound07:43:200
3499730992518,5cyclictest3499283-21kworker/u8:0+events_unbound07:50:310
3499730992514,8cyclictest3580632-21cut11:20:170
3499730992513,10cyclictest11-21ksoftirqd/010:30:140
349973099251,20cyclictest0-21swapper/010:27:490
3499739992417,4cyclictest3582957-21grep11:25:252
3499739992416,5cyclictest0-21swapper/208:10:022
3499739992414,6cyclictest0-21swapper/208:55:202
3499730992418,4cyclictest3550254-21kworker/u8:1-events_freezable_power_09:55:010
3499730992418,4cyclictest3550254-21kworker/u8:1-events_freezable_power_09:55:000
3499730992417,5cyclictest3527847-21kworker/u8:1+events_unbound08:53:040
3499730992417,5cyclictest3480775-21kworker/u8:3+events_unbound07:15:460
349973099241,21cyclictest0-21swapper/009:10:230
349973099241,19cyclictest3515536-21grep08:10:240
349973099241,12cyclictest0-21swapper/008:49:000
349973099241,12cyclictest0-21swapper/008:49:000
3499739992317,3cyclictest0-21swapper/207:15:022
3499739992314,5cyclictest0-21swapper/209:25:252
349973999231,19cyclictest3520973-21grep08:25:262
349973999231,11cyclictest0-21swapper/207:35:172
349973099231,9cyclictest3518234-21munin-node08:20:110
3499730992316,5cyclictest3499283-21kworker/u8:0+events_unbound08:00:250
3499730992314,6cyclictest0-21swapper/009:20:010
349973099230,6cyclictest3559769-21fschecks_count10:20:150
349973099230,19cyclictest0-21swapper/007:20:530
3499739992216,3cyclictest0-21swapper/207:45:172
3499739992215,4cyclictest0-21swapper/208:20:272
3499739992215,3cyclictest0-21swapper/209:20:222
3499739992214,5cyclictest0-21swapper/210:20:152
349973999218,9cyclictest3594288-21run-parts12:00:002
349973999218,9cyclictest3594288-21run-parts12:00:002
349973999211,5cyclictest0-21swapper/207:31:202
3499739992115,4cyclictest3565090-21latency10:35:182
3499739992115,3cyclictest0-21swapper/212:30:142
3499739992114,3cyclictest0-21swapper/208:30:202
3499739992113,5cyclictest3580009-21auditctl11:20:002
3499739992014,3cyclictest0-21swapper/209:00:162
3499739992012,5cyclictest3588032-21ntpq11:40:202
349973999192,12cyclictest3590243-21grep11:45:252
3499739991912,5cyclictest35081802sleep207:45:012
3499739991912,4cyclictest311ktimers/208:00:012
349973999191,13cyclictest3512876-21cron08:05:012
3499739991812,4cyclictest0-21swapper/210:30:242
349973999178,6cyclictest3510107-21date07:50:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional