You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 20:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Mon Jun 01, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3918904995643,10cyclictest391ktimers/307:15:153
3918891995445,5cyclictest3920629-21awk07:15:010
3918891995034,13cyclictest4001925-21grep11:05:250
3918891995021,26cyclictest3957032-21timerwakeupswit08:55:260
3918896994740,4cyclictest4033452-21cron12:40:001
3918899994639,4cyclictest3992287-21fschecks_count10:40:142
3918896994620,22cyclictest0-21swapper/109:50:261
3918891994615,27cyclictest4011475-21grep11:35:140
391889199459,32cyclictest0-21swapper/010:45:010
3918891994513,27cyclictest0-21swapper/007:15:270
3918896994335,5cyclictest3920834-21sort07:15:021
391889199431,8cyclictest3962274-21grep09:10:250
3918891994317,22cyclictest0-21swapper/010:35:000
3918896994226,12cyclictest0-21swapper/109:15:001
391889199421,13cyclictest3918894-21latency_hist07:10:010
391889199421,12cyclictest3949035-21cron08:35:000
3918899994135,4cyclictest3991904-21cron10:40:012
3918896994129,8cyclictest3929433-21grep07:35:261
391889699411,8cyclictest3968573-21/usr/sbin/munin09:30:211
391889699411,10cyclictest3963906-21/usr/sbin/munin09:15:261
391889199411,10cyclictest4020629-21/usr/sbin/munin12:00:230
3918904994031,6cyclictest0-21swapper/309:55:003
3918899994030,6cyclictest3965635-21grep09:20:242
3918899994030,6cyclictest3937591-21/usr/sbin/munin08:00:182
3918896994032,5cyclictest3955439-21unixbench_singl08:50:251
3918896994028,8cyclictest0-21swapper/107:30:261
391889699401,7cyclictest3950578-21cron08:38:001
3918896994016,21cyclictest0-21swapper/110:05:241
3918896994016,19cyclictest0-21swapper/108:30:261
391889699401,5cyclictest3971527-21/usr/sbin/munin09:40:121
391889699401,5cyclictest3923429-21/usr/sbin/munin07:20:171
3918896994015,21cyclictest0-21swapper/112:05:141
391889199407,4cyclictest13550irq/42-30be0000.ethernet08:00:150
391889199401,9cyclictest3954514-21runrttasks08:50:130
391889199401,13cyclictest0-21swapper/007:35:160
391889199401,10cyclictest3939009-21/usr/sbin/munin08:05:190
391889199401,10cyclictest3925077-21/usr/sbin/munin07:25:180
3918904993932,5cyclictest4007499-21kworker/u8:0+events_unbound11:25:583
3918896993928,7cyclictest0-21swapper/111:30:261
391889699391,9cyclictest4014071-21head11:40:231
391889699391,8cyclictest4006306-21/usr/sbin/munin11:20:151
391889699391,8cyclictest3997468-21cpu10:55:141
3918896993916,20cyclictest0-21swapper/111:10:261
391889199392,10cyclictest3950758-21grep08:40:000
391889199391,9cyclictest3970280-21tr09:35:210
3918891993912,3cyclictest4011098-21idleruntime-cro11:35:010
391889199391,11cyclictest3967407-21head09:25:280
391889199391,11cyclictest3933274-21cron07:50:010
391889199391,10cyclictest3974206-21grep09:45:240
391889199391,10cyclictest3958273-21/usr/sbin/munin09:00:210
391889199391,10cyclictest3933735-21/usr/sbin/munin07:50:140
3918904993830,4cyclictest0-21swapper/311:50:013
3918899993825,8cyclictest3957148-21grep08:55:272
391889699387,28cyclictest3978900-21proc_pri10:00:211
391889699382,4cyclictest4029459-21/usr/sbin/munin12:25:271
391889699381,8cyclictest4020280-21sed12:00:181
391889699381,8cyclictest3967051-21/usr/sbin/munin09:25:261
391889699381,8cyclictest3922060-21fgrep07:15:251
391889699381,4cyclictest3992921-21/usr/sbin/munin10:40:231
391889699381,10cyclictest4015721-21grep11:45:241
391889199382,6cyclictest4017897-21cron11:55:000
391889199381,7cyclictest3972494-21grep09:40:250
391889199381,6cyclictest3952461-21cron08:45:000
391889199381,4cyclictest3974989-21df_inode09:50:160
3918891993814,21cyclictest645-21runrttasks09:30:250
3918891993812,4cyclictest3979787-21latency_hist10:05:010
391889199381,13cyclictest4030845-21/usr/sbin/munin12:30:240
391889199381,10cyclictest4031989-21munin-node12:35:110
391889199381,10cyclictest4013757-21/usr/sbin/munin11:40:220
391889199381,10cyclictest164-21systemd-journal11:56:000
3918891993810,25cyclictest0-21swapper/008:45:270
391889199380,13cyclictest0-21swapper/011:23:080
391889199380,13cyclictest0-21swapper/009:55:150
391889699378,26cyclictest3941256-21mailstats08:10:271
391889699372,3cyclictest4008203-21if_err_eth111:25:171
391889699372,3cyclictest0-21swapper/109:05:231
391889699371,9cyclictest4030743-21/usr/sbin/munin12:30:211
391889699371,9cyclictest3981803-21df_inode10:10:121
391889699371,9cyclictest3981803-21df_inode10:10:121
391889699371,8cyclictest4004862-21latency11:15:171
391889699371,8cyclictest3944170-21grep08:20:161
391889699371,4cyclictest4000259-21users11:00:261
391889699371,4cyclictest3943322-21/usr/sbin/munin08:15:271
391889699371,10cyclictest3925129-21irqstats07:25:181
3918896993710,24cyclictest0-21swapper/108:00:241
391889699370,8cyclictest3995760-21apt-get10:50:121
391889199379,5cyclictest3963233-21/usr/sbin/munin09:15:160
391889199378,6cyclictest4016332-21sed11:50:000
391889199376,5cyclictest0-21swapper/010:25:170
391889199372,8cyclictest3994690-21ps10:45:230
391889199372,8cyclictest3924153-21head07:20:250
391889199372,6cyclictest3940726-21grep08:10:160
391889199372,5cyclictest4029851-21apt-get12:30:000
391889199372,4cyclictest3960152-21grep09:05:230
391889199371,10cyclictest4000193-21grep11:00:260
391889199370,15cyclictest0-21swapper/010:05:250
3918904993628,4cyclictest0-21swapper/311:55:593
3918899993621,11cyclictest311ktimers/211:35:082
391889699368,25cyclictest3989581-21wc10:30:261
3918896993628,4cyclictest0-21swapper/111:50:241
391889699362,6cyclictest3957150-21head08:55:271
391889699361,9cyclictest3991452-21grep10:35:261
391889699361,9cyclictest3977606-21/usr/sbin/munin09:55:281
391889699361,9cyclictest3951204-21cut08:40:151
391889699361,8cyclictest3986579-21cron10:24:591
391889699361,7cyclictest4011999-21/usr/sbin/munin11:35:211
391889699361,7cyclictest3973652-21/usr/sbin/munin09:45:201
391889699361,5cyclictest4023252-21/usr/sbin/munin12:10:251
391889699361,5cyclictest3932805-21grep07:45:271
3918896993615,17cyclictest3935094-21seq07:53:551
391889699361,12cyclictest4027750-21sed12:20:261
391889699361,12cyclictest3939896-21head08:05:291
391889699361,11cyclictest3970090-21irqstats09:35:171
391889699361,10cyclictest4018673-21ntpq11:55:211
3918896993610,23cyclictest3994172-21sh10:45:131
3918891993629,3cyclictest0-21swapper/011:15:000
391889199361,9cyclictest4008975-21grep11:25:260
3918891993611,2cyclictest0-21swapper/011:00:000
391889199361,11cyclictest3984400-21sed10:15:260
391889199361,11cyclictest3984400-21sed10:15:260
391889199361,10cyclictest4021718-21grep12:05:160
391889199361,10cyclictest3942244-21apt-get08:15:130
391889199361,10cyclictest3936892-21auditctl08:00:010
391889199360,13cyclictest0-21swapper/009:20:100
3918904993528,4cyclictest3998935-21munin-plugin-st11:00:003
3918896993527,5cyclictest3959300-21munin-plugin-st09:05:011
391889699352,4cyclictest3983559-21fschecks_count10:15:161
391889699352,4cyclictest3983559-21fschecks_count10:15:161
391889699351,9cyclictest3987275-21grep10:25:201
391889699351,8cyclictest3964892-21idleruntime09:20:161
391889699351,7cyclictest4001869-21sed11:05:251
391889699351,7cyclictest3945434-21apt-get08:25:021
391889699351,7cyclictest3945434-21apt-get08:25:021
391889699351,11cyclictest3935532-21df07:55:131
3918891993525,7cyclictest3945431-21sh08:25:010
391889199351,9cyclictest3930813-21wc07:40:250
391889199351,8cyclictest4026420-21cron12:19:590
391889199351,6cyclictest4027687-21unixbench_multi12:20:260
391889199351,11cyclictest4005954-21cron11:20:000
391889199351,11cyclictest3927106-21cat07:30:180
3918891993510,3cyclictest0-21swapper/010:10:160
3918891993510,3cyclictest0-21swapper/010:10:150
391890499346,6cyclictest131rcu_preempt12:00:113
3918904993427,4cyclictest3950291-21unixbench_multi08:35:273
3918904993427,4cyclictest0-21swapper/311:20:003
3918904993425,5cyclictest4007214-21unixbench_multi11:20:283
3918904993424,7cyclictest3934729-21grep07:50:263
3918899993423,8cyclictest3931579-21auditctl07:45:012
391889699341,9cyclictest4025063-21/usr/sbin/munin12:15:131
391889699341,9cyclictest3931106-21grep07:40:261
391889699341,6cyclictest3953264-21grep08:45:241
391889199341,6cyclictest3946893-21grep08:25:270
391889199341,6cyclictest3946893-21grep08:25:270
3918904993323,7cyclictest0-21swapper/310:35:263
3918904993323,6cyclictest0-21swapper/308:05:003
3918899993324,4cyclictest0-21swapper/209:45:252
391889999331,29cyclictest3979289-21grep10:00:252
391889199331,7cyclictest3986123-21grep10:20:250
391889199331,10cyclictest3996205-21meminfo10:50:180
391889199330,9cyclictest4024290-21head12:10:240
3918904993225,4cyclictest0-21swapper/307:50:013
3918904993224,4cyclictest0-21swapper/312:30:283
3918904993222,7cyclictest3986124-21grep10:20:253
3918904993222,6cyclictest3952076-21kworker/u8:1-ext4-rsv-conversion08:45:003
3918899993225,3cyclictest0-21swapper/209:40:152
3918899993222,7cyclictest3984889-21sendmail10:19:592
3918899993222,7cyclictest3984889-21sendmail10:19:592
3918904993124,4cyclictest0-21swapper/307:20:153
3918904993123,5cyclictest0-21swapper/307:15:023
3918904993121,7cyclictest4004309-21ls11:15:013
3918899993125,3cyclictest0-21swapper/207:30:012
3918899993123,5cyclictest0-21swapper/211:30:252
3918904993023,4cyclictest0-21swapper/309:15:263
3918904993023,3cyclictest0-21swapper/308:25:013
3918904993021,6cyclictest0-21swapper/311:40:153
3918899993024,3cyclictest0-21swapper/211:15:012
3918899993023,3cyclictest0-21swapper/211:20:002
3918899993022,5cyclictest0-21swapper/210:30:172
3918899993021,7cyclictest0-21swapper/207:40:012
3918899993020,6cyclictest0-21swapper/207:50:002
3918899993019,7cyclictest4019144-21grep11:55:262
3918899993016,10cyclictest311ktimers/210:25:122
3918904992922,4cyclictest0-21swapper/312:19:593
3918904992921,6cyclictest3987452-21kworker/u8:2+events_unbound10:45:553
3918904992918,7cyclictest4024315-21grep12:10:243
3918904992918,6cyclictest0-21swapper/308:55:263
3918904992917,9cyclictest3959286-21auditctl09:05:013
3918899992922,4cyclictest4026434-21munin-run12:20:002
3918899992921,5cyclictest0-21swapper/211:50:192
3918899992921,4cyclictest3920623-21idleruntime-cro07:15:002
3918899992921,4cyclictest0-21swapper/211:20:282
391890499284,4cyclictest131rcu_preempt07:30:133
3918904992820,4cyclictest0-21swapper/311:00:253
3918904992820,4cyclictest0-21swapper/309:25:283
3918904992818,7cyclictest3972938-21sh09:45:013
3918904992818,6cyclictest0-21swapper/308:05:283
3918899992822,3cyclictest3998940-21sendmail11:00:012
3918899992822,3cyclictest0-21swapper/207:19:592
3918899992820,4cyclictest3936923-21sendmail-msp08:00:012
391889199281,7cyclictest3991907-21grep10:40:010
3918904992721,3cyclictest0-21swapper/310:20:003
3918904992721,3cyclictest0-21swapper/310:20:003
3918904992718,6cyclictest3926283-21grep07:30:023
3918899992721,3cyclictest0-21swapper/212:25:252
3918899992717,6cyclictest0-21swapper/208:35:272
3918904992619,4cyclictest0-21swapper/311:30:173
3918904992618,4cyclictest0-21swapper/312:20:253
3918904992616,7cyclictest53-21kcompactd010:30:223
3918899992619,5cyclictest32-21ksoftirqd/209:35:142
3918899992619,3cyclictest0-21swapper/212:30:282
3918899992618,5cyclictest32-21ksoftirqd/209:10:122
391889999261,22cyclictest4013198-21fschecks_count11:40:152
3918904992518,4cyclictest0-21swapper/308:20:013
3918904992517,5cyclictest145-21jbd2/mmcblk1p2-807:55:163
3918904992517,4cyclictest438-21cron08:35:003
391889999255,3cyclictest131rcu_preempt12:25:002
3918899992519,3cyclictest0-21swapper/208:20:012
3918899992518,5cyclictest3934844-21kworker/u8:1+events_unbound08:10:242
3918899992517,4cyclictest0-21swapper/209:15:262
3918899992516,6cyclictest1-21systemd08:30:322
3918899992516,5cyclictest0-21swapper/207:30:162
3918904992418,3cyclictest0-21swapper/312:30:013
3918904992417,4cyclictest0-21swapper/309:55:273
3918904992416,5cyclictest3974224-21unixbench_singl09:45:243
3918904992414,7cyclictest3946947-21grep08:25:273
3918904992414,7cyclictest3946947-21grep08:25:263
3918899992418,3cyclictest0-21swapper/212:35:152
3918899992418,3cyclictest0-21swapper/211:45:242
3918899992417,4cyclictest438-21cron09:05:002
3918899992416,5cyclictest0-21swapper/210:10:222
3918899992416,5cyclictest0-21swapper/210:10:222
3918904992317,3cyclictest0-21swapper/310:25:213
3918904992316,5cyclictest4021035-21kworker/u8:1+events_unbound12:06:023
3918904992316,4cyclictest3960842-21sshd09:08:183
3918904992316,3cyclictest0-21swapper/307:40:153
3918904992312,7cyclictest0-21swapper/308:45:283
3918899992317,4cyclictest3974341-21kworker/u8:3+events_unbound09:50:452
3918899992316,4cyclictest4020853-21tail12:00:242
3918899992316,3cyclictest0-21swapper/210:05:232
3918899992314,6cyclictest311ktimers/208:25:052
3918899992314,6cyclictest311ktimers/208:25:052
3918899992312,7cyclictest1-21systemd10:45:532
3918899992311,8cyclictest0-21swapper/211:00:552
3918904992216,3cyclictest0-21swapper/310:10:143
3918904992216,3cyclictest0-21swapper/310:10:143
3918904992215,4cyclictest3971222-21sh09:40:013
3918904992213,6cyclictest4016684-21ls11:50:153
3918904992212,8cyclictest3980882-21sed10:05:243
3918904992211,8cyclictest3965015-21cut09:20:163
3918899992216,4cyclictest3934844-21kworker/u8:1+events_unbound07:54:412
3918899992216,3cyclictest0-21swapper/209:25:222
3918899992216,3cyclictest0-21swapper/208:45:252
3918899992215,4cyclictest4001881-21tail11:05:242
3918899992215,3cyclictest0-21swapper/212:10:152
3918899992213,7cyclictest3978090-21sort10:00:002
3918899992213,6cyclictest3968630-21ntpq09:30:222
3918904992117,2cyclictest0-21swapper/308:50:103
3918904992115,3cyclictest0-21swapper/309:10:133
3918904992114,4cyclictest3920639-21munin-node12:35:113
3918904992114,4cyclictest0-21swapper/311:35:143
391889999215,3cyclictest131rcu_preempt08:40:122
3918899992116,3cyclictest3939414-21ntp_offset08:05:252
3918899992115,4cyclictest311ktimers/211:25:172
3918899992115,3cyclictest0-21swapper/210:20:212
3918904992014,3cyclictest3979335-21grep10:00:253
3918904992014,3cyclictest0-21swapper/309:30:263
3918899992013,4cyclictest0-21swapper/209:05:262
3918899992012,4cyclictest4023027-21auditctl12:10:002
3918899992011,6cyclictest3954529-21fschecks_count08:50:152
391889999194,11cyclictest3997224-21cron10:55:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional