You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 00:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Sun May 10, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4053481995227,20cyclictest391ktimers/310:00:133
4053481995027,19cyclictest0-21swapper/312:35:233
4053476995043,4cyclictest4154429-21idleruntime-cro11:59:592
4053473994942,4cyclictest4055209-21munin-plugin-st07:15:011
4053476994736,9cyclictest311ktimers/211:00:112
4053470994635,7cyclictest4124777-21grep10:30:250
4053470994620,4cyclictest0-21swapper/012:30:250
4053476994535,7cyclictest4108176-21fschecks_time09:45:152
4053473994538,4cyclictest4074902-21idleruntime-cro08:10:011
4053473994535,7cyclictest4126432-21grep10:35:261
4053481994434,7cyclictest4122982-21kworker/u8:0+events_unbound11:00:113
4053473994433,7cyclictest4063765-21grep07:35:271
4053481994322,18cyclictest391ktimers/307:45:133
405348199431,10cyclictest4099652-21/usr/sbin/munin09:20:163
4053470994335,4cyclictest4071067-21sendmail08:00:000
405348199421,9cyclictest4130671-21diskstats10:50:143
405348199421,9cyclictest4124324-21/usr/sbin/munin10:30:213
405348199421,9cyclictest4104670-21/usr/sbin/munin09:35:163
405348199421,9cyclictest4104670-21/usr/sbin/munin09:35:163
405348199421,9cyclictest4070258-21/usr/sbin/munin07:55:223
4053476994235,4cyclictest4064228-21cron07:40:012
4053476994231,8cyclictest311ktimers/210:15:112
405348199419,7cyclictest4059003-21seq07:23:403
405348199418,3cyclictest0-21swapper/309:25:173
405348199417,8cyclictest4098676-21sed09:15:243
405348199413,9cyclictest4091517-21/usr/sbin/munin08:55:253
405348199413,5cyclictest4119262-21users10:15:253
4053481994134,4cyclictest4154430-21sshd12:00:003
405348199411,9cyclictest4141169-21/usr/sbin/munin11:20:173
405348199411,9cyclictest4141169-21/usr/sbin/munin11:20:163
405348199411,9cyclictest4089498-21/usr/sbin/munin08:50:153
405348199411,9cyclictest4077277-21/usr/sbin/munin08:15:183
405348199411,9cyclictest4064745-21/usr/sbin/munin07:40:163
405348199411,8cyclictest4128853-21/usr/sbin/munin10:45:173
4053481994114,24cyclictest4156350-21/usr/sbin/munin12:05:233
405348199411,11cyclictest4056416-21/usr/sbin/munin07:15:203
405348199411,10cyclictest4075328-21dpkg08:10:083
4053473994133,6cyclictest4131779-21kworker/u8:1+events_unbound10:54:451
4053470994134,4cyclictest4076800-21cron08:15:010
405348199404,5cyclictest4059360-21/usr/sbin/munin07:25:273
405348199403,11cyclictest4068336-21meminfo07:50:223
405348199402,9cyclictest4111887-21/usr/sbin/munin09:55:213
405348199401,9cyclictest4108533-21/usr/sbin/munin09:45:213
405348199401,9cyclictest4087164-21cron08:44:013
405348199401,9cyclictest4082818-21meminfo08:30:193
405348199401,8cyclictest4094997-21/usr/sbin/munin09:05:243
405348199401,10cyclictest4125885-21/usr/sbin/munin10:35:203
405348199401,10cyclictest4110385-21/usr/sbin/munin09:50:223
405348199401,10cyclictest4081363-21find08:25:233
405348199401,10cyclictest4081363-21find08:25:233
4053481994010,4cyclictest4118012-21cat10:15:013
4053476994029,8cyclictest4157908-21sshd12:10:012
4053473994031,6cyclictest0-21swapper/112:00:001
4053470994029,7cyclictest4112858-21sendmail10:00:010
405348199398,8cyclictest4103404-21ntp_states09:30:223
405348199398,3cyclictest0-21swapper/308:45:173
405348199394,6cyclictest4115853-21grep10:05:253
4053481993930,6cyclictest4160750-21unixbench_multi12:15:253
4053481993930,6cyclictest4160750-21unixbench_multi12:15:243
4053481993924,11cyclictest391ktimers/308:35:133
405348199391,9cyclictest4152715-21awk11:55:003
405348199391,9cyclictest4139838-21/usr/sbin/munin11:15:243
405348199391,9cyclictest4139838-21/usr/sbin/munin11:15:243
405348199391,12cyclictest4150857-21sshd11:48:263
4053481993911,25cyclictest0-21swapper/310:40:233
405348199391,10cyclictest4122879-21grep10:25:273
4053476993930,4cyclictest0-21swapper/207:15:002
4053473993932,4cyclictest4095776-21cron09:10:001
4053470993932,4cyclictest438-21cron08:20:010
4053470993929,6cyclictest0-21swapper/010:25:000
405348199383,5cyclictest4147109-21grep11:35:263
405348199381,9cyclictest4164995-21diskstats12:30:153
405348199381,9cyclictest4143282-21/usr/sbin/munin11:25:223
405348199381,9cyclictest4137905-21/usr/sbin/munin11:10:193
405348199381,9cyclictest4136125-21memory11:05:193
405348199381,9cyclictest4097082-21head09:10:243
405348199381,7cyclictest4054642-21grep07:10:263
405348199381,4cyclictest4132374-21/usr/sbin/munin10:55:163
405348199381,11cyclictest4106825-21ntp_states09:40:223
405348199381,11cyclictest4106825-21ntp_states09:40:213
4053476993830,3cyclictest0-21swapper/208:15:012
4053476993828,6cyclictest0-21swapper/207:24:062
4053476993819,5cyclictest131rcu_preempt10:25:272
4053470993828,7cyclictest4106006-21sh09:40:000
4053470993828,7cyclictest4106006-21sh09:39:590
4053481993727,6cyclictest0-21swapper/311:30:233
405348199371,9cyclictest53-21kcompactd012:20:173
405348199371,9cyclictest4154763-21df_inode12:00:123
405348199371,9cyclictest4092620-21/usr/sbin/munin09:00:153
405348199371,8cyclictest4079279-21/usr/sbin/munin08:20:213
4053481993718,15cyclictest0-21swapper/312:10:203
405348199371,6cyclictest4073628-21grep08:05:163
405348199371,12cyclictest4062561-21grep07:35:003
4053476993731,4cyclictest4157611-21kworker/u8:0+events_unbound12:25:042
4053476993731,4cyclictest4131779-21kworker/u8:1+events_unbound11:34:572
4053476993730,5cyclictest4085532-21kworker/u8:1+events_unbound08:49:182
4053476993719,10cyclictest4150864-21kworker/u8:0+events_unbound11:53:552
4053473993729,4cyclictest0-21swapper/112:20:151
4053473993726,8cyclictest4080260-21latency_hist08:25:011
4053470993728,7cyclictest4065954-21idleruntime-cro07:45:010
405348199363,5cyclictest4163159-21seq12:25:033
405348199361,8cyclictest4148895-21unixbench_singl11:40:263
405348199361,10cyclictest4120535-21cat10:20:183
4053476993614,5cyclictest131rcu_preempt09:40:132
4053476993614,5cyclictest131rcu_preempt09:40:132
4053470993627,7cyclictest438-21cron11:30:010
4053470993625,6cyclictest4074436-21unixbench_multi08:05:250
405348199351,8cyclictest4071841-21/usr/sbin/munin08:00:163
4053476993528,5cyclictest4140179-21kworker/u8:3+events_unbound11:19:522
4053476993528,5cyclictest4140179-21kworker/u8:3+events_unbound11:19:522
4053476993527,4cyclictest4106001-21cron09:40:002
4053476993527,4cyclictest4106001-21cron09:40:002
4053476993524,7cyclictest0-21swapper/211:00:012
4053476993519,5cyclictest4114528-21kworker/u8:2+events_unbound10:06:482
4053473993527,4cyclictest0-21swapper/110:15:161
4053473993524,4cyclictest131rcu_preempt11:25:151
405347399351,8cyclictest24-21ksoftirqd/109:45:121
4053473993517,3cyclictest131rcu_preempt08:11:001
4053473993511,6cyclictest24-21ksoftirqd/112:30:131
4053470993524,7cyclictest4115844-21grep10:05:260
405348199341,9cyclictest4062882-21df_inode07:35:153
4053476993425,6cyclictest4097484-21sh09:15:012
4053476993420,8cyclictest131rcu_preempt12:20:162
4053476993416,5cyclictest4088898-21kworker/u8:2+events_unbound08:59:232
4053473993428,4cyclictest4112521-21kworker/u8:3+events_unbound10:03:411
4053473993426,4cyclictest0-21swapper/109:20:011
4053473993425,6cyclictest4135018-21grep11:00:251
4053473993425,5cyclictest0-21swapper/107:25:271
4053473993424,4cyclictest131rcu_preempt12:10:201
4053473993418,9cyclictest131rcu_preempt08:04:281
4053470993425,6cyclictest4145404-21grep11:30:260
4053470993424,5cyclictest0-21swapper/011:25:000
4053470993424,5cyclictest0-21swapper/011:24:590
405347099340,31cyclictest0-21swapper/012:05:110
4053476993325,4cyclictest0-21swapper/209:55:262
405347699330,6cyclictest0-21swapper/212:00:102
405347399339,6cyclictest131rcu_preempt08:53:011
4053473993324,4cyclictest0-21swapper/109:30:251
4053473993322,3cyclictest131rcu_preempt09:39:171
4053473993322,3cyclictest131rcu_preempt09:39:161
4053473993321,7cyclictest4083368-21grep08:30:251
4053473993319,10cyclictest4092381-21ls09:00:011
4053473993318,3cyclictest131rcu_preempt07:50:231
4053473993313,9cyclictest131rcu_preempt08:45:271
4053473993312,5cyclictest131rcu_preempt11:23:081
4053473993312,5cyclictest131rcu_preempt11:23:081
4053473993312,10cyclictest131rcu_preempt09:10:171
4053470993321,8cyclictest4091947-21grep08:55:280
4053470993320,8cyclictest4153971-21grep11:55:250
4053476993225,5cyclictest4131562-21unixbench_multi10:50:242
4053476993225,4cyclictest4121590-21idleruntime-cro10:25:002
4053476993224,4cyclictest0-21swapper/208:20:172
4053476993223,7cyclictest4058971-21kworker/u8:1+events_unbound07:29:082
4053476993222,6cyclictest311ktimers/211:05:112
4053476993222,6cyclictest0-21swapper/211:50:002
4053476993222,6cyclictest0-21swapper/210:40:162
4053476993222,5cyclictest0-21swapper/207:40:232
405347399325,6cyclictest24-21ksoftirqd/108:20:001
405347399323,6cyclictest24-21ksoftirqd/110:05:161
4053473993223,5cyclictest4085069-21unixbench_multi08:35:261
4053473993222,7cyclictest231ktimers/111:15:171
4053473993222,7cyclictest231ktimers/111:15:161
4053473993222,6cyclictest4067226-21unixbench_singl07:45:241
4053473993220,3cyclictest131rcu_preempt07:57:531
4053473993219,4cyclictest131rcu_preempt07:35:001
4053473993218,5cyclictest131rcu_preempt10:49:081
4053473993216,5cyclictest131rcu_preempt10:55:211
4053473993215,4cyclictest131rcu_preempt09:03:591
4053473993212,13cyclictest131rcu_preempt08:25:131
4053473993212,13cyclictest131rcu_preempt08:25:131
4053473993210,12cyclictest131rcu_preempt10:30:201
4053470993226,4cyclictest4130328-21latency_hist10:50:010
4053470993223,6cyclictest4162540-21grep12:20:240
4053476993125,3cyclictest4146943-21runrttasks11:35:252
4053476993123,4cyclictest0-21swapper/208:10:002
4053476993121,6cyclictest0-21swapper/209:29:592
405347399319,7cyclictest4135978-21cat11:05:171
405347399319,7cyclictest24-21ksoftirqd/110:25:251
405347399314,9cyclictest24-21ksoftirqd/112:20:001
405347399314,9cyclictest24-21ksoftirqd/112:20:001
4053473993121,4cyclictest131rcu_preempt07:40:181
4053473993120,5cyclictest131rcu_preempt09:20:201
4053473993119,4cyclictest131rcu_preempt11:50:231
4053473993118,5cyclictest4164317-21kworker/u8:1+events_unbound12:36:021
4053473993115,9cyclictest131rcu_preempt08:40:181
4053473993115,9cyclictest131rcu_preempt07:15:271
4053473993114,4cyclictest131rcu_preempt11:34:361
4053473993114,10cyclictest131rcu_preempt09:40:181
4053473993114,10cyclictest131rcu_preempt09:40:181
4053473993112,5cyclictest131rcu_preempt12:00:171
4053473993112,4cyclictest131rcu_preempt11:40:221
4053473993112,3cyclictest131rcu_preempt11:10:201
4053473993110,5cyclictest131rcu_preempt09:25:181
4053476993023,3cyclictest0-21swapper/208:40:172
4053476993021,6cyclictest0-21swapper/208:15:182
4053476993020,6cyclictest0-21swapper/209:00:272
4053476993019,7cyclictest0-21swapper/208:50:152
4053476993018,6cyclictest4079961-21kworker/u8:3+events_unbound08:31:302
4053476993015,5cyclictest4054785-21kworker/u8:2+events_unbound08:04:502
4053476993010,11cyclictest32-21ksoftirqd/208:25:262
4053476993010,11cyclictest32-21ksoftirqd/208:25:262
405347399307,12cyclictest24-21ksoftirqd/111:35:261
405347399301,6cyclictest0-21swapper/110:40:241
4053473993014,9cyclictest131rcu_preempt12:25:191
4053473993014,5cyclictest131rcu_preempt10:24:031
4053473993012,11cyclictest131rcu_preempt09:55:201
4053473993010,3cyclictest131rcu_preempt07:22:191
4053470993021,6cyclictest4072980-21sh08:05:010
4053470993021,5cyclictest0-21swapper/011:15:250
4053470993021,5cyclictest0-21swapper/011:15:240
4053470993021,5cyclictest0-21swapper/010:40:250
405347699299,11cyclictest32-21ksoftirqd/209:20:262
4053476992922,5cyclictest4131779-21kworker/u8:1+events_unbound11:14:492
4053476992922,4cyclictest0-21swapper/207:30:162
4053476992911,6cyclictest32-21ksoftirqd/209:15:252
405347399299,12cyclictest24-21ksoftirqd/110:10:201
4053473992913,4cyclictest131rcu_preempt09:50:071
4053473992910,5cyclictest131rcu_preempt12:05:171
4053470992923,3cyclictest0-21swapper/011:35:260
4053470992922,4cyclictest13850irq/36-mmc112:39:590
4053470992922,3cyclictest0-21swapper/010:55:260
4053470992920,5cyclictest4119662-21munin-plugin-st10:20:010
4053470992920,5cyclictest4067661-21idleruntime-cro07:50:010
4053470992918,7cyclictest0-21swapper/010:10:250
4053476992823,3cyclictest4141389-21/usr/sbin/munin11:20:202
4053476992823,3cyclictest4141389-21/usr/sbin/munin11:20:202
4053476992820,4cyclictest0-21swapper/207:55:162
4053476992816,7cyclictest0-21swapper/207:15:242
4053476992814,3cyclictest131rcu_preempt09:10:012
4053470992822,4cyclictest4109439-21munin-plugin-st09:50:000
4053470992821,4cyclictest4127065-21latency_hist10:40:010
4053470992820,5cyclictest4054785-21kworker/u8:2+events_unbound07:39:090
4053470992820,4cyclictest0-21swapper/007:15:030
4053470992819,6cyclictest4094470-21tune2fs09:05:170
4053476992721,4cyclictest4164317-21kworker/u8:1+events_unbound12:36:422
4053476992714,7cyclictest131rcu_preempt10:45:242
4053476992712,3cyclictest131rcu_preempt12:15:252
4053476992712,3cyclictest131rcu_preempt12:15:252
405347699271,11cyclictest0-21swapper/207:51:012
4053470992718,5cyclictest4100922-21munin-plugin-st09:25:010
4053470992717,7cyclictest4106464-21grep09:40:160
4053470992717,7cyclictest4106464-21grep09:40:150
405347099271,24cyclictest0-21swapper/007:25:130
4053476992619,5cyclictest4159743-21kworker/u8:3+events_unbound12:30:242
4053476992619,5cyclictest4122982-21kworker/u8:0+events_unbound10:35:162
4053476992619,5cyclictest4070928-21kworker/u8:0+events_unbound08:37:192
4053476992612,4cyclictest4054785-21kworker/u8:2+events_unbound07:46:322
4053470992619,4cyclictest13550irq/42-30be0000.ethernet08:25:000
405347699257,11cyclictest301rcuc/209:50:242
405347699257,10cyclictest32-21ksoftirqd/211:40:182
405347699256,8cyclictest32-21ksoftirqd/211:25:182
4053476992510,7cyclictest131rcu_preempt12:10:162
405347099253,3cyclictest41038512grep09:30:250
4053470992516,6cyclictest4159512-21debian-sa112:14:590
4053470992516,6cyclictest4155208-21ntpq12:00:180
4053470992515,7cyclictest4058714-21grep07:20:250
4053470992515,6cyclictest0-21swapper/012:25:260
4053476992416,6cyclictest4109274-21kworker/u8:0+events_unbound10:04:362
4053470992419,3cyclictest13550irq/42-30be0000.ethernet10:25:190
4053470992417,3cyclictest0-21swapper/011:41:170
4053470992416,4cyclictest0-21swapper/011:10:240
405347099241,3cyclictest4085795-21apt-get08:40:120
405347099241,19cyclictest0-21swapper/009:02:020
405347099241,19cyclictest0-21swapper/008:28:120
405347099241,19cyclictest0-21swapper/008:28:110
405347099240,20cyclictest0-21swapper/008:48:220
405347099234,14cyclictest13550irq/42-30be0000.ethernet09:50:100
4053470992319,2cyclictest13550irq/42-30be0000.ethernet08:35:140
4053470992316,4cyclictest0-21swapper/008:34:130
4053470992316,3cyclictest0-21swapper/007:52:570
4053470992312,8cyclictest4159859-21df12:15:140
4053470992312,8cyclictest4159859-21df12:15:140
4053470992312,7cyclictest4149982-21/usr/sbin/munin11:45:200
405347099231,18cyclictest0-21swapper/011:51:100
405347099231,18cyclictest0-21swapper/009:15:340
405347099230,19cyclictest0-21swapper/009:28:310
405347099230,19cyclictest0-21swapper/008:51:010
4053470992216,3cyclictest0-21swapper/009:10:230
4053470992215,3cyclictest0-21swapper/010:01:470
4053470992214,5cyclictest4061526-21sort07:30:190
405347099221,19cyclictest0-21swapper/011:05:560
4053470992116,3cyclictest13550irq/42-30be0000.ethernet11:00:130
405347099211,3cyclictest0-21swapper/007:13:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional