You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 23:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Thu Nov 27, 2025 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2183923200,2sleep30-21swapper/307:05:373
2183022670,2sleep20-21swapper/207:05:362
2121822620,2sleep10-21swapper/107:05:231
1040721170,2sleep30-21swapper/309:21:133
851821060,2sleep20-21swapper/211:33:432
226049810194,4cyclictest28635-21kworker/u8:1211:17:131
22611988478,4cyclictest20640-21kworker/u8:3508:37:283
223762830,1chrt0-21swapper/110:55:281
223762830,1chrt0-21swapper/110:55:271
22604987266,3cyclictest20650-21kworker/u8:4508:41:371
22604987265,4cyclictest26512-21kworker/u8:108:56:561
22604987265,4cyclictest26512-21kworker/u8:108:56:551
99212700,1chrt0-21swapper/209:20:372
22604986862,3cyclictest7587-21kworker/u8:108:02:511
22603986756,8cyclictest10-21ksoftirqd/008:37:280
240872650,1chrt0-21swapper/112:06:311
22604986459,3cyclictest19635-21kworker/u8:012:12:311
22609986357,4cyclictest22755-21kworker/u8:808:37:292
62192620,2chrt6218-21ssh11:29:201
24922520,2sleep22494-21rm12:30:482
317302480,2sleep331682-21ssh10:05:443
7032470,20sleep122600-21cyclictest12:26:531
286422450,2sleep30-21swapper/310:00:293
2260398432,36cyclictest0-21swapper/008:10:130
2260398426,32cyclictest0-21swapper/009:45:430
2260398422,36cyclictest20752-21sendmail_mailqu10:50:440
22603984213,26cyclictest15624-21idleruntime-cro11:50:000
2260398413,34cyclictest4748-21tr07:45:380
2260398411,36cyclictest8943-21xargs10:25:440
2260398403,33cyclictest28646-21latency_hist07:25:010
2260398401,36cyclictest11385-21sendmail11:40:000
2260398401,34cyclictest0-21swapper/008:15:150
2260398400,36cyclictest25341-21kernelversion11:00:290
112982400,3sleep38305-21kworker/u8:2211:39:443
265082390,2sleep126490-21ssh09:55:251
2260398397,29cyclictest6616-21sh09:15:160
2260398393,32cyclictest9017-21ssh09:20:140
2260398391,34cyclictest30317-21cron10:04:590
2260398391,34cyclictest29421-21irqrtprio08:50:260
2260398391,34cyclictest27846-21ntpq08:45:370
2260398391,34cyclictest0-21swapper/010:20:240
2260398391,33cyclictest21111-21latency_hist08:30:010
2260398391,29cyclictest14722-21tr10:40:010
22604983832,3cyclictest5826-21kworker/u8:2809:26:411
2260398385,29cyclictest22761-1kworker/u9:009:10:350
2260398383,30cyclictest118150irq/29-4f00000.09:30:140
2260398381,34cyclictest28161-21ssh11:05:400
2260398381,34cyclictest0-21swapper/010:55:150
2260398381,34cyclictest0-21swapper/010:55:150
2260398381,33cyclictest6045-21modprobe12:40:000
2260398381,33cyclictest6045-21modprobe12:40:000
2260398381,33cyclictest3979-21sh11:25:010
2260398381,33cyclictest0-21swapper/007:10:040
2260398381,32cyclictest0-21swapper/012:15:190
2260398380,34cyclictest26874-21ssh12:15:000
2260398380,34cyclictest0-21swapper/007:50:190
2260998371,19cyclictest4412-21taskset10:16:272
2260998371,19cyclictest4412-21taskset10:16:272
2260998371,15cyclictest29109-21ssh12:19:492
2260398377,27cyclictest3322-21seq07:40:460
2260398377,27cyclictest3322-21seq07:40:460
2260398376,20cyclictest118150irq/29-4f00000.11:55:260
2260398373,31cyclictest30685-21idleruntime-cro07:30:000
2260398372,32cyclictest18747-21aten2_rfpower_p09:40:180
2260398372,32cyclictest0-21swapper/007:55:250
2260398371,32cyclictest32659-21ntpq11:15:310
2260398371,32cyclictest20729-21if_eth012:00:220
2260398371,32cyclictest1184-21chrt09:00:290
2260398371,32cyclictest0-21swapper/011:40:170
2260398371,32cyclictest0-21swapper/011:40:170
2260398371,31cyclictest0-21swapper/010:40:160
2260398371,31cyclictest0-21swapper/008:00:130
2260398371,30cyclictest1258-21munin-plugin-st12:30:010
2260398370,34cyclictest25274-21taskset09:53:470
2260398370,33cyclictest118150irq/29-4f00000.10:05:150
197182370,2chrt0-21swapper/211:57:472
2261198362,3cyclictest82942kworker/u8:1011:40:323
2261198362,3cyclictest82942kworker/u8:1011:40:313
2260398363,30cyclictest2044-21snmpd12:20:360
2260398363,29cyclictest26662-21gpgv07:20:010
2260398362,31cyclictest7721-21ssh11:30:410
2260398361,32cyclictest3332chrt07:35:150
2260398361,32cyclictest17542-21head10:45:250
2260398361,31cyclictest3597-21latency_hist12:35:020
2260398361,31cyclictest11571-21aten2_rfpower_p09:25:180
2260398361,31cyclictest0-21swapper/008:05:130
2260398361,26cyclictest6372-21idleruntime-cro11:30:010
2260398360,33cyclictest0-21swapper/008:30:140
2260398360,32cyclictest16116-21df11:50:190
2260398360,31cyclictest0-21swapper/010:10:180
2260398360,31cyclictest0-21swapper/010:10:170
2260998355,15cyclictest0-21swapper/209:33:192
22609983516,16cyclictest29123-21/usr/sbin/munin08:50:202
2260998351,18cyclictest14953-21taskset11:46:072
2260398353,29cyclictest3846-21rm10:15:360
2260398353,29cyclictest3846-21rm10:15:360
2260398351,31cyclictest3285-21find09:05:440
2260398351,31cyclictest22624-21latency_hist07:10:010
2260398351,31cyclictest2049-21lldpd11:10:120
2260398351,31cyclictest16620-21irqrtprio09:35:230
2260398350,31cyclictest0-21swapper/010:30:240
223842350,3chrt11728-21kworker/u8:410:55:303
223842350,3chrt11728-21kworker/u8:410:55:303
2260998344,16cyclictest9367-21kworker/u8:1007:58:582
2260998342,15cyclictest11749-21kworker/u8:2710:36:472
2260398346,25cyclictest25553-21irqrtprio08:40:230
2260398343,26cyclictest22698-21ssh12:05:150
2260398341,30cyclictest32101-21timerwakeupswit07:30:430
2260398341,30cyclictest32101-21timerwakeupswit07:30:430
2260398341,30cyclictest26574-21ssh09:55:270
2260398341,30cyclictest18391-21mailstats08:20:370
2260998339,20cyclictest31901-21/usr/sbin/munin08:55:552
2260998339,20cyclictest31901-21/usr/sbin/munin08:55:542
2260998332,14cyclictest223222kworker/u8:107:28:142
22609983311,19cyclictest2511-21/usr/sbin/munin07:40:212
22609983311,19cyclictest2511-21/usr/sbin/munin07:40:212
2260498331,8cyclictest0-21swapper/111:20:191
2260398331,28cyclictest0-21swapper/008:55:310
2260398331,28cyclictest0-21swapper/008:55:300
114282330,8sleep2251ksoftirqd/209:25:142
2260998323,13cyclictest9364-21kworker/u8:708:04:562
2260998321,27cyclictest4012-21apt-get12:35:282
2260998321,27cyclictest4012-21apt-get12:35:282
2260998321,27cyclictest31674-21/usr/sbin/munin07:30:292
2260998321,27cyclictest31674-21/usr/sbin/munin07:30:292
2260998321,27cyclictest20475-21/usr/sbin/munin08:25:432
22609983212,16cyclictest22325-21/usr/sbin/munin10:56:062
22609983212,16cyclictest22325-21/usr/sbin/munin10:56:052
2260498323,13cyclictest121rcu_preempt09:40:311
22604983226,3cyclictest15098-21kworker/u8:1811:52:141
2260998312,26cyclictest17770-21grep08:20:232
2260998311,26cyclictest6473-21cat11:30:022
2260998311,26cyclictest6206-21apt-get07:50:192
2260998311,26cyclictest4751-21irqrtprio07:45:382
2260998311,26cyclictest30612-21runrttasks10:05:172
2260998311,26cyclictest25273-21grep07:15:232
2260998311,26cyclictest20073-21ssh10:50:252
22609983110,17cyclictest7470-21ntpq09:15:352
22604983126,3cyclictest12925-21kworker/u8:209:37:041
2261198307,4cyclictest121rcu_preempt10:35:013
2260998301,25cyclictest8052-21diskstats10:25:222
2260998301,25cyclictest617-21/usr/sbin/munin07:35:232
2260998301,25cyclictest3108-21ntpq09:05:342
2260998301,25cyclictest30410-21ls10:05:012
2260998301,25cyclictest25555-21ntpq11:00:332
2260998301,25cyclictest25310-21ps12:10:252
2260998301,25cyclictest17882-21ssh11:55:012
2260998301,25cyclictest16128-21/usr/sbin/munin08:15:242
2260998301,25cyclictest14458-21/usr/sbin/munin08:10:322
2260998301,25cyclictest1406-21rs:main2
2260998301,25cyclictest12161-21irqrtprio08:05:242
2260998301,25cyclictest11608-21sed11:40:022
2260998301,25cyclictest0-21swapper/212:25:152
2260998301,24cyclictest25187-21apt-get08:40:132
2260998301,24cyclictest22685-21apt-get12:05:132
2260998301,23cyclictest0-21swapper/208:45:202
2260498307,6cyclictest121rcu_preempt10:35:261
2260498306,4cyclictest121rcu_preempt09:50:341
2261198296,4cyclictest121rcu_preempt08:00:013
2261198296,3cyclictest121rcu_preempt09:25:463
2260998298,17cyclictest15735-21ssh10:40:272
2260998295,20cyclictest30661-21timerandwakeup12:20:582
2260998291,25cyclictest32548-21grep11:15:272
2260998291,25cyclictest32270-21kworker/u8:1210:10:272
2260998291,25cyclictest32270-21kworker/u8:1210:10:272
2260998291,25cyclictest24174-21/usr/sbin/munin09:50:292
2260998291,25cyclictest22252-21sshd-session08:30:502
2260998291,25cyclictest0-21swapper/212:00:142
2260998291,24cyclictest6457-21grep09:15:022
2260998291,24cyclictest6124-21/usr/sbin/munin10:20:252
2260998291,24cyclictest29711-21sh11:10:222
2260998291,24cyclictest25836-21awk09:55:162
2260998291,24cyclictest23221-21aten2_rfpower_v07:10:272
2260998291,24cyclictest17754-21ps10:45:292
2260998291,24cyclictest0-21swapper/211:20:162
2260998291,24cyclictest0-21swapper/211:05:152
2260998291,24cyclictest0-21swapper/207:20:312
3292280,2sleep10-21swapper/107:35:121
271232280,3sleep127122-21ssh12:15:031
2261198282,7cyclictest31-21ksoftirqd/311:15:003
2260998281,24cyclictest12622-21ps11:40:452
2260998281,24cyclictest12622-21ps11:40:452
2260998281,24cyclictest1171-21ntpq09:00:292
2260998281,24cyclictest0-21swapper/209:40:152
2260498287,4cyclictest121rcu_preempt07:25:321
2260498286,4cyclictest121rcu_preempt08:05:251
2260498286,4cyclictest121rcu_preempt07:20:321
2260498285,4cyclictest121rcu_preempt12:35:111
2260498285,4cyclictest121rcu_preempt12:35:111
2260498283,5cyclictest121rcu_preempt11:05:351
22604982821,4cyclictest15097-21kworker/u8:1711:57:091
2260498281,4cyclictest121rcu_preempt07:45:251
183072281,7sleep318331-21sh09:40:013
61592270,2sleep10-21swapper/109:14:041
2261198276,5cyclictest121rcu_preempt11:24:063
2261198274,5cyclictest31-21ksoftirqd/308:05:363
2261198273,3cyclictest121rcu_preempt12:00:173
2260998271,23cyclictest21117-21basename09:45:172
2260998271,23cyclictest16913-21sed09:35:252
2260498273,4cyclictest121rcu_preempt11:00:211
2260498271,5cyclictest121rcu_preempt08:35:151
2260498271,4cyclictest121rcu_preempt09:00:391
2260498271,4cyclictest121rcu_preempt08:25:181
2260498271,4cyclictest0-21swapper/111:10:281
218592270,15sleep331-21ksoftirqd/310:55:003
285522260,2sleep10-21swapper/108:49:081
2261198265,5cyclictest28768-21kworker/u8:412:35:003
2261198261,4cyclictest18381-21/usr/sbin/munin10:45:483
2260498266,4cyclictest121rcu_preempt10:10:191
2260498266,4cyclictest121rcu_preempt10:10:181
2260498266,4cyclictest121rcu_preempt10:05:371
2260498266,4cyclictest121rcu_preempt09:30:341
2260498265,4cyclictest121rcu_preempt11:35:021
2260498265,4cyclictest121rcu_preempt10:45:481
2260498265,4cyclictest121rcu_preempt09:15:241
2260498264,4cyclictest121rcu_preempt10:20:001
2260498264,4cyclictest121rcu_preempt10:19:591
2260498264,4cyclictest121rcu_preempt09:45:191
2260498261,5cyclictest121rcu_preempt08:30:501
2260498261,4cyclictest11132-21ps10:30:401
2260498261,4cyclictest0-21swapper/107:15:211
75382250,2sleep10-21swapper/107:51:521
2261198255,4cyclictest32060-21irqrtprio12:25:213
2261198254,3cyclictest121rcu_preempt09:14:513
22611982519,3cyclictest3312chrt07:35:143
2261198251,4cyclictest4038-21modprobe12:35:213
2261198251,4cyclictest4038-21modprobe12:35:213
2261198251,4cyclictest32234-21ssh11:15:233
2261198251,4cyclictest25558-21grep09:55:003
2260498255,4cyclictest121rcu_preempt12:33:581
2260498255,4cyclictest121rcu_preempt11:39:131
2260498252,7cyclictest3934-21diskmemload12:20:301
22604982518,4cyclictest19-21ksoftirqd/110:50:341
2260498251,7cyclictest8897-21ntpq07:55:331
2260498251,7cyclictest12483-21ntpq11:40:341
2260498251,7cyclictest12483-21ntpq11:40:341
2260498251,4cyclictest121rcu_preempt10:00:461
2260498251,4cyclictest121rcu_preempt08:20:231
2260498250,10cyclictest0-21swapper/109:20:261
217252250,14sleep119-21ksoftirqd/112:01:041
168022250,13sleep10-21swapper/108:16:161
2261198244,4cyclictest121rcu_preempt09:49:523
2261198241,3cyclictest121rcu_preempt11:30:363
2261198240,3cyclictest121rcu_preempt09:40:183
2260498243,4cyclictest121rcu_preempt10:20:171
2260498242,4cyclictest121rcu_preempt10:40:211
2260498241,4cyclictest7819-21ssh10:25:151
2260498241,4cyclictest121rcu_preempt08:10:361
2260498240,3cyclictest121rcu_preempt07:30:221
2260498240,3cyclictest121rcu_preempt07:30:221
37002230,12sleep331-21ksoftirqd/309:07:263
2261198232,3cyclictest121rcu_preempt12:05:223
2261198231,5cyclictest121rcu_preempt08:55:333
2261198231,5cyclictest121rcu_preempt08:55:333
2261198231,3cyclictest121rcu_preempt07:27:073
2261198231,3cyclictest0-21swapper/310:22:293
2261198231,2cyclictest0-21swapper/310:00:013
2260498234,3cyclictest121rcu_preempt07:10:151
2260498232,5cyclictest121rcu_preempt09:05:481
2260498232,4cyclictest121rcu_preempt08:50:231
2261198225,5cyclictest121rcu_preempt10:35:333
2261198222,4cyclictest121rcu_preempt11:25:303
2261198221,4cyclictest14870-21vmstat08:10:433
2261198221,3cyclictest121rcu_preempt07:40:253
2261198221,3cyclictest121rcu_preempt07:40:253
22611982213,6cyclictest26803-21sshd12:14:333
22611982212,7cyclictest24520-21sshd07:13:343
2260498221,4cyclictest121rcu_preempt11:45:341
2260498221,3cyclictest121rcu_preempt07:40:171
2260498221,3cyclictest121rcu_preempt07:40:171
188642220,11sleep331-21ksoftirqd/308:23:253
2261198212,3cyclictest121rcu_preempt09:00:263
2261198211,4cyclictest121rcu_preempt08:30:003
2261198211,4cyclictest0-21swapper/308:45:263
22611982112,6cyclictest25576-21ssh11:00:353
2261198210,3cyclictest121rcu_preempt08:15:173
2261198210,2cyclictest0-21swapper/310:40:193
114922210,11sleep331-21ksoftirqd/308:04:403
65972200,9sleep331-21ksoftirqd/309:15:113
318652200,9sleep331-21ksoftirqd/307:30:403
318652200,9sleep331-21ksoftirqd/307:30:403
2261198201,4cyclictest0-21swapper/309:30:463
22611982013,4cyclictest3934-21diskmemload12:23:153
22611982013,4cyclictest3851-21ntpq10:15:373
22611982013,4cyclictest3851-21ntpq10:15:373
22611982013,4cyclictest27348-21if_err_eth107:20:373
22611982012,5cyclictest890-21if_eth010:10:263
22611982012,5cyclictest890-21if_eth010:10:263
22611982012,4cyclictest25975-21ntpq08:40:303
2261198200,4cyclictest7857-21ssh10:25:173
2261198193,8cyclictest244452kworker/u8:2507:17:033
2261198192,8cyclictest286372kworker/u8:1711:08:193
2261198192,3cyclictest32295-21kworker/u8:3207:46:043
2261198191,3cyclictest121rcu_preempt07:53:123
22611981912,4cyclictest30491-21latency_hist08:55:023
22611981912,4cyclictest21432-21aten2_rfpower_e08:30:313
162622190,7sleep316267-21irqrtprio11:50:253
22611981811,4cyclictest3934-21diskmemload11:55:143
22611981811,4cyclictest27948-21ntpq12:15:323
2261198180,3cyclictest0-21swapper/311:45:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional