You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 11:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Sun Nov 30, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1665122840,2sleep20-21swapper/219:05:262
1672022770,3sleep30-21swapper/319:05:273
1675822640,2sleep113575-21kworker/u8:419:05:291
1765998219210,6cyclictest5731-21kworker/u8:8920:07:082
1765898202195,4cyclictest1887-21kworker/u8:020:07:071
1766198174168,4cyclictest5670-21kworker/u8:2820:07:073
1765398110100,7cyclictest10-21ksoftirqd/020:07:070
176589810194,4cyclictest7043-21kworker/u8:2823:47:171
176589810194,4cyclictest7043-21kworker/u8:2823:47:171
1169021010,2sleep20-21swapper/221:38:122
17661988780,4cyclictest14201-21kworker/u8:2721:47:283
17658987567,5cyclictest22491-21kworker/u8:2123:37:031
17661987467,4cyclictest29778-21kworker/u8:2023:47:183
17661987467,4cyclictest29778-21kworker/u8:2023:47:173
17659987266,4cyclictest19023-21kworker/u8:921:57:562
17659986560,3cyclictest26601-21kworker/u8:819:56:582
17658986458,3cyclictest17326-21kworker/u8:3319:11:541
17658986255,4cyclictest21083-21kworker/u8:1919:22:041
17658985346,4cyclictest28544-21kworker/u8:2319:56:571
17658985122,6cyclictest19-21ksoftirqd/123:55:161
17659984943,4cyclictest28063-21kworker/u8:3321:21:522
17661984740,4cyclictest29775-21kworker/u8:1723:37:033
10602470,14sleep10-21swapper/100:36:421
88102430,3sleep18802-21munin-run22:40:011
51712420,7chrt19-21ksoftirqd/121:25:111
17658984236,3cyclictest7591-21kworker/u8:1620:12:161
21692400,1sleep10-21swapper/123:32:001
17658984034,4cyclictest18710-21kworker/u8:1820:41:561
17661983932,4cyclictest13574-21kworker/u8:319:11:543
17659983933,4cyclictest1896-21kworker/u8:1420:02:002
17659983833,3cyclictest8349-21kworker/u8:522:57:072
17659983832,4cyclictest1143-21kworker/u8:522:36:422
1765998381,10cyclictest25-21ksoftirqd/200:30:152
66252370,2sleep30-21swapper/321:26:343
1765998378,4cyclictest121rcu_preempt22:20:212
1765998360,6cyclictest25-21ksoftirqd/220:40:172
17661983529,4cyclictest21091-21kworker/u8:2719:22:043
1766198351,6cyclictest0-21swapper/322:25:173
1765998355,4cyclictest121rcu_preempt22:20:002
17659983513,11cyclictest121rcu_preempt20:15:022
1765898355,5cyclictest121rcu_preempt22:40:141
7942340,12sleep3121rcu_preempt23:30:183
46582330,7sleep331-21ksoftirqd/321:23:463
313112330,8sleep1191ksoftirqd/121:10:401
1765998334,9cyclictest25-21ksoftirqd/223:50:162
1765998334,5cyclictest25-21ksoftirqd/223:30:002
1765998334,5cyclictest25-21ksoftirqd/223:30:002
1765998333,18cyclictest121rcu_preempt20:20:002
67252320,2sleep20-21swapper/223:40:472
17661983225,3cyclictest9456-21kworker/u8:420:31:543
1766198321,3cyclictest121rcu_preempt22:20:143
17659983210,13cyclictest121rcu_preempt00:15:162
1765898327,4cyclictest121rcu_preempt23:25:291
1765898327,4cyclictest121rcu_preempt23:25:291
17658983216,4cyclictest19-21ksoftirqd/123:40:301
17658983215,4cyclictest19-21ksoftirqd/121:55:301
255532310,2sleep20-21swapper/219:30:212
242762310,3sleep120273-1kworker/u9:223:10:331
242762310,3sleep120273-1kworker/u9:223:10:331
218602310,8sleep3121rcu_preempt00:13:203
204962310,7sleep2251ksoftirqd/223:03:302
1765998314,6cyclictest25-21ksoftirqd/200:10:252
1765998312,5cyclictest25-21ksoftirqd/200:25:012
17659983124,4cyclictest20594-21kworker/u8:820:52:122
1765898316,5cyclictest121rcu_preempt22:15:001
1765898316,4cyclictest121rcu_preempt22:55:161
1765898313,5cyclictest27700-21kworker/1:221:40:461
1765898313,4cyclictest121rcu_preempt20:50:241
17658983124,4cyclictest30119-21diskmemload00:15:151
17658983124,4cyclictest19-21ksoftirqd/100:30:131
17658983115,4cyclictest19-21ksoftirqd/119:40:431
17658983114,4cyclictest19-21ksoftirqd/121:45:371
17658983112,9cyclictest19-21ksoftirqd/122:05:381
17658983112,9cyclictest19-21ksoftirqd/122:05:381
17653983112,15cyclictest0-21swapper/022:15:180
95372300,6sleep331-21ksoftirqd/320:13:163
50312300,2sleep30-21swapper/322:30:263
247072300,18sleep10-21swapper/119:25:501
17661983024,4cyclictest19033-21kworker/u8:1921:57:553
17661983022,4cyclictest31-21ksoftirqd/319:40:283
1766198301,3cyclictest0-21swapper/323:55:143
1766198301,12cyclictest0-21swapper/321:35:273
1765998303,4cyclictest121rcu_preempt21:55:022
1765998303,4cyclictest121rcu_preempt20:25:242
17659983012,10cyclictest121rcu_preempt00:25:262
1765898308,13cyclictest181rcuc/121:30:431
1765898308,13cyclictest181rcuc/121:30:431
1765898304,5cyclictest19-21ksoftirqd/100:25:361
17658983018,4cyclictest19-21ksoftirqd/100:00:391
17658983016,3cyclictest19-21ksoftirqd/122:50:291
17658983015,4cyclictest19-21ksoftirqd/123:50:151
17658983015,4cyclictest19-21ksoftirqd/121:20:361
17658983014,9cyclictest19-21ksoftirqd/123:00:431
17658983014,4cyclictest19-21ksoftirqd/120:55:351
17658983010,7cyclictest19-21ksoftirqd/120:25:231
152442300,3sleep215243-21df_inode21:45:242
258672290,16sleep322671-21kworker/u8:2323:15:173
258672290,16sleep322671-21kworker/u8:2323:15:173
251312290,1sleep319234-21kworker/u8:1600:20:193
245222290,17sleep324307-21kworker/u8:920:54:573
1766198294,4cyclictest121rcu_preempt23:15:003
1766198294,4cyclictest121rcu_preempt23:15:003
1766198293,3cyclictest121rcu_preempt22:00:263
1766198293,3cyclictest121rcu_preempt22:00:263
1766198293,12cyclictest4415-21cut20:00:213
1766198291,5cyclictest21502-21sed19:20:013
1766198291,3cyclictest121rcu_preempt20:20:153
1766198291,12cyclictest0-21swapper/321:10:153
1765998299,10cyclictest121rcu_preempt22:00:222
1765998299,10cyclictest121rcu_preempt22:00:212
1765998296,5cyclictest121rcu_preempt19:20:002
1765998296,4cyclictest121rcu_preempt21:15:142
1765998295,5cyclictest25-21ksoftirqd/219:35:252
1765998295,5cyclictest25-21ksoftirqd/219:35:252
1765998294,4cyclictest121rcu_preempt22:35:022
1765998293,5cyclictest25-21ksoftirqd/219:25:012
1765898295,5cyclictest20717-21kworker/1:023:05:241
1765898294,4cyclictest0-21swapper/120:05:001
1765898293,4cyclictest121rcu_preempt19:45:351
1765898292,4cyclictest121rcu_preempt22:30:341
17658982914,4cyclictest19-21ksoftirqd/120:35:311
1765898291,3cyclictest121rcu_preempt21:50:161
17658982912,4cyclictest19-21ksoftirqd/122:15:361
171772290,2sleep20-21swapper/200:03:382
155482290,15sleep315427-21kworker/u8:1222:52:453
135492290,2sleep20-21swapper/221:40:502
29932280,2sleep20-21swapper/223:35:072
1766198285,11cyclictest4181-21latency_hist20:00:013
1766198282,3cyclictest121rcu_preempt22:35:133
1765998289,13cyclictest25-21ksoftirqd/219:40:302
1765998289,12cyclictest121rcu_preempt22:40:352
1765998288,4cyclictest121rcu_preempt23:15:292
1765998288,4cyclictest121rcu_preempt23:15:292
1765998286,4cyclictest121rcu_preempt22:10:412
1765998285,4cyclictest121rcu_preempt22:50:352
1765998284,5cyclictest121rcu_preempt23:45:142
1765998284,5cyclictest121rcu_preempt23:45:142
1765998284,4cyclictest121rcu_preempt23:30:272
1765998284,4cyclictest121rcu_preempt21:25:172
1765998283,5cyclictest25-21ksoftirqd/222:27:482
1765998282,4cyclictest121rcu_preempt23:20:192
1765998282,4cyclictest121rcu_preempt00:35:222
17659982816,3cyclictest25-21ksoftirqd/223:55:232
1765998281,4cyclictest121rcu_preempt21:10:002
1765898284,7cyclictest121rcu_preempt22:00:161
1765898284,7cyclictest121rcu_preempt22:00:161
1765898282,4cyclictest121rcu_preempt23:25:001
17658982820,4cyclictest19-21ksoftirqd/121:35:381
1765898281,5cyclictest121rcu_preempt19:50:141
17658982813,4cyclictest19-21ksoftirqd/100:20:271
17658982812,4cyclictest19-21ksoftirqd/120:15:321
17658982812,4cyclictest19-21ksoftirqd/100:10:291
13652280,5sleep331-21ksoftirqd/300:38:093
126582280,7sleep225-21ksoftirqd/220:20:352
112602280,6sleep3311ksoftirqd/322:45:003
327132270,2sleep30-21swapper/321:15:053
181552270,15sleep214989-21kworker/u8:3720:35:312
1766198277,4cyclictest121rcu_preempt00:05:263
1766198274,3cyclictest121rcu_preempt22:05:153
1766198274,3cyclictest121rcu_preempt22:05:143
1766198272,4cyclictest121rcu_preempt20:45:253
1766198271,3cyclictest121rcu_preempt23:05:263
1766198271,3cyclictest121rcu_preempt21:40:383
17661982712,9cyclictest121rcu_preempt23:40:343
1765998276,3cyclictest121rcu_preempt21:10:432
1765998275,4cyclictest121rcu_preempt19:45:282
1765998274,5cyclictest25-21ksoftirqd/222:45:372
1765998274,4cyclictest121rcu_preempt21:00:442
1765998274,4cyclictest121rcu_preempt20:45:432
1765998272,5cyclictest25-21ksoftirqd/221:30:192
1765998272,5cyclictest25-21ksoftirqd/221:30:182
1765998271,8cyclictest1207-21cat19:50:262
1765998271,7cyclictest25-21ksoftirqd/220:30:152
1765998271,5cyclictest121rcu_preempt00:05:362
1765998271,4cyclictest0-21swapper/220:55:332
1765898275,4cyclictest121rcu_preempt22:45:271
1765898271,5cyclictest18498-21ntpq00:05:271
17658982714,3cyclictest19-21ksoftirqd/121:05:311
17658982713,4cyclictest19-21ksoftirqd/119:15:351
17658982713,3cyclictest19-21ksoftirqd/122:25:401
17658982713,3cyclictest19-21ksoftirqd/122:24:121
1765398271,14cyclictest8815-21idleruntime-cro22:40:010
170072270,5sleep1191ksoftirqd/120:33:581
114492270,5sleep3121rcu_preempt23:50:403
308632260,2sleep30-21swapper/322:16:503
276192260,1sleep319234-21kworker/u8:1600:25:263
262172260,2sleep30-21swapper/320:57:553
1766198261,10cyclictest0-21swapper/321:54:473
1765998266,4cyclictest121rcu_preempt23:10:252
1765998266,4cyclictest121rcu_preempt23:10:242
1765998265,4cyclictest121rcu_preempt23:05:142
1765998264,6cyclictest25-21ksoftirqd/219:10:382
1765998261,3cyclictest121rcu_preempt19:25:502
1765898267,14cyclictest121rcu_preempt19:30:271
1765898263,7cyclictest19-21ksoftirqd/123:15:221
1765898263,7cyclictest19-21ksoftirqd/123:15:221
17658982611,4cyclictest19-21ksoftirqd/119:35:341
17658982611,4cyclictest19-21ksoftirqd/119:35:331
17658982611,3cyclictest19-21ksoftirqd/121:00:321
17658982611,3cyclictest19-21ksoftirqd/120:45:281
17658982610,4cyclictest19-21ksoftirqd/120:20:401
130462260,3sleep313045-21ssh22:47:143
1766198254,3cyclictest121rcu_preempt20:25:393
1766198253,3cyclictest121rcu_preempt20:40:333
1766198252,3cyclictest121rcu_preempt23:20:203
17661982516,6cyclictest27680-21ssh22:10:273
1766198250,3cyclictest121rcu_preempt20:35:423
1765998253,3cyclictest121rcu_preempt22:05:382
1765998253,3cyclictest121rcu_preempt22:05:372
17658982511,3cyclictest19-21ksoftirqd/121:15:131
1765398256,11cyclictest9946-21chrt21:35:160
21162240,2sleep31887-21kworker/u8:019:54:323
1766198244,5cyclictest31-21ksoftirqd/321:05:453
1766198244,3cyclictest121rcu_preempt00:30:243
1766198242,3cyclictest121rcu_preempt00:00:223
1766198241,6cyclictest22850-21tr00:15:243
1766198241,2cyclictest121rcu_preempt19:35:153
1766198241,2cyclictest121rcu_preempt19:35:153
111982240,2sleep30-21swapper/320:16:033
324502230,5sleep331-21ksoftirqd/323:28:243
324502230,5sleep331-21ksoftirqd/323:28:243
323772230,1sleep322980-21kworker/u8:619:46:103
1766198238,4cyclictest31-21ksoftirqd/323:00:313
1766198234,3cyclictest121rcu_preempt22:55:413
1766198231,5cyclictest26897-21modprobe19:35:003
1766198231,3cyclictest121rcu_preempt19:25:183
1766198231,3cyclictest0-21swapper/321:30:373
1766198231,3cyclictest0-21swapper/321:30:373
1766198221,3cyclictest121rcu_preempt21:00:333
1765398222,4cyclictest32011-21ssh00:35:160
17653982214,6cyclictest26649-21sh23:15:290
17653982214,6cyclictest26649-21sh23:15:290
17653982212,6cyclictest10909-21irqrtprio23:50:260
17653982113,5cyclictest0-21swapper/022:05:010
17653982113,5cyclictest0-21swapper/022:05:000
17653982112,7cyclictest8380-21sshd21:30:310
17653982112,7cyclictest8380-21sshd21:30:300
17653982112,7cyclictest31585-21rm00:34:150
17653982111,8cyclictest30119-21diskmemload22:12:130
17653982110,9cyclictest18011-21sh00:05:220
1765398208,10cyclictest3159-21/usr/sbin/munin19:55:270
1765398203,11cyclictest30419-21ssh23:25:010
1765398202,7cyclictest224452kworker/u8:021:11:230
17653982015,3cyclictest327-21ntpq22:20:340
17653982015,3cyclictest10-21ksoftirqd/000:17:000
17653982014,3cyclictest22070-21mailstats23:05:390
17653982014,3cyclictest10-21ksoftirqd/022:50:170
17653982012,6cyclictest2770-21sh22:25:310
1765398201,11cyclictest0-21swapper/022:05:150
1765398201,11cyclictest0-21swapper/022:05:150
17653982010,3cyclictest11318-21ssh22:45:020
1765398199,7cyclictest5178-21rm21:25:150
17653981914,3cyclictest9696-21idleruntime-cro20:15:000
17653981914,3cyclictest28024-21ssh00:25:320
17653981914,3cyclictest24364-21ntpq19:25:460
17653981914,3cyclictest15772-21sshd21:45:310
17653981912,5cyclictest5833-21irqrtprio23:40:270
17653981912,5cyclictest2205-21sh21:18:380
17653981911,6cyclictest25606-21missed_timers00:20:260
17653981911,6cyclictest17370-21aten2_rfpower_c21:50:190
17653981911,6cyclictest17311-21sh00:04:220
17653981911,6cyclictest12247-21sh22:45:290
1765398191,10cyclictest908-21ssh23:30:220
17653981910,7cyclictest8100-21apt-get23:45:140
17653981910,7cyclictest8100-21apt-get23:45:140
17653981910,7cyclictest19455-21cron19:15:010
1765398189,7cyclictest3009-21/usr/sbin/munin23:35:230
1765398187,9cyclictest32020-21ssh23:26:060
1765398187,9cyclictest32020-21ssh23:26:060
1765398182,5cyclictest17868-21kworker/u8:1022:57:160
17653981813,3cyclictest3628-21gcc21:20:340
17653981813,3cyclictest23737-21ntpq20:50:310
17653981813,3cyclictest20475-21ntpq19:15:330
17653981813,3cyclictest19475-21ntpq23:00:290
17653981813,3cyclictest10-21ksoftirqd/022:30:140
17653981813,3cyclictest10-21ksoftirqd/020:35:150
17653981813,3cyclictest10-21ksoftirqd/020:15:170
17653981813,3cyclictest10-21ksoftirqd/000:10:170
17653981812,4cyclictest10-21ksoftirqd/023:10:160
17653981812,4cyclictest10-21ksoftirqd/023:10:160
17653981812,3cyclictest19747-21/usr/sbin/munin21:55:230
17653981812,3cyclictest10-21ksoftirqd/019:40:190
17653981810,6cyclictest878-21irqrtprio19:50:250
17653981810,6cyclictest14600-21processes20:25:400
17653981810,6cyclictest1405-21sshd19:20:270
17653981810,6cyclictest13659-21missed_timers23:55:270
17653981810,6cyclictest12625-21sh21:40:250
17653981810,6cyclictest11936-21aten2_rfpower_p20:20:190
17653981712,3cyclictest27392-21/usr/sbin/munin19:35:210
17653981712,3cyclictest27392-21/usr/sbin/munin19:35:210
17653981712,3cyclictest26089-21ntpq19:30:330
17653981712,3cyclictest21983-21ntpq20:45:400
17653981712,3cyclictest16403-21ntpq20:30:400
17653981712,3cyclictest10-21ksoftirqd/021:00:160
17653981712,3cyclictest10-21ksoftirqd/020:00:190
17653981710,5cyclictest1405-21sshd20:42:530
1765398168,6cyclictest28540-1kworker/u9:019:45:150
17653981611,3cyclictest28828-21/usr/sbin/munin21:05:260
17653981510,3cyclictest10-21ksoftirqd/020:55:180
1765398142,9cyclictest17758-21latency_hist19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional