You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 23:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Sat Nov 22, 2025 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2285523420,2sleep1121rcu_preempt07:05:251
2418998306297,6cyclictest2539-21kworker/u8:809:07:082
2386222590,17sleep20-21swapper/207:06:542
2418398258252,3cyclictest1050ksoftirqd/009:07:090
2256122530,2sleep30-21swapper/307:05:193
2418798214205,6cyclictest2585-21kworker/u8:5509:07:091
2419298180175,3cyclictest2542-21kworker/u8:1109:07:093
178321320,2sleep30-21swapper/312:20:503
3023921280,2sleep127698-21kworker/u8:6007:25:191
2717021220,2sleep10-21swapper/108:40:441
24192988984,3cyclictest6129-21kworker/u8:110:22:063
87162790,3sleep38715-21ssh11:30:253
87162790,3sleep38715-21ssh11:30:243
31522790,2chrt0-21swapper/312:25:243
24189987367,3cyclictest27562-21kworker/u8:1207:22:412
24192986964,3cyclictest2659-21kworker/u8:007:42:093
24189985852,3cyclictest25611-21kworker/u8:008:52:002
264952480,22sleep3301rcuc/309:53:243
2418998453,3cyclictest121rcu_preempt11:45:202
2418998451,4cyclictest121rcu_preempt10:00:242
157472450,2chrt0-21swapper/210:36:222
24192984338,3cyclictest12602-21kworker/u8:008:07:453
24192984136,3cyclictest21395-21kworker/u8:509:57:193
24192984035,3cyclictest8605-21kworker/u8:708:01:453
2419298397,3cyclictest121rcu_preempt07:25:143
24192983912,4cyclictest121rcu_preempt10:55:283
254252380,2sleep10-21swapper/109:50:291
24189983832,3cyclictest4537-21kworker/u8:1509:12:162
2419298365,19cyclictest121rcu_preempt11:35:163
2418998363,3cyclictest121rcu_preempt09:50:172
51252330,8sleep119-21ksoftirqd/107:45:021
31602330,2chrt0-21swapper/112:25:271
2419298338,5cyclictest31-21ksoftirqd/309:25:003
2418998331,3cyclictest121rcu_preempt08:15:182
24183983323,7cyclictest10-21ksoftirqd/007:22:410
157942330,4sleep119-21ksoftirqd/110:36:371
94662320,19sleep331-21ksoftirqd/312:36:433
2418998322,10cyclictest121rcu_preempt08:00:292
2418798323,7cyclictest1050-21grep12:20:241
252712310,18sleep222048-21kworker/u8:807:10:372
252712310,18sleep222048-21kworker/u8:807:10:362
2418998311,3cyclictest121rcu_preempt10:30:162
223182300,2sleep10-21swapper/109:45:221
2419298297,4cyclictest121rcu_preempt11:20:163
2419298295,9cyclictest121rcu_preempt08:15:453
2418998291,3cyclictest121rcu_preempt12:00:142
2418798295,6cyclictest19-21ksoftirqd/111:55:281
2418798293,8cyclictest29679-21ntp_states11:05:391
2418798293,7cyclictest19-21ksoftirqd/111:10:151
2418798293,5cyclictest5868-21ntpq09:10:301
8952280,6sleep21983-21bootmenu07:33:082
310902280,6sleep1181rcuc/110:01:021
2419298288,11cyclictest31-21ksoftirqd/309:30:413
2419298288,11cyclictest31-21ksoftirqd/309:30:413
2419298287,3cyclictest121rcu_preempt11:47:203
2419298285,4cyclictest121rcu_preempt12:00:403
24192982810,3cyclictest121rcu_preempt07:15:153
2418998283,3cyclictest121rcu_preempt10:45:162
2418798287,6cyclictest19-21ksoftirqd/108:50:321
2418798286,5cyclictest19-21ksoftirqd/110:20:181
2418798283,6cyclictest13932-21ntpq08:05:401
2418798283,4cyclictest19-21ksoftirqd/109:00:301
309672270,12sleep225-21ksoftirqd/207:25:412
297052270,6sleep331-21ksoftirqd/310:00:123
2419298278,6cyclictest121rcu_preempt09:15:233
2419298275,3cyclictest121rcu_preempt11:10:013
2419298274,9cyclictest121rcu_preempt11:40:223
2419298273,4cyclictest121rcu_preempt11:50:243
24192982712,5cyclictest31-21ksoftirqd/311:25:143
2419298270,4cyclictest0-21swapper/310:10:453
24189982714,3cyclictest25-21ksoftirqd/212:25:002
2418798275,6cyclictest19-21ksoftirqd/111:30:531
2418798275,6cyclictest19-21ksoftirqd/111:30:521
2418798275,5cyclictest19-21ksoftirqd/111:40:251
2418798275,4cyclictest19-21ksoftirqd/108:55:371
2418798274,6cyclictest19-21ksoftirqd/109:55:201
2418798274,6cyclictest19-21ksoftirqd/107:45:291
2418798274,4cyclictest19-21ksoftirqd/109:15:421
2418798272,5cyclictest19-21ksoftirqd/112:35:481
2418798272,10cyclictest19-21ksoftirqd/107:40:021
2418798271,9cyclictest26620-21python312:05:431
2418798270,9cyclictest23485-21ssh10:54:051
2418798270,11cyclictest3009-21taskset11:18:161
232402270,2sleep10-21swapper/112:00:171
213162270,17sleep20-21swapper/209:41:412
18552270,4chrt0-21swapper/307:35:263
141852270,10sleep2241rcuc/209:27:182
141852270,10sleep2241rcuc/209:27:182
119072270,2sleep30-21swapper/310:30:123
7702260,5sleep2251ksoftirqd/211:14:422
288572260,1sleep225620-21kworker/u8:1408:45:402
278252260,2sleep21983-21bootmenu07:19:022
2419298267,4cyclictest121rcu_preempt10:50:273
2419298267,3cyclictest121rcu_preempt11:55:243
2419298267,10cyclictest121rcu_preempt12:15:293
2419298264,4cyclictest121rcu_preempt09:00:233
2419298263,3cyclictest121rcu_preempt08:25:383
2419298261,3cyclictest0-21swapper/310:35:293
24192982613,3cyclictest31-21ksoftirqd/310:05:043
2418998265,6cyclictest25-21ksoftirqd/207:45:012
2418998265,4cyclictest121rcu_preempt07:35:232
2418998265,3cyclictest121rcu_preempt12:30:012
2418998264,4cyclictest121rcu_preempt11:25:012
2418998261,3cyclictest121rcu_preempt08:10:152
2418998261,3cyclictest121rcu_preempt08:10:152
2418798265,5cyclictest19-21ksoftirqd/112:30:461
2418798265,5cyclictest19-21ksoftirqd/112:30:451
2418798264,4cyclictest19-21ksoftirqd/111:20:341
2418798263,5cyclictest19-21ksoftirqd/111:28:061
2418798263,5cyclictest19-21ksoftirqd/109:26:561
2418798263,5cyclictest19-21ksoftirqd/109:26:561
2418798263,5cyclictest0-21swapper/110:05:271
2418798263,4cyclictest19-21ksoftirqd/109:21:261
2418798263,4cyclictest19-21ksoftirqd/107:10:241
2418798263,4cyclictest19-21ksoftirqd/107:10:241
2418798262,7cyclictest19-21ksoftirqd/108:20:311
2418798262,5cyclictest22713-21irqrtprio08:30:241
2418798262,5cyclictest22713-21irqrtprio08:30:241
2418798261,8cyclictest13039-21ssh11:39:111
2418798261,6cyclictest19-21ksoftirqd/110:28:351
2418398264,20cyclictest118550irq/29-4f00000.09:43:000
2419298256,4cyclictest121rcu_preempt09:28:553
2419298256,4cyclictest121rcu_preempt09:28:553
2419298255,3cyclictest121rcu_preempt10:40:093
2419298254,4cyclictest121rcu_preempt12:07:133
2419298254,4cyclictest121rcu_preempt09:10:333
2419298253,2cyclictest121rcu_preempt11:15:213
24192982513,4cyclictest31-21ksoftirqd/309:45:343
2418998252,3cyclictest121rcu_preempt08:35:552
2418798255,5cyclictest19-21ksoftirqd/108:19:591
2418798255,5cyclictest19-21ksoftirqd/108:00:311
2418798255,4cyclictest19-21ksoftirqd/107:20:501
2418798254,4cyclictest19-21ksoftirqd/109:33:241
2418798254,4cyclictest19-21ksoftirqd/109:33:231
2418798253,6cyclictest19-21ksoftirqd/110:45:421
2418798252,5cyclictest20481-21apt08:25:131
2418798251,6cyclictest19-21ksoftirqd/110:30:181
2418798251,6cyclictest10701-21munin-run08:00:001
2418798251,5cyclictest19236-21ntpq11:50:381
2418798251,5cyclictest19-21ksoftirqd/107:50:321
163182250,6sleep3121rcu_preempt08:12:523
163182250,6sleep3121rcu_preempt08:12:523
154962250,4sleep225-21ksoftirqd/211:44:312
76292240,5sleep2251ksoftirqd/212:34:492
76292240,5sleep2251ksoftirqd/212:34:482
287332240,2sleep20-21swapper/209:57:382
274412240,2sleep21983-21bootmenu08:41:502
25112240,2sleep21983-21bootmenu09:01:522
2419298248,3cyclictest31-21ksoftirqd/308:40:403
2419298248,3cyclictest121rcu_preempt08:30:193
2419298248,3cyclictest121rcu_preempt08:30:183
2419298246,3cyclictest121rcu_preempt07:50:373
2419298245,4cyclictest121rcu_preempt11:00:353
2419298244,4cyclictest121rcu_preempt08:50:363
2419298244,3cyclictest121rcu_preempt07:20:343
2419298242,3cyclictest121rcu_preempt07:55:353
2419298242,3cyclictest121rcu_preempt07:45:383
2419298241,4cyclictest0-21swapper/310:15:253
2419298241,3cyclictest121rcu_preempt12:32:003
2419298241,3cyclictest121rcu_preempt12:31:593
2419298240,3cyclictest121rcu_preempt08:55:323
2418998245,3cyclictest121rcu_preempt09:30:172
2418998245,3cyclictest121rcu_preempt09:30:172
2418998243,4cyclictest121rcu_preempt11:55:252
2418998243,3cyclictest121rcu_preempt11:00:332
2418998242,3cyclictest121rcu_preempt08:55:212
24189982411,3cyclictest25-21ksoftirqd/209:40:002
2418798244,4cyclictest19-21ksoftirqd/108:10:591
2418798244,4cyclictest19-21ksoftirqd/108:10:581
2418798243,5cyclictest19-21ksoftirqd/110:40:151
2418798243,4cyclictest19-21ksoftirqd/109:35:391
2418798243,4cyclictest19-21ksoftirqd/107:30:441
2418798242,6cyclictest28576-21kernelversion12:10:261
2418798242,5cyclictest19-21ksoftirqd/111:45:341
2418798242,5cyclictest19-21ksoftirqd/110:55:241
2418798241,4cyclictest26337-21apt-get11:00:151
2418798241,10cyclictest19-21ksoftirqd/108:38:481
2418798240,6cyclictest19-21ksoftirqd/109:40:451
2418798240,4cyclictest19-21ksoftirqd/108:45:291
2418798240,4cyclictest0-21swapper/110:11:411
2418398241,16cyclictest93192sleep012:36:000
217592240,2sleep218124-21kworker/u8:1108:26:022
145682240,4sleep225-21ksoftirqd/208:09:052
97002230,12sleep29582-21kworker/u8:3912:37:502
90832230,2sleep20-21swapper/207:55:132
84882230,1sleep26148-21kworker/u8:2610:21:182
2419298235,3cyclictest121rcu_preempt12:11:263
2419298235,3cyclictest121rcu_preempt10:25:443
2419298233,6cyclictest313812kworker/u8:407:30:193
2419298233,5cyclictest121rcu_preempt07:10:203
2419298233,5cyclictest121rcu_preempt07:10:193
2419298233,4cyclictest121rcu_preempt09:40:373
2419298232,4cyclictest121rcu_preempt11:10:313
2419298232,4cyclictest121rcu_preempt08:35:423
2419298231,4cyclictest121rcu_preempt10:45:163
2418998234,4cyclictest121rcu_preempt09:15:432
2418998233,3cyclictest121rcu_preempt11:30:152
2418998233,3cyclictest121rcu_preempt11:30:152
2418998231,6cyclictest9464-21/usr/sbin/munin10:25:432
2418998231,6cyclictest4491-1kworker/u9:010:40:272
2418998231,5cyclictest18572-21df_inode11:50:212
2418998231,4cyclictest4978-21ssh10:15:252
2418998231,4cyclictest0-21swapper/210:50:402
2418998231,3cyclictest0-21swapper/211:25:482
2418998230,3cyclictest0-21swapper/211:20:012
2418798234,4cyclictest19-21ksoftirqd/112:15:431
2418798233,5cyclictest19-21ksoftirqd/110:15:291
2418798233,4cyclictest19-21ksoftirqd/107:15:141
295642220,5sleep225-21ksoftirqd/211:05:292
259432220,11sleep225-21ksoftirqd/210:59:302
254992220,1sleep224747-21kworker/u8:012:05:082
2419298225,3cyclictest121rcu_preempt08:46:093
2419298221,4cyclictest121rcu_preempt08:20:153
2419298220,3cyclictest121rcu_preempt09:35:383
2418998229,3cyclictest25-21ksoftirqd/211:35:252
2418998223,4cyclictest121rcu_preempt12:15:182
2418398221,16cyclictest118550irq/29-4f00000.08:51:590
2418998214,3cyclictest121rcu_preempt07:49:512
2418998212,3cyclictest121rcu_preempt09:47:032
2418398219,10cyclictest2045-21sh12:22:090
2418398212,3cyclictest118550irq/29-4f00000.10:15:450
236392210,11sleep225-21ksoftirqd/208:31:162
236392210,11sleep225-21ksoftirqd/208:31:152
279122200,10sleep21983-21bootmenu12:10:042
2418998205,4cyclictest121rcu_preempt08:20:262
2418998204,3cyclictest121rcu_preempt10:05:292
2418998201,3cyclictest121rcu_preempt07:50:482
24183982014,3cyclictest118550irq/29-4f00000.09:15:160
121102200,2sleep2251ksoftirqd/209:24:002
2418398197,4cyclictest0-21swapper/009:26:350
2418398197,4cyclictest0-21swapper/009:26:340
24183981915,2cyclictest118550irq/29-4f00000.09:30:430
24183981915,2cyclictest118550irq/29-4f00000.09:30:430
24183981914,3cyclictest10-21ksoftirqd/011:50:180
24183981913,4cyclictest17612-21rm10:40:320
24183981911,6cyclictest10-21ksoftirqd/008:36:250
2418398190,9cyclictest118550irq/29-4f00000.08:04:590
2418998180,3cyclictest121rcu_preempt10:10:412
2418398189,5cyclictest28752-21ntpq08:45:310
2418398188,8cyclictest3617-21sh10:11:250
2418398188,8cyclictest2167-21ntp_kernel_pll_07:35:330
2418398188,6cyclictest14192-21timerandwakeup08:05:590
2418398183,4cyclictest16569-21latency_hist10:40:010
24183981813,3cyclictest10-21ksoftirqd/010:05:160
24183981811,5cyclictest5774-21latency_hist11:25:020
2418398181,10cyclictest21466-21cat11:55:270
24183981810,6cyclictest9175-21aten2_rfpower_f07:55:180
24183981810,6cyclictest4044-21ntp_offset12:25:480
2418398179,6cyclictest28972-21sh09:58:560
2418398179,6cyclictest20479-21/usr/sbin/munin08:25:380
2418398179,6cyclictest14896-21/usr/sbin/munin08:10:180
2418398179,6cyclictest14896-21/usr/sbin/munin08:10:170
2418398178,7cyclictest6320-21diskstats11:25:240
2418398178,7cyclictest27604-21sh12:09:440
2418398178,7cyclictest19091-21sh09:37:470
2418398178,6cyclictest12335-21irqrtprio10:30:340
2418398177,4cyclictest21557-21/usr/sbin/munin10:50:200
2418398174,8cyclictest7281-21ssh12:33:000
2418398174,8cyclictest7281-21ssh12:32:590
2418398174,3cyclictest26032-21ssh11:00:010
2418398174,11cyclictest17037-21idleruntime08:15:250
2418398173,11cyclictest9316-21cat10:25:010
24183981713,2cyclictest118550irq/29-4f00000.12:00:140
24183981712,3cyclictest6095-21/usr/sbin/munin09:10:410
24183981712,3cyclictest26989-21/usr/sbin/munin07:15:270
24183981712,3cyclictest25477-21ntpq09:50:330
24183981712,3cyclictest20826-1kworker/u9:211:30:320
24183981712,3cyclictest20826-1kworker/u9:211:30:320
24183981712,3cyclictest11014-21ssh09:20:340
24183981712,3cyclictest10-21ksoftirqd/011:37:080
24183981712,3cyclictest10-21ksoftirqd/011:00:150
24183981711,3cyclictest10-21ksoftirqd/011:45:300
24183981710,5cyclictest32519-21sh11:11:030
24183981710,5cyclictest28830-21/usr/sbin/munin12:10:350
24183981710,5cyclictest22673-21if_eth008:30:230
24183981710,5cyclictest22673-21if_eth008:30:220
24183981710,5cyclictest1938-21runrttasks10:00:470
24183981710,5cyclictest10-21ksoftirqd/007:45:240
2418398170,5cyclictest145962ssh11:40:430
2418398168,6cyclictest32326-21ssh12:19:000
2418398168,6cyclictest26095-21/usr/sbin/munin08:40:230
2418398168,6cyclictest19815-21timerwakeupswit08:20:430
2418398167,7cyclictest23543-21vmstat09:45:480
2418398167,6cyclictest25316-21proc_pri07:10:390
2418398167,6cyclictest25316-21proc_pri07:10:390
2418398165,5cyclictest7671-21irqrtprio07:50:280
24183981611,3cyclictest339-21/usr/sbin/munin07:30:390
24183981611,3cyclictest32412-21/usr/sbin/munin08:55:260
24183981611,3cyclictest2283-21python311:15:420
24183981611,3cyclictest20931-21ssh10:48:080
24183981611,3cyclictest1929-21ntpq09:00:320
24183981611,3cyclictest10370-21ntpq10:25:340
24183981611,3cyclictest10-21ksoftirqd/011:05:150
24183981611,3cyclictest10-21ksoftirqd/007:40:360
2418398153,3cyclictest30452-21irqrtprio07:25:250
2418398130,11cyclictest24201-21latency_hist07:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional