You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 21:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Mon Nov 24, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2568922560,1sleep111869-21kworker/u8:707:05:391
2483122560,2sleep30-21swapper/307:05:213
2639922440,5sleep2251ksoftirqd/207:09:312
2651998165159,4cyclictest13612-21kworker/u8:910:01:551
2651998122117,3cyclictest26161-21kworker/u8:1507:11:571
2651998122117,3cyclictest26161-21kworker/u8:1507:11:571
287921210,2sleep30-21swapper/312:19:553
174721180,2sleep10-21swapper/108:55:351
174721180,2sleep10-21swapper/108:55:351
2651998115107,5cyclictest15664-21kworker/u8:5110:36:441
2702221090,3sleep327021-21cut09:50:263
265199810398,3cyclictest29857-21kworker/u8:1307:22:111
26523989691,3cyclictest31341-21kworker/u8:508:52:183
26522988174,4cyclictest31348-21kworker/u8:1508:52:182
26517986558,4cyclictest118550irq/29-4f00000.10:21:350
195792620,2sleep126512-21cyclictest09:35:241
26519985145,3cyclictest25587-21kworker/u8:811:07:271
26519984843,3cyclictest12451-21kworker/u8:008:02:071
26523984437,4cyclictest21938-21kworker/u8:107:11:563
26523984437,4cyclictest21938-21kworker/u8:107:11:563
26517984436,5cyclictest118550irq/29-4f00000.12:01:490
212202420,2sleep121219-21ld08:20:321
185612420,13sleep30-21swapper/309:32:483
185612420,13sleep30-21swapper/309:32:483
26517984131,7cyclictest118550irq/29-4f00000.09:16:520
315872400,18sleep331-21ksoftirqd/308:49:373
219642390,2sleep121963-21mii-tool10:45:231
26517983830,6cyclictest118550irq/29-4f00000.11:11:340
26517983727,7cyclictest10-21ksoftirqd/011:32:030
26523983428,4cyclictest15619-21kworker/u8:510:36:443
2652298341,21cyclictest3614-21ssh11:15:002
2651998323,4cyclictest121rcu_preempt12:15:111
26517983215,13cyclictest24144-21seq08:30:160
231712320,5sleep331-21ksoftirqd/308:25:403
231712320,5sleep331-21ksoftirqd/308:25:403
113642320,3sleep10-21swapper/107:55:221
2651798317,21cyclictest1411-21rs:main0
26517983018,9cyclictest17390-21runrttasks10:35:320
260872300,6sleep331-21ksoftirqd/312:00:163
131642300,2sleep20-21swapper/208:00:182
114412300,19sleep30-21swapper/311:30:203
71462290,8sleep225-21ksoftirqd/212:26:492
5582290,2sleep30-21swapper/307:25:273
300722290,7sleep2251ksoftirqd/207:18:182
300722290,7sleep2251ksoftirqd/207:18:182
270472290,3sleep11983-21bootmenu08:35:441
26519982922,3cyclictest18276-21kworker/u8:709:41:271
26519982922,3cyclictest18276-21kworker/u8:709:41:271
2651998291,4cyclictest0-21swapper/111:55:001
2651798299,13cyclictest0-21swapper/010:55:160
26517982921,5cyclictest118550irq/29-4f00000.12:27:000
26517982913,10cyclictest118550irq/29-4f00000.10:35:000
26517982913,10cyclictest118550irq/29-4f00000.10:34:590
162512290,12sleep3121rcu_preempt10:34:543
162512290,12sleep3121rcu_preempt10:34:543
134922290,8sleep331-21ksoftirqd/309:21:313
102382290,6sleep3121rcu_preempt10:20:513
32742280,7chrt31-21ksoftirqd/309:00:153
32742280,7chrt31-21ksoftirqd/309:00:153
287482280,7sleep3121rcu_preempt08:40:363
2652398286,5cyclictest31-21ksoftirqd/310:05:243
2651998283,3cyclictest121rcu_preempt12:14:001
26519982815,3cyclictest19-21ksoftirqd/110:20:161
2651798284,21cyclictest2768-1kworker/u9:009:05:130
313252270,5sleep331-21ksoftirqd/309:58:543
2652398278,12cyclictest12532-21ssh12:40:003
2651998275,10cyclictest121rcu_preempt08:05:241
2651998274,4cyclictest121rcu_preempt11:25:311
2651998273,5cyclictest121rcu_preempt11:30:181
2651998271,4cyclictest121rcu_preempt12:35:001
26519982711,4cyclictest19-21ksoftirqd/112:20:371
2651798276,15cyclictest31475-21ssh11:05:170
2651798273,14cyclictest10-21ksoftirqd/010:10:130
26517982714,10cyclictest31540-21taskset12:10:300
215692270,5sleep331-21ksoftirqd/310:45:093
186122270,6sleep2251ksoftirqd/211:45:082
180072270,2sleep30-21swapper/311:43:163
158262270,7sleep1191ksoftirqd/110:32:361
158262270,7sleep1191ksoftirqd/110:32:351
133952270,15sleep213170-21kworker/u8:110:27:412
132212270,6sleep113220-21ssh10:26:481
106602270,16sleep30-21swapper/307:52:513
79622260,3sleep218079-1kworker/u9:311:22:192
66662260,2sleep26664-21apt-get10:15:092
52622260,2sleep20-21swapper/212:24:312
294512260,5sleep2251ksoftirqd/208:44:412
29232260,7sleep31983-21bootmenu08:59:153
29232260,7sleep31983-21bootmenu08:59:153
2652398265,4cyclictest121rcu_preempt12:30:273
2652398261,7cyclictest9155-21irqrtprio11:25:263
2652298269,4cyclictest16949-21irqrtprio10:35:252
2652298263,3cyclictest121rcu_preempt12:00:162
26522982620,4cyclictest26160-21kworker/u8:1407:11:572
26522982620,4cyclictest26160-21kworker/u8:1407:11:562
2652298261,7cyclictest121rcu_preempt09:50:202
2651998267,5cyclictest121rcu_preempt11:20:071
26519982621,3cyclictest15661-21kworker/u8:4811:02:211
26519982613,9cyclictest19-21ksoftirqd/110:05:361
2651798269,13cyclictest12622-21ssh12:40:010
2651798268,15cyclictest21625-21ssh09:40:010
26517982610,9cyclictest30650-21users09:55:450
253452260,2sleep30-21swapper/311:58:393
238132260,5sleep2251ksoftirqd/208:29:092
238132260,5sleep2251ksoftirqd/208:29:092
203452260,2sleep10-21swapper/111:47:521
145572260,15sleep30-21swapper/308:04:373
12162260,14sleep229974-21kworker/u8:4007:26:162
63042250,2sleep10-21swapper/110:14:291
62292250,3sleep331-21ksoftirqd/309:05:463
33032250,5sleep331-21ksoftirqd/311:13:203
317952250,6sleep331-21ksoftirqd/307:21:263
2652398252,5cyclictest31-21ksoftirqd/309:37:313
2652298256,6cyclictest8202kworker/u8:908:55:362
2652298256,6cyclictest8202kworker/u8:908:55:362
2652298256,4cyclictest25-21ksoftirqd/210:55:342
2652298255,3cyclictest121rcu_preempt10:50:282
2652298255,3cyclictest121rcu_preempt10:50:282
2652298254,4cyclictest121rcu_preempt08:20:002
2652298251,4cyclictest0-21swapper/208:45:522
2651998259,4cyclictest19-21ksoftirqd/112:25:351
2651998256,4cyclictest121rcu_preempt10:55:521
2651998254,4cyclictest121rcu_preempt11:10:201
2651998252,3cyclictest121rcu_preempt09:15:141
2651998251,3cyclictest121rcu_preempt10:18:001
2651998251,3cyclictest121rcu_preempt09:56:591
26519982513,3cyclictest19-21ksoftirqd/107:45:141
2651798259,11cyclictest29899-21ssh11:00:340
2651798259,10cyclictest118550irq/29-4f00000.09:50:040
2651798258,14cyclictest8953-21latency_hist10:20:010
2651798257,13cyclictest32692-21sed10:00:340
2651798256,15cyclictest8202kworker/u8:908:55:140
2651798256,15cyclictest8202kworker/u8:908:55:140
2651798255,9cyclictest28324-21munin-plugin-st07:15:000
2651798255,9cyclictest28324-21munin-plugin-st07:14:590
2651798255,14cyclictest0-21swapper/007:15:160
2651798255,14cyclictest0-21swapper/007:15:160
2651798254,10cyclictest21179-21tail11:50:190
2651798253,17cyclictest0-21swapper/009:20:160
2651798251,5cyclictest4422python308:50:410
26517982514,8cyclictest0-21swapper/008:45:470
26517982510,11cyclictest17239-21collect211:41:000
263742250,2sleep10-21swapper/109:49:471
263742250,2sleep10-21swapper/109:49:471
254472250,2sleep10-21swapper/108:31:251
212292250,10sleep225-21ksoftirqd/208:20:332
208452250,1sleep218086-21kworker/u8:910:42:342
199312250,1sleep314357-21kworker/u8:308:17:243
158032250,1sleep215662-21kworker/u8:4910:32:282
158032250,1sleep215662-21kworker/u8:4910:32:282
155652250,3sleep315564-21ssh11:39:183
136682250,2sleep10-21swapper/109:22:211
116562250,15sleep326512-21cyclictest09:19:373
90452240,14sleep3301rcuc/309:13:303
88612240,5sleep331-21ksoftirqd/307:48:323
70272240,4sleep331-21ksoftirqd/307:43:423
67262240,5sleep331-21ksoftirqd/311:20:233
61612240,1sleep2971-21kworker/u8:1410:13:412
50242240,1sleep129859-21kworker/u8:1507:36:591
2652398244,3cyclictest121rcu_preempt12:28:063
2652298242,3cyclictest225272kworker/u8:1011:53:432
2652298240,4cyclictest0-21swapper/212:05:212
2651998245,4cyclictest121rcu_preempt08:25:211
2651998245,4cyclictest121rcu_preempt08:25:211
2651998245,3cyclictest121rcu_preempt12:05:121
2651998245,3cyclictest121rcu_preempt11:16:341
2651998244,4cyclictest121rcu_preempt09:10:281
2651998244,3cyclictest121rcu_preempt08:40:351
2651998243,3cyclictest121rcu_preempt10:53:361
2651998243,3cyclictest121rcu_preempt10:53:361
26519982413,3cyclictest19-21ksoftirqd/111:55:311
26519982413,3cyclictest19-21ksoftirqd/111:41:071
2651798249,11cyclictest15785-21latency_hist11:40:000
2651798248,13cyclictest8995-21apt07:49:590
2651798247,4cyclictest118550irq/29-4f00000.09:45:370
2651798247,4cyclictest118550irq/29-4f00000.09:45:370
2651798242,19cyclictest2458-21taskset07:30:260
26517982414,8cyclictest0-21swapper/009:40:150
26517982414,8cyclictest0-21swapper/009:40:150
26517982412,8cyclictest118550irq/29-4f00000.08:45:010
26517982410,10cyclictest10258-21mailstats07:50:430
236822240,2sleep30-21swapper/309:43:133
236822240,2sleep30-21swapper/309:43:133
210722240,3sleep212415-21kworker/2:109:38:262
204902240,12sleep320270-21kworker/u8:011:48:383
185692240,1sleep218467-21kworker/u8:1509:32:522
185692240,1sleep218467-21kworker/u8:1509:32:512
156422240,5sleep331-21ksoftirqd/308:05:333
155382240,1sleep215193-21kworker/u8:411:39:082
131532240,3sleep213152-21ssh11:34:102
9832230,8sleep331-21ksoftirqd/310:02:053
2652398234,4cyclictest31-21ksoftirqd/311:02:123
2652398231,5cyclictest6067-21munin-run11:20:003
2652398231,3cyclictest0-21swapper/310:55:033
2652398231,10cyclictest0-21swapper/311:51:553
26523982310,3cyclictest31-21ksoftirqd/308:20:383
2652298236,10cyclictest121rcu_preempt08:00:012
2652298231,11cyclictest31523-21ssh10:00:002
2651998239,5cyclictest19-21ksoftirqd/108:45:511
2651998239,3cyclictest19-21ksoftirqd/109:30:411
2651998239,3cyclictest19-21ksoftirqd/109:30:411
2651998239,3cyclictest19-21ksoftirqd/108:10:171
2651998238,3cyclictest19-21ksoftirqd/111:35:141
2651998232,5cyclictest121rcu_preempt09:05:271
2651998232,3cyclictest121rcu_preempt12:04:511
2651998232,13cyclictest10439-21/usr/sbin/munin12:35:411
2651998231,3cyclictest0-21swapper/109:50:111
26519982312,3cyclictest19-21ksoftirqd/109:00:451
26519982312,3cyclictest19-21ksoftirqd/109:00:451
26519982310,3cyclictest19-21ksoftirqd/109:25:301
2651798239,11cyclictest19243-21aten2_rfpower_c10:40:250
2651798237,13cyclictest6050-21seq11:20:000
2651798237,13cyclictest29203-21taskset12:05:320
2651798236,14cyclictest1561-21/usr/sbin/munin12:15:270
2651798235,15cyclictest8765-21chrt11:25:160
2651798235,15cyclictest14554-21aten2_rfpower_f09:25:180
26517982313,7cyclictest118550irq/29-4f00000.08:10:240
26517982311,9cyclictest2010-21aten2_rfpower_p10:05:190
26517982311,9cyclictest0-21swapper/010:45:290
26517982311,8cyclictest8224-21ssh12:30:200
2651798231,18cyclictest27643-21modprobe08:40:010
2651798231,14cyclictest0-21swapper/007:57:460
261122230,3sleep20-21swapper/208:35:212
256772230,2sleep20-21swapper/208:34:122
157842230,2sleep31983-21bootmenu09:25:533
125302230,2sleep30-21swapper/307:57:493
105702230,4sleep119-21ksoftirqd/107:51:481
87372220,1sleep22994-21kworker/u8:011:25:092
52162220,1sleep33218-21kworker/u8:1107:39:283
2652398228,3cyclictest31-21ksoftirqd/310:40:513
2652398224,3cyclictest121rcu_preempt12:10:283
2652398221,6cyclictest31-21ksoftirqd/310:52:583
2652398221,6cyclictest31-21ksoftirqd/310:52:583
2652298224,4cyclictest121rcu_preempt10:00:282
2652298223,3cyclictest121rcu_preempt11:01:352
2652298222,2cyclictest121rcu_preempt09:27:352
2652298222,2cyclictest121rcu_preempt07:35:002
2652298221,5cyclictest5348-21taskset09:05:152
2651998229,4cyclictest19-21ksoftirqd/108:15:431
2651998224,3cyclictest121rcu_preempt08:50:431
2651998222,3cyclictest121rcu_preempt07:25:361
2651998222,3cyclictest121rcu_preempt07:15:211
2651998222,3cyclictest121rcu_preempt07:15:211
2651998221,3cyclictest121rcu_preempt07:30:311
2651798229,10cyclictest17668-21ssh09:30:340
2651798229,10cyclictest17668-21ssh09:30:340
2651798229,10cyclictest0-21swapper/012:22:210
2651798228,11cyclictest24262-21ntpq11:55:310
2651798228,11cyclictest24051-21taskset10:50:170
2651798228,11cyclictest24051-21taskset10:50:160
2651798228,11cyclictest13781-21taskset10:29:430
2651798225,13cyclictest118550irq/29-4f00000.09:00:270
2651798225,13cyclictest118550irq/29-4f00000.09:00:270
2651798225,12cyclictest0-21swapper/007:25:140
26517982213,6cyclictest3751-21basename07:35:180
26517982210,10cyclictest0-21swapper/008:00:140
262822220,2sleep212415-21kworker/2:109:49:212
262822220,2sleep212415-21kworker/2:109:49:202
252412220,11sleep331-21ksoftirqd/309:45:403
252412220,11sleep331-21ksoftirqd/309:45:393
6552210,3sleep2654-21ssh11:07:242
317712210,11sleep225-21ksoftirqd/207:21:082
2652398211,5cyclictest121rcu_preempt08:30:453
2652398211,4cyclictest121rcu_preempt10:10:263
2652298213,3cyclictest121rcu_preempt12:34:582
2652298212,3cyclictest12362kworker/u8:107:50:002
2652298211,3cyclictest0-21swapper/207:50:262
2652298211,10cyclictest0-21swapper/209:20:152
2651998217,3cyclictest19-21ksoftirqd/107:40:201
2651998211,3cyclictest121rcu_preempt10:41:571
2651798218,10cyclictest7212-21sh11:20:330
2651798218,10cyclictest118550irq/29-4f00000.08:15:160
2651798215,12cyclictest0-21swapper/008:05:140
2651798215,11cyclictest0-21swapper/008:20:170
2651798213,5cyclictest0-21swapper/007:24:480
26517982110,8cyclictest5553-21cut07:40:160
2651798210,7cyclictest10-21ksoftirqd/008:25:430
2651798210,7cyclictest10-21ksoftirqd/008:25:430
180822210,1sleep214357-21kworker/u8:308:12:292
163892210,1sleep214356-21kworker/u8:208:09:272
83182200,10sleep31983-21bootmenu10:17:273
2652398202,3cyclictest121rcu_preempt10:25:253
2652398202,3cyclictest121rcu_preempt07:30:233
2652398201,4cyclictest0-21swapper/312:20:393
2652298208,5cyclictest121rcu_preempt10:45:442
2652298204,3cyclictest121rcu_preempt12:17:112
2652298204,3cyclictest121rcu_preempt11:57:312
2652298202,3cyclictest12362kworker/u8:107:40:352
2652298201,4cyclictest121rcu_preempt09:00:322
2652298201,4cyclictest121rcu_preempt09:00:322
2652298201,4cyclictest0-21swapper/209:14:382
2652298201,3cyclictest58682kworker/u8:810:20:542
2651798208,10cyclictest0-21swapper/011:45:140
182212200,10sleep331-21ksoftirqd/308:14:183
298182190,9sleep31983-21bootmenu07:15:463
298182190,9sleep31983-21bootmenu07:15:463
2652398196,3cyclictest31-21ksoftirqd/312:07:383
2652398191,3cyclictest0-21swapper/311:05:273
2652298193,3cyclictest121rcu_preempt07:35:182
2652298192,3cyclictest121rcu_preempt12:10:582
2652298191,8cyclictest0-21swapper/209:19:272
2652298191,3cyclictest121rcu_preempt11:44:502
2652298190,3cyclictest121rcu_preempt10:05:362
2651798196,10cyclictest26587-21sort07:10:010
26523981812,3cyclictest26250-21df08:35:223
26522981811,4cyclictest22707-21ntpq09:40:362
26522981811,4cyclictest22707-21ntpq09:40:362
26522981811,4cyclictest1938-21runrttasks11:15:292
2652298171,5cyclictest121rcu_preempt12:35:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional