You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 03:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sat Nov 22, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2217321520,2sleep13190099cyclictest22:59:571
2509321400,2sleep31847-21nfsd21:37:373
2306821360,3sleep13190099cyclictest00:17:561
762721270,1sleep00-21swapper/023:44:370
2606321240,1sleep30-21swapper/300:14:533
687921230,2sleep36874-21bash22:18:253
687921230,2sleep36874-21bash22:18:253
2581621210,3sleep33190299cyclictest21:19:333
946321200,1sleep13190099cyclictest23:54:081
1748121200,2sleep33190299cyclictest22:34:493
2827221190,3sleep13190099cyclictest23:12:421
1324321160,1sleep213244-21bash22:34:242
1439721110,0sleep00-21swapper/022:43:360
1968121100,0sleep11847-21nfsd21:43:121
31472210735,43sleep30-21swapper/319:07:513
239121060,2sleep22375-21sshd22:11:552
2842321050,2sleep33190299cyclictest23:25:003
122421050,3sleep10-21swapper/121:50:311
285222990,1sleep20-21swapper/223:49:442
105412990,2sleep03189999cyclictest23:23:160
318792970,0sleep10-21swapper/100:32:391
127582960,2sleep20-21swapper/200:10:152
290102940,2sleep20-21swapper/221:59:162
281752940,3sleep20-21swapper/221:40:532
18292940,2sleep10-21swapper/123:07:091
313362920,1sleep20-21swapper/223:56:082
42902910,2sleep10-21swapper/100:39:561
104682910,2sleep310461-21sshd21:24:103
64052900,3sleep00-21swapper/021:41:560
29322900,1sleep02929-21sshd00:39:480
183712900,2sleep10-21swapper/122:19:311
183712900,2sleep10-21swapper/122:19:311
161432880,1sleep041ktimersoftd/023:02:240
10532880,4sleep33190299cyclictest22:48:323
3161828733,49sleep10-21swapper/119:09:421
149972870,2sleep10-21swapper/123:02:161
104332870,1sleep010-21rcuc/023:47:560
255482860,3sleep10-21swapper/122:44:411
195602840,2sleep219559-21bash00:24:272
46412830,4sleep13190099cyclictest21:11:221
43312810,1sleep31848-21nfsd23:07:243
231292800,4sleep33190299cyclictest23:30:243
154112800,2sleep20-21swapper/222:43:412
126422800,2sleep10-21swapper/122:12:541
254102780,2sleep10-21swapper/122:32:261
126492760,1sleep20-21swapper/200:37:202
171572750,2sleep117156-21bash22:50:061
132352740,5sleep10-21swapper/121:39:361
9172730,2sleep3916-21sshd00:09:083
3161427132,9sleep20-21swapper/219:09:392
238082710,1sleep30-21swapper/321:31:243
147972710,4sleep03189999cyclictest21:24:350
14962700,1sleep10-21swapper/100:22:281
17122690,0sleep31713-21bash23:13:163
129412670,3sleep03189999cyclictest23:11:130
10492660,1sleep01047-21bash21:50:290
86952650,2sleep38692-21sshd00:19:553
62542650,1sleep16240-21sshd21:45:001
287432630,1sleep30-21swapper/322:45:003
3157326034,4sleep00-21swapper/019:09:090
122412600,1sleep012230-21sshd23:32:290
90752530,0sleep09074-21sshd00:33:410
181522530,2sleep318151-21sshd22:50:123
191022490,1sleep00-21swapper/000:04:250
154872440,1sleep10-21swapper/119:45:031
3190299400,19cyclictest10950irq/23-ehci_hcd23:35:113
3190299360,26cyclictest1848-21nfsd00:31:563
31900993611,2cyclictest22-21ksoftirqd/123:36:061
31900993512,1cyclictest22-21ksoftirqd/123:17:441
31899993521,5cyclictest16189-21bash23:51:330
3190299340,32cyclictest2505-21bash21:11:093
3190299331,12cyclictest135650irq/27-eth023:41:403
3190299330,13cyclictest135650irq/27-eth000:02:453
31900993311,3cyclictest22-21ksoftirqd/122:26:231
210682330,31sleep2135650irq/27-eth023:27:162
31902993230,1cyclictest0-21swapper/300:27:463
3190299320,18cyclictest26917-21sshd23:18:423
3190299320,14cyclictest135650irq/27-eth023:51:003
31899993226,2cyclictest0-21swapper/000:18:060
31899993212,12cyclictest3-21ksoftirqd/021:46:060
74022310,6sleep10-21swapper/121:17:471
3190299314,18cyclictest1959-21sshd22:20:543
3190299312,21cyclictest10950irq/23-ehci_hcd23:55:093
3190299311,11cyclictest135650irq/27-eth022:10:033
3190299310,28cyclictest28626-21sshd22:08:213
3190299310,28cyclictest27685-21sshd21:59:083
3190299310,16cyclictest3362-21sshd22:02:553
3190299310,14cyclictest135650irq/27-eth021:51:103
31900993114,2cyclictest22-21ksoftirqd/123:55:361
3190299301,27cyclictest1848-21nfsd22:27:063
3190299301,27cyclictest17552-21sshd23:02:323
3190299300,26cyclictest28506-21sshd22:57:203
3190299300,19cyclictest1847-21nfsd23:49:343
3190299300,16cyclictest135650irq/27-eth021:43:523
3190099304,1cyclictest22-21ksoftirqd/121:27:201
31899993016,4cyclictest3-21ksoftirqd/022:09:420
277972300,2sleep227798-21sshd23:12:402
197732300,5sleep33190299cyclictest22:35:013
3190299292,15cyclictest135650irq/27-eth000:22:083
3190299290,27cyclictest29737-21bash00:35:423
3190299290,26cyclictest21403-21sshd23:27:163
3190299290,26cyclictest1848-21nfsd21:45:463
3190299290,20cyclictest135650irq/27-eth021:29:323
279922290,27sleep2135650irq/27-eth023:03:342
31899992812,10cyclictest3-21ksoftirqd/000:29:550
46882270,1sleep04690-21sshd21:32:410
3190099279,7cyclictest18032-21bash22:01:111
3190099279,3cyclictest22-21ksoftirqd/122:36:391
31900992713,4cyclictest4894-21sshd21:56:571
31899992714,10cyclictest3-21ksoftirqd/022:36:370
238122270,5sleep223809-21sshd21:34:322
171932270,1sleep20-21swapper/223:39:172
100942270,2sleep20-21swapper/200:26:512
31901992623,1cyclictest0-21swapper/222:00:032
31900992611,2cyclictest22-21ksoftirqd/100:10:081
31900992610,1cyclictest22-21ksoftirqd/123:40:181
264312260,3sleep20-21swapper/222:26:182
31901992520,4cyclictest6485-21sshd22:58:222
31901992515,3cyclictest23534-21sshd23:21:212
3190199250,4cyclictest28508-21bash22:38:502
3190099252,21cyclictest22-21ksoftirqd/122:22:041
31900992512,6cyclictest0-21swapper/100:03:411
31900992511,2cyclictest144550irq/28-eth1-rx-00:25:111
3190099251,11cyclictest22-21ksoftirqd/100:08:571
31899992512,4cyclictest3-21ksoftirqd/022:17:510
31899992512,4cyclictest3-21ksoftirqd/022:17:500
3190299240,19cyclictest22238-21latency_hist20:00:003
3190099242,4cyclictest12762-21sshd23:45:051
31899992412,4cyclictest3-21ksoftirqd/021:57:290
163472240,2sleep20-21swapper/221:12:322
157072240,22sleep2135650irq/27-eth023:05:232
3190299230,11cyclictest12909-21cpu20:50:103
3190099232,19cyclictest22-21ksoftirqd/121:21:311
31900992315,4cyclictest16273-21sshd23:26:461
31900992313,6cyclictest28981-21sshd21:31:541
3189999235,11cyclictest0-21swapper/021:39:050
31900992213,3cyclictest4747-21bash22:09:101
3190099221,20cyclictest22-21ksoftirqd/123:33:011
31899992218,3cyclictest3-21ksoftirqd/021:17:030
31899992215,5cyclictest3-21ksoftirqd/023:15:180
3189999221,13cyclictest36-21rcuop/222:03:200
3189999220,15cyclictest0-21swapper/023:55:330
3189999220,13cyclictest11957-21sshd23:26:210
120492220,1sleep00-21swapper/000:10:130
3190299210,18cyclictest1847-21nfsd19:45:123
3190199211,15cyclictest28463-21kworker/2:122:54:522
3190099210,19cyclictest22-21ksoftirqd/122:47:231
3190099210,18cyclictest22-21ksoftirqd/123:21:111
3189999219,3cyclictest5546-21bash22:55:120
3189999213,10cyclictest3-21ksoftirqd/022:33:050
31899992119,1cyclictest0-21swapper/022:52:450
3190299200,18cyclictest7657-21runrttasks20:36:113
3190299200,18cyclictest7657-21runrttasks20:36:113
3190299200,18cyclictest29863-21munin-node20:15:143
3190299200,18cyclictest2657-21munin-node20:25:193
3190299200,18cyclictest2569-21munin-node19:15:163
3190299200,18cyclictest24159-21runrttasks20:02:113
3190299200,18cyclictest21664-21bash21:10:013
3190299200,18cyclictest15079-21runrttasks19:42:423
3190299200,12cyclictest10559-21atenall_r5power20:45:133
3190299200,11cyclictest4303-21fschecks_time20:30:133
3190299200,10cyclictest135650irq/27-eth019:35:183
31901992015,2cyclictest31607-21sshd22:23:492
31901992014,4cyclictest28920-21sshd22:17:262
31901992014,4cyclictest28920-21sshd22:17:262
31901992013,5cyclictest5785-21bash23:16:382
31901992012,4cyclictest17187-21rm00:07:262
3189999209,5cyclictest3-21ksoftirqd/023:36:120
3189999201,11cyclictest0-21swapper/000:09:450
3189999200,17cyclictest12334-21bash22:28:070
3189999200,10cyclictest11783-21sshd23:08:070
3190299197,6cyclictest0-21swapper/321:05:003
3190299191,9cyclictest135650irq/27-eth019:25:003
3190299190,18cyclictest135650irq/27-eth021:00:003
3190299190,17cyclictest19684-21runrttasks19:53:203
3190299190,17cyclictest135650irq/27-eth019:31:203
3190299190,10cyclictest1248-21wc20:25:003
31901991915,3cyclictest17132-21bash21:45:562
31901991914,3cyclictest18839-21sshd23:30:072
31901991911,5cyclictest13834-21bash21:39:392
3190199190,17cyclictest33-21ksoftirqd/222:46:422
3189999199,9cyclictest3-21ksoftirqd/021:11:290
3189999197,5cyclictest3-21ksoftirqd/022:11:540
3189999193,13cyclictest5146-21bash22:45:400
3189999191,16cyclictest14727-21sshd22:22:100
3190299180,9cyclictest135650irq/27-eth019:26:213
3190299180,17cyclictest1848-21nfsd20:10:433
3190299180,10cyclictest1848-21nfsd19:12:563
3190199188,5cyclictest14591-21sshd21:21:262
3190199182,7cyclictest135650irq/27-eth020:43:052
3190199181,9cyclictest135650irq/27-eth000:32:372
31901991814,3cyclictest11368-21sshd22:09:492
31901991813,3cyclictest0-21swapper/223:40:062
3189999187,2cyclictest30076-21sshd00:22:040
3189999180,12cyclictest0-21swapper/021:27:540
89422170,15sleep2135650irq/27-eth021:17:572
3190299170,9cyclictest1848-21nfsd20:09:123
3190299170,16cyclictest1848-21nfsd20:40:023
3190199175,3cyclictest5421-21sshd23:50:282
3190199173,4cyclictest135650irq/27-eth020:20:432
31901991715,1cyclictest0-21swapper/220:50:272
31901991713,2cyclictest31428-21sshd21:53:252
31901991711,5cyclictest10950irq/23-ehci_hcd20:30:432
3190199162,4cyclictest25-21rcuop/121:26:312
3190199162,13cyclictest11843-21sshd00:00:302
31901991612,3cyclictest1848-21nfsd00:16:112
3190199159,4cyclictest0-21swapper/219:26:572
3190199158,6cyclictest0-21swapper/220:55:142
3190199151,13cyclictest0-21swapper/219:24:112
31901991510,4cyclictest15071-21runrttasks19:42:352
3190199150,10cyclictest144550irq/28-eth1-rx-20:45:582
3190099159,5cyclictest0-21swapper/120:17:011
3190099150,14cyclictest22-21ksoftirqd/119:30:081
3189999150,3cyclictest1927-21snmpd21:02:370
3190199148,5cyclictest0-21swapper/221:00:122
3190199148,4cyclictest0-21swapper/220:36:122
3190199148,4cyclictest0-21swapper/220:36:122
3190199143,7cyclictest135650irq/27-eth020:08:052
3190199142,9cyclictest0-21swapper/219:57:462
3190199142,11cyclictest135650irq/27-eth021:09:172
31900991410,2cyclictest5076-21needreboot19:20:191
3190099140,11cyclictest0-21swapper/120:22:111
3190099140,10cyclictest135650irq/27-eth020:52:241
3189999146,7cyclictest0-21swapper/020:49:430
3189999145,8cyclictest0-21swapper/019:48:490
31899991411,2cyclictest20489-21memory21:05:170
3189999140,13cyclictest0-21swapper/019:20:560
241092141,12sleep2135650irq/27-eth020:01:322
3190199132,7cyclictest135650irq/27-eth019:11:572
3190199131,4cyclictest135650irq/27-eth020:17:262
3190199131,11cyclictest10950irq/23-ehci_hcd19:36:072
31901991310,2cyclictest17194-21taskset19:45:582
3190199130,12cyclictest0-21swapper/219:50:322
3190199130,12cyclictest0-21swapper/219:33:252
3190199130,12cyclictest0-21swapper/219:18:202
3190099139,3cyclictest10950irq/23-ehci_hcd20:32:251
3190099137,5cyclictest0-21swapper/120:01:261
3190099131,11cyclictest2405-21runrttasks19:12:041
31900991311,1cyclictest0-21swapper/121:06:201
31900991311,1cyclictest0-21swapper/120:56:321
31900991311,1cyclictest0-21swapper/119:15:191
3190099130,12cyclictest0-21swapper/120:46:341
3190099130,12cyclictest0-21swapper/120:36:331
3190099130,12cyclictest0-21swapper/120:36:331
3190099130,12cyclictest0-21swapper/120:06:241
3190099130,12cyclictest0-21swapper/119:53:221
3190099130,12cyclictest0-21swapper/119:35:301
3190099130,12cyclictest0-21swapper/119:28:081
3189999137,5cyclictest0-21swapper/019:38:020
3189999137,4cyclictest0-21swapper/020:58:410
3189999130,5cyclictest21194-21ntp_states19:55:180
3189999130,1cyclictest6380-21munin-node19:25:160
3189999130,12cyclictest0-21swapper/020:31:010
3189999130,12cyclictest0-21swapper/020:20:570
3189999130,12cyclictest0-21swapper/020:17:010
3189999130,12cyclictest0-21swapper/020:05:190
3189999130,12cyclictest0-21swapper/019:52:370
3189999130,12cyclictest0-21swapper/019:31:210
3189999130,12cyclictest0-21swapper/019:13:040
3190199128,3cyclictest30542sleep220:25:432
3190199120,3cyclictest27218-21df_inode20:10:112
3190099122,1cyclictest0-21swapper/121:00:281
31900991210,1cyclictest0-21swapper/120:40:251
3190099120,11cyclictest26909-21aten_r5power_fr20:10:101
3190099120,11cyclictest2405-21runrttasks19:40:171
3190099120,10cyclictest0-21swapper/119:55:121
3189999127,2cyclictest0-21swapper/020:42:290
3189999126,3cyclictest0-21swapper/020:10:220
3189999120,8cyclictest23187-21latency20:00:180
3189999120,8cyclictest0-21swapper/019:40:230
3189999120,12cyclictest0-21swapper/020:38:400
3189999120,12cyclictest0-21swapper/020:38:400
3189999120,11cyclictest0-21swapper/020:50:160
3189999120,10cyclictest0-21swapper/020:25:010
3190099110,2cyclictest0-21swapper/120:25:101
3189999110,7cyclictest0-21swapper/019:15:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional