You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 10:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Nov 30, 2025 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38321500,0sleep10-21swapper/100:17:261
1840221340,1sleep30-21swapper/323:56:433
1103021310,2sleep211029-21sshd00:21:432
2364421280,0sleep21847-21nfsd23:50:572
431521230,3sleep30-21swapper/300:14:353
2741221220,4sleep3790099cyclictest21:31:353
2381421220,4sleep3790099cyclictest23:22:373
386621190,3sleep0789799cyclictest22:42:410
1274621190,3sleep3790099cyclictest22:30:383
283021180,3sleep3790099cyclictest22:55:073
2381721050,1sleep2789999cyclictest00:03:312
242822990,1sleep00-21swapper/023:44:540
60642980,3sleep20-21swapper/223:39:552
105262970,3sleep0789799cyclictest21:42:420
105262970,3sleep0789799cyclictest21:42:410
228492950,2sleep322846-21sshd23:38:203
138702950,1sleep013871-21bash21:52:350
259252940,2sleep10-21swapper/100:06:551
179152930,3sleep0789799cyclictest00:02:570
15362920,2sleep00-21swapper/000:17:320
730929130,49sleep10-21swapper/119:06:081
52772910,2sleep35262-21sshd23:49:183
165702900,3sleep0789799cyclictest23:09:110
138382900,2sleep10-21swapper/122:37:131
219282880,3sleep2789999cyclictest23:00:072
9522870,2sleep20-21swapper/221:54:342
302122850,2sleep230211-21cut22:45:172
89582840,2sleep30-21swapper/323:01:563
93382830,2sleep20-21swapper/222:33:372
305582830,2sleep10-21swapper/120:00:001
183472830,2sleep3790099cyclictest23:44:173
559828234,44sleep30-21swapper/319:05:103
301102820,2sleep130108-21bash22:06:551
300012820,3sleep00-21swapper/023:51:360
221152820,2sleep21848-21nfsd21:56:342
308212810,2sleep10-21swapper/123:29:401
139312810,1sleep10-21swapper/121:20:421
211442800,2sleep121130-21sshd22:34:501
140882800,0sleep00-21swapper/023:21:380
152522780,1sleep015247-21sshd00:22:100
65452770,1sleep16533-21sshd22:23:501
313342770,2sleep30-21swapper/323:13:513
97482750,1sleep29745-21sshd22:05:012
304112750,2sleep10-21swapper/123:39:061
10262750,2sleep20-21swapper/223:07:362
140672740,0sleep00-21swapper/000:36:130
132972741,71sleep326950irq/26-ahci[00000:15:243
193112730,1sleep019301-21sshd22:59:540
241232700,4sleep1789899cyclictest21:37:371
191892700,0sleep019182-21ntp_states22:50:240
10332700,1sleep20-21swapper/223:42:322
179412670,3sleep3790099cyclictest23:18:513
301972660,1sleep030187-21sshd21:25:260
305262610,0sleep00-21swapper/023:26:230
171322530,3sleep2789999cyclictest23:18:472
747725237,11sleep20-21swapper/219:07:572
738324632,11sleep00-21swapper/019:06:590
93342430,29sleep0135650irq/27-eth020:22:470
135112430,4sleep30-21swapper/322:24:343
218862410,39sleep3135650irq/27-eth000:37:083
208462340,4sleep20-21swapper/221:37:192
267472330,28sleep1135650irq/27-eth023:41:511
20962321,28sleep1135650irq/27-eth023:14:101
789899310,27cyclictest6330-21sshd00:11:281
267752310,0sleep00-21swapper/021:47:260
7897993015,12cyclictest3-21ksoftirqd/023:15:200
120642300,2sleep312065-21sshd22:08:223
155592280,2sleep30-21swapper/320:35:203
140722280,1sleep11848-21nfsd21:59:021
7899992718,7cyclictest8517-21cp23:21:022
789799273,23cyclictest1846-21nfsd23:14:450
73332270,2sleep20-21swapper/200:05:082
245102270,3sleep30-21swapper/321:44:063
245102270,3sleep30-21swapper/321:44:053
206942270,1sleep120685-21sshd21:53:181
7900992615,5cyclictest135650irq/27-eth022:52:033
7897992614,7cyclictest3-21ksoftirqd/000:07:450
7897992614,11cyclictest3-21ksoftirqd/023:02:550
161342260,2sleep10-21swapper/121:43:161
161342260,2sleep10-21swapper/121:43:151
144762260,3sleep30-21swapper/300:22:053
7899992514,3cyclictest0-21swapper/223:46:052
7899992418,4cyclictest31455-21bash23:32:522
7899992418,4cyclictest31455-21bash23:32:512
789799249,11cyclictest3-21ksoftirqd/023:30:410
789799249,11cyclictest3-21ksoftirqd/023:30:400
789799246,8cyclictest3-21ksoftirqd/000:26:340
7897992413,3cyclictest3-21ksoftirqd/023:59:460
75312240,2sleep17533-21bash22:14:211
7897992312,1cyclictest3513-21sshd23:45:530
7897992310,12cyclictest3-21ksoftirqd/000:14:370
16482230,2sleep30-21swapper/323:33:063
16482230,2sleep30-21swapper/323:33:063
16442230,21sleep3135650irq/27-eth021:13:283
790099228,5cyclictest135650irq/27-eth000:09:323
789899228,1cyclictest9985-21sshd23:46:341
7898992216,4cyclictest26784-21rm22:57:221
789799220,20cyclictest26123-21sshd23:35:240
790099217,6cyclictest17038-21bash22:40:433
7899992113,5cyclictest30645-21bash23:26:232
7898992114,5cyclictest36-21rcuop/223:16:531
789799216,7cyclictest3-21ksoftirqd/021:36:110
789799216,4cyclictest16446-21sshd22:11:570
789799211,18cyclictest0-21swapper/021:20:170
789799210,14cyclictest0-21swapper/022:33:520
789999208,6cyclictest10950irq/23-ehci_hcd00:33:562
7899992015,3cyclictest30820-21sshd00:10:382
7899992015,3cyclictest1848-21nfsd22:54:012
7899992013,6cyclictest22444-21sshd00:19:432
7898992014,4cyclictest12598-21bash22:40:191
7898992013,6cyclictest1848-21nfsd23:09:101
789799201,9cyclictest11687-21sshd22:17:560
789799200,6cyclictest1374-21bash00:34:580
284182200,18sleep3135650irq/27-eth023:26:113
256862200,18sleep1135650irq/27-eth021:31:251
7899991916,2cyclictest1959-21sshd23:10:042
7899991914,4cyclictest1848-21nfsd23:55:112
7898991910,6cyclictest5840-21sshd23:20:471
7898991910,6cyclictest348-21sshd23:55:031
7898991910,3cyclictest0-21swapper/122:52:191
789899190,17cyclictest22-21ksoftirqd/100:25:081
789899190,13cyclictest22-21ksoftirqd/100:00:561
789799190,9cyclictest7274-21sshd22:46:070
789799190,15cyclictest9780-21bash21:14:150
51252190,2sleep10-21swapper/121:29:291
285252190,2sleep31848-21nfsd22:19:403
790099182,14cyclictest8649-21sshd21:52:033
7900991811,5cyclictest15895-21sshd00:32:543
790099180,5cyclictest1848-21nfsd22:47:183
790099180,12cyclictest14319-21bash21:27:063
7899991814,2cyclictest1847-21nfsd22:40:222
7899991814,2cyclictest10643-21sshd00:25:022
7899991813,2cyclictest135650irq/27-eth022:55:022
789999180,6cyclictest21356-21sshd00:37:042
7898991812,4cyclictest28050-21sshd00:23:301
789899180,6cyclictest21809-21id23:03:161
789799182,9cyclictest0-21swapper/022:05:290
789799180,4cyclictest1605-21sshd22:23:220
789799180,2cyclictest30428-21sshd21:16:080
790099178,4cyclictest12288-21sshd22:01:593
790099178,3cyclictest135650irq/27-eth000:02:433
7900991713,3cyclictest3797-21sshd21:48:223
790099170,7cyclictest31123-21sshd23:07:233
790099170,13cyclictest14923-21dump-pmu-power21:40:003
789999173,2cyclictest16577-21sshd21:11:422
7898991714,2cyclictest0-21swapper/119:30:211
7898991713,3cyclictest6692-21sed21:45:241
7898991712,3cyclictest1842-21nfsd23:50:551
7898991712,3cyclictest13561-21sshd00:36:101
789899170,15cyclictest25668-21sshd22:28:521
789799174,9cyclictest21704-21sshd22:28:280
7897991713,1cyclictest3-21ksoftirqd/022:00:520
7897991710,1cyclictest0-21swapper/020:08:110
789799170,2cyclictest1915-21snmpd20:35:470
789799170,2cyclictest0-21swapper/022:35:130
789799170,1cyclictest1848-21nfsd21:56:270
789799170,12cyclictest0-21swapper/020:47:030
789799170,11cyclictest0-21swapper/021:30:440
790099167,1cyclictest3036-21sshd00:27:513
790099165,5cyclictest7833-21sshd21:23:213
790099160,1cyclictest8647-21sshd22:36:433
790099160,14cyclictest0-21swapper/320:11:423
790099160,12cyclictest0-21swapper/323:51:213
790099160,11cyclictest30084-21munin-run21:10:003
790099160,11cyclictest1203-21id22:26:253
789999167,4cyclictest32138-21sshd22:16:412
789999163,12cyclictest16666-21sshd21:33:442
789999163,12cyclictest10950irq/23-ehci_hcd19:12:042
789999163,11cyclictest36-21rcuop/221:40:072
789999163,11cyclictest36-21rcuop/221:40:072
789999160,3cyclictest10038-21ntp_kernel_err21:20:222
789899169,3cyclictest0-21swapper/119:20:581
789899168,1cyclictest0-21swapper/122:48:031
789899166,8cyclictest0-21swapper/123:33:321
789899166,8cyclictest0-21swapper/123:33:311
789899161,8cyclictest23961-21tune2fs20:55:151
789899160,7cyclictest0-21swapper/121:15:301
789899160,15cyclictest786-21sshd21:13:231
789899160,14cyclictest0-21swapper/122:16:001
790099154,10cyclictest10950irq/23-ehci_hcd20:24:463
7900991511,3cyclictest10950irq/23-ehci_hcd20:48:353
790099150,14cyclictest0-21swapper/322:10:173
790099150,13cyclictest2405-21runrttasks20:17:573
789999157,5cyclictest0-21swapper/219:26:362
789999154,10cyclictest14609-21sshd21:17:462
789999153,4cyclictest10950irq/23-ehci_hcd19:16:252
789999152,8cyclictest10555-21sshd22:14:392
789999151,10cyclictest135650irq/27-eth020:26:452
789999150,14cyclictest135650irq/27-eth022:35:012
789999150,14cyclictest11961-21sshd21:49:162
789999150,11cyclictest13662-21users20:30:252
7898991513,1cyclictest0-21swapper/119:26:441
789899150,13cyclictest0-21swapper/120:20:211
789899150,13cyclictest0-21swapper/119:40:131
789899150,13cyclictest0-21swapper/119:40:131
243502151,12sleep1135650irq/27-eth000:30:181
790099147,6cyclictest0-21swapper/320:50:143
790099146,6cyclictest0-21swapper/319:25:133
790099141,1cyclictest0-21swapper/320:02:053
790099140,4cyclictest135650irq/27-eth020:55:543
790099140,12cyclictest8767-21sshd21:55:173
790099140,12cyclictest0-21swapper/319:40:173
790099140,12cyclictest0-21swapper/319:40:173
790099140,10cyclictest32078-21sshd21:19:293
789999149,4cyclictest9344-21sshd22:27:152
789999143,7cyclictest135650irq/27-eth022:22:372
7899991411,2cyclictest10950irq/23-ehci_hcd20:06:292
789999140,5cyclictest32439-21sshd21:25:402
789999140,13cyclictest18815-21sshd22:05:452
789999140,13cyclictest144550irq/28-eth1-rx-20:03:242
789999140,10cyclictest135650irq/27-eth020:53:132
789899149,4cyclictest135650irq/27-eth020:14:001
789899146,6cyclictest28089-21missed_timers22:00:211
789899140,13cyclictest0-21swapper/120:48:241
789899140,13cyclictest0-21swapper/120:43:591
789899140,13cyclictest0-21swapper/120:29:461
789799148,3cyclictest0-21swapper/020:26:470
789799147,6cyclictest0-21swapper/019:55:140
790099137,5cyclictest0-21swapper/319:30:083
790099134,1cyclictest0-21swapper/319:16:113
7900991310,3cyclictest10950irq/23-ehci_hcd19:45:423
790099130,5cyclictest0-21swapper/320:32:233
790099130,5cyclictest0-21swapper/320:09:343
790099130,12cyclictest18251-21taskset20:40:343
790099130,12cyclictest135650irq/27-eth019:55:553
790099130,12cyclictest0-21swapper/320:26:513
790099130,12cyclictest0-21swapper/319:37:313
789999137,2cyclictest0-21swapper/219:55:272
789999133,6cyclictest135650irq/27-eth020:35:252
789999133,6cyclictest135650irq/27-eth019:37:092
789999132,7cyclictest135650irq/27-eth020:48:542
789999132,7cyclictest135650irq/27-eth020:42:572
789999132,7cyclictest135650irq/27-eth019:51:132
7899991311,1cyclictest0-21swapper/219:31:062
789999130,12cyclictest135650irq/27-eth020:21:252
789999130,12cyclictest135650irq/27-eth019:40:102
789999130,12cyclictest135650irq/27-eth019:40:102
789999130,12cyclictest0-21swapper/221:07:512
789999130,12cyclictest0-21swapper/221:00:442
789999130,12cyclictest0-21swapper/220:15:082
789999130,12cyclictest0-21swapper/220:10:142
789999130,12cyclictest0-21swapper/219:46:062
789999130,12cyclictest0-21swapper/219:21:302
789899132,10cyclictest135650irq/27-eth019:35:391
789899131,11cyclictest135650irq/27-eth020:37:301
789899130,12cyclictest0-21swapper/121:08:541
789899130,12cyclictest0-21swapper/121:00:421
789899130,12cyclictest0-21swapper/120:17:301
789899130,12cyclictest0-21swapper/120:04:241
789899130,12cyclictest0-21swapper/119:53:181
789899130,11cyclictest8180-21df19:10:131
789899130,11cyclictest24187-21df_inode19:45:141
789899130,11cyclictest21408-21df20:50:141
789899130,11cyclictest1327-21irqstats20:05:191
789799137,4cyclictest0-21swapper/020:41:290
789799137,1cyclictest0-21swapper/020:11:560
789799136,6cyclictest0-21swapper/019:31:160
7897991311,1cyclictest0-21swapper/019:28:280
789799130,12cyclictest0-21swapper/020:55:180
789799130,12cyclictest0-21swapper/019:41:420
789799130,12cyclictest0-21swapper/019:41:420
789799130,12cyclictest0-21swapper/019:35:280
789799130,12cyclictest0-21swapper/019:16:140
789799130,10cyclictest0-21swapper/020:53:360
790099127,4cyclictest0-21swapper/319:13:003
7900991210,1cyclictest0-21swapper/321:00:033
790099120,3cyclictest13618-21ntp_states19:20:193
790099120,11cyclictest26452-21df_abs19:50:133
789999120,11cyclictest23424-21aten_r5power_fr20:55:132
789899120,11cyclictest2405-21runrttasks20:30:131
789899120,10cyclictest0-21swapper/119:15:151
789799121,9cyclictest0-21swapper/019:10:160
789799121,2cyclictest0-21swapper/019:50:150
789799121,1cyclictest0-21swapper/020:16:500
789799120,9cyclictest0-21swapper/021:00:140
789799120,8cyclictest0-21swapper/021:05:230
789799120,2cyclictest0-21swapper/020:00:190
789799120,12cyclictest0-21swapper/019:21:280
789799120,11cyclictest0-21swapper/019:46:410
789799110,10cyclictest0-21swapper/020:31:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional