You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 14:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 14, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
722321440,5sleep02365499cyclictest10:06:180
2086221430,1sleep220861-21bash12:05:402
350421350,4sleep12365599cyclictest12:10:271
3031021350,3sleep22365699cyclictest09:22:192
1906121310,2sleep219060-21sshd10:27:402
1934721260,0sleep219319-21sshd10:55:012
814421240,4sleep22365699cyclictest11:57:422
2927121210,3sleep12365599cyclictest10:49:191
2899621200,0sleep12365599cyclictest12:09:551
255821190,3sleep12365599cyclictest11:13:241
2155421170,0sleep121553-21sshd09:54:451
1194921160,1sleep20-21swapper/210:54:182
659221100,1sleep10-21swapper/111:07:031
2702521100,3sleep12365599cyclictest11:56:161
836521050,1sleep20-21swapper/212:04:312
717221040,0sleep00-21swapper/010:03:050
468521010,4sleep32365799cyclictest11:54:063
2135729934,45sleep10-21swapper/107:05:121
56272910,4sleep32365799cyclictest11:47:293
311852910,2sleep20-21swapper/209:55:332
42932900,1sleep30-21swapper/310:32:513
42932900,1sleep30-21swapper/310:32:503
6912890,2sleep20-21swapper/209:36:022
311052890,3sleep20-21swapper/210:22:082
156242890,1sleep015623-21bash11:11:190
287682880,3sleep20-21swapper/209:18:462
15402880,2sleep21535-21sshd12:33:372
142502880,5sleep32365799cyclictest09:40:353
13912880,2sleep10-21swapper/110:02:301
218352870,1sleep019525-21kworker/0:011:42:370
2339028633,43sleep30-21swapper/307:09:553
216972840,4sleep12365599cyclictest11:18:531
56012830,2sleep32365799cyclictest09:59:443
67322820,1sleep20-21swapper/210:16:182
321052820,2sleep30-21swapper/311:16:273
214912820,2sleep20-21swapper/209:10:412
129412820,2sleep31848-21nfsd10:06:573
306692800,0sleep00-21swapper/012:26:340
270402790,3sleep10-21swapper/110:08:231
125662780,2sleep30-21swapper/310:57:353
199592770,2sleep219964-21aten_r5power_fr11:05:112
119392770,2sleep20-21swapper/209:27:122
66162760,0sleep10-21swapper/110:33:081
66162760,0sleep10-21swapper/110:33:081
212502760,1sleep30-21swapper/312:18:593
7852740,3sleep30-21swapper/309:39:243
326272740,1sleep00-21swapper/012:39:440
29562740,1sleep02954-21sshd09:36:170
283972720,2sleep11846-21nfsd11:36:361
160592690,3sleep22365699cyclictest12:15:092
320892680,3sleep332088-21perl11:30:183
260732680,0sleep00-21swapper/011:19:200
222162670,3sleep12365599cyclictest09:41:301
219242660,1sleep20-21swapper/211:45:472
147682660,2sleep10-21swapper/109:13:251
206522600,2sleep12365599cyclictest09:17:451
86292590,1sleep10-21swapper/111:44:351
2329325835,11sleep00-21swapper/007:08:550
256632530,1sleep00-21swapper/010:28:220
302932520,0sleep20-21swapper/212:39:312
2316825131,17sleep20-21swapper/207:07:252
279542490,0sleep00-21swapper/010:11:430
311122480,0sleep031113-21sshd11:30:150
69572410,3sleep02365499cyclictest12:00:560
313112380,2sleep20-21swapper/210:45:512
267062363,29sleep1135650irq/27-eth010:18:261
23654993531,2cyclictest9592-21sshd10:47:100
56462340,32sleep1135650irq/27-eth010:53:371
55482320,0sleep25550-21id11:10:162
98512300,23sleep3135650irq/27-eth012:27:553
21842300,2sleep22113-21sshd10:39:232
88732290,1sleep00-21swapper/010:36:400
278462280,2sleep30-21swapper/311:39:593
23654992824,2cyclictest1848-21nfsd10:32:590
23654992824,2cyclictest1848-21nfsd10:32:590
155712280,2sleep20-21swapper/211:01:142
23654992713,9cyclictest3-21ksoftirqd/012:11:330
2365499270,12cyclictest27327-21bash10:52:290
67662260,2sleep36761-21sshd09:30:013
23654992622,2cyclictest19367-21sshd10:24:230
207982264,20sleep3135650irq/27-eth011:01:493
202152260,2sleep30-21swapper/310:14:303
164942260,2sleep30-21swapper/309:47:293
67882250,0sleep06779-21sshd09:49:500
23657992510,8cyclictest135650irq/27-eth011:29:103
23654992510,14cyclictest3-21ksoftirqd/012:17:100
2365499241,13cyclictest0-21swapper/012:32:090
136222240,18sleep326950irq/26-ahci[00009:23:573
2365799230,21cyclictest135650irq/27-eth010:23:493
23654992312,4cyclictest3-21ksoftirqd/011:52:300
130522230,16sleep3135650irq/27-eth010:00:243
11152230,3sleep30-21swapper/311:23:323
2365499224,3cyclictest26890-21bash11:49:500
23654992214,4cyclictest3-21ksoftirqd/011:58:090
23654992211,3cyclictest3-21ksoftirqd/009:42:220
23654992211,10cyclictest3-21ksoftirqd/009:55:350
2365599210,18cyclictest135650irq/27-eth012:03:151
2365499213,9cyclictest3-21ksoftirqd/009:53:030
23654992112,3cyclictest3-21ksoftirqd/011:05:540
2365499210,17cyclictest10370-21sshd09:12:580
302612200,17sleep3135650irq/27-eth012:30:033
2365799208,6cyclictest135650irq/27-eth009:14:233
2365799201,15cyclictest20907-21cp10:44:563
2365499209,4cyclictest3-21ksoftirqd/010:15:100
2365499201,8cyclictest6664-21sshd11:00:210
23654992016,3cyclictest3-21ksoftirqd/011:22:190
23654992011,5cyclictest3-21ksoftirqd/011:36:400
23654992010,4cyclictest0-21swapper/009:21:120
2365499200,17cyclictest25538-21sshd12:09:340
215152200,17sleep3135650irq/27-eth012:09:103
62232190,16sleep1135650irq/27-eth012:37:061
2365799190,8cyclictest0-21swapper/312:10:323
2365799190,15cyclictest25740-21sshd09:25:093
2365699191,15cyclictest1959-21sshd10:00:232
2365599199,6cyclictest10950irq/23-ehci_hcd11:49:151
2365599197,2cyclictest28156-21id10:25:161
2365599193,10cyclictest0-21swapper/111:22:361
2365599190,3cyclictest2551-21sshd11:00:021
2365599190,12cyclictest21472-21nscd12:21:401
23654991915,2cyclictest3-21ksoftirqd/010:40:130
23654991911,6cyclictest3-21ksoftirqd/012:21:140
20292190,17sleep2135650irq/27-eth012:20:192
40212180,8sleep30-21swapper/308:46:513
40212180,8sleep30-21swapper/308:46:513
2365799189,1cyclictest0-21swapper/310:39:123
23657991816,1cyclictest0-21swapper/307:43:193
23657991813,3cyclictest0-21swapper/311:44:043
2365799180,7cyclictest6983-21sshd12:00:583
2365799180,6cyclictest9706-21sshd09:50:083
2365799180,16cyclictest8426-21sshd11:10:303
2365799180,16cyclictest20425-21sshd10:48:193
2365699185,3cyclictest0-21swapper/211:32:502
23656991815,2cyclictest10325-21bash09:46:472
23656991811,6cyclictest3985-21sshd11:44:062
23656991811,5cyclictest12770-21sshd10:13:382
23656991811,3cyclictest135650irq/27-eth011:26:282
2365699180,9cyclictest23589-21sshd12:29:212
2365599185,11cyclictest7848-21sshd09:56:291
2365599184,5cyclictest28686-21sshd11:53:171
23654991813,4cyclictest3-21ksoftirqd/011:26:460
2365499180,15cyclictest16207-21sshd09:30:520
261762170,15sleep3135650irq/27-eth011:56:123
2365799172,3cyclictest10045-21bash12:21:053
2365799172,0cyclictest0-21swapper/311:05:423
2365799171,5cyclictest25638-21sshd10:15:043
23657991713,2cyclictest0-21swapper/312:35:553
2365699179,1cyclictest17086-21bash12:12:002
23656991713,3cyclictest17172-21sshd11:38:512
2365699170,13cyclictest5537-21sshd09:52:592
2365599175,6cyclictest0-21swapper/110:23:381
2365599170,12cyclictest3848-21sshd10:36:041
2365599170,12cyclictest1141-21sshd09:49:161
2365599170,11cyclictest1847-21nfsd12:33:521
2365499170,15cyclictest21379-21sshd09:28:120
257092160,14sleep3135650irq/27-eth010:52:193
2365799167,4cyclictest21721-21sshd10:27:583
2365799164,11cyclictest0-21swapper/307:45:213
23657991613,2cyclictest0-21swapper/309:17:363
2365699168,6cyclictest29907-21sshd11:50:062
2365699164,7cyclictest47-21rcuop/309:43:412
2365699163,5cyclictest1845-21nfsd10:43:112
2365699161,13cyclictest29244-21sshd11:16:092
23656991610,1cyclictest919-21sshd10:09:022
2365699160,9cyclictest1846-21nfsd10:31:312
2365699160,9cyclictest1846-21nfsd10:31:312
2365699160,14cyclictest17282-21sshd11:21:462
2365699160,14cyclictest0-21swapper/207:15:142
2365599167,7cyclictest0-21swapper/109:30:241
2365599162,5cyclictest7573-21sshd11:31:021
2365599162,1cyclictest26682-21sshd09:25:131
2365599161,4cyclictest5996-21sshd09:36:351
23655991610,4cyclictest21789-21rm10:45:011
2365499160,14cyclictest0-21swapper/010:55:230
2365799150,13cyclictest0-21swapper/307:20:143
2365799150,11cyclictest2405-21runrttasks08:41:533
2365699159,4cyclictest0-21swapper/209:09:522
2365699153,11cyclictest10950irq/23-ehci_hcd08:17:392
2365699152,2cyclictest25810-21df_abs08:25:172
23656991512,2cyclictest19858-21sshd09:31:182
2365599157,4cyclictest10950irq/23-ehci_hcd08:15:151
2365599156,5cyclictest10950irq/23-ehci_hcd07:25:211
2365599152,4cyclictest135650irq/27-eth010:57:311
23655991512,1cyclictest0-21swapper/108:20:221
2365599150,7cyclictest713-21sshd11:26:561
2365599150,4cyclictest3995-21sshd09:22:571
2365599150,3cyclictest20365-21sshd12:15:281
2365599150,14cyclictest135650irq/27-eth012:27:121
2365599150,13cyclictest0-21swapper/108:00:161
2365499150,4cyclictest0-21swapper/009:17:140
2365799146,7cyclictest0-21swapper/309:05:063
2365799146,6cyclictest0-21swapper/307:27:503
23657991411,2cyclictest144550irq/28-eth1-rx-08:36:233
2365799140,3cyclictest135650irq/27-eth008:56:213
2365799140,13cyclictest0-21swapper/307:15:113
2365699149,4cyclictest32108-21unixbench_singl07:25:232
2365699142,7cyclictest0-21swapper/208:02:112
2365699141,12cyclictest25-21rcuop/108:11:132
23656991410,3cyclictest10950irq/23-ehci_hcd08:07:442
2365699140,3cyclictest85872sleep208:56:592
2365599143,10cyclictest10950irq/23-ehci_hcd07:39:151
2365599141,8cyclictest0-21swapper/109:00:151
2365599140,5cyclictest1915-21snmpd08:27:511
2365599140,3cyclictest135650irq/27-eth009:05:471
2365599140,3cyclictest0-21swapper/108:11:511
2365599140,13cyclictest15243-21munin-node10:10:241
2365599140,13cyclictest135650irq/27-eth008:56:381
2365599140,13cyclictest0-21swapper/107:15:221
2365499147,4cyclictest0-21swapper/008:55:090
2365499140,1cyclictest0-21swapper/007:10:220
2365499140,13cyclictest0-21swapper/008:30:530
2365799132,3cyclictest135650irq/27-eth008:23:293
2365799130,12cyclictest0-21swapper/309:01:253
2365799130,12cyclictest0-21swapper/308:52:113
2365799130,12cyclictest0-21swapper/308:27:483
2365799130,12cyclictest0-21swapper/308:12:013
2365799130,12cyclictest0-21swapper/308:04:093
2365799130,12cyclictest0-21swapper/307:35:073
2365799130,12cyclictest0-21swapper/307:11:433
2365799130,11cyclictest29428-21users08:30:223
2365799130,11cyclictest22088-21ntp_states08:15:203
2365799130,11cyclictest17060-21hddtemp_smartct08:05:143
2365799130,11cyclictest12961-21ntp_states07:55:193
2365699137,5cyclictest0-21swapper/208:31:072
2365699131,9cyclictest23670-21munin-node07:10:132
23656991311,1cyclictest0-21swapper/208:36:592
23656991311,1cyclictest0-21swapper/207:38:412
2365699130,4cyclictest8429-21pmu-power07:45:192
2365699130,4cyclictest3903-21awk08:45:242
2365699130,4cyclictest3903-21awk08:45:242
2365699130,3cyclictest135650irq/27-eth007:40:102
2365699130,12cyclictest0-21swapper/209:00:242
2365699130,12cyclictest0-21swapper/208:40:322
2365699130,12cyclictest0-21swapper/208:22:382
2365699130,12cyclictest0-21swapper/207:50:242
2365699130,11cyclictest1893-21nscd08:50:192
23655991311,1cyclictest0-21swapper/108:46:521
23655991311,1cyclictest0-21swapper/108:46:521
2365599130,5cyclictest0-21swapper/107:10:201
2365599130,4cyclictest1896-21nscd08:40:301
2365599130,12cyclictest14873-21kworker/1:207:40:041
2365599130,12cyclictest0-21swapper/108:31:041
2365599130,12cyclictest0-21swapper/107:58:221
2365599130,12cyclictest0-21swapper/107:50:101
2365599130,12cyclictest0-21swapper/107:47:281
2365599130,12cyclictest0-21swapper/107:31:071
2365599130,12cyclictest0-21swapper/107:22:561
2365499138,4cyclictest0-21swapper/007:45:530
2365499137,5cyclictest0-21swapper/008:01:440
2365499136,2cyclictest18444-21munin-run08:10:000
2365499130,9cyclictest31238-21munin-node08:35:210
2365499130,5cyclictest0-21swapper/008:25:200
2365499130,1cyclictest135650irq/27-eth007:37:000
2365499130,12cyclictest0-21swapper/007:50:200
2365499130,12cyclictest0-21swapper/007:27:090
2365499130,10cyclictest0-21swapper/008:50:130
2365499130,10cyclictest0-21swapper/007:40:110
2365499130,10cyclictest0-21swapper/007:15:460
2365799120,11cyclictest0-21swapper/307:30:073
2365799120,10cyclictest0-21swapper/307:50:133
2365699125,6cyclictest10950irq/23-ehci_hcd07:30:132
23656991210,1cyclictest0-21swapper/207:55:052
2365699120,11cyclictest135650irq/27-eth007:20:472
2365599121,6cyclictest16387-21aten_r5power_fr08:05:121
2365599120,3cyclictest30849-21irqstats08:35:191
2365599120,11cyclictest4629-21atenall_r5power08:50:131
2365499125,4cyclictest0-21swapper/008:16:580
2365499121,1cyclictest0-21swapper/007:20:590
23654991210,1cyclictest0-21swapper/008:14:490
2365499120,8cyclictest32360-21aten_r5power_fr08:40:130
2365499120,1cyclictest0-21swapper/009:07:360
2365499120,1cyclictest0-21swapper/009:01:260
2365499120,1cyclictest0-21swapper/007:55:370
2365499120,11cyclictest0-21swapper/008:45:040
2365499120,11cyclictest0-21swapper/008:45:040
2365499120,11cyclictest0-21swapper/008:20:220
2365499120,11cyclictest0-21swapper/007:34:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional