You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 13:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sat Nov 15, 2025 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2597821830,3sleep02473399cyclictest21:29:280
2780921440,4sleep12473499cyclictest21:20:231
2098221270,1sleep020974-21sshd23:34:260
1846821260,2sleep10-21swapper/123:21:591
609621200,1sleep02473399cyclictest22:46:510
1097121160,1sleep32473699cyclictest22:13:403
2077721150,1sleep02473399cyclictest22:11:290
1705021150,3sleep22473599cyclictest22:11:052
2578621140,4sleep325771-21sshd23:28:463
2052921060,3sleep31846-21nfsd23:12:593
613721010,2sleep30-21swapper/300:03:583
2447029833,45sleep30-21swapper/319:09:543
215772980,1sleep20-21swapper/221:13:462
326352970,1sleep32473699cyclictest23:57:083
168602970,1sleep20-21swapper/223:18:472
161392960,0sleep00-21swapper/021:40:330
281012940,3sleep20-21swapper/222:06:002
71242920,1sleep02473399cyclictest00:07:080
68702920,2sleep20-21swapper/223:48:292
68702920,2sleep20-21swapper/223:48:292
308142920,1sleep130813-21sshd23:04:471
177942900,2sleep217792-21sshd21:43:522
158872900,0sleep21848-21nfsd21:49:492
238682870,2sleep323871-21smartctl00:30:163
177862860,2sleep217767-21sshd22:54:142
217962850,2sleep121799-21bash23:34:311
99862840,2sleep20-21swapper/221:15:392
273032840,3sleep02473399cyclictest23:47:200
273032840,3sleep02473399cyclictest23:47:190
182752840,2sleep10-21swapper/122:51:051
177472840,0sleep217748-21bash21:22:322
2423628334,45sleep10-21swapper/119:06:561
34952820,2sleep33493-21sshd22:00:403
327262820,2sleep00-21swapper/022:30:570
121202820,0sleep01845-21nfsd21:49:280
49992810,3sleep25000-21sshd22:37:352
271142810,4sleep32473699cyclictest21:26:263
144562800,3sleep22473599cyclictest21:28:212
267072740,4sleep32473699cyclictest22:36:333
238972720,2sleep10-21swapper/123:53:131
311482710,4sleep12473499cyclictest22:12:291
42502700,5sleep12473499cyclictest22:43:391
120052700,3sleep12473499cyclictest00:04:331
28722690,2sleep32865-21sshd00:06:433
264252670,1sleep12473499cyclictest23:59:431
21142670,1sleep00-21swapper/023:11:130
271552660,1sleep10-21swapper/122:58:101
227822660,1sleep10-21swapper/120:15:151
93062650,2sleep12473499cyclictest21:40:031
37382620,3sleep12473499cyclictest21:30:201
298842600,1sleep22473599cyclictest00:30:462
228192590,4sleep02473399cyclictest22:54:450
2435124833,11sleep20-21swapper/219:08:252
2473399473,32cyclictest18999-21bash00:26:400
2473399461,2cyclictest135650irq/27-eth000:11:080
2473399450,2cyclictest1959-21sshd22:43:050
2473399450,1cyclictest0-21swapper/000:16:180
324032440,1sleep30-21swapper/323:07:583
2473399440,36cyclictest8590-21sshd21:36:520
2424524437,4sleep00-21swapper/019:07:040
2473399433,4cyclictest23256-21sshd23:50:060
2473399430,4cyclictest1847-21nfsd23:35:380
2473399430,4cyclictest17357-21sshd00:20:200
2473399430,3cyclictest1846-21nfsd00:32:550
2473399430,2cyclictest1893-21nscd00:38:440
2473399425,33cyclictest0-21swapper/023:20:510
2473399420,2cyclictest23683-21sshd21:20:030
2473399420,2cyclictest0-21swapper/021:31:450
2473399410,3cyclictest1848-21nfsd21:59:030
2473399410,2cyclictest16707-21bash23:27:540
2473399410,1cyclictest1848-21nfsd22:28:280
2473399392,2cyclictest26950irq/26-ahci[00023:41:150
2473399390,36cyclictest0-21swapper/022:09:210
2473399390,2cyclictest0-21swapper/023:01:090
2473399390,1cyclictest1847-21nfsd00:01:510
24736993816,19cyclictest17726-21bash21:19:303
2473399380,3cyclictest0-21swapper/022:37:050
2473399380,2cyclictest11971-21cpuspeed_turbos23:55:120
2473399380,2cyclictest0-21swapper/022:22:140
2473399371,2cyclictest20353-21bash22:02:190
2473399370,2cyclictest9365-21sshd22:56:280
2473399370,2cyclictest0-21swapper/023:15:220
2473399360,3cyclictest314-21sshd21:54:250
304162350,0sleep330415-21sshd23:32:123
2473699359,5cyclictest0-21swapper/321:50:573
24736993532,2cyclictest0-21swapper/322:58:493
2473399354,29cyclictest5829-21sshd22:16:090
2473399354,28cyclictest0-21swapper/021:13:420
2473399350,32cyclictest5940-21sshd23:05:240
298332330,30sleep1135650irq/27-eth021:17:351
24736993312,8cyclictest0-21swapper/300:23:283
2473699330,7cyclictest0-21swapper/321:56:243
2473699330,3cyclictest0-21swapper/321:31:133
2473399330,1cyclictest0-21swapper/021:18:180
2473699316,3cyclictest0-21swapper/322:23:453
2473699312,4cyclictest0-21swapper/300:11:463
2473699302,7cyclictest0-21swapper/323:22:243
2473699292,5cyclictest0-21swapper/323:49:033
2473699292,5cyclictest0-21swapper/323:49:023
24736992913,5cyclictest10950irq/23-ehci_hcd23:39:393
165702291,25sleep3135650irq/27-eth021:22:253
96892280,2sleep29688-21sshd22:16:312
322112280,2sleep132196-21sshd22:03:281
146772280,2sleep314665-21sshd23:52:203
37812270,1sleep33780-21sshd22:15:563
278362270,25sleep3135650irq/27-eth021:47:523
2473699270,7cyclictest20548-21sshd23:19:103
5922260,1sleep20-21swapper/222:34:102
2473699260,7cyclictest0-21swapper/300:28:373
137972260,3sleep20-21swapper/223:27:372
264312250,23sleep1135650irq/27-eth000:18:111
24736992522,2cyclictest0-21swapper/322:33:463
2473699250,23cyclictest1848-21nfsd21:37:213
2473399250,2cyclictest10420-21latency_hist19:50:000
2473699241,4cyclictest0-21swapper/322:43:413
2473699240,10cyclictest0-21swapper/321:44:473
24734992416,5cyclictest21685-21bash21:35:081
2473399249,13cyclictest0-21swapper/019:30:230
2473399240,1cyclictest0-21swapper/019:15:210
194002240,2sleep11893-21nscd00:33:051
255242230,2sleep30-21swapper/322:55:003
2473699230,10cyclictest0-21swapper/322:07:433
24734992310,5cyclictest0-21swapper/121:56:381
2473399230,2cyclictest0-21swapper/021:10:020
2473399230,2cyclictest0-21swapper/019:35:220
2473399230,2cyclictest0-21swapper/019:25:000
229882230,3sleep20-21swapper/222:20:482
2473699228,3cyclictest0-21swapper/322:47:043
2473699221,4cyclictest0-21swapper/323:00:283
2473699221,4cyclictest0-21swapper/322:25:093
2473699221,11cyclictest0-21swapper/300:17:193
24735992218,3cyclictest12479-21sshd00:04:352
24735992216,4cyclictest36-21rcuop/200:09:182
24735992212,2cyclictest10950irq/23-ehci_hcd23:35:212
24735992211,5cyclictest10950irq/23-ehci_hcd22:00:302
2473499229,6cyclictest10950irq/23-ehci_hcd00:08:241
2473499227,6cyclictest27821-21sshd21:53:571
24734992216,4cyclictest23599-21sshd00:36:441
24734992211,4cyclictest19821-21sshd21:25:431
278312212,17sleep1135650irq/27-eth000:24:301
2473699217,6cyclictest135650irq/27-eth000:37:253
2473699214,6cyclictest0-21swapper/321:10:043
24736992111,1cyclictest0-21swapper/321:00:133
2473699211,11cyclictest0-21swapper/319:49:393
24735992116,4cyclictest1848-21nfsd23:01:542
24735992115,4cyclictest13822-21sshd00:13:582
24735992114,5cyclictest9295-21nscd22:55:572
2473599210,19cyclictest33-21ksoftirqd/223:22:432
2473599210,18cyclictest29499-21sshd00:27:422
24734992118,1cyclictest0-21swapper/123:16:441
24734992116,3cyclictest1848-21nfsd23:46:591
24734992116,3cyclictest1848-21nfsd23:46:591
24734992111,7cyclictest7912-21sshd00:25:321
2473499210,19cyclictest135650irq/27-eth023:43:141
2473599201,17cyclictest33-21ksoftirqd/223:11:462
24734992014,5cyclictest1848-21nfsd23:13:051
24734992014,4cyclictest5937-21sshd22:22:181
24734992012,5cyclictest31019-21sshd23:26:111
24734992012,3cyclictest0-21swapper/121:49:161
2473399200,2cyclictest2405-21runrttasks19:53:350
2473399200,2cyclictest13811-21sort19:55:170
2473399200,2cyclictest1190-21crond19:30:000
2473399200,1cyclictest26792-21crond19:15:000
2473699199,5cyclictest0-21swapper/319:43:093
2473599199,5cyclictest10950irq/23-ehci_hcd21:37:402
2473599193,12cyclictest22352-21sshd22:26:532
24735991915,2cyclictest29483-21sshd00:37:232
24735991914,3cyclictest12769-21sshd21:52:292
24735991913,4cyclictest9594-21sshd21:58:192
2473499197,5cyclictest0-21swapper/100:10:351
2473499196,6cyclictest10950irq/23-ehci_hcd22:05:171
2473399190,15cyclictest3668-21diskstats20:45:180
24736991811,2cyclictest10950irq/23-ehci_hcd23:44:403
24735991814,2cyclictest1848-21nfsd23:30:012
24735991814,2cyclictest0-21swapper/223:51:242
24735991813,4cyclictest32182-21sshd22:49:262
24735991813,3cyclictest5230-21bash22:40:372
24735991813,3cyclictest32172-21bash23:41:362
24735991812,4cyclictest3452-21sshd23:57:292
24735991812,3cyclictest135650irq/27-eth021:31:292
2473499185,4cyclictest21444-21sshd22:36:011
2473499184,5cyclictest135650irq/27-eth022:46:031
24734991813,4cyclictest1893-21nscd22:25:261
24734991813,3cyclictest36-21rcuop/222:30:061
2473499180,9cyclictest15872-21cp23:36:571
2473399181,4cyclictest0-21swapper/020:59:460
2473399181,1cyclictest19524-21ls20:10:000
2473399181,15cyclictest0-21swapper/020:13:300
2473399180,2cyclictest0-21swapper/021:00:160
2473399180,2cyclictest0-21swapper/019:40:160
24735991713,2cyclictest27085-21sshd00:24:242
24735991712,3cyclictest22520-21sshd23:07:002
2473499171,8cyclictest0-21swapper/121:13:171
2473499170,4cyclictest16563-21sshd22:17:121
2473499170,15cyclictest9488-21sshd23:05:441
2473399177,9cyclictest0-21swapper/020:40:220
2473399177,7cyclictest0-21swapper/020:50:590
2473399173,9cyclictest0-21swapper/020:00:140
2473399171,14cyclictest0-21swapper/020:30:150
2473399170,16cyclictest0-21swapper/020:35:200
2473699161,13cyclictest0-21swapper/320:35:143
2473599160,8cyclictest15642-21sshd00:17:092
2473599160,14cyclictest135650irq/27-eth020:27:572
2473399160,2cyclictest0-21swapper/020:25:230
2473399160,1cyclictest0-21swapper/020:16:320
2473399160,14cyclictest0-21swapper/020:20:160
2473699154,2cyclictest1848-21nfsd19:35:223
2473699150,13cyclictest0-21swapper/320:24:093
2473699150,11cyclictest0-21swapper/320:17:093
24735991513,1cyclictest0-21swapper/220:43:222
2473499153,4cyclictest10950irq/23-ehci_hcd19:33:361
24734991511,3cyclictest10950irq/23-ehci_hcd19:43:551
24734991510,4cyclictest10950irq/23-ehci_hcd20:49:341
2473699149,1cyclictest30664-21chrt20:31:523
2473699140,12cyclictest8480-21fschecks_time20:55:143
2473599148,5cyclictest0-21swapper/219:37:542
2473599146,3cyclictest10950irq/23-ehci_hcd19:50:212
2473599144,9cyclictest10950irq/23-ehci_hcd20:20:352
2473599144,9cyclictest0-21swapper/220:55:102
2473599142,3cyclictest0-21swapper/221:07:432
2473599141,4cyclictest135650irq/27-eth019:29:152
2473599141,11cyclictest14408-21munin-node19:55:222
2473599140,10cyclictest6650-21fschecks_time19:40:142
2473499148,1cyclictest12554-21sshd19:53:441
2473499146,4cyclictest10950irq/23-ehci_hcd19:15:201
2473499142,11cyclictest10950irq/23-ehci_hcd19:20:491
24734991412,1cyclictest0-21swapper/119:26:001
2473499141,11cyclictest10153-21taskset19:47:091
2473499140,7cyclictest26900-21latency_hist19:15:001
2473499140,12cyclictest27366-21uname20:25:171
2473699138,4cyclictest11569-21tr19:50:173
2473699130,4cyclictest741-21turbostat20:44:553
2473699130,4cyclictest0-21swapper/321:06:063
2473699130,3cyclictest0-21swapper/319:20:213
2473699130,2cyclictest0-21swapper/320:50:123
2473699130,12cyclictest0-21swapper/320:46:503
2473699130,12cyclictest0-21swapper/320:25:343
2473699130,12cyclictest0-21swapper/320:10:473
2473699130,12cyclictest0-21swapper/319:55:003
2473699130,12cyclictest0-21swapper/319:27:503
2473699130,11cyclictest2157-21perl19:30:153
2473699130,11cyclictest18634-21munin-node20:05:223
2473699130,11cyclictest15501-21df_inode20:00:133
2473599138,4cyclictest6306-21hwlatdetect20:50:152
2473599137,2cyclictest10950irq/23-ehci_hcd20:05:162
2473599131,4cyclictest0-21swapper/220:35:302
24735991311,1cyclictest0-21swapper/220:45:052
24735991311,1cyclictest0-21swapper/219:13:192
2473599130,5cyclictest0-21swapper/220:00:442
2473599130,4cyclictest2405-21runrttasks19:45:182
2473599130,12cyclictest0-21swapper/221:00:262
2473599130,12cyclictest0-21swapper/220:34:202
2473599130,12cyclictest0-21swapper/220:11:262
2473599130,12cyclictest0-21swapper/219:30:422
2473599130,12cyclictest0-21swapper/219:21:082
2473599130,12cyclictest0-21swapper/219:19:582
2473499139,3cyclictest135650irq/27-eth021:00:431
2473499139,3cyclictest135650irq/27-eth020:22:331
2473499136,2cyclictest0-21swapper/121:05:161
2473499133,9cyclictest0-21swapper/120:40:141
24734991311,1cyclictest0-21swapper/119:57:371
2473499130,4cyclictest18345-21memory20:05:201
2473499130,12cyclictest0-21swapper/120:50:091
2473499130,12cyclictest0-21swapper/120:30:121
2473499130,12cyclictest0-21swapper/120:14:241
2473499130,12cyclictest0-21swapper/120:01:261
2473499130,11cyclictest8212-21df_inode20:55:131
2473499130,11cyclictest31911-21iostat_ios20:35:171
2473699120,3cyclictest25630-21memory19:10:173
2473699120,11cyclictest0-21swapper/319:18:343
2473599120,4cyclictest0-21swapper/220:15:052
24734991210,1cyclictest0-21swapper/119:35:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional