You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 17:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Dec 01, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2996921800,3sleep10-21swapper/109:37:281
1163121350,3sleep2940399cyclictest12:05:352
2759421330,2sleep20-21swapper/211:13:512
2633921300,2sleep20-21swapper/209:37:042
442221250,5sleep3940499cyclictest12:23:423
2822021200,3sleep1940299cyclictest11:20:291
2850521130,1sleep20-21swapper/212:32:152
553921110,1sleep30-21swapper/309:24:353
1318621090,4sleep2940399cyclictest11:08:582
1156021070,7sleep10-21swapper/111:15:271
1100821070,1sleep011009-21sshd11:59:230
217221060,1sleep22160-21sshd12:23:302
8887210432,43sleep30-21swapper/307:06:523
2138721020,2sleep121384-21bash09:22:521
94412980,1sleep1940299cyclictest10:41:331
250552980,1sleep00-21swapper/011:46:440
241252940,3sleep30-21swapper/310:26:273
112372940,3sleep30-21swapper/309:32:083
263412920,1sleep126321-21sshd10:13:381
256522920,1sleep10-21swapper/112:28:501
888029032,46sleep10-21swapper/107:06:461
216992890,1sleep30-21swapper/311:19:583
230802880,0sleep00-21swapper/009:23:040
90422870,1sleep39041-21bash10:05:063
142412870,0sleep00-21swapper/012:34:060
206252860,2sleep10-21swapper/109:19:271
29662850,2sleep20-21swapper/209:44:372
129382850,2sleep10-21swapper/111:45:251
57172840,2sleep10-21swapper/112:39:311
46892840,2sleep10-21swapper/110:21:161
102792840,3sleep20-21swapper/210:18:362
63522830,2sleep10-21swapper/110:47:491
235422830,3sleep30-21swapper/311:39:583
109002830,2sleep20-21swapper/209:25:102
190282820,2sleep11848-21nfsd10:09:341
189712820,2sleep218962-21sshd10:25:552
314822810,2sleep231483-21sshd11:44:102
286972780,1sleep028696-21bash10:13:540
256702780,2sleep325671-21bash10:23:273
25562780,1sleep10-21swapper/109:57:441
61762730,2sleep36173-21bash11:48:163
902927232,11sleep20-21swapper/207:08:402
87422720,2sleep03-21ksoftirqd/009:51:370
185832720,2sleep10-21swapper/112:12:381
304812690,2sleep22405-21runrttasks09:20:212
79342650,0sleep00-21swapper/009:14:300
898825633,11sleep00-21swapper/007:08:090
251762510,0sleep31848-21nfsd10:36:293
22222500,0sleep02220-21bash12:17:140
227272420,39sleep3135650irq/27-eth012:03:403
207882400,3sleep20-21swapper/210:32:482
9404993331,1cyclictest0-21swapper/312:13:503
9403993328,3cyclictest16968-21sshd11:56:212
299942330,4sleep3940499cyclictest12:32:253
940399321,3cyclictest0-21swapper/211:51:322
267762310,3sleep10-21swapper/111:27:021
940399302,4cyclictest16078-21id11:49:212
9401993012,17cyclictest3-21ksoftirqd/011:27:560
65312300,24sleep1135650irq/27-eth009:41:421
151792300,3sleep11847-21nfsd10:19:071
9402992914,4cyclictest0-21swapper/111:39:191
940299291,25cyclictest22-21ksoftirqd/111:35:011
940299290,21cyclictest22-21ksoftirqd/110:36:501
9401992815,11cyclictest10-21rcuc/010:19:350
940399274,4cyclictest1847-21nfsd10:38:212
940399273,22cyclictest33-21ksoftirqd/210:04:542
9403992713,3cyclictest19471-21sshd11:39:332
140692270,1sleep314071-21id12:09:043
940399261,4cyclictest3973-21sshd12:39:222
940299265,18cyclictest22-21ksoftirqd/111:53:471
940199261,11cyclictest0-21swapper/012:13:220
940199260,18cyclictest0-21swapper/012:24:160
322842260,2sleep232283-21bash09:47:302
219772260,2sleep20-21swapper/210:13:112
132022260,2sleep113206-21sshd12:15:161
940399253,20cyclictest33-21ksoftirqd/209:53:442
9403992515,4cyclictest25-21rcuop/111:04:302
9403992511,12cyclictest33-21ksoftirqd/210:51:442
9402992522,2cyclictest27511-21sshd09:33:561
940299252,18cyclictest22-21ksoftirqd/110:00:011
940199251,21cyclictest30080-21sshd10:33:460
78752250,2sleep10-21swapper/110:31:271
200232252,21sleep3135650irq/27-eth009:49:373
9404992415,5cyclictest10665-21sshd11:52:073
9403992413,8cyclictest31491-21kworker/2:112:04:262
9403992413,8cyclictest135650irq/27-eth011:25:402
940399241,21cyclictest33-21ksoftirqd/211:34:372
940399240,22cyclictest33-21ksoftirqd/209:58:242
9402992413,8cyclictest22-21ksoftirqd/112:09:251
9402992412,8cyclictest0-21swapper/111:08:161
9402992410,7cyclictest135650irq/27-eth011:12:161
9402992410,4cyclictest0-21swapper/111:56:181
9401992421,2cyclictest0-21swapper/011:36:180
17812240,2sleep30-21swapper/311:21:063
940399233,18cyclictest33-21ksoftirqd/210:55:482
940399232,17cyclictest33-21ksoftirqd/209:18:212
9403992319,2cyclictest1848-21nfsd11:16:282
940399230,22cyclictest33-21ksoftirqd/210:42:232
940399230,20cyclictest33-21ksoftirqd/209:31:432
9402992315,5cyclictest31374-21sshd11:04:141
940299230,15cyclictest22-21ksoftirqd/112:03:411
940199238,8cyclictest3-21ksoftirqd/010:08:100
940199238,12cyclictest3-21ksoftirqd/009:55:130
9401992315,4cyclictest3-21ksoftirqd/011:41:590
940199230,21cyclictest0-21swapper/009:34:390
172602230,0sleep00-21swapper/011:12:420
940499228,9cyclictest6196-21sshd11:55:123
940499220,20cyclictest0-21swapper/309:18:043
940399222,18cyclictest33-21ksoftirqd/211:21:332
9403992215,4cyclictest16987-21bash12:15:332
9403992212,2cyclictest31971-21sshd12:26:162
9402992213,7cyclictest27941-21sshd11:43:441
9402992213,6cyclictest22-21ksoftirqd/109:51:561
940299220,19cyclictest22-21ksoftirqd/109:49:001
940299220,12cyclictest36-21rcuop/209:25:291
940199227,12cyclictest3-21ksoftirqd/010:45:280
940199223,1cyclictest0-21swapper/010:25:170
940199221,9cyclictest14393-21sshd09:25:240
940199221,19cyclictest0-21swapper/012:35:510
940199221,17cyclictest0-21swapper/011:05:160
940199220,8cyclictest29245-21sshd11:00:220
940499217,5cyclictest135650irq/27-eth009:26:033
9404992113,2cyclictest10950irq/23-ehci_hcd09:56:173
9403992116,2cyclictest1959-21sshd12:12:092
940399210,19cyclictest33-21ksoftirqd/210:23:062
940399210,19cyclictest33-21ksoftirqd/210:05:112
940299218,7cyclictest1847-21nfsd10:26:391
940299216,5cyclictest30058-21iostat10:50:151
9402992114,5cyclictest12172-21sshd10:58:411
940199211,8cyclictest1959-21sshd11:51:560
9401992114,5cyclictest3-21ksoftirqd/011:17:320
9401992112,8cyclictest1848-21nfsd09:47:510
940199211,17cyclictest1959-21sshd12:25:510
940199211,15cyclictest5179-21sshd12:01:560
940499208,7cyclictest36-21rcuop/211:43:153
940499206,6cyclictest135650irq/27-eth010:50:593
940499206,6cyclictest10950irq/23-ehci_hcd09:44:203
9404992011,6cyclictest0-21swapper/310:12:293
9404992010,5cyclictest135650irq/27-eth011:31:593
9403992011,6cyclictest27039-21sshd10:50:012
9402992015,3cyclictest6068-21id12:30:051
9402992013,5cyclictest23651-21bash12:22:261
940199209,5cyclictest8-21rcu_preempt10:40:520
940199209,5cyclictest3-21ksoftirqd/009:44:330
940199208,11cyclictest3-21ksoftirqd/010:03:520
9401992012,6cyclictest10-21rcuc/010:58:310
9401992012,4cyclictest0-21swapper/009:19:070
940199201,17cyclictest13800-21kworker/0:010:37:350
940199201,17cyclictest0-21swapper/012:08:250
940199200,8cyclictest17135-21sshd10:52:150
219962202,16sleep3135650irq/27-eth009:39:583
940499199,2cyclictest0-21swapper/310:59:323
940499198,5cyclictest0-21swapper/311:25:543
940499197,6cyclictest135650irq/27-eth010:18:363
940499195,5cyclictest10950irq/23-ehci_hcd11:06:143
940499194,3cyclictest135650irq/27-eth010:44:033
940399192,12cyclictest33-21ksoftirqd/208:40:132
940199199,9cyclictest3-21ksoftirqd/010:20:550
940199191,5cyclictest0-21swapper/009:38:420
9401991913,5cyclictest3-21ksoftirqd/011:31:020
940199191,17cyclictest0-21swapper/011:24:390
210922190,17sleep3135650irq/27-eth012:15:583
940499182,6cyclictest28176-21sshd12:38:353
9404991811,1cyclictest44-21ksoftirqd/310:04:163
940399182,11cyclictest13760-21perf07:20:002
940399182,11cyclictest13760-21perf07:20:002
940299188,4cyclictest135650irq/27-eth007:45:231
940499176,0cyclictest0-21swapper/309:50:103
9404991710,4cyclictest1848-21nfsd12:25:033
940499170,8cyclictest20377-21sshd11:02:583
940499170,4cyclictest1847-21nfsd11:11:063
940499170,12cyclictest0-21swapper/310:46:093
940299170,16cyclictest0-21swapper/109:13:101
940499167,7cyclictest28977-21sshd10:30:193
9404991613,2cyclictest0-21swapper/309:02:393
9403991612,2cyclictest0-21swapper/207:24:032
940399161,14cyclictest33-21ksoftirqd/209:12:422
940299167,4cyclictest135650irq/27-eth007:19:091
940299167,4cyclictest135650irq/27-eth007:19:081
940199161,3cyclictest0-21swapper/007:41:130
940199161,12cyclictest0-21swapper/007:38:100
940499156,1cyclictest32111-21sshd09:13:383
940399153,4cyclictest10950irq/23-ehci_hcd09:00:472
9403991511,3cyclictest10950irq/23-ehci_hcd07:41:342
940299157,6cyclictest0-21swapper/108:31:381
940299157,6cyclictest0-21swapper/108:07:271
9402991511,3cyclictest10950irq/23-ehci_hcd08:40:431
940299150,13cyclictest6670-21sshd08:15:041
940299150,13cyclictest0-21swapper/108:25:161
940199159,1cyclictest0-21swapper/008:40:180
940199157,5cyclictest0-21swapper/007:28:200
940199150,14cyclictest0-21swapper/007:56:430
940199150,12cyclictest0-21swapper/008:48:550
940199150,12cyclictest0-21swapper/007:20:460
940499143,10cyclictest10950irq/23-ehci_hcd07:44:383
9404991412,1cyclictest0-21swapper/309:07:163
940499141,12cyclictest26265-40kipmi007:55:183
9404991411,2cyclictest10950irq/23-ehci_hcd08:30:303
940499140,13cyclictest0-21swapper/307:31:503
940399142,11cyclictest135650irq/27-eth008:30:282
9403991411,3cyclictest10950irq/23-ehci_hcd08:47:462
940399141,12cyclictest135650irq/27-eth008:12:582
940399140,11cyclictest144550irq/28-eth1-rx-07:59:222
940299149,4cyclictest135650irq/27-eth007:56:001
9402991411,2cyclictest10950irq/23-ehci_hcd08:36:541
9402991410,3cyclictest25106-21cpuspeed_turbos08:55:111
940299140,13cyclictest0-21swapper/109:00:161
940199147,3cyclictest0-21swapper/008:12:460
940199146,7cyclictest0-21swapper/009:00:130
9401991412,1cyclictest8413-21kworker/0:208:50:450
9401991412,1cyclictest0-21swapper/008:04:430
940199140,11cyclictest0-21swapper/008:20:060
940199140,11cyclictest0-21swapper/007:50:120
940199140,10cyclictest0-21swapper/009:05:030
940499138,3cyclictest25594-21hddtemp_smartct08:55:133
940499138,3cyclictest0-21swapper/308:25:183
940499136,3cyclictest10950irq/23-ehci_hcd07:25:183
940499132,3cyclictest135650irq/27-eth008:00:033
940499132,10cyclictest135650irq/27-eth008:16:493
9404991311,1cyclictest0-21swapper/308:12:253
940499130,4cyclictest16978-21runrttasks08:35:223
940499130,4cyclictest0-21swapper/307:15:063
940499130,4cyclictest0-21swapper/307:15:063
940499130,12cyclictest0-21swapper/308:51:373
940499130,12cyclictest0-21swapper/308:45:593
940499130,12cyclictest0-21swapper/308:40:543
940499130,12cyclictest0-21swapper/308:23:013
940499130,12cyclictest0-21swapper/307:47:203
940499130,12cyclictest0-21swapper/307:35:223
940499130,12cyclictest0-21swapper/307:23:563
940499130,11cyclictest28963-21switchtime07:50:223
940399138,3cyclictest9749-21df_inode07:10:132
940399138,3cyclictest20177-21users07:30:242
940399131,3cyclictest12026-21munin-node08:25:172
940399131,11cyclictest135650irq/27-eth008:06:212
940399131,11cyclictest0-21swapper/208:38:412
9403991311,1cyclictest0-21swapper/207:51:232
940399130,4cyclictest8963-21munin-node08:20:132
940399130,12cyclictest29499-21munin-node09:05:262
940399130,12cyclictest0-21swapper/208:50:012
940399130,12cyclictest0-21swapper/208:17:542
940399130,12cyclictest0-21swapper/208:01:312
940399130,12cyclictest0-21swapper/207:45:382
940399130,11cyclictest16585-21df_inode07:25:132
940399130,10cyclictest135650irq/27-eth008:55:582
940299136,2cyclictest135650irq/27-eth007:20:091
940299130,4cyclictest9294-21munin-node08:20:131
940299130,12cyclictest0-21swapper/109:06:461
940299130,12cyclictest0-21swapper/108:10:061
940299130,12cyclictest0-21swapper/108:01:271
940299130,12cyclictest0-21swapper/107:51:231
940299130,12cyclictest0-21swapper/107:26:041
940299130,11cyclictest2405-21runrttasks07:40:191
940299130,11cyclictest2405-21runrttasks07:10:211
940199137,2cyclictest0-21swapper/008:26:220
940199131,1cyclictest0-21swapper/007:31:090
9401991311,1cyclictest0-21swapper/008:56:120
940199131,11cyclictest0-21swapper/008:35:240
940199130,1cyclictest0-21swapper/007:19:010
940199130,1cyclictest0-21swapper/007:19:000
940199130,12cyclictest0-21swapper/008:32:250
940199130,12cyclictest0-21swapper/008:05:110
940499121,2cyclictest0-21swapper/307:10:143
940499120,11cyclictest0-21swapper/308:05:053
940399120,11cyclictest0-21swapper/207:35:162
940299128,3cyclictest20690-21diskstats08:45:151
940299120,10cyclictest23401-21iostat08:50:151
940299120,10cyclictest21806-21munin-node07:35:171
940299120,10cyclictest18526-21taskset07:30:051
940199121,1cyclictest25685-21df_inode07:45:140
940199120,4cyclictest0-21swapper/007:13:170
940199120,11cyclictest0-21swapper/008:16:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional