You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 05:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Nov 23, 2025 00:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
681421470,3sleep2940299cyclictest23:37:202
488121360,1sleep30-21swapper/323:12:403
474321350,133sleep326950irq/26-ahci[00000:21:433
1397021280,0sleep313971-21sshd23:07:223
940421220,3sleep0940099cyclictest21:47:190
2571521170,2sleep20-21swapper/200:07:392
1536321170,1sleep00-21swapper/022:00:030
2163521150,3sleep1940199cyclictest00:20:111
52192970,1sleep3940399cyclictest22:35:323
307332950,0sleep130732-21bash21:12:581
25712950,1sleep00-21swapper/023:15:260
260282940,3sleep30-21swapper/322:10:073
287482900,0sleep00-21swapper/021:30:560
212132900,3sleep121210-21bash22:37:061
4972890,1sleep0495-21sshd00:18:030
24022870,4sleep10-21swapper/122:01:471
900228633,49sleep30-21swapper/319:08:183
145772850,1sleep014572-21sshd23:50:320
123512840,0sleep00-21swapper/000:09:360
886028233,44sleep10-21swapper/119:06:491
76382820,2sleep30-21swapper/323:46:473
37822820,2sleep10-21swapper/123:49:371
287312820,1sleep00-21swapper/021:43:080
22442820,1sleep00-21swapper/021:28:330
127662820,0sleep00-21swapper/023:31:450
269112810,2sleep20-21swapper/223:55:002
158802810,3sleep21848-21nfsd21:23:452
183542800,1sleep10-21swapper/121:45:121
144222800,1sleep08-21rcu_preempt23:44:240
190702790,4sleep1940199cyclictest19:30:151
81352780,0sleep00-21swapper/022:54:250
174122780,2sleep10-21swapper/122:27:291
173362780,3sleep217312-21sshd22:36:442
179192770,1sleep017914-21sshd00:36:010
905027333,11sleep20-21swapper/219:08:532
32042710,2sleep23203-21sshd23:27:502
66472670,4sleep2940299cyclictest00:02:252
300132670,65sleep126950irq/26-ahci[00023:58:251
227192660,0sleep00-21swapper/023:35:410
188802640,1sleep30-21swapper/321:11:483
10602640,4sleep1940199cyclictest21:25:201
229182630,2sleep3940399cyclictest21:18:213
172592620,2sleep21847-21nfsd00:10:062
294822590,0sleep029480-21bash22:16:260
224902580,1sleep30-21swapper/321:33:283
316392550,1sleep10-21swapper/119:56:081
903425233,15sleep00-21swapper/019:08:430
300232480,0sleep330024-21cpuspeed_turbos21:40:143
169822480,1sleep10-21swapper/123:13:511
42602470,1sleep10-21swapper/121:59:001
212462470,1sleep321237-21sshd23:41:503
137382440,2sleep3940399cyclictest23:19:423
292602410,4sleep30-21swapper/322:19:343
80502370,2sleep10-21swapper/121:16:541
189952350,3sleep30-21swapper/321:45:143
168562332,28sleep1135650irq/27-eth000:00:161
276422320,2sleep10-21swapper/122:16:141
231372310,1sleep09399-21cyclictest22:34:180
323042302,26sleep126950irq/26-ahci[00000:27:471
9401992910,18cyclictest22-21ksoftirqd/123:07:101
90622290,2sleep3940399cyclictest22:51:153
245412280,0sleep00-21swapper/022:59:070
940199277,18cyclictest22-21ksoftirqd/122:07:051
9401992717,7cyclictest19930-21sshd00:13:361
9401992715,6cyclictest13400-21bash23:31:481
327482270,3sleep10-21swapper/123:21:231
282962270,0sleep00-21swapper/000:04:400
940199266,17cyclictest22-21ksoftirqd/121:54:021
9401992619,5cyclictest10950irq/23-ehci_hcd23:26:531
9401992611,4cyclictest0-21swapper/123:51:221
940199260,18cyclictest22-21ksoftirqd/123:43:431
940099266,6cyclictest1959-21sshd21:58:130
940099260,22cyclictest0-21swapper/022:44:120
940099260,22cyclictest0-21swapper/022:44:110
9401992512,6cyclictest10950irq/23-ehci_hcd19:17:241
940199251,16cyclictest22-21ksoftirqd/100:36:381
3362250,23sleep3135650irq/27-eth021:58:383
296072250,2sleep30-21swapper/322:07:223
940199247,15cyclictest22-21ksoftirqd/100:08:431
940199246,13cyclictest22-21ksoftirqd/121:21:461
940099243,14cyclictest0-21swapper/021:39:250
9400992412,11cyclictest0-21swapper/019:11:360
305492240,1sleep09399-21cyclictest21:12:570
225152240,2sleep322504-21sshd22:27:593
181862240,2sleep218187-21bash00:16:312
135662240,22sleep1135650irq/27-eth023:04:171
940199235,14cyclictest22-21ksoftirqd/123:38:241
940199233,16cyclictest22-21ksoftirqd/122:56:131
9401992314,5cyclictest0-21swapper/100:31:461
9401992314,5cyclictest0-21swapper/100:31:451
9401992313,4cyclictest3961-21cp21:37:461
9401992312,6cyclictest135650irq/27-eth022:52:391
9401992310,5cyclictest15844-21bash22:48:511
940099230,21cyclictest0-21swapper/022:14:580
940099230,1cyclictest0-21swapper/021:22:190
178012230,2sleep317800-21sshd23:23:063
9402992216,4cyclictest16320-21sshd22:42:462
9402992216,4cyclictest16320-21sshd22:42:452
940199222,18cyclictest22-21ksoftirqd/121:41:281
9401992213,5cyclictest13230-21sshd22:42:271
9401992213,5cyclictest13230-21sshd22:42:271
9401992211,8cyclictest22-21ksoftirqd/122:32:361
940199220,16cyclictest22-21ksoftirqd/123:18:431
79142220,2sleep20-21swapper/200:38:252
64302220,2sleep10-21swapper/122:11:141
21832220,20sleep3135650irq/27-eth000:28:003
149232220,1sleep114924-21timerandwakeup20:30:221
110592220,19sleep3135650irq/27-eth022:02:393
940299218,4cyclictest10950irq/23-ehci_hcd21:52:272
940299217,5cyclictest26950irq/26-ahci[00022:58:112
9401992110,9cyclictest135650irq/27-eth000:17:481
940099219,10cyclictest23321-21sshd22:37:190
171332211,17sleep310950irq/23-ehci_hcd00:03:323
940399206,6cyclictest10950irq/23-ehci_hcd19:11:373
9402992010,4cyclictest144550irq/28-eth1-rx-22:48:542
940199208,9cyclictest22-21ksoftirqd/119:50:141
9401992011,4cyclictest1959-21sshd21:32:371
940199200,18cyclictest22-21ksoftirqd/122:23:101
940099200,1cyclictest0-21swapper/023:45:240
286502200,0sleep00-21swapper/019:50:180
940399195,3cyclictest24897-21sshd00:14:053
9402991913,3cyclictest23231-21bash22:15:482
940099198,10cyclictest0-21swapper/021:16:420
940099192,2cyclictest10142-21sshd00:32:010
940099192,2cyclictest10142-21sshd00:32:010
940099190,9cyclictest0-21swapper/000:14:110
940099190,2cyclictest7712-21sshd23:09:560
940099190,17cyclictest0-21swapper/023:14:520
940399184,1cyclictest25828-21sshd23:26:533
940399182,3cyclictest31699-21sshd21:22:093
940399181,5cyclictest12465-21sshd23:50:213
9402991816,1cyclictest0-21swapper/220:54:432
9402991813,4cyclictest14458-21sshd23:16:362
9402991811,2cyclictest32411-21bash22:25:472
940099188,7cyclictest0-21swapper/020:31:390
940099186,8cyclictest0-21swapper/023:23:200
940099185,8cyclictest1949-21sshd22:23:000
940099184,9cyclictest27898-21sshd00:20:430
940099184,3cyclictest15183-21kworker/0:119:48:030
940099180,2cyclictest0-21swapper/022:25:250
940099180,17cyclictest26409-21sshd22:49:550
940099180,17cyclictest0-21swapper/023:58:200
940099180,17cyclictest0-21swapper/020:50:130
940099180,16cyclictest0-21swapper/023:00:140
940099180,16cyclictest0-21swapper/000:27:430
20092180,16sleep3135650irq/27-eth022:20:023
940399171,5cyclictest16033-21sshd23:35:093
940399171,4cyclictest21176-21sshd22:49:223
940399171,4cyclictest11587-21bash23:04:053
9403991714,2cyclictest28759-21sshd21:37:013
940399171,3cyclictest0-21swapper/300:36:253
9403991712,4cyclictest17096-21sshd22:58:243
940399170,8cyclictest0-21swapper/300:17:293
940399170,15cyclictest1893-21nscd22:33:183
940399170,15cyclictest10965-21sshd00:06:043
940399170,11cyclictest28328-21bash23:30:133
940299179,6cyclictest5669-21sshd22:50:562
940299172,13cyclictest18487-21sshd21:39:092
9402991712,4cyclictest20727-21id21:18:092
9402991712,3cyclictest28123-21sshd23:14:552
940299171,14cyclictest16617-21sshd23:22:592
940199170,15cyclictest0-21swapper/120:10:131
940099179,4cyclictest0-21swapper/023:27:010
940099176,10cyclictest9737-21id21:53:260
940099170,1cyclictest0-21swapper/019:22:570
940099170,16cyclictest0-21swapper/022:05:320
940099170,16cyclictest0-21swapper/021:02:560
940099170,16cyclictest0-21swapper/019:56:350
272792170,15sleep3135650irq/27-eth023:55:013
234332172,12sleep3135650irq/27-eth021:27:283
940399161,6cyclictest135650irq/27-eth021:51:343
940399160,14cyclictest0-21swapper/319:55:173
940299169,6cyclictest28255-21sshd22:22:262
940299167,8cyclictest1847-21nfsd23:03:312
940299167,7cyclictest3351-21id23:49:352
940299165,6cyclictest16584-21bash22:30:252
940299165,10cyclictest0-21swapper/222:13:062
940299162,12cyclictest7019-21sshd23:34:202
940299161,6cyclictest0-21swapper/223:05:192
940299161,13cyclictest23367-21sshd23:42:022
940299161,13cyclictest0-21swapper/200:27:522
940199163,11cyclictest2405-21runrttasks20:28:581
9401991610,3cyclictest0-21swapper/119:40:161
940099164,11cyclictest0-21swapper/021:05:150
940099164,11cyclictest0-21swapper/021:05:150
940099160,8cyclictest0-21swapper/019:19:330
940099160,1cyclictest0-21swapper/020:59:470
940099160,1cyclictest0-21swapper/019:35:170
940099160,15cyclictest0-21swapper/020:47:340
940099160,15cyclictest0-21swapper/020:41:520
940099160,15cyclictest0-21swapper/020:10:480
940099160,12cyclictest0-21swapper/020:27:510
207922160,3sleep22405-21runrttasks00:33:082
207922160,3sleep22405-21runrttasks00:33:072
940399154,10cyclictest10950irq/23-ehci_hcd21:04:273
940399151,2cyclictest10950irq/23-ehci_hcd22:41:523
940399151,2cyclictest10950irq/23-ehci_hcd22:41:513
9403991511,3cyclictest10950irq/23-ehci_hcd19:18:103
940399151,12cyclictest1927-21snmpd21:05:133
940399151,12cyclictest1927-21snmpd21:05:133
940399150,11cyclictest13177-21sshd00:32:203
940399150,11cyclictest13177-21sshd00:32:203
940299157,6cyclictest10002-21cut19:10:152
940299155,2cyclictest0-21swapper/220:08:112
940299153,1cyclictest30929-21sshd23:55:182
940299152,11cyclictest0-21swapper/200:21:382
9402991512,2cyclictest0-21swapper/222:06:252
9402991511,3cyclictest1848-21nfsd21:49:022
9402991511,3cyclictest0-21swapper/221:09:272
9402991511,3cyclictest0-21swapper/221:09:262
9402991510,4cyclictest28806-21sshd21:40:082
9402991510,4cyclictest13443-21sshd21:32:372
940299150,6cyclictest13589-21sshd21:26:292
940299150,4cyclictest17115-21sshd21:11:372
940299150,13cyclictest0-21swapper/221:55:482
9401991511,3cyclictest10950irq/23-ehci_hcd19:26:541
940099155,8cyclictest0-21swapper/020:36:030
940099150,3cyclictest17023-21ipmitool19:25:170
940099150,2cyclictest0-21swapper/020:20:480
940099150,14cyclictest0-21swapper/020:01:160
940099150,11cyclictest0-21swapper/020:17:110
233542150,13sleep226950irq/26-ahci[00022:00:412
940399148,5cyclictest0-21swapper/319:22:373
940399144,9cyclictest0-21swapper/320:17:043
940399143,10cyclictest10950irq/23-ehci_hcd20:05:053
940399142,11cyclictest0-21swapper/319:50:043
9403991411,2cyclictest10950irq/23-ehci_hcd19:44:593
940399141,11cyclictest20009-21timerwakeupswit19:30:233
940299141,11cyclictest0-21swapper/219:45:162
940299140,13cyclictest10950irq/23-ehci_hcd20:45:392
940099146,7cyclictest0-21swapper/020:05:270
940099140,1cyclictest0-21swapper/019:40:220
940399138,4cyclictest0-21swapper/320:50:003
940399138,3cyclictest20689-21diskstats20:45:133
940399131,3cyclictest4408-21munin-node20:10:173
940399131,11cyclictest1848-21nfsd20:01:423
940399131,11cyclictest15278-21runrttasks20:31:383
940399131,10cyclictest0-21swapper/320:20:253
940399130,12cyclictest0-21swapper/320:55:473
940399130,12cyclictest0-21swapper/320:25:023
940399130,12cyclictest0-21swapper/319:45:053
940399130,12cyclictest0-21swapper/319:35:013
940399130,11cyclictest16579-21diskstats19:25:153
940399130,10cyclictest10950irq/23-ehci_hcd20:41:553
940299134,1cyclictest0-21swapper/219:56:112
940299133,2cyclictest2405-21runrttasks20:31:362
940299132,3cyclictest135650irq/27-eth020:40:252
940299131,4cyclictest135650irq/27-eth019:25:552
940299130,7cyclictest0-21swapper/219:36:072
940299130,3cyclictest135650irq/27-eth020:25:162
940299130,12cyclictest144550irq/28-eth1-rx-19:30:242
940299130,12cyclictest0-21swapper/221:01:382
940299130,12cyclictest0-21swapper/220:58:242
940299130,12cyclictest0-21swapper/220:38:232
940299130,12cyclictest0-21swapper/220:21:162
940299130,12cyclictest0-21swapper/220:17:012
940299130,12cyclictest0-21swapper/220:13:282
940299130,12cyclictest0-21swapper/219:50:322
940299130,12cyclictest0-21swapper/219:42:422
940299130,12cyclictest0-21swapper/219:15:352
940199131,11cyclictest10950irq/23-ehci_hcd19:35:181
9401991311,1cyclictest0-21swapper/121:04:381
940199130,4cyclictest23288-21fschecks_time20:50:141
940199130,12cyclictest1848-21nfsd20:01:571
940199130,12cyclictest0-21swapper/120:49:251
940199130,12cyclictest0-21swapper/120:15:341
940199130,12cyclictest0-21swapper/120:05:541
940199130,12cyclictest0-21swapper/119:47:211
940199130,12cyclictest0-21swapper/119:21:011
940199130,12cyclictest0-21swapper/119:10:241
940199130,11cyclictest8963-21munin-node20:20:171
940199130,11cyclictest25189-21munin-node20:55:131
940199130,11cyclictest18861-21irqstats20:40:171
940099130,7cyclictest0-21swapper/019:30:550
940399120,3cyclictest16133-21diskstats20:35:143
940299120,11cyclictest135650irq/27-eth020:00:052
940299120,10cyclictest14244-21df19:20:122
940199120,10cyclictest16467-21perl20:35:151
940199120,10cyclictest0-21swapper/121:05:141
940199120,10cyclictest0-21swapper/121:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional