You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 14:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Nov 24, 2025 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1535621610,1sleep20-21swapper/211:22:532
1998321370,1sleep00-21swapper/009:28:170
3017321320,3sleep01849799cyclictest09:15:300
184021300,2sleep31835-21sshd09:22:583
2922621270,2sleep31847-21nfsd10:20:173
2842121230,2sleep01848-21nfsd12:10:480
1790321190,2sleep10-21swapper/110:49:211
2514521050,1sleep125143-21sshd10:56:351
162172990,5sleep31850099cyclictest11:46:433
162932970,1sleep10-21swapper/111:16:101
219362960,1sleep11846-21nfsd11:53:581
214642960,4sleep10-21swapper/110:39:481
1820529533,44sleep30-21swapper/307:09:363
93182940,2sleep10-21swapper/112:25:201
288222930,2sleep30-21swapper/311:27:393
43912920,0sleep00-21swapper/011:31:410
312562900,18sleep2135650irq/27-eth012:07:542
262562900,1sleep21848-21nfsd10:23:252
260262900,2sleep30-21swapper/311:24:013
144812900,4sleep31850099cyclictest10:01:463
276612880,1sleep20-21swapper/212:14:032
245222880,2sleep30-21swapper/311:06:263
199942870,2sleep21848-21nfsd10:19:252
40652860,2sleep24064-21bash11:18:242
228932860,2sleep322891-21cpu12:30:113
221182860,1sleep20-21swapper/212:33:262
1792028432,48sleep10-21swapper/107:06:031
125492830,1sleep10-21swapper/109:34:141
314952820,2sleep10-21swapper/110:40:401
311122820,2sleep131110-21sshd10:33:541
197232820,2sleep219712-21sshd11:26:412
37792810,1sleep11849899cyclictest10:54:311
313342810,2sleep10-21swapper/112:04:441
146422810,2sleep314639-21sshd10:11:563
272472800,3sleep10-21swapper/112:17:151
203922800,0sleep120390-21bash09:18:071
146552800,2sleep10-21swapper/109:44:571
269872790,2sleep226974-21sshd09:15:162
47712780,2sleep14767-21bash11:48:521
257552770,2sleep125751-21bash09:25:251
248202770,1sleep20-21swapper/210:53:192
12592770,1sleep03-21ksoftirqd/011:00:470
316002750,2sleep30-21swapper/309:32:493
262112750,1sleep00-21swapper/011:24:020
44972740,0sleep00-21swapper/011:28:280
40722740,2sleep14071-21bash12:31:341
88732730,0sleep08868-21sshd10:48:240
39472690,0sleep13942-21sshd11:21:401
147012690,2sleep11848-21nfsd12:39:101
292972670,2sleep229290-21sshd09:56:272
34352650,2sleep10-21swapper/112:21:271
128492620,0sleep00-21swapper/011:59:380
285662610,4sleep31850099cyclictest11:51:113
1798825832,22sleep00-21swapper/007:06:530
1809925213,9sleep20-21swapper/207:08:152
165512520,4sleep21849999cyclictest11:12:382
127302440,0sleep312729-21sshd12:12:313
150572360,4sleep10-21swapper/111:42:561
273712350,2sleep30-21swapper/311:40:503
317862340,2sleep131780-21sshd11:07:131
70952330,0sleep20-21swapper/212:28:342
174592330,3sleep10-21swapper/111:29:501
18497993212,4cyclictest3-21ksoftirqd/011:51:490
152102320,27sleep2135650irq/27-eth011:42:572
18497993110,15cyclictest3-21ksoftirqd/011:45:460
1849799310,26cyclictest3692-21rm09:53:520
1849799301,13cyclictest0-21swapper/011:15:060
222792290,3sleep322275-21sshd12:00:263
189062280,2sleep318910-21bash10:32:283
18497992816,11cyclictest3-21ksoftirqd/010:20:490
166192280,3sleep20-21swapper/209:10:422
267892270,2sleep10-21swapper/111:37:271
1849799271,4cyclictest10-21rcuc/011:42:470
18497992714,10cyclictest3-21ksoftirqd/012:37:280
1849799270,25cyclictest11553-21rm11:39:140
1849799270,11cyclictest0-21swapper/010:19:040
318852260,2sleep12405-21runrttasks11:34:291
308432260,2sleep31848-21nfsd09:49:553
238282260,3sleep21849999cyclictest10:46:302
225122260,2sleep122511-21bash09:52:221
1849899266,10cyclictest17971-21sshd12:06:321
1849799261,6cyclictest16029-21bash10:55:360
1849799261,14cyclictest26236-21diskstats10:40:140
18497992610,7cyclictest3-21ksoftirqd/012:07:410
1849799260,1cyclictest0-21swapper/012:24:180
61232250,2sleep26122-21id11:52:152
253062250,2sleep20-21swapper/212:23:452
1849799258,16cyclictest3-21ksoftirqd/011:05:480
1849799251,22cyclictest0-21swapper/010:36:010
1849799251,22cyclictest0-21swapper/009:41:300
1849799251,15cyclictest5216-21id12:15:050
40562240,2sleep10-21swapper/110:07:331
18499992413,4cyclictest1847-21nfsd12:15:382
18499992411,12cyclictest25655-21sshd12:04:102
18497992417,6cyclictest3-21ksoftirqd/009:36:320
18497992412,4cyclictest8-21rcu_preempt12:00:570
18497992411,12cyclictest3-21ksoftirqd/010:08:130
1849799240,9cyclictest29804-21sshd09:46:250
1849799240,22cyclictest21532-21sshd10:26:120
153832240,1sleep20-21swapper/212:35:562
18499992311,5cyclictest135650irq/27-eth011:38:112
1849999230,18cyclictest33-21ksoftirqd/211:09:522
1849899239,6cyclictest135650irq/27-eth011:59:231
1849799231,4cyclictest24373-21rm12:30:170
1849799231,16cyclictest15775-21bash12:25:580
1849799231,15cyclictest1807-21cp10:03:550
1849799230,6cyclictest29002-21rm10:50:200
160952230,2sleep116094-21bash09:58:361
18499992217,3cyclictest13558-21sshd10:38:572
1849899222,5cyclictest1846-21nfsd10:14:171
1849799222,19cyclictest0-21swapper/011:10:380
1849799220,10cyclictest1848-21nfsd10:32:570
274612210,3sleep10-21swapper/111:14:021
1850099219,5cyclictest10950irq/23-ehci_hcd10:44:333
1850099214,6cyclictest135650irq/27-eth011:03:113
18499992116,3cyclictest16808-21bash09:51:432
1849999210,19cyclictest11183-21sshd09:40:492
18498992113,2cyclictest22-21ksoftirqd/111:00:071
1849799217,7cyclictest0-21swapper/009:23:000
1849799211,13cyclictest0-21swapper/007:45:250
1849799210,20cyclictest1848-21nfsd09:32:190
1849799210,19cyclictest0-21swapper/010:10:200
1849799210,13cyclictest0-21swapper/009:58:500
126852210,19sleep3135650irq/27-eth011:59:383
206442202,16sleep3135650irq/27-eth011:36:413
1849999202,11cyclictest135650irq/27-eth007:29:132
18499992015,3cyclictest8117-21bash10:01:042
18499992013,5cyclictest27092-21sshd11:47:512
1849899203,5cyclictest0-21swapper/112:11:201
18498992015,3cyclictest2747-21sshd09:36:331
1849799200,5cyclictest0-21swapper/009:05:240
1849799200,19cyclictest0-21swapper/009:13:590
1849799200,16cyclictest0-21swapper/008:37:450
1849799200,12cyclictest0-21swapper/008:46:200
66832190,2sleep30-21swapper/309:54:123
20542190,4sleep31850099cyclictest10:27:353
1850099199,4cyclictest0-21swapper/312:16:043
1850099197,6cyclictest26950irq/26-ahci[00012:05:013
1850099195,6cyclictest135650irq/27-eth012:39:143
1850099192,2cyclictest29230-21sshd10:16:473
18500991914,3cyclictest19589-21sshd09:18:033
18500991910,7cyclictest10950irq/23-ehci_hcd11:34:383
18500991910,2cyclictest26950irq/26-ahci[00011:10:153
1849999193,12cyclictest135650irq/27-eth007:14:212
1849999193,11cyclictest135650irq/27-eth008:09:052
18499991915,2cyclictest9494-21sshd10:31:312
18499991913,5cyclictest1847-21nfsd10:55:352
1849899193,1cyclictest10950irq/23-ehci_hcd10:21:101
1849899191,17cyclictest22-21ksoftirqd/110:16:351
18498991911,3cyclictest8137-21sshd09:47:321
18498991910,6cyclictest20934-21sshd10:29:321
1849799198,8cyclictest0-21swapper/008:25:550
1849799191,11cyclictest0-21swapper/007:15:160
282112180,16sleep2135650irq/27-eth011:57:482
1850099187,2cyclictest30262-21bash10:06:533
1850099185,8cyclictest0-21swapper/309:11:463
1850099180,15cyclictest1959-21sshd10:37:123
1849999181,8cyclictest25888-21sshd09:25:252
18499991814,2cyclictest4302-21sshd11:04:282
18499991811,4cyclictest135650irq/27-eth011:30:312
1849799180,1cyclictest0-21swapper/009:00:560
1849799180,1cyclictest0-21swapper/009:00:560
1849799180,12cyclictest13660-21munin-node08:10:100
1849799180,10cyclictest0-21swapper/008:20:190
1850099177,8cyclictest0-21swapper/310:49:553
1850099173,2cyclictest16078-21sshd12:22:473
18500991714,2cyclictest24236-21sshd11:17:033
1850099170,9cyclictest9996-21sshd09:27:123
1850099170,9cyclictest1844-21nfsd10:57:273
1850099170,15cyclictest0-21swapper/310:50:083
18499991714,2cyclictest9766-21sshd10:11:242
18499991712,3cyclictest22617-21sshd10:06:042
18499991712,3cyclictest1847-21nfsd09:47:142
1850099163,1cyclictest26907-21sshd09:56:133
1849999163,6cyclictest135650irq/27-eth008:39:052
1849999162,4cyclictest135650irq/27-eth008:45:092
1849999160,12cyclictest18577-21sshd10:25:532
1849899169,5cyclictest2599-21sshd10:00:261
1849899166,1cyclictest10038-21cp09:20:191
1849899160,8cyclictest0-21swapper/109:11:421
1849799160,15cyclictest0-21swapper/008:52:080
1849799160,15cyclictest0-21swapper/008:01:400
1849799160,15cyclictest0-21swapper/007:43:330
1849799160,15cyclictest0-21swapper/007:31:550
1849799160,15cyclictest0-21swapper/007:26:380
1849799160,13cyclictest0-21swapper/008:15:150
1850099153,1cyclictest0-21swapper/309:01:273
1850099153,1cyclictest0-21swapper/309:01:273
18500991511,3cyclictest10950irq/23-ehci_hcd07:55:253
18500991511,3cyclictest0-21swapper/308:28:573
18500991510,4cyclictest23474-21sshd09:38:503
1849999153,11cyclictest0-21swapper/207:20:022
1849999152,6cyclictest135650irq/27-eth008:16:502
1849999151,7cyclictest135650irq/27-eth007:41:492
18499991512,2cyclictest7339-21sshd10:44:582
18499991512,2cyclictest3767-21taskset07:45:272
18499991511,2cyclictest0-21swapper/208:00:162
1849999150,6cyclictest135650irq/27-eth007:17:022
1849999150,13cyclictest32278-21sshd09:22:462
1849999150,13cyclictest0-21swapper/208:28:552
1849899156,7cyclictest0-21swapper/108:25:161
18498991511,3cyclictest10950irq/23-ehci_hcd08:52:071
18498991511,3cyclictest10950irq/23-ehci_hcd08:01:411
18498991511,3cyclictest10950irq/23-ehci_hcd07:26:371
1849799150,1cyclictest0-21swapper/008:55:500
1849799150,1cyclictest0-21swapper/008:55:490
1849799150,1cyclictest0-21swapper/008:30:040
1849799150,1cyclictest0-21swapper/007:35:020
1849799150,1cyclictest0-21swapper/007:22:410
1849799150,14cyclictest0-21swapper/008:40:120
1849799150,14cyclictest0-21swapper/008:08:210
1849799150,12cyclictest0-21swapper/007:55:030
1849799150,12cyclictest0-21swapper/007:13:140
108142150,13sleep3135650irq/27-eth012:25:263
1850099141,11cyclictest16207-21sshd09:41:243
1850099140,5cyclictest0-21swapper/307:46:193
1849999143,8cyclictest135650irq/27-eth007:36:332
1849999143,6cyclictest144550irq/28-eth1-rx-09:07:382
1849999143,6cyclictest135650irq/27-eth008:43:222
1849999143,6cyclictest135650irq/27-eth008:31:412
1849999143,6cyclictest135650irq/27-eth007:58:022
1849999142,3cyclictest7721-21cp09:30:222
1849999142,3cyclictest1848-21nfsd09:35:152
1849999142,11cyclictest10950irq/23-ehci_hcd08:14:162
18499991411,2cyclictest2405-21runrttasks09:00:062
18499991411,2cyclictest2405-21runrttasks09:00:052
1849999140,5cyclictest135650irq/27-eth008:57:142
1849999140,5cyclictest135650irq/27-eth008:57:132
1849899147,6cyclictest18735-21gltestperf08:20:161
1849899146,1cyclictest6853-21perl09:05:161
1849899145,0cyclictest0-21swapper/108:05:151
1849899143,10cyclictest10950irq/23-ehci_hcd08:37:441
18498991410,3cyclictest10950irq/23-ehci_hcd08:43:521
18498991410,3cyclictest10950irq/23-ehci_hcd07:17:391
18497991411,2cyclictest0-21swapper/007:50:270
1850099139,3cyclictest0-21swapper/309:05:303
1850099137,5cyclictest0-21swapper/307:51:393
1850099132,1cyclictest0-21swapper/307:41:223
1850099132,10cyclictest10950irq/23-ehci_hcd08:50:453
1850099131,6cyclictest31614-21taskset07:35:453
1850099130,5cyclictest0-21swapper/308:05:543
1850099130,4cyclictest25223-21df_inode08:35:143
1850099130,4cyclictest22948-21diskstats08:30:123
1850099130,12cyclictest10950irq/23-ehci_hcd08:20:073
1850099130,12cyclictest0-21swapper/308:40:483
1850099130,12cyclictest0-21swapper/308:10:063
1850099130,12cyclictest0-21swapper/308:01:263
1850099130,12cyclictest0-21swapper/307:34:123
1850099130,11cyclictest2804-21ntp_states08:55:263
1850099130,11cyclictest2804-21ntp_states08:55:263
1850099130,11cyclictest15775-21munin-node08:15:143
1849999132,7cyclictest135650irq/27-eth008:24:132
1849999131,11cyclictest135650irq/27-eth008:50:052
1849999130,12cyclictest0-21swapper/207:32:152
1849899136,1cyclictest29978-21fschecks_time08:45:151
1849899133,1cyclictest0-21swapper/107:45:211
1849899133,1cyclictest0-21swapper/107:21:401
1849899133,0cyclictest0-21swapper/107:50:171
1849899132,4cyclictest135650irq/27-eth007:35:131
1849899132,10cyclictest135650irq/27-eth007:11:561
1849899131,8cyclictest0-21swapper/108:55:141
1849899131,8cyclictest0-21swapper/108:55:131
1849899130,11cyclictest32217-21aten_r5power_fr07:40:111
1850099120,3cyclictest23957-21memory07:20:153
1850099120,11cyclictest18698-21cat07:10:133
1850099120,11cyclictest0-21swapper/308:45:143
1850099120,11cyclictest0-21swapper/307:15:003
1850099120,10cyclictest0-21swapper/307:25:143
1849999120,11cyclictest0-21swapper/207:50:022
1849899127,3cyclictest16536-21iostat_ios08:15:161
18498991210,1cyclictest0-21swapper/108:33:541
18498991210,1cyclictest0-21swapper/107:30:551
1849899120,11cyclictest0-21swapper/109:02:401
1849899120,11cyclictest0-21swapper/109:02:391
1849899115,1cyclictest6783-21cpu07:55:111
1849899111,1cyclictest0-21swapper/108:10:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional