You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-17 - 01:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Mon Jun 16, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2109621700,4sleep33221499cyclictest10:15:013
2651821580,1sleep026519-21bash11:04:000
2911221510,2sleep23221399cyclictest11:18:452
1939921460,0sleep219374-21sshd09:54:202
134421440,0sleep20-21swapper/212:31:202
1623421420,2sleep3417-21jbd2/dm-0-810:41:473
1623421420,2sleep3417-21jbd2/dm-0-810:41:463
535621410,4sleep23221399cyclictest12:07:432
456521310,2sleep30-21swapper/311:12:253
417021290,2sleep12405-21runrttasks07:19:591
1016721280,5sleep03220499cyclictest10:34:260
1394221260,1sleep313941-21sshd10:07:273
3209421250,2sleep10-21swapper/112:28:221
3209421250,2sleep10-21swapper/112:28:221
1769321200,2sleep10-21swapper/109:33:391
1763821170,2sleep21847-21nfsd12:27:032
1763821170,2sleep21847-21nfsd12:27:032
36721160,1sleep00-21swapper/010:26:330
3183921160,2sleep20-21swapper/210:46:592
112321140,1sleep10-21swapper/110:16:101
31819210735,42sleep10-21swapper/107:08:191
1307721070,1sleep20-21swapper/211:43:302
544721060,2sleep10-21swapper/111:19:391
1806321060,0sleep00-21swapper/010:17:590
2793221020,3sleep20-21swapper/210:02:022
140321020,1sleep13220999cyclictest12:17:001
244792990,2sleep30-21swapper/310:01:383
323932980,5sleep136-21rcuop/210:40:121
323932980,5sleep136-21rcuop/210:40:121
3179129737,56sleep30-21swapper/307:07:563
252652970,1sleep00-21swapper/012:36:190
21962960,0sleep00-21swapper/011:54:540
308212930,2sleep30-21swapper/310:53:363
250952930,1sleep00-21swapper/010:56:310
21622910,1sleep31847-21nfsd12:13:563
209142910,1sleep33221499cyclictest10:21:463
191952890,0sleep00-21swapper/009:47:210
312502880,1sleep00-21swapper/010:02:230
314722870,1sleep13220999cyclictest11:51:221
316282830,1sleep20-21swapper/212:00:362
214192830,2sleep30-21swapper/309:54:323
40972820,2sleep34092-21sshd09:11:323
273712820,1sleep33221499cyclictest09:37:583
221212820,2sleep30-21swapper/309:17:013
141962820,2sleep22405-21runrttasks10:41:342
141962820,2sleep22405-21runrttasks10:41:332
32032810,1sleep11847-21nfsd09:55:501
246772810,2sleep324619-21sshd10:35:483
79082780,1sleep20-21swapper/211:01:342
257642780,0sleep00-21swapper/009:41:150
126322780,2sleep112630-21sshd11:46:301
221242770,0sleep01848-21nfsd12:15:540
71252760,4sleep20-21swapper/211:36:332
219882760,2sleep121971-21sshd11:31:261
177212720,1sleep11846-21nfsd11:56:161
87392710,4sleep23221399cyclictest11:33:282
59162710,2sleep10-21swapper/110:37:201
164942700,2sleep30-21swapper/310:11:043
33532690,0sleep00-21swapper/011:32:540
246592670,2sleep20-21swapper/211:53:562
250212660,1sleep10-21swapper/110:25:371
194902660,2sleep30-21swapper/312:05:473
3184726136,13sleep00-21swapper/007:08:370
320942580,2sleep30-21swapper/311:22:183
3220499570,56cyclictest0-21swapper/009:53:410
3181025135,12sleep20-21swapper/207:08:112
84832470,2sleep21848-21nfsd09:29:152
60272430,40sleep3135650irq/27-eth009:59:473
83082370,1sleep00-21swapper/011:26:410
51892370,1sleep05190-21sshd12:14:170
32204993612,22cyclictest3-21ksoftirqd/009:30:180
3220499340,1cyclictest0-21swapper/012:31:280
32204993312,14cyclictest3-21ksoftirqd/010:54:090
3220999328,2cyclictest0-21swapper/110:21:451
32204993214,14cyclictest3-21ksoftirqd/009:29:010
32213993128,1cyclictest0-21swapper/210:19:062
110832310,4sleep23221399cyclictest09:39:522
32213993014,6cyclictest10227-21sshd10:27:362
32204993012,12cyclictest3-21ksoftirqd/010:40:300
32204993012,12cyclictest3-21ksoftirqd/010:40:290
154322300,28sleep1135650irq/27-eth009:53:561
138992300,27sleep3135650irq/27-eth011:49:493
62792290,1sleep00-21swapper/012:23:120
41842290,2sleep20-21swapper/209:18:332
32213992924,3cyclictest10950irq/23-ehci_hcd09:41:182
120652290,3sleep112068-21id09:36:191
84262280,2sleep18428-21sshd12:37:431
3221399280,6cyclictest135650irq/27-eth010:21:032
32204992818,9cyclictest3-21ksoftirqd/010:14:510
269282280,26sleep1135650irq/27-eth011:44:541
32204992714,10cyclictest3-21ksoftirqd/010:48:260
32204992713,7cyclictest3-21ksoftirqd/012:05:070
32204992713,12cyclictest3-21ksoftirqd/010:21:000
3220499270,1cyclictest15505-21sshd09:36:410
165792270,2sleep116577-21sshd12:32:431
44782260,3sleep10-21swapper/110:54:271
32214992621,4cyclictest1846-21nfsd09:27:543
32214992613,5cyclictest10950irq/23-ehci_hcd10:59:543
32213992622,3cyclictest1848-21nfsd11:05:432
32213992620,4cyclictest8141-21sshd11:23:122
32213992620,4cyclictest24673-21sshd10:56:272
32213992611,12cyclictest24291-21sshd12:36:132
32213992610,14cyclictest33-21ksoftirqd/212:22:092
32204992613,12cyclictest3-21ksoftirqd/010:06:170
189362260,24sleep1135650irq/27-eth009:26:451
132652260,2sleep313269-21gltestperf12:35:173
32214992516,6cyclictest0-21swapper/311:08:283
3221399252,21cyclictest33-21ksoftirqd/210:13:312
32213992520,3cyclictest1848-21nfsd10:36:172
32213992518,4cyclictest27962-21cp11:25:212
32209992510,6cyclictest10950irq/23-ehci_hcd09:42:521
3220499257,3cyclictest3-21ksoftirqd/011:57:530
32204992511,8cyclictest3-21ksoftirqd/011:21:170
95452240,3sleep30-21swapper/311:33:333
3221399242,21cyclictest33-21ksoftirqd/211:12:362
32213992420,2cyclictest1846-21nfsd10:09:052
32213992419,4cyclictest26094-21bash10:53:022
32213992417,5cyclictest1848-21nfsd11:46:392
32213992417,4cyclictest4746-21sshd11:58:102
32213992415,6cyclictest7163-21sshd09:56:152
32213992414,6cyclictest18807-21sshd09:33:462
32209992411,6cyclictest135650irq/27-eth009:13:251
32204992410,13cyclictest3-21ksoftirqd/011:15:100
3220499240,16cyclictest0-21swapper/011:36:170
150322240,3sleep20-21swapper/208:55:002
3221499239,6cyclictest135650irq/27-eth011:42:233
32214992311,5cyclictest135650irq/27-eth012:25:183
32214992311,5cyclictest135650irq/27-eth012:25:183
32214992311,3cyclictest27584-21sshd12:30:453
3221399232,19cyclictest33-21ksoftirqd/210:33:482
32213992319,3cyclictest1848-21nfsd09:45:332
32213992313,5cyclictest19308-21sshd12:15:362
3220499237,14cyclictest3-21ksoftirqd/009:55:090
32204992316,3cyclictest3-21ksoftirqd/011:45:040
32204992313,4cyclictest3-21ksoftirqd/011:43:050
32204992311,10cyclictest3-21ksoftirqd/010:36:450
32204992310,9cyclictest3-21ksoftirqd/009:15:370
98072221,19sleep3135650irq/27-eth011:55:293
32214992211,6cyclictest135650irq/27-eth009:32:283
32214992210,5cyclictest135650irq/27-eth010:49:523
3221499220,20cyclictest44-21ksoftirqd/311:39:093
3220999229,5cyclictest10950irq/23-ehci_hcd10:05:111
3220999227,12cyclictest29020-21bash11:21:591
32209992219,1cyclictest0-21swapper/110:30:501
214952222,18sleep3135650irq/27-eth012:24:363
169342220,2sleep10-21swapper/112:21:131
155012220,2sleep11848-21nfsd11:09:581
3221499218,4cyclictest13086-21bash12:02:003
32214992111,3cyclictest3900-21sshd11:15:583
32213992115,3cyclictest20032-21bash12:12:272
32209992111,5cyclictest10950irq/23-ehci_hcd11:10:191
3220999210,5cyclictest1959-21sshd11:25:481
32204992115,5cyclictest3-21ksoftirqd/012:25:490
32204992115,5cyclictest3-21ksoftirqd/012:25:490
32204992115,5cyclictest3-21ksoftirqd/012:04:290
32204992115,4cyclictest3-21ksoftirqd/011:10:520
32204992110,10cyclictest0-21swapper/011:06:200
238022210,19sleep1135650irq/27-eth009:17:131
32213992018,1cyclictest0-21swapper/209:02:212
32213992015,3cyclictest13776-21sshd09:12:332
32213992012,5cyclictest21899-21sshd09:20:182
3220999207,6cyclictest10950irq/23-ehci_hcd12:13:111
3220999204,13cyclictest10950irq/23-ehci_hcd09:45:381
3220999202,13cyclictest14257-21sshd10:45:111
32209992010,7cyclictest1846-21nfsd11:39:131
3220499200,17cyclictest1848-21nfsd09:10:170
32214991914,4cyclictest17472-21sshd12:18:273
32214991910,6cyclictest4126-21sshd11:26:123
3221499190,7cyclictest29449-21sshd10:32:573
3221499190,12cyclictest27140-21munin-node11:00:153
3220999195,9cyclictest0-21swapper/109:22:041
304192190,2sleep330418-21bash11:51:173
3221499188,3cyclictest10950irq/23-ehci_hcd09:45:163
3221499181,6cyclictest1847-21nfsd10:26:063
3221499180,15cyclictest13502-21bash09:22:513
3220999189,7cyclictest13306-21sshd12:02:011
3220999183,5cyclictest32317-21bash11:04:391
32209991812,5cyclictest1847-21nfsd10:11:071
32209991810,6cyclictest31316-21sshd12:07:011
32209991810,1cyclictest13230-21cp10:55:191
3220999180,3cyclictest10950irq/23-ehci_hcd10:03:521
3221499170,4cyclictest3540-21bash09:42:193
32204991711,5cyclictest3-21ksoftirqd/009:21:020
3221499164,1cyclictest0-21swapper/307:42:023
3221499160,13cyclictest0-21swapper/308:46:203
3220999160,12cyclictest135650irq/27-eth008:22:361
3221499154,10cyclictest10950irq/23-ehci_hcd07:46:043
32214991511,3cyclictest10950irq/23-ehci_hcd08:06:233
3221399153,11cyclictest10950irq/23-ehci_hcd08:05:292
3221399150,14cyclictest33-21ksoftirqd/209:05:162
32209991511,3cyclictest10950irq/23-ehci_hcd08:17:241
3220999150,13cyclictest0-21swapper/107:55:001
32204991511,1cyclictest0-21swapper/007:56:250
3220499150,14cyclictest0-21swapper/008:31:500
67972140,12sleep3135650irq/27-eth008:35:193
3221499143,10cyclictest10950irq/23-ehci_hcd08:55:023
3221499143,10cyclictest10950irq/23-ehci_hcd08:55:013
32214991410,3cyclictest10950irq/23-ehci_hcd07:19:553
3221499140,12cyclictest1079-21getsmi07:10:213
3221499140,10cyclictest0-21swapper/307:52:043
3221399149,4cyclictest10950irq/23-ehci_hcd08:04:512
3221399145,8cyclictest33-21ksoftirqd/207:35:202
3221399142,11cyclictest10950irq/23-ehci_hcd07:16:452
3221399141,11cyclictest16635-21memory07:45:182
3221399140,5cyclictest0-21swapper/208:35:282
3221399140,13cyclictest33-21ksoftirqd/207:55:362
3221399140,12cyclictest29397-21munin-node08:15:182
3221399140,12cyclictest0-21swapper/208:22:292
32209991410,3cyclictest10950irq/23-ehci_hcd07:46:531
32209991410,3cyclictest10950irq/23-ehci_hcd07:20:321
3220999140,13cyclictest0-21swapper/107:36:261
3220999140,13cyclictest0-21swapper/107:30:551
3220999140,12cyclictest21855-21sshd09:10:001
3220499140,13cyclictest0-21swapper/008:25:050
3220499140,13cyclictest0-21swapper/007:15:040
3220499140,12cyclictest0-21swapper/007:30:080
3221499137,5cyclictest3230-21sshd08:25:293
32214991310,2cyclictest0-21swapper/309:05:243
3221499130,12cyclictest0-21swapper/308:30:003
3221499130,12cyclictest0-21swapper/308:20:133
3221499130,12cyclictest0-21swapper/308:12:473
3221499130,12cyclictest0-21swapper/308:01:283
3221499130,12cyclictest0-21swapper/307:31:343
3221499130,12cyclictest0-21swapper/307:27:573
3221499130,11cyclictest9766-21grep08:40:243
3221499130,11cyclictest5293-21memory07:20:183
3221499130,11cyclictest20282-21chrt07:55:043
3221499130,11cyclictest18287-21latency09:00:223
3221499130,11cyclictest13674-21if_eth008:50:193
3221399138,4cyclictest135650irq/27-eth007:50:582
3221399138,3cyclictest9270-21munin-node07:30:142
3221399134,8cyclictest33-21ksoftirqd/207:20:102
32213991311,1cyclictest0-21swapper/208:55:222
32213991311,1cyclictest0-21swapper/208:55:212
3221399131,11cyclictest0-21swapper/208:13:562
3221399130,4cyclictest4261-21fschecks_count08:30:152
3221399130,12cyclictest135650irq/27-eth007:25:582
3221399130,12cyclictest0-21swapper/208:42:342
3221399130,12cyclictest0-21swapper/207:41:432
3221399130,11cyclictest32235-21munin-node07:10:192
3220999137,5cyclictest0-21swapper/108:00:251
3220999132,10cyclictest26950irq/26-ahci[00008:53:361
32209991311,1cyclictest0-21swapper/108:10:181
3220999130,12cyclictest135650irq/27-eth008:40:151
3220999130,12cyclictest135650irq/27-eth007:10:501
3220999130,12cyclictest0-21swapper/108:47:391
3220999130,12cyclictest0-21swapper/108:36:301
3220999130,12cyclictest0-21swapper/108:31:391
3220999130,12cyclictest0-21swapper/108:26:131
3220999130,12cyclictest0-21swapper/108:05:081
3220999130,12cyclictest0-21swapper/107:58:351
3220999130,12cyclictest0-21swapper/107:26:321
32204991311,1cyclictest0-21swapper/009:02:060
3220499130,1cyclictest11957-21munin-node08:45:250
3220499130,12cyclictest0-21swapper/008:57:130
3220499130,12cyclictest0-21swapper/008:57:120
3220499130,12cyclictest0-21swapper/008:40:320
3220499130,12cyclictest0-21swapper/008:20:290
3220499130,12cyclictest0-21swapper/008:02:100
3220499130,12cyclictest0-21swapper/007:50:310
3220499130,11cyclictest0-21swapper/007:20:230
3221499120,11cyclictest135650irq/27-eth007:35:133
3221499120,11cyclictest0-21swapper/308:15:043
3221399127,4cyclictest0-21swapper/208:45:532
3221399120,10cyclictest1854-21df_inode08:25:132
3220999121,3cyclictest10950irq/23-ehci_hcd09:00:521
3220999120,3cyclictest14265-21irqstats07:40:161
3220999120,3cyclictest0-21swapper/108:55:161
3220999120,3cyclictest0-21swapper/108:55:151
3220499128,3cyclictest0-21swapper/007:45:580
3220499122,1cyclictest0-21swapper/007:38:180
3220499120,8cyclictest0-21swapper/009:05:050
3220499120,2cyclictest0-21swapper/008:35:190
3220499120,1cyclictest0-21swapper/007:40:380
3220499120,12cyclictest0-21swapper/008:50:300
3220499120,12cyclictest0-21swapper/008:05:270
3220499120,11cyclictest0-21swapper/008:12:150
3220499120,11cyclictest0-21swapper/007:25:200
3220499120,10cyclictest0-21swapper/008:15:400
3220499111,8cyclictest0-21swapper/007:10:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional