You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 21:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Nov 20, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1140421610,2sleep10-21swapper/110:56:211
1385921550,4sleep21260099cyclictest09:24:362
824421530,1sleep30-21swapper/312:20:003
337421470,2sleep00-21swapper/010:25:300
33221270,3sleep11259999cyclictest11:11:241
739621260,1sleep21260099cyclictest09:53:222
2265221260,3sleep01259899cyclictest09:18:410
2186321150,1sleep21260099cyclictest09:28:532
11996211235,47sleep30-21swapper/307:05:433
163692970,1sleep01259899cyclictest12:20:380
118142970,3sleep20-21swapper/210:46:162
68182940,0sleep041ktimersoftd/012:04:220
68182940,0sleep041ktimersoftd/012:04:220
74502930,1sleep041ktimersoftd/009:46:470
304382900,1sleep30-21swapper/311:50:343
123632900,2sleep10-21swapper/112:20:181
311302880,1sleep031131-21sshd11:54:000
46992870,2sleep00-21swapper/009:30:230
1233928432,43sleep10-21swapper/107:09:581
317952820,2sleep041ktimersoftd/009:29:590
109912820,1sleep10-21swapper/111:51:571
33492810,2sleep23347-21sshd09:36:392
137942810,0sleep01848-21nfsd11:35:400
106882810,1sleep20-21swapper/209:14:062
322702800,1sleep332272-21id10:25:133
156132800,2sleep00-21swapper/010:50:070
31132790,1sleep10-21swapper/111:44:391
280022790,2sleep128001-21sshd11:04:351
143452780,2sleep314346-21bash12:05:063
324952770,1sleep30-21swapper/311:44:223
185712770,2sleep318548-21rm10:20:243
255012730,1sleep20-21swapper/209:45:202
57332700,5sleep30-21swapper/310:52:193
251932700,1sleep025192-21bash11:01:010
137832700,2sleep213781-21sshd11:29:172
24412670,3sleep21848-21nfsd12:00:282
24412670,3sleep21848-21nfsd12:00:272
302712620,2sleep20-21swapper/211:50:332
256542610,1sleep10-21swapper/112:39:151
1211725633,11sleep00-21swapper/007:07:170
1259899540,52cyclictest9391-21sshd11:58:060
1221325237,10sleep20-21swapper/207:08:312
1259899510,49cyclictest22321-21sshd12:05:450
1259899480,41cyclictest18131-21sshd10:33:430
1259899470,27cyclictest19677-21cp11:26:350
1259899462,38cyclictest17611-21sshd12:11:310
1259899461,44cyclictest1848-21nfsd10:41:060
1259899450,40cyclictest2879-21sshd10:55:290
1259899450,39cyclictest4528-21sshd09:23:370
1259899450,37cyclictest7315-21sshd12:25:550
1259899450,33cyclictest19780-21sshd10:14:090
1259899441,37cyclictest0-21swapper/009:38:280
1259899441,29cyclictest0-21swapper/012:16:090
1259899440,37cyclictest1847-21nfsd11:45:300
1259899440,34cyclictest0-21swapper/010:20:410
1259899430,38cyclictest1848-21nfsd10:17:010
1259899430,37cyclictest32574-21sshd11:31:020
1259899430,37cyclictest11716-21sshd11:42:100
1259899430,36cyclictest27276-21sshd11:10:510
1259899421,37cyclictest0-21swapper/009:14:560
1259899420,35cyclictest4905-21sshd11:18:410
244962410,1sleep20-21swapper/211:17:202
1259899410,32cyclictest7941-21sshd12:34:480
1259899390,1cyclictest1847-21nfsd12:36:580
7482380,0sleep3747-21bash09:23:133
1259899380,36cyclictest1846-21nfsd10:37:320
1259899380,20cyclictest4712-21sshd10:45:320
1259899371,33cyclictest0-21swapper/009:43:290
1259899370,28cyclictest0-21swapper/009:50:050
1259899361,31cyclictest25942-21sshd11:20:430
1259899350,1cyclictest5424-21sshd09:56:170
1259899341,30cyclictest28306-21sshd10:01:520
126642330,22sleep3135650irq/27-eth011:29:123
1259899330,30cyclictest16794-21sshd11:06:400
1259899330,29cyclictest2680-21sshd10:05:480
103942290,26sleep1135650irq/27-eth012:04:451
103942290,26sleep1135650irq/27-eth012:04:441
191192280,3sleep219106-21sshd11:39:432
177982280,26sleep3135650irq/27-eth012:14:443
151842280,1sleep20-21swapper/211:06:282
1259899281,24cyclictest0-21swapper/007:40:140
57272270,24sleep1135650irq/27-eth011:34:501
252292270,2sleep225220-21sshd12:24:442
133432270,2sleep20-21swapper/212:17:182
320992260,2sleep10-21swapper/111:08:121
192472260,2sleep219244-21sshd11:42:562
174412260,6sleep30-21swapper/310:00:443
12600992612,12cyclictest33-21ksoftirqd/212:37:432
321502250,3sleep30-21swapper/310:18:403
12601992523,1cyclictest0-21swapper/310:45:413
12601992515,6cyclictest26143-21sshd12:03:073
12601992515,6cyclictest26143-21sshd12:03:073
321982240,22sleep1135650irq/27-eth009:33:101
12600992411,4cyclictest0-21swapper/211:57:392
12599992417,5cyclictest36-21rcuop/212:08:141
1259899240,21cyclictest0-21swapper/007:30:180
9202230,2sleep1913-21sshd10:28:401
1260199230,18cyclictest24119-21sshd09:25:333
1260099232,17cyclictest33-21ksoftirqd/212:07:072
1259899230,21cyclictest0-21swapper/007:16:550
264052222,18sleep3135650irq/27-eth009:19:053
141762220,2sleep20-21swapper/210:56:382
12600992217,3cyclictest13673-21sshd11:45:362
12600992213,4cyclictest13132-21sshd09:34:302
12600992211,8cyclictest21466-21sshd10:20:422
12599992213,7cyclictest1845-21nfsd11:23:341
1259999220,20cyclictest14041-21sshd12:17:241
1259899221,20cyclictest135650irq/27-eth008:15:140
120312220,2sleep112030-21sshd10:33:051
93402213,16sleep210950irq/23-ehci_hcd10:16:202
1260199219,6cyclictest135650irq/27-eth011:57:463
12601992113,5cyclictest1959-21sshd09:59:253
12600992115,4cyclictest23104-21bash09:15:202
12600992115,4cyclictest1714-21sshd12:25:242
12600992114,4cyclictest9384-21sshd10:39:392
12600992110,6cyclictest10950irq/23-ehci_hcd12:12:092
12599992114,4cyclictest14407-21bash12:26:361
12599992110,2cyclictest10950irq/23-ehci_hcd10:21:151
1259899215,10cyclictest16492-21sa108:30:000
1259899210,17cyclictest12691-21perl08:20:150
123952213,6sleep1135650irq/27-eth011:19:311
56582200,2sleep30-21swapper/309:13:353
1260199206,6cyclictest10950irq/23-ehci_hcd09:55:003
12601992015,3cyclictest1848-21nfsd12:25:143
12601992012,6cyclictest25219-21bash12:36:133
12601992012,6cyclictest17305-21sshd09:34:563
12601992012,3cyclictest0-21swapper/310:36:523
12601992011,7cyclictest135650irq/27-eth011:19:073
1260199200,9cyclictest30467-21sshd11:21:103
1260199200,7cyclictest15656-21bash10:40:143
12600992016,2cyclictest823-21sshd11:34:202
12600992015,3cyclictest28235-21sshd09:58:422
12600992015,3cyclictest27731-21cp10:34:462
12600992015,3cyclictest22041-21sshd10:50:372
12600992014,3cyclictest32548-21sshd10:25:142
12600992013,3cyclictest10950irq/23-ehci_hcd10:07:132
12600992012,3cyclictest757-21sshd11:21:282
12600992011,2cyclictest10950irq/23-ehci_hcd10:04:222
12599992011,4cyclictest22681-21id11:56:101
1259899200,2cyclictest32132-21awk07:50:190
1260199198,8cyclictest9275-21sshd11:09:113
1260199195,2cyclictest0-21swapper/309:39:283
12601991917,1cyclictest1959-21sshd11:00:483
12601991917,1cyclictest0-21swapper/308:45:473
12601991915,2cyclictest0-21swapper/312:20:363
12601991912,5cyclictest4634-21cp12:31:323
12601991911,5cyclictest0-21swapper/309:45:363
12600991914,4cyclictest11529-21sshd11:02:572
12600991914,2cyclictest33-21ksoftirqd/212:30:422
1259999196,5cyclictest135650irq/27-eth009:12:501
1259999193,5cyclictest13532-21sshd12:11:071
1259999191,5cyclictest30231-21sshd10:41:401
12599991914,4cyclictest1847-21nfsd10:16:171
12599991911,4cyclictest1959-21sshd09:19:501
1259899191,9cyclictest23565-21aten_r5power_fr08:45:100
1259899191,11cyclictest0-21swapper/007:10:120
1259899190,1cyclictest0-21swapper/008:54:460
1259899190,18cyclictest0-21swapper/009:10:000
1259899190,18cyclictest0-21swapper/007:45:130
250472180,15sleep1135650irq/27-eth009:55:101
142872180,16sleep1135650irq/27-eth010:00:271
12601991813,3cyclictest8271-21cp10:59:263
12601991812,4cyclictest8482-21bash11:31:513
12600991815,2cyclictest2492-21rm10:12:222
12600991814,2cyclictest20127-21sshd10:43:572
12600991812,4cyclictest36-21rcuop/211:11:392
12600991810,6cyclictest23072-21sshd09:41:532
12599991814,3cyclictest18620-21sshd09:35:021
12599991812,5cyclictest144550irq/28-eth1-rx-11:39:421
1259899183,11cyclictest0-21swapper/009:00:220
1259899180,2cyclictest4153-21munin-node08:00:180
1259899180,17cyclictest0-21swapper/007:56:510
1259899180,16cyclictest0-21swapper/007:40:000
1259899180,16cyclictest0-21swapper/007:20:150
77042170,14sleep1135650irq/27-eth011:45:081
12601991714,1cyclictest1845-21nfsd11:47:493
12601991711,2cyclictest135650irq/27-eth010:09:473
1260199170,15cyclictest0-21swapper/309:42:053
1259999178,2cyclictest21926-21sshd12:30:131
1259999176,4cyclictest135650irq/27-eth009:40:411
12599991712,3cyclictest12023-21sshd10:36:211
12599991710,4cyclictest0-21swapper/109:23:591
1259999170,6cyclictest20473-21sshd11:29:581
1259999170,13cyclictest135650irq/27-eth010:10:161
1259899170,2cyclictest5315-21munin-node08:05:100
1259899170,2cyclictest1915-21snmpd08:41:450
1259899170,1cyclictest7897-21munin-node08:10:120
1259899170,16cyclictest0-21swapper/008:39:020
1259899170,15cyclictest0-21swapper/008:55:130
1259899170,15cyclictest0-21swapper/008:30:140
1259899170,13cyclictest19662-21cpuspeed_turbos07:25:110
1260199167,1cyclictest0-21swapper/310:11:143
1260199165,4cyclictest24885-21sshd11:13:583
1260199160,12cyclictest19060-21sshd10:33:493
12599991611,3cyclictest21511-21munin-run07:30:001
1259999161,13cyclictest135650irq/27-eth010:45:091
1259999160,6cyclictest21205-21bash09:48:171
1259999160,3cyclictest5918-21bash09:27:051
1259999160,11cyclictest16249-21sshd10:07:111
1260199157,3cyclictest47-21rcuop/311:36:523
1260199150,13cyclictest0-21swapper/307:45:173
1260099156,5cyclictest27680-21runrttasks08:52:372
12600991511,3cyclictest10950irq/23-ehci_hcd08:15:512
1260099150,13cyclictest0-21swapper/208:00:222
12599991511,3cyclictest8407-21atenall_r5power09:50:121
1259999150,13cyclictest0-21swapper/110:50:571
1259999150,13cyclictest0-21swapper/108:20:221
1260199143,10cyclictest10950irq/23-ehci_hcd08:33:253
1260199140,6cyclictest0-21swapper/308:11:053
1260199140,11cyclictest0-21swapper/308:05:153
1260099142,11cyclictest0-21swapper/208:59:072
1260099140,12cyclictest2556-21sshd09:10:012
1259999148,3cyclictest0-21swapper/109:00:561
1259999146,3cyclictest30922-21atenall_r5power07:50:111
1259999143,10cyclictest10950irq/23-ehci_hcd07:30:021
1259999140,3cyclictest135650irq/27-eth009:08:381
1260199139,3cyclictest135650irq/27-eth008:55:433
1260199137,5cyclictest0-21swapper/308:40:193
1260199137,5cyclictest0-21swapper/308:21:433
1260199137,5cyclictest0-21swapper/307:59:593
1260199135,4cyclictest10950irq/23-ehci_hcd07:35:183
1260199133,9cyclictest0-21swapper/307:34:343
1260199132,10cyclictest135650irq/27-eth007:15:523
12601991311,1cyclictest0-21swapper/309:04:593
12601991310,2cyclictest27592-21smartctl07:40:213
1260199130,8cyclictest0-21swapper/308:35:033
1260199130,12cyclictest4675-21munin-node08:00:223
1260199130,12cyclictest1847-21nfsd08:26:573
1260199130,12cyclictest0-21swapper/307:52:553
1260199130,12cyclictest0-21swapper/307:20:393
1260199130,11cyclictest27320-21grep08:50:233
1260199130,11cyclictest10211-21munin-node08:15:153
1260099139,3cyclictest135650irq/27-eth008:45:482
1260099139,3cyclictest135650irq/27-eth007:40:322
1260099139,3cyclictest10950irq/23-ehci_hcd08:24:062
1260099137,5cyclictest0-21swapper/207:30:462
1260099137,5cyclictest0-21swapper/207:12:032
1260099131,11cyclictest135650irq/27-eth007:45:242
12600991311,1cyclictest0-21swapper/208:30:572
1260099130,5cyclictest0-21swapper/208:10:462
1260099130,5cyclictest0-21swapper/208:05:202
1260099130,4cyclictest30424-21wget09:00:112
1260099130,4cyclictest17914-21if_err_eth007:20:142
1260099130,12cyclictest1848-21nfsd07:35:392
1260099130,12cyclictest0-21swapper/208:35:282
1260099130,12cyclictest0-21swapper/207:55:042
1260099130,12cyclictest0-21swapper/207:28:392
1260099130,12cyclictest0-21swapper/207:17:422
1259999138,4cyclictest135650irq/27-eth008:32:591
1259999137,5cyclictest0-21swapper/107:56:341
1259999132,2cyclictest13786-21open_files07:10:191
12599991311,1cyclictest0-21swapper/108:36:471
12599991311,1cyclictest0-21swapper/107:19:471
1259999130,12cyclictest3765-21if_err_eth008:00:141
1259999130,12cyclictest0-21swapper/108:55:161
1259999130,12cyclictest0-21swapper/108:50:501
1259999130,12cyclictest0-21swapper/108:47:171
1259999130,12cyclictest0-21swapper/108:42:441
1259999130,12cyclictest0-21swapper/108:28:441
1259999130,12cyclictest0-21swapper/108:18:061
1259999130,12cyclictest0-21swapper/108:05:221
1259999130,12cyclictest0-21swapper/107:42:221
12601991210,1cyclictest0-21swapper/309:05:313
1260199120,3cyclictest13364-21munin-node07:10:153
1260199120,10cyclictest20121-21perl07:25:133
1260099121,10cyclictest21547-21df08:40:102
1260099120,11cyclictest14544-21seq08:25:092
1260099120,11cyclictest0-21swapper/207:50:062
1259999126,5cyclictest0-21swapper/108:10:501
1259999122,4cyclictest135650irq/27-eth007:35:041
1259999120,3cyclictest0-21swapper/107:45:141
1259999120,11cyclictest0-21swapper/107:20:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional