You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-07 - 18:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Tue May 07, 2024 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
569021380,3sleep01202599cyclictest11:07:490
3195421380,3sleep31204099cyclictest09:41:323
207021250,1sleep10-21swapper/109:33:521
2259821230,2sleep30-21swapper/311:09:533
3250321220,2sleep01202599cyclictest11:14:540
2645921170,3sleep01202599cyclictest09:56:320
2432621000,0sleep00-21swapper/009:32:350
11757210034,44sleep10-21swapper/107:09:441
1170229346,43sleep30-21swapper/307:09:013
76672910,1sleep00-21swapper/011:31:030
76672910,1sleep00-21swapper/011:31:020
56632910,2sleep35645-21sshd12:13:413
202132900,2sleep120212-21bash10:23:071
1171629034,11sleep20-21swapper/207:09:132
51172830,2sleep30-21swapper/310:36:423
267892830,2sleep30-21swapper/310:27:443
208652820,2sleep10-21swapper/110:42:331
312362810,2sleep30-21swapper/311:14:453
166932810,2sleep20-21swapper/211:59:252
175492800,2sleep10-21swapper/112:11:071
158552800,1sleep215850-21cp12:30:352
26002780,2sleep20-21swapper/210:32:322
210952780,2sleep20-21swapper/212:39:012
148022780,2sleep30-21swapper/311:35:413
162142760,2sleep10-21swapper/109:51:241
162142760,2sleep10-21swapper/109:51:241
123132740,1sleep012311-21sshd09:54:550
123132740,1sleep012311-21sshd09:54:550
73462720,4sleep11203099cyclictest11:54:231
298572720,1sleep00-21swapper/010:24:170
138532720,1sleep20-21swapper/211:39:342
118072710,2sleep211805-21sshd10:29:522
170052680,3sleep11203099cyclictest10:53:521
129312680,2sleep30-21swapper/309:11:263
127512680,2sleep312748-21bash11:55:023
314162670,1sleep231413-21rm10:35:572
259562660,2sleep30-21swapper/311:29:283
137952660,2sleep20-21swapper/207:11:362
80862650,1sleep10-21swapper/111:27:181
235702630,4sleep30-21swapper/310:07:573
195102620,2sleep30-21swapper/312:07:313
192842620,1sleep10-21swapper/112:23:171
315242600,3sleep31204099cyclictest09:53:183
315242600,3sleep31204099cyclictest09:53:183
95872590,4sleep31204099cyclictest11:31:183
95872590,4sleep31204099cyclictest11:31:173
190782590,2sleep20-21swapper/210:15:132
1163525841,4sleep00-21swapper/007:08:110
74672390,2sleep27465-21bash10:21:302
128732340,0sleep212875-21id10:53:202
105472310,28sleep2138550irq/27-eth011:50:482
162072290,2sleep316204-21sshd11:20:303
12030992924,3cyclictest26081-21id11:44:581
12040992611,12cyclictest0-21swapper/310:21:373
12040992517,5cyclictest1596-21sshd09:49:463
12040992516,5cyclictest28648-21sshd10:47:213
12040992510,13cyclictest0-21swapper/309:25:393
1203499250,19cyclictest33-21ksoftirqd/209:19:342
183292240,2sleep10-21swapper/109:23:581
1204099246,17cyclictest0-21swapper/310:10:333
1204099243,19cyclictest0-21swapper/309:22:493
12040992417,4cyclictest5982-21sshd11:15:283
12040992417,4cyclictest138550irq/27-eth011:02:023
1204099241,2cyclictest138550irq/27-eth012:15:463
84472231,20sleep2138550irq/27-eth011:31:102
84472231,20sleep2138550irq/27-eth011:31:092
174072230,2sleep30-21swapper/312:23:023
153332230,2sleep10-21swapper/110:30:151
1204099235,0cyclictest0-21swapper/310:41:023
1204099230,3cyclictest10950irq/23-ehci_hcd09:55:533
12025992311,5cyclictest3-21ksoftirqd/012:24:450
1202599231,14cyclictest0-21swapper/012:02:420
1202599230,15cyclictest0-21swapper/011:29:130
80662220,2sleep18055-21sshd09:58:171
282992220,3sleep20-21swapper/209:56:462
1204099229,6cyclictest5039-21ntp_states12:25:253
1204099224,9cyclictest44-21ksoftirqd/312:01:503
1204099224,9cyclictest25388-21sshd12:35:383
12040992215,4cyclictest1987-21sshd10:04:123
12040992215,4cyclictest1987-21sshd10:04:123
12040992212,6cyclictest31121-21bash10:51:323
1203499224,16cyclictest33-21ksoftirqd/209:36:392
12034992218,2cyclictest14794-21sshd09:23:312
12034992217,3cyclictest7619-21sshd09:34:392
12034992217,3cyclictest1876-21nfsd10:47:212
12034992214,5cyclictest8650-21sshd12:18:002
12034992213,7cyclictest36-21rcuop/210:43:592
12034992212,7cyclictest30238-21kworker/u8:311:04:352
1203499220,16cyclictest33-21ksoftirqd/209:10:012
1202599221,13cyclictest0-21swapper/009:40:190
1202599221,12cyclictest19731-21bash10:46:140
88212210,2sleep28817-21bash12:25:502
257792210,19sleep228750irq/26-ahci[00011:17:542
12040992112,6cyclictest13931-21sshd10:57:183
1204099210,10cyclictest9841-21sshd09:34:563
12034992116,3cyclictest16033-21sshd12:22:512
12034992116,3cyclictest1144-21sshd10:05:142
12034992116,3cyclictest0-21swapper/210:01:582
12034992116,3cyclictest0-21swapper/210:01:582
12034992115,4cyclictest28789-21sshd12:12:322
12034992115,3cyclictest31175-21bash11:22:222
12034992115,3cyclictest23613-21sshd09:52:192
12034992115,3cyclictest23613-21sshd09:52:182
12034992112,2cyclictest138550irq/27-eth011:07:512
12034992111,6cyclictest26692-21bash11:25:362
1203099219,5cyclictest138550irq/27-eth009:42:171
12030992118,1cyclictest0-21swapper/112:29:291
1203099210,6cyclictest26879-21sshd10:27:451
12025992115,5cyclictest22501-21sshd09:12:370
1202599210,14cyclictest0-21swapper/009:22:140
1204099209,5cyclictest27219-21sshd11:45:053
12040992013,4cyclictest23382-21sshd10:15:363
12040992012,6cyclictest23134-21sshd09:16:283
12040992012,5cyclictest19762-21grep08:40:263
12040992011,5cyclictest30554-21sshd11:41:263
1204099200,18cyclictest44-21ksoftirqd/310:32:403
12034992016,2cyclictest2121-21runrttasks09:29:472
12034992015,3cyclictest5253-21sshd12:05:452
12034992015,3cyclictest26208-21fschecks_count11:10:172
12034992012,4cyclictest24536-21sshd12:00:202
1203499200,17cyclictest33-21ksoftirqd/211:46:562
1203099209,5cyclictest138550irq/27-eth009:29:081
1203099201,15cyclictest18356-21sshd10:57:501
1203099200,15cyclictest12902-21sshd12:18:341
1202599208,10cyclictest24345-21sshd11:02:230
1202599201,16cyclictest0-21swapper/010:56:170
1202599200,16cyclictest0-21swapper/007:55:180
12040991913,4cyclictest0-21swapper/311:53:253
12040991913,4cyclictest0-21swapper/309:36:513
12040991912,3cyclictest32220-21unixbench_multi07:55:313
12040991911,4cyclictest24866-21sshd12:31:463
12034991915,2cyclictest1987-21sshd09:41:532
12034991914,3cyclictest11694-21bash09:46:572
12034991911,3cyclictest11334-21sshd11:43:042
1203099198,4cyclictest10950irq/23-ehci_hcd12:36:011
1202599199,3cyclictest0-21swapper/010:25:480
1202599195,12cyclictest0-21swapper/011:35:340
12025991912,6cyclictest3-21ksoftirqd/012:12:380
1204099183,11cyclictest0-21swapper/308:25:183
12034991813,3cyclictest8889-21bash10:10:072
1203099188,6cyclictest10950irq/23-ehci_hcd10:13:571
1203099187,4cyclictest138550irq/27-eth011:01:491
1203099185,5cyclictest138550irq/27-eth010:16:481
12030991816,1cyclictest0-21swapper/112:03:171
12030991816,1cyclictest0-21swapper/108:25:501
12030991813,2cyclictest6153-21bash10:01:571
12030991813,2cyclictest6153-21bash10:01:571
1202599181,6cyclictest0-21swapper/010:05:290
12025991813,3cyclictest0-21swapper/010:52:430
1202599180,3cyclictest31874-21sshd12:16:500
1202599180,16cyclictest0-21swapper/009:37:520
1202599180,15cyclictest0-21swapper/011:23:260
108152180,2sleep310816-21rt-features08:20:253
232942170,9sleep122-21ksoftirqd/110:07:551
1204099175,9cyclictest4824-21crond08:10:003
1204099175,9cyclictest4824-21crond08:10:003
12034991713,3cyclictest0-21swapper/207:21:312
12034991712,3cyclictest138550irq/27-eth010:55:152
1203099179,1cyclictest0-21swapper/109:11:571
1203099178,4cyclictest5559-21sshd10:36:461
12030991712,3cyclictest0-21swapper/109:45:151
1203099170,8cyclictest0-21swapper/112:05:021
1203099170,15cyclictest0-21swapper/111:46:531
1203099170,15cyclictest0-21swapper/111:13:281
1203099170,15cyclictest0-21swapper/108:39:571
1203099170,13cyclictest8236-21sshd11:15:421
1202599178,2cyclictest0-21swapper/011:15:110
1202599178,2cyclictest0-21swapper/010:44:010
1202599174,7cyclictest25567-21kworker/0:010:14:480
1202599173,8cyclictest31642-21kworker/0:211:55:280
1202599171,14cyclictest0-21swapper/012:25:390
1202599171,14cyclictest0-21swapper/011:43:280
1202599171,10cyclictest0-21swapper/010:02:330
1202599171,10cyclictest0-21swapper/010:02:330
1202599170,9cyclictest22837-21sshd10:15:330
1202599170,15cyclictest30211-21cp09:29:240
1202599170,14cyclictest14921-21sshd09:19:320
1204099169,5cyclictest25969-21perf07:44:593
1204099168,6cyclictest23360-21atenall_r5power07:35:143
1204099167,5cyclictest692-21grep08:00:143
1204099164,11cyclictest0-21swapper/308:17:243
1204099163,8cyclictest17640-21nfsd407:20:203
12040991610,3cyclictest0-21swapper/307:30:143
1203499164,11cyclictest10950irq/23-ehci_hcd08:55:442
1203499162,12cyclictest0-21swapper/208:47:512
12034991612,2cyclictest936-21fschecks_count08:00:162
12034991612,2cyclictest0-21swapper/207:30:142
12034991611,2cyclictest27080-21missed_timers07:45:162
1203499160,14cyclictest33-21ksoftirqd/208:05:282
1203499160,14cyclictest33-21ksoftirqd/208:05:282
1203099168,3cyclictest138550irq/27-eth010:45:351
12030991612,2cyclictest0-21swapper/111:24:481
12030991611,1cyclictest17592-21sshd09:35:441
12030991610,5cyclictest23482-21sshd11:06:051
1203099160,4cyclictest0-21swapper/111:36:571
1203099160,14cyclictest0-21swapper/108:20:191
1203099160,12cyclictest0-21swapper/112:30:141
1203099160,12cyclictest0-21swapper/108:09:311
1203099160,12cyclictest0-21swapper/108:09:311
1202599161,3cyclictest0-21swapper/010:35:240
12025991612,2cyclictest0-21swapper/012:37:430
1202599160,9cyclictest0-21swapper/009:45:450
1202599160,9cyclictest0-21swapper/008:45:010
1203499153,1cyclictest12148-21df_inode08:25:132
12034991511,2cyclictest20848-21basename07:30:002
12034991511,1cyclictest33-21ksoftirqd/208:30:302
1203499150,11cyclictest138550irq/27-eth007:55:192
1203099156,2cyclictest26192-21bash11:33:191
1203099156,2cyclictest26192-21bash11:33:191
1203099155,4cyclictest138550irq/27-eth009:18:191
1203099150,13cyclictest2121-21runrttasks08:49:121
1203099150,13cyclictest0-21swapper/111:56:301
1202599157,2cyclictest1674-21sshd10:32:260
1202599155,9cyclictest0-21swapper/008:25:270
1202599151,6cyclictest0-21swapper/011:45:040
1202599151,5cyclictest31654-21sshd12:32:370
12025991513,1cyclictest6736-21bash11:50:230
1202599150,9cyclictest0-21swapper/012:08:040
1202599150,13cyclictest0-21swapper/008:55:120
1202599150,12cyclictest0-21swapper/008:15:040
1204099148,4cyclictest0-21swapper/309:08:553
1204099146,4cyclictest29766-21latency_hist09:05:003
1204099142,9cyclictest16221-21latency_hist08:35:013
1204099141,12cyclictest36-21rcuop/207:52:003
12040991411,2cyclictest260502chrt08:55:193
1204099140,12cyclictest19907-21ntp_kernel_err07:25:233
1204099140,10cyclictest0-21swapper/308:10:123
1203499144,6cyclictest16334-21sadc07:19:592
1203499142,10cyclictest25340-21idleruntime-cro07:40:002
12034991410,2cyclictest29414-21nfsd407:50:192
1203499140,5cyclictest8181-21memory08:15:202
1203499140,13cyclictest0-21swapper/208:40:412
1203499140,13cyclictest0-21swapper/208:37:332
1203099147,5cyclictest7664-21fschecks_count08:15:131
1203099140,5cyclictest0-21swapper/108:55:151
1202599146,7cyclictest0-21swapper/008:24:420
1202599145,5cyclictest17198-21kworker/0:109:00:160
1202599144,9cyclictest0-21swapper/008:52:200
1202599140,6cyclictest0-21swapper/007:42:250
1204099137,5cyclictest0-21swapper/307:47:303
1204099135,7cyclictest44-21ksoftirqd/308:45:143
1204099135,7cyclictest44-21ksoftirqd/307:15:193
1204099133,9cyclictest0-21swapper/308:36:513
1204099133,1cyclictest0-21swapper/308:53:363
12040991311,1cyclictest0-21swapper/307:11:393
1203499138,3cyclictest27891-21diskstats09:00:142
1203499132,7cyclictest31828-21munin-run09:10:002
1203499130,12cyclictest0-21swapper/208:11:552
1203099138,3cyclictest748-21df08:00:141
1203099138,3cyclictest0-21swapper/107:50:171
12030991311,1cyclictest0-21swapper/107:45:411
12030991311,1cyclictest0-21swapper/107:29:021
12030991310,2cyclictest0-21swapper/107:30:501
1203099130,4cyclictest1955-21snmpd07:18:001
1203099130,12cyclictest0-21swapper/109:05:031
1203099130,12cyclictest0-21swapper/108:51:071
1203099130,12cyclictest0-21swapper/108:44:521
1203099130,12cyclictest0-21swapper/108:11:431
1203099130,12cyclictest0-21swapper/107:55:251
1203099130,12cyclictest0-21swapper/107:43:171
1203099130,12cyclictest0-21swapper/107:36:071
1203099130,11cyclictest14732-21hddtemp_smartct08:30:161
1203099130,11cyclictest12394-21df_inode07:10:151
1202599137,4cyclictest0-21swapper/007:21:270
1202599134,4cyclictest24396-21cut07:35:250
12025991311,1cyclictest0-21swapper/007:10:030
1202599131,10cyclictest0-21swapper/007:30:270
1202599130,3cyclictest0-21swapper/008:30:320
1202599130,12cyclictest0-21swapper/008:45:370
1202599130,12cyclictest0-21swapper/008:08:180
1202599130,12cyclictest0-21swapper/008:08:170
1202599130,12cyclictest0-21swapper/008:00:330
1202599130,12cyclictest0-21swapper/007:46:030
1202599130,10cyclictest0-21swapper/007:50:010
1203499128,3cyclictest9840-21df08:20:122
12034991210,1cyclictest0-21swapper/207:44:062
1203499120,10cyclictest0-21swapper/208:50:112
1203099120,10cyclictest27546-21munin-node09:00:101
1203099120,10cyclictest0-21swapper/107:20:101
1202599128,2cyclictest5280-21cpuspeed_turbos08:10:090
1202599125,6cyclictest0-21swapper/007:25:290
1202599120,11cyclictest0-21swapper/008:35:050
1202599120,10cyclictest0-21swapper/007:16:200
1202599110,10cyclictest0-21swapper/009:05:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional