You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 01:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Fri Apr 26, 2024 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2909521230,3sleep22630099cyclictest08:30:112
1658421220,3sleep22630099cyclictest11:37:302
2066121140,2sleep30-21swapper/311:37:593
2359821000,3sleep20-21swapper/212:22:352
2604429927,43sleep30-21swapper/307:09:253
2592829537,46sleep10-21swapper/107:07:531
281962930,5sleep20-21swapper/209:11:352
251822900,1sleep20-21swapper/211:34:462
206882900,1sleep041ktimersoftd/009:49:440
179362900,2sleep30-21swapper/312:29:173
253482890,3sleep32630599cyclictest11:49:543
239912890,3sleep323989-21sshd09:50:073
142842890,0sleep00-21swapper/009:44:510
278072880,2sleep30-21swapper/310:25:183
183352880,0sleep00-21swapper/010:08:440
92372870,2sleep30-21swapper/310:03:463
221652850,3sleep32630599cyclictest12:00:283
165342850,2sleep10-21swapper/112:25:221
156522850,1sleep20-21swapper/212:14:222
150022850,1sleep30-21swapper/310:58:483
204222820,0sleep00-21swapper/011:34:120
137722820,2sleep10-21swapper/110:47:041
52572810,2sleep11987-21sshd10:07:081
236562810,0sleep041ktimersoftd/010:13:130
65832800,1sleep12121-21runrttasks09:28:251
224632800,2sleep20-21swapper/209:57:362
254402790,2sleep10-21swapper/110:17:171
252482790,2sleep225242-21bash12:08:082
240552790,1sleep20-21swapper/210:21:002
224422790,2sleep10-21swapper/110:55:451
324582780,2sleep30-21swapper/311:16:273
258952780,0sleep00-21swapper/009:58:020
105562780,0sleep01876-21nfsd12:17:240
55462760,1sleep05544-21sshd12:27:500
33392740,2sleep33334-21sshd12:38:353
7142730,2sleep12629399cyclictest11:12:371
258472730,0sleep10-21swapper/109:38:311
81032720,0sleep00-21swapper/009:28:360
2602827234,9sleep20-21swapper/207:09:122
39152680,1sleep00-21swapper/009:51:290
173342680,1sleep10-21swapper/110:24:081
2581925834,12sleep00-21swapper/007:06:330
25152460,0sleep00-21swapper/009:31:450
251762310,1sleep00-21swapper/010:44:380
295932280,2sleep20-21swapper/211:16:062
63942270,25sleep3138550irq/27-eth012:09:423
158962270,2sleep20-21swapper/209:37:162
2630599260,5cyclictest13206-21rm12:14:043
29702250,3sleep20-21swapper/212:16:302
237562250,2sleep223749-21sshd09:22:452
70322240,22sleep2138550irq/27-eth011:58:512
50422240,1sleep10-21swapper/111:20:541
36492240,2sleep10-21swapper/109:20:201
247222240,1sleep20-21swapper/211:49:492
161672240,2sleep316168-21bash10:43:333
326452230,22sleep328750irq/26-ahci[00008:40:003
319622230,1sleep231964-21id11:43:032
258592234,17sleep110950irq/23-ehci_hcd09:34:391
140722230,3sleep20-21swapper/211:14:182
2630099226,8cyclictest0-21swapper/209:09:342
156302222,18sleep210950irq/23-ehci_hcd10:12:142
116672220,2sleep10-21swapper/109:52:261
99212210,3sleep02628899cyclictest11:05:540
319592210,0sleep031960-21sshd10:56:570
2628899210,2cyclictest18011-21bash10:31:510
158282210,2sleep32121-21runrttasks11:29:543
2630599200,18cyclictest32696-21sshd11:08:423
2630099206,2cyclictest29889-21sshd10:25:272
2630099205,7cyclictest1877-21nfsd11:23:352
2630099205,3cyclictest0-21swapper/210:19:512
2629399207,1cyclictest23746-21rm12:18:591
2628899201,15cyclictest0-21swapper/012:07:230
138792200,18sleep1138550irq/27-eth011:44:481
91292190,17sleep1138550irq/27-eth009:55:551
2630099194,3cyclictest7872-21sshd11:09:392
2630099194,2cyclictest0-21swapper/207:21:182
2629399190,14cyclictest27488-21sshd11:38:481
2628899198,4cyclictest3-21ksoftirqd/010:16:510
2628899192,1cyclictest0-21swapper/011:03:320
2628899190,15cyclictest22679-21sshd11:56:540
2628899190,14cyclictest0-21swapper/009:35:140
2630099184,4cyclictest0-21swapper/209:26:552
2630099184,3cyclictest0-21swapper/210:07:112
2630099184,13cyclictest10950irq/23-ehci_hcd10:37:462
2630099183,3cyclictest0-21swapper/209:31:312
2630099182,2cyclictest0-21swapper/208:58:192
2630099182,12cyclictest0-21swapper/207:52:562
2630099181,13cyclictest14878-21sshd09:17:492
2629399180,10cyclictest31630-21sshd10:41:271
2628899187,4cyclictest0-21swapper/010:25:160
2628899186,4cyclictest3-21ksoftirqd/011:11:190
2628899180,14cyclictest26650-21bash12:33:540
2628899180,14cyclictest17091-21bash09:21:570
2628899180,14cyclictest0-21swapper/011:42:250
2628899180,14cyclictest0-21swapper/010:02:190
2628899180,11cyclictest30151-21cpuspeed_turbos10:45:130
150642180,2sleep30-21swapper/310:16:003
86672170,15sleep1138550irq/27-eth009:48:141
267602170,16sleep128750irq/26-ahci[00012:37:341
2630599170,5cyclictest13287-21sshd11:59:343
2630599170,16cyclictest0-21swapper/311:11:343
2630599170,15cyclictest0-21swapper/309:33:503
2630599170,15cyclictest0-21swapper/309:26:523
2630599170,12cyclictest16805-21sshd09:37:233
2630099173,2cyclictest0-21swapper/210:33:232
2630099173,1cyclictest0-21swapper/208:28:552
2630099173,10cyclictest12321-21sshd10:54:422
2630099172,6cyclictest0-21swapper/212:03:532
2630099172,10cyclictest760-21sshd11:04:572
2630099171,8cyclictest17935-21sshd11:26:152
2630099170,15cyclictest0-21swapper/209:50:052
2629399171,11cyclictest18232-21sshd10:04:551
2629399170,16cyclictest47-21rcuop/309:43:251
2628899170,10cyclictest0-21swapper/012:36:220
237832170,15sleep1138550irq/27-eth010:13:151
26382160,14sleep3138550irq/27-eth009:59:103
2630599167,8cyclictest0-21swapper/308:56:333
2630599167,4cyclictest4422-21sshd11:01:223
26305991613,2cyclictest0-21swapper/308:50:183
26305991612,3cyclictest13006-21bash09:44:423
2630599160,7cyclictest0-21swapper/310:14:573
2630099162,9cyclictest3941-21needreboot07:30:212
2630099162,2cyclictest0-21swapper/208:01:592
2630099160,12cyclictest11312-21sshd09:44:312
2629399166,3cyclictest9905-21sshd12:20:581
2629399165,2cyclictest27606-21sshd10:52:361
2629399160,14cyclictest4323-21sshd12:13:031
2628899165,4cyclictest0-21swapper/008:47:350
221672160,14sleep310950irq/23-ehci_hcd09:45:393
213492160,3sleep02628899cyclictest11:19:050
302722150,13sleep2138550irq/27-eth010:41:172
300482150,13sleep1138550irq/27-eth010:33:211
26305991511,3cyclictest10950irq/23-ehci_hcd08:09:003
2630599150,6cyclictest0-21swapper/312:15:213
2630599150,3cyclictest23007-21sshd11:30:363
2630599150,13cyclictest0-21swapper/310:45:073
2630599150,13cyclictest0-21swapper/310:30:283
2630599150,12cyclictest18781-21sshd10:20:223
2630599150,12cyclictest0-21swapper/310:37:123
2630599150,11cyclictest8502-21sshd09:20:513
2630599150,10cyclictest32620-21grep09:20:003
2630099152,8cyclictest1921-21nscd10:56:272
2630099152,12cyclictest147450irq/28-eth1-rx-08:48:112
2630099151,9cyclictest0-21swapper/207:48:132
26300991512,2cyclictest5979-21bash09:47:492
26300991512,2cyclictest3770-21sshd12:27:372
26300991512,2cyclictest21017-21sshd10:01:142
2630099151,11cyclictest0-21swapper/212:35:132
2630099151,0cyclictest0-21swapper/207:18:462
2630099150,8cyclictest0-21swapper/207:36:022
2630099150,13cyclictest0-21swapper/208:35:512
2629399157,7cyclictest6926-21sshd12:05:591
2629399151,11cyclictest138550irq/27-eth010:38:101
26293991510,3cyclictest0-21swapper/109:17:061
2629399150,7cyclictest23744-21sshd11:30:421
2629399150,6cyclictest0-21swapper/111:30:011
2629399150,13cyclictest7151-21taskset12:31:371
2629399150,13cyclictest0-21swapper/111:00:051
2629399150,13cyclictest0-21swapper/108:55:121
2628899157,5cyclictest0-21swapper/007:18:090
2628899153,5cyclictest1875-21nfsd10:50:120
2628899151,2cyclictest0-21swapper/012:01:530
2628899150,14cyclictest0-21swapper/011:20:040
188332150,1sleep026280-21cyclictest12:10:590
101802151,12sleep3138550irq/27-eth011:44:223
57332140,13sleep310950irq/23-ehci_hcd09:12:493
2630599141,1cyclictest21745-21sshd10:09:083
26305991410,3cyclictest138550irq/27-eth011:50:333
2630599140,9cyclictest138550irq/27-eth007:15:553
2630599140,5cyclictest17687-21sshd10:51:233
2630599140,5cyclictest0-21swapper/312:32:463
2630599140,13cyclictest0-21swapper/311:22:053
2630599140,12cyclictest13791-21crond09:10:003
2630599140,12cyclictest0-21swapper/307:42:363
2630099144,9cyclictest147450irq/28-eth1-rx-09:03:592
2630099144,9cyclictest147450irq/28-eth1-rx-08:05:392
2630099144,9cyclictest147450irq/28-eth1-rx-07:41:312
2630099144,9cyclictest147450irq/28-eth1-rx-07:29:552
2630099144,9cyclictest147450irq/28-eth1-rx-07:10:512
2630099144,9cyclictest0-21swapper/208:22:192
2630099143,7cyclictest0-21swapper/208:52:162
2630099142,7cyclictest25-21rcuop/111:51:112
2630099142,11cyclictest138550irq/27-eth007:57:352
2630099141,4cyclictest29771-21munin-node10:45:222
2630099141,2cyclictest0-21swapper/208:10:462
2630099140,13cyclictest0-21swapper/212:30:212
2630099140,12cyclictest1914-21ls08:40:292
2629399141,12cyclictest138550irq/27-eth008:30:141
2629399141,11cyclictest18368-21switchtime09:10:221
26293991410,3cyclictest10950irq/23-ehci_hcd09:01:161
26293991410,3cyclictest10950irq/23-ehci_hcd08:54:001
2629399140,5cyclictest2269-21sshd12:01:531
2629399140,5cyclictest0-21swapper/108:45:131
2629399140,3cyclictest138550irq/27-eth007:37:371
2629399140,2cyclictest0-21swapper/111:55:481
2629399140,2cyclictest0-21swapper/111:46:361
2629399140,12cyclictest31520-21sshd11:16:201
2629399140,12cyclictest0-21swapper/111:50:211
2628899148,5cyclictest10098-21sshd11:25:220
2628899145,8cyclictest28344-21sshd09:15:240
2628899145,5cyclictest16420-21sshd10:35:290
2628899140,4cyclictest29248-21bash10:21:380
2628899140,1cyclictest2121-21runrttasks08:09:260
2628899140,1cyclictest0-21swapper/008:20:210
2628899140,13cyclictest15343-21sshd09:10:090
2630599137,5cyclictest0-21swapper/307:20:283
2630599132,10cyclictest10950irq/23-ehci_hcd08:17:513
26305991311,1cyclictest0-21swapper/309:02:323
2630599130,5cyclictest0-21swapper/307:49:423
2630599130,12cyclictest138550irq/27-eth008:30:073
2630599130,12cyclictest0-21swapper/308:40:373
2630599130,12cyclictest0-21swapper/308:26:133
2630599130,12cyclictest0-21swapper/307:56:543
2630599130,12cyclictest0-21swapper/307:51:113
2630599130,12cyclictest0-21swapper/307:37:103
2630599130,12cyclictest0-21swapper/307:30:373
2630599130,11cyclictest25502-21munin-node08:20:223
2630599130,11cyclictest2383-21cpuspeed_turbos12:20:113
2630099137,5cyclictest0-21swapper/208:15:072
2629399139,3cyclictest1424-21iostat_ios07:25:151
2629399139,3cyclictest138550irq/27-eth011:05:011
2629399133,1cyclictest0-21swapper/108:11:021
2629399132,10cyclictest138550irq/27-eth008:27:281
2629399132,10cyclictest10950irq/23-ehci_hcd08:04:091
26293991311,1cyclictest0-21swapper/107:22:051
2629399130,9cyclictest0-21swapper/110:25:511
2629399130,4cyclictest16014-21seq07:57:091
2629399130,4cyclictest12650-21munin-node07:50:151
2629399130,12cyclictest31488-21grep08:35:161
2629399130,12cyclictest0-21swapper/109:08:011
2629399130,12cyclictest0-21swapper/108:23:041
2629399130,12cyclictest0-21swapper/107:10:111
2629399130,11cyclictest3869-21memory07:30:201
2629399130,11cyclictest24380-21ntp_states08:15:231
2629399130,11cyclictest1181-21iostat_ios08:40:191
2629399130,11cyclictest11407-21taskset07:45:441
2628899137,5cyclictest0-21swapper/007:40:480
2628899135,5cyclictest0-21swapper/011:51:280
26288991311,1cyclictest0-21swapper/011:48:090
26288991311,1cyclictest0-21swapper/007:35:500
26288991311,1cyclictest0-21swapper/007:20:230
2628899130,8cyclictest10855-21ntpq07:45:210
2628899130,5cyclictest0-21swapper/008:11:210
2628899130,4cyclictest0-21swapper/011:36:130
2628899130,1cyclictest0-21swapper/009:00:400
2628899130,12cyclictest0-21swapper/009:05:050
2628899130,12cyclictest0-21swapper/008:40:200
2628899130,12cyclictest0-21swapper/007:13:010
2628899130,10cyclictest29812-21sshd12:23:190
2628899130,10cyclictest0-21swapper/007:50:120
2630599127,3cyclictest26979-21perl07:10:123
2630599127,3cyclictest21655-21tr08:10:133
26305991210,1cyclictest0-21swapper/307:25:083
2630599120,3cyclictest3087-21df_inode08:45:113
2630599120,10cyclictest0-21swapper/308:00:113
2629399120,3cyclictest0-21swapper/107:15:131
2629399120,11cyclictest19021-21munin-node08:05:101
2629399120,11cyclictest0-21swapper/107:40:021
2628899128,3cyclictest0-21swapper/008:00:350
2628899127,4cyclictest0-21swapper/008:58:320
2628899127,3cyclictest0-21swapper/007:55:040
26288991210,1cyclictest0-21swapper/008:32:300
2628899120,9cyclictest0-21swapper/008:36:250
2628899120,11cyclictest0-21swapper/008:50:360
2628899120,10cyclictest0-21swapper/008:17:390
2628899117,3cyclictest0-21swapper/008:25:210
2628899117,3cyclictest0-21swapper/007:30:260
2628899117,3cyclictest0-21swapper/007:26:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional