You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 22:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Wed Apr 24, 2024 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
822221440,3sleep31307899cyclictest12:04:493
2005121230,3sleep31307899cyclictest12:31:383
2823521080,2sleep20-21swapper/211:33:142
12673210633,44sleep10-21swapper/107:08:191
12685210433,43sleep30-21swapper/307:08:303
66502960,1sleep00-21swapper/012:19:130
237272940,2sleep223719-21sshd11:51:422
135372940,1sleep10-21swapper/111:54:201
128782910,3sleep20-21swapper/212:05:172
128782910,3sleep20-21swapper/212:05:172
311132900,0sleep00-21swapper/011:48:510
77672860,1sleep07755-21sshd09:30:300
250042860,0sleep00-21swapper/009:52:050
250042860,0sleep00-21swapper/009:52:050
180912830,1sleep00-21swapper/012:09:350
180912830,1sleep00-21swapper/012:09:340
266902820,0sleep00-21swapper/011:17:300
239172810,1sleep023912-21sshd11:51:440
206292810,2sleep220630-21sshd12:28:052
139462810,0sleep00-21swapper/009:27:290
190852790,1sleep20-21swapper/209:39:532
326662780,1sleep10-21swapper/109:29:451
67602770,2sleep30-21swapper/309:53:483
67602770,2sleep30-21swapper/309:53:483
66242770,1sleep00-21swapper/011:57:130
66242770,1sleep00-21swapper/011:57:120
207082770,2sleep120700-21sshd12:24:271
101882770,1sleep10-21swapper/111:38:511
38262760,1sleep10-21swapper/109:18:231
132832760,2sleep10-21swapper/109:11:461
36662740,0sleep00-21swapper/009:18:220
222422730,1sleep00-21swapper/010:03:110
255372720,1sleep20-21swapper/211:29:052
188792700,1sleep20-21swapper/210:06:372
326212680,0sleep00-21swapper/012:22:050
126992679,19sleep20-21swapper/207:08:402
100992670,2sleep110098-21sshd09:38:481
211962650,2sleep10-21swapper/107:35:071
80222640,4sleep11307699cyclictest11:03:361
1273726436,4sleep00-21swapper/007:09:110
296752541,51sleep328750irq/26-ahci[00011:59:523
296752541,51sleep328750irq/26-ahci[00011:59:523
38492500,0sleep03850-21bash09:38:020
224352340,1sleep122433-21sshd10:53:411
186032320,30sleep2138550irq/27-eth012:24:132
30332310,29sleep3138550irq/27-eth010:08:403
1307899312,12cyclictest3468-21sshd10:04:483
81932300,3sleep38189-21sshd11:42:243
80942302,26sleep3138550irq/27-eth010:24:513
276202290,1sleep20-21swapper/211:55:512
276202290,1sleep20-21swapper/211:55:512
260832290,2sleep126076-21sshd09:55:591
260832290,2sleep126076-21sshd09:55:581
117522290,4sleep11307699cyclictest12:01:271
248582270,25sleep228750irq/26-ahci[00012:17:362
199112270,4sleep20-21swapper/211:16:392
298252260,2sleep30-21swapper/311:14:043
272592260,2sleep227255-21sshd12:32:292
143572260,2sleep10-21swapper/111:08:211
13078992622,3cyclictest0-21swapper/309:19:593
85142250,4sleep11307699cyclictest12:37:451
270252250,2sleep30-21swapper/311:05:543
144162250,1sleep00-21swapper/012:01:460
1307899250,3cyclictest0-21swapper/312:08:593
1307899250,3cyclictest0-21swapper/312:08:583
1307899250,3cyclictest0-21swapper/309:14:583
1307899250,10cyclictest0-21swapper/312:23:523
317582240,3sleep20-21swapper/211:21:562
255952240,22sleep128750irq/26-ahci[00010:19:081
1307899248,11cyclictest22483-21sshd10:57:293
1307899243,14cyclictest138550irq/27-eth010:19:073
1307899242,10cyclictest138550irq/27-eth011:51:003
1307899242,10cyclictest138550irq/27-eth011:29:193
1307899240,3cyclictest0-21swapper/311:17:413
1307899240,18cyclictest17947-21sshd10:41:273
215612230,0sleep00-21swapper/012:39:170
155382230,3sleep10-21swapper/110:49:001
1307899233,9cyclictest138550irq/27-eth011:00:353
1307899233,10cyclictest138550irq/27-eth010:51:103
1307899233,10cyclictest138550irq/27-eth009:42:023
1307899232,19cyclictest31600-21sshd09:21:403
1307899232,10cyclictest138550irq/27-eth011:47:213
1307899231,12cyclictest5151-21sshd11:34:253
1307899231,10cyclictest138550irq/27-eth009:47:353
1307899231,0cyclictest0-21swapper/312:29:223
1307899230,3cyclictest0-21swapper/310:38:393
1307899230,3cyclictest0-21swapper/310:13:213
1307899230,2cyclictest0-21swapper/310:46:163
1307899230,2cyclictest0-21swapper/309:27:343
1307899230,15cyclictest0-21swapper/312:11:543
1307899230,15cyclictest0-21swapper/310:27:113
1307899230,13cyclictest0-21swapper/309:31:083
1307599238,6cyclictest23880-21sshd11:32:430
112732230,2sleep211260-21sshd09:34:562
50952220,2sleep25085-21sshd10:20:252
1307899223,9cyclictest138550irq/27-eth012:15:103
1307899223,9cyclictest138550irq/27-eth010:30:063
1307899222,11cyclictest138550irq/27-eth009:36:393
1307899222,10cyclictest138550irq/27-eth012:35:263
1307899222,10cyclictest138550irq/27-eth011:20:033
1307899222,10cyclictest138550irq/27-eth009:57:423
1307899222,10cyclictest138550irq/27-eth009:57:423
1307899220,3cyclictest0-21swapper/311:35:153
1307899220,3cyclictest0-21swapper/308:00:193
273462210,19sleep228750irq/26-ahci[00010:38:492
1307899218,7cyclictest138550irq/27-eth009:00:463
1307899210,3cyclictest0-21swapper/307:20:123
1307899210,14cyclictest0-21swapper/307:29:143
1307899210,10cyclictest0-21swapper/308:40:153
1307899210,10cyclictest0-21swapper/308:20:223
1307599215,9cyclictest29582-21cp10:46:470
1307599213,13cyclictest18291-21sshd10:56:580
119112212,17sleep1138550irq/27-eth012:34:301
1307899202,8cyclictest138550irq/27-eth008:15:223
1307899200,2cyclictest0-21swapper/308:50:143
1307899200,2cyclictest0-21swapper/308:25:183
1307899200,2cyclictest0-21swapper/308:10:173
1307899200,2cyclictest0-21swapper/307:55:153
1307899200,19cyclictest0-21swapper/307:10:143
1307899200,10cyclictest0-21swapper/308:45:203
1307899200,10cyclictest0-21swapper/307:19:163
1307599205,14cyclictest13317-21id10:05:530
1307599202,1cyclictest30593-21sshd11:02:200
40382192,15sleep1138550irq/27-eth011:41:561
1307899190,3cyclictest0-21swapper/308:35:133
1307899190,2cyclictest0-21swapper/308:30:173
1307899190,2cyclictest0-21swapper/307:50:293
1307899190,2cyclictest0-21swapper/307:50:293
1307899190,2cyclictest0-21swapper/307:35:073
1307899190,2cyclictest0-21swapper/307:34:463
1307599199,4cyclictest0-21swapper/011:43:500
1307599196,4cyclictest24377-21sshd10:15:090
13075991911,7cyclictest31959-21sshd11:37:310
1307599191,14cyclictest18084-21cp12:27:460
1307599190,18cyclictest25405-21sshd10:50:130
1307599190,14cyclictest29674-21id12:10:450
1307599190,11cyclictest1877-21nfsd09:21:290
264832184,12sleep110950irq/23-ehci_hcd09:32:511
18962180,1sleep00-21swapper/009:10:260
160242180,2sleep116018-21sshd10:33:371
1307899182,7cyclictest138550irq/27-eth008:08:443
1307899180,1cyclictest0-21swapper/309:05:273
1307899180,1cyclictest0-21swapper/308:55:293
1307899180,1cyclictest0-21swapper/307:46:293
1307799183,10cyclictest1877-21nfsd09:27:362
13076991813,3cyclictest32231-21bash11:56:241
13076991813,3cyclictest32231-21bash11:56:241
13076991812,4cyclictest15658-21sshd11:16:061
1307599181,15cyclictest11898-21sshd10:25:160
1307599180,1cyclictest138550irq/27-eth010:43:300
1307599180,14cyclictest0-21swapper/009:58:400
1307599180,14cyclictest0-21swapper/009:58:400
324712170,4sleep20-21swapper/209:53:002
324712170,4sleep20-21swapper/209:52:592
218992170,3sleep20-21swapper/210:30:222
1307699170,15cyclictest0-21swapper/112:08:461
1307699170,15cyclictest0-21swapper/112:08:451
1307599171,5cyclictest0-21swapper/010:38:500
1307599171,15cyclictest41ktimersoftd/010:14:390
1307599170,15cyclictest0-21swapper/011:22:490
1307899160,1cyclictest0-21swapper/307:40:293
1307799165,10cyclictest17028-21sshd12:02:042
1307799164,10cyclictest13342-21id09:23:272
1307799163,11cyclictest0-21swapper/209:18:272
1307799162,13cyclictest2121-21runrttasks10:44:522
13077991612,3cyclictest24445-21sshd10:46:072
13077991610,4cyclictest0-21swapper/208:08:072
1307699167,4cyclictest2181-21sshd12:15:031
1307699163,0cyclictest0-21swapper/111:14:591
13076991614,1cyclictest0-21swapper/109:01:591
13076991611,4cyclictest19305-21sshd12:13:201
13076991610,1cyclictest23747-21id11:32:411
1307699160,3cyclictest20991-21ls09:20:231
1307599161,7cyclictest1258-21sshd10:31:490
1307599161,14cyclictest41ktimersoftd/007:20:000
1307599161,13cyclictest3750-21id11:07:030
1307599160,15cyclictest41ktimersoftd/012:33:270
1307599160,15cyclictest24259-21bash11:28:560
1307599160,15cyclictest20796-21bash09:40:050
94702150,3sleep19466-21sshd10:25:011
1307799155,3cyclictest4229-21sshd10:59:152
1307799153,6cyclictest1987-21sshd11:46:422
1307799153,10cyclictest20068-21sshd11:36:042
1307799152,9cyclictest0-21swapper/211:41:442
1307799152,8cyclictest23138-21perf07:40:002
1307799152,6cyclictest27265-21sshd10:00:012
1307799152,6cyclictest27265-21sshd10:00:002
1307799152,10cyclictest6434-21bash10:51:442
1307799151,12cyclictest6126-21sshd11:11:082
1307799151,12cyclictest27785-21cp10:00:052
1307799150,6cyclictest0-21swapper/209:49:562
1307799150,14cyclictest1748-21sshd12:36:582
1307699159,4cyclictest1987-21sshd11:20:571
1307699158,6cyclictest1921-21nscd10:27:461
1307699157,6cyclictest0-21swapper/109:50:411
1307699157,6cyclictest0-21swapper/109:50:411
1307699155,6cyclictest138550irq/27-eth009:42:061
1307699154,6cyclictest0-21swapper/110:37:471
1307699154,10cyclictest0-21swapper/108:08:211
1307699153,3cyclictest23250-21rm10:07:121
13076991513,1cyclictest0-21swapper/107:10:241
13076991512,2cyclictest0-21swapper/110:10:531
1307699150,11cyclictest1278-21sshd10:43:241
1307699150,10cyclictest0-21swapper/111:28:211
1307599159,5cyclictest0-21swapper/008:41:400
1307599151,13cyclictest6130-21sshd10:24:350
1307599151,11cyclictest8-21rcu_preempt09:00:260
1307599150,5cyclictest0-21swapper/011:10:480
1307599150,12cyclictest0-21swapper/007:28:120
1307599150,12cyclictest0-21swapper/007:22:100
12962150,0sleep041ktimersoftd/009:45:240
1307799148,5cyclictest14543-21sshd09:11:552
1307799147,6cyclictest3618-21sshd12:11:302
1307799147,3cyclictest32064-21sshd11:06:322
1307799146,6cyclictest0-21swapper/210:25:162
1307799142,7cyclictest20817-21kworker/u8:207:55:082
13077991412,1cyclictest0-21swapper/208:10:252
1307799140,13cyclictest24942-21sshd11:01:402
1307799140,12cyclictest27956-21sshd10:15:272
1307799140,12cyclictest0-21swapper/209:40:182
1307699148,4cyclictest11335-21sshd11:46:301
1307699143,6cyclictest11896-21sshd12:27:041
13076991411,2cyclictest0-21swapper/107:21:231
1307699140,5cyclictest31916-21id09:45:151
1307699140,13cyclictest0-21swapper/109:09:021
1307699140,10cyclictest15077-21bash10:56:341
1307599142,5cyclictest23764-21sh07:45:000
1307599141,2cyclictest10-21rcuc/008:46:110
1307599141,10cyclictest0-21swapper/008:36:000
1307599140,13cyclictest41ktimersoftd/007:35:070
1307799132,6cyclictest6835-21kworker/u8:208:22:532
1307799131,7cyclictest138550irq/27-eth007:35:012
1307799131,11cyclictest138550irq/27-eth007:44:122
1307799130,3cyclictest0-21swapper/208:26:012
1307799130,12cyclictest1877-21nfsd08:31:022
1307799130,12cyclictest138550irq/27-eth008:05:012
1307799130,12cyclictest0-21swapper/209:01:392
1307799130,12cyclictest0-21swapper/208:57:272
1307799130,12cyclictest0-21swapper/208:45:492
1307799130,12cyclictest0-21swapper/208:43:012
1307799130,12cyclictest0-21swapper/207:26:032
1307799130,12cyclictest0-21swapper/207:21:372
1307799130,11cyclictest16111-21sshd10:10:112
1307799130,11cyclictest14388-21df08:35:122
1307699139,3cyclictest138550irq/27-eth007:50:171
1307699139,3cyclictest138550irq/27-eth007:50:161
1307699139,3cyclictest138550irq/27-eth007:45:291
1307699138,4cyclictest0-21swapper/108:15:141
1307699137,5cyclictest0-21swapper/107:15:431
1307699132,10cyclictest0-21swapper/108:40:041
1307699131,11cyclictest30542-21sshd10:00:201
13076991310,2cyclictest138550irq/27-eth008:01:561
1307699130,5cyclictest0-21swapper/108:36:381
1307699130,5cyclictest0-21swapper/107:57:561
1307699130,4cyclictest2121-21runrttasks08:59:401
1307699130,4cyclictest13520-21taskset08:30:321
1307699130,12cyclictest0-21swapper/108:53:061
1307699130,12cyclictest0-21swapper/108:45:031
1307699130,12cyclictest0-21swapper/108:23:061
1307699130,12cyclictest0-21swapper/108:12:081
1307599139,3cyclictest3-21ksoftirqd/007:32:460
1307599137,5cyclictest0-21swapper/008:11:220
1307599131,11cyclictest15111-21crond07:15:000
13075991311,1cyclictest0-21swapper/008:01:200
13075991311,1cyclictest0-21swapper/007:55:480
13075991311,1cyclictest0-21swapper/007:46:010
1307599131,10cyclictest2135-21grep08:05:250
1307599130,1cyclictest147450irq/28-eth1-rx-08:20:260
1307599130,12cyclictest0-21swapper/009:05:490
1307599130,12cyclictest0-21swapper/008:50:350
1307599130,12cyclictest0-21swapper/007:51:100
1307599130,12cyclictest0-21swapper/007:51:100
1307799127,3cyclictest28148-21fschecks_time09:05:152
1307799123,6cyclictest26570-21diskstats07:50:132
1307799123,6cyclictest26570-21diskstats07:50:122
1307799120,4cyclictest23986-21munin-node07:45:162
1307799120,4cyclictest13799-21if_err_eth007:10:162
1307799120,11cyclictest5119-21munin-node08:15:192
1307799120,11cyclictest2121-21runrttasks08:50:032
1307799120,11cyclictest0-21swapper/207:15:272
1307699128,3cyclictest138550irq/27-eth007:25:481
13076991210,1cyclictest0-21swapper/107:42:111
1307699120,3cyclictest10988-21munin-node08:25:271
1307699120,10cyclictest0-21swapper/107:30:351
1307599122,3cyclictest23167-21wget08:55:110
1307599120,1cyclictest0-21swapper/008:15:590
1307599120,11cyclictest0-21swapper/008:30:280
1307599120,11cyclictest0-21swapper/008:25:520
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional