You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-02 - 21:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Sat Mar 02, 2024 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2378821470,1sleep20-21swapper/211:27:072
3256721320,3sleep01520599cyclictest09:57:490
1542821210,3sleep11520699cyclictest10:19:461
1508121180,2sleep015079-21crond07:10:000
1856221120,4sleep11520699cyclictest10:20:101
829321110,1sleep08288-21fschecks_time08:05:250
15025210024,63sleep30-21swapper/307:09:353
313512980,2sleep20-21swapper/212:32:052
1485629635,49sleep10-21swapper/107:07:291
88422940,0sleep38837-21sshd12:25:513
317442940,0sleep331729-21sshd12:10:223
277032920,3sleep21520799cyclictest09:12:542
177522890,2sleep00-21swapper/009:23:420
260592870,2sleep30-21swapper/312:38:503
221872860,0sleep00-21swapper/010:44:130
104322850,3sleep010423-21sshd12:11:350
272272840,6sleep10-21swapper/110:01:061
149632840,1sleep014943-21sshd09:35:400
271002830,2sleep127101-21sshd10:25:111
244722830,0sleep00-21swapper/010:52:120
149562820,3sleep20-21swapper/212:04:382
269472800,3sleep31521099cyclictest10:01:043
172742800,2sleep10-21swapper/109:55:491
239562770,2sleep01520599cyclictest11:23:170
192282770,1sleep019221-21sshd11:45:570
9612760,2sleep20-21swapper/209:38:032
133202750,1sleep20-21swapper/209:23:082
273462740,2sleep31521099cyclictest11:11:583
131102700,1sleep00-21swapper/010:23:250
105292690,2sleep30-21swapper/310:27:053
161602670,1sleep014752-21kworker/0:110:55:080
1381726134,9sleep20-21swapper/207:05:262
183502590,3sleep218344-21sshd11:22:342
68532550,4sleep30-21swapper/311:29:013
150712510,5sleep11520699cyclictest12:23:011
58732500,0sleep15875-21id10:53:521
36612440,0sleep00-21swapper/011:32:310
251932390,0sleep225192-21bash10:32:582
36562370,0sleep00-21swapper/012:39:590
232232370,2sleep10-21swapper/112:34:521
156582360,0sleep315659-21sshd09:31:403
268022350,33sleep3138550irq/27-eth009:37:133
50352340,2sleep25034-21sshd10:06:202
86412321,29sleep1138550irq/27-eth011:33:081
323632320,29sleep3138550irq/27-eth007:45:343
15205993227,4cyclictest4652-21fschecks_time11:05:250
38792310,2sleep10-21swapper/111:36:241
38792310,2sleep10-21swapper/111:36:241
272552310,0sleep00-21swapper/009:49:110
33672290,2sleep10-21swapper/110:49:441
142322290,0sleep00-21swapper/011:18:120
102252290,2sleep210203-21sshd09:18:432
95022280,4sleep11520699cyclictest11:52:361
7172270,1sleep30-21swapper/310:21:533
297492270,3sleep10-21swapper/111:12:161
164792270,2sleep216478-21sshd11:37:572
164792270,2sleep216478-21sshd11:37:572
263122260,1sleep20-21swapper/210:00:592
127012266,18sleep210950irq/23-ehci_hcd08:15:222
126272260,2sleep312626-21sshd12:19:113
89302250,3sleep00-21swapper/009:50:470
259712250,4sleep31521099cyclictest11:23:323
181922250,4sleep21520799cyclictest11:10:492
171882250,23sleep1138550irq/27-eth009:51:541
97122240,2sleep39714-21idleruntime10:50:253
48932240,4sleep21520799cyclictest12:18:172
1521099240,7cyclictest0-21swapper/310:43:353
108482240,2sleep310847-21bash11:17:473
55942230,21sleep328750irq/26-ahci[00010:18:333
232172230,2sleep30-21swapper/309:44:453
176272230,2sleep32121-21runrttasks07:15:203
285982220,2sleep128599-21sshd09:33:251
257172220,20sleep2138550irq/27-eth009:52:592
24082220,2sleep041ktimersoftd/010:30:110
217102220,20sleep2138550irq/27-eth010:36:242
183462220,3sleep20-21swapper/210:51:252
83152210,3sleep10-21swapper/111:09:471
41622210,18sleep3138550irq/27-eth011:55:433
316982210,1sleep031695-21sshd10:37:360
269042210,2sleep30-21swapper/311:39:163
269042210,2sleep30-21swapper/311:39:163
251942200,18sleep3138550irq/27-eth011:04:023
172702200,3sleep10-21swapper/112:01:021
153812200,2sleep22121-21runrttasks11:41:392
15210992015,3cyclictest9377-21sshd09:46:553
15207992013,6cyclictest47-21rcuop/312:25:222
295182191,16sleep2138550irq/27-eth012:06:162
250462190,2sleep10-21swapper/112:13:191
1521099190,14cyclictest4073-21sshd11:44:153
1520799195,5cyclictest29369-21sshd09:25:122
1520799190,8cyclictest0-21swapper/208:32:002
126262190,2sleep30-21swapper/310:35:233
1521099180,4cyclictest26107-21irqstats12:20:373
1520799185,12cyclictest28750irq/26-ahci[00009:31:022
1520799182,11cyclictest147450irq/28-eth1-rx-11:03:182
1520699188,2cyclictest548-21bash09:45:481
1520699185,5cyclictest138550irq/27-eth011:28:431
1520599186,6cyclictest3-21ksoftirqd/010:17:240
15205991813,3cyclictest3-21ksoftirqd/011:10:310
1520599181,14cyclictest1987-21sshd09:12:200
1520599180,14cyclictest0-21swapper/008:02:060
109942180,1sleep30-21swapper/311:33:263
1521099175,11cyclictest147450irq/28-eth1-rx-10:58:143
1521099170,16cyclictest0-21swapper/308:20:273
1520799175,2cyclictest3031-21bash10:45:392
1520799175,2cyclictest0-21swapper/209:03:442
1520799172,11cyclictest30444-21bash11:51:142
1520799171,3cyclictest0-21swapper/211:08:152
15207991712,4cyclictest1540-21sshd10:10:112
1520699175,6cyclictest14910-21fschecks_count08:20:251
1520699170,13cyclictest0-21swapper/112:08:261
15205991713,3cyclictest3-21ksoftirqd/009:17:150
15205991713,2cyclictest3-21ksoftirqd/011:56:590
1520599171,2cyclictest11135-21bash10:27:100
15205991712,3cyclictest3-21ksoftirqd/012:23:030
1520599171,13cyclictest0-21swapper/011:27:390
150762170,0sleep115077-21sshd11:02:461
316262161,13sleep1138550irq/27-eth011:55:181
1521099168,3cyclictest14486-21sshd09:11:113
1521099167,7cyclictest14219-21sshd09:59:373
1521099163,11cyclictest0-21swapper/310:10:173
1521099162,12cyclictest6296-21sshd10:46:053
1521099161,3cyclictest0-21swapper/310:34:193
15210991612,3cyclictest30044-21sshd09:29:203
15210991611,1cyclictest28465-21sshd10:09:313
15210991610,4cyclictest28941-21nfsd408:50:293
1521099160,9cyclictest15196-21atenall_r5power09:15:223
1521099160,7cyclictest0-21swapper/308:45:323
1521099160,14cyclictest0-21swapper/309:00:353
1520799165,1cyclictest0-21swapper/207:15:162
1520799164,2cyclictest0-21swapper/207:48:562
1520799163,12cyclictest1943-21snmpd10:24:402
1520799162,8cyclictest0-21swapper/207:41:362
1520799162,7cyclictest0-21swapper/208:13:202
1520799162,10cyclictest1943-21snmpd11:31:432
1520799161,1cyclictest27713-21cp10:40:542
15207991611,4cyclictest9532-21sshd10:58:142
1520799160,14cyclictest17263-21sshd11:57:172
1520799160,14cyclictest0-21swapper/209:49:122
1520699160,4cyclictest13727-21sshd09:35:331
1520699160,3cyclictest20734-21sshd12:16:231
1520699160,15cyclictest147450irq/28-eth1-rx-07:52:041
1520699160,11cyclictest1051-21sshd10:14:041
1520599169,3cyclictest3-21ksoftirqd/012:33:370
1520599168,6cyclictest0-21swapper/008:30:210
15205991612,3cyclictest3-21ksoftirqd/012:28:550
15205991612,2cyclictest3-21ksoftirqd/012:17:170
15205991612,2cyclictest3-21ksoftirqd/009:28:550
1520599160,2cyclictest8703-21users09:30:360
1520599160,15cyclictest0-21swapper/010:13:040
1520599160,14cyclictest3-21ksoftirqd/010:04:000
1520599160,14cyclictest0-21swapper/012:09:460
1520599160,14cyclictest0-21swapper/010:49:070
1520599160,10cyclictest0-21swapper/011:50:590
1521099157,5cyclictest27033-21fschecks_count07:35:243
1521099157,5cyclictest27033-21fschecks_count07:35:243
15210991512,2cyclictest13251-21sshd12:30:063
1521099150,13cyclictest1875-21nfsd12:06:233
1521099150,13cyclictest13286-21sshd12:00:353
1521099150,11cyclictest29020-21sshd11:54:583
1520799157,4cyclictest10950irq/23-ehci_hcd12:22:342
1520799155,6cyclictest147450irq/28-eth1-rx-11:46:352
1520799155,2cyclictest0-21swapper/207:58:442
1520799155,2cyclictest0-21swapper/207:58:442
1520799154,6cyclictest1875-21nfsd09:41:062
1520799153,0cyclictest25-21rcuop/111:19:132
1520799152,12cyclictest16894-21sshd10:15:522
1520799152,12cyclictest0-21swapper/208:25:122
1520799152,11cyclictest30471-21df08:55:202
1520799151,7cyclictest0-21swapper/209:09:122
1520799151,7cyclictest0-21swapper/208:24:322
15207991511,3cyclictest6221-21irqstats08:00:252
1520799150,13cyclictest30775-21sshd12:35:402
1520799150,11cyclictest29191-21sshd09:57:222
1520699158,3cyclictest28372-21bash11:47:071
1520699157,3cyclictest0-21swapper/109:11:171
1520699155,4cyclictest17763-21sshd10:08:081
1520699155,3cyclictest7980-21bash10:38:401
1520699153,10cyclictest0-21swapper/112:38:261
1520699152,3cyclictest22109-21sshd09:20:161
1520699151,9cyclictest8410-21bash09:42:541
1520699150,3cyclictest0-21swapper/110:30:231
1520699150,14cyclictest0-21swapper/111:44:121
1520699150,13cyclictest7316-21sshd12:29:261
1520699150,13cyclictest0-21swapper/107:15:211
15205991512,2cyclictest3-21ksoftirqd/010:09:100
15205991511,3cyclictest3-21ksoftirqd/011:42:130
15205991511,2cyclictest3-21ksoftirqd/011:00:360
1520599150,2cyclictest0-21swapper/009:41:210
258002140,2sleep10-21swapper/109:16:351
1521099148,5cyclictest15978-21fschecks_time07:10:203
1521099147,6cyclictest12427-21sshd11:49:083
1521099144,4cyclictest138550irq/27-eth009:53:393
15210991411,2cyclictest20607-21bash11:07:193
1521099140,7cyclictest20017-21cpuspeed_turbos07:20:213
1521099140,6cyclictest0-21swapper/307:25:223
1521099140,12cyclictest16479-21turbostat08:29:553
1520799148,4cyclictest29466-21perl10:25:252
1520799144,1cyclictest0-21swapper/207:35:082
1520799144,1cyclictest0-21swapper/207:35:082
1520799142,11cyclictest138550irq/27-eth007:51:002
1520799141,7cyclictest25655-21sshd12:13:242
1520799141,1cyclictest0-21swapper/208:38:312
1520799140,8cyclictest0-21swapper/208:42:122
1520699141,12cyclictest138550irq/27-eth011:22:451
15206991411,2cyclictest0-21swapper/107:58:501
15206991411,2cyclictest0-21swapper/107:58:491
1520699141,11cyclictest1921-21nscd09:27:281
1520699140,12cyclictest30041-21proc_pri07:40:291
1520699140,12cyclictest2133-21munin-node08:15:181
1520699140,12cyclictest18058-21sshd10:55:211
1520699140,10cyclictest138550irq/27-eth011:17:001
1520599148,5cyclictest0-21swapper/008:37:300
1520599147,6cyclictest1874-21nfsd11:37:030
1520599147,6cyclictest1874-21nfsd11:37:020
1520599144,3cyclictest10950irq/23-ehci_hcd08:20:000
1520599140,13cyclictest0-21swapper/008:40:290
1520599140,13cyclictest0-21swapper/007:45:260
1521099137,5cyclictest0-21swapper/308:37:113
1521099135,6cyclictest32414-21cat09:00:003
1521099131,11cyclictest138550irq/27-eth007:31:053
15210991311,1cyclictest0-21swapper/308:40:243
1521099130,12cyclictest0-21swapper/308:30:213
1521099130,12cyclictest0-21swapper/308:10:373
1521099130,12cyclictest0-21swapper/308:07:433
1521099130,12cyclictest0-21swapper/308:00:593
1521099130,12cyclictest0-21swapper/307:55:303
1521099130,12cyclictest0-21swapper/307:55:303
1521099130,12cyclictest0-21swapper/307:51:083
1521099130,11cyclictest28842-21munin-node07:40:283
1521099130,11cyclictest27059-21sshd09:20:423
1520799135,2cyclictest0-21swapper/207:10:402
1520799134,8cyclictest0-21swapper/207:27:042
1520799131,10cyclictest8588-21memory08:05:292
1520799130,12cyclictest0-21swapper/208:53:252
1520799130,12cyclictest0-21swapper/208:49:572
1520799130,11cyclictest25593-21rt-features07:30:342
1520799130,10cyclictest138550irq/27-eth007:21:362
1520699137,5cyclictest0-21swapper/109:00:361
1520699137,5cyclictest0-21swapper/107:21:371
1520699137,1cyclictest22492-21diskstats10:40:251
1520699130,4cyclictest30939-21iostat08:55:241
1520699130,3cyclictest0-21swapper/108:00:321
1520699130,12cyclictest147450irq/28-eth1-rx-08:40:591
1520699130,12cyclictest0-21swapper/109:06:341
1520699130,12cyclictest0-21swapper/108:50:411
1520699130,12cyclictest0-21swapper/108:45:051
1520699130,12cyclictest0-21swapper/108:27:071
1520699130,12cyclictest0-21swapper/107:46:501
1520699130,12cyclictest0-21swapper/107:38:121
1520699130,12cyclictest0-21swapper/107:38:121
1520699130,12cyclictest0-21swapper/107:32:271
1520699130,12cyclictest0-21swapper/107:25:421
1520699130,11cyclictest8383-21hddtemp_smartct08:05:261
1520699130,11cyclictest19297-21df_inode08:30:221
1520699130,11cyclictest15623-21df07:10:181
1520599137,5cyclictest0-21swapper/008:25:220
1520599137,5cyclictest0-21swapper/007:54:040
1520599132,1cyclictest0-21swapper/008:20:260
1520599130,2cyclictest0-21swapper/012:00:320
1520599130,12cyclictest0-21swapper/009:00:420
1520599130,12cyclictest0-21swapper/008:57:490
1520599130,12cyclictest0-21swapper/007:57:520
1520599130,12cyclictest0-21swapper/007:57:520
1520599130,12cyclictest0-21swapper/007:36:220
1520599130,12cyclictest0-21swapper/007:36:220
1520599130,12cyclictest0-21swapper/007:20:290
1520599130,11cyclictest0-21swapper/007:25:240
1520599130,10cyclictest0-21swapper/008:51:000
1520599130,10cyclictest0-21swapper/008:10:370
1521099128,3cyclictest1876-21nfsd09:05:043
1521099127,3cyclictest0-21swapper/308:15:183
1520699120,3cyclictest11250-21smart_sda08:10:321
1520699120,3cyclictest0-21swapper/108:35:241
1520599122,9cyclictest0-21swapper/007:40:440
1520599120,8cyclictest0-21swapper/007:17:070
1520599120,11cyclictest0-21swapper/009:05:130
1520599120,11cyclictest0-21swapper/007:30:230
1520599120,11cyclictest0-21swapper/007:12:430
1520599120,10cyclictest0-21swapper/008:45:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional