You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-02 - 00:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot0.osadl.org (updated Fri Mar 01, 2024 12:44:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3180021840,1sleep2717199cyclictest11:55:242
1258521440,1sleep01876-21nfsd10:53:540
3198421360,0sleep031985-21sshd11:39:550
1050421360,2sleep31876-21nfsd09:57:033
3171321260,3sleep2717199cyclictest10:27:562
73121170,5sleep0716999cyclictest09:10:270
908321160,2sleep19066-21sshd09:45:221
1437021110,1sleep20-21swapper/209:34:292
944521070,2sleep29447-21sshd12:16:162
805721070,2sleep18056-21sshd11:36:571
6935210534,43sleep10-21swapper/107:09:201
2825521000,2sleep10-21swapper/109:59:131
17402950,1sleep00-21swapper/011:28:210
121352920,2sleep112129-21sshd09:34:121
183592910,0sleep010-21rcuc/010:26:090
27142900,2sleep31921-21nscd09:14:313
680328841,43sleep30-21swapper/307:07:463
191992870,1sleep319189-21sshd11:53:533
220722860,0sleep041ktimersoftd/008:54:590
96452850,1sleep00-21swapper/011:40:590
270502850,2sleep10-21swapper/111:43:091
23742850,1sleep21877-21nfsd12:23:372
90512840,1sleep010-21rcuc/009:49:100
98312830,4sleep20-21swapper/212:00:332
312232830,2sleep10-21swapper/110:31:511
149842830,2sleep30-21swapper/312:13:043
61012790,0sleep041ktimersoftd/009:18:360
218412770,1sleep021839-21bash10:22:370
207962770,1sleep00-21swapper/009:31:220
136882760,4sleep1717099cyclictest11:57:071
324192750,4sleep3717299cyclictest11:47:403
282762730,3sleep2717199cyclictest10:23:272
94472720,2sleep2717199cyclictest11:05:312
189422690,4sleep1717099cyclictest11:02:451
73892680,3sleep2717199cyclictest09:37:222
57852670,1sleep10-21swapper/111:28:501
675026643,11sleep20-21swapper/207:07:052
232962650,3sleep2717199cyclictest12:06:072
44822640,3sleep3717299cyclictest10:48:533
685726033,4sleep00-21swapper/007:08:280
76752580,0sleep3717299cyclictest11:32:573
288102550,2sleep3717299cyclictest12:34:363
160742490,4sleep3717299cyclictest10:17:513
20612460,0sleep12062-21bash10:12:001
272722440,1sleep122-21ksoftirqd/111:47:011
292732360,2sleep329272-21sshd11:04:033
235072340,2sleep223510-21munin-plugin-st11:35:002
129292340,32sleep3138550irq/27-eth009:26:503
204552330,0sleep320458-21sshd11:26:403
717299300,28cyclictest893-21sshd10:40:203
14092300,3sleep2717199cyclictest09:10:332
54032290,2sleep00-21swapper/012:00:070
318292290,2sleep331828-21sshd11:12:173
178222290,2sleep20-21swapper/209:23:432
177652290,1sleep00-21swapper/009:57:560
148952292,25sleep3138550irq/27-eth009:15:483
227102280,1sleep00-21swapper/009:20:290
309482270,4sleep2717199cyclictest10:11:322
121922270,1sleep012190-21sshd11:17:430
109192270,25sleep1138550irq/27-eth012:36:161
716999261,19cyclictest27271-21munin-run07:55:000
36832250,2sleep20-21swapper/210:32:282
298562250,2sleep10-21swapper/110:51:591
247932250,3sleep10-21swapper/110:59:301
216712250,3sleep121672-21bash11:54:111
101762250,1sleep110174-21bash10:17:051
7169992420,3cyclictest0-21swapper/009:40:410
275532240,22sleep1138550irq/27-eth012:14:401
203812240,2sleep320379-21sshd09:38:543
184962240,3sleep10-21swapper/112:21:331
253022230,2sleep325304-21id10:02:523
94202220,2sleep30-21swapper/309:49:133
717099225,14cyclictest11827-21id09:37:531
7170992212,3cyclictest0-21swapper/107:40:011
58752210,4sleep20-21swapper/209:52:362
259772210,0sleep00-21swapper/010:06:580
244632210,18sleep3138550irq/27-eth011:15:223
153862210,1sleep20-21swapper/212:13:082
716999205,9cyclictest0-21swapper/011:55:220
7169992016,3cyclictest3-21ksoftirqd/011:35:000
273592200,3sleep20-21swapper/210:51:402
162682200,1sleep316267-21sshd09:30:503
139512200,0sleep00-21swapper/012:28:560
7170991913,4cyclictest15647-21sshd09:23:281
7169991914,4cyclictest0-21swapper/010:31:580
716999190,1cyclictest11261-21id10:17:130
716999190,10cyclictest0-21swapper/010:49:280
717299180,13cyclictest0-21swapper/312:27:293
717199180,13cyclictest147450irq/28-eth1-rx-07:20:112
7170991812,1cyclictest18820-21sshd10:42:301
717099181,14cyclictest10960-21timerwakeupswit10:45:321
717099180,16cyclictest0-21swapper/107:10:201
717099180,14cyclictest0-21swapper/109:52:541
716999189,8cyclictest3-21ksoftirqd/009:50:120
716999183,13cyclictest3-21ksoftirqd/011:20:240
7169991812,4cyclictest3-21ksoftirqd/012:32:160
716999180,3cyclictest0-21swapper/012:35:410
716999180,16cyclictest27080-21sshd10:59:460
716999180,11cyclictest0-21swapper/010:14:150
716999180,10cyclictest0-21swapper/010:36:260
236492181,15sleep3138550irq/27-eth007:45:253
11412182,14sleep3138550irq/27-eth012:03:323
80732170,1sleep00-21swapper/011:13:220
717199173,7cyclictest0-21swapper/208:53:332
7171991712,3cyclictest1989-21sshd11:04:422
7171991711,5cyclictest0-21swapper/212:27:332
717199171,11cyclictest0-21swapper/207:15:472
717199171,10cyclictest0-21swapper/210:19:472
717099179,1cyclictest27923-21rm10:07:131
717099177,2cyclictest138550irq/27-eth010:04:441
717099171,11cyclictest0-21swapper/109:13:301
716999177,6cyclictest0-21swapper/007:58:170
716999173,13cyclictest0-21swapper/011:01:070
716999170,4cyclictest0-21swapper/008:55:440
716999170,1cyclictest0-21swapper/012:20:400
716999170,16cyclictest14471-21bash10:41:560
716999170,16cyclictest0-21swapper/007:45:470
716999170,15cyclictest0-21swapper/009:38:350
716999170,13cyclictest16588-21bash11:53:330
716999170,10cyclictest0-21swapper/012:18:510
238812170,15sleep3138550irq/27-eth010:51:143
717299167,7cyclictest27368-21sshd12:06:383
717299167,4cyclictest27571-21sshd10:07:103
717299166,3cyclictest0-21swapper/308:40:283
717299162,2cyclictest0-21swapper/310:14:063
717299160,8cyclictest0-21swapper/309:41:013
717299160,5cyclictest14980-21bash09:23:243
717299160,14cyclictest0-21swapper/308:45:183
717299160,12cyclictest11098-21sshd10:33:273
717299160,11cyclictest21291-21bash11:06:583
717199167,7cyclictest0-21swapper/211:22:072
717199163,8cyclictest0-21swapper/209:00:312
717199163,8cyclictest0-21swapper/207:12:292
717199163,10cyclictest0-21swapper/211:48:472
7171991613,2cyclictest0-21swapper/210:58:002
717199161,10cyclictest31714-21sshd09:40:192
717099165,2cyclictest23878-21sshd10:39:071
717099160,4cyclictest4285-21sshd11:16:441
717099160,14cyclictest3051-21bash11:20:371
717099160,14cyclictest0-21swapper/109:05:361
717099160,12cyclictest9589-21sshd10:25:121
717099160,11cyclictest8284-21sshd11:13:241
716999167,8cyclictest0-21swapper/007:30:420
716999167,4cyclictest0-21swapper/007:27:330
716999166,6cyclictest0-21swapper/008:34:540
716999163,12cyclictest0-21swapper/008:09:590
716999162,1cyclictest0-21swapper/010:01:570
7169991612,3cyclictest3-21ksoftirqd/008:20:250
7169991612,3cyclictest30729-21rm11:47:280
716999161,14cyclictest25688-21switchtime09:00:300
716999160,2cyclictest0-21swapper/012:05:490
716999160,15cyclictest0-21swapper/009:29:120
716999160,15cyclictest0-21swapper/007:12:440
716999160,13cyclictest0-21swapper/012:14:290
716999160,10cyclictest0-21swapper/008:50:000
717299159,1cyclictest3527-21hddtemp_smartct12:35:253
717299152,6cyclictest138550irq/27-eth010:55:423
717299152,12cyclictest24815-21sshd12:22:223
717299152,12cyclictest0-21swapper/307:22:253
717299151,2cyclictest24318-21sshd11:35:053
717299151,0cyclictest0-21swapper/310:22:223
717299150,13cyclictest32465-21sshd12:15:163
717299150,13cyclictest0-21swapper/308:35:243
717299150,13cyclictest0-21swapper/308:25:303
717299150,12cyclictest16802-21sshd09:53:573
717199157,7cyclictest0-21swapper/210:47:012
717199153,7cyclictest0-21swapper/209:08:242
717199153,4cyclictest13682-21sshd11:29:482
717199153,11cyclictest0-21swapper/211:41:152
717199152,5cyclictest2116-21sshd11:51:442
717199151,5cyclictest0-21swapper/209:29:512
717199151,4cyclictest138550irq/27-eth008:06:552
7171991513,1cyclictest0-21swapper/210:36:422
7171991511,3cyclictest27275-21awk07:55:002
717199150,4cyclictest0-21swapper/212:30:312
717199150,14cyclictest15468-21sshd10:01:362
717199150,13cyclictest0-21swapper/207:58:232
717099159,1cyclictest2325-21sshd10:20:151
717099159,1cyclictest138550irq/27-eth009:41:441
717099153,3cyclictest15633-21sshd12:17:041
717099151,9cyclictest29923-21cpuspeed_turbos08:00:201
717099151,5cyclictest138550irq/27-eth007:30:431
717099151,13cyclictest13360-21sshd12:05:011
7170991511,3cyclictest10950irq/23-ehci_hcd08:51:511
7170991510,4cyclictest24756-21sshd09:16:571
717099150,3cyclictest13172-21sshd12:00:581
717099150,11cyclictest27602-21sshd11:31:241
717099150,10cyclictest0-21swapper/112:32:381
716999157,7cyclictest0-21swapper/009:05:470
716999157,7cyclictest0-21swapper/008:28:020
716999157,7cyclictest0-21swapper/008:17:410
716999150,1cyclictest0-21swapper/007:21:090
716999150,14cyclictest0-21swapper/011:05:020
716999150,14cyclictest0-21swapper/008:00:340
716999150,12cyclictest0-21swapper/007:43:500
716999150,11cyclictest0-21swapper/008:37:430
187872152,11sleep310950irq/23-ehci_hcd10:26:123
717299147,3cyclictest7628-21sshd11:40:443
717299146,1cyclictest978-21sshd10:36:063
717299140,13cyclictest2506-21bash11:20:323
717299140,12cyclictest1876-21nfsd11:55:573
717199149,4cyclictest27428-21sshd11:19:372
717199149,4cyclictest25216-21sshd11:11:282
717199149,3cyclictest1377-21sshd12:35:142
717199142,3cyclictest22124-21munin-node08:55:192
717199142,11cyclictest5446-21sshd10:08:292
717199142,11cyclictest10566-21bash09:15:222
717199141,1cyclictest0-21swapper/208:48:112
717199141,12cyclictest20227-21sshd11:38:272
717199141,12cyclictest0-21swapper/209:55:252
717199141,11cyclictest4134-21munin-node08:15:282
717199141,10cyclictest138550irq/27-eth007:28:182
717199140,13cyclictest0-21swapper/209:45:132
717199140,13cyclictest0-21swapper/208:32:512
717099145,1cyclictest0-21swapper/108:11:131
717099140,6cyclictest29740-21bash09:25:061
717099140,2cyclictest0-21swapper/112:25:351
717099140,13cyclictest0-21swapper/111:05:441
717099140,13cyclictest0-21swapper/107:22:591
717099140,10cyclictest138550irq/27-eth008:26:511
716999148,5cyclictest0-21swapper/008:40:330
7169991410,3cyclictest10467-21needreboot07:15:260
716999140,13cyclictest0-21swapper/008:14:040
717299139,3cyclictest138550irq/27-eth008:10:373
717299137,5cyclictest0-21swapper/307:37:343
717299137,1cyclictest0-21swapper/308:50:333
7172991311,1cyclictest0-21swapper/307:56:043
7172991311,1cyclictest0-21swapper/307:54:523
7172991311,1cyclictest0-21swapper/307:15:233
717299130,5cyclictest0-21swapper/307:28:053
717299130,4cyclictest16868-21grep07:30:213
717299130,12cyclictest0-21swapper/309:05:323
717299130,12cyclictest0-21swapper/309:01:383
717299130,12cyclictest0-21swapper/308:30:343
717299130,12cyclictest0-21swapper/308:07:273
717299130,12cyclictest0-21swapper/308:03:203
717299130,12cyclictest0-21swapper/307:42:323
717299130,11cyclictest22124-21munin-node08:55:173
717199139,3cyclictest30392-21perl08:00:222
717199139,3cyclictest21892-21ntp_states07:40:312
717199139,3cyclictest14760-21users08:35:342
717199138,4cyclictest32213-21sshd10:40:112
717199137,5cyclictest0-21swapper/208:25:282
717199137,5cyclictest0-21swapper/208:21:142
717199132,1cyclictest0-21swapper/208:42:212
717199131,4cyclictest18784-21df07:35:222
717199131,11cyclictest3013-21ntp_states08:10:262
717199131,11cyclictest138550irq/27-eth007:30:282
717199130,12cyclictest0-21swapper/207:45:312
717099139,3cyclictest138550irq/27-eth008:40:051
717099136,3cyclictest14396-21munin-node08:35:301
717099133,1cyclictest10557-21nfsd407:15:281
717099132,10cyclictest10950irq/23-ehci_hcd07:46:171
717099130,5cyclictest0-21swapper/107:26:271
717099130,2cyclictest138550irq/27-eth008:55:011
717099130,12cyclictest0-21swapper/108:30:001
717099130,12cyclictest0-21swapper/108:20:371
717099130,12cyclictest0-21swapper/108:15:351
717099130,12cyclictest0-21swapper/107:50:341
717099130,11cyclictest28158-21sh07:55:211
717099130,11cyclictest17897-21df08:45:181
716999137,5cyclictest0-21swapper/007:36:560
717299127,4cyclictest0-21swapper/308:16:423
717299120,3cyclictest7756-21munin-node08:20:323
717299120,10cyclictest0-21swapper/307:10:123
717099120,11cyclictest20919-21munin-node07:40:191
717099120,11cyclictest1877-21nfsd08:06:171
717099120,11cyclictest0-21swapper/109:00:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional