You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-28 - 01:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack5slot0.osadl.org (updated Tue Feb 27, 2024 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3273921370,2sleep22170199cyclictest10:13:452
3273921370,2sleep22170199cyclictest10:13:442
1239021370,2sleep112393-21bash10:47:391
834821220,1sleep20-21swapper/211:53:112
2141329934,43sleep10-21swapper/107:08:491
9412940,2sleep22170199cyclictest11:48:272
200322910,0sleep320031-21sshd11:58:343
42772880,1sleep04271-21sshd10:50:340
323362880,2sleep30-21swapper/310:13:413
323362880,2sleep30-21swapper/310:13:413
2139328633,44sleep30-21swapper/307:08:353
140382850,3sleep10-21swapper/109:18:411
288402840,2sleep228842-21sshd11:01:132
169092840,2sleep20-21swapper/211:07:302
161592830,2sleep12170099cyclictest11:42:161
325922820,2sleep10-21swapper/110:13:441
325922820,2sleep10-21swapper/110:13:431
159222820,1sleep20-21swapper/210:59:502
131592820,2sleep10-21swapper/110:39:401
262842810,2sleep20-21swapper/210:20:592
240852810,1sleep00-21swapper/012:26:040
74322780,2sleep37431-21sshd11:41:113
298262780,2sleep10-21swapper/110:29:391
232942780,1sleep30-21swapper/311:19:503
273192770,2sleep30-21swapper/310:33:183
275852750,2sleep127580-21sshd09:52:481
118582750,1sleep10-21swapper/108:00:001
29812740,4sleep22170199cyclictest11:56:242
320302730,1sleep00-21swapper/011:48:160
174242730,4sleep32170299cyclictest09:35:103
121002730,3sleep02169699cyclictest09:10:070
114582710,1sleep20-21swapper/209:34:252
228362630,3sleep12170099cyclictest10:00:181
2086626234,12sleep20-21swapper/207:05:332
2126425547,4sleep00-21swapper/007:06:550
244542380,3sleep30-21swapper/308:25:263
23612330,2sleep22357-21bash10:05:392
41062312,27sleep2138550irq/27-eth009:53:582
47362300,3sleep20-21swapper/210:18:212
24112290,27sleep228750irq/26-ahci[00012:39:102
2170199294,10cyclictest28750irq/26-ahci[00011:35:212
197612292,25sleep228750irq/26-ahci[00010:44:322
48382280,0sleep00-21swapper/010:14:180
48382280,0sleep00-21swapper/010:14:180
184812280,3sleep20-21swapper/211:42:332
2170199267,9cyclictest138550irq/27-eth012:33:012
197622260,2sleep20-21swapper/209:19:262
61322250,22sleep2138550irq/27-eth011:17:452
239652250,3sleep30-21swapper/309:27:533
268592240,1sleep010-21rcuc/012:03:160
263112240,0sleep00-21swapper/011:31:410
21696992421,2cyclictest31621-21sshd09:40:570
21696992421,2cyclictest31621-21sshd09:40:560
189092240,2sleep00-21swapper/010:44:240
295232230,2sleep11876-21nfsd09:57:001
267472230,2sleep326746-21bash11:31:443
2170199236,10cyclictest10950irq/23-ehci_hcd10:34:032
322912220,3sleep20-21swapper/209:12:422
2170199228,12cyclictest27854-21sshd11:12:382
2170199221,4cyclictest0-21swapper/208:33:052
201052221,19sleep2138550irq/27-eth012:06:152
71382210,1sleep00-21swapper/012:39:420
56122210,4sleep22170199cyclictest12:23:582
47152210,2sleep14708-21sshd12:00:311
2170199218,11cyclictest5356-21sshd10:02:032
2170199214,9cyclictest138550irq/27-eth012:13:262
2170199212,2cyclictest0-21swapper/209:25:562
2170199210,5cyclictest0-21swapper/210:25:202
2170199210,19cyclictest0-21swapper/207:25:262
165702210,2sleep216567-21sshd09:43:162
165702210,2sleep216567-21sshd09:43:152
101622210,2sleep20-21swapper/210:51:192
8712203,15sleep310950irq/23-ehci_hcd12:07:523
241362200,0sleep124134-21bash12:18:191
2170199207,11cyclictest6930-21chrt07:46:392
2170199206,12cyclictest8589-21sshd09:38:122
2170199203,2cyclictest0-21swapper/212:02:292
2170199203,1cyclictest0-21swapper/210:36:232
2170199200,5cyclictest0-21swapper/212:25:332
2170199200,3cyclictest0-21swapper/212:15:242
2170199200,2cyclictest0-21swapper/211:22:402
2170199200,14cyclictest0-21swapper/207:15:472
2169699200,15cyclictest0-21swapper/010:02:240
58182190,3sleep30-21swapper/310:50:453
2170199196,11cyclictest11646-21sshd09:46:472
2170199196,11cyclictest11646-21sshd09:46:462
2170199195,11cyclictest138550irq/27-eth007:20:302
2170199193,0cyclictest0-21swapper/210:45:222
2170199190,2cyclictest0-21swapper/211:26:012
2170199190,2cyclictest0-21swapper/209:24:082
2170199190,2cyclictest0-21swapper/207:55:302
2170199190,2cyclictest0-21swapper/207:40:282
2170199190,2cyclictest0-21swapper/207:35:272
2170199190,18cyclictest0-21swapper/211:30:012
2170199190,17cyclictest0-21swapper/208:20:232
2169699190,14cyclictest11154-21cp12:20:340
136792190,17sleep1138550irq/27-eth010:43:461
2170199182,5cyclictest0-21swapper/207:14:192
2170199180,9cyclictest0-21swapper/208:05:192
2170199180,9cyclictest0-21swapper/208:02:242
2170199180,17cyclictest0-21swapper/208:45:322
2170199180,17cyclictest0-21swapper/208:42:432
2170199180,17cyclictest0-21swapper/208:38:002
2170199180,17cyclictest0-21swapper/208:17:112
2170199180,16cyclictest0-21swapper/209:56:422
2170199180,16cyclictest0-21swapper/208:55:232
2170199180,15cyclictest0-21swapper/209:04:192
2169699180,2cyclictest0-21swapper/010:19:140
2170299171,15cyclictest0-21swapper/309:40:213
2170299171,15cyclictest0-21swapper/309:40:213
2170199170,9cyclictest0-21swapper/207:31:012
2170199170,8cyclictest0-21swapper/209:05:542
2170199170,1cyclictest0-21swapper/208:50:282
2170199170,1cyclictest0-21swapper/208:25:232
2170199170,1cyclictest0-21swapper/208:14:542
2170199170,0cyclictest0-21swapper/207:52:002
2170099174,4cyclictest445-21jbd2/dm-0-812:12:311
21700991712,4cyclictest22932-21sshd11:58:561
2170099171,1cyclictest0-21swapper/109:20:521
2169699173,2cyclictest0-21swapper/012:09:440
2169699171,11cyclictest0-21swapper/010:38:360
2169699170,4cyclictest0-21swapper/011:08:210
2169699170,15cyclictest6440-21cp12:31:470
2169699170,14cyclictest0-21swapper/011:04:540
129582170,0sleep00-21swapper/011:18:340
2170299163,8cyclictest18342-21bash12:25:263
2170299161,6cyclictest0-21swapper/309:17:173
2170299161,6cyclictest0-21swapper/308:12:293
21702991614,1cyclictest0-21swapper/310:02:413
21702991612,3cyclictest16314-21sshd12:13:333
21702991612,3cyclictest10950irq/23-ehci_hcd10:08:383
2170299161,13cyclictest0-21swapper/310:20:113
2170299160,14cyclictest0-21swapper/310:40:093
2170099166,1cyclictest0-21swapper/108:53:261
2170099165,10cyclictest8441-21bash11:53:131
21700991612,2cyclictest0-21swapper/111:30:391
2170099160,1cyclictest0-21swapper/110:58:501
2170099160,1cyclictest0-21swapper/109:27:311
2170099160,11cyclictest1877-21nfsd12:05:281
2169699169,2cyclictest30235-21kworker/0:111:38:440
2169699168,4cyclictest0-21swapper/010:29:470
2169699167,5cyclictest0-21swapper/011:25:100
2169699165,1cyclictest0-21swapper/011:57:320
2169699161,7cyclictest0-21swapper/009:22:050
2169699160,7cyclictest0-21swapper/009:15:480
2169699160,4cyclictest28532-21sshd10:09:080
2169699160,4cyclictest26806-21sshd10:45:220
2169699160,15cyclictest6848-21sshd09:25:400
140312160,3sleep10-21swapper/112:20:561
308702150,2sleep10-21swapper/109:45:031
308702150,2sleep10-21swapper/109:45:021
264642150,1sleep10-21swapper/111:27:531
217832151,3sleep10-21swapper/110:16:211
2170299153,10cyclictest18662-21sshd09:23:183
2170299152,11cyclictest4497-21sshd12:35:273
2170299151,13cyclictest0-21swapper/311:53:013
2170299151,13cyclictest0-21swapper/310:46:473
21702991510,4cyclictest2920-21sshd09:57:453
2170299150,14cyclictest11279-21sshd11:03:023
2170299150,14cyclictest0-21swapper/310:36:543
2170299150,13cyclictest11459-21sshd09:30:213
2170099159,5cyclictest28230-21sshd11:05:031
2170099157,2cyclictest0-21swapper/107:50:301
2170099154,5cyclictest0-21swapper/110:22:021
2170099153,8cyclictest5454-21sshd09:33:371
2170099153,3cyclictest2363-21iostat_ios10:50:231
21700991512,2cyclictest0-21swapper/110:09:341
21700991511,3cyclictest138550irq/27-eth012:32:341
2170099150,1cyclictest29716-21sshd09:40:411
2170099150,1cyclictest29716-21sshd09:40:411
2170099150,14cyclictest0-21swapper/111:02:391
2170099150,13cyclictest511-21bash10:34:021
2170099150,13cyclictest0-21swapper/112:35:301
2170099150,13cyclictest0-21swapper/111:35:111
2170099150,11cyclictest29928-21sshd11:16:421
2169699158,3cyclictest9772-21memory09:05:260
2169699157,5cyclictest0-21swapper/008:29:490
2169699157,4cyclictest0-21swapper/010:33:450
2169699156,1cyclictest2592-21sshd12:11:520
2169699153,2cyclictest0-21swapper/009:33:320
2169699150,1cyclictest0-21swapper/011:44:350
2169699150,14cyclictest0-21swapper/011:11:390
2169699150,14cyclictest0-21swapper/007:51:120
2169699150,12cyclictest10810-21sshd11:53:290
2169699150,11cyclictest0-21swapper/009:56:080
2169699150,11cyclictest0-21swapper/008:15:180
2170299148,5cyclictest1874-21nfsd12:31:513
2170299148,5cyclictest138550irq/27-eth009:50:063
2170299144,9cyclictest1987-21sshd12:01:223
2170299142,3cyclictest19510-21sshd10:16:033
2170299142,10cyclictest804-21bash11:20:533
2170299141,4cyclictest0-21swapper/311:25:353
21702991412,1cyclictest0-21swapper/312:18:503
2170299141,12cyclictest0-21swapper/309:46:463
2170299141,12cyclictest0-21swapper/309:46:453
2170299141,11cyclictest0-21swapper/311:35:093
21702991410,3cyclictest16778-21sshd10:55:583
21702991410,3cyclictest13484-21sshd12:20:513
21702991410,0cyclictest0-21swapper/310:28:503
2170299140,5cyclictest28740-21cpuspeed_turbos07:25:203
2170299140,13cyclictest6326-21munin-node07:45:313
2170299140,13cyclictest14230-21munin-node08:05:343
2170099149,4cyclictest138550irq/27-eth011:12:241
2170099147,6cyclictest0-21swapper/108:10:181
2170099144,2cyclictest0-21swapper/109:10:141
2170099143,10cyclictest0-21swapper/109:04:291
21700991411,2cyclictest10950irq/23-ehci_hcd08:59:471
2170099140,8cyclictest0-21swapper/111:20:351
2170099140,13cyclictest27238-21sshd11:47:411
2170099140,13cyclictest0-21swapper/108:34:221
2169699148,5cyclictest0-21swapper/008:40:080
2169699146,4cyclictest0-21swapper/010:55:310
2169699143,6cyclictest1407-21sshd11:20:570
2169699142,11cyclictest0-21swapper/009:46:490
2169699142,11cyclictest0-21swapper/009:46:480
2169699141,10cyclictest0-21swapper/012:15:250
2169699140,9cyclictest10843-21bash09:54:460
2169699140,5cyclictest0-21swapper/008:35:300
2169699140,3cyclictest16593-21sshd10:23:570
2169699140,3cyclictest0-21swapper/007:28:580
2169699140,13cyclictest0-21swapper/007:18:020
2169699140,12cyclictest0-21swapper/009:35:280
17162142,11sleep1138550irq/27-eth008:48:411
2170299132,3cyclictest138550irq/27-eth008:00:483
2170299131,3cyclictest0-21swapper/311:10:193
2170299131,3cyclictest0-21swapper/308:20:273
2170299131,11cyclictest0-21swapper/308:47:513
2170299130,5cyclictest1877-21nfsd07:57:033
2170299130,4cyclictest2121-21runrttasks08:36:503
2170299130,3cyclictest8476-21bash11:45:193
2170299130,2cyclictest138550irq/27-eth007:50:313
2170299130,12cyclictest138550irq/27-eth008:16:553
2170299130,12cyclictest0-21swapper/309:09:323
2170299130,12cyclictest0-21swapper/308:50:133
2170299130,12cyclictest0-21swapper/308:40:093
2170299130,12cyclictest0-21swapper/307:40:103
2170299130,12cyclictest0-21swapper/307:30:203
2170299130,12cyclictest0-21swapper/307:19:473
2170299130,11cyclictest28366-21sshd11:05:053
2170299130,11cyclictest27044-21iostat07:20:243
2170299130,11cyclictest1271-21hddtemp_smartct07:35:233
2170299130,11cyclictest11720-21sshd09:10:043
2170099139,3cyclictest29143-21timerandwakeup08:35:321
2170099139,3cyclictest138550irq/27-eth007:15:151
21700991311,1cyclictest0-21swapper/107:12:351
2170099130,5cyclictest4910-21chrt07:44:341
2170099130,4cyclictest20689-21sshd09:35:361
2170099130,12cyclictest23156-21sshd12:25:571
2170099130,12cyclictest1876-21nfsd08:28:351
2170099130,12cyclictest10950irq/23-ehci_hcd07:30:301
2170099130,12cyclictest0-21swapper/109:08:201
2170099130,12cyclictest0-21swapper/108:44:051
2170099130,12cyclictest0-21swapper/108:20:281
2170099130,12cyclictest0-21swapper/108:01:121
2170099130,12cyclictest0-21swapper/107:37:441
2169699138,4cyclictest0-21swapper/008:55:250
2169699137,5cyclictest0-21swapper/008:01:350
2169699137,5cyclictest0-21swapper/007:13:200
2169699133,2cyclictest0-21swapper/008:09:530
2169699131,8cyclictest0-21swapper/008:50:200
2169699130,9cyclictest0-21swapper/007:20:200
2169699130,8cyclictest0-21swapper/007:35:300
2169699130,5cyclictest6137-21munin-node07:45:300
2169699130,12cyclictest0-21swapper/009:04:370
2169699130,12cyclictest0-21swapper/008:32:560
2169699130,12cyclictest0-21swapper/007:59:270
2169699130,12cyclictest0-21swapper/007:40:280
2170299128,3cyclictest0-21swapper/308:30:263
2170299120,3cyclictest7387-21iostat09:00:263
2170299120,3cyclictest5131-21iostat_ios08:55:243
2170299120,10cyclictest22127-21diskstats07:10:183
2170099120,4cyclictest0-21swapper/108:15:281
2170099120,3cyclictest6300-21ntp_kernel_err07:45:321
2170099120,11cyclictest28562-21munin-node07:25:381
2170099120,11cyclictest2121-21runrttasks07:21:211
2170099120,11cyclictest0-21swapper/108:05:401
2169699120,11cyclictest0-21swapper/008:20:030
2169699110,3cyclictest0-21swapper/008:45:080
2169699110,3cyclictest0-21swapper/007:33:150
2169699110,1cyclictest0-21swapper/008:10:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional