You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-17 - 16:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Mon Jun 17, 2024 12:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
187469225521,29sleep70-21swapper/707:03:437
1875107994745,2cyclictest1913464-21kworker/u16:4+flush-8:007:47:124
1875107994644,2cyclictest2015204-21kworker/u16:4+events_unbound08:10:474
187476924013,8sleep50-21swapper/507:04:455
187472723322,8sleep40-21swapper/407:04:124
1875107993129,2cyclictest2075514-21kworker/u16:0+flush-8:009:15:104
1875108993026,3cyclictest2026043-21kworker/u16:1+flush-8:008:25:395
1875107993028,2cyclictest1996548-21kworker/u16:3+flush-8:008:40:404
1875107993028,2cyclictest1889155-21kworker/u16:1+flush-8:007:50:264
18745642306,8sleep60-21swapper/607:02:066
1875107992725,2cyclictest2436667-21kworker/u16:1+flush-8:012:05:464
1875107992725,2cyclictest2271156-21kworker/u16:2+flush-8:011:30:394
1875107992725,2cyclictest2251208-21kworker/u16:1+flush-8:010:45:364
1875107992624,2cyclictest2271156-21kworker/u16:2+flush-8:010:40:334
1875107992624,2cyclictest2230823-21kworker/u16:3+events_unbound10:11:004
1875107992624,2cyclictest1996548-21kworker/u16:3+events_unbound08:25:404
1875107992624,2cyclictest1947228-21kworker/u16:0+flush-8:008:15:374
1875107992523,2cyclictest2271156-21kworker/u16:2+flush-8:010:25:364
1875107992523,2cyclictest2114777-21kworker/u16:4+flush-8:009:40:104
1875107992522,2cyclictest2026043-21kworker/u16:1+flush-8:009:20:364
1875110992422,1cyclictest0-21swapper/709:10:107
1875107992321,2cyclictest2505542-21kworker/u16:2+flush-8:012:25:304
1875107992321,2cyclictest1996548-21kworker/u16:3+flush-8:008:20:244
1875107992320,3cyclictest2361012-21kworker/u16:0+flush-8:011:45:304
1875107992320,3cyclictest2361012-21kworker/u16:0+flush-8:011:45:304
1875107992220,2cyclictest2310250-21kworker/u16:3+events_unbound10:58:204
1875107992220,2cyclictest2251208-21kworker/u16:1+flush-8:010:30:584
1875107992220,2cyclictest2182562-21kworker/u16:0+flush-8:009:55:384
1875109992117,3cyclictest1996680-21cat08:05:066
1875108992118,2cyclictest1889155-21kworker/u16:1+flush-8:007:30:425
1875108992116,4cyclictest1884829-21latency_hist07:10:115
1875108992114,6cyclictest0-21swapper/512:20:535
1875107992119,2cyclictest2114154-21kworker/u16:3+events_unbound09:19:524
1875107992119,2cyclictest2075514-21kworker/u16:0+flush-8:009:05:404
1875107992119,2cyclictest1936627-21kworker/u16:2+events_unbound07:55:264
187511099200,18cyclictest0-21swapper/711:16:547
1875107992018,2cyclictest2436667-21kworker/u16:1+flush-8:012:30:384
1875107992018,2cyclictest2075746-21kworker/u16:2+flush-8:009:00:314
1875107992016,3cyclictest2104747-21cat09:00:104
1875110991916,2cyclictest0-21swapper/712:00:387
187511099190,18cyclictest0-21swapper/711:59:237
187511099190,17cyclictest0-21swapper/711:45:377
187511099190,17cyclictest0-21swapper/711:45:377
1875109991917,2cyclictest1913464-21kworker/u16:4+flush-8:007:50:116
1875109991915,3cyclictest901-21in:imjournal08:25:116
1875108991915,3cyclictest2514975-21latency_hist12:30:105
1875107991917,2cyclictest2271156-21kworker/u16:2+events_unbound11:55:224
1875107991917,2cyclictest2182562-21kworker/u16:0+events_unbound09:53:564
1875107991917,2cyclictest1996548-21kworker/u16:3+events_unbound08:32:214
1875107991917,2cyclictest1947228-21kworker/u16:0+flush-8:008:00:264
187511099189,8cyclictest0-21swapper/708:27:567
187511099188,9cyclictest0-21swapper/708:10:087
187511099184,6cyclictest0-21swapper/707:43:317
1875107991816,2cyclictest2475713-21kworker/u16:2+flush-8:012:10:304
1875107991816,2cyclictest2271156-21kworker/u16:2+events_unbound11:22:534
1875107991816,2cyclictest2026043-21kworker/u16:1+flush-8:008:45:114
1875107991816,2cyclictest1996548-21kworker/u16:3+flush-8:008:35:394
1875107991816,2cyclictest1889155-21kworker/u16:1+flush-8:007:25:254
1875107991816,2cyclictest1889155-21kworker/u16:1+flush-8:007:25:254
1875107991816,2cyclictest1874593-21kworker/u16:2+events_unbound07:10:124
1875107991816,2cyclictest1854823-21kworker/u16:5+events_unbound07:20:204
1875107991816,2cyclictest1854823-21kworker/u16:5+events_unbound07:20:204
1875107991815,2cyclictest2026043-21kworker/u16:1+flush-8:009:25:234
1875107991813,4cyclictest2446513-21latency_hist11:55:104
1875107991813,4cyclictest2446513-21latency_hist11:55:104
1875110991716,0cyclictest0-21swapper/711:10:277
1875110991716,0cyclictest0-21swapper/709:00:417
187510999174,5cyclictest0-21swapper/612:20:386
1875109991714,2cyclictest889-21gdbus08:10:486
1875109991714,2cyclictest2114154-21kworker/u16:3+flush-8:009:10:406
1875108991714,2cyclictest1135-21snmpd11:26:345
1875108991710,6cyclictest2075514-21kworker/u16:0+flush-8:009:00:365
187510899170,16cyclictest2069199-21grep08:40:325
1875107991715,2cyclictest2290706-21kworker/u16:4+events_unbound11:05:224
1875107991715,2cyclictest2290706-21kworker/u16:4+events_unbound11:00:354
1875107991715,2cyclictest2251208-21kworker/u16:1+events_unbound10:20:314
1875107991715,2cyclictest2230823-21kworker/u16:3+flush-8:010:18:074
1875107991715,2cyclictest2075746-21kworker/u16:2+flush-8:008:50:424
1875107991715,2cyclictest1936627-21kworker/u16:2+flush-8:007:35:274
187511099163,6cyclictest0-21swapper/710:29:567
1875110991615,0cyclictest0-21swapper/708:35:457
187511099160,1cyclictest0-21swapper/710:50:387
187511099160,11cyclictest0-21swapper/709:17:497
1875108991613,2cyclictest899-21ModemManager07:47:075
1875108991613,2cyclictest2347964-21ntpq11:00:415
1875107991614,2cyclictest2436667-21kworker/u16:1+events_unbound12:23:054
1875107991614,2cyclictest2389492-21kworker/u16:3+flush-8:011:25:444
1875107991614,2cyclictest2260985-21kworker/u16:0+flush-8:010:35:214
1875107991614,2cyclictest2026043-21kworker/u16:1+flush-8:009:40:314
1875107991614,2cyclictest1874593-21kworker/u16:2+events_unbound07:15:484
1875107991614,2cyclictest1854823-21kworker/u16:5+events_unbound07:07:284
1875107991613,2cyclictest1996548-21kworker/u16:3+events_unbound08:05:404
187511099157,7cyclictest0-21swapper/707:29:227
187511099157,7cyclictest0-21swapper/707:29:227
187511099153,5cyclictest0-21swapper/710:03:207
187511099152,6cyclictest0-21swapper/710:46:037
1875110991513,1cyclictest0-21swapper/711:50:367
1875110991513,1cyclictest0-21swapper/711:50:367
187511099150,8cyclictest0-21swapper/709:20:347
187510999157,7cyclictest0-21swapper/608:46:246
1875109991513,2cyclictest1889155-21kworker/u16:1+flush-8:007:25:396
1875109991513,2cyclictest1889155-21kworker/u16:1+flush-8:007:25:396
1875109991513,2cyclictest1874593-21kworker/u16:2+flush-8:007:20:346
1875109991513,2cyclictest1874593-21kworker/u16:2+flush-8:007:20:346
1875109991512,2cyclictest1135-21snmpd11:53:106
1875109991512,2cyclictest1135-21snmpd11:53:106
1875108991510,4cyclictest1986955-21latency_hist08:00:115
187510899150,14cyclictest2426150-21/usr/sbin/munin11:40:445
187510799156,8cyclictest0-21swapper/409:30:554
187510799156,8cyclictest0-21swapper/409:30:554
1875107991513,2cyclictest2436667-21kworker/u16:1+events_unbound12:20:054
1875107991513,2cyclictest2436667-21kworker/u16:1+events_unbound12:01:514
1875107991513,2cyclictest2271156-21kworker/u16:2+events_unbound10:53:214
1875107991513,2cyclictest2192354-21kworker/u16:2+events_unbound09:45:344
1875107991513,2cyclictest1953769-21kworker/u16:3+events_unbound07:42:544
1875107991513,2cyclictest1913464-21kworker/u16:4+events_unbound07:32:134
1875110991413,0cyclictest0-21swapper/712:30:417
1875110991413,0cyclictest0-21swapper/712:20:487
1875110991413,0cyclictest0-21swapper/707:20:247
1875110991413,0cyclictest0-21swapper/707:20:247
1875110991412,1cyclictest0-21swapper/707:10:347
1875110991411,2cyclictest0-21swapper/709:11:217
1875110991411,1cyclictest0-21swapper/711:25:257
187511099140,6cyclictest0-21swapper/711:43:047
187510999146,8cyclictest0-21swapper/607:36:376
1875109991410,3cyclictest2485956-21kworker/u16:3+flush-8:012:15:366
1875109991410,3cyclictest1819672-21kworker/u16:0+flush-8:007:10:366
1875108991412,2cyclictest2271156-21kworker/u16:2+events_unbound11:15:105
187510899140,14cyclictest0-21swapper/511:45:375
187510899140,14cyclictest0-21swapper/511:45:375
187510899140,14cyclictest0-21swapper/508:35:105
1875107991412,2cyclictest2398024-21kworker/u16:4+events_unbound11:42:264
1875107991412,2cyclictest2361012-21kworker/u16:0+events_unbound11:38:434
1875107991412,2cyclictest2182562-21kworker/u16:0+events_unbound10:00:334
187511099134,8cyclictest0-21swapper/712:19:597
1875110991312,0cyclictest0-21swapper/707:50:297
1875110991310,2cyclictest0-21swapper/711:23:527
1875110991310,2cyclictest0-21swapper/708:42:247
187511099130,6cyclictest0-21swapper/712:10:477
187511099130,5cyclictest0-21swapper/708:49:577
187511099130,11cyclictest0-21swapper/707:32:137
187511099130,11cyclictest0-21swapper/707:08:037
187510999139,3cyclictest2271943-21cat10:25:266
1875109991310,2cyclictest2271156-21kworker/u16:2+flush-8:011:45:326
1875109991310,2cyclictest2271156-21kworker/u16:2+flush-8:011:45:326
187510999130,5cyclictest0-21swapper/611:40:466
187510899138,4cyclictest2182880-21latency_hist09:40:105
187510899130,1cyclictest0-21swapper/511:50:585
187510899130,1cyclictest0-21swapper/511:50:585
187510899130,13cyclictest0-21swapper/509:05:265
1875107991311,2cyclictest2251208-21kworker/u16:1+events_unbound11:15:124
187511099129,2cyclictest0-21swapper/711:09:547
187511099129,2cyclictest0-21swapper/708:52:277
1875110991211,0cyclictest0-21swapper/708:00:477
187511099120,1cyclictest0-21swapper/712:05:327
187510999129,2cyclictest1135-21snmpd11:59:356
187510999129,2cyclictest1135-21snmpd10:53:156
187510999127,4cyclictest2242663-21cat10:10:286
187510999123,8cyclictest0-21swapper/609:30:256
187510999123,8cyclictest0-21swapper/609:30:256
1875109991211,1cyclictest0-21swapper/609:29:436
1875109991211,1cyclictest0-21swapper/608:06:386
1875109991210,1cyclictest0-21swapper/610:01:086
187510999120,1cyclictest0-21swapper/608:55:406
187510899125,7cyclictest0-21swapper/510:16:325
187510899125,6cyclictest1997835-21hddtemp_smartct08:05:295
1875108991210,2cyclictest27430-21gmain10:58:445
1875108991210,1cyclictest0-21swapper/512:15:325
187510899120,1cyclictest0-21swapper/511:15:495
187510899120,1cyclictest0-21swapper/510:05:115
187510899120,12cyclictest0-21swapper/508:03:195
187510899120,12cyclictest0-21swapper/507:42:315
1875107991210,2cyclictest2251208-21kworker/u16:1+flush-8:011:10:364
187511099118,2cyclictest0-21swapper/709:32:047
187511099118,2cyclictest0-21swapper/709:32:047
1875110991110,0cyclictest0-21swapper/709:45:307
1875110991110,0cyclictest0-21swapper/708:30:417
1875110991110,0cyclictest0-21swapper/708:10:307
1875110991110,0cyclictest0-21swapper/707:55:377
1875110991110,0cyclictest0-21swapper/707:15:507
187511099110,9cyclictest0-21swapper/708:18:177
187511099110,10cyclictest0-21swapper/710:14:147
187511099110,10cyclictest0-21swapper/709:40:417
187510999119,2cyclictest2361012-21kworker/u16:0+events_unbound11:35:246
187510999118,2cyclictest851ktimers/609:05:336
187510999118,2cyclictest1982501-21cut07:55:326
187510999118,2cyclictest1135-21snmpd10:17:476
187510999118,2cyclictest1135-21snmpd09:42:076
187510999117,3cyclictest2475849-21latency_hist12:10:106
187510999117,3cyclictest2340094-21tune2fs11:00:266
1875109991110,1cyclictest0-21swapper/611:27:386
1875109991110,1cyclictest0-21swapper/611:17:236
1875109991110,1cyclictest0-21swapper/610:44:176
1875109991110,1cyclictest0-21swapper/609:01:206
1875109991110,1cyclictest0-21swapper/607:16:296
187510999110,3cyclictest2138656-21cut09:15:276
187510999110,1cyclictest0-21swapper/609:47:506
187510999110,1cyclictest0-21swapper/608:29:106
187510999110,11cyclictest0-21swapper/612:04:416
187510999110,11cyclictest0-21swapper/611:06:406
187510999110,11cyclictest0-21swapper/609:56:406
187510999110,11cyclictest0-21swapper/609:52:156
187510999110,11cyclictest0-21swapper/608:51:056
187510999110,10cyclictest2521399-21kthreadcore12:30:296
187510999110,10cyclictest2367028-21tr11:10:346
187510999110,10cyclictest2281360-21cat10:30:236
187510999110,0cyclictest0-21swapper/611:22:166
187510899118,3cyclictest27129-21gmain12:05:235
187510899118,2cyclictest1135-21snmpd08:14:475
187510899117,3cyclictest2516140-21cat12:30:235
1875108991110,1cyclictest0-21swapper/511:56:205
1875108991110,1cyclictest0-21swapper/511:35:365
1875108991110,1cyclictest0-21swapper/510:33:245
1875108991110,1cyclictest0-21swapper/509:15:135
1875108991110,1cyclictest0-21swapper/508:35:385
1875108991110,1cyclictest0-21swapper/507:22:015
1875108991110,1cyclictest0-21swapper/507:22:015
187510899110,1cyclictest0-21swapper/509:24:025
187510899110,1cyclictest0-21swapper/509:10:195
187510899110,1cyclictest0-21swapper/508:56:085
187510899110,11cyclictest0-21swapper/508:17:025
187510899110,11cyclictest0-21swapper/507:15:055
187510799119,2cyclictest2241190-21kworker/u16:2+events_unbound10:08:284
187511099109,0cyclictest0-21swapper/712:29:407
187511099109,0cyclictest0-21swapper/711:00:337
187511099109,0cyclictest0-21swapper/710:59:307
187511099109,0cyclictest0-21swapper/710:15:267
187511099108,1cyclictest0-21swapper/710:10:047
187511099108,1cyclictest0-21swapper/707:47:087
187511099100,9cyclictest0-21swapper/711:37:287
187511099100,9cyclictest0-21swapper/709:26:227
187511099100,5cyclictest0-21swapper/710:20:417
187511099100,1cyclictest0-21swapper/711:30:307
187510999109,1cyclictest0-21swapper/612:10:596
187510999109,1cyclictest0-21swapper/610:50:076
187510999109,1cyclictest0-21swapper/610:20:576
187510999108,2cyclictest86-21ksoftirqd/612:25:426
187510999107,2cyclictest2173456-21/usr/sbin/munin09:35:426
187510999107,2cyclictest2054979-21kworker/u16:5+flush-8:008:40:106
187510999107,2cyclictest2018151-21kthreadcore08:15:366
187510999106,3cyclictest2300022-21latency_hist10:40:106
187510999105,5cyclictest0-21swapper/608:32:446
187510999100,2cyclictest1877030-21grep07:05:346
187510999100,1cyclictest0-21swapper/608:40:416
187510999100,0cyclictest0-21swapper/607:31:566
187510899109,1cyclictest0-21swapper/512:12:255
187510899109,1cyclictest0-21swapper/510:44:365
187510899109,1cyclictest0-21swapper/510:28:035
187510899109,1cyclictest0-21swapper/509:59:215
187510899109,1cyclictest0-21swapper/509:46:355
187510899109,1cyclictest0-21swapper/508:46:225
187510899109,1cyclictest0-21swapper/507:15:335
187510899108,2cyclictest27430-21gmain10:11:045
187510899107,2cyclictest1135-21snmpd11:05:245
187510899107,2cyclictest1135-21snmpd09:52:595
187510899107,2cyclictest1135-21snmpd07:29:135
187510899107,2cyclictest1135-21snmpd07:29:135
187510899106,3cyclictest2311000-21cat10:45:255
187510899104,5cyclictest26819-21gdbus09:26:355
187510899103,7cyclictest0-21swapper/510:38:245
187510899100,10cyclictest0-21swapper/508:51:155
18751109990,8cyclictest0-21swapper/710:35:277
18751109990,8cyclictest0-21swapper/710:30:437
18751109990,8cyclictest0-21swapper/709:59:267
18751109990,0cyclictest0-21swapper/708:20:377
18751099998,1cyclictest0-21swapper/611:33:006
18751099997,2cyclictest86-21ksoftirqd/607:50:306
18751099990,8cyclictest0-21swapper/610:05:156
18751099990,3cyclictest1947723-21/usr/sbin/munin07:40:426
18751099990,2cyclictest2144157-21/usr/sbin/munin09:20:386
18751089999,0cyclictest0-21swapper/509:33:205
18751089999,0cyclictest0-21swapper/509:33:205
18751089998,1cyclictest0-21swapper/511:21:115
18751089998,1cyclictest0-21swapper/510:50:265
18751089998,1cyclictest0-21swapper/510:01:145
18751089998,1cyclictest0-21swapper/507:37:345
18751089995,3cyclictest2457479-21cat12:00:255
18751089995,3cyclictest2271156-21kworker/u16:2+flush-8:011:30:405
18751089995,3cyclictest2192599-21pool-org.gnome.09:44:455
18751089990,1cyclictest0-21swapper/507:53:275
18751109985,1cyclictest21735832sleep709:35:257
18751109980,7cyclictest0-21swapper/710:40:507
18751109980,7cyclictest0-21swapper/709:50:417
18751109980,0cyclictest0-21swapper/708:58:117
18751109980,0cyclictest0-21swapper/707:35:227
18751099983,4cyclictest2330065-21cat10:55:236
18751089986,1cyclictest0-21swapper/510:20:355
18751089983,4cyclictest2026695-21cat08:20:215
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional