You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-13 - 06:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Feb 12, 2025 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
142022940,0sleep20-21swapper/211:47:152
73322680,0sleep60-21swapper/611:46:316
873725127,8sleep60-21swapper/607:02:196
866624926,8sleep20-21swapper/207:01:192
148702460,0sleep50-21swapper/509:05:165
215082450,0sleep20-21swapper/212:34:002
129112450,0sleep00-21swapper/010:55:150
3512440,0sleep30-21swapper/310:57:513
325202440,0sleep30-21swapper/312:11:593
129742440,0sleep30-21swapper/310:34:523
104392440,0sleep40-21swapper/409:31:024
321572430,0sleep10-21swapper/112:31:431
282852420,0sleep50-21swapper/510:41:035
168992420,2sleep7910699cyclictest12:30:057
872924128,9sleep70-21swapper/707:02:127
862924130,8sleep30-21swapper/307:00:483
25972410,0sleep10-21swapper/110:16:481
883924028,8sleep50-21swapper/507:03:385
879824027,9sleep00-21swapper/007:03:090
879024029,8sleep10-21swapper/107:03:021
642924027,9sleep40-21swapper/406:59:364
16382400,0sleep00-21swapper/012:18:450
130752400,0sleep10-21swapper/110:55:161
103742400,0sleep60-21swapper/611:21:566
199972380,0sleep30-21swapper/312:30:253
9098992217,4cyclictest711-21dbus-daemon09:30:246
136832220,0sleep40-21swapper/412:00:154
222312210,0sleep00-21swapper/009:45:080
32872200,2sleep3907499cyclictest09:38:303
910699190,5cyclictest1133-21sshd12:05:297
910699161,5cyclictest8075-21bash11:14:037
910699161,1cyclictest0-21swapper/711:05:037
9106991514,1cyclictest73-21ksoftirqd/710:08:027
910699151,6cyclictest18638-21bash11:30:217
910699150,5cyclictest28379-21bash11:20:137
910699150,5cyclictest16895-21grepconf.sh10:47:577
910699150,3cyclictest14158-21sshd11:49:427
82442150,0sleep60-21swapper/610:42:486
4122150,0sleep60-21swapper/612:28:366
322662150,0sleep30-21swapper/311:01:433
910699142,1cyclictest0-21swapper/710:54:527
9106991413,1cyclictest73-21ksoftirqd/711:54:557
9106991413,1cyclictest73-21ksoftirqd/709:23:217
9106991413,1cyclictest73-21ksoftirqd/709:10:027
910699141,2cyclictest0-21swapper/710:27:577
910699141,1cyclictest0-21swapper/710:19:487
910699141,0cyclictest0-21swapper/709:56:287
910699140,5cyclictest5215-21grepconf.sh09:26:127
910699140,5cyclictest3706-21sshd09:59:537
910699140,5cyclictest30222-21bash12:01:597
910699140,5cyclictest28398-21bash11:41:597
910699140,5cyclictest15849-21bash11:18:457
910699140,5cyclictest14117-21bash09:39:567
910699140,4cyclictest22241-21sshd11:44:467
909899140,12cyclictest99-21kswapd008:23:376
904799140,4cyclictest0-21swapper/009:58:270
280102140,0sleep327993-21sshd12:14:473
9106991312,1cyclictest73-21ksoftirqd/710:40:207
9106991312,1cyclictest73-21ksoftirqd/710:09:557
910699131,3cyclictest21200-21sshd11:00:247
910699131,3cyclictest0-21swapper/709:36:557
910699131,2cyclictest3436-21id10:16:557
910699131,1cyclictest0-21swapper/709:07:197
910699130,6cyclictest20924-21sshd09:44:577
910699130,5cyclictest6941-21grep12:12:427
910699130,5cyclictest3540-21sshd09:34:277
910699130,5cyclictest11615-21grepconf.sh11:36:347
910699130,4cyclictest482-21grep12:15:137
910699130,1cyclictest73-21ksoftirqd/712:25:267
909899130,3cyclictest7449-21tune2fs10:54:456
909099139,4cyclictest57-21ksoftirqd/512:12:095
908299134,2cyclictest711-21dbus-daemon10:13:244
908299134,2cyclictest711-21dbus-daemon10:05:524
908299134,2cyclictest19447-21bash12:20:354
908299133,2cyclictest711-21dbus-daemon11:47:224
908299133,2cyclictest668-21systemd-logind11:35:154
9074991311,1cyclictest41-21ksoftirqd/311:54:493
9074991311,1cyclictest41-21ksoftirqd/311:40:343
907499131,1cyclictest131rcu_sched11:46:223
907499130,1cyclictest131rcu_sched10:01:403
904799132,5cyclictest19527-21bash11:47:450
159192130,1sleep31-21systemd10:31:003
910699124,2cyclictest73-21ksoftirqd/709:15:227
9106991212,0cyclictest73-21ksoftirqd/711:24:577
910699121,1cyclictest0-21swapper/709:50:467
909899122,4cyclictest18327-21sshd11:44:256
909099126,3cyclictest763-21runrttasks11:09:095
909099124,5cyclictest1640-21sshd11:48:495
908299128,4cyclictest0-21swapper/409:49:424
908299126,5cyclictest10789-21sshd10:51:114
908299124,2cyclictest711-21dbus-daemon10:59:474
908299124,2cyclictest711-21dbus-daemon10:55:034
908299124,2cyclictest7098-21grepconf.sh09:47:334
908299124,2cyclictest597-21grepconf.sh12:31:484
908299124,2cyclictest31579-21sshd11:05:204
908299124,2cyclictest30751-21bash11:55:234
908299124,2cyclictest30475-21bash09:25:144
908299124,2cyclictest23665-21grepconf.sh10:44:414
908299124,1cyclictest9441-21grepconf.sh09:56:104
908299124,1cyclictest8303-21id10:42:484
908299124,1cyclictest7262-21grep10:00:234
908299124,1cyclictest7016-21grep11:21:334
908299123,3cyclictest859-21polkitd09:40:484
908299123,2cyclictest711-21dbus-daemon12:15:234
908299123,2cyclictest29832-21sshd09:08:154
908299123,2cyclictest25011-21grep09:11:404
908299123,2cyclictest13384-21bash11:51:544
908299123,2cyclictest13084-21bash10:26:404
908299123,2cyclictest11787-21cp12:09:504
908299122,2cyclictest859-21polkitd12:24:484
908299122,2cyclictest668-21systemd-logind12:06:054
9082991210,1cyclictest49-21ksoftirqd/410:16:584
908299120,1cyclictest0-21swapper/411:13:164
907499128,2cyclictest41-21ksoftirqd/310:20:503
9074991211,1cyclictest41-21ksoftirqd/311:07:193
9074991210,1cyclictest41-21ksoftirqd/310:04:413
906399121,10cyclictest21040-21kworker/2:010:47:372
905499129,2cyclictest2801-21bash09:34:201
905499129,2cyclictest1-21systemd10:01:371
905499120,1cyclictest30239-21sshd12:21:441
904799122,4cyclictest8537-21sshd10:21:580
904799120,11cyclictest711-21dbus-daemon09:19:340
904799120,1cyclictest0-21swapper/010:39:290
116972120,0sleep20-21swapper/210:51:172
9106991110,1cyclictest73-21ksoftirqd/710:29:337
910699111,9cyclictest11227-21sshd12:19:437
910699111,1cyclictest0-21swapper/710:50:327
909899113,7cyclictest21748-21bash11:00:276
909899112,4cyclictest17768-21grepconf.sh11:26:336
909899112,4cyclictest0-21swapper/611:30:256
909899112,4cyclictest0-21swapper/610:27:516
909899111,4cyclictest2435-21sshd11:55:416
909899111,4cyclictest16037-21grep10:39:276
909899110,5cyclictest30442-21grepconf.sh10:53:436
909899110,10cyclictest711-21dbus-daemon10:15:076
909099114,6cyclictest711-21dbus-daemon11:50:535
908299116,5cyclictest0-21swapper/411:32:014
908299114,1cyclictest4149-21if_em108:54:464
908299114,1cyclictest30851-21bash09:21:184
908299114,1cyclictest28889-21grep09:16:224
908299113,2cyclictest711-21dbus-daemon10:21:014
908299113,2cyclictest32317-21bash10:33:224
908299113,2cyclictest15557-21bash09:35:464
908299113,2cyclictest13669-21grep11:14:424
908299113,2cyclictest12798-21grep11:25:564
908299113,1cyclictest9526-21sshd11:39:534
908299112,2cyclictest711-21dbus-daemon10:34:334
907499119,1cyclictest41-21ksoftirqd/311:52:423
9074991110,1cyclictest41-21ksoftirqd/311:30:293
907499110,2cyclictest31372-21sshd12:02:073
907499110,10cyclictest711-21dbus-daemon10:47:113
906399118,2cyclictest29257-21grepconf.sh10:03:382
906399112,5cyclictest2895-21bash12:12:162
9063991110,1cyclictest33-21ksoftirqd/212:23:082
9063991110,1cyclictest33-21ksoftirqd/212:00:152
906399110,10cyclictest0-21swapper/209:25:192
905499118,2cyclictest13663-21bash09:23:181
905499110,9cyclictest27961-21sshd11:16:151
905499110,10cyclictest0-21swapper/111:41:431
904799117,0cyclictest0-21swapper/010:26:340
904799112,4cyclictest30210-21sshd11:55:200
904799112,4cyclictest0-21swapper/012:19:430
904799111,4cyclictest23196-21sshd10:40:200
151392110,0sleep20-21swapper/211:22:322
121152118,1sleep125-21ksoftirqd/109:27:081
910699101,1cyclictest0-21swapper/707:04:467
910699100,1cyclictest0-21swapper/710:34:497
910699100,1cyclictest0-21swapper/707:29:457
909899109,1cyclictest0-21swapper/609:56:406
909899108,1cyclictest65-21ksoftirqd/610:09:116
909899102,3cyclictest0-21swapper/609:22:006
909899101,3cyclictest0-21swapper/609:52:006
909899100,4cyclictest7757-21grepconf.sh12:19:236
909899100,10cyclictest0-21swapper/612:12:376
909899100,10cyclictest0-21swapper/609:43:546
909899100,1cyclictest0-21swapper/609:13:476
909099107,2cyclictest22036-21sshd11:19:315
909099103,6cyclictest24684-21sshd12:34:205
909099103,1cyclictest8407-21sshd09:56:015
909099101,4cyclictest10766-21sshd11:29:375
909099101,4cyclictest0-21swapper/512:15:295
909099101,3cyclictest29040-21sshd10:03:365
909099100,4cyclictest0-21swapper/511:24:585
908299105,5cyclictest0-21swapper/408:19:504
908299103,2cyclictest0-21swapper/407:30:564
908299101,2cyclictest16990-21wc07:14:524
907499109,1cyclictest41-21ksoftirqd/311:19:053
907499109,1cyclictest41-21ksoftirqd/309:56:273
907499108,1cyclictest41-21ksoftirqd/311:24:463
907499108,1cyclictest41-21ksoftirqd/309:42:003
907499108,1cyclictest41-21ksoftirqd/309:19:373
907499108,1cyclictest41-21ksoftirqd/309:09:433
907499108,1cyclictest41-21ksoftirqd/309:04:463
907499108,1cyclictest24503-21sshd09:49:473
907499107,3cyclictest41-21ksoftirqd/312:26:393
907499104,3cyclictest0-21swapper/310:40:063
907499100,10cyclictest0-21swapper/312:21:183
907499100,10cyclictest0-21swapper/310:14:423
907499100,10cyclictest0-21swapper/309:45:323
906399109,1cyclictest33-21ksoftirqd/211:17:332
906399108,2cyclictest33-21ksoftirqd/210:06:572
906399108,1cyclictest33-21ksoftirqd/212:06:082
906399108,1cyclictest33-21ksoftirqd/211:35:422
906399108,1cyclictest0-21swapper/210:16:052
906399102,5cyclictest13773-21grep09:48:262
906399101,3cyclictest24789-21sshd10:40:332
906399100,10cyclictest0-21swapper/211:54:372
905499100,4cyclictest859-21polkitd11:47:401
905499100,10cyclictest31878-21sshd11:50:521
904799109,1cyclictest0-21swapper/012:13:560
904799109,1cyclictest0-21swapper/009:12:470
904799102,2cyclictest3452-21grepconf.sh10:46:130
904799101,3cyclictest0-21swapper/009:40:220
904799100,9cyclictest0-21swapper/011:40:490
904799100,6cyclictest31283-21rm11:24:310
904799100,4cyclictest31946-21sshd09:37:580
904799100,4cyclictest1-21systemd10:06:190
904799100,10cyclictest0-21swapper/012:30:290
125362100,0sleep10-21swapper/112:13:171
91069991,1cyclictest0-21swapper/708:54:517
91069991,1cyclictest0-21swapper/708:53:417
91069991,1cyclictest0-21swapper/708:39:527
91069991,1cyclictest0-21swapper/708:38:177
91069990,1cyclictest16854-21needreboot08:19:487
90989997,1cyclictest65-21ksoftirqd/609:49:176
90989995,1cyclictest680-21nscd10:44:506
90989992,6cyclictest14703-21bash11:18:376
90989990,9cyclictest0-21swapper/612:22:496
90989990,4cyclictest732-21NetworkManager09:07:376
90989990,4cyclictest11989-21sshd11:49:336
90989990,4cyclictest0-21swapper/611:11:076
90909997,1cyclictest31110-21sshd12:28:255
90909994,4cyclictest3707-21cp09:26:005
90909994,2cyclictest711-21dbus-daemon10:29:255
90909994,2cyclictest668-21systemd-logind11:54:335
90909992,3cyclictest668-21systemd-logind09:35:105
90909992,3cyclictest25061-21sshd10:11:285
90909991,4cyclictest2144-21sshd10:58:055
90909991,3cyclictest24062-21sshd09:41:175
90909991,3cyclictest0-21swapper/510:05:045
90909991,3cyclictest0-21swapper/509:48:505
90909991,2cyclictest1299-21grepconf.sh10:37:355
90909990,9cyclictest0-21swapper/512:04:275
90909990,9cyclictest0-21swapper/510:24:305
90909990,9cyclictest0-21swapper/508:39:495
90909990,8cyclictest0-21swapper/510:52:465
90909990,3cyclictest2333-21grepconf.sh09:12:575
90909990,3cyclictest0-21swapper/509:17:475
90909990,0cyclictest0-21swapper/510:32:425
90829993,1cyclictest763-21runrttasks08:32:324
90749999,0cyclictest0-21swapper/311:34:383
90749998,1cyclictest41-21ksoftirqd/310:11:393
90749997,1cyclictest41-21ksoftirqd/312:04:443
90749997,1cyclictest41-21ksoftirqd/310:51:543
90749997,1cyclictest41-21ksoftirqd/309:32:173
90749997,1cyclictest41-21ksoftirqd/309:24:483
90749994,3cyclictest8603-21sshd11:10:083
90749990,9cyclictest0-21swapper/309:18:443
90639999,0cyclictest0-21swapper/212:15:072
90639998,1cyclictest33-21ksoftirqd/210:37:422
90639998,1cyclictest33-21ksoftirqd/209:32:082
90639998,1cyclictest0-21swapper/209:37:372
90639993,3cyclictest680-21nscd10:54:582
90639993,3cyclictest23491-21grepconf.sh10:19:342
90639993,3cyclictest22051-21id11:00:292
90639993,3cyclictest12171-21sshd10:30:282
90639992,3cyclictest21971-21systemd-cgroups10:11:012
90639990,0cyclictest0-21swapper/211:24:592
90549999,0cyclictest0-21swapper/109:48:221
90549999,0cyclictest0-21swapper/109:09:451
90549998,1cyclictest25-21ksoftirqd/109:14:501
90549998,1cyclictest18586-21sshd11:07:401
90549998,1cyclictest0-21swapper/110:43:521
90549997,1cyclictest28900-21ps12:14:501
90549997,1cyclictest25-21ksoftirqd/111:55:371
90549996,2cyclictest4430-21bash09:09:161
90549990,4cyclictest4065-21sshd11:39:201
90549990,0cyclictest0-21swapper/112:07:251
90549990,0cyclictest0-21swapper/109:58:371
90479999,0cyclictest0-21swapper/009:27:360
90479997,1cyclictest9-21ksoftirqd/011:28:250
90479993,6cyclictest0-21swapper/010:50:060
90479993,6cyclictest0-21swapper/009:52:250
90479992,6cyclictest9932-21sshd12:06:250
90479992,6cyclictest5628-21sshd10:17:130
90479992,3cyclictest30900-21sshd12:24:570
90479991,3cyclictest25768-21sshd11:12:160
90479990,9cyclictest0-21swapper/011:49:580
90479990,8cyclictest21177-21kworker/0:211:04:440
91069981,1cyclictest0-21swapper/708:45:347
91069981,1cyclictest0-21swapper/708:24:497
91069981,1cyclictest0-21swapper/708:04:457
91069981,1cyclictest0-21swapper/708:00:127
91069981,1cyclictest0-21swapper/707:55:187
91069981,1cyclictest0-21swapper/707:45:337
91069981,1cyclictest0-21swapper/707:34:427
91069981,1cyclictest0-21swapper/707:23:227
91069981,1cyclictest0-21swapper/707:10:057
91069981,0cyclictest0-21swapper/708:59:437
91069981,0cyclictest0-21swapper/708:14:437
91069981,0cyclictest0-21swapper/707:16:457
91069980,1cyclictest0-21swapper/708:10:017
91069980,1cyclictest0-21swapper/707:49:477
90989986,1cyclictest65-21ksoftirqd/612:04:346
90989986,1cyclictest0-21swapper/610:02:396
90989985,2cyclictest711-21dbus-daemon09:25:246
90989985,2cyclictest2293-21sshd12:02:276
90989983,3cyclictest0-21swapper/612:31:456
90989982,6cyclictest29024-21sshd10:11:586
90989982,6cyclictest15265-21sshd10:30:556
90909988,0cyclictest0-21swapper/511:01:145
90909988,0cyclictest0-21swapper/508:49:455
90909986,1cyclictest57-21ksoftirqd/511:20:315
90909985,2cyclictest57-21ksoftirqd/507:37:435
90909983,5cyclictest0-21swapper/512:19:415
90909982,6cyclictest0-21swapper/512:05:075
90909981,0cyclictest0-21swapper/511:09:375
90909980,7cyclictest18367-21kworker/5:311:41:335
90909980,7cyclictest13974-21kworker/5:410:15:325
90909980,7cyclictest11856-21kworker/5:009:19:545
90909980,5cyclictest30467-21grepconf.sh09:33:425
90909980,3cyclictest0-21swapper/511:35:345
90909980,3cyclictest0-21swapper/510:46:505
90829988,0cyclictest0-21swapper/408:49:474
90749984,2cyclictest41-21ksoftirqd/311:21:013
90749982,3cyclictest0-21swapper/307:44:313
90749980,5cyclictest3038-21sshd10:25:213
90639988,0cyclictest0-21swapper/209:04:592
90639985,2cyclictest27043-21grep12:24:412
90639985,2cyclictest13282-21grepconf.sh10:26:422
90639983,4cyclictest5826-21grep08:59:322
90639983,2cyclictest0-21swapper/207:46:482
90639982,4cyclictest28696-21sshd11:04:582
90639982,4cyclictest1-21systemd09:49:542
90639982,3cyclictest28738-21sshd09:12:092
90639982,3cyclictest15909-21grepconf.sh09:23:352
90639982,3cyclictest10669-21grepconf.sh11:29:362
90639982,3cyclictest1-21systemd11:43:232
90639982,2cyclictest2787-21sshd11:09:402
90639982,2cyclictest13177-21grepconf.sh11:49:372
90639980,4cyclictest14605-21sshd09:14:332
90639980,0cyclictest0-21swapper/209:41:492
90549988,0cyclictest0-21swapper/112:01:451
90549988,0cyclictest0-21swapper/111:13:211
90549988,0cyclictest0-21swapper/110:12:201
90549986,1cyclictest25-21ksoftirqd/109:35:061
90549985,2cyclictest740-21gdbus11:22:501
90549985,2cyclictest15602-21cp09:52:501
90549985,2cyclictest15543-21rm10:35:131
90549980,7cyclictest8973-21grepconf.sh10:05:011
90549980,0cyclictest0-21swapper/111:24:421
90479988,0cyclictest0-21swapper/009:33:070
90479986,1cyclictest9-21ksoftirqd/010:32:430
90479986,1cyclictest9-21ksoftirqd/010:10:290
90479985,2cyclictest23082-21grepconf.sh11:15:390
90479982,3cyclictest0-21swapper/012:01:270
90479982,1cyclictest18780-21sshd11:30:220
90479981,6cyclictest27957-21bash10:03:270
90479981,4cyclictest861-21gdbus11:02:460
91069976,1cyclictest73-21ksoftirqd/707:39:427
91069971,1cyclictest0-21swapper/708:29:467
91069971,0cyclictest0-21swapper/707:25:157
90989976,1cyclictest0-21swapper/608:59:456
90989975,1cyclictest65-21ksoftirqd/608:56:446
90989975,1cyclictest65-21ksoftirqd/607:52:186
90989975,1cyclictest65-21ksoftirqd/607:16:116
90989974,2cyclictest711-21dbus-daemon11:04:376
90989974,2cyclictest711-21dbus-daemon09:35:046
90989974,2cyclictest17565-21id09:14:496
90989973,3cyclictest29102-21grepconf.sh10:20:196
90989972,1cyclictest26321-21sshd11:34:446
90909974,2cyclictest22780-21bash09:49:415
90909972,1cyclictest0-21swapper/508:31:375
90909972,1cyclictest0-21swapper/507:32:085
90829977,0cyclictest0-21swapper/408:03:364
90829970,1cyclictest0-21swapper/407:06:494
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional