You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 16:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Nov 03, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1124421490,2sleep3507999cyclictest12:12:033
1028121280,1sleep2507599cyclictest10:43:482
2102321180,1sleep20-21swapper/211:49:502
1222021100,2sleep30-21swapper/311:56:353
3018121010,0sleep00-21swapper/011:23:460
3018121010,0sleep00-21swapper/011:23:460
2923721000,2sleep30-21swapper/311:50:383
2643621000,3sleep30-21swapper/310:41:533
213272960,2sleep20-21swapper/211:33:502
189922940,1sleep10-21swapper/111:02:031
122132940,0sleep00-21swapper/012:20:100
289562910,3sleep00-21swapper/010:59:460
253132910,0sleep00-21swapper/011:38:250
234572880,2sleep20-21swapper/210:24:202
67612870,4sleep3507999cyclictest12:31:183
109892870,2sleep310990-21bash10:00:013
140242840,1sleep03-21ksoftirqd/011:01:300
38702820,2sleep20-21swapper/209:59:082
247432820,2sleep20-21swapper/209:48:012
453828133,44sleep10-21swapper/107:06:091
448028134,43sleep30-21swapper/307:05:283
294952810,2sleep00-21swapper/011:10:120
193882810,3sleep20-21swapper/209:16:262
192532810,0sleep00-21swapper/010:34:130
192332810,1sleep21848-21nfsd10:17:062
63902800,1sleep00-21swapper/012:31:160
307112790,2sleep330710-21sshd11:20:203
307112790,2sleep330710-21sshd11:20:203
214662790,2sleep321468-21sshd11:09:193
204782790,2sleep320475-21sshd11:26:023
204782790,2sleep320475-21sshd11:26:013
156812790,1sleep20-21swapper/210:54:512
10772780,5sleep1506999cyclictest10:18:431
98742770,1sleep10-21swapper/112:27:441
186882770,2sleep30-21swapper/309:50:353
213112750,0sleep00-21swapper/009:34:240
10882750,2sleep20-21swapper/209:39:042
221862740,1sleep30-21swapper/312:36:523
186122740,1sleep10-21swapper/110:04:001
93502730,3sleep2507599cyclictest11:56:152
310722730,2sleep30-21swapper/311:39:093
229732730,1sleep322971-21sshd11:34:043
279012710,1sleep127895-21sshd11:46:321
124562710,2sleep10-21swapper/107:25:131
124312710,2sleep20-21swapper/210:36:512
215202700,1sleep20-21swapper/209:27:222
155082690,1sleep00-21swapper/012:04:550
9362680,3sleep0506899cyclictest09:21:300
460625934,13sleep00-21swapper/007:07:000
83062580,3sleep3507999cyclictest12:00:093
506899580,57cyclictest11613-21cp11:52:350
506899580,20cyclictest26185-21id10:49:030
301352560,0sleep10-21swapper/110:52:531
5068995528,22cyclictest27949-21sshd11:30:310
506899530,19cyclictest26826-21sshd11:58:260
474125237,11sleep20-21swapper/207:08:432
506899500,26cyclictest1959-21sshd11:18:590
178332500,0sleep117831-21bash10:20:231
506899490,46cyclictest1847-21nfsd12:16:070
506899490,37cyclictest10381-21sshd10:54:160
506899487,39cyclictest26521-21sshd10:08:040
506899480,38cyclictest26721-21sshd12:37:230
506899480,36cyclictest1847-21nfsd12:12:550
506899480,23cyclictest27070-21sshd10:35:020
506899471,43cyclictest27267-21sshd11:06:220
506899470,27cyclictest0-21swapper/012:28:580
506899461,37cyclictest16578-21sshd12:05:010
506899460,42cyclictest1847-21nfsd11:29:570
506899460,42cyclictest1847-21nfsd11:29:570
506899460,40cyclictest32269-21bash11:43:100
98982450,1sleep10-21swapper/109:19:021
5068994510,28cyclictest1959-21sshd10:14:580
506899450,21cyclictest2494-21sshd11:47:270
148742450,43sleep3135650irq/27-eth009:40:253
506899411,37cyclictest19243-21sshd09:54:070
506899393,27cyclictest10950irq/23-ehci_hcd09:37:310
506899390,26cyclictest30209-21sshd09:17:400
506899384,30cyclictest3585-21sshd09:14:540
506899380,31cyclictest0-21swapper/010:41:330
506899361,25cyclictest0-21swapper/010:15:110
506899360,34cyclictest1848-21nfsd10:23:580
506899360,33cyclictest23667-21sshd09:44:450
506899360,33cyclictest20732-21sshd10:27:280
506899351,31cyclictest0-21swapper/009:29:560
5069993316,7cyclictest20837-21sshd12:05:241
506899330,31cyclictest30135-21bash09:55:120
322472330,2sleep122-21ksoftirqd/110:42:351
118922331,28sleep1135650irq/27-eth012:16:021
295602320,30sleep1135650irq/27-eth010:05:091
5075993027,2cyclictest0-21swapper/212:23:272
102202300,28sleep1135650irq/27-eth010:26:201
506899290,25cyclictest4707-21bash10:02:340
75122280,3sleep30-21swapper/309:11:203
5068992722,4cyclictest18578-21sleep07:40:010
168312270,5sleep1506999cyclictest09:50:241
5079992611,4cyclictest0-21swapper/310:55:123
5069992612,4cyclictest0-21swapper/111:06:141
5069992610,7cyclictest22-21ksoftirqd/112:10:091
295452260,2sleep229536-21sshd11:13:382
283092260,2sleep20-21swapper/210:56:062
75322250,4sleep1506999cyclictest11:18:021
5069992521,3cyclictest0-21swapper/111:56:341
5069992518,4cyclictest36-21rcuop/212:31:371
5069992514,8cyclictest6499-21id11:28:071
5069992514,8cyclictest6499-21id11:28:071
506899255,19cyclictest0-21swapper/007:15:180
506899250,22cyclictest10998-21sshd09:49:580
32152250,2sleep10-21swapper/110:46:281
5075992311,4cyclictest0-21swapper/211:06:242
506999235,2cyclictest1847-21nfsd11:30:501
506999233,17cyclictest22-21ksoftirqd/112:36:501
5069992315,5cyclictest23338-21bash10:59:071
189072230,2sleep30-21swapper/310:10:263
62752220,19sleep3135650irq/27-eth010:50:193
5075992215,4cyclictest14099-21sshd10:47:432
5075992214,4cyclictest5583-21bash12:35:052
5075992212,4cyclictest36-21rcuop/212:32:452
5075992210,6cyclictest10950irq/23-ehci_hcd11:03:032
506999228,3cyclictest10950irq/23-ehci_hcd09:38:251
506999223,17cyclictest22-21ksoftirqd/112:21:171
5069992213,3cyclictest22-21ksoftirqd/111:52:131
506999221,12cyclictest22-21ksoftirqd/111:35:211
88052210,5sleep3135650irq/27-eth010:36:243
507999219,6cyclictest135650irq/27-eth009:21:383
5079992110,2cyclictest18205-21sshd11:19:093
507999210,11cyclictest1846-21nfsd11:10:223
5075992112,7cyclictest23968-21bash11:54:122
5075992112,7cyclictest19784-21bash12:17:032
506999214,15cyclictest22-21ksoftirqd/111:20:171
506999214,15cyclictest22-21ksoftirqd/111:20:171
5069992116,3cyclictest22-21ksoftirqd/109:57:111
5069992114,4cyclictest28894-21bash11:13:341
5069992110,10cyclictest22-21ksoftirqd/110:30:361
506999210,14cyclictest22-21ksoftirqd/112:01:531
506899212,17cyclictest14012-21munin-run07:30:010
506899210,13cyclictest10608-21munin-node08:30:250
153402210,19sleep1135650irq/27-eth010:10:141
137832210,4sleep2507599cyclictest11:44:572
5079992012,2cyclictest135650irq/27-eth012:29:403
507999201,15cyclictest8883-21sshd12:15:383
5075992015,3cyclictest20797-21sshd11:26:042
5075992015,3cyclictest20797-21sshd11:26:032
5075992014,3cyclictest12294-21sshd09:50:052
5075992013,5cyclictest1848-21nfsd12:06:282
506999205,5cyclictest22-21ksoftirqd/109:32:381
5069992015,3cyclictest18122-21munin-run08:49:591
5069992011,5cyclictest27064-21sshd09:41:431
5069992010,9cyclictest22-21ksoftirqd/111:41:341
506899200,18cyclictest0-21swapper/007:20:140
506899200,12cyclictest27155-21grep07:55:240
506899200,11cyclictest540-21fschecks_time08:10:160
507999190,14cyclictest30896-21sshd10:28:333
507599196,6cyclictest10950irq/23-ehci_hcd10:11:122
5075991915,2cyclictest32457-21sshd09:32:062
5075991914,3cyclictest29851-21sshd11:20:172
5075991914,3cyclictest29851-21sshd11:20:172
5075991914,3cyclictest21121-21sshd10:30:512
5075991911,3cyclictest1847-21nfsd10:09:202
5075991910,6cyclictest22625-21bash11:16:122
507599190,6cyclictest28836-21sshd12:26:012
507599190,16cyclictest33-21ksoftirqd/212:00:512
506899190,18cyclictest23948-21nfsd409:00:180
506899190,18cyclictest16539-21tune2fs08:45:140
506899190,18cyclictest0-21swapper/008:50:170
506899190,18cyclictest0-21swapper/008:44:090
104452190,2sleep30-21swapper/309:29:433
507999183,3cyclictest29258-21sshd11:42:473
5079991814,3cyclictest135650irq/27-eth010:46:493
507999180,3cyclictest14970-21sshd09:37:013
507999180,16cyclictest21494-21sshd11:45:423
507999180,16cyclictest0-21swapper/308:40:193
507999180,15cyclictest0-21swapper/311:01:553
507999180,13cyclictest0-21swapper/307:57:343
5075991814,2cyclictest1847-21nfsd11:35:392
5075991814,2cyclictest135650irq/27-eth009:20:422
5075991813,3cyclictest3929-21sshd12:11:072
5075991812,4cyclictest15161-21sshd09:43:522
5069991814,2cyclictest1847-21nfsd09:29:201
5069991813,4cyclictest22-21ksoftirqd/109:22:301
5069991810,5cyclictest14305-21sshd10:37:031
506899180,17cyclictest28867-21needreboot08:00:180
506899180,16cyclictest24014-21munin-node07:50:140
506899180,16cyclictest21399-21df07:45:150
506899180,15cyclictest0-21swapper/008:05:230
506899180,13cyclictest0-21swapper/008:55:310
506899180,11cyclictest9049-21cat08:29:590
507999177,3cyclictest1845-21nfsd10:21:443
507999174,2cyclictest18563-21sshd10:07:153
507999171,13cyclictest1959-21sshd10:18:093
5079991710,6cyclictest10950irq/23-ehci_hcd12:21:353
5079991710,2cyclictest10950irq/23-ehci_hcd12:05:023
507599171,8cyclictest135650irq/27-eth007:21:012
5075991714,2cyclictest0-21swapper/209:13:242
5069991713,3cyclictest31113-21sshd09:14:191
5069991713,2cyclictest0-21swapper/109:45:211
506899170,8cyclictest10950irq/23-ehci_hcd07:30:140
506899170,16cyclictest12195-21munin-node08:35:170
506899170,13cyclictest5606-21tune2fs07:10:140
507999162,1cyclictest7476-21sshd09:15:153
507999161,14cyclictest32095-21sshd09:32:023
507999160,14cyclictest32663-21sshd09:45:303
507999160,11cyclictest135650irq/27-eth010:32:533
507599162,11cyclictest135650irq/27-eth008:28:062
5069991612,3cyclictest10950irq/23-ehci_hcd07:41:411
506999160,14cyclictest231072sleep107:50:021
506899167,6cyclictest0-21swapper/008:20:240
506899160,8cyclictest3153-21gawk08:15:140
506899160,15cyclictest0-21swapper/009:05:500
506899160,15cyclictest0-21swapper/007:40:230
126612161,13sleep2135650irq/27-eth007:25:142
507999158,5cyclictest12455-21fschecks_time07:25:123
507999150,14cyclictest30728-21sshd10:01:553
5075991512,2cyclictest23701-21sshd10:27:472
5075991511,3cyclictest10950irq/23-ehci_hcd08:19:202
507599150,9cyclictest0-21swapper/207:14:192
507599150,13cyclictest0-21swapper/210:01:252
506999157,6cyclictest0-21swapper/108:30:181
506999156,5cyclictest10950irq/23-ehci_hcd08:40:141
5069991511,3cyclictest10950irq/23-ehci_hcd07:38:521
506999150,13cyclictest0-21swapper/109:02:181
506999150,13cyclictest0-21swapper/108:17:591
507999148,5cyclictest0-21swapper/308:04:523
507999147,6cyclictest0-21swapper/308:45:133
5079991410,3cyclictest10950irq/23-ehci_hcd08:05:433
507999140,12cyclictest20649-21seq07:42:463
507999140,10cyclictest0-21swapper/309:05:413
5075991410,2cyclictest0-21swapper/208:00:172
507599140,5cyclictest0-21swapper/209:00:162
507599140,5cyclictest0-21swapper/207:46:192
507599140,11cyclictest0-21swapper/207:15:252
506999148,5cyclictest1848-21nfsd07:24:171
506999143,10cyclictest10950irq/23-ehci_hcd08:06:551
506999140,11cyclictest0-21swapper/108:40:001
506999140,11cyclictest0-21swapper/107:46:151
507999139,3cyclictest10950irq/23-ehci_hcd07:21:423
507999137,5cyclictest0-21swapper/308:57:463
507999137,4cyclictest24130-21uname07:50:173
507999132,3cyclictest10950irq/23-ehci_hcd08:51:213
507999130,5cyclictest0-21swapper/309:03:583
507999130,5cyclictest0-21swapper/308:20:003
507999130,4cyclictest9228-21munin-node08:30:193
507999130,12cyclictest135650irq/27-eth007:45:043
507999130,12cyclictest0-21swapper/308:35:343
507999130,12cyclictest0-21swapper/308:25:563
507999130,12cyclictest0-21swapper/308:17:053
507999130,12cyclictest0-21swapper/308:12:473
507999130,12cyclictest0-21swapper/307:36:153
507999130,12cyclictest0-21swapper/307:32:033
507999130,12cyclictest0-21swapper/307:15:343
507599135,5cyclictest10950irq/23-ehci_hcd07:35:132
507599133,9cyclictest0-21swapper/208:14:072
507599131,1cyclictest0-21swapper/208:40:202
5075991311,1cyclictest0-21swapper/208:09:162
5075991311,1cyclictest0-21swapper/207:30:162
507599130,12cyclictest0-21swapper/208:53:592
507599130,12cyclictest0-21swapper/208:45:522
507599130,12cyclictest0-21swapper/207:53:212
507599130,12cyclictest0-21swapper/207:40:592
507599130,10cyclictest25887-21df07:55:142
507599130,10cyclictest10950irq/23-ehci_hcd08:55:152
506999137,5cyclictest0-21swapper/109:06:221
506999130,5cyclictest0-21swapper/108:55:041
506999130,12cyclictest0-21swapper/108:54:131
506999130,12cyclictest0-21swapper/108:23:511
506999130,12cyclictest0-21swapper/108:10:431
506999130,12cyclictest0-21swapper/108:02:081
506999130,12cyclictest0-21swapper/107:55:021
506999130,12cyclictest0-21swapper/107:16:211
507999127,4cyclictest5613-21fschecks_time07:10:143
507599128,3cyclictest135650irq/27-eth008:35:492
507599127,4cyclictest0-21swapper/209:06:062
507599123,6cyclictest135650irq/27-eth008:20:062
507599120,4cyclictest0-21swapper/208:30:562
506999120,3cyclictest0-21swapper/107:10:111
506999120,11cyclictest0-21swapper/108:25:441
506999120,11cyclictest0-21swapper/107:30:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional