You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 21:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Nov 30, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
981021750,2sleep00-21swapper/007:05:170
1641321500,3sleep01129299cyclictest11:34:260
1320521380,1sleep11129399cyclictest12:26:531
3135321240,1sleep11129399cyclictest12:07:061
1303221240,3sleep31129599cyclictest09:11:053
99021210,3sleep01129299cyclictest10:58:520
99021210,3sleep01129299cyclictest10:58:510
632221160,3sleep30-21swapper/309:30:213
2937621140,3sleep01129299cyclictest12:00:430
1221621060,1sleep00-21swapper/009:37:270
10862210433,42sleep30-21swapper/307:08:063
279972990,1sleep027993-21bash10:14:420
257122980,3sleep10-21swapper/110:14:281
53502960,3sleep31129599cyclictest09:17:023
132142960,1sleep013212-21bash11:27:180
203182940,3sleep20-21swapper/212:09:112
1095629436,46sleep10-21swapper/107:09:171
271262930,1sleep027121-21sshd09:51:540
133022920,2sleep00-21swapper/011:59:200
231762910,4sleep20-21swapper/211:41:462
303312890,2sleep230324-21sshd11:25:382
84192880,1sleep30-21swapper/312:32:423
42432880,2sleep30-21swapper/311:19:543
254932860,1sleep00-21swapper/009:55:020
198762860,3sleep32405-21runrttasks10:04:043
94052850,2sleep10-21swapper/109:56:331
141702850,3sleep314169-21id11:47:083
191572840,1sleep119151-21df_inode10:30:151
14012840,2sleep10-21swapper/111:49:031
300762830,2sleep20-21swapper/209:32:492
270112820,1sleep30-21swapper/311:51:213
151202820,2sleep11848-21nfsd10:00:211
316532810,0sleep00-21swapper/012:38:040
299692810,1sleep10-21swapper/110:08:181
252482810,0sleep00-21swapper/011:18:390
245922800,1sleep20-21swapper/212:18:412
102212800,0sleep00-21swapper/009:40:240
39772790,2sleep13973-21sshd11:36:241
218062780,3sleep00-21swapper/011:00:590
219472770,2sleep10-21swapper/111:54:001
299722750,1sleep10-21swapper/107:50:141
58092740,1sleep30-21swapper/311:36:383
149022740,1sleep11129399cyclictest09:34:351
86732730,2sleep31129599cyclictest10:12:413
54462690,2sleep35272-21sshd12:01:303
308432680,4sleep21129499cyclictest07:50:272
201692680,1sleep10-21swapper/112:02:581
265482670,2sleep226547-21bash10:17:492
87902650,3sleep38764-21sshd12:29:403
111972590,2sleep21843-21nfsd09:17:372
293052520,2sleep129284-21sshd11:15:311
1094525237,11sleep20-21swapper/207:09:092
272282510,1sleep30-21swapper/310:27:363
169912510,0sleep00-21swapper/010:20:070
135362390,4sleep30-21swapper/309:44:073
39142340,1sleep30-21swapper/311:02:313
274782340,1sleep30-21swapper/311:28:493
11294993213,17cyclictest33-21ksoftirqd/211:16:332
11294993112,17cyclictest33-21ksoftirqd/211:13:462
11294993111,18cyclictest33-21ksoftirqd/210:35:462
33912300,2sleep11129399cyclictest11:33:031
12352300,27sleep1135650irq/27-eth011:09:201
11292993016,6cyclictest3-21ksoftirqd/011:45:180
1129499286,3cyclictest10950irq/23-ehci_hcd09:42:402
181912270,2sleep20-21swapper/210:43:352
141522270,2sleep20-21swapper/209:27:552
1129499273,22cyclictest33-21ksoftirqd/211:37:152
11294992724,2cyclictest14275-21sshd09:11:142
1129499272,23cyclictest33-21ksoftirqd/209:53:302
299372260,2sleep129938-21sshd10:51:431
285102260,3sleep20-21swapper/210:01:382
211142260,1sleep30-21swapper/312:21:233
11294992615,3cyclictest25162-21sshd10:51:112
1129499260,19cyclictest33-21ksoftirqd/212:30:082
1129499260,19cyclictest33-21ksoftirqd/211:56:242
11292992613,12cyclictest3-21ksoftirqd/009:26:380
103262260,3sleep20-21swapper/211:03:152
54012250,2sleep30-21swapper/312:38:393
1129499259,3cyclictest31573-21sshd09:45:492
316832240,0sleep041ktimersoftd/009:05:140
250262240,1sleep00-21swapper/009:19:030
11294992414,3cyclictest33-21ksoftirqd/211:06:162
1129499234,3cyclictest0-21swapper/211:50:542
11294992317,3cyclictest9743-21sshd10:06:122
11294992317,3cyclictest28195-21sshd10:58:192
11294992317,3cyclictest28195-21sshd10:58:192
11294992314,3cyclictest8881-21sshd12:20:162
11294992311,3cyclictest18896-21cp10:23:332
11292992312,4cyclictest3-21ksoftirqd/010:18:490
22492220,2sleep12248-21bash11:42:531
11294992216,4cyclictest36-21rcuop/210:33:242
11294992216,3cyclictest9825-21sshd12:26:352
1129499221,19cyclictest33-21ksoftirqd/209:22:462
1129499220,3cyclictest32428-21id09:36:122
1129499220,20cyclictest33-21ksoftirqd/210:13:252
1129499220,17cyclictest33-21ksoftirqd/211:47:262
11293992210,4cyclictest12600-21sshd11:24:021
1129399220,4cyclictest1845-21nfsd10:37:181
1129299229,4cyclictest31115-21sshd09:45:470
1129299221,2cyclictest16187-21sshd12:30:190
1129299221,2cyclictest0-21swapper/011:11:010
316942210,0sleep00-21swapper/010:34:510
1129499218,12cyclictest33-21ksoftirqd/209:55:252
1129499210,19cyclictest33-21ksoftirqd/211:32:182
1129499210,18cyclictest33-21ksoftirqd/210:46:542
1129499210,17cyclictest33-21ksoftirqd/212:01:062
327442200,0sleep00-21swapper/012:13:260
249892200,2sleep324988-21bash09:22:153
11295992012,6cyclictest30882-21bash12:19:173
11294992015,3cyclictest23097-21sshd10:27:122
1129499200,18cyclictest33-21ksoftirqd/211:24:082
11293992015,3cyclictest17538-21id09:25:041
11293992010,3cyclictest135650irq/27-eth010:15:391
11292992017,1cyclictest30397-21sshd09:22:490
11292992011,2cyclictest0-21swapper/012:19:320
1129299201,11cyclictest12283-21bash09:11:000
1129299201,11cyclictest0-21swapper/011:51:260
11295991914,4cyclictest26252-21sshd09:51:493
1129599190,16cyclictest1959-21sshd11:31:113
1129499191,14cyclictest33-21ksoftirqd/212:38:002
1129399196,5cyclictest10950irq/23-ehci_hcd09:10:051
1129399190,9cyclictest23670-21cp09:41:481
1129399190,6cyclictest23812-21sshd09:18:561
1129299197,4cyclictest0-21swapper/010:50:110
1129299191,9cyclictest9156-21bash10:46:040
11292991915,2cyclictest3-21ksoftirqd/010:05:420
11292991911,4cyclictest4844-21sshd10:42:090
1129299190,9cyclictest21797-21sshd10:27:030
1129299190,15cyclictest0-21swapper/010:02:260
63872180,2sleep16386-21sshd11:29:581
318612180,0sleep11848-21nfsd09:36:091
1129599186,9cyclictest10549-21sshd10:32:393
11295991813,3cyclictest14903-21sshd10:19:573
11295991811,4cyclictest9230-21sshd09:59:513
11295991810,3cyclictest17288-21sshd09:47:513
1129299188,5cyclictest3-21ksoftirqd/012:24:470
1129299184,3cyclictest1847-21nfsd11:39:270
11292991815,2cyclictest3-21ksoftirqd/012:06:160
1129299181,16cyclictest0-21swapper/012:28:520
90432170,14sleep3135650irq/27-eth011:20:193
1129599179,5cyclictest1633-21sshd11:09:203
1129599171,13cyclictest1959-21sshd10:21:593
1129599170,15cyclictest11618-21sshd10:42:523
11293991710,3cyclictest0-21swapper/112:20:111
11293991710,2cyclictest11650-21sshd10:22:481
1129299177,5cyclictest9968-21bash09:30:440
1129299176,5cyclictest20779-21sshd11:24:500
1129299171,13cyclictest0-21swapper/010:36:260
1129299170,5cyclictest0-21swapper/011:05:370
1129299170,14cyclictest17621-21sshd11:44:260
281012160,2sleep128102-21sshd11:01:411
1129599168,3cyclictest12345-21sshd09:27:453
1129599163,4cyclictest8809-21sshd12:14:133
11295991613,2cyclictest0-21swapper/311:13:443
11295991611,3cyclictest654-21netstat10:55:203
11295991611,3cyclictest654-21netstat10:55:193
1129599160,7cyclictest11724-21sshd12:08:213
1129599160,7cyclictest0-21swapper/310:52:513
1129599160,15cyclictest20013-21cp10:07:163
1129599160,10cyclictest1847-21nfsd11:42:303
1129499160,11cyclictest17271-21sshd12:11:572
1129399166,2cyclictest13004-21sshd11:56:061
1129399163,0cyclictest0-21swapper/111:14:441
1129399161,4cyclictest10950irq/23-ehci_hcd09:20:381
11293991611,4cyclictest15394-21sshd12:30:151
1129399161,14cyclictest12309-21sshd10:46:241
1129399160,2cyclictest3681-21sshd09:52:471
1129399160,14cyclictest0-21swapper/109:49:471
1129399160,13cyclictest19679-21sshd10:43:441
1129599158,6cyclictest0-21swapper/311:57:223
1129599158,3cyclictest4840-21sshd10:35:203
11295991510,4cyclictest135650irq/27-eth007:40:373
1129599150,6cyclictest12376-21bash09:37:283
1129499152,11cyclictest0-21swapper/207:23:482
11294991513,1cyclictest0-21swapper/208:40:282
11294991511,3cyclictest10950irq/23-ehci_hcd07:30:252
1129399157,6cyclictest0-21swapper/112:10:191
1129399150,3cyclictest1959-21sshd12:37:021
1129399150,2cyclictest1893-21nscd10:55:361
1129399150,2cyclictest1893-21nscd10:55:351
1129399150,1cyclictest0-21swapper/112:15:271
1129399150,13cyclictest0-21swapper/110:25:051
1129399150,13cyclictest0-21swapper/108:12:151
1129599148,5cyclictest1848-21nfsd08:45:103
1129599140,13cyclictest0-21swapper/308:31:323
1129599140,13cyclictest0-21swapper/307:50:253
1129599140,12cyclictest32599-21munin-node07:55:173
1129599140,12cyclictest135650irq/27-eth010:45:063
1129599140,11cyclictest0-21swapper/308:21:023
1129599140,10cyclictest135650irq/27-eth007:34:563
1129499140,13cyclictest0-21swapper/207:10:182
1129399143,3cyclictest10950irq/23-ehci_hcd09:04:391
1129399140,12cyclictest2405-21runrttasks07:35:381
1129299146,5cyclictest0-21swapper/007:40:560
1129299141,6cyclictest0-21swapper/007:21:170
11292991411,3cyclictest20935-21kworker/0:207:25:030
11292991410,3cyclictest20935-21kworker/0:208:56:110
1129299140,8cyclictest0-21swapper/008:07:370
1129299140,13cyclictest0-21swapper/007:16:240
1129299140,11cyclictest0-21swapper/007:11:530
1129599137,5cyclictest10950irq/23-ehci_hcd09:00:193
1129599137,2cyclictest0-21swapper/308:16:243
1129599137,1cyclictest32092-21idleruntime09:05:163
11295991311,1cyclictest0-21swapper/307:16:173
1129599131,10cyclictest0-21swapper/307:20:173
11295991310,2cyclictest0-21swapper/308:00:103
1129599130,12cyclictest0-21swapper/307:45:013
1129599130,12cyclictest0-21swapper/307:29:463
1129599130,11cyclictest27074-21df08:55:133
1129599130,11cyclictest2405-21runrttasks08:35:473
1129599130,11cyclictest23026-21df_inode07:35:143
1129599130,11cyclictest20738-21iostat_ios08:40:163
1129499138,4cyclictest2405-21runrttasks08:33:462
1129499138,3cyclictest22972-21df07:35:142
1129499137,3cyclictest135650irq/27-eth008:05:132
1129499132,10cyclictest135650irq/27-eth008:47:002
1129499131,3cyclictest11541-21hddtemp_smartct08:20:142
1129499131,11cyclictest135650irq/27-eth007:45:562
11294991310,2cyclictest10950irq/23-ehci_hcd07:41:272
1129499130,4cyclictest1261-21seq07:58:272
1129499130,2cyclictest135650irq/27-eth007:15:062
1129499130,12cyclictest135650irq/27-eth008:55:042
1129499130,12cyclictest0-21swapper/208:50:592
1129499130,12cyclictest0-21swapper/208:37:562
1129499130,12cyclictest0-21swapper/208:17:082
1129499130,12cyclictest0-21swapper/208:00:422
1129499130,11cyclictest0-21swapper/209:01:592
1129399137,5cyclictest0-21swapper/108:18:151
1129399131,1cyclictest0-21swapper/108:26:101
11293991311,1cyclictest0-21swapper/108:31:121
1129399130,12cyclictest1848-21nfsd08:50:561
1129399130,12cyclictest0-21swapper/108:43:081
1129399130,12cyclictest0-21swapper/108:20:151
1129399130,12cyclictest0-21swapper/108:02:591
1129399130,12cyclictest0-21swapper/107:55:401
1129399130,12cyclictest0-21swapper/107:46:281
1129399130,12cyclictest0-21swapper/107:41:541
1129399130,12cyclictest0-21swapper/107:34:151
1129399130,12cyclictest0-21swapper/107:27:431
1129399130,12cyclictest0-21swapper/107:20:281
1129399130,12cyclictest0-21swapper/107:18:161
1129299139,1cyclictest0-21swapper/007:45:530
1129299137,5cyclictest0-21swapper/008:20:140
1129299137,5cyclictest0-21swapper/008:16:420
1129299130,8cyclictest0-21swapper/007:55:020
1129299130,1cyclictest0-21swapper/008:32:050
1129299130,12cyclictest0-21swapper/008:38:520
1129299130,12cyclictest0-21swapper/008:25:550
1129299130,12cyclictest0-21swapper/007:30:490
1129599120,4cyclictest0-21swapper/308:50:153
1129599120,3cyclictest6626-21diskstats08:10:143
1129599120,3cyclictest3993-21taskset08:05:033
1129599120,3cyclictest0-21swapper/307:10:123
1129599120,11cyclictest0-21swapper/308:25:093
1129499120,11cyclictest569-21vmstat09:05:242
1129499120,11cyclictest1848-21nfsd07:25:172
1129499120,11cyclictest0-21swapper/208:25:062
1129499120,11cyclictest0-21swapper/208:10:012
1129399128,3cyclictest135650irq/27-eth008:05:301
1129399125,3cyclictest10950irq/23-ehci_hcd08:55:141
1129399120,11cyclictest135650irq/27-eth008:37:341
1129399120,11cyclictest0-21swapper/109:05:571
1129399120,11cyclictest0-21swapper/108:46:001
1129399120,11cyclictest0-21swapper/107:10:141
1129299129,2cyclictest0-21swapper/008:50:160
1129299128,3cyclictest0-21swapper/008:10:270
1129299122,1cyclictest0-21swapper/007:36:210
11292991210,1cyclictest0-21swapper/009:00:270
1129299120,8cyclictest0-21swapper/008:45:250
1129299120,7cyclictest0-21swapper/008:00:160
1129299120,1cyclictest0-21swapper/008:44:340
1129299120,10cyclictest0-21swapper/007:50:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional