You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 18:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Wed Dec 03, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2923521490,1sleep029231-21sshd10:03:420
2480721430,1sleep024803-21sshd10:40:410
91321290,1sleep31846-21nfsd10:45:013
981421120,2sleep30-21swapper/309:48:093
1128221110,1sleep21592799cyclictest12:28:082
1232221100,3sleep21592799cyclictest09:48:252
688721090,2sleep16885-21sshd10:01:131
2123621030,2sleep121227-21sshd11:17:251
2096321010,2sleep020966-21cut10:20:130
2096321010,2sleep020966-21cut10:20:130
335321000,2sleep21592799cyclictest09:23:072
77032980,2sleep20-21swapper/212:07:242
75272960,1sleep30-21swapper/310:28:543
301652960,2sleep230149-21sshd10:17:302
164342950,2sleep10-21swapper/110:09:161
3292930,3sleep10-21swapper/109:12:401
136872930,2sleep113686-21sshd12:01:061
31622910,2sleep23161-21bash09:33:142
120082910,1sleep20-21swapper/211:19:502
51032900,1sleep20-21swapper/209:51:002
1535329033,44sleep10-21swapper/107:06:201
267842890,2sleep30-21swapper/310:37:353
45302870,2sleep20-21swapper/209:05:162
100362870,2sleep310033-21sshd11:36:063
277832860,1sleep227771-21sshd12:16:062
277832860,1sleep227771-21sshd12:16:052
228712850,4sleep20-21swapper/211:34:142
200742830,1sleep027958-21kworker/0:211:13:520
1566028334,44sleep30-21swapper/307:09:543
320692820,2sleep10-21swapper/111:21:461
145892820,2sleep314586-21sshd09:14:113
53702790,2sleep25371-21bash12:03:442
220972790,4sleep31592899cyclictest09:35:153
176272790,2sleep317622-21sshd10:02:253
90992780,2sleep20-21swapper/212:24:322
203182780,1sleep00-21swapper/011:23:540
273222770,2sleep327312-21rm12:16:033
273222770,2sleep327312-21rm12:16:033
287582760,4sleep01592299cyclictest09:19:000
168452760,3sleep21592799cyclictest10:02:202
131952760,1sleep10-21swapper/111:29:551
141572740,0sleep00-21swapper/010:29:340
176322720,2sleep317631-21sshd12:08:293
79792690,3sleep10-21swapper/112:10:441
26472690,1sleep22648-21cat07:50:162
185022680,2sleep10-21swapper/109:55:361
1557125633,11sleep20-21swapper/207:08:492
1550525532,11sleep00-21swapper/007:08:150
83852457,35sleep1135650irq/27-eth010:32:251
325072370,2sleep11959-21sshd11:35:131
94602340,5sleep10-21swapper/109:30:231
323062340,0sleep232308-21id10:44:552
15928993428,5cyclictest31130-21sshd12:33:383
225532320,2sleep122552-21sshd12:15:291
225532320,2sleep122552-21sshd12:15:291
224642300,3sleep10-21swapper/111:30:441
38862290,3sleep10-21swapper/110:28:321
1592799297,19cyclictest33-21ksoftirqd/212:14:342
1592799297,16cyclictest33-21ksoftirqd/211:40:392
52152280,3sleep35216-21sshd11:32:223
299312280,2sleep20-21swapper/210:37:542
1592699289,7cyclictest135650irq/27-eth011:09:251
1592699279,6cyclictest10950irq/23-ehci_hcd10:40:411
1592699277,6cyclictest135650irq/27-eth011:00:181
15926992722,2cyclictest0-21swapper/110:16:561
198222260,2sleep119823-21sshd12:32:241
169532260,23sleep1135650irq/27-eth009:17:471
15928992613,2cyclictest1847-21nfsd11:08:073
15927992610,11cyclictest21542-21sshd10:09:492
1592299260,23cyclictest0-21swapper/008:10:120
1592299260,15cyclictest28361-21sshd12:06:000
1592799253,1cyclictest18800-21sshd09:17:572
15927992510,2cyclictest10950irq/23-ehci_hcd11:57:402
1592799250,3cyclictest28968-21sshd10:24:282
1592799250,3cyclictest28968-21sshd10:24:272
1592799250,23cyclictest24285-21sshd09:11:482
21042240,1sleep30-21swapper/310:18:043
15927992417,5cyclictest21398-21sshd12:39:222
15927992414,6cyclictest1848-21nfsd10:49:412
15927992413,5cyclictest10950irq/23-ehci_hcd11:03:432
15927992411,5cyclictest29395-21sshd09:29:132
1592299241,16cyclictest135650irq/27-eth010:52:060
138332240,2sleep313832-21sshd12:35:113
12372240,21sleep1135650irq/27-eth010:45:031
100962240,4sleep11592699cyclictest08:05:211
177872230,2sleep117786-21bash09:38:221
15928992320,2cyclictest11502-21sshd11:22:593
15927992315,4cyclictest27295-21sshd09:56:362
15927992310,8cyclictest1959-21sshd10:27:182
1592299230,15cyclictest0-21swapper/009:24:200
218662220,1sleep01848-21nfsd11:37:230
163082224,16sleep210950irq/23-ehci_hcd11:50:422
15927992217,3cyclictest30372-21sshd09:43:292
15927992213,7cyclictest30408-21sshd10:31:192
1592799220,20cyclictest33-21ksoftirqd/211:45:412
1592799220,20cyclictest33-21ksoftirqd/211:37:382
15922992220,1cyclictest0-21swapper/009:35:210
1592299221,13cyclictest0-21swapper/011:50:430
1592299220,15cyclictest0-21swapper/010:31:210
257112210,0sleep025712-21bash10:17:000
233162210,2sleep12405-21runrttasks10:13:251
1592899218,5cyclictest10950irq/23-ehci_hcd11:10:443
15928992115,3cyclictest0-21swapper/309:44:443
15927992116,3cyclictest9060-21sshd12:31:132
15927992116,3cyclictest29440-21sshd11:21:292
15927992116,3cyclictest0-21swapper/211:26:152
15927992112,6cyclictest12538-21sshd10:56:122
15927992110,3cyclictest16357-21sshd10:12:412
1592799210,18cyclictest33-21ksoftirqd/211:06:562
1592699210,18cyclictest22-21ksoftirqd/109:21:321
1592299210,14cyclictest0-21swapper/012:01:360
1592299210,13cyclictest21854-21sshd10:06:220
147962210,1sleep30-21swapper/311:50:303
257582201,17sleep1135650irq/27-eth010:37:301
15928992015,3cyclictest9940-21bash09:23:513
15928992012,4cyclictest10950irq/23-ehci_hcd11:27:573
15927992015,3cyclictest29595-21sshd09:35:562
15927992014,3cyclictest22255-21ls10:50:222
1592699204,4cyclictest135650irq/27-eth012:21:551
1592299205,13cyclictest0-21swapper/012:23:530
1592299201,17cyclictest10152-21sshd12:38:070
1592299201,11cyclictest2995-21sshd11:25:280
1592299200,11cyclictest27755-21cp09:29:050
80612191,16sleep3135650irq/27-eth010:11:423
5222190,17sleep1135650irq/27-eth010:24:561
5222190,17sleep1135650irq/27-eth010:24:551
1592899198,5cyclictest135650irq/27-eth011:15:333
1592899194,8cyclictest135650irq/27-eth012:02:283
1592899191,7cyclictest0-21swapper/310:52:133
15928991912,6cyclictest10950irq/23-ehci_hcd12:21:243
15928991911,2cyclictest10950irq/23-ehci_hcd11:04:313
15927991911,6cyclictest32549-21sshd11:11:452
1592699199,7cyclictest15316-21taskset12:25:101
1592699194,3cyclictest26234-21sshd10:50:461
1592299198,2cyclictest788-21sshd09:50:340
1592299191,8cyclictest15770-21id10:39:510
1592299191,3cyclictest31797-21sshd10:10:460
15922991910,2cyclictest0-21swapper/012:32:450
1592299190,11cyclictest0-21swapper/011:31:320
107342191,1sleep10-21swapper/109:48:171
26912180,16sleep1135650irq/27-eth010:58:431
1592899189,4cyclictest24440-21sshd10:06:393
1592899188,8cyclictest135650irq/27-eth009:50:203
1592899182,9cyclictest9414-21sshd11:42:523
1592899182,5cyclictest1845-21nfsd12:28:333
15928991813,3cyclictest0-21swapper/309:58:023
1592899181,13cyclictest0-21swapper/309:26:053
1592899180,6cyclictest29842-21sshd12:13:013
1592699185,4cyclictest17341-21bash11:50:471
1592699185,4cyclictest10950irq/23-ehci_hcd11:45:541
15926991810,6cyclictest9400-21sshd09:40:461
1592299186,3cyclictest0-21swapper/010:56:040
1592299181,9cyclictest16808-21sshd12:25:160
15922991811,1cyclictest0-21swapper/009:46:120
1592299180,9cyclictest14069-21sshd12:11:230
1592299180,17cyclictest0-21swapper/009:40:170
1592299180,15cyclictest1847-21nfsd12:16:120
1592299180,15cyclictest1847-21nfsd12:16:120
1592299180,13cyclictest8904-21grep09:30:210
1592299180,11cyclictest0-21swapper/011:16:380
15928991712,4cyclictest1959-21sshd10:20:083
15928991712,4cyclictest1959-21sshd10:20:083
15928991710,1cyclictest26142-21sshd10:57:443
1592899170,8cyclictest932-21id09:19:303
1592899170,15cyclictest9898-21sshd11:46:173
1592899170,10cyclictest0-21swapper/311:56:383
15927991714,2cyclictest13976-21ipmi_fans08:15:162
1592699171,9cyclictest2650-21sshd09:50:451
1592699171,8cyclictest28547-21sshd12:36:381
1592699170,7cyclictest1778-21sshd09:26:131
1592699170,15cyclictest25091-21sshd11:58:521
1592299170,9cyclictest20280-21sshd09:59:170
1592299170,9cyclictest0-21swapper/009:11:300
1592299170,11cyclictest23689-21bash11:40:530
1592899166,2cyclictest10950irq/23-ehci_hcd10:46:263
1592899163,7cyclictest144550irq/28-eth1-rx-07:41:413
15928991610,5cyclictest10950irq/23-ehci_hcd07:57:513
1592899160,7cyclictest0-21swapper/307:20:153
1592899160,14cyclictest0-21swapper/310:30:403
1592899160,13cyclictest0-21swapper/308:59:133
1592799160,14cyclictest0-21swapper/208:45:132
1592299169,1cyclictest0-21swapper/011:08:260
1592299165,8cyclictest0-21swapper/010:45:220
1592299165,2cyclictest4350-21sshd11:45:410
1592299160,15cyclictest0-21swapper/011:59:590
1592299160,14cyclictest1959-21sshd11:01:180
1592899157,6cyclictest0-21swapper/307:15:193
1592899152,4cyclictest14715-21sshd09:30:543
15928991511,3cyclictest10950irq/23-ehci_hcd07:27:283
1592899151,13cyclictest0-21swapper/307:14:453
1592799153,9cyclictest0-21swapper/207:36:122
1592699152,12cyclictest10950irq/23-ehci_hcd08:46:111
15926991510,4cyclictest6089-21sshd11:42:321
1592699150,6cyclictest0-21swapper/107:10:161
1592699150,3cyclictest135650irq/27-eth009:01:081
1592699150,14cyclictest0-21swapper/107:25:591
1592699150,10cyclictest2363-21sshd12:06:511
15922991513,1cyclictest29153-21taskset07:37:240
1592299150,6cyclictest0-21swapper/007:10:140
1592299150,14cyclictest0-21swapper/009:05:420
1592299150,12cyclictest0-21swapper/008:27:110
1592299150,12cyclictest0-21swapper/008:17:570
1592899141,12cyclictest0-21swapper/308:21:423
1592899140,13cyclictest1848-21nfsd08:25:133
1592899140,13cyclictest0-21swapper/307:32:303
1592799149,4cyclictest135650irq/27-eth007:42:262
1592799143,10cyclictest15943-21munin-node07:10:122
15927991410,3cyclictest10950irq/23-ehci_hcd08:54:412
1592799140,13cyclictest144550irq/28-eth1-rx-08:32:212
1592699147,5cyclictest0-21swapper/107:45:151
1592699144,2cyclictest28488-21sshd11:11:191
1592699140,6cyclictest1848-21nfsd07:41:141
1592699140,12cyclictest31771-21df_inode08:55:131
15922991412,1cyclictest0-21swapper/008:02:000
1592299140,8cyclictest0-21swapper/008:21:490
198852130,12sleep1135650irq/27-eth007:15:371
1592899139,3cyclictest135650irq/27-eth008:15:053
1592899132,10cyclictest10950irq/23-ehci_hcd08:01:043
1592899131,7cyclictest5979-21latency_hist09:10:013
1592899130,5cyclictest27026-21grep08:45:113
1592899130,4cyclictest2328-21munin-node09:00:183
1592899130,12cyclictest0-21swapper/308:52:183
1592899130,12cyclictest0-21swapper/308:10:593
1592899130,12cyclictest0-21swapper/307:51:043
1592899130,12cyclictest0-21swapper/307:45:233
1592899130,12cyclictest0-21swapper/307:35:123
1592899130,11cyclictest9326-21hddtemp_smartct08:05:143
1592899130,11cyclictest25378-21munin-node08:40:163
1592899130,11cyclictest22330-21munin-node08:35:183
1592899130,11cyclictest22330-21munin-node08:35:183
1592899130,10cyclictest10950irq/23-ehci_hcd08:34:053
1592799139,3cyclictest26950irq/26-ahci[00008:35:362
1592799139,3cyclictest26950irq/26-ahci[00008:35:352
1592799138,3cyclictest629-21users08:55:222
1592799137,5cyclictest0-21swapper/207:30:132
1592799131,3cyclictest32573-21hddtemp_smartct07:45:152
1592799131,11cyclictest2405-21runrttasks08:01:292
1592799130,12cyclictest0-21swapper/208:40:462
1592799130,12cyclictest0-21swapper/208:21:272
1592799130,12cyclictest0-21swapper/207:26:312
1592799130,12cyclictest0-21swapper/207:20:252
1592699138,4cyclictest135650irq/27-eth007:20:001
1592699132,10cyclictest135650irq/27-eth008:15:331
1592699132,10cyclictest10950irq/23-ehci_hcd07:51:121
15926991311,1cyclictest0-21swapper/108:53:561
15926991310,2cyclictest0-21swapper/107:58:111
1592699130,12cyclictest21697-21users08:30:241
1592699130,12cyclictest135650irq/27-eth008:20:051
1592699130,12cyclictest135650irq/27-eth008:04:151
1592699130,12cyclictest0-21swapper/108:36:421
1592699130,12cyclictest0-21swapper/108:36:411
1592699130,12cyclictest0-21swapper/108:26:181
1592699130,12cyclictest0-21swapper/108:13:591
1592299136,6cyclictest0-21swapper/007:55:310
15922991311,1cyclictest0-21swapper/008:08:120
1592299130,12cyclictest0-21swapper/008:41:280
1592299130,12cyclictest0-21swapper/008:35:440
1592299130,12cyclictest0-21swapper/008:35:440
1592299130,12cyclictest0-21swapper/008:34:480
1592299130,12cyclictest0-21swapper/007:45:150
1592299130,12cyclictest0-21swapper/007:24:030
1592299130,12cyclictest0-21swapper/007:18:190
1592299130,11cyclictest0-21swapper/007:25:090
1592299130,10cyclictest0-21swapper/008:55:530
1592799128,3cyclictest4245-21cpuspeed_turbos07:55:122
1592799128,3cyclictest1848-21nfsd09:00:412
1592799128,3cyclictest1848-21nfsd08:25:202
1592799128,3cyclictest1848-21nfsd08:05:042
1592799128,3cyclictest0-21swapper/208:10:432
1592799120,11cyclictest0-21swapper/207:15:002
1592699120,3cyclictest5474-21taskset09:07:371
1592699120,3cyclictest28632-21sensors_temp07:35:241
1592699120,11cyclictest24612-21munin-node08:40:201
1592699120,11cyclictest0-21swapper/107:30:161
1592299124,5cyclictest0-21swapper/008:54:280
15922991210,1cyclictest0-21swapper/007:41:520
1592299120,8cyclictest0-21swapper/007:51:090
1592299120,4cyclictest0-21swapper/008:45:160
1592299120,11cyclictest0-21swapper/009:01:270
1592299120,11cyclictest0-21swapper/007:30:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional