You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 20:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Thu Dec 04, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
419821360,2sleep20-21swapper/209:51:202
1273421360,0sleep00-21swapper/012:25:420
3042221330,5sleep3510599cyclictest12:05:203
2306221320,1sleep1509699cyclictest11:09:271
1223821290,1sleep012235-21bash10:35:230
540721270,3sleep2510099cyclictest11:43:232
1387921250,2sleep20-21swapper/210:55:132
2695021230,2sleep326938-21sshd09:33:303
183702990,1sleep30-21swapper/311:22:083
228532980,1sleep1135650irq/27-eth012:11:041
127412970,2sleep10-21swapper/112:28:591
20732940,2sleep12075-21nfsd412:15:201
477429232,48sleep30-21swapper/307:09:053
222542920,3sleep0509199cyclictest10:46:060
193892910,0sleep041ktimersoftd/011:12:230
17982910,1sleep10-21swapper/109:47:471
240032900,3sleep0509199cyclictest11:29:140
272232880,5sleep31844-21nfsd11:06:213
141172850,1sleep30-21swapper/310:12:453
63982840,2sleep20-21swapper/210:51:012
119602840,2sleep211959-21bash10:38:422
473728335,44sleep10-21swapper/107:08:361
323062830,1sleep032304-21sshd09:16:560
15402830,6sleep3510599cyclictest11:17:113
65042820,1sleep16506-21bash12:02:591
118142820,2sleep311812-21sshd10:25:253
191772810,1sleep10-21swapper/110:45:471
10102800,4sleep0509199cyclictest11:55:480
73612780,3sleep30-21swapper/310:41:273
11112780,2sleep30-21swapper/311:39:513
7032770,1sleep08-21rcu_preempt10:53:550
262792770,4sleep0509199cyclictest10:33:390
124512770,3sleep10-21swapper/111:31:161
89902760,1sleep08985-21rm09:14:440
217032760,1sleep30-21swapper/312:23:323
10572750,2sleep11044-21sshd09:51:001
322832740,0sleep232284-21sshd11:33:172
73252730,1sleep10-21swapper/109:38:211
477827334,9sleep20-21swapper/207:09:092
167072730,2sleep30-21swapper/310:58:433
286532710,1sleep30-21swapper/312:17:553
125662710,2sleep112567-21sshd10:29:031
3672690,0sleep2368-21bash10:21:062
300762690,1sleep10-21swapper/112:24:221
195422680,3sleep319537-21bash09:22:203
44702640,3sleep2510099cyclictest10:44:272
114602630,2sleep111458-21bash12:38:171
114602630,2sleep111458-21bash12:38:171
128842620,1sleep30-21swapper/310:02:323
85502590,3sleep0509199cyclictest11:21:050
52262590,1sleep10-21swapper/111:04:101
206202590,1sleep020618-21sshd10:20:010
55062580,0sleep25505-21bash10:11:412
102322490,2sleep20-21swapper/211:11:252
481924739,4sleep00-21swapper/007:09:340
188732380,2sleep10-21swapper/109:12:201
119352340,0sleep211936-21sshd09:45:282
118022340,3sleep00-21swapper/011:40:450
289152330,31sleep1135650irq/27-eth010:53:291
5096993211,18cyclictest22-21ksoftirqd/112:06:581
5096993211,18cyclictest22-21ksoftirqd/111:45:141
295942320,1sleep00-21swapper/009:44:050
509699318,20cyclictest22-21ksoftirqd/112:31:001
253652313,26sleep3135650irq/27-eth012:26:583
178202300,28sleep3135650irq/27-eth009:49:313
5096992921,4cyclictest17563-21id10:39:151
5096992917,4cyclictest0-21swapper/109:20:571
32862290,3sleep10-21swapper/111:17:211
5091992813,12cyclictest3-21ksoftirqd/012:00:590
266692280,2sleep126661-21bash09:33:281
264642280,2sleep30-21swapper/311:32:423
203922280,24sleep1135650irq/27-eth011:28:521
509699271,23cyclictest22-21ksoftirqd/111:11:171
509699271,17cyclictest22-21ksoftirqd/111:22:471
509699270,23cyclictest22-21ksoftirqd/111:55:261
509699264,19cyclictest22-21ksoftirqd/110:56:031
312762260,4sleep10-21swapper/110:17:451
273992260,4sleep20-21swapper/211:29:362
218642260,2sleep20-21swapper/212:04:352
7302250,2sleep20-21swapper/208:10:152
54792250,22sleep3135650irq/27-eth011:10:553
509699256,16cyclictest22-21ksoftirqd/109:58:391
5096992512,2cyclictest22-21ksoftirqd/110:03:541
509699250,22cyclictest22-21ksoftirqd/110:34:381
509699250,17cyclictest22-21ksoftirqd/110:10:221
299182252,21sleep2135650irq/27-eth009:33:502
193142252,20sleep3135650irq/27-eth011:25:253
191452250,0sleep00-21swapper/010:26:220
155552250,1sleep20-21swapper/209:15:172
510599248,5cyclictest16159-21sshd10:48:503
5096992416,5cyclictest15687-21sshd09:29:041
509699240,21cyclictest22-21ksoftirqd/111:50:511
5091992418,5cyclictest3-21ksoftirqd/011:54:240
102622240,22sleep3135650irq/27-eth012:03:213
5096992313,3cyclictest6019-21sshd09:41:361
37582230,2sleep23755-21sshd11:23:592
220072230,0sleep222009-21bash12:36:022
220072230,0sleep222009-21bash12:36:022
5105992218,2cyclictest23128-21ls07:49:593
510099222,9cyclictest2579-21sshd09:37:512
5100992213,7cyclictest1915-21snmpd12:25:442
5100992212,6cyclictest16475-21sshd11:05:172
5096992217,3cyclictest15308-21sshd11:38:001
5096992213,7cyclictest135650irq/27-eth010:40:531
509199221,13cyclictest25743-21bash11:09:440
5091992211,2cyclictest3-21ksoftirqd/010:41:230
197742220,0sleep00-21swapper/011:48:020
5105992112,5cyclictest1570-21bash10:54:003
5100992115,3cyclictest17376-21sshd12:23:082
5100992110,7cyclictest10950irq/23-ehci_hcd11:53:412
5096992117,2cyclictest7885-21bash11:43:381
509199219,11cyclictest3-21ksoftirqd/011:37:430
5091992114,4cyclictest3-21ksoftirqd/009:24:150
509199210,19cyclictest30265-21sshd12:05:200
319772211,17sleep2135650irq/27-eth010:04:362
212512210,19sleep2135650irq/27-eth011:35:222
510599209,1cyclictest0-21swapper/312:30:393
510599203,12cyclictest22969-21sshd12:11:053
510099204,8cyclictest2653-21runrttasks11:03:532
510099203,2cyclictest0-21swapper/211:46:292
5100992013,4cyclictest6519-21sshd12:06:112
5096992012,4cyclictest13044-21bash09:15:071
5091992012,4cyclictest3-21ksoftirqd/012:19:200
509199201,1cyclictest135650irq/27-eth010:56:520
5091992010,2cyclictest0-21swapper/009:55:130
509199200,1cyclictest1847-21nfsd12:30:550
509199200,12cyclictest24717-21sshd12:20:380
327162201,17sleep2135650irq/27-eth009:27:212
314502200,18sleep2135650irq/27-eth010:27:412
228292200,17sleep3135650irq/27-eth011:02:373
137232200,18sleep3135650irq/27-eth011:53:553
510099195,3cyclictest4719-21sshd10:47:392
510099193,8cyclictest1848-21nfsd09:44:572
510099192,13cyclictest135650irq/27-eth009:22:012
510099190,14cyclictest5552-21load08:20:162
5096991914,2cyclictest0-21swapper/110:20:261
509199198,4cyclictest3-21ksoftirqd/011:34:050
5091991915,3cyclictest3-21ksoftirqd/011:02:250
5091991914,3cyclictest3-21ksoftirqd/011:19:250
509199190,9cyclictest6598-21sshd10:11:470
510599187,7cyclictest32155-21sshd09:10:223
510599186,8cyclictest1893-21nscd10:17:083
510599186,2cyclictest30649-21sshd11:55:303
5105991812,4cyclictest9081-21sshd10:08:503
5105991811,4cyclictest13499-21sshd09:52:193
5105991810,2cyclictest135650irq/27-eth011:48:313
510599180,15cyclictest8885-21sshd11:43:453
510099182,11cyclictest22276-21users08:55:252
510099181,8cyclictest26942-21bash12:33:272
510099181,11cyclictest24859-21sshd09:56:572
509199188,9cyclictest3-21ksoftirqd/012:10:360
5091991816,1cyclictest0-21swapper/007:43:150
308102180,16sleep3135650irq/27-eth009:16:483
510599177,1cyclictest1959-21sshd09:38:133
510599175,11cyclictest10950irq/23-ehci_hcd09:28:473
510599172,10cyclictest11029-21sshd10:38:373
510599171,6cyclictest31687-21sshd10:21:003
510599170,4cyclictest25766-21sshd12:36:233
510599170,4cyclictest25766-21sshd12:36:233
510099174,5cyclictest144550irq/28-eth1-rx-12:20:002
510099173,7cyclictest27297-21sshd12:11:292
510099173,7cyclictest1848-21nfsd10:31:192
510099171,12cyclictest3265-21memory08:15:172
510099170,13cyclictest1848-21nfsd09:12:402
509199177,3cyclictest27429-21bash09:50:210
5091991714,1cyclictest1848-21nfsd12:35:130
5091991714,1cyclictest1848-21nfsd12:35:130
509199170,16cyclictest0-21swapper/010:17:260
509199170,14cyclictest6837-21sshd09:35:020
41432170,15sleep3135650irq/27-eth008:16:253
510599164,2cyclictest15411-21sshd09:42:363
510599160,14cyclictest9148-21sshd09:55:213
510599160,11cyclictest7674-21sshd10:31:433
510099166,5cyclictest10950irq/23-ehci_hcd11:58:132
510099164,9cyclictest144550irq/28-eth1-rx-08:42:292
510099164,2cyclictest1848-21nfsd07:11:542
510099163,6cyclictest13991-21bash11:15:132
510099161,9cyclictest29867-21sshd10:07:392
510099161,14cyclictest144550irq/28-eth1-rx-07:47:262
509699163,12cyclictest7524-21sshd10:08:401
5091991611,3cyclictest3-21ksoftirqd/009:48:510
509199160,15cyclictest0-21swapper/007:15:170
509199160,10cyclictest0-21swapper/007:40:000
510599157,6cyclictest9693-21fschecks_count08:30:143
510599152,12cyclictest10950irq/23-ehci_hcd08:13:123
5105991511,3cyclictest10950irq/23-ehci_hcd07:22:513
510599150,13cyclictest8521-21ntp_kernel_err07:15:193
510599150,13cyclictest0-21swapper/307:50:193
510099154,8cyclictest144550irq/28-eth1-rx-07:50:532
510099152,2cyclictest0-21swapper/207:59:082
510099151,13cyclictest144550irq/28-eth1-rx-09:02:292
510099151,13cyclictest144550irq/28-eth1-rx-08:25:492
510099151,13cyclictest144550irq/28-eth1-rx-07:19:452
510099150,6cyclictest6528-21sshd10:15:152
509699150,6cyclictest0-21swapper/107:50:161
509699150,5cyclictest0-21swapper/107:31:111
509699150,14cyclictest0-21swapper/107:59:401
509199152,9cyclictest0-21swapper/009:28:240
5091991510,4cyclictest0-21swapper/010:07:370
509199150,13cyclictest0-21swapper/007:25:200
509199150,12cyclictest27673-21bash10:00:390
509199150,12cyclictest0-21swapper/009:00:320
5105991410,3cyclictest10950irq/23-ehci_hcd09:07:563
510599140,13cyclictest0-21swapper/308:50:533
510599140,12cyclictest14547-21df_abs07:30:123
510099144,9cyclictest144550irq/28-eth1-rx-08:38:332
510099144,9cyclictest144550irq/28-eth1-rx-07:22:372
510099143,8cyclictest144550irq/28-eth1-rx-07:42:462
510099142,1cyclictest0-21swapper/209:05:052
510099141,2cyclictest0-21swapper/207:30:222
510099141,12cyclictest144550irq/28-eth1-rx-08:54:082
510099141,12cyclictest144550irq/28-eth1-rx-08:32:012
510099141,12cyclictest144550irq/28-eth1-rx-08:06:452
510099141,12cyclictest144550irq/28-eth1-rx-07:25:372
5100991410,3cyclictest10950irq/23-ehci_hcd08:45:292
509699146,3cyclictest0-21swapper/108:15:181
509699143,10cyclictest135650irq/27-eth008:59:251
509699140,3cyclictest135650irq/27-eth007:25:531
509699140,13cyclictest0-21swapper/108:47:581
509699140,12cyclictest135650irq/27-eth009:05:161
509199144,9cyclictest0-21swapper/007:21:020
509199141,8cyclictest0-21swapper/008:10:000
5091991411,2cyclictest0-21swapper/008:21:510
5091991410,3cyclictest0-21swapper/008:55:000
509199140,2cyclictest0-21swapper/007:10:150
509199140,12cyclictest1959-21sshd09:30:020
509199140,12cyclictest0-21swapper/007:48:370
509199140,11cyclictest0-21swapper/007:58:020
510599139,3cyclictest135650irq/27-eth007:25:053
510599138,3cyclictest18884-21munin-node07:40:143
510599137,4cyclictest6320-21users08:20:233
510599137,2cyclictest0-21swapper/308:35:133
510599137,1cyclictest24013-21nfsd409:00:193
510599131,11cyclictest0-21swapper/308:01:193
5105991310,2cyclictest0-21swapper/308:40:183
510599130,12cyclictest0-21swapper/308:25:173
510599130,12cyclictest0-21swapper/307:56:373
510599130,11cyclictest16522-21munin-node07:35:183
510099130,12cyclictest144550irq/28-eth1-rx-07:35:372
509699137,5cyclictest28249-21munin-node08:00:111
509699137,5cyclictest15610-21taskset08:42:111
509699133,9cyclictest0-21swapper/107:11:541
509699131,11cyclictest0-21swapper/107:20:281
509699130,5cyclictest0-21swapper/107:18:541
509699130,4cyclictest0-21swapper/107:43:441
509699130,3cyclictest230412sleep107:49:111
509699130,12cyclictest10950irq/23-ehci_hcd09:01:391
509699130,12cyclictest0-21swapper/108:52:481
509699130,12cyclictest0-21swapper/108:38:261
509699130,12cyclictest0-21swapper/108:31:051
509699130,12cyclictest0-21swapper/108:20:361
509699130,12cyclictest0-21swapper/108:11:421
509699130,11cyclictest8217-21runrttasks08:25:181
509199138,4cyclictest0-21swapper/008:30:400
509199137,4cyclictest0-21swapper/008:39:160
5091991311,2cyclictest0-21swapper/008:59:120
509199131,11cyclictest0-21swapper/009:05:520
5091991311,1cyclictest0-21swapper/008:47:440
509199130,9cyclictest2711-21diskstats08:15:130
509199130,10cyclictest0-21swapper/008:00:440
510599127,4cyclictest5718-21perl07:10:123
510599127,3cyclictest30870-21munin-node08:05:153
510599120,3cyclictest16342-21df08:45:113
510599120,10cyclictest0-21swapper/308:55:173
510099128,3cyclictest28238-21df_inode08:00:122
509699128,3cyclictest30212-21aten_r5power_fr08:05:111
509699126,5cyclictest17243-21if_err_eth007:35:131
509199120,8cyclictest0-21swapper/008:40:380
509199120,4cyclictest0-21swapper/008:10:230
509199120,11cyclictest0-21swapper/008:25:140
509199120,11cyclictest0-21swapper/007:50:180
509199120,11cyclictest0-21swapper/007:30:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional