You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 06:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Thu Nov 06, 2025 00:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2783221630,2sleep00-21swapper/000:08:440
1937221410,1sleep019370-21sshd23:48:510
837721340,2sleep38369-21bash23:35:193
2397521340,2sleep1219399cyclictest21:05:271
1838821290,0sleep10-21swapper/122:46:511
1124021290,2sleep11848-21nfsd23:44:591
2585621260,2sleep21848-21nfsd22:10:492
2302821230,1sleep00-21swapper/021:37:120
766421210,2sleep10-21swapper/123:38:221
1367321210,0sleep00-21swapper/023:08:110
2416621200,4sleep3220399cyclictest21:43:243
1942221180,2sleep21847-21nfsd23:42:362
1564321100,2sleep10-21swapper/122:40:261
1740021070,4sleep2219899cyclictest21:30:332
1936321060,1sleep30-21swapper/300:01:213
1106521040,2sleep10-21swapper/123:29:321
3218321020,2sleep10-21swapper/122:02:181
2034121010,1sleep1219399cyclictest21:12:401
1856210135,45sleep10-21swapper/119:09:041
1856210135,45sleep10-21swapper/119:09:031
2355521000,0sleep00-21swapper/021:22:050
1788121000,2sleep117883-21sshd21:51:521
248402960,1sleep30-21swapper/321:13:053
285342950,7sleep10-21swapper/123:52:491
132202930,1sleep013209-21sshd23:17:210
202922910,2sleep3220399cyclictest21:52:063
167622910,1sleep01847-21nfsd22:16:040
76402900,3sleep10-21swapper/122:18:211
308562890,3sleep21848-21nfsd23:34:262
22472890,3sleep22249-21bash21:26:082
16602890,1sleep20-21swapper/223:13:142
37812880,2sleep30-21swapper/321:38:263
27672870,1sleep20-21swapper/200:09:292
262522860,1sleep20-21swapper/223:27:532
209082850,1sleep320903-21sshd00:27:463
3292840,1sleep00-21swapper/023:00:370
181282840,1sleep20-21swapper/222:37:422
244122830,0sleep00-21swapper/019:55:220
195122830,3sleep1219399cyclictest21:45:551
193128335,44sleep30-21swapper/319:09:503
193128335,44sleep30-21swapper/319:09:503
51302810,0sleep05124-21sshd23:35:040
225032810,1sleep10-21swapper/122:50:201
186972810,1sleep00-21swapper/000:27:310
15242800,1sleep01353-21sshd22:20:450
50122790,1sleep00-21swapper/021:41:330
275442790,1sleep027530-21sshd21:19:290
275442790,1sleep027530-21sshd21:19:290
197522790,2sleep10-21swapper/100:04:391
178582790,2sleep117856-21bash00:07:401
255162780,1sleep02405-21runrttasks23:12:240
7912770,1sleep20-21swapper/221:50:172
44172770,3sleep24414-21sshd00:36:392
267822740,2sleep10-21swapper/121:55:401
17922740,4sleep1219399cyclictest21:32:121
12602730,1sleep01847-21nfsd23:56:250
200092720,2sleep319997-21sshd00:20:573
91882670,3sleep1219399cyclictest23:13:571
316522650,1sleep0218899cyclictest23:53:080
55262640,0sleep11847-21nfsd21:26:271
217752600,0sleep00-21swapper/000:38:380
2188995952,3cyclictest5437-21sshd22:58:080
155825933,4sleep00-21swapper/019:05:380
155825933,4sleep00-21swapper/019:05:370
2188995452,1cyclictest0-21swapper/023:20:110
163025132,14sleep20-21swapper/219:06:282
163025132,14sleep20-21swapper/219:06:282
69912430,2sleep16977-21sshd00:26:161
2198993916,10cyclictest33-21ksoftirqd/222:53:422
2188993937,1cyclictest10482-21sshd00:00:270
2188993834,2cyclictest28103-21sshd22:26:210
2188993634,1cyclictest19102-21bash23:33:180
2188993533,1cyclictest3-21ksoftirqd/022:53:180
2188993533,1cyclictest15639-21sshd00:20:290
2188993533,1cyclictest10783-21rm22:46:060
2198993315,5cyclictest33-21ksoftirqd/223:02:502
219899327,18cyclictest33-21ksoftirqd/222:46:022
2193993225,5cyclictest347-21sshd23:34:391
54692312,27sleep3135650irq/27-eth022:42:373
219399318,12cyclictest22-21ksoftirqd/123:49:581
2193993126,3cyclictest3871-21bash23:04:131
2193993126,3cyclictest30833-21bash22:23:371
2193993125,4cyclictest23778-21bash22:59:541
2193993123,6cyclictest135650irq/27-eth022:11:151
177522310,29sleep3135650irq/27-eth022:13:103
2193993024,5cyclictest22-21ksoftirqd/123:15:101
2193993021,5cyclictest12861-21sshd00:10:251
2193993020,7cyclictest5829-21sshd22:27:201
2193993019,6cyclictest1848-21nfsd21:36:511
169462300,2sleep20-21swapper/223:45:242
292172290,0sleep00-21swapper/022:02:010
2203992924,3cyclictest15257-21ls20:50:003
2193992925,2cyclictest13507-21sshd22:37:161
2193992923,4cyclictest14978-21bash00:20:261
2193992918,9cyclictest0-21swapper/123:06:441
2193992917,9cyclictest0-21swapper/100:30:021
2203992825,2cyclictest19452-21sshd23:27:133
219899282,3cyclictest19952-21sshd00:34:552
219399288,12cyclictest11478-21bash23:57:271
2193992822,3cyclictest20706-21sshd23:21:071
2193992819,5cyclictest26210-21unixbench_singl00:35:261
2193992811,15cyclictest6107-21timerandwakeup21:20:241
219899273,4cyclictest1901-21nscd23:16:502
2193992719,5cyclictest23948-21sshd00:18:071
2193992719,5cyclictest135650irq/27-eth022:06:571
2193992719,4cyclictest12887-21sshd22:31:011
219899269,7cyclictest33-21ksoftirqd/200:18:402
219899269,1cyclictest1959-21sshd00:20:372
219899263,21cyclictest33-21ksoftirqd/222:16:322
2198992610,10cyclictest33-21ksoftirqd/223:24:532
2193992610,12cyclictest3839-21sshd21:41:261
219899250,1cyclictest1847-21nfsd21:48:382
2193992516,7cyclictest31341-21id21:19:511
2193992516,7cyclictest31341-21id21:19:511
157502250,4sleep2219899cyclictest21:21:192
157372250,2sleep20-21swapper/222:40:272
219899245,17cyclictest33-21ksoftirqd/222:04:562
219899243,18cyclictest33-21ksoftirqd/222:09:362
2198992416,1cyclictest33-21ksoftirqd/223:51:462
218899245,17cyclictest3-21ksoftirqd/022:13:120
2188992414,8cyclictest3-21ksoftirqd/000:12:100
2188992412,10cyclictest3-21ksoftirqd/022:43:230
2188992410,12cyclictest3-21ksoftirqd/021:33:110
169952240,22sleep326950irq/26-ahci[00022:28:273
306102230,1sleep30-21swapper/323:46:463
219899233,18cyclictest33-21ksoftirqd/223:06:252
219899231,4cyclictest33-21ksoftirqd/223:57:592
219899231,19cyclictest33-21ksoftirqd/200:12:342
219899230,22cyclictest33-21ksoftirqd/221:59:322
219899230,21cyclictest33-21ksoftirqd/222:56:152
219899230,21cyclictest33-21ksoftirqd/222:32:082
219899230,14cyclictest33-21ksoftirqd/222:26:282
2188992319,3cyclictest3-21ksoftirqd/000:15:210
7682220,16sleep3135650irq/27-eth023:40:463
67162220,1sleep20-21swapper/220:30:142
2203992213,1cyclictest27095-21bash22:50:453
2203992211,7cyclictest11663-21sshd22:24:543
2203992211,3cyclictest10950irq/23-ehci_hcd23:11:363
2203992210,1cyclictest0-21swapper/300:31:373
2198992216,4cyclictest33-21ksoftirqd/221:10:452
2198992216,4cyclictest15240-21cp21:42:332
219899221,19cyclictest33-21ksoftirqd/222:21:552
219899220,20cyclictest33-21ksoftirqd/223:39:172
2188992211,3cyclictest3-21ksoftirqd/023:44:170
218899220,21cyclictest3-21ksoftirqd/022:36:390
202262220,1sleep30-21swapper/321:33:583
2203992116,4cyclictest15226-21sshd22:55:533
2203992115,4cyclictest32332-21sshd22:35:573
2203992115,2cyclictest16264-21sshd22:16:013
219899215,5cyclictest135650irq/27-eth021:35:552
219899210,2cyclictest22226-21sshd00:01:392
219899210,19cyclictest33-21ksoftirqd/221:18:332
219899210,19cyclictest33-21ksoftirqd/221:18:322
218899217,13cyclictest3-21ksoftirqd/021:13:060
184102210,1sleep041ktimersoftd/021:51:550
220399201,6cyclictest3415-21sshd23:22:373
2203992014,4cyclictest1959-21sshd23:59:423
220399201,17cyclictest135650irq/27-eth000:05:083
2203992011,2cyclictest10950irq/23-ehci_hcd21:17:233
2203992011,2cyclictest10950irq/23-ehci_hcd21:17:233
219899207,11cyclictest33-21ksoftirqd/200:28:422
218899206,13cyclictest32599-21sshd22:32:590
2188992016,3cyclictest3-21ksoftirqd/023:26:590
2188992016,3cyclictest3-21ksoftirqd/000:31:030
2188992015,3cyclictest3-21ksoftirqd/022:09:090
2188992011,3cyclictest3-21ksoftirqd/021:27:470
194562200,4sleep3220399cyclictest22:04:133
220399199,3cyclictest14523-21sshd23:32:513
220399198,8cyclictest0-21swapper/323:51:553
220399194,13cyclictest27267-21sshd00:35:333
2203991914,3cyclictest27177-21bash00:15:133
220399190,9cyclictest16757-21rm23:08:283
2193991914,4cyclictest2405-21runrttasks19:20:161
218899194,14cyclictest3-21ksoftirqd/021:45:390
220399188,3cyclictest10950irq/23-ehci_hcd22:48:093
2203991813,3cyclictest20339-21bash21:55:123
220399181,10cyclictest1847-21nfsd22:32:133
220399180,2cyclictest0-21swapper/323:02:293
2188991815,2cyclictest3-21ksoftirqd/021:55:180
287042170,15sleep3135650irq/27-eth021:46:503
220399178,4cyclictest417-21jbd2/dm-0-800:10:073
220399171,13cyclictest2405-21runrttasks21:27:213
220399170,6cyclictest12090-21sshd22:06:293
219899170,6cyclictest0-21swapper/221:01:262
219399171,14cyclictest4891-21fschecks_count19:15:141
219399170,15cyclictest0-21swapper/119:55:151
220399161,5cyclictest1844-21nfsd21:21:453
220399160,7cyclictest1187-21sshd23:16:113
220399160,14cyclictest13656-21munin-node19:35:193
219399166,5cyclictest9699-21fschecks_time19:25:151
2193991612,2cyclictest0-21swapper/120:10:001
219399160,14cyclictest1970-21ntpd20:00:201
220399157,4cyclictest18901-21ntpq20:55:193
220399154,10cyclictest0-21swapper/319:33:033
2203991511,3cyclictest10950irq/23-ehci_hcd19:17:583
2198991511,3cyclictest10950irq/23-ehci_hcd20:09:432
219899150,5cyclictest0-21swapper/220:16:552
219399159,3cyclictest0-21swapper/119:43:481
219399155,5cyclictest0-21swapper/119:14:581
219399151,3cyclictest135650irq/27-eth021:00:231
219399150,3cyclictest135650irq/27-eth019:37:401
219399150,2cyclictest10950irq/23-ehci_hcd20:46:551
219399150,13cyclictest11433-21atenall_r5power19:30:101
218899154,10cyclictest0-21swapper/019:50:220
218899151,1cyclictest0-21swapper/019:32:360
220399140,3cyclictest2405-21runrttasks20:11:463
220399140,12cyclictest18634-21fschecks_count19:45:133
219899141,12cyclictest135650irq/27-eth020:11:002
219899141,11cyclictest0-21swapper/219:40:102
219899141,11cyclictest0-21swapper/219:30:122
219899140,13cyclictest0-21swapper/220:00:182
219899140,12cyclictest0-21swapper/220:45:152
219399146,6cyclictest10041-21threads20:35:221
219399145,0cyclictest0-21swapper/120:55:141
219399144,7cyclictest1959-21sshd19:50:111
218899140,13cyclictest0-21swapper/020:45:160
218899140,13cyclictest0-21swapper/019:36:240
220399139,3cyclictest135650irq/27-eth020:41:583
220399139,3cyclictest10950irq/23-ehci_hcd20:28:023
2203991311,1cyclictest0-21swapper/319:55:543
220399130,4cyclictest2812-21munin-node20:20:173
220399130,4cyclictest24206-21runrttasks21:08:033
220399130,4cyclictest15479-21munin-node20:50:203
220399130,12cyclictest1131-21jbd2/dm-2-819:20:123
220399130,12cyclictest0-21swapper/321:02:393
220399130,12cyclictest0-21swapper/319:51:073
220399130,12cyclictest0-21swapper/319:26:133
220399130,11cyclictest16264-21diskstats19:40:093
219899138,4cyclictest0-21swapper/219:51:012
219899131,4cyclictest0-21swapper/220:25:152
219899131,3cyclictest0-21swapper/221:05:172
219899131,11cyclictest135650irq/27-eth019:27:082
2198991311,1cyclictest0-21swapper/220:54:382
219899130,12cyclictest3703-21taskset20:23:142
219899130,12cyclictest0-21swapper/220:41:102
219899130,12cyclictest0-21swapper/219:56:072
219899130,12cyclictest0-21swapper/219:17:252
219399138,4cyclictest19930-21runrttasks19:46:091
219399136,4cyclictest135650irq/27-eth020:40:381
219399133,1cyclictest0-21swapper/120:15:141
219399130,2cyclictest0-21swapper/120:10:121
219399130,12cyclictest0-21swapper/120:20:061
219399130,11cyclictest6403-21munin-node20:30:111
218899137,5cyclictest0-21swapper/021:02:350
218899137,2cyclictest0-21swapper/020:24:140
218899132,1cyclictest144550irq/28-eth1-rx-19:44:560
218899130,8cyclictest0-21swapper/021:05:250
218899130,1cyclictest0-21swapper/020:14:220
218899130,1cyclictest0-21swapper/019:29:450
220399120,3cyclictest9520-21memory20:35:183
220399120,3cyclictest6688-21diskstats20:30:143
220399120,3cyclictest2533-21df19:10:113
220399120,11cyclictest739-21smicount20:15:203
220399120,11cyclictest28795-21grep20:05:213
220399120,10cyclictest25936-21memory20:00:193
219899128,3cyclictest2676-21fschecks_count19:10:142
219899128,3cyclictest18025-21df20:55:122
219899120,3cyclictest8906-21df20:35:132
219899120,3cyclictest14422-21iostat_ios19:35:142
219899120,11cyclictest8475-21runrttasks19:20:232
219899120,10cyclictest18491-21munin-node19:45:122
219399123,7cyclictest15783-21df_abs20:50:131
219399120,3cyclictest5252-21ntp_states20:25:231
218899127,1cyclictest0-21swapper/020:16:560
218899123,1cyclictest0-21swapper/019:49:160
218899121,9cyclictest0-21swapper/020:03:340
2188991211,1cyclictest0-21swapper/020:51:060
2188991210,1cyclictest0-21swapper/019:15:010
218899120,2cyclictest0-21swapper/020:31:340
218899120,12cyclictest0-21swapper/019:21:000
218899120,11cyclictest0-21swapper/020:06:320
218899110,3cyclictest0-21swapper/020:42:030
218899110,2cyclictest0-21swapper/020:26:000
218899110,1cyclictest0-21swapper/019:13:340
218899110,10cyclictest0-21swapper/020:55:040
218899110,10cyclictest0-21swapper/020:35:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional