You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-13 - 08:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack5slot0.osadl.org (updated Sat Sep 13, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2585621500,2sleep10-21swapper/123:43:491
698521480,1sleep22248699cyclictest22:49:192
388621350,4sleep30-21swapper/321:15:163
778121320,0sleep00-21swapper/023:41:590
677221250,0sleep00-21swapper/021:45:320
2366321220,4sleep22248699cyclictest21:35:112
2200321210,2sleep322004-21sshd21:31:573
211121190,1sleep20-21swapper/222:09:222
1421621150,3sleep32249199cyclictest21:46:153
2444921140,2sleep10-21swapper/100:06:011
994421120,2sleep10-21swapper/121:30:461
1803121090,1sleep12248199cyclictest23:12:141
1304821090,3sleep02247599cyclictest23:11:460
22190210532,44sleep30-21swapper/319:09:273
22072210533,43sleep10-21swapper/119:07:581
2721521020,2sleep02247599cyclictest22:26:480
260482980,0sleep30-21swapper/300:12:493
29232950,4sleep12248199cyclictest22:33:381
84652930,2sleep20-21swapper/223:01:582
250852930,1sleep30-21swapper/323:28:203
144932920,0sleep00-21swapper/021:37:180
62202910,2sleep20-21swapper/200:00:572
22032890,1sleep30-21swapper/322:58:143
318752880,1sleep20-21swapper/200:26:342
23792880,1sleep02376-21bash21:12:050
119432880,0sleep011944-21sshd21:34:050
282712870,1sleep00-21swapper/022:51:130
244912870,2sleep124481-21sshd21:29:131
196322860,1sleep119618-21sshd21:40:441
51212850,1sleep01848-21nfsd23:20:150
25032840,2sleep20-21swapper/223:54:162
262502830,2sleep326249-21sshd00:19:303
88112820,2sleep30-21swapper/323:17:343
11482820,2sleep21145-21sshd00:06:592
6172810,1sleep30-21swapper/323:10:323
317462810,1sleep10-21swapper/123:31:591
121942810,2sleep112195-21sshd23:20:521
11562810,1sleep32249199cyclictest22:36:333
34582800,2sleep20-21swapper/223:29:232
66262790,2sleep26617-21sshd22:18:522
24572790,3sleep22248699cyclictest23:57:252
160412780,2sleep10-21swapper/122:13:421
307762760,2sleep130774-21sshd22:02:561
296372760,0sleep229638-21sshd00:13:132
267982740,2sleep326797-21sshd00:22:473
254002740,3sleep02247599cyclictest21:44:230
6162730,1sleep0613-21sshd00:00:240
146542710,1sleep314652-21sshd23:36:263
315722690,1sleep031568-21sshd23:31:570
238162610,2sleep20-21swapper/221:47:102
189882590,2sleep31959-21sshd00:08:483
2218025632,13sleep00-21swapper/019:09:200
2186625034,11sleep20-21swapper/219:05:382
22475994027,4cyclictest0-21swapper/022:21:140
22486993933,4cyclictest28234-21sshd22:54:292
22491993832,4cyclictest1847-21nfsd21:37:343
36692370,2sleep01893-21nscd22:45:520
135872360,2sleep10-21swapper/123:45:411
22491993530,3cyclictest6979-21sshd22:18:543
103122350,7sleep03-21ksoftirqd/021:55:020
212072340,2sleep221208-21bash23:37:042
248262330,31sleep3135650irq/27-eth023:40:273
107612330,31sleep3135650irq/27-eth022:52:413
152452300,2sleep315243-21bash22:40:543
237482290,3sleep20-21swapper/223:12:472
50002280,2sleep14995-21sshd22:06:341
2247599280,26cyclictest29782-21sshd22:17:590
196582280,3sleep219656-21sshd21:55:482
49262270,2sleep11848-21nfsd21:21:211
22491992712,6cyclictest135650irq/27-eth022:05:003
213352260,3sleep02247599cyclictest00:22:130
308122250,0sleep041ktimersoftd/000:06:400
2248699251,3cyclictest21019-21sshd22:32:162
22481992515,7cyclictest28601-21bash21:50:341
22475992514,2cyclictest0-21swapper/023:54:470
2247599250,3cyclictest2712-21rm23:57:270
2247599250,11cyclictest5538-21bash22:36:590
57902240,22sleep2135650irq/27-eth023:32:362
22491992419,4cyclictest1905-21nscd21:41:093
2248699240,22cyclictest1848-21nfsd00:16:022
2248199249,6cyclictest135650irq/27-eth021:55:051
2247599248,3cyclictest0-21swapper/022:40:240
2247599242,13cyclictest32499-21sshd00:37:020
2247599240,1cyclictest28528-21sshd00:19:440
21522240,4sleep02149-21sshd00:26:530
271592230,1sleep041ktimersoftd/023:37:400
2249199238,1cyclictest20259-21rm23:52:443
22491992312,6cyclictest28944-21sshd23:00:453
2248199238,8cyclictest10950irq/23-ehci_hcd22:42:541
22481992310,7cyclictest10950irq/23-ehci_hcd22:23:131
22475992317,4cyclictest27933-21sshd23:25:240
115132230,0sleep00-21swapper/023:05:200
22491992211,3cyclictest2638-21sshd23:23:073
22486992214,3cyclictest32010-21sshd23:22:502
22486992213,7cyclictest26424-21sshd22:39:012
22486992213,7cyclictest135650irq/27-eth000:30:122
2248699220,3cyclictest23486-21sshd23:09:452
22475992217,4cyclictest27630-21sshd22:02:380
22475992214,4cyclictest0-21swapper/021:20:350
22475992211,6cyclictest3-21ksoftirqd/023:18:150
2247599221,14cyclictest0-21swapper/022:59:230
22475992211,1cyclictest1848-21nfsd22:30:400
2247599220,5cyclictest1848-21nfsd22:06:180
2247599220,16cyclictest0-21swapper/023:01:340
75142210,4sleep12248199cyclictest21:39:431
287952210,2sleep128784-21sshd23:25:301
2249199219,8cyclictest32237-21bash22:30:183
2249199216,3cyclictest0-21swapper/323:34:103
22491992114,5cyclictest10686-21sshd21:58:043
2248699218,4cyclictest10950irq/23-ehci_hcd22:23:342
22486992116,3cyclictest1848-21nfsd23:48:152
22486992114,5cyclictest23620-21sshd22:29:342
22486992114,4cyclictest1848-21nfsd00:39:342
22486992113,6cyclictest1847-21nfsd00:22:332
22486992113,4cyclictest10093-21sshd21:33:552
22486992111,3cyclictest10950irq/23-ehci_hcd23:44:502
2248699210,19cyclictest33-21ksoftirqd/221:40:252
22481992116,3cyclictest12704-21munin-run20:00:001
2248199211,17cyclictest11147-21sshd23:58:191
22481992111,4cyclictest10950irq/23-ehci_hcd00:01:321
2247599211,2cyclictest23235-21sshd23:46:400
2247599210,17cyclictest0-21swapper/022:10:090
2247599210,14cyclictest15802-21sshd21:16:210
136952210,19sleep1135650irq/27-eth000:28:071
2249199209,2cyclictest14878-21df_inode21:10:123
2249199208,4cyclictest17011-21sshd22:07:423
2249199208,2cyclictest9778-21bash00:31:013
22491992015,3cyclictest31390-21cp23:07:163
22491992013,4cyclictest24965-21sshd21:23:153
22491992013,4cyclictest0-21swapper/300:38:113
2249199200,8cyclictest1361-21sshd21:51:053
22486992013,5cyclictest14013-21sshd22:40:472
22486992012,6cyclictest24545-21sshd23:19:042
2248699201,17cyclictest33-21ksoftirqd/222:11:242
2248199207,3cyclictest6924-21bash22:37:071
2248199206,2cyclictest24490-21sshd22:57:131
22481992014,4cyclictest9652-21sshd21:12:471
2247599200,9cyclictest16429-21sshd21:25:230
130732200,18sleep1135650irq/27-eth022:52:551
2249199197,5cyclictest135650irq/27-eth022:26:183
22491991913,3cyclictest0-21swapper/322:46:263
2248699197,1cyclictest10950irq/23-ehci_hcd22:02:402
22486991915,3cyclictest135650irq/27-eth021:17:332
22486991912,3cyclictest13461-21sshd22:59:212
22486991911,2cyclictest10950irq/23-ehci_hcd21:22:112
2248699190,17cyclictest0-21swapper/221:25:382
2248199198,7cyclictest16554-21sshd00:15:141
2248199198,5cyclictest10950irq/23-ehci_hcd00:37:481
2248199196,5cyclictest135650irq/27-eth023:07:281
2248199196,2cyclictest11874-21bash22:46:411
2248199194,6cyclictest1847-21nfsd23:52:271
2248199193,3cyclictest31079-21sshd21:47:511
2248199192,8cyclictest14678-21sshd23:02:331
22481991910,3cyclictest10950irq/23-ehci_hcd00:10:281
2247599193,9cyclictest0-21swapper/021:53:510
2249199187,2cyclictest27514-21sshd23:56:393
22491991810,1cyclictest10252-21sshd22:10:083
2249199180,6cyclictest23789-21sshd00:25:453
22486991812,4cyclictest25290-21sshd21:50:192
2248199189,2cyclictest2382-21sshd00:30:201
2248199182,8cyclictest6958-21sshd23:17:231
22481991813,3cyclictest0-21swapper/122:26:531
2248199181,14cyclictest31281-21bash22:15:091
22481991811,4cyclictest17675-21sshd23:36:431
2248199180,14cyclictest1959-21sshd00:21:301
2249199176,2cyclictest6215-21sshd22:24:563
2249199171,3cyclictest0-21swapper/323:46:593
2249199170,6cyclictest27854-21sshd21:26:273
2248699178,2cyclictest0-21swapper/221:00:552
2248699173,7cyclictest135650irq/27-eth019:14:072
2248199170,5cyclictest29453-21sshd21:17:391
2248699163,8cyclictest135650irq/27-eth019:38:042
2248699163,11cyclictest135650irq/27-eth019:52:512
2248699163,11cyclictest135650irq/27-eth019:43:432
2248199160,3cyclictest144550irq/28-eth1-rx-19:50:111
2247599165,2cyclictest135650irq/27-eth000:31:390
2249199158,4cyclictest0-21swapper/321:09:503
2249199154,7cyclictest0-21swapper/300:00:423
2248699153,5cyclictest135650irq/27-eth019:21:272
2248699153,11cyclictest135650irq/27-eth020:57:192
2248699152,6cyclictest135650irq/27-eth020:42:152
22486991511,3cyclictest17953-21unixbench_singl21:10:242
22486991511,3cyclictest10950irq/23-ehci_hcd19:25:342
2248199150,11cyclictest1915-21snmpd19:11:141
2247599151,11cyclictest0-21swapper/000:10:110
2247599151,10cyclictest0-21swapper/020:35:230
2247599151,10cyclictest0-21swapper/020:35:230
2247599150,12cyclictest0-21swapper/020:20:040
2249199143,10cyclictest10950irq/23-ehci_hcd20:48:583
2249199140,13cyclictest0-21swapper/320:17:333
2249199140,12cyclictest22849-21cut19:10:133
2248699143,7cyclictest135650irq/27-eth019:17:032
2248699143,6cyclictest135650irq/27-eth019:49:592
2248699143,6cyclictest135650irq/27-eth019:34:352
2248699142,7cyclictest135650irq/27-eth019:56:472
2248699141,8cyclictest1131-21jbd2/dm-2-820:36:432
2248699141,8cyclictest1131-21jbd2/dm-2-820:36:432
2248699141,5cyclictest417-21jbd2/dm-0-821:06:152
2248699140,13cyclictest0-21swapper/220:47:242
2248699140,10cyclictest135650irq/27-eth020:23:202
22481991412,1cyclictest0-21swapper/121:01:521
22481991412,1cyclictest0-21swapper/120:11:511
22481991412,1cyclictest0-21swapper/119:32:121
22481991410,3cyclictest10950irq/23-ehci_hcd20:35:091
22481991410,3cyclictest10950irq/23-ehci_hcd20:35:091
2248199140,4cyclictest2405-21runrttasks20:46:091
22475991410,3cyclictest0-21swapper/020:46:320
2249199138,4cyclictest13348-21fschecks_count20:00:153
2249199137,5cyclictest0-21swapper/320:20:083
22491991311,1cyclictest0-21swapper/320:51:013
2249199130,12cyclictest0-21swapper/320:10:533
2249199130,12cyclictest0-21swapper/320:08:033
2249199130,12cyclictest0-21swapper/319:56:213
2249199130,12cyclictest0-21swapper/319:38:353
2249199130,12cyclictest0-21swapper/319:32:053
2249199130,12cyclictest0-21swapper/319:25:393
2249199130,12cyclictest0-21swapper/319:23:273
2249199130,11cyclictest7924-21munin-node21:00:213
2249199130,11cyclictest6090-21munin-node19:45:223
2248699138,1cyclictest0-21swapper/220:51:102
2248699137,5cyclictest17823-21munin-node20:10:142
2248699137,5cyclictest0-21swapper/220:05:162
2248699130,12cyclictest10950irq/23-ehci_hcd20:25:532
2248699130,12cyclictest0-21swapper/220:15:242
2248699130,11cyclictest26940-21df_inode20:30:142
2248699130,11cyclictest13200-21munin-node20:00:142
2248199137,5cyclictest0-21swapper/120:57:441
2248199137,5cyclictest0-21swapper/120:02:241
2248199137,4cyclictest1915-21snmpd20:05:431
22481991311,1cyclictest0-21swapper/120:44:251
22481991311,1cyclictest0-21swapper/120:19:501
22481991311,1cyclictest0-21swapper/119:15:231
2248199130,9cyclictest12406-21munin-plugin-st21:10:001
2248199130,12cyclictest0-21swapper/120:25:081
2248199130,11cyclictest3817-21munin-node19:40:141
2248199130,11cyclictest27942-21memory19:20:181
2248199130,11cyclictest27767-21ntp_states20:30:201
2248199130,11cyclictest22940-21memory20:20:171
2248199130,11cyclictest0-21swapper/119:35:141
2248199130,11cyclictest0-21swapper/119:25:261
2247599138,4cyclictest0-21swapper/021:01:420
2247599137,3cyclictest0-21swapper/021:06:000
22475991312,1cyclictest0-21swapper/020:59:250
22475991311,1cyclictest0-21swapper/020:11:310
2247599130,1cyclictest0-21swapper/019:41:240
2247599130,1cyclictest0-21swapper/019:32:340
2247599130,12cyclictest0-21swapper/020:50:370
2247599130,12cyclictest0-21swapper/020:30:160
2247599130,10cyclictest0-21swapper/019:45:220
2247599130,10cyclictest0-21swapper/019:35:380
2249199125,3cyclictest10950irq/23-ehci_hcd20:55:203
2249199121,3cyclictest0-21swapper/319:15:013
22491991210,1cyclictest0-21swapper/320:30:103
2249199120,4cyclictest0-21swapper/319:50:023
2249199120,3cyclictest24665-21diskstats20:25:143
2249199120,11cyclictest0-21swapper/320:41:563
2249199120,11cyclictest0-21swapper/320:35:303
2249199120,11cyclictest0-21swapper/320:35:293
2249199120,11cyclictest0-21swapper/319:40:053
2248199120,9cyclictest10950irq/23-ehci_hcd20:50:151
2248199120,11cyclictest0-21swapper/119:45:041
2247599126,3cyclictest0-21swapper/019:28:040
22475991211,1cyclictest0-21swapper/019:18:410
2247599120,7cyclictest0-21swapper/020:40:160
2247599120,7cyclictest0-21swapper/020:00:170
2247599120,1cyclictest0-21swapper/019:14:070
2247599120,11cyclictest0-21swapper/020:25:070
2247599112,1cyclictest0-21swapper/020:05:210
2247599110,7cyclictest0-21swapper/020:15:170
2247599110,1cyclictest0-21swapper/019:55:020
2247599110,1cyclictest0-21swapper/019:51:000
2247599100,9cyclictest0-21swapper/019:20:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional