You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 16:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 28, 2025 12:44:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3241821380,2sleep12092599cyclictest12:00:571
2393221360,0sleep223925-21sshd09:31:162
436621320,0sleep04365-21bash11:48:090
402521290,2sleep30-21swapper/312:14:343
1696921170,1sleep10-21swapper/110:17:441
1632321080,1sleep216322-21sshd10:07:392
19080210433,39sleep30-21swapper/307:05:173
824321010,1sleep18240-21sshd12:32:001
263352940,2sleep226331-21ps12:00:232
193822940,3sleep02092499cyclictest10:38:030
189352940,1sleep233-21ksoftirqd/207:05:152
2047329333,56sleep10-21swapper/107:07:501
9602910,0sleep1954-21sshd11:13:151
272142890,2sleep127215-21latency_hist09:15:001
228372890,2sleep122828-21sshd09:51:401
228372890,2sleep122828-21sshd09:51:391
168932890,4sleep20-21swapper/210:44:272
86932880,2sleep31847-21nfsd11:28:123
46882880,1sleep04680-21sshd11:51:300
74852870,4sleep22092699cyclictest09:12:532
58442870,0sleep11847-21nfsd11:48:181
37542870,2sleep23745-21sshd11:58:092
286662850,1sleep228655-21sshd11:40:182
286662850,1sleep228655-21sshd11:40:182
186602850,1sleep00-21swapper/011:39:200
97952820,1sleep30-21swapper/311:41:403
97952820,1sleep30-21swapper/311:41:393
53012800,2sleep30-21swapper/311:37:553
48552800,2sleep20-21swapper/210:26:192
56682790,2sleep20-21swapper/211:24:432
299952790,1sleep00-21swapper/011:57:320
80212780,2sleep20-21swapper/209:00:262
247942780,2sleep124793-21bash09:45:061
250242770,3sleep02092499cyclictest12:06:490
229202770,2sleep31848-21nfsd12:00:073
186482770,1sleep01847-21nfsd12:12:420
48172760,2sleep10-21swapper/109:19:211
196352760,1sleep30-21swapper/310:24:403
10012760,1sleep10-21swapper/111:30:441
253242750,1sleep08-21rcu_preempt09:21:160
109602740,2sleep12092599cyclictest09:40:091
31152720,1sleep10-21swapper/111:37:401
147652720,1sleep02092499cyclictest09:50:470
147652720,1sleep02092499cyclictest09:50:460
115032720,3sleep02092499cyclictest12:22:010
323942710,0sleep00-21swapper/010:55:560
63762680,3sleep02092499cyclictest12:31:460
197052680,2sleep119693-21sshd10:14:441
22332640,1sleep20-21swapper/207:40:002
64152633,58sleep1135650irq/27-eth010:00:061
307732630,0sleep11848-21nfsd09:25:141
2054625934,22sleep00-21swapper/007:08:460
202312550,4sleep32092799cyclictest10:48:043
304602530,1sleep01848-21nfsd10:42:280
293802530,2sleep129367-21sshd12:27:181
155182470,1sleep10-21swapper/110:07:341
139762340,3sleep10-21swapper/112:22:171
20924993128,2cyclictest0-21swapper/011:44:590
20924993128,2cyclictest0-21swapper/011:44:580
111602310,28sleep3135650irq/27-eth010:40:243
20924993013,14cyclictest3-21ksoftirqd/011:03:070
193322300,2sleep30-21swapper/311:32:373
191682290,1sleep20-21swapper/209:47:522
165522290,2sleep116493-21sshd12:19:091
39672280,3sleep10-21swapper/110:29:431
20927992824,2cyclictest0-21swapper/311:48:553
179822280,2sleep30-21swapper/311:18:593
272472270,2sleep10-21swapper/109:24:591
239582270,6sleep20-21swapper/210:58:382
2092499276,18cyclictest8-21rcu_preempt10:47:580
20924992614,2cyclictest0-21swapper/009:13:040
2092499261,22cyclictest0-21swapper/011:09:040
20924992511,6cyclictest23079-21kworker/0:011:16:070
129142250,23sleep1135650irq/27-eth009:57:251
67362240,22sleep2135650irq/27-eth010:13:222
311832240,22sleep2135650irq/27-eth011:54:222
225072240,22sleep3135650irq/27-eth009:31:063
2092499249,8cyclictest3-21ksoftirqd/010:18:520
2092499241,20cyclictest23292-21sshd09:55:100
2092499241,14cyclictest30106-21cp12:27:220
2092499240,21cyclictest0-21swapper/012:01:260
143412240,2sleep214331-21sshd10:34:092
324542230,21sleep3135650irq/27-eth012:37:483
2092499237,14cyclictest3-21ksoftirqd/009:41:100
20924992312,9cyclictest3-21ksoftirqd/011:21:080
2092499231,13cyclictest22333-21bash11:11:570
20924992310,6cyclictest3-21ksoftirqd/010:14:180
156472230,1sleep08-21rcu_preempt12:36:080
127872230,2sleep20-21swapper/212:25:322
286802220,2sleep30-21swapper/310:28:533
284602220,1sleep10-21swapper/111:54:041
20924992217,3cyclictest3-21ksoftirqd/009:17:070
2092499221,2cyclictest36-21rcuop/210:30:490
20924992210,4cyclictest0-21swapper/010:00:550
192082220,20sleep1135650irq/27-eth010:47:591
136052220,3sleep10-21swapper/110:57:321
75722210,2sleep30-21swapper/311:51:493
318002210,2sleep231786-21sshd10:35:492
302612210,19sleep2135650irq/27-eth012:13:582
238182210,2sleep323819-21sshd11:01:513
2092799218,3cyclictest21394-21sshd09:54:583
2092799218,3cyclictest21394-21sshd09:54:583
2092799216,6cyclictest1846-21nfsd11:06:543
2092699210,15cyclictest14039-21timerandwakeup11:25:262
2092599211,0cyclictest0-21swapper/112:35:251
20924992113,4cyclictest3-21ksoftirqd/010:07:490
2092499210,19cyclictest47-21rcuop/312:18:290
136922210,19sleep3135650irq/27-eth012:22:173
120982212,17sleep210950irq/23-ehci_hcd12:05:282
323962201,17sleep1135650irq/27-eth010:52:451
20927992014,4cyclictest16868-21bash09:40:373
2092699205,3cyclictest9493-21sshd11:10:252
2092699205,3cyclictest0-21swapper/209:37:412
20926992015,4cyclictest1847-21nfsd11:47:012
2092699200,12cyclictest5037-21id09:25:512
20924992013,5cyclictest3-21ksoftirqd/009:39:530
20924992012,6cyclictest3-21ksoftirqd/011:33:050
2092499201,16cyclictest3-21ksoftirqd/009:25:190
171242200,1sleep20-21swapper/212:22:382
53922190,16sleep3135650irq/27-eth009:15:553
20927991913,5cyclictest11886-21sshd10:00:303
20927991913,4cyclictest22145-21id10:38:203
20927991913,4cyclictest18695-21bash12:15:553
20927991911,3cyclictest10950irq/23-ehci_hcd12:05:503
2092799190,17cyclictest9334-21rm10:30:133
2092799190,12cyclictest18056-21sshd10:51:133
2092699195,3cyclictest27989-21sshd11:16:092
2092699194,3cyclictest1848-21nfsd11:37:292
2092699190,10cyclictest1108-21sshd11:09:432
2092599197,2cyclictest0-21swapper/111:40:041
2092599197,2cyclictest0-21swapper/111:40:041
2092599190,6cyclictest10258-21sshd10:23:421
2092599190,13cyclictest0-21swapper/111:29:321
20924991915,2cyclictest3-21ksoftirqd/011:26:070
20924991913,5cyclictest3-21ksoftirqd/010:28:490
2092499191,17cyclictest0-21swapper/010:20:020
2092499190,7cyclictest30987-21sshd09:49:100
249202180,16sleep326950irq/26-ahci[00009:58:403
2092799188,2cyclictest0-21swapper/311:55:233
20927991813,3cyclictest31513-21rm09:45:403
20927991811,2cyclictest1847-21nfsd09:11:143
2092699187,2cyclictest0-21swapper/209:42:452
20926991811,5cyclictest15498-21sshd10:20:522
2092699180,10cyclictest31135-21sshd09:59:182
2092599186,5cyclictest0-21swapper/110:34:101
2092599183,12cyclictest8065-21sshd11:17:401
2092499188,7cyclictest0-21swapper/008:20:050
20924991814,2cyclictest3-21ksoftirqd/009:30:350
20924991813,3cyclictest3-21ksoftirqd/010:54:570
2092799175,3cyclictest2021-21sshd10:56:093
2092799171,5cyclictest28791-21sshd12:27:153
20927991711,4cyclictest22432-21sshd12:30:063
2092799171,11cyclictest26271-21bash10:11:593
2092799170,16cyclictest30338-21bash09:25:133
2092699179,2cyclictest135650irq/27-eth010:16:002
2092699176,5cyclictest26340-21sshd12:30:242
2092699173,9cyclictest144550irq/28-eth1-rx-08:23:212
2092699173,6cyclictest0-21swapper/210:52:252
2092699172,7cyclictest1848-21nfsd08:40:092
20926991711,4cyclictest2959-21rm12:35:002
2092699170,8cyclictest13580-21sshd11:32:012
2092699170,11cyclictest28058-21sshd09:15:042
2092699170,11cyclictest0-21swapper/209:20:452
2092699170,10cyclictest0-21swapper/210:47:572
2092599176,3cyclictest5247-21sshd11:06:391
2092599172,2cyclictest16623-21sshd11:56:011
2092599172,1cyclictest12635-21sshd12:05:311
2092599170,3cyclictest11164-21sshd11:00:301
12022170,15sleep326950irq/26-ahci[00009:39:083
118902170,15sleep2135650irq/27-eth010:00:312
2092799168,6cyclictest30796-21sshd11:12:573
20927991612,3cyclictest10950irq/23-ehci_hcd07:25:573
20927991610,4cyclictest0-21swapper/310:16:523
2092799160,4cyclictest9914-21bash11:21:373
2092799160,14cyclictest15064-21sshd10:07:323
2092699168,6cyclictest26748-21taskset08:30:532
2092699162,9cyclictest0-21swapper/208:00:132
2092699162,6cyclictest144550irq/28-eth1-rx-09:07:572
2092699162,3cyclictest12675-21bash09:50:332
2092699162,3cyclictest12675-21bash09:50:332
2092699162,2cyclictest10292-21sshd12:18:292
20926991612,3cyclictest0-21swapper/211:02:112
2092599169,1cyclictest7596-21sshd09:32:591
20925991612,3cyclictest10950irq/23-ehci_hcd08:00:151
2092599160,3cyclictest0-21swapper/112:10:141
2092599160,2cyclictest0-21swapper/110:37:421
2092499160,15cyclictest0-21swapper/007:45:220
34832151,12sleep2135650irq/27-eth008:50:422
2092799154,3cyclictest10950irq/23-ehci_hcd08:05:503
20927991511,3cyclictest10950irq/23-ehci_hcd07:23:253
2092799151,13cyclictest0-21swapper/307:10:163
2092799150,6cyclictest1848-21nfsd08:55:233
2092799150,14cyclictest2405-21runrttasks07:40:583
2092799150,13cyclictest17796-21sshd09:20:303
2092699154,10cyclictest144550irq/28-eth1-rx-08:57:002
2092699150,11cyclictest227112sleep207:11:532
2092599152,0cyclictest0-21swapper/109:36:281
20925991512,2cyclictest0-21swapper/110:42:091
2092599150,4cyclictest4973-21sshd11:21:041
2092599150,2cyclictest0-21swapper/107:50:171
2092499150,5cyclictest0-21swapper/009:01:280
2092499150,14cyclictest0-21swapper/008:52:360
2092799141,11cyclictest30393-21diskstats07:30:123
20927991410,3cyclictest10950irq/23-ehci_hcd08:47:263
2092799140,5cyclictest0-21swapper/307:39:143
2092699144,9cyclictest144550irq/28-eth1-rx-07:20:092
2092699143,10cyclictest144550irq/28-eth1-rx-08:12:172
2092699142,1cyclictest0-21swapper/207:25:392
2092699141,4cyclictest0-21swapper/207:45:122
2092699141,11cyclictest0-21swapper/208:45:182
2092699140,10cyclictest319972sleep207:33:572
2092599147,6cyclictest0-21swapper/107:41:141
2092599146,6cyclictest0-21swapper/108:25:161
20925991410,3cyclictest10950irq/23-ehci_hcd07:24:291
20925991410,3cyclictest0-21swapper/107:36:501
2092599140,11cyclictest10950irq/23-ehci_hcd07:17:421
2092599140,10cyclictest177572sleep108:12:331
2092499148,5cyclictest0-21swapper/008:37:270
2092499148,3cyclictest0-21swapper/008:01:000
20924991411,1cyclictest0-21swapper/007:40:200
2092499140,2cyclictest24865-21munin-node07:15:230
2092499140,13cyclictest0-21swapper/008:45:180
2092499140,13cyclictest0-21swapper/008:27:330
2092499140,13cyclictest0-21swapper/008:05:480
2092499140,13cyclictest0-21swapper/007:25:050
2092499140,11cyclictest0-21swapper/008:33:480
2092799132,10cyclictest10950irq/23-ehci_hcd08:53:433
2092799132,10cyclictest10950irq/23-ehci_hcd07:51:223
2092799131,3cyclictest0-21swapper/309:00:173
2092799131,3cyclictest0-21swapper/308:30:143
2092799131,3cyclictest0-21swapper/307:45:223
2092799131,10cyclictest0-21swapper/308:00:123
2092799130,5cyclictest0-21swapper/309:05:513
2092799130,4cyclictest9816-21cat07:55:133
2092799130,4cyclictest0-21swapper/308:15:173
2092799130,12cyclictest10950irq/23-ehci_hcd08:35:033
2092799130,12cyclictest0-21swapper/307:15:133
2092799130,11cyclictest30357-21munin-node08:40:143
2092799130,11cyclictest21274-21irqstats08:20:173
2092799130,11cyclictest16255-21df_inode08:10:103
2092699132,2cyclictest0-21swapper/208:39:092
2092699131,3cyclictest0-21swapper/207:35:142
2092699130,12cyclictest0-21swapper/208:25:082
2092699130,12cyclictest0-21swapper/208:17:562
2092699130,10cyclictest135650irq/27-eth007:16:152
2092599139,3cyclictest21820-21munin-node07:10:171
2092599139,3cyclictest135650irq/27-eth008:42:061
2092599139,3cyclictest135650irq/27-eth007:55:131
2092599138,4cyclictest0-21swapper/107:26:521
2092599137,5cyclictest0-21swapper/108:51:021
2092599132,10cyclictest135650irq/27-eth009:05:471
2092599132,10cyclictest135650irq/27-eth008:55:011
2092599130,12cyclictest0-21swapper/109:03:161
2092599130,12cyclictest0-21swapper/108:46:001
2092599130,12cyclictest0-21swapper/108:38:081
2092599130,12cyclictest0-21swapper/107:47:401
2092599130,12cyclictest0-21swapper/107:32:281
2092499138,4cyclictest0-21swapper/008:40:120
2092499138,2cyclictest0-21swapper/007:13:060
2092499135,4cyclictest0-21swapper/007:35:150
2092499131,1cyclictest0-21swapper/007:51:350
2092499130,12cyclictest0-21swapper/008:58:210
2092499130,10cyclictest2405-21runrttasks08:16:130
2092499130,10cyclictest0-21swapper/007:30:120
2092799120,3cyclictest23106-21munin-node08:25:113
2092699128,3cyclictest7078-21df07:50:132
2092699120,11cyclictest9082-21munin-node07:55:102
2092699120,11cyclictest13919-21df08:05:112
2092599121,10cyclictest135650irq/27-eth008:20:521
2092599120,11cyclictest1915-21snmpd08:32:261
2092599120,11cyclictest135650irq/27-eth008:19:011
2092599120,11cyclictest0-21swapper/108:05:041
2092499123,1cyclictest0-21swapper/007:55:140
2092499120,8cyclictest27128-21unixbench_singl07:20:230
2092499120,1cyclictest0-21swapper/008:10:010
2092499120,11cyclictest0-21swapper/009:05:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional