You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-30 - 04:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sat Aug 30, 2025 00:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
449621410,1sleep24491-21rm23:58:242
178021400,2sleep32278999cyclictest23:30:083
1574221310,1sleep31847-21nfsd21:31:433
1500521250,1sleep115004-21bash21:22:311
653821210,3sleep22278899cyclictest22:19:442
124921190,1sleep10-21swapper/123:17:471
3101421100,3sleep12278799cyclictest21:27:041
1709821050,2sleep12278799cyclictest23:00:391
2241929833,44sleep30-21swapper/319:08:403
117342980,1sleep10-21swapper/122:35:261
127942960,1sleep01847-21nfsd00:24:390
216262940,1sleep021616-21sshd21:16:570
194552910,2sleep319454-21bash21:16:443
241852890,2sleep124171-21sshd22:03:041
158222890,2sleep315827-21cut00:15:123
3662860,1sleep00-21swapper/022:59:100
3662860,1sleep00-21swapper/022:59:100
172912860,4sleep22278899cyclictest22:11:302
233592840,3sleep10-21swapper/123:29:061
78772820,2sleep10-21swapper/121:34:061
21392820,1sleep20-21swapper/221:51:462
188582820,2sleep10-21swapper/100:28:331
2233828133,44sleep10-21swapper/119:07:361
193162810,1sleep319314-21bash22:26:593
162172810,2sleep20-21swapper/223:50:112
10072810,2sleep21000-21sshd22:00:482
35512800,5sleep20-21swapper/221:36:392
295262800,1sleep02405-21runrttasks22:03:350
233912800,2sleep10-21swapper/122:58:151
233912800,2sleep10-21swapper/122:58:151
175362790,2sleep02278699cyclictest00:12:000
63742780,1sleep26355-21sshd21:43:052
219362780,0sleep321931-21sshd23:35:083
44872770,1sleep14488-21bash00:07:411
149772770,3sleep214976-21sshd22:29:422
242462750,5sleep22278899cyclictest22:30:262
202382740,2sleep20-21swapper/221:56:312
82332730,0sleep00-21swapper/022:16:450
251382730,1sleep025124-21sshd22:36:450
183242720,4sleep12278799cyclictest00:12:061
229842710,1sleep222985-21id00:00:122
95882700,2sleep32278999cyclictest23:49:313
75152690,4sleep22278899cyclictest22:53:392
233602690,0sleep00-21swapper/021:41:340
71502650,3sleep32278999cyclictest23:18:223
2239326234,24sleep20-21swapper/219:08:182
121592610,2sleep22278899cyclictest22:41:362
95162540,2sleep19510-21cp21:18:551
192512500,2sleep20-21swapper/221:22:562
202152490,46sleep1135650irq/27-eth023:38:041
2220324235,4sleep00-21swapper/019:06:120
127862422,32sleep2135650irq/27-eth023:49:512
2278699380,35cyclictest15232-21sshd22:20:250
2278699380,12cyclictest16099-21sshd00:15:140
2278699370,14cyclictest0-21swapper/023:09:200
218732360,2sleep121874-21bash23:56:551
2278699357,5cyclictest0-21swapper/023:18:340
22788993430,3cyclictest0-21swapper/200:06:342
2278699340,6cyclictest8442-21sshd00:34:120
2278699340,12cyclictest15912-21sshd21:46:590
2278699338,2cyclictest23558-21sshd22:00:000
2278699330,2cyclictest14975-21sshd23:37:320
323542310,1sleep00-21swapper/023:42:180
260142300,25sleep1135650irq/27-eth021:54:071
242312300,0sleep124232-21id22:49:011
22787993019,10cyclictest22-21ksoftirqd/123:13:431
2278699308,2cyclictest0-21swapper/023:28:310
2278699300,15cyclictest19887-21bash22:27:020
292212280,3sleep30-21swapper/322:49:313
267602280,1sleep026755-21sshd21:11:160
267602280,1sleep026755-21sshd21:11:150
2278799286,18cyclictest22-21ksoftirqd/123:50:281
2278699280,15cyclictest0-21swapper/021:54:050
120852280,1sleep00-21swapper/023:00:140
290782270,25sleep2135650irq/27-eth000:29:392
22787992717,2cyclictest10950irq/23-ehci_hcd23:48:521
22787992710,16cyclictest22-21ksoftirqd/123:42:171
2278799270,20cyclictest22-21ksoftirqd/122:06:451
2278699270,8cyclictest7576-21sshd22:44:180
2278699270,18cyclictest16873-21sshd00:35:060
2278699270,15cyclictest20953-21sshd22:48:410
164542270,2sleep216426-21sshd21:10:182
164542270,2sleep216426-21sshd21:10:182
125592270,3sleep20-21swapper/221:28:262
22789992610,6cyclictest10950irq/23-ehci_hcd22:20:133
2278799267,17cyclictest22-21ksoftirqd/123:22:501
22787992613,5cyclictest1847-21nfsd23:05:441
22787992612,9cyclictest1846-21nfsd00:19:331
171022260,2sleep217088-21sshd23:25:212
164792260,4sleep30-21swapper/322:54:323
160242260,1sleep20-21swapper/200:31:312
14922260,1sleep30-21swapper/321:24:223
147182260,2sleep32405-21runrttasks22:11:153
71552250,2sleep11848-21nfsd21:40:071
297632250,3sleep00-21swapper/023:57:420
64042240,2sleep26393-21sshd22:38:042
22789992411,6cyclictest10950irq/23-ehci_hcd23:14:233
22787992416,7cyclictest22-21ksoftirqd/121:36:121
22787992414,7cyclictest31941-21sshd00:33:151
22787992411,10cyclictest13489-21sshd00:24:431
2278699240,8cyclictest27701-21sshd23:14:100
191972240,2sleep20-21swapper/200:38:482
294562230,3sleep22278899cyclictest22:46:172
22789992317,4cyclictest17315-21bash21:10:213
22789992317,4cyclictest17315-21bash21:10:203
22789992310,5cyclictest10950irq/23-ehci_hcd23:42:573
2278799233,17cyclictest22-21ksoftirqd/122:12:051
22787992318,1cyclictest14732-21sshd21:50:001
22787992316,4cyclictest0-21swapper/121:55:161
22787992315,5cyclictest31960-21sshd22:40:241
2278799230,21cyclictest22-21ksoftirqd/122:30:581
2278799230,21cyclictest22-21ksoftirqd/122:29:501
2278799230,20cyclictest22-21ksoftirqd/100:36:221
2278699234,4cyclictest28459-21sshd00:00:380
2278699230,7cyclictest8292-21sshd22:53:440
2278699230,21cyclictest0-21swapper/021:36:440
2278699230,1cyclictest6549-21sshd22:07:290
2278999229,6cyclictest135650irq/27-eth000:26:353
22788992217,3cyclictest0-21swapper/223:31:022
22787992216,4cyclictest1847-21nfsd21:12:501
22787992216,4cyclictest1847-21nfsd21:12:501
2278699226,2cyclictest3779-21sshd21:27:340
2278699220,15cyclictest6738-21bash23:24:280
2278699220,12cyclictest0-21swapper/021:30:120
22789992114,5cyclictest30495-21sshd21:48:233
22789992112,3cyclictest135650irq/27-eth000:30:333
22788992112,2cyclictest10950irq/23-ehci_hcd23:11:112
22787992116,3cyclictest22373-21sshd23:32:001
22787992114,5cyclictest1848-21nfsd22:19:471
2278799210,19cyclictest22-21ksoftirqd/122:20:221
2278699217,6cyclictest0-21swapper/019:25:200
2278999208,5cyclictest10950irq/23-ehci_hcd00:36:533
2278999208,4cyclictest10950irq/23-ehci_hcd21:56:213
22789992014,4cyclictest1848-21nfsd23:26:393
2278999200,17cyclictest17013-21sshd22:39:053
22788992011,3cyclictest10950irq/23-ehci_hcd22:20:572
22788992010,2cyclictest135650irq/27-eth000:11:242
22787992013,4cyclictest27191-21bash00:03:411
2278799200,18cyclictest22-21ksoftirqd/122:50:091
22786992014,5cyclictest0-21swapper/000:06:330
181742200,1sleep20-21swapper/223:16:152
60532190,1sleep30-21swapper/321:40:013
2278999199,3cyclictest10950irq/23-ehci_hcd22:03:203
2278999198,4cyclictest29330-21sshd21:36:003
2278999197,5cyclictest10950irq/23-ehci_hcd00:20:123
22789991915,2cyclictest21558-21sshd22:15:033
22789991914,4cyclictest1848-21nfsd22:08:563
22789991912,1cyclictest10950irq/23-ehci_hcd23:01:513
22789991910,6cyclictest26970-21sshd23:07:543
22789991910,1cyclictest10950irq/23-ehci_hcd00:08:303
324492180,16sleep3135650irq/27-eth022:34:293
2278999189,2cyclictest14119-21id22:41:483
22789991812,1cyclictest5323-21cp00:14:083
22789991811,5cyclictest24866-21sshd00:03:283
22788991814,3cyclictest7104-21sshd23:24:312
22788991811,5cyclictest14834-21sshd21:46:532
22788991810,2cyclictest10950irq/23-ehci_hcd23:07:182
2278999177,7cyclictest19762-21sshd21:29:083
22789991712,4cyclictest1847-21nfsd23:51:113
22789991712,4cyclictest12450-21sshd23:21:523
2278899175,6cyclictest135650irq/27-eth021:18:012
2278899175,10cyclictest22015-21sshd22:55:032
2278899175,10cyclictest22015-21sshd22:55:032
22788991712,3cyclictest15332-21sshd23:00:282
2278899170,8cyclictest0-21swapper/223:40:042
2278899170,11cyclictest0-21swapper/221:31:282
2278699170,2cyclictest1987-21sshd23:48:460
2278699170,10cyclictest0-21swapper/023:54:120
2278999168,3cyclictest3431-21atenall_r5power23:55:123
2278999166,4cyclictest0-21swapper/321:54:553
2278999160,12cyclictest0-21swapper/322:57:093
2278999160,12cyclictest0-21swapper/322:57:093
2278899168,6cyclictest7221-21sshd00:17:342
2278899162,13cyclictest1847-21nfsd00:21:592
2278899160,14cyclictest0-21swapper/220:00:372
22787991610,5cyclictest10950irq/23-ehci_hcd20:18:421
22786991613,2cyclictest0-21swapper/021:20:390
2278699160,11cyclictest22748-21sshd00:25:300
2278999154,3cyclictest10950irq/23-ehci_hcd20:46:583
22789991511,3cyclictest10950irq/23-ehci_hcd19:30:443
2278899157,5cyclictest0-21swapper/220:25:062
2278899152,9cyclictest3099-21sshd23:36:222
2278899150,13cyclictest0-21swapper/219:20:142
2278799150,13cyclictest0-21swapper/121:02:261
2278699151,2cyclictest0-21swapper/023:34:590
2278699150,14cyclictest0-21swapper/022:10:120
2278999143,3cyclictest10950irq/23-ehci_hcd19:12:033
2278999143,10cyclictest10950irq/23-ehci_hcd20:22:553
2278999140,12cyclictest0-21swapper/319:57:493
2278899149,4cyclictest144550irq/28-eth1-rx-20:51:132
2278899149,4cyclictest135650irq/27-eth020:16:112
2278899142,11cyclictest0-21swapper/220:35:002
22788991410,3cyclictest10950irq/23-ehci_hcd19:44:152
2278899140,13cyclictest9369-21munin-node21:00:182
2278899140,13cyclictest0-21swapper/219:53:282
2278899140,12cyclictest1848-21nfsd22:05:062
2278899140,12cyclictest12232-21sensors_temp19:55:212
2278799143,10cyclictest10950irq/23-ehci_hcd20:38:541
22787991410,3cyclictest10950irq/23-ehci_hcd19:38:001
2278799140,13cyclictest5333-21chrt20:50:371
2278799140,12cyclictest8008-21idleruntime-cro21:00:001
2278799140,11cyclictest0-21swapper/120:25:361
2278699147,4cyclictest0-21swapper/019:21:290
2278699142,7cyclictest0-21swapper/020:25:160
2278699140,13cyclictest0-21swapper/022:33:560
2278699140,13cyclictest0-21swapper/019:55:210
103362141,11sleep1135650irq/27-eth019:50:411
2278999137,5cyclictest0-21swapper/320:50:093
2278999137,5cyclictest0-21swapper/320:09:113
2278999137,5cyclictest0-21swapper/319:50:233
2278999137,5cyclictest0-21swapper/319:35:223
2278999136,6cyclictest0-21swapper/320:43:413
2278999131,11cyclictest0-21swapper/320:12:513
2278999130,12cyclictest0-21swapper/320:35:093
2278999130,12cyclictest0-21swapper/320:31:373
2278999130,12cyclictest0-21swapper/320:25:493
2278999130,12cyclictest0-21swapper/320:15:303
2278999130,12cyclictest0-21swapper/320:01:233
2278999130,12cyclictest0-21swapper/319:48:233
2278999130,11cyclictest0-21swapper/319:40:193
2278899138,3cyclictest22351-21munin-node20:20:142
2278899132,3cyclictest135650irq/27-eth019:30:122
22788991311,1cyclictest0-21swapper/219:37:332
22788991311,1cyclictest0-21swapper/219:25:062
2278899130,5cyclictest0-21swapper/220:57:042
2278899130,12cyclictest0-21swapper/221:05:122
2278899130,12cyclictest0-21swapper/220:45:412
2278899130,12cyclictest0-21swapper/220:30:362
2278899130,12cyclictest0-21swapper/220:12:152
2278899130,12cyclictest0-21swapper/219:11:462
2278899130,10cyclictest144550irq/28-eth1-rx-20:40:552
2278899130,10cyclictest10950irq/23-ehci_hcd19:46:142
2278799138,4cyclictest1927-21snmpd19:34:321
2278799138,4cyclictest0-21swapper/120:30:081
2278799131,4cyclictest135650irq/27-eth020:40:471
22787991311,1cyclictest0-21swapper/119:29:291
2278799130,4cyclictest26223-21munin-node19:15:171
2278799130,2cyclictest0-21swapper/119:45:291
2278799130,1cyclictest11030-21atenall_r5power19:55:121
2278799130,12cyclictest22805-21munin-node19:10:201
2278799130,12cyclictest0-21swapper/121:05:561
2278799130,12cyclictest0-21swapper/120:46:181
2278799130,12cyclictest0-21swapper/120:10:331
2278799130,12cyclictest0-21swapper/120:07:501
2278799130,12cyclictest0-21swapper/120:00:461
2278799130,11cyclictest4108-21taskset19:40:101
2278799130,11cyclictest22622-21df20:20:131
2278699136,6cyclictest0-21swapper/019:30:460
2278699135,5cyclictest0-21swapper/019:15:230
2278699133,1cyclictest0-21swapper/020:53:420
22786991311,1cyclictest0-21swapper/021:02:130
22786991311,1cyclictest0-21swapper/020:56:390
2278699130,5cyclictest0-21swapper/020:37:580
2278699130,1cyclictest135650irq/27-eth019:11:290
2278699130,12cyclictest0-21swapper/020:48:100
2278699130,12cyclictest0-21swapper/020:16:590
2278699130,12cyclictest0-21swapper/020:09:210
2278699130,11cyclictest0-21swapper/020:22:550
2278999129,3cyclictest135650irq/27-eth021:07:373
2278999129,2cyclictest0-21swapper/319:16:333
2278999122,9cyclictest0-21swapper/321:00:043
22789991210,1cyclictest0-21swapper/320:55:133
2278999120,11cyclictest135650irq/27-eth019:20:003
2278999120,11cyclictest0-21swapper/319:25:233
2278899127,4cyclictest0-21swapper/219:15:112
2278899120,10cyclictest16190-21hddtemp_smartct20:05:152
2278799128,3cyclictest135650irq/27-eth019:20:131
2278699128,3cyclictest0-21swapper/019:45:340
2278699126,5cyclictest0-21swapper/019:38:310
2278699121,1cyclictest0-21swapper/019:50:330
2278699120,8cyclictest0-21swapper/020:00:170
2278699120,12cyclictest0-21swapper/019:41:350
2278699120,11cyclictest0-21swapper/021:06:260
2278699120,11cyclictest0-21swapper/020:42:350
2278699120,11cyclictest0-21swapper/020:30:120
2278699120,11cyclictest0-21swapper/020:13:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional