You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 02:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 14, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1082321650,1sleep31502199cyclictest23:05:473
124321550,2sleep01501699cyclictest23:26:120
360221530,5sleep11501999cyclictest23:14:221
2350321460,1sleep00-21swapper/021:38:500
716721340,1sleep37156-21sshd00:37:013
967321310,4sleep11501999cyclictest22:25:521
2542721280,0sleep225428-21bash00:39:122
1036121220,2sleep110359-21bash23:30:091
1496921190,1sleep31502199cyclictest23:36:373
95621160,1sleep11847-21nfsd21:30:371
532721090,5sleep10-21swapper/123:29:411
1198221040,1sleep30-21swapper/300:01:063
2303821030,21sleep2135650irq/27-eth022:30:142
14615210135,54sleep30-21swapper/319:08:113
224372990,2sleep122431-21sshd23:00:431
224622970,2sleep10-21swapper/123:40:231
236892960,4sleep30-21swapper/323:10:113
53642910,1sleep00-21swapper/021:19:060
214792900,5sleep30-21swapper/321:50:393
133002870,1sleep10-21swapper/121:19:511
171632860,2sleep325-21rcuop/123:58:343
38472840,2sleep236-21rcuop/222:13:192
125122840,3sleep312510-21bash23:02:583
1470728334,45sleep10-21swapper/119:09:221
102502830,4sleep31502199cyclictest23:24:063
12182820,2sleep30-21swapper/322:00:533
60622810,0sleep00-21swapper/022:25:310
326392800,2sleep30-21swapper/300:15:463
40742790,3sleep20-21swapper/200:22:412
125472790,1sleep10-21swapper/100:23:361
120512790,0sleep00-21swapper/021:10:320
69442780,2sleep10-21swapper/100:19:471
190152780,3sleep01501699cyclictest21:29:240
104642770,0sleep110453-21sshd21:37:351
298902740,2sleep129878-21sshd23:16:471
250882730,2sleep325083-21sshd21:20:493
292632680,2sleep329264-21bash21:33:203
212492660,1sleep00-21swapper/022:17:590
165182650,0sleep21848-21nfsd22:47:542
320052640,1sleep10-21swapper/122:00:431
267992640,1sleep20-21swapper/222:55:072
95372500,0sleep09538-21bash00:37:190
1448325034,12sleep20-21swapper/219:06:462
132652500,2sleep30-21swapper/322:11:073
15012490,2sleep11495-21bash23:23:171
1472124831,5sleep00-21swapper/019:09:330
1501699430,40cyclictest0-21swapper/022:05:350
146452400,37sleep3135650irq/27-eth021:29:003
308752330,0sleep230877-21id00:12:232
229662330,30sleep3135650irq/27-eth023:40:263
15016993228,2cyclictest9586-21sshd23:11:490
35572310,3sleep01501699cyclictest23:41:430
229572310,2sleep322956-21sshd00:28:073
119342300,2sleep111925-21sshd23:54:581
208422290,10sleep00-21swapper/021:47:400
106922290,3sleep01501699cyclictest00:04:070
15016992810,11cyclictest0-21swapper/023:07:290
1501699280,19cyclictest6847-21fschecks_time21:40:160
142762280,25sleep3135650irq/27-eth021:37:583
103072280,4sleep31502199cyclictest22:56:333
324742270,22sleep2135650irq/27-eth000:15:452
15021992714,5cyclictest1845-21nfsd22:36:423
118982270,3sleep20-21swapper/222:23:092
309532260,23sleep1135650irq/27-eth021:21:251
1501999257,6cyclictest10950irq/23-ehci_hcd00:37:551
15019992522,2cyclictest10912-21sshd22:32:091
177042241,21sleep3135650irq/27-eth022:23:443
173692240,2sleep21502099cyclictest22:05:252
1502199242,3cyclictest7423-21sshd00:06:503
15019992411,5cyclictest10950irq/23-ehci_hcd23:55:501
99642230,3sleep39961-21sshd22:32:043
150272230,0sleep3431ktimersoftd/321:16:563
15020992318,3cyclictest23252-21sshd23:49:522
1501999239,8cyclictest3919-21cp23:05:131
117792230,3sleep20-21swapper/222:17:042
292272220,1sleep00-21swapper/022:58:220
1502199228,6cyclictest10950irq/23-ehci_hcd23:27:213
1502199224,8cyclictest29689-21sshd00:32:203
15020992212,1cyclictest21108-21sshd23:28:052
1501699222,10cyclictest7252-21cp23:45:130
1501699220,20cyclictest11260-21bash00:26:510
1501699220,14cyclictest7789-21sshd00:30:000
103502220,2sleep31848-21nfsd22:41:093
1502199217,6cyclictest26950irq/26-ahci[00021:15:013
15020992113,2cyclictest10950irq/23-ehci_hcd22:41:222
1501999217,4cyclictest0-21swapper/122:43:521
15019992110,2cyclictest135650irq/27-eth022:21:211
1501999210,18cyclictest18085-21sshd22:05:291
1501699210,13cyclictest31001-21sshd22:00:370
1501699210,10cyclictest0-21swapper/000:09:580
97732200,3sleep19772-21sshd21:43:361
1502099209,4cyclictest10950irq/23-ehci_hcd23:12:432
1501999206,5cyclictest135650irq/27-eth000:25:151
15019992015,3cyclictest9581-21cp23:45:231
1501999200,18cyclictest0-21swapper/122:13:341
1501699208,5cyclictest3-21ksoftirqd/021:52:400
1501699202,1cyclictest0-21swapper/022:23:530
15016992017,2cyclictest3-21ksoftirqd/023:59:100
1501699200,19cyclictest0-21swapper/019:56:480
1501699200,15cyclictest1847-21nfsd23:34:520
1501699200,12cyclictest0-21swapper/023:24:190
258162190,17sleep2135650irq/27-eth000:28:282
173732190,1sleep20-21swapper/223:21:412
1502199199,8cyclictest9931-21bash21:55:393
1502199196,4cyclictest1959-21sshd23:34:383
1502199194,12cyclictest0-21swapper/322:49:063
1502199190,8cyclictest0-21swapper/322:07:093
1502099198,5cyclictest135650irq/27-eth023:31:242
1502099198,3cyclictest18217-21sshd21:17:152
1502099197,6cyclictest32513-21sshd23:41:232
1502099193,3cyclictest5542-21sshd23:38:522
15020991914,3cyclictest8584-21bash21:13:232
15019991915,2cyclictest0-21swapper/122:49:481
1501999191,14cyclictest1983-21sshd21:55:001
1501699193,13cyclictest15010-21cyclictest22:35:150
1501699190,12cyclictest0-21swapper/022:31:220
1501699190,11cyclictest0-21swapper/023:17:040
305192183,14sleep210950irq/23-ehci_hcd00:09:112
282032180,4sleep00-21swapper/022:45:510
213252180,1sleep121309-21sshd21:29:371
205692180,0sleep120568-21sshd21:53:421
1502199189,5cyclictest3043-21bash22:16:133
1502199187,2cyclictest10368-21bash23:15:013
1502199185,3cyclictest0-21swapper/323:46:503
1502199181,6cyclictest1846-21nfsd22:52:103
1502199181,6cyclictest1846-21nfsd22:52:103
15021991814,3cyclictest1847-21nfsd23:53:343
15021991813,3cyclictest0-21swapper/300:23:373
1502099189,3cyclictest135650irq/27-eth021:57:342
1502099189,3cyclictest11632-21sshd23:58:002
1502099189,1cyclictest10950irq/23-ehci_hcd21:46:202
1502099183,8cyclictest9634-21uptime21:25:232
15020991811,2cyclictest10950irq/23-ehci_hcd23:05:412
1502099180,13cyclictest27292-21sshd21:51:132
1501999183,6cyclictest10950irq/23-ehci_hcd21:46:361
15019991813,4cyclictest32675-21sshd22:52:311
15019991813,4cyclictest32675-21sshd22:52:311
1501699186,3cyclictest15989-21sshd00:14:120
1501699183,14cyclictest0-21swapper/023:02:140
1501699181,2cyclictest10998-21sshd00:23:260
1501699180,16cyclictest0-21swapper/022:40:530
1501699180,10cyclictest26616-21sshd23:50:110
49982170,3sleep21502099cyclictest22:53:002
49982170,3sleep21502099cyclictest22:53:002
218962171,12sleep2135650irq/27-eth022:02:552
164492170,15sleep2135650irq/27-eth023:15:282
1502199179,5cyclictest5838-21sshd22:25:303
1502199179,3cyclictest32570-21sshd21:45:383
1502199175,4cyclictest14976-21sshd00:10:443
1502199170,12cyclictest16118-21sshd21:44:133
1502099176,5cyclictest1576-21avahi-daemon23:03:062
1502099173,10cyclictest2198-21sshd22:28:182
15020991714,2cyclictest625-21sshd21:33:412
15020991712,3cyclictest1225-21sshd00:32:472
1502099170,9cyclictest20118-21sshd00:01:552
1502099170,4cyclictest25673-21sshd21:39:032
1501999170,15cyclictest0-21swapper/121:13:501
1501999170,14cyclictest0-21swapper/100:01:261
1501699170,9cyclictest4679-21sshd00:16:130
1501699170,13cyclictest0-21swapper/021:57:240
1502199163,1cyclictest19592-21munin-node19:20:163
1502099164,11cyclictest10950irq/23-ehci_hcd20:35:412
1502099160,12cyclictest17340-21sshd23:52:192
1501999169,4cyclictest20850-21bash00:05:071
1501999168,7cyclictest11154-21bash00:10:241
1501999163,12cyclictest17031-21id22:17:341
15019991612,3cyclictest28258-21bash22:36:481
1501999160,13cyclictest12004-21cp23:36:191
1501699164,11cyclictest7978-21munin-node22:50:250
1501699164,11cyclictest7978-21munin-node22:50:250
1501699160,9cyclictest0-21swapper/023:37:250
1501699160,13cyclictest938-21sshd21:30:380
1501699160,12cyclictest0-21swapper/021:23:090
1502199156,7cyclictest0-21swapper/320:55:133
1502199154,10cyclictest10950irq/23-ehci_hcd20:45:313
1502199150,13cyclictest0-21swapper/320:20:133
1502099157,7cyclictest0-21swapper/219:41:182
1502099152,4cyclictest21763-21sshd22:36:092
1502099152,3cyclictest4212-21sshd21:40:052
1502099152,12cyclictest5150-21sshd21:22:022
1502099150,13cyclictest0-21swapper/220:25:142
1501999158,5cyclictest24988-21sendmail_mailtr20:40:231
1501999150,8cyclictest0-21swapper/122:56:341
1501999150,13cyclictest135650irq/27-eth000:30:021
1501699159,5cyclictest0-21swapper/020:11:130
1501699154,7cyclictest1846-21nfsd22:11:400
1501699150,3cyclictest0-21swapper/020:56:270
1501699150,14cyclictest0-21swapper/019:30:200
1501699150,14cyclictest0-21swapper/019:12:180
1502199149,4cyclictest10950irq/23-ehci_hcd20:11:153
1502199142,10cyclictest0-21swapper/319:35:143
15021991412,1cyclictest0-21swapper/320:30:183
15021991410,3cyclictest135650irq/27-eth020:36:093
1502199140,12cyclictest22744-21cut19:25:173
1502199140,10cyclictest0-21swapper/319:40:013
1502099148,5cyclictest25519-21sshd20:42:162
1502099148,5cyclictest1848-21nfsd20:56:502
1502099142,11cyclictest10950irq/23-ehci_hcd19:15:122
1502099141,12cyclictest144550irq/28-eth1-rx-20:20:232
1502099141,12cyclictest135650irq/27-eth020:00:012
15020991410,3cyclictest10950irq/23-ehci_hcd19:20:502
1501999149,4cyclictest1915-21snmpd19:21:121
1501999140,13cyclictest0-21swapper/121:07:121
1501999140,12cyclictest11759-21taskset20:11:261
1501999140,10cyclictest0-21swapper/120:10:001
1501699143,1cyclictest0-21swapper/020:21:210
1501699140,6cyclictest0-21swapper/020:30:300
1501699140,13cyclictest31750-21munin-node19:45:160
1502199137,5cyclictest0-21swapper/320:07:213
1502199137,5cyclictest0-21swapper/319:16:153
1502199134,4cyclictest13411-21munin-node20:15:213
1502199130,12cyclictest3505-21forks19:55:133
1502199130,12cyclictest0-21swapper/321:00:013
1502199130,12cyclictest0-21swapper/320:51:533
1502199130,12cyclictest0-21swapper/320:40:133
1502199130,12cyclictest0-21swapper/320:00:013
1502199130,12cyclictest0-21swapper/319:53:333
1502199130,12cyclictest0-21swapper/319:47:113
1502199130,11cyclictest24418-21df19:30:133
1502199130,11cyclictest17643-21grep20:25:173
1502099139,3cyclictest135650irq/27-eth020:05:552
1502099137,5cyclictest0-21swapper/220:16:082
1502099137,5cyclictest0-21swapper/219:51:262
1502099131,4cyclictest135650irq/27-eth019:55:392
1502099131,11cyclictest1848-21nfsd19:12:162
1502099131,11cyclictest135650irq/27-eth021:08:042
15020991311,1cyclictest0-21swapper/220:30:582
15020991311,1cyclictest0-21swapper/219:25:142
1502099130,12cyclictest135650irq/27-eth019:48:412
1502099130,12cyclictest0-21swapper/220:10:122
1502099130,12cyclictest0-21swapper/219:35:222
1502099130,11cyclictest25983-21munin-node20:45:262
1501999137,5cyclictest2881-21runrttasks19:54:201
1501999137,5cyclictest0-21swapper/120:51:071
1501999131,5cyclictest0-21swapper/120:30:161
1501999130,5cyclictest0-21swapper/120:55:261
1501999130,4cyclictest26425-21munin-node19:35:201
1501999130,12cyclictest1848-21nfsd19:56:311
1501999130,12cyclictest0-21swapper/121:01:281
1501999130,12cyclictest0-21swapper/120:49:001
1501999130,12cyclictest0-21swapper/120:27:501
1501999130,12cyclictest0-21swapper/120:15:081
1501999130,11cyclictest30987-21taskset19:45:101
1501699139,1cyclictest0-21swapper/020:00:000
1501699137,5cyclictest0-21swapper/020:05:130
1501699137,5cyclictest0-21swapper/019:27:360
1501699137,3cyclictest0-21swapper/019:35:160
15016991311,1cyclictest0-21swapper/020:44:120
1501699130,1cyclictest0-21swapper/020:50:570
1501699130,12cyclictest974-21ls19:50:140
1501699130,12cyclictest0-21swapper/021:00:260
1501699130,12cyclictest0-21swapper/020:47:430
1501699130,12cyclictest0-21swapper/019:44:100
1501699130,12cyclictest0-21swapper/019:19:520
1501699130,10cyclictest0-21swapper/020:25:020
1502199120,3cyclictest16179-21ntp_states19:10:193
1502199120,10cyclictest3062-21df_inode21:05:133
1502099121,2cyclictest28950-21munin-node20:50:162
1502099120,4cyclictest135650irq/27-eth021:01:162
1502099120,11cyclictest0-21swapper/219:31:122
1501999125,3cyclictest10950irq/23-ehci_hcd19:25:111
1501999120,3cyclictest15300-21df19:10:121
1501999120,11cyclictest26950irq/26-ahci[00019:15:071
1501999120,11cyclictest0-21swapper/120:35:161
1501999120,11cyclictest0-21swapper/120:20:081
1501999120,11cyclictest0-21swapper/120:00:501
1501999120,11cyclictest0-21swapper/119:30:021
1501699127,4cyclictest0-21swapper/020:15:450
15016991210,1cyclictest0-21swapper/021:06:100
1501699120,9cyclictest0-21swapper/019:20:110
1501699120,11cyclictest0-21swapper/020:35:190
1501999116,0cyclictest0-21swapper/119:40:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional