You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 02:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Dec 01, 2025 00:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180672230159,24sleep30-21swapper/319:05:523
182022211157,42sleep00-21swapper/019:07:340
180812201162,26sleep20-21swapper/219:06:032
162122200161,26sleep10-21swapper/119:05:001
291722120,0sleep20-21swapper/222:19:122
18499991110,0cyclictest28-21ksoftirqd/200:00:002
1849199110,11cyclictest0-21swapper/100:25:191
18483991110,1cyclictest9-21ksoftirqd/000:33:510
1849999101,8cyclictest1497-21sendmail-mta22:00:512
1848399109,1cyclictest9-21ksoftirqd/021:19:490
1848399108,1cyclictest9-21ksoftirqd/021:30:000
18483991010,0cyclictest9-21ksoftirqd/021:52:350
148782100,0sleep30-21swapper/321:14:413
185049998,1cyclictest35-21ksoftirqd/300:35:003
184999998,1cyclictest28-21ksoftirqd/221:19:262
184999997,1cyclictest28-21ksoftirqd/223:35:342
184999990,5cyclictest5843-21proc_pri22:30:202
184839998,1cyclictest9-21ksoftirqd/022:50:000
184839990,6cyclictest26919-21/usr/sbin/munin00:35:230
184839990,6cyclictest26919-21/usr/sbin/munin00:35:220
184839990,6cyclictest0-21swapper/021:10:120
17790290,0sleep10-21swapper/120:14:561
25166280,0sleep10-21swapper/122:12:351
2234280,1sleep10-21swapper/123:55:281
185049985,2cyclictest11393-21diskmemload00:13:363
185049982,4cyclictest742-21runrttasks22:15:273
185049980,5cyclictest841-21nscd22:56:213
185049980,4cyclictest1017-21apt-get22:25:133
184999987,1cyclictest28-21ksoftirqd/222:10:582
184999986,1cyclictest60950irq/123-eno123:50:172
184999986,1cyclictest60950irq/123-eno122:55:012
184999986,1cyclictest28-21ksoftirqd/220:04:592
184999982,4cyclictest11393-21diskmemload23:05:132
184999980,8cyclictest0-21swapper/223:11:592
184919981,3cyclictest0-21swapper/122:45:131
184919980,5cyclictest0-21swapper/123:16:011
184919980,4cyclictest0-21swapper/120:25:131
184839987,1cyclictest9-21ksoftirqd/000:07:280
184839986,1cyclictest30458-21gltestperf22:20:130
184839986,1cyclictest20956-21ssh21:20:510
184839984,4cyclictest4312-21awk20:55:010
184839983,4cyclictest0-21swapper/021:40:000
184839983,1cyclictest0-21swapper/000:00:180
184839981,5cyclictest254-21systemd-journal00:19:550
184839981,4cyclictest11393-21diskmemload22:34:450
184839980,6cyclictest12127-21apt-get21:55:150
27418270,0sleep10-21swapper/123:45:221
185049976,1cyclictest35-21ksoftirqd/322:35:173
185049976,1cyclictest35-21ksoftirqd/320:01:313
185049976,1cyclictest18929-21cpuspeed_turbos22:50:163
185049975,1cyclictest9624-21ssh23:20:273
185049974,1cyclictest570-21systemd-logind22:30:223
185049974,1cyclictest254-21systemd-journal22:50:013
185049973,2cyclictest254-21systemd-journal20:00:003
185049972,3cyclictest35-21ksoftirqd/322:00:063
185049971,3cyclictest35-21ksoftirqd/321:46:253
185049970,4cyclictest30163-21/usr/sbin/munin23:50:163
185049970,4cyclictest16296-21apt-get00:20:103
185049970,2cyclictest0-21swapper/323:55:563
184999976,1cyclictest60950irq/123-eno123:45:212
184999976,1cyclictest60950irq/123-eno123:18:532
184999976,1cyclictest60950irq/123-eno123:00:162
184999976,1cyclictest60950irq/123-eno122:40:152
184999976,1cyclictest60950irq/123-eno121:56:482
184999976,1cyclictest60950irq/123-eno100:36:552
184999976,1cyclictest60950irq/123-eno100:36:552
184999976,1cyclictest60950irq/123-eno100:17:052
184999976,1cyclictest11393-21diskmemload21:25:152
184999976,0cyclictest60950irq/123-eno123:42:522
184999976,0cyclictest60950irq/123-eno121:45:212
184999975,1cyclictest60950irq/123-eno121:34:222
184999975,1cyclictest60950irq/123-eno119:14:592
184999975,1cyclictest18252-21ssh00:20:532
184999974,2cyclictest16437-21grep22:45:202
184999974,2cyclictest11393-21diskmemload21:20:112
184999973,2cyclictest254-21systemd-journal00:02:152
184999973,1cyclictest254-21systemd-journal22:50:432
184999972,4cyclictest788-21lldpd23:21:142
184999971,4cyclictest28-21ksoftirqd/222:27:282
184999970,6cyclictest26639-21apt00:35:012
184999970,6cyclictest0-21swapper/221:00:152
184999970,4cyclictest8510-21sh00:08:282
184999970,3cyclictest254-21systemd-journal20:34:592
184999970,3cyclictest0-21swapper/219:20:152
184999970,1cyclictest19177-21ssh22:05:132
184919970,5cyclictest0-21swapper/123:30:571
184919970,4cyclictest0-21swapper/122:25:211
184919970,3cyclictest0-21swapper/121:10:121
184919970,1cyclictest0-21swapper/123:25:211
184919970,1cyclictest0-21swapper/122:00:181
184839976,1cyclictest9-21ksoftirqd/023:50:000
184839976,1cyclictest9-21ksoftirqd/019:40:120
184839976,1cyclictest6938-21cat19:50:170
184839975,1cyclictest1689-21ssh23:10:180
184839975,1cyclictest0-21swapper/023:25:150
184839974,2cyclictest11393-21diskmemload22:39:050
184839973,3cyclictest29467-21apt-get23:05:130
184839973,2cyclictest570-21systemd-logind21:30:210
184839973,2cyclictest11393-21diskmemload23:20:130
184839973,0cyclictest0-21swapper/019:30:120
184839971,1cyclictest28149-1kworker/u9:223:51:140
184839970,7cyclictest0-21swapper/023:19:210
184839970,6cyclictest9226-21ssh00:10:040
184839970,6cyclictest32408-1kworker/u9:222:26:340
184839970,6cyclictest31798-1kworker/u9:023:55:030
184839970,6cyclictest19732-21ntp_states23:35:180
184839970,6cyclictest13322-21ssh22:40:230
184839970,6cyclictest0-21swapper/020:45:160
184839970,6cyclictest0-21swapper/019:15:200
184839970,6cyclictest0-21swapper/000:25:120
184839970,2cyclictest22278-21/usr/sbin/munin23:40:160
184839970,1cyclictest7381-21ssh21:47:410
184839970,1cyclictest22793-21/usr/sbin/munin20:25:190
184839970,1cyclictest11393-21diskmemload22:55:210
184839970,1cyclictest11393-21diskmemload22:13:570
184839970,1cyclictest11393-21diskmemload21:40:120
20982260,0sleep10-21swapper/123:37:291
185049966,0cyclictest0-21swapper/321:56:493
185049965,1cyclictest35-21ksoftirqd/320:45:153
185049965,1cyclictest32615-21ssh22:23:563
185049965,1cyclictest307-21ssh21:38:003
185049965,1cyclictest25146-21ssh22:12:293
185049965,1cyclictest21315-21ssh22:06:323
185049965,1cyclictest17529-21sshd20:11:333
185049965,1cyclictest17089-21ssh21:15:243
185049964,1cyclictest5458-21ntp_states23:15:193
185049963,1cyclictest570-21systemd-logind23:45:213
185049963,1cyclictest570-21systemd-logind23:35:203
185049963,1cyclictest254-21systemd-journal19:53:243
185049963,1cyclictest254-21systemd-journal19:40:013
185049962,1cyclictest14515-21/usr/sbin/munin00:15:183
185049961,3cyclictest11393-21diskmemload00:36:483
185049961,3cyclictest11393-21diskmemload00:36:473
185049961,2cyclictest11393-21diskmemload23:27:413
185049961,1cyclictest11393-21diskmemload21:30:183
185049961,1cyclictest0-21swapper/321:25:123
185049960,5cyclictest20003-21cpu00:25:133
185049960,4cyclictest0-21swapper/323:00:283
185049960,3cyclictest11393-21diskmemload23:43:133
185049960,3cyclictest11393-21diskmemload23:33:133
185049960,3cyclictest0-21swapper/323:07:013
185049960,2cyclictest803-21sshd21:51:513
185049960,2cyclictest0-21swapper/322:42:113
185049960,2cyclictest0-21swapper/321:20:313
185049960,2cyclictest0-21swapper/300:00:123
184999966,0cyclictest60950irq/123-eno121:50:122
184999966,0cyclictest60950irq/123-eno121:35:062
184999966,0cyclictest60950irq/123-eno120:55:092
184999966,0cyclictest60950irq/123-eno120:44:232
184999966,0cyclictest60950irq/123-eno120:36:592
184999966,0cyclictest60950irq/123-eno120:12:462
184999966,0cyclictest60950irq/123-eno120:07:402
184999966,0cyclictest60950irq/123-eno119:50:142
184999966,0cyclictest60950irq/123-eno100:25:442
184999966,0cyclictest60950irq/123-eno100:10:082
184999965,1cyclictest60950irq/123-eno123:30:162
184999965,1cyclictest60950irq/123-eno123:25:012
184999965,1cyclictest60950irq/123-eno121:10:172
184999965,1cyclictest60950irq/123-eno120:25:132
184999965,1cyclictest60950irq/123-eno119:45:112
184999965,1cyclictest2549-21ntpq21:40:192
184999965,1cyclictest21582-21ntpq20:20:192
184999964,1cyclictest19215-21ntp_states20:15:192
184999964,1cyclictest1106-21sendmail-msp19:40:012
184999963,3cyclictest9691-21sed22:35:232
184999962,2cyclictest32238-21apt-get20:45:132
184999960,2cyclictest0-21swapper/222:20:162
184919964,1cyclictest0-21swapper/123:06:131
184919961,4cyclictest0-21swapper/119:10:141
184919961,3cyclictest0-21swapper/122:20:111
184919960,6cyclictest0-21swapper/122:54:251
184919960,6cyclictest0-21swapper/122:16:171
184919960,5cyclictest0-21swapper/100:18:551
184919960,5cyclictest0-21swapper/100:10:301
184919960,4cyclictest0-21swapper/123:53:311
184919960,4cyclictest0-21swapper/123:22:331
184919960,4cyclictest0-21swapper/123:12:311
184919960,4cyclictest0-21swapper/123:04:181
184919960,4cyclictest0-21swapper/122:07:181
184919960,4cyclictest0-21swapper/121:41:371
184919960,4cyclictest0-21swapper/100:35:051
184919960,4cyclictest0-21swapper/100:35:041
184919960,4cyclictest0-21swapper/100:30:141
184919960,3cyclictest0-21swapper/121:55:181
184919960,3cyclictest0-21swapper/121:50:151
184919960,3cyclictest0-21swapper/121:15:201
184919960,3cyclictest0-21swapper/100:01:391
184919960,2cyclictest0-21swapper/123:40:121
184919960,1cyclictest0-21swapper/121:36:001
184919960,1cyclictest0-21swapper/120:00:121
184839964,1cyclictest36842sleep019:45:110
184839963,2cyclictest11393-21diskmemload00:20:120
184839963,1cyclictest254-21systemd-journal21:00:010
184839960,6cyclictest0-21swapper/021:08:400
184839960,6cyclictest0-21swapper/021:01:340
184839960,6cyclictest0-21swapper/020:15:380
184839960,6cyclictest0-21swapper/020:08:250
184839960,6cyclictest0-21swapper/019:25:220
184839960,5cyclictest19188-21df_inode19:10:150
184839960,5cyclictest11393-21diskmemload22:05:210
184839960,5cyclictest0-21swapper/020:40:120
184839960,1cyclictest0-21swapper/022:50:190
184839960,0cyclictest0-21swapper/023:30:270
184839960,0cyclictest0-21swapper/023:01:110
184839960,0cyclictest0-21swapper/022:15:140
184839960,0cyclictest0-21swapper/022:00:170
184839960,0cyclictest0-21swapper/020:00:040
184839960,0cyclictest0-21swapper/019:36:340
185049955,0cyclictest11393-21diskmemload23:10:093
185049955,0cyclictest0-21swapper/320:55:213
185049954,1cyclictest7853-21ssh00:06:213
185049954,1cyclictest35-21ksoftirqd/319:13:223
185049954,1cyclictest24614-21sshd20:26:223
185049952,2cyclictest18960-21irqstats20:15:173
185049952,1cyclictest254-21systemd-journal20:33:553
185049950,3cyclictest0-21swapper/321:40:123
185049950,1cyclictest0-21swapper/321:05:143
184999955,0cyclictest60950irq/123-eno121:05:092
184999955,0cyclictest60950irq/123-eno119:10:162
184999954,1cyclictest60950irq/123-eno120:50:132
184999954,1cyclictest60950irq/123-eno119:55:162
184999954,1cyclictest60950irq/123-eno119:28:572
184999950,3cyclictest0-21swapper/219:40:222
184999950,0cyclictest0-21swapper/219:30:132
184919951,2cyclictest0-21swapper/122:55:131
184919951,2cyclictest0-21swapper/120:40:191
184919951,2cyclictest0-21swapper/119:35:121
184919951,1cyclictest0-21swapper/120:15:121
184919950,5cyclictest0-21swapper/121:45:191
184919950,5cyclictest0-21swapper/120:50:181
184919950,5cyclictest0-21swapper/119:40:171
184919950,4cyclictest0-21swapper/121:31:191
184919950,4cyclictest0-21swapper/120:35:171
184919950,4cyclictest0-21swapper/119:25:141
184919950,3cyclictest0-21swapper/122:35:561
184919950,3cyclictest0-21swapper/122:30:211
184919950,3cyclictest0-21swapper/121:28:381
184919950,3cyclictest0-21swapper/100:20:551
184919950,2cyclictest0-21swapper/122:40:141
184919950,2cyclictest0-21swapper/119:59:591
184919950,2cyclictest0-21swapper/100:06:001
184919950,0cyclictest0-21swapper/121:23:501
184839955,0cyclictest0-21swapper/020:20:530
184839950,5cyclictest0-21swapper/020:10:570
184839950,4cyclictest29136-21grep20:35:230
184839950,1cyclictest8598-21/usr/sbin/munin19:55:150
184839950,1cyclictest24107-21/usr/sbin/munin19:20:170
184839950,0cyclictest0-21swapper/020:31:420
185049944,0cyclictest25510-21sensors19:20:213
185049943,1cyclictest4806-21netstat19:45:173
185049943,1cyclictest29883-21apt-get20:40:123
185049942,1cyclictest21821-21telnet19:15:143
185049942,1cyclictest2164-21wc19:40:163
185049941,2cyclictest0-21swapper/319:25:103
185049941,1cyclictest6904-21/usr/sbin/munin21:00:123
185049941,1cyclictest2175-21apt-get20:50:143
185049940,4cyclictest29755-21expr19:30:153
185049940,3cyclictest0-21swapper/320:05:193
185049940,1cyclictest254-21systemd-journal20:36:403
185049940,1cyclictest21201-21gltestperf20:20:173
184919941,2cyclictest0-21swapper/119:15:131
184919940,3cyclictest0-21swapper/120:55:101
184919940,3cyclictest0-21swapper/120:08:211
184919940,2cyclictest0-21swapper/120:30:131
184919940,2cyclictest0-21swapper/119:20:151
184919940,1cyclictest0-21swapper/119:50:151
184919940,0cyclictest0-21swapper/119:30:201
184919931,1cyclictest0-21swapper/121:00:121
184919931,1cyclictest0-21swapper/120:20:141
184919930,3cyclictest0-21swapper/119:45:181
184919930,1cyclictest0-21swapper/120:45:121
184919930,0cyclictest0-21swapper/121:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional