You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Fri May 09, 2025 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
172082210142,54sleep30-21swapper/319:06:513
174332203164,26sleep20-21swapper/219:09:482
171902198160,25sleep00-21swapper/019:06:350
172832197160,24sleep10-21swapper/119:07:491
48042690,0sleep20-21swapper/200:26:182
264792620,0sleep20-21swapper/222:50:182
327152600,1sleep121-21ksoftirqd/100:20:211
17541991514,1cyclictest28-21ksoftirqd/223:21:292
293082130,1sleep00-21swapper/000:16:080
17547991312,1cyclictest35-21ksoftirqd/319:45:013
17541991313,0cyclictest28-21ksoftirqd/223:36:082
17541991312,1cyclictest28-21ksoftirqd/221:40:112
17541991312,1cyclictest28-21ksoftirqd/221:25:222
17541991311,1cyclictest28-21ksoftirqd/223:15:002
17541991311,1cyclictest28-21ksoftirqd/200:15:252
17541991311,1cyclictest21347-21cron20:25:002
17541991211,1cyclictest28-21ksoftirqd/223:45:122
17541991210,1cyclictest28-21ksoftirqd/200:40:002
17547991110,1cyclictest35-21ksoftirqd/323:50:013
1754199119,1cyclictest28-21ksoftirqd/222:35:202
1754199119,1cyclictest28-21ksoftirqd/221:40:002
1754199119,1cyclictest28-21ksoftirqd/221:40:002
17541991111,0cyclictest28-21ksoftirqd/200:13:212
17541991110,1cyclictest28-21ksoftirqd/222:42:132
17541991110,1cyclictest28-21ksoftirqd/222:20:182
1752999112,4cyclictest32356-21pluginstate19:40:010
226652100,0sleep310548-21diskmemload21:24:373
1754799109,1cyclictest35-21ksoftirqd/323:25:003
1754799108,2cyclictest35-21ksoftirqd/322:55:013
1754799108,1cyclictest35-21ksoftirqd/321:50:003
17547991010,0cyclictest35-21ksoftirqd/300:15:163
1754199109,1cyclictest28-21ksoftirqd/223:30:212
1754199109,1cyclictest28-21ksoftirqd/223:25:192
1754199109,1cyclictest28-21ksoftirqd/223:07:332
1754199109,1cyclictest28-21ksoftirqd/223:00:222
1754199109,1cyclictest28-21ksoftirqd/222:25:002
1754199109,1cyclictest28-21ksoftirqd/222:15:142
1754199109,1cyclictest28-21ksoftirqd/222:06:252
1754199109,1cyclictest28-21ksoftirqd/221:52:372
1754199109,1cyclictest28-21ksoftirqd/200:01:382
1754199108,1cyclictest28-21ksoftirqd/222:58:412
1754199108,1cyclictest28-21ksoftirqd/222:00:172
1754199108,1cyclictest28-21ksoftirqd/221:55:132
1754199108,1cyclictest28-21ksoftirqd/221:12:042
1754199108,1cyclictest28-21ksoftirqd/221:00:002
1754199108,1cyclictest28-21ksoftirqd/220:10:002
1754199108,1cyclictest28-21ksoftirqd/220:05:002
1754199102,8cyclictest0-21swapper/219:20:122
17541991010,0cyclictest28-21ksoftirqd/200:09:212
1754199100,9cyclictest0-21swapper/221:30:102
1754199100,10cyclictest0-21swapper/200:32:432
1752999109,1cyclictest16745-21ssh22:38:540
1752999101,4cyclictest14572-21latency_hist21:14:590
1752999100,2cyclictest10548-21diskmemload22:15:180
115062100,0sleep30-21swapper/300:35:173
175479999,0cyclictest35-21ksoftirqd/322:49:593
175479998,1cyclictest35-21ksoftirqd/323:40:143
175479998,1cyclictest35-21ksoftirqd/323:39:593
175479998,1cyclictest35-21ksoftirqd/323:00:003
175479998,1cyclictest35-21ksoftirqd/322:40:013
175419999,0cyclictest8471-21sensors21:45:202
175419998,1cyclictest28-21ksoftirqd/223:58:072
175419998,1cyclictest28-21ksoftirqd/223:40:312
175419998,1cyclictest28-21ksoftirqd/223:16:152
175419998,1cyclictest28-21ksoftirqd/222:30:152
175419998,1cyclictest28-21ksoftirqd/221:20:402
175419998,1cyclictest28-21ksoftirqd/221:15:182
175419998,1cyclictest28-21ksoftirqd/221:10:002
175419998,1cyclictest28-21ksoftirqd/200:22:122
175419997,1cyclictest28-21ksoftirqd/223:50:192
175419990,7cyclictest10548-21diskmemload22:10:112
175299998,1cyclictest27917-21grep22:10:200
175479988,0cyclictest35-21ksoftirqd/323:05:153
175479988,0cyclictest35-21ksoftirqd/321:05:203
175479987,1cyclictest35-21ksoftirqd/320:45:013
175479987,1cyclictest35-21ksoftirqd/320:15:003
175479986,2cyclictest1449-21ntpd00:25:403
175479986,1cyclictest35-21ksoftirqd/320:35:113
175479986,1cyclictest35-21ksoftirqd/319:15:013
175479982,2cyclictest30216-21apt-get19:35:133
175479981,4cyclictest10548-21diskmemload21:15:013
175479980,7cyclictest10548-21diskmemload23:05:003
175479980,1cyclictest0-21swapper/322:05:173
175419987,1cyclictest28-21ksoftirqd/222:45:072
175419987,1cyclictest28-21ksoftirqd/219:30:122
175419987,1cyclictest28-21ksoftirqd/219:15:012
175419986,1cyclictest28-21ksoftirqd/220:45:002
175419986,1cyclictest28-21ksoftirqd/220:40:012
175419986,1cyclictest28-21ksoftirqd/220:25:132
175419980,6cyclictest16854-21apt-get20:15:112
175379980,7cyclictest0-21swapper/122:05:221
175299987,1cyclictest9-21ksoftirqd/019:40:160
175299985,2cyclictest20219-21ntp_kernel_pll_21:20:200
175299983,4cyclictest32638-21ssh22:59:020
175299982,3cyclictest11521-21apt-get23:55:130
175299982,1cyclictest5872-21/usr/sbin/munin21:00:170
175299981,6cyclictest11471-21ssh21:50:180
175299981,2cyclictest0-21swapper/021:28:580
175299980,7cyclictest7673-21ssh22:25:350
175299980,7cyclictest6962-21ssh23:49:040
175299980,7cyclictest24610-21ssh22:48:590
175299980,7cyclictest11495-21ssh22:30:230
175299980,7cyclictest0-21swapper/023:35:180
175299980,6cyclictest12812-21kworker/u8:100:05:110
175299980,4cyclictest254-21systemd-journal00:01:110
175479976,1cyclictest35-21ksoftirqd/321:00:013
175479976,1cyclictest35-21ksoftirqd/320:17:003
175479976,1cyclictest35-21ksoftirqd/319:25:143
175479976,1cyclictest35-21ksoftirqd/300:30:143
175479976,1cyclictest1449-21ntpd20:53:173
175479976,1cyclictest10548-21diskmemload21:31:543
175479975,1cyclictest8397-21ssh22:27:293
175479975,1cyclictest35-21ksoftirqd/323:55:143
175479975,1cyclictest35-21ksoftirqd/300:25:003
175479972,3cyclictest27929-21kworker/u8:020:48:313
175479971,3cyclictest19325-21apt-get00:05:113
175479970,5cyclictest0-21swapper/322:22:353
175479970,5cyclictest0-21swapper/321:10:133
175479970,4cyclictest10260-21kworker/3:021:45:003
175479970,2cyclictest25277-21munin-run19:24:593
175479970,2cyclictest10548-21diskmemload22:30:133
175479970,1cyclictest0-21swapper/323:18:333
175419977,0cyclictest28-21ksoftirqd/220:50:102
175419977,0cyclictest28-21ksoftirqd/219:10:132
175419976,1cyclictest28-21ksoftirqd/219:55:122
175419976,1cyclictest28-21ksoftirqd/219:40:182
175419976,1cyclictest28-21ksoftirqd/219:35:152
175419971,5cyclictest26065-21munin-run20:35:002
175419970,3cyclictest0-21swapper/219:45:162
175419970,2cyclictest0-21swapper/221:00:142
175419970,2cyclictest0-21swapper/219:25:132
175379970,3cyclictest0-21swapper/100:00:041
175379970,2cyclictest0-21swapper/122:58:551
175379970,1cyclictest0-21swapper/120:55:211
175379970,0cyclictest0-21swapper/122:50:151
175299974,1cyclictest10548-21diskmemload23:20:020
175299973,2cyclictest254-21systemd-journal20:16:590
175299972,2cyclictest10548-21diskmemload21:16:080
175299972,1cyclictest7217-21/usr/sbin/munin19:55:190
175299971,6cyclictest28592-21ssh22:54:110
175299971,3cyclictest10548-21diskmemload00:37:200
175299970,6cyclictest8830-21ssh21:45:230
175299970,6cyclictest8146-21ssh23:08:550
175299970,6cyclictest29546-21ssh21:31:320
175299970,6cyclictest23232-21ssh00:10:070
175299970,6cyclictest15772-21ssh23:18:260
175299970,6cyclictest15560-21grep21:55:140
175299970,6cyclictest11267-21ssh23:11:500
175299970,6cyclictest10548-21diskmemload23:00:120
175299970,6cyclictest0-21swapper/023:25:100
175299970,6cyclictest0-21swapper/021:40:160
175299970,6cyclictest0-21swapper/021:05:130
175299970,6cyclictest0-21swapper/019:10:130
175299970,2cyclictest7524-21irqstats00:30:170
175299970,2cyclictest32563-21tr23:40:140
175299970,1cyclictest516-21grep21:35:220
175299970,1cyclictest516-21grep21:35:210
175299970,1cyclictest4767-21ssh00:26:120
175299970,1cyclictest24542-21ssh22:05:450
175299970,1cyclictest21016-21ssh22:01:400
175299970,1cyclictest10548-21diskmemload22:40:520
175299970,1cyclictest10548-21diskmemload00:20:080
175299970,1cyclictest0-21swapper/023:30:150
175299970,1cyclictest0-21swapper/022:20:200
175479966,0cyclictest35-21ksoftirqd/323:10:003
175479966,0cyclictest35-21ksoftirqd/321:50:163
175479965,1cyclictest35-21ksoftirqd/322:40:143
175479965,1cyclictest35-21ksoftirqd/320:10:003
175479965,1cyclictest35-21ksoftirqd/320:05:013
175479965,1cyclictest35-21ksoftirqd/319:55:013
175479965,1cyclictest26366-21ssh23:30:363
175479965,1cyclictest25276-21ssh21:26:053
175479965,1cyclictest21080-21ssh22:01:503
175479965,1cyclictest17256-21ssh00:00:293
175479965,1cyclictest1449-21ntpd20:28:033
175479963,2cyclictest10548-21diskmemload21:36:303
175479963,2cyclictest10548-21diskmemload21:36:293
175479963,1cyclictest254-21systemd-journal23:30:003
175479960,4cyclictest10548-21diskmemload00:11:333
175479960,3cyclictest0-21swapper/322:16:433
175479960,3cyclictest0-21swapper/322:11:303
175479960,1cyclictest0-21swapper/321:55:103
175419966,0cyclictest60950irq/123-eno120:46:212
175419966,0cyclictest60950irq/123-eno120:10:132
175419965,1cyclictest28-21ksoftirqd/219:50:112
175379963,2cyclictest0-21swapper/100:07:201
175379960,6cyclictest0-21swapper/121:16:391
175379960,6cyclictest0-21swapper/100:35:391
175379960,5cyclictest0-21swapper/121:11:451
175379960,5cyclictest0-21swapper/120:15:181
175379960,5cyclictest0-21swapper/100:30:161
175379960,4cyclictest0-21swapper/123:56:381
175379960,4cyclictest0-21swapper/123:40:131
175379960,4cyclictest0-21swapper/122:25:171
175379960,2cyclictest0-21swapper/100:10:211
175379960,1cyclictest0-21swapper/121:05:121
175379960,1cyclictest0-21swapper/119:50:141
175299965,1cyclictest30009-21ntpq20:40:160
175299962,0cyclictest0-21swapper/019:20:170
175299960,6cyclictest0-21swapper/023:50:180
175299960,6cyclictest0-21swapper/020:20:150
175299960,5cyclictest0-21swapper/020:50:100
175299960,3cyclictest0-21swapper/019:30:120
175299960,1cyclictest0-21swapper/019:45:160
175299960,0cyclictest0-21swapper/020:35:090
175299960,0cyclictest0-21swapper/020:02:300
175299960,0cyclictest0-21swapper/019:54:120
24552250,0sleep10-21swapper/120:30:161
175479952,1cyclictest254-21systemd-journal19:57:343
175479952,1cyclictest254-21systemd-journal19:34:553
175479951,0cyclictest0-21swapper/323:50:173
175479950,3cyclictest0-21swapper/321:00:163
175479950,2cyclictest3368-21basename19:45:163
175479950,1cyclictest0-21swapper/320:30:123
175379955,0cyclictest0-21swapper/123:45:381
175379955,0cyclictest0-21swapper/123:09:251
175379954,1cyclictest59352sleep121:43:011
175379951,2cyclictest0-21swapper/119:25:161
175379951,1cyclictest28418-21sleep20:40:001
175379951,1cyclictest0-21swapper/123:50:101
175379951,1cyclictest0-21swapper/122:45:121
175379950,5cyclictest0-21swapper/122:30:191
175379950,5cyclictest0-21swapper/122:20:191
175379950,5cyclictest0-21swapper/120:46:391
175379950,4cyclictest0-21swapper/121:32:131
175379950,3cyclictest0-21swapper/123:27:381
175379950,3cyclictest0-21swapper/123:20:011
175379950,3cyclictest0-21swapper/122:40:241
175379950,3cyclictest0-21swapper/121:23:571
175379950,2cyclictest0-21swapper/123:31:561
175379950,2cyclictest0-21swapper/122:16:001
175379950,2cyclictest0-21swapper/121:49:161
175379950,2cyclictest0-21swapper/121:38:051
175379950,2cyclictest0-21swapper/121:38:051
175379950,2cyclictest0-21swapper/100:16:511
175379950,1cyclictest0-21swapper/122:00:141
175379950,1cyclictest0-21swapper/121:25:201
175379950,0cyclictest0-21swapper/123:00:471
175379950,0cyclictest0-21swapper/122:39:391
175379950,0cyclictest0-21swapper/119:22:211
175299953,1cyclictest25597-21basename19:25:130
175299950,5cyclictest0-21swapper/020:10:150
175299950,4cyclictest21587-21/usr/sbin/munin20:25:150
175299950,4cyclictest0-21swapper/020:05:180
175299950,3cyclictest23991-21cut20:30:130
175299950,3cyclictest0-21swapper/020:55:140
175299950,1cyclictest254-21systemd-journal19:14:590
175299950,0cyclictest0-21swapper/020:45:130
175479941,1cyclictest35-21ksoftirqd/319:10:043
175479940,1cyclictest254-21systemd-journal20:19:593
175379944,0cyclictest0-21swapper/119:44:081
175379944,0cyclictest0-21swapper/119:16:031
175379943,1cyclictest309392sleep120:44:371
175379943,1cyclictest195152sleep119:10:451
175379942,1cyclictest32093-21chrt19:37:091
175379941,2cyclictest0-21swapper/120:25:171
175379941,2cyclictest0-21swapper/120:24:591
175379941,1cyclictest0-21swapper/119:30:121
175379940,4cyclictest0-21swapper/121:50:231
175379940,4cyclictest0-21swapper/119:45:191
175379940,4cyclictest0-21swapper/100:25:201
175379940,3cyclictest0-21swapper/123:16:411
175379940,3cyclictest0-21swapper/120:10:151
175379940,2cyclictest0-21swapper/123:35:131
175379940,2cyclictest0-21swapper/122:12:141
175379940,2cyclictest0-21swapper/121:00:191
175379940,1cyclictest0-21swapper/123:10:131
175379940,1cyclictest0-21swapper/121:55:161
175379940,0cyclictest0-21swapper/120:05:191
175379931,1cyclictest0-21swapper/120:00:101
175379931,1cyclictest0-21swapper/119:55:111
175379930,2cyclictest0-21swapper/120:50:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional