You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-04 - 09:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Fri Jul 04, 2025 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33792207151,43sleep20-21swapper/219:05:102
52022202165,24sleep30-21swapper/319:06:193
53752199159,26sleep00-21swapper/019:08:340
54012198158,26sleep10-21swapper/119:08:551
123922330,0sleep30-21swapper/322:10:153
5557991716,1cyclictest9-21ksoftirqd/023:15:170
5557991414,0cyclictest9-21ksoftirqd/023:55:120
5557991413,1cyclictest9-21ksoftirqd/021:55:130
289312140,0sleep30-21swapper/321:05:153
5577991311,2cyclictest28-21ksoftirqd/223:50:282
5577991311,1cyclictest28-21ksoftirqd/223:15:002
555799138,2cyclictest9-21ksoftirqd/000:12:080
5557991313,0cyclictest9-21ksoftirqd/021:15:190
5557991312,1cyclictest9-21ksoftirqd/020:10:000
5557991311,1cyclictest9-21ksoftirqd/022:50:230
556899120,11cyclictest0-21swapper/123:45:201
5557991211,1cyclictest9-21ksoftirqd/023:30:110
5557991211,1cyclictest9-21ksoftirqd/023:20:170
5557991211,1cyclictest9-21ksoftirqd/023:20:170
5557991211,1cyclictest9-21ksoftirqd/022:15:180
5557991211,1cyclictest9-21ksoftirqd/022:00:190
5557991211,1cyclictest9-21ksoftirqd/021:25:130
309322120,0sleep00-21swapper/021:10:000
557799119,1cyclictest28-21ksoftirqd/220:40:012
5577991110,1cyclictest28-21ksoftirqd/221:21:552
5577991110,1cyclictest28-21ksoftirqd/219:50:132
557799110,0cyclictest0-21swapper/221:03:512
555799119,1cyclictest9-21ksoftirqd/023:00:220
555799119,1cyclictest9-21ksoftirqd/022:20:150
555799119,1cyclictest9-21ksoftirqd/021:50:000
555799119,1cyclictest9-21ksoftirqd/019:40:010
555799113,4cyclictest30855-21diskmemload22:10:000
5557991111,0cyclictest9-21ksoftirqd/023:45:200
5557991111,0cyclictest9-21ksoftirqd/023:40:180
5557991110,1cyclictest9-21ksoftirqd/022:40:010
5557991110,1cyclictest9-21ksoftirqd/021:40:180
558899108,1cyclictest35-21ksoftirqd/322:55:163
558899108,1cyclictest30855-21diskmemload21:39:593
558899107,1cyclictest35-21ksoftirqd/320:55:003
557799109,1cyclictest28-21ksoftirqd/223:35:112
557799109,1cyclictest28-21ksoftirqd/222:41:352
557799109,1cyclictest28-21ksoftirqd/222:05:142
557799108,1cyclictest28-21ksoftirqd/223:08:342
557799108,1cyclictest28-21ksoftirqd/221:25:142
5577991010,0cyclictest28-21ksoftirqd/223:28:522
5577991010,0cyclictest28-21ksoftirqd/222:00:102
5577991010,0cyclictest0-21swapper/200:29:042
557799100,9cyclictest1497-21sendmail-mta21:59:292
555799109,1cyclictest9-21ksoftirqd/021:30:130
555799109,1cyclictest9-21ksoftirqd/019:45:210
555799109,1cyclictest9-21ksoftirqd/019:40:140
555799109,1cyclictest9-21ksoftirqd/000:20:150
555799109,1cyclictest9-21ksoftirqd/000:00:160
555799109,1cyclictest742-21runrttasks23:13:550
555799108,1cyclictest9-21ksoftirqd/023:50:180
555799108,1cyclictest9-21ksoftirqd/023:00:010
555799108,1cyclictest9-21ksoftirqd/019:15:000
555799108,1cyclictest9-21ksoftirqd/000:15:160
5557991010,0cyclictest9-21ksoftirqd/022:10:140
5557991010,0cyclictest9-21ksoftirqd/021:51:570
5557991010,0cyclictest9-21ksoftirqd/021:20:550
5557991010,0cyclictest9-21ksoftirqd/000:25:180
5557991010,0cyclictest13650irq/124-ahci[0022:50:000
5557991010,0cyclictest101rcuc/019:15:010
37772100,0sleep10-21swapper/121:58:361
55889998,1cyclictest35-21ksoftirqd/322:55:013
55889998,1cyclictest35-21ksoftirqd/322:09:593
55889997,1cyclictest35-21ksoftirqd/320:20:003
55889991,7cyclictest17740-21snmpd21:44:113
55889990,6cyclictest2043-21/usr/sbin/munin00:05:163
55889990,6cyclictest2043-21/usr/sbin/munin00:05:163
55889990,5cyclictest11201-21apt-get19:20:143
55779999,0cyclictest28-21ksoftirqd/223:30:182
55779999,0cyclictest28-21ksoftirqd/222:35:292
55779999,0cyclictest28-21ksoftirqd/222:24:562
55779999,0cyclictest28-21ksoftirqd/200:18:072
55779999,0cyclictest28-21ksoftirqd/200:02:382
55779998,1cyclictest28-21ksoftirqd/223:49:582
55779998,1cyclictest28-21ksoftirqd/223:45:002
55779998,1cyclictest28-21ksoftirqd/223:15:202
55779998,1cyclictest28-21ksoftirqd/222:55:232
55779998,1cyclictest28-21ksoftirqd/222:10:162
55779998,1cyclictest28-21ksoftirqd/220:45:012
55779998,1cyclictest28-21ksoftirqd/200:35:152
55779998,1cyclictest28-21ksoftirqd/200:20:132
55779997,1cyclictest28-21ksoftirqd/222:30:152
55779997,1cyclictest28-21ksoftirqd/221:30:192
55779990,8cyclictest0-21swapper/200:30:432
55689990,2cyclictest0-21swapper/119:20:151
55579999,0cyclictest9-21ksoftirqd/023:05:510
55579999,0cyclictest9-21ksoftirqd/021:10:140
55579998,1cyclictest9-21ksoftirqd/022:25:120
55579998,1cyclictest9-21ksoftirqd/021:00:260
55579998,1cyclictest9-21ksoftirqd/020:55:200
55579998,1cyclictest9-21ksoftirqd/020:35:200
55579998,1cyclictest9-21ksoftirqd/000:40:000
55579998,1cyclictest9-21ksoftirqd/000:05:150
55579998,1cyclictest9-21ksoftirqd/000:05:150
55579997,1cyclictest9-21ksoftirqd/000:30:200
55889987,1cyclictest35-21ksoftirqd/323:18:323
55889987,1cyclictest35-21ksoftirqd/321:00:003
55889987,1cyclictest35-21ksoftirqd/300:30:003
55889986,1cyclictest9126-21sh21:22:293
55889986,1cyclictest17740-21snmpd21:30:133
55889984,3cyclictest557-21nscd23:48:213
55889982,5cyclictest17740-21snmpd22:15:413
55889982,4cyclictest21354-21/usr/sbin/munin23:05:203
55889980,4cyclictest254-21systemd-journal22:25:003
55779988,0cyclictest60950irq/123-eno121:45:322
55779988,0cyclictest28-21ksoftirqd/221:50:162
55779988,0cyclictest28-21ksoftirqd/221:10:062
55779988,0cyclictest28-21ksoftirqd/200:05:162
55779988,0cyclictest28-21ksoftirqd/200:05:162
55779987,1cyclictest6912-21ntp_kernel_pll_19:10:192
55779987,1cyclictest28-21ksoftirqd/223:55:172
55779987,1cyclictest28-21ksoftirqd/223:20:182
55779987,1cyclictest28-21ksoftirqd/223:20:182
55779987,1cyclictest28-21ksoftirqd/220:25:002
55779987,1cyclictest28-21ksoftirqd/219:30:172
55779986,1cyclictest60950irq/123-eno120:30:192
55779986,1cyclictest28-21ksoftirqd/222:50:232
55779980,8cyclictest0-21swapper/223:01:092
55779980,8cyclictest0-21swapper/222:46:372
55779980,8cyclictest0-21swapper/222:16:512
55779980,8cyclictest0-21swapper/221:41:092
55779980,8cyclictest0-21swapper/221:37:152
55779980,8cyclictest0-21swapper/221:15:052
55779980,8cyclictest0-21swapper/200:10:342
55779980,0cyclictest0-21swapper/222:25:092
55689980,7cyclictest0-21swapper/123:05:201
55689980,7cyclictest0-21swapper/120:15:181
55579988,0cyclictest13650irq/124-ahci[0019:35:010
55579987,1cyclictest9-21ksoftirqd/021:40:000
55579987,1cyclictest9-21ksoftirqd/020:50:180
55579987,1cyclictest9-21ksoftirqd/020:10:210
55579987,1cyclictest9-21ksoftirqd/020:00:000
55579986,1cyclictest9-21ksoftirqd/022:40:000
55579984,2cyclictest30855-21diskmemload23:28:560
55579984,2cyclictest254-21systemd-journal20:20:000
55579983,4cyclictest13374-21perf19:25:000
55579983,3cyclictest30855-21diskmemload23:38:210
55579982,1cyclictest13450-21grep20:30:190
55579980,7cyclictest30584-21ssh22:34:160
55889977,0cyclictest35-21ksoftirqd/323:10:203
55889976,1cyclictest35-21ksoftirqd/322:40:003
55889976,1cyclictest35-21ksoftirqd/321:45:143
55889976,1cyclictest35-21ksoftirqd/320:27:343
55889976,1cyclictest35-21ksoftirqd/320:00:003
55889976,1cyclictest35-21ksoftirqd/300:20:003
55889976,1cyclictest17740-21snmpd23:55:563
55889975,1cyclictest35-21ksoftirqd/320:15:003
55889975,1cyclictest17740-21snmpd23:27:383
55889974,2cyclictest17740-21snmpd00:00:413
55889972,2cyclictest2627-21apt-get21:15:143
55889971,4cyclictest12211-21apt-get20:30:133
55889971,1cyclictest5574-21sort00:10:153
55889970,5cyclictest25513-21nscd22:28:563
55889970,2cyclictest0-21swapper/322:00:133
55779976,1cyclictest20825-21kworker/2:119:20:192
55779976,1cyclictest20825-21kworker/2:119:15:132
55779976,1cyclictest17740-21snmpd19:36:312
55779975,1cyclictest28-21ksoftirqd/220:29:592
55779975,1cyclictest1552-21ntpq20:05:192
55779970,7cyclictest0-21swapper/219:57:192
55779970,6cyclictest29537-21hddtemp_smartct21:05:172
55779970,0cyclictest0-21swapper/220:00:232
55689971,6cyclictest0-21swapper/119:48:131
55689970,7cyclictest0-21swapper/123:15:181
55689970,6cyclictest0-21swapper/123:50:231
55689970,6cyclictest0-21swapper/122:11:381
55689970,6cyclictest0-21swapper/120:45:231
55689970,4cyclictest0-21swapper/121:55:001
55689970,0cyclictest0-21swapper/123:56:371
55689970,0cyclictest0-21swapper/123:40:001
55689970,0cyclictest0-21swapper/123:36:451
55689970,0cyclictest0-21swapper/123:31:351
55689970,0cyclictest0-21swapper/123:01:311
55689970,0cyclictest0-21swapper/122:57:431
55689970,0cyclictest0-21swapper/122:48:191
55689970,0cyclictest0-21swapper/122:42:451
55689970,0cyclictest0-21swapper/122:37:091
55689970,0cyclictest0-21swapper/122:30:371
55689970,0cyclictest0-21swapper/122:27:251
55689970,0cyclictest0-21swapper/122:23:471
55689970,0cyclictest0-21swapper/122:15:111
55689970,0cyclictest0-21swapper/122:01:311
55689970,0cyclictest0-21swapper/121:47:451
55689970,0cyclictest0-21swapper/121:40:551
55689970,0cyclictest0-21swapper/121:38:511
55689970,0cyclictest0-21swapper/121:31:041
55689970,0cyclictest0-21swapper/121:27:291
55689970,0cyclictest0-21swapper/121:22:331
55689970,0cyclictest0-21swapper/121:10:091
55689970,0cyclictest0-21swapper/100:35:091
55689970,0cyclictest0-21swapper/100:31:051
55689970,0cyclictest0-21swapper/100:26:251
55689970,0cyclictest0-21swapper/100:22:031
55689970,0cyclictest0-21swapper/100:12:151
55689970,0cyclictest0-21swapper/100:05:431
55689970,0cyclictest0-21swapper/100:05:431
55689970,0cyclictest0-21swapper/100:00:131
55579977,0cyclictest9-21ksoftirqd/019:25:150
55579976,1cyclictest9-21ksoftirqd/020:45:000
55579976,1cyclictest9-21ksoftirqd/020:00:170
55579975,1cyclictest9-21ksoftirqd/020:30:000
55579971,5cyclictest25341-21/usr/sbin/munin19:50:200
55579971,4cyclictest0-21swapper/020:20:130
55579970,7cyclictest0-21swapper/020:48:520
22545270,0sleep330855-21diskmemload00:32:063
55889965,1cyclictest9491-21ssh23:30:453
55889965,1cyclictest7607-21ntp_states22:45:203
55889965,1cyclictest35-21ksoftirqd/321:55:143
55889965,1cyclictest35-21ksoftirqd/319:15:013
55889965,1cyclictest31953-21ssh21:52:153
55889965,1cyclictest19137-21cat19:35:163
55889965,1cyclictest17740-21snmpd21:00:543
55889965,1cyclictest17740-21snmpd19:50:023
55889965,1cyclictest17309-21ssh23:41:473
55889965,1cyclictest13655-21ssh00:20:173
55889965,1cyclictest12486-21ssh21:26:003
55889965,1cyclictest11263-21ssh23:35:083
55889964,1cyclictest30855-21diskmemload23:51:323
55889964,1cyclictest17740-21snmpd21:10:043
55889964,1cyclictest17740-21snmpd20:41:303
55889964,1cyclictest17740-21snmpd20:37:423
55889962,2cyclictest254-21systemd-journal19:34:593
55889961,0cyclictest27487-21telnet22:30:143
55889960,5cyclictest0-21swapper/323:20:333
55889960,5cyclictest0-21swapper/323:20:333
55889960,4cyclictest0-21swapper/323:00:293
55889960,3cyclictest19305-21apt-get20:45:183
55889960,3cyclictest0-21swapper/322:40:163
55889960,3cyclictest0-21swapper/300:35:093
55779966,0cyclictest60950irq/123-eno119:45:252
55779966,0cyclictest60950irq/123-eno119:25:382
55779966,0cyclictest25408-21sensors20:55:212
55779965,1cyclictest20825-21kworker/2:120:10:072
55779965,1cyclictest17740-21snmpd20:50:092
55779964,1cyclictest28-21ksoftirqd/220:15:182
55779964,1cyclictest28-21ksoftirqd/219:40:182
55779960,0cyclictest0-21swapper/220:49:312
55689961,2cyclictest0-21swapper/120:25:231
55689960,5cyclictest0-21swapper/120:24:111
55689960,5cyclictest0-21swapper/119:10:571
55689960,3cyclictest0-21swapper/123:11:381
55689960,0cyclictest0-21swapper/123:29:031
55689960,0cyclictest0-21swapper/123:20:251
55689960,0cyclictest0-21swapper/123:20:241
55689960,0cyclictest0-21swapper/122:52:071
55689960,0cyclictest0-21swapper/121:17:471
55689960,0cyclictest0-21swapper/120:35:221
55689960,0cyclictest0-21swapper/100:17:531
55889955,0cyclictest0-21swapper/319:15:003
55889954,1cyclictest17740-21snmpd20:20:443
55689955,0cyclictest0-21swapper/122:07:081
55689955,0cyclictest0-21swapper/120:10:151
55689954,1cyclictest0-21swapper/119:15:201
55689951,2cyclictest0-21swapper/120:55:131
55689950,5cyclictest0-21swapper/120:31:241
55689950,5cyclictest0-21swapper/120:03:331
55689950,5cyclictest0-21swapper/119:56:121
55689950,1cyclictest30715-21chrt21:08:251
55689950,0cyclictest0-21swapper/119:51:571
55689950,0cyclictest0-21swapper/119:41:541
55889943,1cyclictest23795-21hddtemp_smartct19:45:183
55889942,1cyclictest14724-21ntp_states19:25:213
55889942,1cyclictest1154-21gltestperf20:05:163
55889942,0cyclictest20638-21apt-get19:40:143
55889940,1cyclictest30480-21apt-get20:00:153
55689944,0cyclictest0-21swapper/120:09:211
55689944,0cyclictest0-21swapper/119:35:121
55689942,1cyclictest13542-21chrt19:25:041
55689941,3cyclictest0-21swapper/120:50:241
55689941,2cyclictest0-21swapper/119:30:181
55689940,2cyclictest0-21swapper/120:40:211
55689933,0cyclictest0-21swapper/121:00:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional