You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 15:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackaslot8.osadl.org (updated Wed Jul 02, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
54502342310,20sleep20-21swapper/207:09:182
53612282248,21sleep00-21swapper/007:08:240
51402263233,18sleep30-21swapper/307:05:333
51722256222,22sleep10-21swapper/107:05:551
252922640,0sleep30-21swapper/309:35:173
182752630,0sleep10-21swapper/111:16:421
263482590,0sleep30-21swapper/310:03:053
164572590,0sleep30-21swapper/309:55:163
15512590,0sleep10-21swapper/111:56:001
204162580,0sleep30-21swapper/307:40:133
286482570,0sleep00-21swapper/010:59:320
165452560,0sleep00-21swapper/012:27:540
227192550,0sleep00-21swapper/009:33:030
27852520,0sleep00-21swapper/009:15:200
113632200,1sleep00-21swapper/010:44:230
227322170,0sleep20-21swapper/208:55:212
100112170,2sleep37937-21munin-node12:03:533
304382140,0sleep30-21swapper/311:54:083
162342130,0sleep10-21swapper/110:20:251
56262110,7sleep35629-21ssh11:33:193
56159995,3cyclictest19982-21systemd-journal11:24:323
56109997,2cyclictest28-21ksoftirqd/211:20:002
56109993,3cyclictest1905-21perf10:10:022
56069997,2cyclictest22-21ksoftirqd/108:35:011
56069990,8cyclictest20616-21/usr/sbin/munin07:40:141
56049994,4cyclictest30654-21snmpd11:15:090
56159983,4cyclictest0-21swapper/311:38:183
56159983,3cyclictest19982-21systemd-journal07:20:013
56109987,1cyclictest28-21ksoftirqd/212:05:012
56109985,2cyclictest28-21ksoftirqd/212:10:012
56109984,3cyclictest19982-21systemd-journal10:45:442
56109983,4cyclictest19982-21systemd-journal08:28:032
56109983,3cyclictest19982-21systemd-journal12:18:462
56109983,3cyclictest19982-21systemd-journal09:16:512
56109980,7cyclictest27597-21irqstats07:55:172
56069985,2cyclictest22-21ksoftirqd/111:40:151
56069984,3cyclictest19982-21systemd-journal09:02:161
56049984,2cyclictest502-21systemd-logind11:43:190
56049984,1cyclictest21695-21cron10:00:000
56049983,3cyclictest19982-21systemd-journal11:30:500
56049983,3cyclictest19982-21systemd-journal11:20:480
56049983,3cyclictest19982-21systemd-journal10:24:020
56049983,3cyclictest19982-21systemd-journal07:59:160
56049980,5cyclictest15037-21perf11:15:010
56049980,3cyclictest19061-21awk08:50:000
5654270,0sleep30-21swapper/309:45:433
56159977,0cyclictest0-21swapper/307:51:463
56159974,2cyclictest11736-21in:imuxsock10:43:143
56159973,3cyclictest9086-21memory10:15:193
56159973,3cyclictest508-21dbus-daemon09:24:233
56159973,3cyclictest30654-21snmpd08:52:203
56159973,3cyclictest30654-21snmpd08:06:043
56159973,3cyclictest19982-21systemd-journal11:10:023
56159973,3cyclictest0-21swapper/309:42:563
56159973,1cyclictest0-21swapper/312:18:173
56159973,1cyclictest0-21swapper/311:15:493
56159973,1cyclictest0-21swapper/310:30:123
56159972,4cyclictest0-21swapper/311:44:583
56159972,3cyclictest7661-21lldpd07:30:153
56159972,3cyclictest19982-21systemd-journal10:52:243
56159971,4cyclictest19982-21systemd-journal07:57:363
56159970,7cyclictest0-21swapper/312:20:143
56159970,5cyclictest19982-21systemd-journal12:37:323
56109976,1cyclictest28-21ksoftirqd/212:10:002
56109976,1cyclictest28-21ksoftirqd/210:30:012
56109975,2cyclictest28-21ksoftirqd/209:15:002
56109975,1cyclictest3047-21cpuspeed_turbos12:20:162
56109974,2cyclictest508-21dbus-daemon11:35:002
56109974,2cyclictest11736-21in:imuxsock09:36:532
56109973,3cyclictest7661-21lldpd09:30:342
56109973,3cyclictest508-21dbus-daemon12:28:472
56109973,3cyclictest19982-21systemd-journal11:22:522
56109973,3cyclictest19982-21systemd-journal10:51:092
56109973,3cyclictest19982-21systemd-journal07:25:012
56109973,3cyclictest19771-21sshd10:24:242
56109973,3cyclictest19116-21gdbus09:10:012
56109973,3cyclictest15245-21df08:40:142
56109973,1cyclictest0-21swapper/211:12:252
56109972,3cyclictest19982-21systemd-journal09:27:422
56109972,3cyclictest19982-21systemd-journal08:05:012
56069977,0cyclictest0-21swapper/110:27:481
56069974,2cyclictest508-21dbus-daemon12:04:351
56069974,2cyclictest2704-21cron11:05:011
56069974,2cyclictest11736-21in:imuxsock08:42:401
56069974,2cyclictest11736-21in:imuxsock07:56:471
56069973,3cyclictest508-21dbus-daemon07:54:171
56069973,3cyclictest19982-21systemd-journal09:30:371
56069973,3cyclictest19982-21systemd-journal08:03:511
56069973,3cyclictest0-21swapper/111:52:251
56069972,3cyclictest6978-21munin-run11:35:001
56069972,3cyclictest19982-21systemd-journal10:44:491
56069970,5cyclictest502-21systemd-logind12:32:331
56049974,2cyclictest3139-21idleruntime-cro08:15:000
56049973,3cyclictest9066-21df_inode07:15:150
56049973,3cyclictest508-21dbus-daemon10:46:090
56049973,3cyclictest30654-21snmpd11:50:280
56049973,3cyclictest30654-21snmpd09:08:110
56049973,3cyclictest19982-21systemd-journal12:10:500
56049973,3cyclictest19982-21systemd-journal08:23:590
56049973,3cyclictest0-21swapper/012:20:570
56049973,3cyclictest0-21swapper/012:06:320
56049973,2cyclictest19982-21systemd-journal10:00:400
56049973,1cyclictest7821-21turbostat10:15:010
56049972,3cyclictest7661-21lldpd10:18:060
56049971,4cyclictest19982-21systemd-journal12:37:320
56159963,2cyclictest22828-21taskset10:25:553
56159963,2cyclictest20153-21sed09:30:203
56159963,2cyclictest19982-21systemd-journal11:00:453
56159962,3cyclictest5853-21cat08:20:113
56159962,3cyclictest508-21dbus-daemon08:28:033
56159962,3cyclictest30654-21snmpd12:12:383
56159962,3cyclictest30654-21snmpd11:56:133
56159962,3cyclictest30654-21snmpd10:21:333
56159962,3cyclictest30654-21snmpd08:35:493
56159962,3cyclictest30654-21snmpd08:34:583
56159962,3cyclictest30654-21snmpd08:02:423
56159962,3cyclictest30654-21snmpd07:46:513
56159962,3cyclictest30654-21snmpd07:38:393
56159962,3cyclictest21788-21expr08:55:143
56159962,3cyclictest20815-21irqstats11:45:183
56159962,3cyclictest20681-21wc12:30:163
56159962,3cyclictest2049-21cut09:15:163
56159962,3cyclictest11736-21in:imuxsock07:25:053
56159962,3cyclictest0-21swapper/312:05:093
56159962,3cyclictest0-21swapper/310:45:063
56159962,3cyclictest0-21swapper/310:06:333
56159962,1cyclictest0-21swapper/309:11:553
56159961,3cyclictest19982-21systemd-journal11:25:223
56159961,3cyclictest19982-21systemd-journal10:37:483
56159961,3cyclictest19982-21systemd-journal09:50:153
56159961,3cyclictest19982-21systemd-journal09:03:063
56159961,2cyclictest19982-21systemd-journal12:25:013
56159961,2cyclictest19982-21systemd-journal09:25:123
56159960,6cyclictest0-21swapper/310:55:553
56159960,2cyclictest9801-21df_inode11:10:153
56159960,1cyclictest0-21swapper/308:10:403
56159960,0cyclictest0-21swapper/310:13:073
56109963,2cyclictest7546-21rm09:47:572
56109963,2cyclictest668-21runrttasks10:56:202
56109963,2cyclictest508-21dbus-daemon11:35:232
56109963,2cyclictest32134-21sed08:05:192
56109963,2cyclictest28872-21cat11:25:222
56109963,2cyclictest20371-21cpuspeed_turbos07:40:132
56109963,2cyclictest19676-21sh09:57:482
56109963,1cyclictest0-21swapper/211:55:562
56109963,1cyclictest0-21swapper/211:05:132
56109962,4cyclictest28-21ksoftirqd/207:16:502
56109962,3cyclictest6146-21basename10:40:132
56109962,3cyclictest5638-21basename08:20:102
56109962,3cyclictest508-21dbus-daemon11:42:032
56109962,3cyclictest367-21expr10:35:142
56109962,3cyclictest3153-21basename08:15:002
56109962,3cyclictest31085-21proc_pri09:40:222
56109962,3cyclictest30654-21snmpd11:45:492
56109962,3cyclictest30654-21snmpd10:01:562
56109962,3cyclictest30654-21snmpd09:21:022
56109962,3cyclictest30654-21snmpd08:30:312
56109962,3cyclictest30654-21snmpd07:45:272
56109962,3cyclictest30654-21snmpd07:33:032
56109962,3cyclictest30654-21snmpd07:13:182
56109962,3cyclictest29741-11brltty09:50:162
56109962,3cyclictest25006-21expr07:50:142
56109962,3cyclictest19915-21cat12:30:122
56109962,3cyclictest18287-21sensors08:45:192
56109962,1cyclictest0-21swapper/211:01:082
56109962,1cyclictest0-21swapper/210:31:322
56109961,4cyclictest0-21swapper/210:11:402
56109961,3cyclictest7661-21lldpd08:39:472
56109961,1cyclictest0-21swapper/211:50:232
56109960,5cyclictest24282-21grep09:00:152
56109960,3cyclictest28066-21/usr/sbin/munin12:35:192
56109960,2cyclictest8220-21/usr/sbin/munin10:15:192
56069964,1cyclictest1045-21ls09:15:001
56069963,2cyclictest508-21dbus-daemon09:05:361
56069963,2cyclictest3591-21head10:10:181
56069963,2cyclictest32729-21sh12:37:371
56069963,2cyclictest30654-21snmpd07:25:351
56069963,2cyclictest29838-21tr10:05:211
56069963,2cyclictest27283-21fschecks_count12:15:141
56069963,2cyclictest26012-21rm10:56:281
56069963,2cyclictest25905-21sh09:35:211
56069962,3cyclictest8273-21sed09:20:221
56069962,3cyclictest6115-21ls07:10:131
56069962,3cyclictest508-21dbus-daemon09:45:401
56069962,3cyclictest508-21dbus-daemon08:11:221
56069962,3cyclictest508-21dbus-daemon07:48:511
56069962,3cyclictest508-21dbus-daemon07:15:281
56069962,3cyclictest32049-21cat08:05:181
56069962,3cyclictest3175-21cat11:05:151
56069962,3cyclictest30654-21snmpd11:20:151
56069962,3cyclictest30654-21snmpd11:10:571
56069962,3cyclictest30654-21snmpd09:15:201
56069962,3cyclictest30654-21snmpd08:25:551
56069962,3cyclictest30654-21snmpd08:15:071
56069962,3cyclictest13833-21sensors08:35:221
56069962,3cyclictest13227-21expr09:25:131
56069962,3cyclictest1-21systemd08:24:431
56069962,3cyclictest11850-21expr12:25:131
56069962,3cyclictest0-21swapper/112:20:141
56069962,3cyclictest0-21swapper/112:05:201
56069962,3cyclictest0-21swapper/111:46:371
56069962,1cyclictest0-21swapper/111:37:091
56069962,1cyclictest0-21swapper/111:25:501
56069962,1cyclictest0-21swapper/110:50:551
56069962,1cyclictest0-21swapper/110:45:101
56069962,1cyclictest0-21swapper/110:35:551
56069962,1cyclictest0-21swapper/110:16:351
56069962,1cyclictest0-21swapper/109:40:321
56069961,4cyclictest18106-21chrt09:56:061
56069961,4cyclictest0-21swapper/110:32:391
56069961,4cyclictest0-21swapper/110:00:091
56069961,3cyclictest19982-21systemd-journal08:45:101
56069961,1cyclictest141rcu_preempt12:10:131
56049963,2cyclictest30654-21snmpd08:55:050
56049963,2cyclictest30523-21grep08:00:220
56049963,2cyclictest27963-21diskmemload10:05:220
56049963,2cyclictest22439-21/usr/sbin/munin07:45:160
56049963,2cyclictest20245-21ntp_kernel_pll_08:50:200
56049963,2cyclictest18780-21tail07:35:180
56049963,2cyclictest11736-21in:imuxsock07:25:010
56049962,3cyclictest9947-21cpuspeed_turbos09:50:140
56049962,3cyclictest8074-21seq08:25:140
56049962,3cyclictest666-21which11:55:200
56049962,3cyclictest31264-21vmstat11:00:270
56049962,3cyclictest30654-21snmpd09:45:100
56049962,3cyclictest30654-21snmpd09:40:070
56049962,3cyclictest30654-21snmpd08:36:320
56049962,3cyclictest30654-21snmpd08:19:460
56049962,3cyclictest30654-21snmpd07:40:400
56049962,3cyclictest30654-21snmpd07:21:020
56049962,3cyclictest28624-21cat09:10:130
56049962,3cyclictest27048-21cat10:30:150
56049962,3cyclictest26177-21awk09:35:230
56049962,3cyclictest21039-21expr10:25:140
56049962,3cyclictest19938-21grep12:30:130
56049962,3cyclictest13252-21expr09:25:130
56049962,1cyclictest0-21swapper/012:15:540
56049962,1cyclictest0-21swapper/011:35:300
56049962,1cyclictest0-21swapper/011:25:150
56049961,3cyclictest19982-21systemd-journal12:05:000
56049961,3cyclictest19982-21systemd-journal08:06:210
56049961,3cyclictest19982-21systemd-journal07:10:030
56049960,5cyclictest19982-21systemd-journal07:53:590
56049960,3cyclictest3837-21rm11:05:180
56049960,3cyclictest22833-21rm11:46:480
56049960,3cyclictest18623-21rm10:50:110
56049960,2cyclictest7190-21/usr/sbin/munin09:20:140
56049960,2cyclictest23752-21/usr/sbin/munin09:00:180
56159953,1cyclictest668-21runrttasks07:11:263
56159953,1cyclictest15249-21sh08:40:153
56159952,2cyclictest25970-21chrt09:05:063
56159952,2cyclictest17195-21cat08:45:133
56159950,4cyclictest10931-21apt-get07:20:143
56159950,3cyclictest19982-21systemd-journal08:15:083
56109953,1cyclictest19720-21fschecks_count08:50:172
56109952,2cyclictest508-21dbus-daemon07:35:042
56109952,2cyclictest4733-21cat08:15:192
56109952,2cyclictest13120-21chrt07:25:072
56069953,1cyclictest22129-21hddtemp_smartct08:55:171
56069953,1cyclictest15793-21cpuspeed_turbos07:30:151
56069952,2cyclictest19447-21cut08:50:171
56069952,2cyclictest10032-21cstates09:50:151
56069951,3cyclictest11603-21cat07:20:161
56069950,3cyclictest19982-21systemd-journal07:35:061
56049952,2cyclictest32454-21ssh10:35:040
56049952,2cyclictest30654-21snmpd08:40:020
56049952,2cyclictest10354-21gdbus08:30:020
56049951,2cyclictest19982-21systemd-journal07:30:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional