You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-25 - 05:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri May 24, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110952322290,20sleep20-21swapper/207:06:232
111612301269,20sleep10-21swapper/107:07:141
111952275242,21sleep00-21swapper/007:07:410
110442257220,22sleep30-21swapper/307:05:433
306222670,3sleep334-21ksoftirqd/311:57:073
251252620,0sleep20-21swapper/210:46:462
163682600,0sleep20-21swapper/210:40:132
226372570,0sleep20-21swapper/209:51:132
311372560,0sleep10-21swapper/109:33:491
212412530,0sleep10-21swapper/111:31:261
203762190,0sleep120377-21cat11:50:281
238902180,0sleep10-21swapper/110:20:021
265622160,0sleep00-21swapper/011:55:070
300212150,1sleep30-21swapper/307:50:003
34652140,0sleep30-21swapper/308:00:223
197672130,0sleep20-21swapper/209:25:002
185122130,0sleep00-21swapper/009:48:390
1149599124,1cyclictest141rcu_preempt10:25:111
11504991110,1cyclictest34-21ksoftirqd/310:25:013
22921290,0sleep10-21swapper/108:45:121
115019994,3cyclictest19982-21systemd-journal08:25:022
114959996,2cyclictest22-21ksoftirqd/108:20:001
114959994,3cyclictest19982-21systemd-journal07:10:471
32475280,7sleep132498-21sh12:18:431
25612280,0sleep20-21swapper/208:50:182
18219280,0sleep00-21swapper/010:15:120
115049986,2cyclictest34-21ksoftirqd/308:30:003
115049984,3cyclictest19982-21systemd-journal10:07:123
115049983,3cyclictest19982-21systemd-journal12:04:303
115049983,3cyclictest19982-21systemd-journal09:15:013
115019986,1cyclictest28-21ksoftirqd/210:00:012
115019986,1cyclictest0-21swapper/209:14:332
115019986,1cyclictest0-21swapper/209:14:332
115019984,3cyclictest508-21dbus-daemon11:20:012
115019982,3cyclictest26053-21ls12:15:002
114959987,1cyclictest22-21ksoftirqd/112:35:011
114959985,2cyclictest22-21ksoftirqd/107:45:011
114959983,3cyclictest19982-21systemd-journal10:41:291
114959983,3cyclictest19982-21systemd-journal10:13:101
114919985,2cyclictest12-21ksoftirqd/011:15:000
114919983,3cyclictest19982-21systemd-journal12:00:100
114919983,3cyclictest19982-21systemd-journal10:51:050
114919983,3cyclictest19982-21systemd-journal07:19:580
25282270,0sleep00-21swapper/010:46:570
115049974,2cyclictest508-21dbus-daemon11:35:423
115049974,2cyclictest11736-21in:imuxsock10:15:373
115049974,2cyclictest11736-21in:imuxsock09:05:013
115049973,3cyclictest508-21dbus-daemon12:12:513
115049973,3cyclictest508-21dbus-daemon11:15:293
115049973,3cyclictest2886-21grep10:55:143
115049973,3cyclictest19982-21systemd-journal11:49:533
115049973,3cyclictest19982-21systemd-journal11:13:363
115049973,3cyclictest19982-21systemd-journal08:39:133
115049973,3cyclictest19982-21systemd-journal07:25:013
115049973,3cyclictest19116-21gdbus10:25:013
115049973,3cyclictest13388-21snmpd08:07:413
115049973,3cyclictest0-21swapper/311:06:083
115049973,1cyclictest0-21swapper/310:35:363
115049973,1cyclictest0-21swapper/309:58:043
115049972,3cyclictest19982-21systemd-journal10:49:493
115049972,3cyclictest19982-21systemd-journal09:52:403
115049972,3cyclictest19982-21systemd-journal09:33:123
115049972,3cyclictest19982-21systemd-journal09:29:433
115049972,3cyclictest19982-21systemd-journal09:07:113
115049972,3cyclictest19982-21systemd-journal07:41:113
115049972,3cyclictest19982-21systemd-journal07:19:343
115049970,3cyclictest10334-21apt-get12:05:113
115019975,1cyclictest28-21ksoftirqd/211:10:012
115019974,2cyclictest11736-21in:imuxsock10:05:012
115019974,2cyclictest11736-21in:imuxsock07:21:382
115019973,3cyclictest508-21dbus-daemon09:00:562
115019973,3cyclictest508-21dbus-daemon08:15:272
115019973,3cyclictest502-21systemd-logind08:48:502
115019973,3cyclictest32117-21sshd10:25:352
115019973,3cyclictest29741-11brltty11:25:162
115019973,3cyclictest19982-21systemd-journal09:30:192
115019973,3cyclictest19982-21systemd-journal07:50:012
115019973,3cyclictest13388-21snmpd08:58:512
115019973,3cyclictest13388-21snmpd07:11:332
115019973,3cyclictest0-21swapper/211:57:222
115019973,3cyclictest0-21swapper/210:23:422
115019973,2cyclictest19982-21systemd-journal12:36:052
115019973,1cyclictest0-21swapper/210:05:272
115019972,3cyclictest19982-21systemd-journal11:40:012
115019972,3cyclictest19982-21systemd-journal07:36:392
115019972,2cyclictest20236-1kworker/u9:011:49:042
115019971,5cyclictest0-21swapper/211:10:022
115019970,1cyclictest0-21swapper/212:22:482
114959976,1cyclictest22-21ksoftirqd/107:20:011
114959975,1cyclictest22-21ksoftirqd/111:10:021
114959974,2cyclictest502-21systemd-logind11:20:161
114959974,2cyclictest22-21ksoftirqd/108:33:241
114959973,3cyclictest508-21dbus-daemon12:00:001
114959973,3cyclictest508-21dbus-daemon09:16:211
114959973,3cyclictest29065-21cron09:00:001
114959973,3cyclictest19982-21systemd-journal12:05:441
114959973,2cyclictest8143-21ssh12:23:431
114959971,2cyclictest19982-21systemd-journal07:50:121
114959970,1cyclictest141rcu_preempt08:40:141
114919974,2cyclictest508-21dbus-daemon11:33:130
114919974,2cyclictest508-21dbus-daemon09:11:470
114919974,2cyclictest508-21dbus-daemon09:11:470
114919974,2cyclictest25858-21munin-run12:35:010
114919973,3cyclictest508-21dbus-daemon08:40:010
114919973,3cyclictest508-21dbus-daemon07:25:490
114919973,3cyclictest19982-21systemd-journal10:27:110
114919973,3cyclictest19982-21systemd-journal09:27:130
114919973,3cyclictest19982-21systemd-journal08:27:330
114919973,3cyclictest13388-21snmpd11:15:450
114919973,3cyclictest13388-21snmpd10:21:510
114919973,3cyclictest1-21systemd11:05:400
114919973,3cyclictest0-21swapper/011:38:080
114919973,3cyclictest0-21swapper/010:36:100
114919973,1cyclictest0-21swapper/011:27:450
114919972,3cyclictest19982-21systemd-journal11:48:140
114919972,2cyclictest22417-21dump-pmu-power08:45:000
114919970,7cyclictest0-21swapper/007:10:140
114919970,3cyclictest30259-21/usr/sbin/munin07:50:180
115049964,1cyclictest26974-21sed12:35:143
115049963,2cyclictest6619-21sh12:22:313
115049963,2cyclictest4875-21needreboot11:20:203
115049963,2cyclictest26742-21expr12:15:133
115049963,2cyclictest21228-21sshd07:30:023
115049963,2cyclictest19982-21systemd-journal09:10:123
115049963,2cyclictest19982-21systemd-journal09:10:123
115049963,2cyclictest19974-21ntpq07:25:223
115049963,2cyclictest1376-21ntpq09:35:213
115049963,2cyclictest11118-21sh11:25:133
115049962,3cyclictest9637-21rt-features11:00:233
115049962,3cyclictest4307-21cat10:30:143
115049962,3cyclictest30674-21entropy07:50:143
115049962,3cyclictest2001-21sshd10:00:303
115049962,3cyclictest18205-21cat11:30:123
115049962,3cyclictest16676-21cat08:30:183
115049962,3cyclictest15294-21tr09:20:243
115049962,3cyclictest13388-21snmpd10:50:203
115049962,3cyclictest13388-21snmpd10:40:083
115049962,3cyclictest13388-21snmpd09:40:163
115049962,3cyclictest13388-21snmpd08:42:403
115049962,3cyclictest13388-21snmpd08:21:533
115049962,3cyclictest13388-21snmpd08:15:113
115049962,3cyclictest13388-21snmpd07:56:433
115049962,3cyclictest0-21swapper/312:25:203
115049962,2cyclictest19982-21systemd-journal08:50:183
115049962,1cyclictest0-21swapper/311:40:423
115049961,4cyclictest18243-21apt-get12:30:103
115049961,3cyclictest19982-21systemd-journal11:50:183
115049961,3cyclictest19982-21systemd-journal09:47:143
115049961,3cyclictest19982-21systemd-journal08:55:233
115049961,3cyclictest19982-21systemd-journal08:45:303
115049961,2cyclictest13746-21ssh10:10:543
115019966,0cyclictest0-21swapper/211:35:322
115019966,0cyclictest0-21swapper/211:32:102
115019964,1cyclictest18811-21hddtemp_smartct08:35:152
115019963,3cyclictest20236-1kworker/u9:010:50:132
115019963,2cyclictest29444-21ssh12:16:162
115019963,2cyclictest21004-21ntp_kernel_pll_09:25:192
115019963,2cyclictest18696-21sed10:15:192
115019963,2cyclictest16029-21ssh09:46:022
115019963,2cyclictest11736-21in:imuxsock10:56:052
115019963,2cyclictest10336-21sh11:00:442
115019963,2cyclictest0-21swapper/212:26:282
115019962,3cyclictest508-21dbus-daemon08:35:012
115019962,3cyclictest31843-21expr09:05:142
115019962,3cyclictest29741-11brltty07:41:402
115019962,3cyclictest19982-21systemd-journal09:40:592
115019962,3cyclictest13388-21snmpd12:05:082
115019962,3cyclictest13388-21snmpd11:21:582
115019962,3cyclictest13388-21snmpd10:37:202
115019962,3cyclictest13388-21snmpd10:30:172
115019962,3cyclictest13388-21snmpd07:33:272
115019962,3cyclictest1-21systemd07:50:012
115019962,3cyclictest11799-21grep08:20:162
115019962,3cyclictest0-21swapper/209:35:092
115019962,3cyclictest0-21swapper/209:16:412
115019962,3cyclictest0-21swapper/208:10:122
115019962,1cyclictest0-21swapper/212:32:492
115019962,1cyclictest0-21swapper/211:50:152
115019961,3cyclictest19982-21systemd-journal10:10:322
115019960,6cyclictest0-21swapper/212:00:342
115019960,5cyclictest20008-21ntp_states07:25:232
115019960,3cyclictest6503-21idleruntime-cro08:10:012
114959964,1cyclictest0-21swapper/107:20:111
114959963,2cyclictest502-21systemd-logind11:00:151
114959963,2cyclictest3044-21/usr/sbin/munin09:10:451
114959963,2cyclictest3044-21/usr/sbin/munin09:10:451
114959963,2cyclictest18922-21sh10:15:201
114959963,2cyclictest15402-21apt-get08:30:011
114959963,2cyclictest14950-21grep09:45:271
114959963,2cyclictest13388-21snmpd11:36:281
114959963,2cyclictest13388-21snmpd10:46:331
114959963,2cyclictest13388-21snmpd09:42:081
114959963,2cyclictest13252-21ssh12:26:221
114959963,2cyclictest13130-21chrt08:24:291
114959963,2cyclictest12317-21uname11:25:231
114959963,2cyclictest1001-21awk07:55:191
114959963,2cyclictest0-21swapper/110:05:271
114959963,1cyclictest0-21swapper/110:53:491
114959962,3cyclictest6831-21sshd08:10:101
114959962,3cyclictest4539-21fw_packets10:30:161
114959962,3cyclictest31533-21sshd11:15:491
114959962,3cyclictest13388-21snmpd12:10:401
114959962,3cyclictest13388-21snmpd12:00:431
114959962,3cyclictest13388-21snmpd11:05:461
114959962,3cyclictest13388-21snmpd08:54:241
114959962,3cyclictest13388-21snmpd08:04:581
114959962,3cyclictest13388-21snmpd07:35:071
114959962,3cyclictest1282-21sshd09:35:211
114959962,1cyclictest0-21swapper/112:35:291
114959962,1cyclictest0-21swapper/109:56:471
114959962,1cyclictest0-21swapper/109:21:581
114959961,4cyclictest29741-11brltty11:40:181
114959961,4cyclictest0-21swapper/110:00:121
114959961,2cyclictest11122-21ssh10:35:211
114959960,6cyclictest0-21swapper/110:56:501
114959960,5cyclictest19982-11systemd-journal11:46:091
114959960,3cyclictest21661-21diskstats07:30:161
114959960,0cyclictest0-21swapper/109:50:411
114959960,0cyclictest0-21swapper/109:27:561
114919966,0cyclictest0-21swapper/010:30:170
114919963,2cyclictest8871-21sensors_temp09:15:260
114919963,2cyclictest668-21runrttasks09:35:430
114919963,2cyclictest508-21dbus-daemon11:00:140
114919963,2cyclictest3346-21sh10:55:200
114919963,2cyclictest26417-21sh09:55:130
114919963,2cyclictest16270-21acpi10:40:130
114919963,2cyclictest15354-21sh09:20:250
114919963,2cyclictest13388-21snmpd08:02:000
114919962,3cyclictest7713-21kernelversion09:40:200
114919962,3cyclictest28422-21who12:15:290
114919962,3cyclictest28360-21cat07:45:110
114919962,3cyclictest25726-21sed07:40:010
114919962,3cyclictest21492-21expr07:30:160
114919962,3cyclictest19982-21systemd-journal12:25:220
114919962,3cyclictest19982-21systemd-journal12:10:210
114919962,3cyclictest16998-21sed08:30:230
114919962,3cyclictest13388-21snmpd11:41:010
114919962,3cyclictest13388-21snmpd10:07:160
114919962,3cyclictest13388-21snmpd10:00:460
114919962,3cyclictest13388-21snmpd09:54:070
114919962,3cyclictest13388-21snmpd09:34:360
114919962,3cyclictest13388-21snmpd09:06:000
114919962,3cyclictest13388-21snmpd08:51:500
114919962,3cyclictest13388-21snmpd08:24:290
114919962,3cyclictest13388-21snmpd08:15:530
114919962,3cyclictest13388-21snmpd07:56:540
114919962,3cyclictest13388-21snmpd07:20:360
114919962,3cyclictest12845-21which10:10:230
114919962,3cyclictest10720-21expr12:05:110
114919961,3cyclictest19982-21systemd-journal11:50:000
114919961,2cyclictest7198-21ssh11:21:470
114919961,2cyclictest28771-21ssh12:35:560
114919960,4cyclictest19982-21systemd-journal08:55:200
114919960,2cyclictest29327-21/usr/sbin/munin09:00:140
114919960,1cyclictest3267-21ntp_states12:20:200
115049953,1cyclictest668-21runrttasks07:10:033
115049951,3cyclictest23995-21/usr/sbin/munin07:35:133
115049951,2cyclictest502-21systemd-logind08:10:023
115019953,1cyclictest3464-21sendmail_mailst08:00:222
115019951,3cyclictest32488-21/usr/sbin/munin07:55:162
115019951,3cyclictest20757-21expr08:40:162
115019951,3cyclictest14569-21apt07:15:122
114959952,2cyclictest4684-21tr08:05:121
114959952,2cyclictest29654-21cat09:00:121
114959951,3cyclictest31969-21df_inode09:05:141
114959951,3cyclictest13388-21snmpd07:45:131
114959950,3cyclictest19982-21systemd-journal08:35:041
114959950,3cyclictest19982-21systemd-journal07:27:291
114919952,2cyclictest6716-21sshd08:10:070
114919952,2cyclictest26176-21cat07:40:140
114919952,2cyclictest22945-21expr08:45:110
114919950,3cyclictest19982-21systemd-journal08:06:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional