You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 13:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Thu Dec 04, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45262296262,21sleep20-21swapper/219:09:392
45102285252,21sleep30-21swapper/319:09:283
42052279249,19sleep10-21swapper/119:05:481
42042259225,22sleep00-21swapper/019:05:470
139322680,0sleep10-21swapper/120:40:141
156062620,0sleep10-21swapper/122:05:241
23162610,0sleep30-21swapper/321:35:303
157972600,0sleep20-21swapper/223:31:142
12612600,0sleep00-21swapper/022:39:220
11872570,0sleep20-21swapper/223:00:182
69872550,0sleep00-21swapper/023:25:190
176382540,0sleep20-21swapper/200:17:152
114852530,0sleep10-21swapper/122:24:541
161462500,0sleep00-21swapper/022:05:460
245012220,0sleep00-21swapper/023:37:030
249612190,0sleep20-21swapper/221:50:222
238352160,0sleep00-21swapper/023:58:550
114952160,0sleep10-21swapper/123:29:051
275252140,0sleep00-21swapper/023:18:020
250222140,0sleep10-21swapper/119:50:211
240952140,0sleep30-21swapper/323:59:103
467199124,5cyclictest34-21ksoftirqd/321:30:223
4671991110,1cyclictest34-21ksoftirqd/319:55:013
4671991110,1cyclictest331rcuc/319:15:023
4671991110,1cyclictest331rcuc/319:15:023
466699111,9cyclictest28969-21grep23:40:172
202182110,0sleep00-21swapper/023:35:000
467199109,1cyclictest34-21ksoftirqd/320:15:013
467199101,2cyclictest34-21ksoftirqd/322:55:013
466299106,3cyclictest6376-21sed20:20:241
303272100,0chrt0-21swapper/121:54:591
120282100,1sleep00-21swapper/022:25:080
46719998,1cyclictest34-21ksoftirqd/323:10:013
46719998,1cyclictest34-21ksoftirqd/322:25:013
46719998,1cyclictest34-21ksoftirqd/321:20:013
46719998,1cyclictest34-21ksoftirqd/320:05:013
46719998,1cyclictest34-21ksoftirqd/300:24:593
46719998,1cyclictest34-21ksoftirqd/300:00:013
46719997,2cyclictest34-21ksoftirqd/322:35:013
46719993,4cyclictest34-21ksoftirqd/322:17:353
46719993,4cyclictest34-21ksoftirqd/322:13:503
46719993,4cyclictest34-21ksoftirqd/320:28:123
46719992,4cyclictest34-21ksoftirqd/323:25:093
46719992,4cyclictest34-21ksoftirqd/322:45:193
46719991,4cyclictest0-21swapper/322:40:073
46669995,3cyclictest19982-21systemd-journal22:07:052
46609994,3cyclictest19982-21systemd-journal20:38:380
26204290,1sleep10-21swapper/121:30:181
25229290,0sleep20-21swapper/221:05:132
6688280,1sleep20-21swapper/221:39:172
46719987,1cyclictest34-21ksoftirqd/323:40:003
46719987,1cyclictest34-21ksoftirqd/322:57:593
46719987,1cyclictest34-21ksoftirqd/322:40:013
46719987,1cyclictest331rcuc/320:20:153
46719985,2cyclictest34-21ksoftirqd/322:10:003
46719985,2cyclictest34-21ksoftirqd/321:15:013
46719985,2cyclictest34-21ksoftirqd/319:15:023
46719983,3cyclictest34-21ksoftirqd/319:56:293
46719982,4cyclictest34-21ksoftirqd/323:43:213
46719982,4cyclictest34-21ksoftirqd/323:23:213
46719982,4cyclictest34-21ksoftirqd/323:15:203
46719982,4cyclictest34-21ksoftirqd/322:26:433
46719982,4cyclictest34-21ksoftirqd/321:22:053
46719982,4cyclictest34-21ksoftirqd/321:05:343
46719982,4cyclictest34-21ksoftirqd/300:12:403
46719982,4cyclictest331rcuc/322:02:083
46719981,5cyclictest34-21ksoftirqd/323:54:403
46719981,5cyclictest34-21ksoftirqd/323:45:123
46719981,5cyclictest34-21ksoftirqd/323:30:303
46719981,5cyclictest34-21ksoftirqd/321:48:443
46719981,5cyclictest34-21ksoftirqd/321:41:003
46719981,5cyclictest34-21ksoftirqd/300:39:473
46719981,5cyclictest34-21ksoftirqd/300:30:153
46719981,5cyclictest34-21ksoftirqd/300:25:003
46719981,5cyclictest34-21ksoftirqd/300:19:163
46719981,5cyclictest34-21ksoftirqd/300:06:023
46719980,5cyclictest34-21ksoftirqd/323:10:213
46719980,4cyclictest0-21swapper/321:50:013
46669985,2cyclictest28-21ksoftirqd/220:20:002
46669984,3cyclictest19982-21systemd-journal22:10:402
46669984,3cyclictest19982-21systemd-journal21:43:392
46669983,3cyclictest19982-21systemd-journal20:35:172
46669983,3cyclictest19982-21systemd-journal20:31:062
46629984,3cyclictest19982-21systemd-journal23:48:531
46629984,3cyclictest19982-21systemd-journal00:35:111
46629983,3cyclictest19982-21systemd-journal22:50:271
46629983,3cyclictest19982-21systemd-journal21:05:201
46629982,5cyclictest9265-21cron21:20:011
46629982,3cyclictest2068-21systemctl22:40:001
46609983,3cyclictest19982-21systemd-journal22:51:430
46609981,4cyclictest11651-21dump-pmu-power22:25:000
29348280,0sleep10-21swapper/123:19:401
46719976,1cyclictest34-21ksoftirqd/320:55:003
46719976,1cyclictest34-21ksoftirqd/320:50:003
46719974,1cyclictest141rcu_preempt20:30:163
46719971,4cyclictest34-21ksoftirqd/321:55:113
46719971,4cyclictest23927-21switchtime21:00:203
46719971,4cyclictest0-21swapper/323:01:193
46719971,4cyclictest0-21swapper/320:15:153
46719971,4cyclictest0-21swapper/319:30:173
46719970,5cyclictest34-21ksoftirqd/321:25:213
46719970,5cyclictest34-21ksoftirqd/319:25:183
46719970,5cyclictest11481-21unixbench_multi19:20:203
46669975,1cyclictest28-21ksoftirqd/222:35:012
46669975,1cyclictest16934-21awk20:45:162
46669974,2cyclictest19982-21systemd-journal22:20:512
46669974,2cyclictest11736-21in:imuxsock23:07:092
46669973,3cyclictest6870-21systemctl19:15:012
46669973,3cyclictest6870-21systemctl19:15:012
46669973,3cyclictest508-21dbus-daemon23:10:542
46669973,3cyclictest508-21dbus-daemon19:25:012
46669973,3cyclictest32102-21turbostat23:00:012
46669973,3cyclictest19982-21systemd-journal21:24:312
46669973,3cyclictest18642-21cut20:50:152
46669973,3cyclictest16127-21sshd19:30:372
46669973,2cyclictest7661-21lldpd22:18:032
46669973,2cyclictest19982-21systemd-journal00:23:592
46669973,1cyclictest0-21swapper/223:55:222
46669973,1cyclictest0-21swapper/222:50:282
46669973,1cyclictest0-21swapper/221:48:012
46669973,1cyclictest0-21swapper/221:28:412
46669973,1cyclictest0-21swapper/200:11:452
46669971,3cyclictest15750-21ls20:45:012
46629973,3cyclictest508-21dbus-daemon19:24:341
46629973,3cyclictest0-21swapper/121:43:271
46629973,1cyclictest0-21swapper/100:04:541
46629972,4cyclictest0-21swapper/120:46:231
46629972,3cyclictest19982-21systemd-journal21:21:251
46629970,4cyclictest27701-21sendmail20:00:011
46629970,4cyclictest17421-21cron22:50:001
46609975,2cyclictest12-21ksoftirqd/019:20:010
46609974,2cyclictest11736-21in:imuxsock22:02:550
46609974,2cyclictest11736-21in:imuxsock20:32:470
46609973,3cyclictest508-21dbus-daemon19:59:240
46609973,3cyclictest508-21dbus-daemon00:39:590
46609973,3cyclictest30654-21snmpd22:32:350
46609973,3cyclictest23231-21apt-get21:50:140
46609973,3cyclictest19982-21systemd-journal20:41:580
46609973,3cyclictest19982-21systemd-journal19:48:580
46609973,3cyclictest0-21swapper/021:41:210
46609973,3cyclictest0-21swapper/021:36:220
46609973,3cyclictest0-21swapper/021:12:260
46609973,2cyclictest19982-21systemd-journal21:16:270
46609971,4cyclictest19982-21systemd-journal23:00:540
46609971,4cyclictest19982-21systemd-journal20:03:100
46609971,3cyclictest950-21rm23:43:170
46609970,3cyclictest27083-21cron00:25:000
46609970,3cyclictest19982-21systemd-journal20:11:130
46719965,1cyclictest331rcuc/320:35:123
46719963,1cyclictest34-21ksoftirqd/320:55:153
46719962,3cyclictest30654-21snmpd20:00:033
46719962,3cyclictest30654-21snmpd19:45:033
46719961,3cyclictest34-21ksoftirqd/319:35:163
46719960,4cyclictest34-21ksoftirqd/320:40:163
46719960,4cyclictest0-21swapper/319:40:133
46669964,1cyclictest25535-21grep21:30:152
46669964,1cyclictest1-21systemd19:55:142
46669963,2cyclictest719-21rm00:05:132
46669963,2cyclictest4145-21unixbench_singl22:40:202
46669963,2cyclictest3715-21cat23:45:122
46669963,2cyclictest28492-21grep21:10:182
46669963,2cyclictest25424-21ssh00:00:062
46669963,2cyclictest23487-21grep23:15:162
46669963,2cyclictest20756-21awk23:35:142
46669962,3cyclictest9041-21cat00:35:182
46669962,3cyclictest31542-21cat21:55:152
46669962,3cyclictest30654-21snmpd22:36:142
46669962,3cyclictest30654-21snmpd20:26:182
46669962,3cyclictest24874-21cat19:50:202
46669962,3cyclictest2063-21seq20:12:372
46669962,3cyclictest19982-21systemd-journal19:27:422
46669962,3cyclictest18746-21pluginstate19:40:012
46669962,3cyclictest13032-21cat22:25:172
46669962,2cyclictest19982-21systemd-journal22:00:012
46669962,1cyclictest141rcu_preempt19:15:012
46669962,1cyclictest0-21swapper/223:50:382
46669962,1cyclictest0-21swapper/223:25:242
46669962,1cyclictest0-21swapper/223:22:292
46669962,1cyclictest0-21swapper/221:16:162
46669962,1cyclictest0-21swapper/200:29:272
46669961,3cyclictest19982-21systemd-journal20:06:192
46669961,3cyclictest19982-21systemd-journal19:45:132
46669960,4cyclictest29587-21sshd20:01:102
46669960,4cyclictest19982-21systemd-journal22:45:532
46669960,4cyclictest19982-21systemd-journal19:45:002
46629963,3cyclictest9539-21kworker/1:219:41:001
46629963,3cyclictest9539-21kworker/1:219:26:361
46629963,3cyclictest30414-21kworker/1:123:42:071
46629963,2cyclictest9625-21expr20:30:131
46629963,2cyclictest7543-21ssh23:05:081
46629963,2cyclictest5598-21cut19:10:151
46629963,2cyclictest5598-21cut19:10:151
46629963,2cyclictest508-21dbus-daemon21:25:201
46629963,2cyclictest3374-21unixbench_multi00:30:201
46629963,2cyclictest31303-21sh22:15:421
46629963,2cyclictest31301-21ssh23:20:181
46629963,2cyclictest30827-21apt-get21:55:121
46629963,2cyclictest30654-21snmpd23:10:451
46629963,2cyclictest30654-21snmpd22:40:321
46629963,2cyclictest29533-21ssh21:10:461
46629963,2cyclictest2434-21head00:05:231
46629963,2cyclictest22940-21taskset19:46:401
46629963,2cyclictest1-21systemd20:26:191
46629962,3cyclictest500-21cat20:10:121
46629962,3cyclictest30654-21snmpd20:55:261
46629962,3cyclictest30654-21snmpd20:17:371
46629962,3cyclictest30654-21snmpd00:24:561
46629962,3cyclictest29623-21sshd20:01:171
46629962,3cyclictest19478-21tr23:55:181
46629962,3cyclictest13757-21cat23:30:141
46629962,3cyclictest0-21swapper/122:33:221
46629962,3cyclictest0-21swapper/100:25:021
46629962,3cyclictest0-21swapper/100:17:221
46629962,1cyclictest0-21swapper/123:52:231
46629962,1cyclictest0-21swapper/123:35:461
46629962,1cyclictest0-21swapper/123:00:041
46629962,1cyclictest0-21swapper/122:25:561
46629962,1cyclictest0-21swapper/122:12:431
46629962,1cyclictest0-21swapper/122:00:041
46629962,1cyclictest0-21swapper/121:46:321
46629961,3cyclictest19982-21systemd-journal22:55:031
46629961,1cyclictest411-21ssh21:35:121
46629960,1cyclictest7272-21df19:15:021
46609964,1cyclictest21053-21hddtemp_smartct20:55:160
46609963,2cyclictest7210-21ssh23:47:150
46609963,2cyclictest508-21dbus-daemon00:05:340
46609963,2cyclictest3778-21swap20:15:180
46609963,2cyclictest30615-21tr20:05:160
46609963,2cyclictest28930-21ssh22:15:010
46609963,2cyclictest26909-21diskmemload21:25:210
46609963,2cyclictest25945-21cut21:05:170
46609963,2cyclictest19228-21cstates19:40:130
46609963,2cyclictest15492-21ntp_offset19:30:180
46609963,2cyclictest10726-21sh00:11:460
46609963,2cyclictest0-21swapper/022:45:020
46609963,1cyclictest0-21swapper/000:00:010
46609962,3cyclictest5499-21cat20:20:180
46609962,3cyclictest30654-21snmpd23:06:390
46609962,3cyclictest30621-21cat23:20:140
46609962,3cyclictest25603-21diskstats22:55:140
46609962,3cyclictest19982-21systemd-journal21:01:090
46609962,3cyclictest19197-21ntpq20:50:180
46609962,3cyclictest17374-21which19:35:160
46609962,3cyclictest15996-21cat00:15:230
46609962,3cyclictest1-21systemd23:50:330
46609962,3cyclictest0-21swapper/023:11:110
46609962,3cyclictest0-21swapper/020:46:230
46609962,2cyclictest19982-21systemd-journal19:50:130
46609962,1cyclictest0-21swapper/021:45:350
46609962,1cyclictest0-21swapper/021:30:500
46609962,1cyclictest0-21swapper/000:26:210
46609961,4cyclictest508-21dbus-daemon19:10:110
46609961,4cyclictest508-21dbus-daemon19:10:110
46609961,2cyclictest6322-21rm00:33:160
46609960,6cyclictest0-21swapper/022:10:200
46609960,6cyclictest0-21swapper/021:20:250
46609960,5cyclictest3549-21ntp_states22:40:170
46609960,5cyclictest13214-21ntp_kernel_pll_19:25:160
46609960,4cyclictest19982-21systemd-journal19:24:340
46609960,0cyclictest0-21swapper/021:57:210
18650260,0sleep10-21swapper/120:50:151
46669952,2cyclictest22848-21cpuspeed_turbos21:00:132
46669952,2cyclictest20880-21tune2fs20:55:152
46669951,3cyclictest4821-21basename20:20:142
46669950,4cyclictest2818-21/usr/sbin/munin00:30:172
46629953,2cyclictest9539-21kworker/1:219:30:121
46629952,3cyclictest9539-21kworker/1:220:05:011
46629952,2cyclictest11758-21expr20:35:141
46629951,3cyclictest30654-21snmpd00:10:141
46629951,3cyclictest17371-21hddtemp_smartct19:35:161
46629950,4cyclictest0-21swapper/121:00:151
46609950,4cyclictest7038-21/usr/sbin/munin20:25:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional