You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-21 - 23:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Tue Jan 21, 2025 12:45:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
103932217150,23sleep20-21swapper/207:05:292
86252199161,25sleep00-21swapper/007:05:040
103972199160,26sleep10-21swapper/107:05:331
105382197157,26sleep30-21swapper/307:07:243
1081699170,16cyclictest0-21swapper/109:15:161
299912140,0sleep10-21swapper/110:20:141
44602130,0sleep10-21swapper/109:49:341
1082499130,12cyclictest0-21swapper/209:29:062
1082499130,1cyclictest0-21swapper/212:00:142
1081699120,0cyclictest0-21swapper/112:00:141
1081299123,4cyclictest12468-21perf10:40:000
10812991210,1cyclictest9-21ksoftirqd/007:20:000
1081699119,1cyclictest0-21swapper/109:30:111
1081699109,1cyclictest0-21swapper/110:40:181
1081699108,1cyclictest0-21swapper/110:30:171
1081699103,7cyclictest21-21ksoftirqd/107:59:421
1081699100,1cyclictest0-21swapper/108:40:191
1081299103,3cyclictest14903-21perf08:25:000
1081299100,5cyclictest24340-21perf08:45:000
30372290,0sleep20-21swapper/207:50:002
108319998,1cyclictest35-21ksoftirqd/310:05:003
108249998,1cyclictest28-21ksoftirqd/209:40:002
108249997,2cyclictest9723-21sh11:18:182
108249997,1cyclictest28-21ksoftirqd/208:30:002
108249997,1cyclictest0-21swapper/209:57:412
108249993,5cyclictest4079-21diskmemload10:55:182
108249990,4cyclictest26302-21apt-get11:40:142
108249990,2cyclictest2023-21pmu-power11:50:152
108169999,0cyclictest21-21ksoftirqd/112:35:011
108169999,0cyclictest21-21ksoftirqd/112:25:391
108169999,0cyclictest21-21ksoftirqd/112:10:371
108169999,0cyclictest21-21ksoftirqd/112:05:051
108169999,0cyclictest21-21ksoftirqd/111:55:131
108169999,0cyclictest21-21ksoftirqd/111:45:061
108169999,0cyclictest21-21ksoftirqd/111:40:031
108169999,0cyclictest21-21ksoftirqd/111:31:171
108169999,0cyclictest21-21ksoftirqd/111:25:041
108169999,0cyclictest21-21ksoftirqd/111:20:111
108169999,0cyclictest21-21ksoftirqd/111:16:011
108169999,0cyclictest21-21ksoftirqd/111:05:111
108169999,0cyclictest21-21ksoftirqd/110:55:211
108169999,0cyclictest21-21ksoftirqd/110:52:091
108169999,0cyclictest21-21ksoftirqd/110:45:391
108169999,0cyclictest21-21ksoftirqd/110:35:191
108169999,0cyclictest21-21ksoftirqd/110:27:491
108169999,0cyclictest21-21ksoftirqd/110:15:271
108169999,0cyclictest21-21ksoftirqd/110:11:231
108169999,0cyclictest21-21ksoftirqd/110:05:011
108169999,0cyclictest21-21ksoftirqd/110:00:111
108169999,0cyclictest21-21ksoftirqd/109:55:031
108169999,0cyclictest21-21ksoftirqd/109:40:051
108169999,0cyclictest21-21ksoftirqd/109:35:501
108169999,0cyclictest21-21ksoftirqd/109:20:511
108169999,0cyclictest21-21ksoftirqd/109:11:021
108169999,0cyclictest21-21ksoftirqd/109:05:191
108169999,0cyclictest21-21ksoftirqd/109:00:211
108169999,0cyclictest21-21ksoftirqd/108:36:451
108169999,0cyclictest21-21ksoftirqd/108:30:351
108169999,0cyclictest21-21ksoftirqd/108:10:431
108169999,0cyclictest21-21ksoftirqd/107:36:191
108169999,0cyclictest21-21ksoftirqd/107:21:081
108169999,0cyclictest0-21swapper/112:30:081
108169998,1cyclictest0-21swapper/112:15:171
108169998,1cyclictest0-21swapper/108:45:121
108169997,2cyclictest0-21swapper/109:50:091
108169993,6cyclictest21-21ksoftirqd/107:50:061
108169993,6cyclictest201rcuc/112:20:591
108169990,8cyclictest21-21ksoftirqd/111:50:021
108169990,8cyclictest21-21ksoftirqd/111:35:501
108169990,8cyclictest21-21ksoftirqd/111:10:121
108169990,8cyclictest21-21ksoftirqd/111:00:111
108169990,8cyclictest21-21ksoftirqd/109:25:061
108169990,8cyclictest21-21ksoftirqd/107:45:171
108169990,1cyclictest0-21swapper/108:20:131
108129996,3cyclictest21101-21cpuspeed_turbos10:10:090
108129991,7cyclictest13379-21munin-node09:52:070
108129990,5cyclictest29242-21apt-get08:55:110
108319987,1cyclictest35-21ksoftirqd/308:24:593
108319986,1cyclictest35-21ksoftirqd/309:07:203
108319981,6cyclictest10098-21ssh09:15:183
108319981,3cyclictest21160-21apt-get07:30:133
108319980,5cyclictest20472-21uname10:50:123
108249986,1cyclictest60950irq/123-eno112:38:252
108249986,1cyclictest60950irq/123-eno110:53:302
108249986,1cyclictest60950irq/123-eno110:10:102
108249986,1cyclictest60950irq/123-eno109:30:112
108249982,5cyclictest11030-21apt-get07:10:122
108249980,7cyclictest13379-21munin-node12:29:542
108249980,2cyclictest0-21swapper/208:45:122
108249980,1cyclictest0-21swapper/210:02:592
108169988,0cyclictest21-21ksoftirqd/108:55:011
108169988,0cyclictest21-21ksoftirqd/108:50:011
108169988,0cyclictest21-21ksoftirqd/108:25:031
108169988,0cyclictest21-21ksoftirqd/108:15:031
108169988,0cyclictest21-21ksoftirqd/108:05:011
108169988,0cyclictest21-21ksoftirqd/108:00:011
108169988,0cyclictest21-21ksoftirqd/107:40:011
108169988,0cyclictest21-21ksoftirqd/107:30:011
108169988,0cyclictest21-21ksoftirqd/107:25:011
108169988,0cyclictest21-21ksoftirqd/107:10:031
108169980,8cyclictest21-21ksoftirqd/107:15:001
108129987,1cyclictest9-21ksoftirqd/008:10:010
108129983,2cyclictest254-21systemd-journal07:40:150
108129981,1cyclictest24702-21ssh11:37:150
108129980,7cyclictest23776-21ssh10:55:070
108129980,4cyclictest4079-21diskmemload09:10:190
108129980,1cyclictest4079-21diskmemload12:19:160
108129980,1cyclictest2380-21ssh11:10:080
6942270,0sleep30-21swapper/311:55:413
12804270,0sleep20-21swapper/209:19:312
108319976,1cyclictest35-21ksoftirqd/307:24:593
108319975,1cyclictest4424-21ssh11:10:493
108319974,1cyclictest35-21ksoftirqd/308:17:303
108319970,6cyclictest18426-21ssh10:05:403
108319970,5cyclictest30402-21apt-get09:40:093
108319970,2cyclictest0-21swapper/311:15:133
108319970,2cyclictest0-21swapper/308:50:173
108319970,1cyclictest8410-21idleruntime-cro09:15:003
108249977,0cyclictest0-21swapper/211:56:202
108249976,1cyclictest60950irq/123-eno112:20:212
108249976,1cyclictest60950irq/123-eno112:15:292
108249976,1cyclictest60950irq/123-eno111:46:212
108249976,1cyclictest60950irq/123-eno111:35:442
108249976,1cyclictest60950irq/123-eno111:10:092
108249976,1cyclictest60950irq/123-eno110:38:152
108249976,1cyclictest60950irq/123-eno110:18:322
108249976,1cyclictest60950irq/123-eno110:07:092
108249976,1cyclictest60950irq/123-eno109:46:422
108249976,1cyclictest60950irq/123-eno107:50:142
108249976,1cyclictest28-21ksoftirqd/211:35:002
108249976,1cyclictest28-21ksoftirqd/209:24:592
108249976,0cyclictest60950irq/123-eno112:06:342
108249976,0cyclictest60950irq/123-eno110:20:212
108249975,1cyclictest60950irq/123-eno111:05:492
108249975,1cyclictest60950irq/123-eno111:00:152
108249975,1cyclictest60950irq/123-eno109:50:152
108249975,1cyclictest60950irq/123-eno109:40:112
108249975,1cyclictest28-21ksoftirqd/208:00:102
108249974,1cyclictest254-21systemd-journal07:25:002
108249973,1cyclictest254-21systemd-journal09:05:012
108249972,1cyclictest0-21swapper/210:48:442
108249971,4cyclictest1497-21sendmail-mta08:40:552
108249971,1cyclictest0-21swapper/207:30:132
108129976,1cyclictest9-21ksoftirqd/011:20:190
108129976,1cyclictest32752-21ssh11:06:070
108129976,1cyclictest32398-1kworker/u9:210:26:230
108129976,1cyclictest29235-21ssh09:38:410
108129976,1cyclictest16928-21ssh11:29:130
108129975,1cyclictest3849-21ssh12:35:190
108129975,1cyclictest21935-21ssh10:51:350
108129975,1cyclictest13650irq/124-ahci[0007:35:000
108129975,1cyclictest12725-21ssh10:40:100
108129971,5cyclictest0-21swapper/012:30:020
108129970,6cyclictest8627-21ssh09:15:020
108129970,6cyclictest4590-21diskstats10:30:100
108129970,6cyclictest31369-21apt-get09:00:000
108129970,6cyclictest30448-21aten_r1power_en09:40:090
108129970,6cyclictest2917-21ssh09:46:150
108129970,6cyclictest29166-21ssh12:26:340
108129970,6cyclictest28007-21ssh11:00:030
108129970,6cyclictest26198-21irqstats10:15:160
108129970,6cyclictest25451-21cut09:35:000
108129970,6cyclictest21124-21ssh11:34:100
108129970,6cyclictest19184-21ssh09:27:040
108129970,6cyclictest18765-21ssh10:06:230
108129970,6cyclictest18028-21ssh10:47:200
108129970,6cyclictest15854-21ssh12:10:040
108129970,6cyclictest13897-21aten2.4-expect10:00:120
108129970,6cyclictest13414-21ssh09:20:090
108129970,6cyclictest12304-21ssh09:57:370
108129970,6cyclictest11969-21ssh12:02:210
108129970,6cyclictest0-21swapper/012:20:280
108129970,6cyclictest0-21swapper/011:54:430
108129970,6cyclictest0-21swapper/011:45:500
108129970,6cyclictest0-21swapper/011:15:160
108129970,6cyclictest0-21swapper/007:50:190
108129970,4cyclictest13202-21perf07:15:000
108129970,1cyclictest6461-21ssh11:55:210
108129970,1cyclictest28634-21systemd-cgroups11:41:330
108129970,1cyclictest14084-21ssh12:06:350
108129970,1cyclictest0-21swapper/008:30:180
108319965,1cyclictest8968-21ntpq08:10:193
108319965,1cyclictest8382-21ssh10:35:103
108319965,1cyclictest6494-21ssh10:31:363
108319965,1cyclictest597-21ssh12:30:233
108319965,1cyclictest32686-21ssh11:05:593
108319965,1cyclictest30743-21ssh11:45:413
108319965,1cyclictest30092-21ssh11:00:503
108319965,1cyclictest29540-21ssh10:20:063
108319965,1cyclictest28662-21ssh12:25:273
108319965,1cyclictest28366-21ssh11:41:003
108319965,1cyclictest28106-21ssh10:17:343
108319965,1cyclictest27829-21ssh09:35:553
108319965,1cyclictest26424-21ssh10:57:093
108319965,1cyclictest26255-21ssh12:20:373
108319965,1cyclictest2583-21ssh09:45:323
108319965,1cyclictest2570-21ssh11:50:183
108319965,1cyclictest24673-21ntpq07:35:173
108319965,1cyclictest24108-21ssh10:13:183
108319965,1cyclictest23528-21mailstats11:35:213
108319965,1cyclictest21047-21ssh09:30:043
108319965,1cyclictest20221-21ssh09:28:553
108319965,1cyclictest1993-21ssh10:26:153
108319965,1cyclictest19553-21ssh11:30:433
108319965,1cyclictest17790-21ssh09:24:553
108319965,1cyclictest16993-21ssh11:29:203
108319965,1cyclictest15216-21ntpq07:15:153
108319965,1cyclictest13416-21ssh12:05:053
108319965,1cyclictest11678-21ssh12:01:433
108319964,1cyclictest7162-21rm09:51:063
108319964,1cyclictest35-21ksoftirqd/311:25:003
108319964,1cyclictest35-21ksoftirqd/308:56:213
108319964,1cyclictest18600-21ssh10:48:353
108319962,3cyclictest10447-21memory09:55:173
108319962,2cyclictest254-21systemd-journal07:41:303
108319960,2cyclictest0-21swapper/312:10:023
108319960,1cyclictest0-21swapper/307:25:113
108249966,0cyclictest60950irq/123-eno111:29:062
108249966,0cyclictest60950irq/123-eno110:26:042
108249966,0cyclictest60950irq/123-eno109:10:172
108249966,0cyclictest60950irq/123-eno108:56:242
108249966,0cyclictest60950irq/123-eno108:37:242
108249966,0cyclictest60950irq/123-eno107:19:122
108249965,1cyclictest60950irq/123-eno112:30:082
108249965,1cyclictest60950irq/123-eno111:20:242
108249965,1cyclictest60950irq/123-eno110:40:182
108249965,1cyclictest60950irq/123-eno110:30:372
108249965,1cyclictest60950irq/123-eno108:20:102
108249964,1cyclictest60950irq/123-eno112:10:082
108249964,1cyclictest60950irq/123-eno108:50:152
108249964,1cyclictest60950irq/123-eno108:10:132
108249964,1cyclictest11594-21switchtime08:15:212
108249960,6cyclictest0-21swapper/208:31:092
108249960,6cyclictest0-21swapper/207:57:342
108249960,6cyclictest0-21swapper/207:35:102
108129966,0cyclictest9-21ksoftirqd/007:28:530
108129963,2cyclictest4300-21python08:00:190
108129963,1cyclictest254-21systemd-journal08:35:460
108129962,0cyclictest0-21swapper/007:45:170
108129961,4cyclictest0-21swapper/007:55:120
108129960,5cyclictest28053-1kworker/u9:110:20:110
108129960,5cyclictest26890-21/usr/sbin/munin08:50:170
108129960,0cyclictest0-21swapper/008:46:370
108129960,0cyclictest0-21swapper/007:38:390
108129960,0cyclictest0-21swapper/007:22:290
108319953,1cyclictest4079-21diskmemload12:35:033
108319953,1cyclictest21864-21sed12:15:223
108319953,1cyclictest1040-21fschecks_count07:55:153
108319952,2cyclictest3898-21memory08:00:173
108319952,1cyclictest570-21systemd-logind09:00:203
108319952,1cyclictest254-21systemd-journal08:35:003
108319952,1cyclictest254-21systemd-journal08:30:003
108319951,1cyclictest254-21systemd-journal08:44:593
108319951,1cyclictest0-21swapper/307:10:163
108319950,2cyclictest21074-21/usr/sbin/munin08:35:193
108319950,2cyclictest0-21swapper/310:41:103
108319950,2cyclictest0-21swapper/307:50:143
108249954,1cyclictest60950irq/123-eno109:00:192
108249950,4cyclictest5246-21/usr/sbin/munin08:05:202
108249950,4cyclictest18800-21/usr/sbin/munin07:25:192
108249950,1cyclictest25882-21/usr/sbin/munin07:40:182
108129954,1cyclictest9-21ksoftirqd/009:05:010
108129954,1cyclictest15225-21telnet08:25:120
108129950,4cyclictest7963-21telnet08:10:140
108129950,1cyclictest0-21swapper/008:15:120
108319943,1cyclictest28232-21chrt07:45:083
108319942,1cyclictest5285-21aten_r1power_en08:05:123
108319940,1cyclictest254-21systemd-journal08:41:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional