You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 15:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Jun 16, 2025 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
104472201160,27sleep20-21swapper/207:06:492
106762199160,25sleep00-21swapper/007:09:490
106822198162,23sleep10-21swapper/107:09:541
104582197159,25sleep30-21swapper/307:06:583
186392620,0sleep30-21swapper/310:50:193
10779991919,0cyclictest35-21ksoftirqd/310:56:433
10779991717,0cyclictest35-21ksoftirqd/312:36:393
262412150,0sleep00-21swapper/012:25:160
13882150,1sleep1201rcuc/109:45:211
10771991514,1cyclictest28-21ksoftirqd/210:45:002
10779991414,0cyclictest35-21ksoftirqd/309:54:133
10779991411,2cyclictest3897-21users10:30:243
10779991411,2cyclictest19946-21apt-get11:35:133
1076299140,13cyclictest0-21swapper/008:25:180
292962130,0sleep30-21swapper/311:05:133
10779991310,2cyclictest27120-21users11:00:253
1077999129,2cyclictest7662-21ssh09:14:043
1077999129,2cyclictest12159-21grep12:05:243
1077999122,9cyclictest22986-21grep07:30:213
10779991212,0cyclictest35-21ksoftirqd/311:33:433
10779991211,1cyclictest8915-21ssh10:38:333
10779991211,1cyclictest4047-21diskmemload09:43:163
10779991210,1cyclictest3467-21apt-get08:00:123
1076299120,11cyclictest13131-21munin-node10:49:140
1077999119,1cyclictest26837-21/usr/sbin/munin10:20:233
1077999119,1cyclictest2273-21ssh11:54:183
1077999118,2cyclictest24825-21/usr/sbin/munin07:35:173
1077999112,8cyclictest15058-21ssh11:27:553
1077999112,2cyclictest31613-21ssh12:31:293
1077999112,1cyclictest17279-21runrttasks09:25:173
10779991111,0cyclictest35-21ksoftirqd/311:18:013
10779991111,0cyclictest35-21ksoftirqd/310:28:313
10779991110,1cyclictest4047-21diskmemload11:10:263
10779991110,1cyclictest4047-21diskmemload10:17:343
10779991110,1cyclictest4047-21diskmemload09:30:283
10779991110,1cyclictest31099-21ssh11:49:473
10779991110,1cyclictest16612-21apt-get07:20:133
1077999111,9cyclictest3880-21memory11:55:223
1076299119,1cyclictest9-21ksoftirqd/008:50:000
1076299114,4cyclictest4366-21perf11:15:000
10762991110,1cyclictest21890-21ssh11:35:470
1077999109,1cyclictest4047-21diskmemload12:10:253
1077999109,1cyclictest35-21ksoftirqd/312:00:123
1077999109,1cyclictest35-21ksoftirqd/310:10:233
1077999109,1cyclictest0-21swapper/309:20:003
1077999108,1cyclictest4047-21diskmemload10:01:003
1077999104,5cyclictest4047-21diskmemload09:35:223
10779991010,0cyclictest35-21ksoftirqd/312:18:273
10779991010,0cyclictest35-21ksoftirqd/312:18:273
10779991010,0cyclictest35-21ksoftirqd/311:40:143
10779991010,0cyclictest35-21ksoftirqd/310:05:343
10779991010,0cyclictest35-21ksoftirqd/308:34:003
1077999101,8cyclictest15027-21ntp_states10:45:203
1077999101,1cyclictest654-21sed09:45:153
1077999101,1cyclictest24227-21ssh12:21:413
1077999100,9cyclictest13181-21ssh10:44:093
1077999100,9cyclictest10453-21ssh09:16:043
1077199109,1cyclictest28-21ksoftirqd/210:25:162
1077199109,1cyclictest28-21ksoftirqd/210:10:162
1077199108,1cyclictest28-21ksoftirqd/211:40:022
1076299103,6cyclictest13913-21awk12:10:000
1076299100,5cyclictest557-21nscd09:51:340
12309290,0sleep10-21swapper/110:41:501
107799999,0cyclictest35-21ksoftirqd/312:25:383
107799999,0cyclictest35-21ksoftirqd/311:20:313
107799999,0cyclictest35-21ksoftirqd/309:56:013
107799999,0cyclictest35-21ksoftirqd/308:38:203
107799999,0cyclictest35-21ksoftirqd/308:18:343
107799999,0cyclictest35-21ksoftirqd/307:50:163
107799999,0cyclictest35-21ksoftirqd/307:29:563
107799999,0cyclictest35-21ksoftirqd/307:15:143
107799999,0cyclictest35-21ksoftirqd/307:10:003
107799990,8cyclictest17740-21snmpd08:29:253
107799990,8cyclictest14694-21runrttasks08:20:453
107719999,0cyclictest28-21ksoftirqd/211:05:142
107719998,1cyclictest28-21ksoftirqd/211:20:172
107719998,1cyclictest28-21ksoftirqd/210:05:002
107719998,1cyclictest28-21ksoftirqd/208:15:002
107719998,1cyclictest28-21ksoftirqd/207:15:002
107719998,1cyclictest0-21swapper/211:16:092
107719990,6cyclictest60950irq/123-eno109:47:152
107719990,5cyclictest5545-21awk09:50:242
107719990,4cyclictest0-21swapper/211:00:312
107659991,5cyclictest0-21swapper/107:55:111
107659990,7cyclictest0-21swapper/112:20:121
107629997,1cyclictest0-21swapper/011:50:270
107629992,4cyclictest254-21systemd-journal09:09:550
107799988,0cyclictest35-21ksoftirqd/309:05:003
107799988,0cyclictest35-21ksoftirqd/309:00:023
107799988,0cyclictest35-21ksoftirqd/308:55:023
107799988,0cyclictest35-21ksoftirqd/308:50:023
107799988,0cyclictest35-21ksoftirqd/308:45:283
107799988,0cyclictest35-21ksoftirqd/308:40:023
107799988,0cyclictest35-21ksoftirqd/308:40:023
107799988,0cyclictest35-21ksoftirqd/308:10:023
107799988,0cyclictest35-21ksoftirqd/308:05:003
107799988,0cyclictest35-21ksoftirqd/307:45:043
107799988,0cyclictest35-21ksoftirqd/307:40:063
107799980,8cyclictest35-21ksoftirqd/307:55:013
107719987,1cyclictest28-21ksoftirqd/210:50:182
107719987,1cyclictest28-21ksoftirqd/210:05:152
107719987,1cyclictest28-21ksoftirqd/209:25:212
107719987,1cyclictest28-21ksoftirqd/207:59:592
107719986,1cyclictest60950irq/123-eno112:34:282
107719986,1cyclictest60950irq/123-eno110:30:162
107719986,1cyclictest28-21ksoftirqd/211:45:232
107719986,1cyclictest17740-21snmpd10:46:432
107659980,5cyclictest0-21swapper/109:25:141
107659980,4cyclictest0-21swapper/108:10:141
107629986,1cyclictest803-21sshd12:16:350
107629986,1cyclictest803-21sshd12:16:350
107629986,1cyclictest17740-21snmpd10:55:190
107629986,1cyclictest17740-21snmpd09:01:360
107629986,1cyclictest17740-21snmpd08:23:220
107629986,1cyclictest17740-21snmpd07:49:360
107629986,1cyclictest17740-21snmpd07:44:390
107629985,2cyclictest17740-21snmpd10:15:180
107629983,2cyclictest24476-21sshd08:42:340
107629983,2cyclictest24476-21sshd08:42:340
107629981,6cyclictest30398-21latency_hist10:25:000
107629980,7cyclictest4047-21diskmemload10:25:230
107629980,7cyclictest30909-21ssh09:42:060
107629980,7cyclictest27385-21seq11:01:050
107629980,7cyclictest23962-21ssh11:40:170
107629980,7cyclictest20529-21ssh09:30:090
107629980,7cyclictest11917-21ssh10:40:440
107629980,6cyclictest28059-21cstates11:45:190
107629980,3cyclictest0-21swapper/008:15:110
107629980,1cyclictest17562-21ssh10:50:010
107719976,1cyclictest60950irq/123-eno112:15:182
107719976,1cyclictest60950irq/123-eno112:15:172
107719976,1cyclictest60950irq/123-eno112:13:432
107719976,1cyclictest60950irq/123-eno111:55:272
107719976,1cyclictest60950irq/123-eno111:12:242
107719976,1cyclictest60950irq/123-eno110:21:122
107719976,1cyclictest60950irq/123-eno110:19:192
107719976,1cyclictest60950irq/123-eno108:05:132
107719976,1cyclictest60950irq/123-eno107:25:122
107719976,1cyclictest28-21ksoftirqd/212:25:222
107719976,1cyclictest28-21ksoftirqd/212:00:232
107719976,0cyclictest16442-21kworker/2:008:45:182
107719975,1cyclictest60950irq/123-eno112:35:212
107719975,1cyclictest60950irq/123-eno112:05:162
107719975,1cyclictest60950irq/123-eno109:35:152
107719975,1cyclictest60950irq/123-eno109:20:292
107719975,1cyclictest28-21ksoftirqd/208:25:002
107719975,1cyclictest28-21ksoftirqd/207:40:002
107719975,1cyclictest17740-21snmpd09:30:352
107719975,1cyclictest17740-21snmpd09:17:412
107719973,2cyclictest570-21systemd-logind09:55:212
107719972,4cyclictest21498-21/usr/sbin/munin10:55:162
107719972,4cyclictest13131-21munin-node11:25:222
107719970,2cyclictest0-21swapper/210:37:382
107719970,2cyclictest0-21swapper/208:30:122
107719970,1cyclictest0-21swapper/209:05:022
107719970,1cyclictest0-21swapper/208:17:262
107659971,6cyclictest0-21swapper/108:56:501
107659971,6cyclictest0-21swapper/108:31:431
107659970,6cyclictest0-21swapper/112:18:131
107659970,6cyclictest0-21swapper/112:18:131
107659970,6cyclictest0-21swapper/110:45:191
107659970,4cyclictest0-21swapper/111:25:391
107659970,4cyclictest0-21swapper/111:21:341
107659970,4cyclictest0-21swapper/110:05:131
107629976,1cyclictest9507-21ssh10:40:010
107629976,1cyclictest9-21ksoftirqd/008:15:000
107629976,1cyclictest17740-21snmpd09:58:030
107629976,1cyclictest15081-21idleruntime12:10:190
107629975,1cyclictest17740-21snmpd08:59:320
107629975,1cyclictest17740-21snmpd07:38:130
107629975,1cyclictest17740-21snmpd07:21:020
107629975,1cyclictest17740-21snmpd07:13:020
107629974,2cyclictest16139-21cron07:20:000
107629973,2cyclictest13921-21sed11:25:240
107629972,4cyclictest32296-21ssh09:45:120
107629970,6cyclictest9141-21ssh12:02:260
107629970,6cyclictest6311-21munin-run12:00:000
107629970,6cyclictest4047-21diskmemload09:10:190
107629970,6cyclictest31257-21ssh11:05:580
107629970,6cyclictest2912-21chrt12:36:260
107629970,6cyclictest22790-21hddtemp_smartct12:20:150
107629970,6cyclictest19471-21df_inode07:25:140
107629970,6cyclictest18314-21ssh10:08:340
107629970,6cyclictest17987-1kworker/u9:111:30:480
107629970,6cyclictest14325-21ssh10:03:180
107629970,6cyclictest11031-21ssh11:22:260
107629970,6cyclictest0-21swapper/009:20:180
107629970,6cyclictest0-21swapper/008:50:160
107629970,1cyclictest5516-21ssh10:34:420
107629970,1cyclictest3962-21df08:00:130
107629970,1cyclictest29770-21ls12:30:180
107629970,1cyclictest11725-21ssh09:19:010
107629970,1cyclictest0-21swapper/009:28:240
13055260,0sleep10-21swapper/109:20:171
107719966,0cyclictest60950irq/123-eno112:20:002
107719966,0cyclictest60950irq/123-eno111:50:162
107719966,0cyclictest60950irq/123-eno111:35:112
107719966,0cyclictest60950irq/123-eno111:30:092
107719966,0cyclictest60950irq/123-eno109:11:302
107719966,0cyclictest60950irq/123-eno108:55:412
107719966,0cyclictest60950irq/123-eno108:37:312
107719966,0cyclictest60950irq/123-eno108:25:132
107719966,0cyclictest60950irq/123-eno108:01:152
107719966,0cyclictest60950irq/123-eno107:50:152
107719966,0cyclictest60950irq/123-eno107:43:262
107719966,0cyclictest60950irq/123-eno107:32:012
107719965,1cyclictest28-21ksoftirqd/209:40:142
107719960,6cyclictest0-21swapper/207:15:002
107659966,0cyclictest0-21swapper/111:55:401
107659966,0cyclictest0-21swapper/109:17:561
107659962,1cyclictest0-21swapper/110:35:271
107659961,5cyclictest0-21swapper/107:32:451
107659961,4cyclictest0-21swapper/111:52:391
107659960,6cyclictest0-21swapper/111:16:251
107659960,6cyclictest0-21swapper/110:30:241
107659960,6cyclictest0-21swapper/108:23:551
107659960,5cyclictest0-21swapper/112:26:211
107659960,3cyclictest0-21swapper/112:36:181
107659960,3cyclictest0-21swapper/112:04:311
107659960,3cyclictest0-21swapper/111:40:171
107659960,3cyclictest0-21swapper/111:10:041
107659960,3cyclictest0-21swapper/107:15:141
107659960,2cyclictest0-21swapper/112:05:151
107659960,2cyclictest0-21swapper/111:00:211
107659960,1cyclictest0-21swapper/112:11:591
107659960,1cyclictest0-21swapper/110:52:221
107659960,1cyclictest0-21swapper/108:50:161
107659960,1cyclictest0-21swapper/107:27:391
107659960,0cyclictest0-21swapper/110:28:081
107629965,1cyclictest25402-21ssh09:35:170
107629965,1cyclictest17740-21snmpd07:31:210
107629964,1cyclictest19757-21apt-get08:35:010
107629961,4cyclictest4571-21ssh11:15:050
107629960,6cyclictest0-21swapper/008:06:420
107629960,5cyclictest30723-21apt-get07:50:010
107629960,0cyclictest4047-21diskmemload10:10:190
22443250,0sleep10-21swapper/108:40:001
107719955,0cyclictest60950irq/123-eno108:50:162
107719955,0cyclictest60950irq/123-eno107:45:122
107719953,1cyclictest28-21ksoftirqd/209:00:192
107719950,5cyclictest0-21swapper/207:21:302
107719950,1cyclictest22561-21/usr/sbin/munin08:40:162
107719950,1cyclictest22561-21/usr/sbin/munin08:40:162
107659955,0cyclictest0-21swapper/109:51:031
107659955,0cyclictest0-21swapper/107:41:551
107659952,2cyclictest0-21swapper/109:56:511
107659952,0cyclictest0-21swapper/108:40:221
107659952,0cyclictest0-21swapper/108:40:211
107659951,1cyclictest0-21swapper/107:20:001
107659950,5cyclictest0-21swapper/109:11:171
107659950,5cyclictest0-21swapper/109:05:421
107659950,5cyclictest0-21swapper/108:05:451
107659950,5cyclictest0-21swapper/107:51:271
107659950,4cyclictest0-21swapper/111:45:141
107659950,4cyclictest0-21swapper/111:30:111
107659950,4cyclictest0-21swapper/110:24:201
107659950,4cyclictest0-21swapper/109:35:231
107659950,4cyclictest0-21swapper/109:00:141
107659950,3cyclictest0-21swapper/111:36:131
107659950,3cyclictest0-21swapper/110:55:501
107659950,3cyclictest0-21swapper/110:16:491
107659950,3cyclictest0-21swapper/110:00:551
107659950,2cyclictest0-21swapper/112:33:561
107659950,1cyclictest0-21swapper/111:05:131
107659950,1cyclictest0-21swapper/109:40:231
107629950,5cyclictest0-21swapper/007:55:080
107629950,3cyclictest0-21swapper/008:35:150
107659944,0cyclictest0-21swapper/108:46:291
107659941,2cyclictest0-21swapper/108:00:111
107659941,1cyclictest0-21swapper/108:15:111
107659941,1cyclictest0-21swapper/107:10:111
107659940,3cyclictest0-21swapper/110:12:051
107659940,2cyclictest0-21swapper/109:30:361
107659931,1cyclictest0-21swapper/108:25:181
107659931,1cyclictest0-21swapper/107:45:121
107659930,2cyclictest25403-21chrt07:35:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional