You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-03 - 18:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Wed Sep 03, 2025 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17792203187,11sleep10-21swapper/107:08:441
18772196162,12sleep00-21swapper/007:10:000
15822191174,13sleep30-21swapper/307:06:173
1618210789,13sleep20-21swapper/207:06:442
248762490,0sleep30-21swapper/309:39:353
118962480,0sleep30-21swapper/310:37:243
274962470,0sleep20-21swapper/212:24:242
88482450,0sleep10-21swapper/111:40:511
313812440,0sleep00-21swapper/009:58:440
302942440,0sleep00-21swapper/011:02:540
245982440,0sleep10-21swapper/110:43:581
245982440,0sleep10-21swapper/110:43:571
304742420,0sleep30-21swapper/309:41:473
167772420,0sleep10-21swapper/109:19:181
117652420,0sleep20-21swapper/211:25:512
4712410,0sleep00-21swapper/010:47:560
197302140,0sleep20-21swapper/209:52:432
218572110,0sleep10-21swapper/111:15:131
11970290,0sleep311972-21proc_pri07:25:193
11970290,0sleep311972-21proc_pri07:25:193
20709981,4cyclictest8835-21awk12:15:010
20709971,3cyclictest61-21kswapd009:55:000
20709970,7cyclictest0-21swapper/011:57:330
8290260,0sleep30-21swapper/309:30:253
20829965,1cyclictest31-21ksoftirqd/212:15:002
20709963,3cyclictest0-21swapper/010:10:180
20709962,4cyclictest0-21swapper/011:13:530
20709962,4cyclictest0-21swapper/009:34:310
20709960,6cyclictest21320-21ssh10:41:530
20709960,6cyclictest21320-21ssh10:41:530
20709960,6cyclictest0-21swapper/011:25:330
20709960,6cyclictest0-21swapper/010:02:460
20859955,0cyclictest0-21swapper/312:07:513
20859954,1cyclictest0-21swapper/311:42:063
20859954,1cyclictest0-21swapper/308:00:033
20859950,5cyclictest0-21swapper/312:23:173
20859950,5cyclictest0-21swapper/309:49:323
20859950,5cyclictest0-21swapper/308:05:173
20859950,5cyclictest0-21swapper/307:49:353
20859950,5cyclictest0-21swapper/307:40:333
20859950,4cyclictest22608-21memory10:10:143
20859950,4cyclictest0-21swapper/309:00:133
20859950,4cyclictest0-21swapper/307:50:093
20859950,0cyclictest30008-21diskmemload11:28:523
20829955,0cyclictest0-21swapper/212:03:322
20829953,1cyclictest25287-21/usr/sbin/munin09:00:172
20829952,3cyclictest21839-21expr10:10:112
20829950,5cyclictest0-21swapper/212:25:392
20829950,5cyclictest0-21swapper/209:24:132
20829950,0cyclictest30997-21snmpd09:17:402
20789951,2cyclictest0-21swapper/110:20:111
20789951,2cyclictest0-21swapper/109:25:141
20789950,5cyclictest0-21swapper/111:14:021
20789950,5cyclictest0-21swapper/110:19:281
20789950,0cyclictest0-21swapper/110:04:461
20709952,3cyclictest9969-21ssh10:36:090
20709952,3cyclictest22871-21ssh10:26:270
20709952,3cyclictest0-21swapper/012:35:140
20709952,3cyclictest0-21swapper/012:33:450
20709952,3cyclictest0-21swapper/011:45:140
20709952,3cyclictest0-21swapper/011:36:330
20709952,3cyclictest0-21swapper/011:08:090
20709952,3cyclictest0-21swapper/010:55:140
20709952,3cyclictest0-21swapper/010:22:460
20709952,3cyclictest0-21swapper/010:05:190
20709952,3cyclictest0-21swapper/009:29:540
20709952,3cyclictest0-21swapper/007:25:180
20709952,3cyclictest0-21swapper/007:25:180
20709950,5cyclictest28207-21ssh11:50:460
20709950,5cyclictest27703-21munin-run07:59:590
20709950,5cyclictest0-21swapper/012:20:260
20709950,5cyclictest0-21swapper/012:08:130
20709950,5cyclictest0-21swapper/012:00:210
20709950,5cyclictest0-21swapper/011:20:220
20709950,5cyclictest0-21swapper/011:16:420
20709950,5cyclictest0-21swapper/010:30:300
20709950,5cyclictest0-21swapper/010:15:110
20709950,5cyclictest0-21swapper/009:45:140
20709950,5cyclictest0-21swapper/009:43:110
20709950,5cyclictest0-21swapper/009:38:550
20709950,5cyclictest0-21swapper/009:21:140
20709950,5cyclictest0-21swapper/008:29:550
20709950,4cyclictest6022-21ssh11:40:120
20709950,1cyclictest0-21swapper/009:15:460
20709950,0cyclictest0-21swapper/012:26:330
20709950,0cyclictest0-21swapper/012:16:500
20709950,0cyclictest0-21swapper/011:32:230
10460250,0sleep00-21swapper/010:52:590
306240,0sleep10-21swapper/108:10:001
23655240,0sleep30-21swapper/312:39:013
20859944,0cyclictest0-21swapper/308:31:373
20859941,3cyclictest29354-21sh10:45:403
20859941,1cyclictest39662sh09:29:003
20859940,4cyclictest32279-21fw_packets10:15:133
20859940,4cyclictest30008-21diskmemload10:32:303
20859940,4cyclictest17709-21perl10:40:183
20859940,4cyclictest17709-21perl10:40:183
20859940,4cyclictest13703-21irqstats12:00:163
20859940,4cyclictest11120-21munin-run11:10:003
20859940,4cyclictest0-21swapper/312:31:133
20859940,4cyclictest0-21swapper/312:29:023
20859940,4cyclictest0-21swapper/312:15:153
20859940,4cyclictest0-21swapper/311:45:493
20859940,4cyclictest0-21swapper/311:35:023
20859940,4cyclictest0-21swapper/311:10:123
20859940,4cyclictest0-21swapper/311:00:123
20859940,4cyclictest0-21swapper/310:50:103
20859940,4cyclictest0-21swapper/310:25:153
20859940,4cyclictest0-21swapper/308:36:083
20859940,3cyclictest9617-21diskstats10:20:123
20859940,3cyclictest9552-21memory09:15:173
20859940,3cyclictest8368-21ssh12:14:423
20859940,3cyclictest5337-21cut08:20:003
20859940,3cyclictest4252-21ntp_states11:55:193
20859940,3cyclictest3814-21rm11:22:053
20859940,3cyclictest26646-21irqstats11:50:183
20859940,3cyclictest23966-21/usr/sbin/munin09:55:183
20859940,3cyclictest20847-21df_inode08:50:123
20859940,3cyclictest18899-21wc08:45:163
20859940,3cyclictest18503-21sh11:30:003
20859940,3cyclictest18176-21ssh09:20:013
20859940,3cyclictest15599-21sensors_temp09:50:193
20859940,3cyclictest14253-21/usr/sbin/munin10:55:153
20859940,3cyclictest12708-21memory10:05:173
20859940,1cyclictest28200-21expr09:05:173
20859940,0cyclictest0-21swapper/311:16:223
20859940,0cyclictest0-21swapper/307:10:093
20829943,1cyclictest15536-21ssh11:45:032
20829942,1cyclictest26020-21ssh11:00:212
20829942,1cyclictest25612-21munin-run09:40:002
20829941,3cyclictest172392chrt08:40:272
20829941,2cyclictest0-21swapper/210:15:122
20829940,4cyclictest0-21swapper/212:30:122
20829940,4cyclictest0-21swapper/212:05:122
20829940,4cyclictest0-21swapper/211:55:102
20829940,4cyclictest0-21swapper/211:15:112
20829940,4cyclictest0-21swapper/210:40:162
20829940,4cyclictest0-21swapper/210:40:162
20829940,4cyclictest0-21swapper/210:36:342
20829940,4cyclictest0-21swapper/210:05:112
20829940,4cyclictest0-21swapper/209:46:382
20829940,4cyclictest0-21swapper/209:40:122
20829940,4cyclictest0-21swapper/208:50:112
20829940,4cyclictest0-21swapper/208:25:172
20829940,3cyclictest8938-21hddtemp_smartct07:20:132
20829940,3cyclictest8180-21users09:30:202
20829940,3cyclictest8047-21cut07:20:002
20829940,3cyclictest6302-21ssh11:23:402
20829940,3cyclictest4751-21munin-node07:15:002
20829940,3cyclictest3144-21ntp_states11:05:192
20829940,3cyclictest30610-21users09:25:222
20829940,3cyclictest30117-21/usr/sbin/munin11:35:212
20829940,3cyclictest27618-21users11:50:222
20829940,3cyclictest24262-21sh11:32:332
20829940,3cyclictest23981-21ssh09:55:132
20829940,3cyclictest20348-21memory10:25:192
20829940,3cyclictest18700-21ssh10:56:512
20829940,3cyclictest14575-21sensors_temp07:30:212
20829940,3cyclictest14149-21ntp_states08:35:172
20829940,3cyclictest12170-21sh10:54:022
20829940,3cyclictest10812-21ntp_states12:15:202
20829940,3cyclictest10112-21irqstats10:20:142
20829940,1cyclictest424-21/usr/sbin/munin08:10:182
20829940,1cyclictest28187-21ntpq10:45:172
20829940,1cyclictest28061-21cut08:00:162
20829940,1cyclictest1503-21/usr/sbin/munin10:00:132
20789944,0cyclictest0-21swapper/111:39:121
20789944,0cyclictest0-21swapper/109:42:041
20789941,2cyclictest0-21swapper/112:35:111
20789941,2cyclictest0-21swapper/111:55:121
20789941,2cyclictest0-21swapper/111:30:121
20789941,2cyclictest0-21swapper/110:25:151
20789941,2cyclictest0-21swapper/110:10:091
20789941,2cyclictest0-21swapper/108:35:121
20789941,2cyclictest0-21swapper/107:15:121
20789941,2cyclictest0-21swapper/107:10:121
20789941,1cyclictest0-21swapper/110:50:091
20789940,4cyclictest0-21swapper/112:02:541
20789940,4cyclictest0-21swapper/110:45:141
20789940,4cyclictest0-21swapper/110:05:291
20789940,4cyclictest0-21swapper/109:12:491
20789940,2cyclictest0-21swapper/112:10:131
20789940,0cyclictest0-21swapper/111:54:461
20709944,0cyclictest0-21swapper/009:00:370
20709942,1cyclictest22565-21latency_hist08:55:000
20709941,3cyclictest28874-21awk08:00:170
20709940,4cyclictest17848-21apt-get08:45:120
20709940,4cyclictest0-21swapper/009:05:150
20709940,4cyclictest0-21swapper/008:07:040
20709940,4cyclictest0-21swapper/007:35:090
20709940,4cyclictest0-21swapper/007:32:090
20709940,4cyclictest0-21swapper/007:23:430
20709940,4cyclictest0-21swapper/007:13:410
20709940,3cyclictest1454-21ssh09:11:110
25061230,0sleep10-21swapper/109:00:001
20859931,1cyclictest4840-21apt07:15:013
20859930,3cyclictest25454-21apt-get07:55:123
20859930,3cyclictest15376-21dpkg08:40:143
20859930,3cyclictest0-21swapper/310:00:123
20859930,3cyclictest0-21swapper/309:10:153
20859930,3cyclictest0-21swapper/308:55:113
20859930,3cyclictest0-21swapper/308:25:123
20859930,3cyclictest0-21swapper/308:20:123
20859930,3cyclictest0-21swapper/308:10:113
20859930,3cyclictest0-21swapper/307:35:093
20859930,3cyclictest0-21swapper/307:30:133
20859930,3cyclictest0-21swapper/307:20:113
20829932,1cyclictest30997-21snmpd08:15:052
20829932,1cyclictest30997-21snmpd07:50:052
20829931,2cyclictest15691-21cpuspeed07:35:112
20829931,1cyclictest0-21swapper/208:45:112
20829930,3cyclictest5834-21rm11:40:042
20829930,3cyclictest30523-21ssh09:10:122
20829930,3cyclictest30420-21apt08:05:112
20829930,3cyclictest15816-21ssh12:35:042
20829930,3cyclictest11394-21irqstats08:30:202
20829930,3cyclictest0-21swapper/208:55:122
20829930,3cyclictest0-21swapper/208:20:172
20829930,3cyclictest0-21swapper/207:55:122
20829930,3cyclictest0-21swapper/207:45:112
20829930,3cyclictest0-21swapper/207:40:012
20829930,3cyclictest0-21swapper/207:25:122
20829930,3cyclictest0-21swapper/207:25:112
20829930,1cyclictest28930-21ssh10:30:072
20829930,1cyclictest27761-21/usr/sbin/munin09:05:182
20829930,1cyclictest11487-21ssh11:10:072
20789933,0cyclictest0-21swapper/111:47:201
20789933,0cyclictest0-21swapper/110:33:251
20789933,0cyclictest0-21swapper/107:30:051
20789931,2cyclictest0-21swapper/109:05:141
20789931,1cyclictest0-21swapper/112:30:121
20789931,1cyclictest0-21swapper/112:20:001
20789931,1cyclictest0-21swapper/111:20:101
20789931,1cyclictest0-21swapper/111:05:141
20789931,1cyclictest0-21swapper/110:35:091
20789931,1cyclictest0-21swapper/109:55:141
20789931,1cyclictest0-21swapper/109:45:011
20789931,1cyclictest0-21swapper/109:20:111
20789931,1cyclictest0-21swapper/108:25:121
20789931,1cyclictest0-21swapper/108:20:111
20789931,1cyclictest0-21swapper/107:55:111
20789931,1cyclictest0-21swapper/107:40:141
20789931,1cyclictest0-21swapper/107:35:101
20789931,1cyclictest0-21swapper/107:25:111
20789931,1cyclictest0-21swapper/107:25:111
20789930,3cyclictest0-21swapper/112:25:121
20789930,3cyclictest0-21swapper/109:50:121
20789930,3cyclictest0-21swapper/109:02:211
20789930,2cyclictest26446-21taskset11:00:271
20789930,2cyclictest0-21swapper/112:05:131
20789930,2cyclictest0-21swapper/110:55:121
20789930,2cyclictest0-21swapper/108:40:131
20709933,0cyclictest0-21swapper/008:20:020
20709931,2cyclictest30997-21snmpd08:30:140
20709931,1cyclictest15375-21apt-get08:40:140
20709930,3cyclictest5013-21cut07:15:020
20709930,3cyclictest470-21/usr/sbin/munin08:10:120
20709930,3cyclictest3212-21grep08:15:130
20709930,3cyclictest23812-21hddtemp_smartct07:50:120
20709930,3cyclictest22796-21apt-get08:55:110
20709930,3cyclictest12875-21apt-get08:35:120
20709930,3cyclictest0-21swapper/007:45:120
20709930,3cyclictest0-21swapper/007:40:120
20789921,1cyclictest0-21swapper/108:45:111
20789921,1cyclictest0-21swapper/107:55:001
20789921,0cyclictest0-21swapper/107:20:101
20789920,2cyclictest2545-21taskset08:13:051
20789920,1cyclictest93772sleep112:15:131
20789920,1cyclictest0-21swapper/111:25:121
20789920,1cyclictest0-21swapper/109:35:121
20789920,1cyclictest0-21swapper/109:30:121
20789920,1cyclictest0-21swapper/108:50:101
20789920,1cyclictest0-21swapper/108:30:191
20789920,1cyclictest0-21swapper/108:15:111
20789920,1cyclictest0-21swapper/108:00:141
20789920,1cyclictest0-21swapper/107:45:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional