You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-16 - 21:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Tue Sep 16, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
149502209194,10sleep10-21swapper/107:08:441
147002189172,12sleep30-21swapper/307:06:063
149742184167,12sleep00-21swapper/007:09:030
150272179160,14sleep20-21swapper/207:09:412
295852820,0sleep00-21swapper/010:22:580
56862450,0sleep20-21swapper/212:37:012
308512420,0sleep00-21swapper/012:33:420
157882380,0sleep20-21swapper/212:25:232
1523199120,7cyclictest20825-21apt-get08:25:110
1523199120,11cyclictest20815-21apt-get10:35:040
202612100,0sleep00-21swapper/011:55:190
181632100,0sleep318081-21latency_hist10:50:013
1523999100,8cyclictest0-21swapper/310:25:133
1523199100,9cyclictest28569-21apt-get10:55:120
1523199100,6cyclictest7257-21hddtemp_smartct12:05:160
1523199100,6cyclictest710-21sshd07:44:280
1523199100,6cyclictest612-21taskset08:46:080
1523199100,6cyclictest20765-21taskset07:19:330
152319991,5cyclictest4487-21taskset09:38:300
152319990,8cyclictest3722-21apt-get12:20:120
152319990,8cyclictest3651-21apt-get08:55:110
152319990,8cyclictest3487-21apt-get07:50:120
152319990,8cyclictest31085-21apt-get11:45:110
152319990,8cyclictest15342-21apt-get07:10:120
152319990,7cyclictest10319-21taskset08:00:320
152319990,6cyclictest711-21runrttasks08:34:040
152319990,6cyclictest7045-21memory07:55:170
152319990,6cyclictest32646-21hddtemp_smartct09:20:150
152319990,6cyclictest299222chrt09:19:140
152319990,6cyclictest20419-21taskset09:45:460
152319990,6cyclictest18886-21diskstats08:20:130
152319990,6cyclictest1709-21diskstats08:50:140
152319990,6cyclictest14449-21chrt11:04:150
152319990,6cyclictest14088-21taskset10:47:290
152319990,6cyclictest10764-21taskset09:09:140
152319990,5cyclictest3897-21sh10:42:220
152319990,5cyclictest30544-21taskset08:40:440
152319990,5cyclictest23044-21taskset07:21:540
152319990,5cyclictest17815-21taskset08:16:340
152319990,5cyclictest12889-21taskset08:06:520
152319990,0cyclictest21148-21apt-get11:40:110
152399980,7cyclictest0-21swapper/311:55:133
152319981,6cyclictest19420-21cut10:50:140
152319980,7cyclictest8790-21apt-get11:50:110
152319980,7cyclictest26538-21diskstats07:30:150
152319980,7cyclictest23537-21apt-get07:25:110
152319980,7cyclictest15223-21cyclictest11:35:120
152319980,7cyclictest13709-21apt-get11:20:120
152319980,7cyclictest11387-21apt-get09:10:140
152319980,7cyclictest1039-21apt-get12:35:130
152319980,6cyclictest32465-21ssh10:08:190
152319980,5cyclictest8197-21taskset09:02:570
152319980,5cyclictest7573-21sh09:55:220
152319980,5cyclictest5864-21ssh10:27:110
152319980,5cyclictest5540-21ssh10:10:280
152319980,5cyclictest32330-21ssh09:51:520
152319980,5cyclictest30340-21sshd07:35:280
152319980,5cyclictest28914-21ssh11:27:230
152319980,5cyclictest28718-21rm11:10:390
152319980,5cyclictest28103-21taskset08:36:240
152319980,5cyclictest26024-21ssh12:15:050
152319980,5cyclictest25607-21taskset12:14:570
152319980,5cyclictest25353-21taskset09:32:350
152319980,5cyclictest18840-21ssh11:05:430
152319980,5cyclictest15933-21ssh10:15:430
152319980,5cyclictest15467-21taskset08:13:090
152319980,5cyclictest13651-21ssh10:30:480
152319980,5cyclictest13362-21ssh12:25:010
152319980,5cyclictest1203-21ssh12:02:070
152319980,5cyclictest1195-21taskset11:30:110
152319980,5cyclictest11942-21ssh09:25:340
152319980,5cyclictest0-21swapper/007:45:070
152399970,6cyclictest0-21swapper/308:55:123
152319971,6cyclictest8251-21sort09:40:180
152319971,6cyclictest8251-21sort09:40:180
152319970,6cyclictest3502-21sh11:15:030
152319970,6cyclictest15641-21/usr/sbin/munin10:00:160
19422250,0sleep10-21swapper/112:11:011
152399953,1cyclictest10862-21ssh10:30:123
152399951,2cyclictest0-21swapper/309:40:163
152399951,2cyclictest0-21swapper/309:40:163
152399951,2cyclictest0-21swapper/308:35:113
152399950,5cyclictest0-21swapper/312:18:583
152399950,5cyclictest0-21swapper/311:20:123
152399950,5cyclictest0-21swapper/309:45:463
152399950,5cyclictest0-21swapper/309:38:213
152399950,4cyclictest0-21swapper/311:25:123
152399950,4cyclictest0-21swapper/307:40:143
152399950,0cyclictest0-21swapper/312:13:003
152399950,0cyclictest0-21swapper/311:52:463
152399950,0cyclictest0-21swapper/309:59:523
152349955,0cyclictest0-21swapper/209:55:172
152349951,3cyclictest0-21swapper/207:30:142
152349950,5cyclictest0-21swapper/210:35:252
152349950,5cyclictest0-21swapper/210:16:492
152349950,5cyclictest0-21swapper/210:00:132
152349950,5cyclictest0-21swapper/209:40:262
152349950,5cyclictest0-21swapper/209:40:252
152329951,2cyclictest0-21swapper/108:25:121
152329950,5cyclictest0-21swapper/112:21:111
152329950,2cyclictest0-21swapper/109:20:111
152399944,0cyclictest0-21swapper/311:10:013
152399944,0cyclictest0-21swapper/310:22:093
152399944,0cyclictest0-21swapper/310:14:433
152399944,0cyclictest0-21swapper/309:17:333
152399944,0cyclictest0-21swapper/308:34:443
152399943,1cyclictest13924-21tr12:25:113
152399942,2cyclictest14109-21ssh11:35:543
152399942,1cyclictest973-21ssh09:20:203
152399942,1cyclictest0-21swapper/307:20:133
152399941,2cyclictest0-21swapper/309:00:123
152399941,1cyclictest0-21swapper/309:50:103
152399941,1cyclictest0-21swapper/309:25:133
152399940,4cyclictest32520-21ntp_states11:45:173
152399940,4cyclictest14707-21ntp_states10:15:183
152399940,4cyclictest1016-21apt-get07:45:153
152399940,4cyclictest0-21swapper/312:05:143
152399940,4cyclictest0-21swapper/311:40:113
152399940,4cyclictest0-21swapper/311:34:343
152399940,4cyclictest0-21swapper/310:58:393
152399940,4cyclictest0-21swapper/310:41:123
152399940,4cyclictest0-21swapper/310:35:133
152399940,4cyclictest0-21swapper/310:00:323
152399940,4cyclictest0-21swapper/309:10:143
152399940,4cyclictest0-21swapper/308:40:103
152399940,4cyclictest0-21swapper/308:05:113
152399940,4cyclictest0-21swapper/307:10:483
152399940,3cyclictest5901-21ssh11:00:023
152399940,3cyclictest4528-21rm12:36:163
152399940,3cyclictest3545-21ssh11:15:063
152399940,3cyclictest28542-21ssh12:00:043
152399940,3cyclictest28471-21apt-get07:35:083
152399940,3cyclictest24623-21if_eth412:30:163
152399940,3cyclictest21815-21/usr/sbin/munin08:25:163
152399940,3cyclictest21457-21ssh10:50:493
152399940,3cyclictest0-21swapper/310:05:173
152399940,1cyclictest20250-21diskstats09:30:143
152399940,0cyclictest0-21swapper/308:47:333
152349944,0cyclictest0-21swapper/212:00:512
152349944,0cyclictest0-21swapper/210:51:092
152349944,0cyclictest0-21swapper/210:30:112
152349944,0cyclictest0-21swapper/209:26:202
152349943,1cyclictest0-21swapper/208:05:252
152349942,2cyclictest714-21snmpd10:09:262
152349942,2cyclictest301ktimersoftd/211:22:012
152349942,1cyclictest714-21snmpd10:21:092
152349941,3cyclictest0-21swapper/211:25:202
152349941,2cyclictest0-21swapper/208:50:132
152349940,4cyclictest29275-21grep09:50:182
152349940,4cyclictest27142-21hddtemp_smartct12:15:162
152349940,4cyclictest10843-21diskmemload11:36:182
152349940,4cyclictest0-21swapper/212:12:342
152349940,4cyclictest0-21swapper/211:45:122
152349940,4cyclictest0-21swapper/210:46:392
152349940,4cyclictest0-21swapper/210:40:142
152349940,4cyclictest0-21swapper/210:27:152
152349940,4cyclictest0-21swapper/210:10:132
152349940,4cyclictest0-21swapper/209:35:122
152349940,4cyclictest0-21swapper/209:30:242
152349940,4cyclictest0-21swapper/209:10:292
152349940,4cyclictest0-21swapper/208:40:092
152349940,4cyclictest0-21swapper/207:25:112
152349940,3cyclictest9834-21ssh11:01:202
152349940,3cyclictest8628-21cut09:05:132
152349940,3cyclictest7405-21ssh11:16:232
152349940,3cyclictest714-21snmpd11:13:572
152349940,3cyclictest22411-21grep09:15:162
152349940,3cyclictest17787-21kworker/2:209:20:022
152349940,3cyclictest17775-21munin-node07:15:002
152349940,3cyclictest17737-21ssh09:45:142
152349940,3cyclictest15884-21sh11:05:002
152349940,3cyclictest0-21swapper/207:40:012
152329944,0cyclictest0-21swapper/112:30:551
152329944,0cyclictest0-21swapper/110:51:331
152329944,0cyclictest0-21swapper/109:48:411
152329944,0cyclictest0-21swapper/109:30:051
152329944,0cyclictest0-21swapper/109:18:081
152329944,0cyclictest0-21swapper/109:12:111
152329941,2cyclictest0-21swapper/110:00:141
152329941,2cyclictest0-21swapper/109:05:121
152329941,2cyclictest0-21swapper/108:30:141
152329941,2cyclictest0-21swapper/108:15:131
152329940,4cyclictest0-21swapper/112:03:081
152329940,4cyclictest0-21swapper/111:54:511
152329940,4cyclictest0-21swapper/109:54:401
152329940,3cyclictest0-21swapper/111:40:101
152329940,1cyclictest0-21swapper/108:40:101
152329940,0cyclictest0-21swapper/110:17:471
152329940,0cyclictest0-21swapper/110:11:491
152399930,3cyclictest3487-21ssh12:20:043
152399930,3cyclictest26188-21grep07:30:153
152399930,3cyclictest18513-21grep08:20:123
152399930,3cyclictest0-21swapper/311:05:063
152399930,3cyclictest0-21swapper/309:05:123
152399930,3cyclictest0-21swapper/308:50:133
152399930,3cyclictest0-21swapper/308:10:133
152399930,3cyclictest0-21swapper/308:00:103
152399930,3cyclictest0-21swapper/307:55:133
152399930,3cyclictest0-21swapper/307:50:123
152399930,3cyclictest0-21swapper/307:25:113
152399930,3cyclictest0-21swapper/307:15:163
152399930,2cyclictest15862-21/usr/sbin/munin08:15:133
152349932,1cyclictest714-21snmpd12:20:022
152349932,1cyclictest714-21snmpd08:00:022
152349932,1cyclictest714-21snmpd07:50:052
152349931,2cyclictest10843-21diskmemload10:55:032
152349931,2cyclictest0-21swapper/208:25:122
152349931,2cyclictest0-21swapper/207:20:132
152349930,3cyclictest20875-21ssh11:40:012
152349930,3cyclictest1347-21apt-get11:30:162
152349930,3cyclictest13385-21apt-get08:10:122
152349930,3cyclictest0-21swapper/212:30:122
152349930,3cyclictest0-21swapper/212:05:062
152349930,3cyclictest0-21swapper/211:55:112
152349930,3cyclictest0-21swapper/211:50:022
152349930,3cyclictest0-21swapper/209:00:592
152349930,3cyclictest0-21swapper/208:55:122
152349930,3cyclictest0-21swapper/208:45:132
152349930,3cyclictest0-21swapper/208:35:012
152349930,3cyclictest0-21swapper/208:20:122
152349930,3cyclictest0-21swapper/208:15:132
152349930,3cyclictest0-21swapper/207:55:022
152349930,3cyclictest0-21swapper/207:45:162
152349930,3cyclictest0-21swapper/207:40:132
152349930,3cyclictest0-21swapper/207:15:012
152349930,2cyclictest0-21swapper/208:30:012
152329933,0cyclictest0-21swapper/112:16:401
152329933,0cyclictest0-21swapper/112:07:381
152329933,0cyclictest0-21swapper/111:18:371
152329933,0cyclictest0-21swapper/109:42:441
152329933,0cyclictest0-21swapper/109:42:431
152329933,0cyclictest0-21swapper/107:16:301
152329931,2cyclictest0-21swapper/112:35:141
152329931,1cyclictest0-21swapper/112:25:101
152329931,1cyclictest0-21swapper/111:55:121
152329931,1cyclictest0-21swapper/111:45:121
152329931,1cyclictest0-21swapper/111:30:171
152329931,1cyclictest0-21swapper/111:25:131
152329931,1cyclictest0-21swapper/111:10:111
152329931,1cyclictest0-21swapper/111:05:131
152329931,1cyclictest0-21swapper/111:00:131
152329931,1cyclictest0-21swapper/110:35:131
152329931,1cyclictest0-21swapper/110:30:121
152329931,1cyclictest0-21swapper/110:25:141
152329931,1cyclictest0-21swapper/109:35:131
152329931,1cyclictest0-21swapper/108:50:121
152329931,1cyclictest0-21swapper/108:05:121
152329931,1cyclictest0-21swapper/107:50:111
152329931,1cyclictest0-21swapper/107:45:151
152329931,1cyclictest0-21swapper/107:40:141
152329931,1cyclictest0-21swapper/107:10:121
152329931,0cyclictest0-21swapper/108:20:111
152329930,3cyclictest0-21swapper/108:55:261
152329930,3cyclictest0-21swapper/108:02:461
152329930,2cyclictest25503-21chrt07:26:441
152329930,2cyclictest11132-21chrt11:35:091
152329930,2cyclictest0-21swapper/110:20:131
152329930,2cyclictest0-21swapper/108:10:131
152329921,1cyclictest0-21swapper/110:55:121
152329921,1cyclictest0-21swapper/110:45:141
152329921,1cyclictest0-21swapper/110:40:131
152329921,1cyclictest0-21swapper/109:25:131
152329921,1cyclictest0-21swapper/107:20:121
152329920,1cyclictest0-21swapper/111:20:131
152329920,1cyclictest0-21swapper/110:05:171
152329920,1cyclictest0-21swapper/109:55:121
152329920,1cyclictest0-21swapper/109:00:131
152329920,1cyclictest0-21swapper/108:45:121
152329920,1cyclictest0-21swapper/108:35:011
152329920,1cyclictest0-21swapper/107:55:121
152329920,1cyclictest0-21swapper/107:35:091
152329920,1cyclictest0-21swapper/107:30:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional