You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 21:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Mon Nov 24, 2025 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313572233159,60sleep20-21swapper/207:05:372
316672213149,23sleep00-21swapper/007:09:370
316852208149,48sleep30-21swapper/307:09:533
315452205150,21sleep10-21swapper/107:08:061
21082760,0sleep10-21swapper/111:35:151
303752190,0sleep10-21swapper/110:00:151
78702180,0sleep121-21ksoftirqd/109:30:111
45312160,0sleep10-21swapper/112:25:101
3180399161,13cyclictest0-21swapper/210:53:392
3180399150,14cyclictest24691-21diskmemload10:40:142
3180399150,14cyclictest0-21swapper/208:45:132
3180399150,13cyclictest7227-21ssh11:42:112
3180399140,13cyclictest8983-21fschecks_count08:35:152
3180399140,13cyclictest26299-21apt-get12:10:142
3180399140,13cyclictest24691-21diskmemload11:20:202
3180399140,13cyclictest24691-21diskmemload10:05:152
3180399140,13cyclictest19036-21perf10:30:002
3180399140,13cyclictest17102-21ssh11:55:222
3180399140,13cyclictest11357-21latency_hist12:35:002
3180399140,13cyclictest0-21swapper/209:00:162
3180399140,13cyclictest0-21swapper/208:05:132
3180399131,11cyclictest9920-21tr10:15:172
3180399131,11cyclictest24691-21diskmemload12:15:112
3180399130,12cyclictest24691-21diskmemload11:10:142
3180399130,12cyclictest21081-21users10:30:232
3180399130,12cyclictest0-21swapper/210:20:132
3180399130,12cyclictest0-21swapper/209:25:152
3180399130,12cyclictest0-21swapper/208:55:162
3180399130,0cyclictest0-21swapper/208:10:102
31810991210,1cyclictest35-21ksoftirqd/307:50:003
3180399121,10cyclictest24691-21diskmemload09:45:202
3180399120,12cyclictest0-21swapper/212:05:122
3180399120,12cyclictest0-21swapper/211:25:142
3180399120,11cyclictest21915-21apt-get07:55:122
3180399120,11cyclictest14097-21sh11:06:272
3180399120,11cyclictest0-21swapper/211:49:072
3180399120,11cyclictest0-21swapper/211:01:012
3180399120,11cyclictest0-21swapper/210:13:142
3180399120,11cyclictest0-21swapper/210:03:562
3180399120,11cyclictest0-21swapper/209:35:262
3180399120,11cyclictest0-21swapper/209:23:412
3180399120,10cyclictest0-21swapper/209:54:172
3180399120,0cyclictest0-21swapper/211:37:232
3180399120,0cyclictest0-21swapper/210:35:202
3179599120,12cyclictest0-21swapper/110:30:131
3180399110,9cyclictest15899-21df_inode09:40:152
3180399110,11cyclictest0-21swapper/212:22:092
3180399110,11cyclictest0-21swapper/211:31:352
3180399110,11cyclictest0-21swapper/211:31:352
3180399110,11cyclictest0-21swapper/210:56:212
3180399110,11cyclictest0-21swapper/210:46:132
3180399110,10cyclictest16775-21perf07:45:002
3180399110,10cyclictest16775-21perf07:45:002
3180399110,10cyclictest0-21swapper/212:39:572
3180399110,10cyclictest0-21swapper/212:25:152
3180399110,10cyclictest0-21swapper/211:50:182
3180399110,10cyclictest0-21swapper/211:15:092
3180399110,10cyclictest0-21swapper/209:55:232
3180399110,10cyclictest0-21swapper/208:15:122
3180399110,0cyclictest0-21swapper/212:00:582
3180399110,0cyclictest0-21swapper/209:32:432
3180399110,0cyclictest0-21swapper/209:16:232
3180399110,0cyclictest0-21swapper/207:14:222
31787991110,1cyclictest9-21ksoftirqd/010:00:490
278342110,0sleep00-21swapper/012:10:230
3181099100,6cyclictest13191-21kworker/u8:109:35:523
3180399100,9cyclictest0-21swapper/209:10:592
3180399100,5cyclictest4942-21munin-run07:20:012
3180399100,0cyclictest0-21swapper/209:05:192
3179599100,5cyclictest0-21swapper/111:48:171
3178799108,1cyclictest9-21ksoftirqd/008:20:000
3178799105,4cyclictest24074-21ntp_offset10:35:190
3178799101,4cyclictest19321-21munin-run07:50:000
214802100,0sleep324691-21diskmemload09:46:523
318109999,0cyclictest35-21ksoftirqd/311:13:303
318039993,5cyclictest11196-21expr08:40:162
318039990,8cyclictest4687-21memory08:25:172
318039990,6cyclictest254-21systemd-journal07:30:062
317959990,3cyclictest0-21swapper/111:15:111
317879998,1cyclictest9-21ksoftirqd/011:21:510
317879995,1cyclictest254-21systemd-journal11:17:000
317879992,4cyclictest11732-21perf11:05:000
317879991,7cyclictest1728-21munin-node08:56:270
317879991,4cyclictest9-21ksoftirqd/011:45:000
318109987,1cyclictest3938-21ssh10:07:403
318109986,1cyclictest35-21ksoftirqd/308:10:003
318109980,1cyclictest0-21swapper/311:15:113
318039983,4cyclictest8748-21awk07:25:202
318039980,8cyclictest0-21swapper/208:30:142
318039980,7cyclictest1318-21/usr/sbin/munin08:20:132
318039980,7cyclictest0-21swapper/207:35:172
318039980,7cyclictest0-21swapper/207:20:142
318039980,0cyclictest0-21swapper/208:50:142
317879987,1cyclictest14639-21/usr/sbin/munin07:40:120
317879987,1cyclictest14639-21/usr/sbin/munin07:40:120
317879984,1cyclictest254-21systemd-journal09:05:000
317879982,5cyclictest28026-21sh11:25:210
317879981,6cyclictest16332-21ssh11:55:160
317879980,4cyclictest4299-21perf12:25:010
317879980,4cyclictest29757-21perf10:00:000
317879980,4cyclictest11608-21/usr/sbin/munin09:35:170
317879980,4cyclictest0-21swapper/012:00:060
317879980,3cyclictest254-21systemd-journal09:16:530
318109977,0cyclictest0-21swapper/309:12:293
318109976,1cyclictest35-21ksoftirqd/311:40:003
318109976,1cyclictest35-21ksoftirqd/307:20:003
318109975,1cyclictest29959-21ssh10:00:063
318109974,1cyclictest12032-21/usr/sbin/munin11:50:143
318109971,4cyclictest8097-21/usr/sbin/munin12:30:163
318109971,4cyclictest24691-21diskmemload12:06:293
318109971,3cyclictest0-21swapper/311:58:253
318109970,6cyclictest0-21swapper/311:21:393
318109970,4cyclictest24691-21diskmemload12:35:053
318109970,4cyclictest0-21swapper/311:47:163
318109970,4cyclictest0-21swapper/307:10:123
318109970,3cyclictest0-21swapper/309:43:543
318109970,2cyclictest0-21swapper/309:57:113
318039970,6cyclictest25449-21ntp_states08:00:172
318039970,6cyclictest19558-21apt-get07:50:132
318039970,6cyclictest18803-21/usr/sbin/munin07:45:192
317959971,4cyclictest0-21swapper/112:23:451
317959970,6cyclictest0-21swapper/111:12:111
317959970,4cyclictest0-21swapper/109:21:181
317879976,1cyclictest27811-21ntp_states08:05:190
317879976,1cyclictest2219-21cat08:20:170
317879975,1cyclictest20400-21ntp_states09:45:200
317879975,1cyclictest10156-21timerwakeupswit10:15:190
317879974,1cyclictest13650irq/124-ahci[0007:15:000
317879973,3cyclictest1449-21ntpd09:12:520
317879972,4cyclictest24691-21diskmemload09:20:140
317879972,2cyclictest254-21systemd-journal11:50:000
317879972,1cyclictest17513-21ssh11:10:570
317879971,4cyclictest742-21runrttasks12:16:550
317879971,4cyclictest24691-21diskmemload09:40:190
317879970,7cyclictest0-21swapper/008:31:150
317879970,6cyclictest25107-21ssh09:52:010
317879970,6cyclictest21820-1kworker/u9:212:06:270
317879970,6cyclictest19373-21telnet10:30:130
317879970,6cyclictest1911-1kworker/u9:209:25:050
317879970,6cyclictest12531-21ssh12:35:170
317879970,6cyclictest0-21swapper/011:05:200
317879970,6cyclictest0-21swapper/010:53:220
317879970,1cyclictest8571-21perl09:30:150
317879970,1cyclictest5138-21cstates10:55:130
317879970,1cyclictest3858-21ssh11:37:490
317879970,1cyclictest30453-21cstates11:30:130
317879970,1cyclictest30453-21cstates11:30:130
317879970,1cyclictest24691-21diskmemload12:31:420
317879970,1cyclictest24691-21diskmemload11:48:340
28930270,1sleep00-21swapper/008:10:010
9799260,0sleep10-21swapper/108:35:201
318109966,0cyclictest0-21swapper/310:49:043
318109965,1cyclictest30551-21ssh09:15:473
318109965,1cyclictest18540-21ssh10:28:303
318109965,1cyclictest11977-21ssh11:05:133
318109965,0cyclictest24691-21diskmemload12:15:153
318109964,1cyclictest4764-21ssh10:55:043
318109964,1cyclictest24691-21diskmemload10:21:333
318109964,0cyclictest24691-21diskmemload09:21:493
318109963,1cyclictest254-21systemd-journal10:35:243
318109963,1cyclictest254-21systemd-journal08:00:213
318109963,1cyclictest254-21systemd-journal07:55:003
318109963,1cyclictest24691-21diskmemload12:28:253
318109962,3cyclictest0-21swapper/309:30:113
318109962,2cyclictest254-21systemd-journal08:59:233
318109962,1cyclictest254-21systemd-journal10:30:003
318109961,4cyclictest24691-21diskmemload12:23:283
318109961,3cyclictest24691-21diskmemload10:15:083
318109960,6cyclictest0-21swapper/310:51:233
318109960,4cyclictest19700-21df12:00:133
318109960,4cyclictest0-21swapper/310:40:093
318109960,3cyclictest27102-21df_inode11:25:143
318109960,3cyclictest0-21swapper/312:10:193
318109960,3cyclictest0-21swapper/311:42:353
318109960,3cyclictest0-21swapper/309:50:303
318109960,2cyclictest0-21swapper/311:03:083
318109960,2cyclictest0-21swapper/310:10:223
318109960,1cyclictest0-21swapper/309:27:123
317959966,0cyclictest0-21swapper/110:21:091
317959966,0cyclictest0-21swapper/109:57:191
317959963,2cyclictest6929-21chrt10:56:261
317959963,1cyclictest30654-21taskset09:16:011
317959961,4cyclictest0-21swapper/109:25:191
317959960,6cyclictest0-21swapper/111:40:401
317959960,6cyclictest0-21swapper/107:25:221
317959960,4cyclictest0-21swapper/111:55:161
317959960,3cyclictest0-21swapper/110:08:141
317959960,3cyclictest0-21swapper/109:10:191
317959960,1cyclictest0-21swapper/108:25:121
317879962,3cyclictest24691-21diskmemload10:45:160
317879962,2cyclictest0-21swapper/012:25:140
317879962,1cyclictest254-21systemd-journal08:40:000
317879960,6cyclictest24691-21diskmemload10:05:290
317879960,6cyclictest0-21swapper/008:48:250
317879960,6cyclictest0-21swapper/008:29:500
317879960,6cyclictest0-21swapper/007:34:320
317879960,5cyclictest12146-21/usr/sbin/munin10:20:130
317879960,5cyclictest0-21swapper/008:00:110
317879960,3cyclictest21730-21perf07:55:010
317879960,1cyclictest17736-21ssh10:25:590
317879960,0cyclictest0-21swapper/010:40:180
317879960,0cyclictest0-21swapper/010:10:140
317879960,0cyclictest0-21swapper/007:35:100
318109954,1cyclictest29889-21cat08:10:153
318109953,1cyclictest8957-21sensors_temp07:25:213
318109953,1cyclictest6021-21sshd08:30:033
318109953,1cyclictest3914-21cpuspeed_turbos08:25:143
318109953,1cyclictest341rcuc/308:35:143
318109952,2cyclictest3124-21taskset08:21:013
318109952,1cyclictest254-21systemd-journal08:43:523
318109951,3cyclictest0-21swapper/307:35:123
318109951,2cyclictest254-21systemd-journal09:04:083
318109951,2cyclictest254-21systemd-journal07:30:513
318109950,5cyclictest0-21swapper/311:30:103
318109950,5cyclictest0-21swapper/311:30:103
318109950,4cyclictest21912-21/usr/sbin/munin07:55:163
318109950,2cyclictest254-21systemd-journal07:21:213
318109950,1cyclictest0-21swapper/308:50:093
317959955,0cyclictest0-21swapper/109:05:381
317959955,0cyclictest0-21swapper/108:18:201
317959951,4cyclictest0-21swapper/110:40:121
317959951,3cyclictest200-21jbd2/sda2-807:30:061
317959951,3cyclictest0-21swapper/110:35:121
317959951,2cyclictest0-21swapper/108:50:001
317959951,1cyclictest0-21swapper/112:30:301
317959950,5cyclictest0-21swapper/110:45:461
317959950,5cyclictest0-21swapper/110:15:061
317959950,5cyclictest0-21swapper/108:56:141
317959950,4cyclictest0-21swapper/109:50:131
317959950,4cyclictest0-21swapper/109:43:181
317959950,4cyclictest0-21swapper/109:00:121
317959950,3cyclictest0-21swapper/112:35:231
317959950,3cyclictest0-21swapper/112:01:151
317959950,3cyclictest0-21swapper/111:25:141
317959950,3cyclictest0-21swapper/111:20:121
317959950,3cyclictest0-21swapper/111:08:331
317959950,3cyclictest0-21swapper/110:11:011
317959950,3cyclictest0-21swapper/109:46:421
317959950,3cyclictest0-21swapper/109:35:221
317959950,2cyclictest0-21swapper/112:15:061
317959950,2cyclictest0-21swapper/112:09:401
317959950,2cyclictest0-21swapper/111:51:211
317959950,1cyclictest0-21swapper/112:12:011
317959950,1cyclictest0-21swapper/110:50:181
317959950,1cyclictest0-21swapper/110:25:041
317959950,1cyclictest0-21swapper/108:50:091
317959950,1cyclictest0-21swapper/107:55:001
317879953,1cyclictest7551-21/usr/sbin/munin07:25:160
317879953,1cyclictest5500-21grep07:20:120
317879953,1cyclictest23103-21fschecks_count09:05:160
317879950,5cyclictest0-21swapper/008:40:140
317879950,5cyclictest0-21swapper/007:55:010
317879950,1cyclictest15476-21/usr/sbin/munin08:50:090
317879950,0cyclictest0-21swapper/007:19:380
318109944,0cyclictest16042-21sensors07:40:193
318109944,0cyclictest16042-21sensors07:40:193
318109942,1cyclictest32051-21fschecks_time08:15:153
318109942,1cyclictest13123-21/usr/sbin/munin08:45:163
318109940,1cyclictest23651-21needreboot09:05:183
317959940,4cyclictest0-21swapper/108:40:181
317959940,2cyclictest0-21swapper/108:30:181
317959940,2cyclictest0-21swapper/108:10:171
317959940,1cyclictest0-21swapper/111:30:121
317959940,1cyclictest0-21swapper/111:30:121
317959940,1cyclictest0-21swapper/107:44:241
317959940,1cyclictest0-21swapper/107:44:241
317959940,0cyclictest0-21swapper/111:00:091
317959940,0cyclictest0-21swapper/107:45:181
317959933,0cyclictest0-21swapper/107:38:541
317959931,1cyclictest0-21swapper/108:20:131
317959931,1cyclictest0-21swapper/108:05:131
317959931,1cyclictest0-21swapper/108:00:111
317959931,1cyclictest0-21swapper/107:15:031
317959930,3cyclictest0-21swapper/107:10:201
317959930,2cyclictest0-21swapper/107:55:171
317959930,0cyclictest0-21swapper/107:20:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional