You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 00:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sun Nov 23, 2025 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205032201183,13sleep00-21swapper/007:07:210
205662194178,11sleep10-21swapper/107:08:121
203892180162,13sleep30-21swapper/307:05:533
204232176159,12sleep20-21swapper/207:06:202
164632480,0sleep20-21swapper/212:08:022
74862470,0sleep30-21swapper/309:20:333
127292470,0sleep00-21swapper/009:55:250
237512440,0sleep10-21swapper/110:17:351
261452420,0sleep30-21swapper/310:50:553
237112110,0sleep10-21swapper/110:01:021
208779992,3cyclictest26477-21apt-get09:15:010
208879970,6cyclictest0-21swapper/308:05:123
208779972,5cyclictest4042-21kworker/0:010:04:460
208779972,5cyclictest4042-21kworker/0:009:44:220
208779971,6cyclictest4042-21kworker/0:010:06:370
208879960,5cyclictest0-21swapper/308:55:123
208879960,1cyclictest26382-21runrttasks10:19:153
208829960,1cyclictest22726-21ssh12:10:422
208779962,4cyclictest4042-21kworker/0:011:29:530
208779962,4cyclictest4042-21kworker/0:011:13:530
208779962,4cyclictest4042-21kworker/0:011:13:520
208779962,4cyclictest4042-21kworker/0:011:00:370
208779962,4cyclictest4042-21kworker/0:010:27:450
208779962,4cyclictest21821-21kworker/0:212:37:130
208779962,4cyclictest21821-21kworker/0:212:19:370
208779961,5cyclictest4042-21kworker/0:012:04:010
208779961,5cyclictest4042-21kworker/0:011:51:050
208779961,5cyclictest4042-21kworker/0:011:41:370
208779961,5cyclictest4042-21kworker/0:011:33:450
208779961,5cyclictest4042-21kworker/0:011:21:210
208779961,5cyclictest4042-21kworker/0:011:16:450
208779961,5cyclictest4042-21kworker/0:011:05:210
208779961,5cyclictest4042-21kworker/0:010:52:050
208779961,5cyclictest4042-21kworker/0:010:45:160
208779961,5cyclictest4042-21kworker/0:010:42:530
208779961,5cyclictest4042-21kworker/0:010:30:130
208779961,5cyclictest4042-21kworker/0:010:21:400
208779961,5cyclictest4042-21kworker/0:010:13:410
208779961,5cyclictest4042-21kworker/0:009:38:220
208779961,5cyclictest4042-21kworker/0:009:21:420
208779961,5cyclictest21821-21kworker/0:212:32:200
208779961,5cyclictest21821-21kworker/0:212:25:330
208779961,5cyclictest21821-21kworker/0:212:20:210
208779960,3cyclictest29445-21awk12:15:000
208879955,0cyclictest30165-21kworker/3:209:26:123
208879955,0cyclictest30165-21kworker/3:209:15:003
208879955,0cyclictest30165-21kworker/3:209:03:463
208879955,0cyclictest30165-21kworker/3:208:52:333
208879955,0cyclictest30165-21kworker/3:208:41:233
208879955,0cyclictest30165-21kworker/3:207:45:233
208879955,0cyclictest30165-21kworker/3:207:34:123
208879955,0cyclictest30165-21kworker/3:207:11:493
208879955,0cyclictest21238-21kworker/3:011:18:083
208879955,0cyclictest21238-21kworker/3:010:44:323
208879950,5cyclictest12938-21/usr/sbin/munin11:50:223
208879950,5cyclictest0-21swapper/312:05:183
208879950,5cyclictest0-21swapper/311:58:043
208879950,5cyclictest0-21swapper/311:40:113
208879950,5cyclictest0-21swapper/311:29:053
208879950,5cyclictest0-21swapper/309:50:193
208879950,4cyclictest27231-21perl08:25:143
208879950,3cyclictest0-21swapper/311:31:033
208829955,0cyclictest0-21swapper/210:02:392
208829954,1cyclictest0-21swapper/211:44:482
208829951,1cyclictest0-21swapper/211:05:122
208829950,5cyclictest0-21swapper/212:35:092
208829950,5cyclictest0-21swapper/209:46:132
208829950,4cyclictest754-21ssh10:22:132
208829950,4cyclictest32728-21apt-get07:30:152
208789955,0cyclictest0-21swapper/111:50:181
208789950,5cyclictest0-21swapper/112:14:011
208789950,5cyclictest0-21swapper/111:20:461
208789950,5cyclictest0-21swapper/111:02:431
208789950,5cyclictest0-21swapper/110:28:061
208779953,1cyclictest15603-21wc08:00:180
208779953,1cyclictest15603-21wc08:00:180
208779952,3cyclictest4042-21kworker/0:012:07:280
208779952,3cyclictest4042-21kworker/0:011:55:050
208779952,3cyclictest4042-21kworker/0:011:47:370
208779952,3cyclictest4042-21kworker/0:010:39:050
208779952,3cyclictest4042-21kworker/0:009:52:370
208779952,3cyclictest4042-21kworker/0:009:05:160
208779952,3cyclictest4042-21kworker/0:008:25:210
208779952,3cyclictest4042-21kworker/0:008:05:120
208779951,4cyclictest4042-21kworker/0:010:16:360
208779951,4cyclictest4042-21kworker/0:009:30:300
208779951,4cyclictest4042-21kworker/0:009:25:410
208779951,4cyclictest4042-21kworker/0:009:15:340
208779950,5cyclictest4042-21kworker/0:011:35:160
208779950,5cyclictest4042-21kworker/0:010:56:090
208779950,5cyclictest4042-21kworker/0:009:46:500
208779950,5cyclictest4042-21kworker/0:008:55:130
208779950,5cyclictest0-21swapper/009:00:010
208779950,5cyclictest0-21swapper/007:30:010
208879944,0cyclictest30165-21kworker/3:207:56:363
208879944,0cyclictest30165-21kworker/3:207:23:003
208879943,1cyclictest0-21swapper/311:01:183
208879941,2cyclictest0-21swapper/312:10:133
208879941,1cyclictest0-21swapper/308:45:133
208879940,4cyclictest485-21ntp_states08:35:163
208879940,4cyclictest10187-21irqstats07:50:153
208879940,4cyclictest0-21swapper/312:35:113
208879940,4cyclictest0-21swapper/312:30:393
208879940,4cyclictest0-21swapper/312:25:113
208879940,4cyclictest0-21swapper/312:21:043
208879940,4cyclictest0-21swapper/311:45:483
208879940,4cyclictest0-21swapper/311:35:493
208879940,4cyclictest0-21swapper/310:46:463
208879940,4cyclictest0-21swapper/310:20:053
208879940,4cyclictest0-21swapper/309:45:143
208879940,3cyclictest3672-21sh09:35:153
208879940,3cyclictest32446-21sh12:00:013
208879940,3cyclictest29765-21sh12:15:053
208879940,3cyclictest27037-21memory10:35:183
208879940,3cyclictest2613-21sh09:18:563
208879940,3cyclictest23450-21munin-node07:15:013
208879940,3cyclictest22990-21sh10:00:353
208879940,3cyclictest20679-21basename11:05:123
208879940,3cyclictest1810-21irqstats10:55:183
208879940,3cyclictest15280-21sed10:30:003
208879940,3cyclictest14638-21df_inode09:05:153
208879940,3cyclictest13989-21sh09:56:123
208879940,3cyclictest13002-21ssh10:12:063
208879940,1cyclictest4258-21/usr/sbin/munin07:40:223
208879940,1cyclictest32007-21awk11:10:183
208879940,1cyclictest32007-21awk11:10:173
208879940,1cyclictest26256-21if_eth109:30:173
208879940,1cyclictest24062-21/usr/sbin/munin08:20:143
208879940,1cyclictest21567-21/usr/sbin/munin08:15:143
208879940,1cyclictest18099-21/usr/sbin/munin11:20:133
208879940,1cyclictest14838-21sort09:40:213
208829942,1cyclictest5575-21awk08:45:192
208829941,2cyclictest13267-21ssh10:45:112
208829941,2cyclictest0-21swapper/208:55:122
208829941,1cyclictest0-21swapper/208:00:112
208829941,1cyclictest0-21swapper/208:00:112
208829940,4cyclictest3383-21apt10:40:122
208829940,4cyclictest0-21swapper/212:25:092
208829940,4cyclictest0-21swapper/212:19:592
208829940,4cyclictest0-21swapper/211:55:112
208829940,4cyclictest0-21swapper/211:32:362
208829940,4cyclictest0-21swapper/211:20:102
208829940,4cyclictest0-21swapper/211:00:122
208829940,4cyclictest0-21swapper/210:25:132
208829940,4cyclictest0-21swapper/209:55:592
208829940,4cyclictest0-21swapper/209:40:122
208829940,4cyclictest0-21swapper/209:15:122
208829940,4cyclictest0-21swapper/207:45:132
208829940,3cyclictest8953-21perl11:15:152
208829940,3cyclictest894-21diskstats12:00:142
208829940,3cyclictest8392-21/usr/sbin/munin10:10:152
208829940,3cyclictest8157-21tr08:50:182
208829940,3cyclictest7182-21users09:20:212
208829940,3cyclictest5830-21ssh09:35:542
208829940,3cyclictest5001-21perl07:40:162
208829940,3cyclictest368-21ssh10:55:012
208829940,3cyclictest3523-21df_inode11:45:132
208829940,3cyclictest31819-21cat10:05:162
208829940,3cyclictest30479-21rm11:10:072
208829940,3cyclictest30479-21rm11:10:072
208829940,3cyclictest29153-21ssh11:25:152
208829940,3cyclictest27715-21ssh12:30:152
208829940,3cyclictest27418-21ssh09:30:272
208829940,3cyclictest26635-21perl10:35:152
208829940,3cyclictest23729-21df10:50:142
208829940,3cyclictest23516-21fschecks_count07:15:012
208829940,3cyclictest21814-21ssh10:16:222
208829940,3cyclictest17775-21ssh10:30:222
208829940,3cyclictest17619-21fschecks_time09:10:132
208829940,3cyclictest15217-21/usr/sbin/munin09:25:162
208829940,3cyclictest12736-21ssh11:50:042
208829940,3cyclictest10490-21ssh12:20:592
208829940,3cyclictest0-21swapper/211:35:292
208829940,3cyclictest0-21swapper/209:00:112
208829940,1cyclictest1912-21cat09:50:212
208789944,0cyclictest0-21swapper/112:25:301
208789944,0cyclictest0-21swapper/110:52:591
208789944,0cyclictest0-21swapper/109:40:391
208789942,1cyclictest0-21swapper/108:15:131
208789941,2cyclictest0-21swapper/111:05:111
208789941,2cyclictest0-21swapper/109:50:171
208789941,2cyclictest0-21swapper/107:35:101
208789941,1cyclictest0-21swapper/110:45:111
208789941,1cyclictest0-21swapper/109:15:011
208789940,4cyclictest0-21swapper/112:39:201
208789940,4cyclictest0-21swapper/110:08:271
208789940,4cyclictest0-21swapper/109:45:541
208789940,0cyclictest0-21swapper/110:35:401
208779944,0cyclictest0-21swapper/007:50:030
208779940,4cyclictest4220-21apt-get08:45:130
208779940,4cyclictest0-21swapper/008:32:580
208779940,4cyclictest0-21swapper/008:20:130
208779940,4cyclictest0-21swapper/008:15:130
208779940,4cyclictest0-21swapper/007:30:160
208779940,3cyclictest4233-21cat07:40:010
208779940,3cyclictest19653-21fschecks_count08:10:150
208779940,1cyclictest1526-21lockfile-create08:39:590
208779940,1cyclictest13891-21cron08:00:010
4277230,0sleep10-21swapper/111:29:281
32739230,0sleep10-21swapper/112:32:391
208879932,1cyclictest19072-21date08:10:003
208879930,3cyclictest29716-21df07:25:133
208879930,3cyclictest29115-21egrep08:30:123
208879930,3cyclictest0-21swapper/310:05:113
208879930,3cyclictest0-21swapper/308:00:033
208879930,3cyclictest0-21swapper/308:00:033
208879930,3cyclictest0-21swapper/307:35:113
208879930,1cyclictest15337-21date10:30:013
208829932,1cyclictest714-21snmpd08:40:062
208829932,1cyclictest714-21snmpd08:10:062
208829932,0cyclictest11668-21apt-get07:55:132
208829931,1cyclictest0-21swapper/208:05:122
208829930,3cyclictest0-21swapper/209:05:132
208829930,3cyclictest0-21swapper/208:35:112
208829930,3cyclictest0-21swapper/208:30:122
208829930,3cyclictest0-21swapper/208:25:072
208829930,3cyclictest0-21swapper/208:20:012
208829930,3cyclictest0-21swapper/208:15:122
208829930,3cyclictest0-21swapper/207:50:122
208829930,3cyclictest0-21swapper/207:35:112
208829930,3cyclictest0-21swapper/207:25:012
208829930,3cyclictest0-21swapper/207:20:112
208829930,3cyclictest0-21swapper/207:10:132
208789933,0cyclictest0-21swapper/112:02:311
208789933,0cyclictest0-21swapper/111:43:281
208789933,0cyclictest0-21swapper/111:32:501
208789933,0cyclictest0-21swapper/110:58:131
208789931,2cyclictest0-21swapper/109:35:121
208789931,1cyclictest0-21swapper/112:15:121
208789931,1cyclictest0-21swapper/111:55:111
208789931,1cyclictest0-21swapper/110:40:111
208789931,1cyclictest0-21swapper/109:55:121
208789931,1cyclictest0-21swapper/109:20:021
208789931,1cyclictest0-21swapper/109:10:121
208789931,1cyclictest0-21swapper/108:55:121
208789931,1cyclictest0-21swapper/108:20:131
208789931,1cyclictest0-21swapper/108:10:131
208789931,1cyclictest0-21swapper/108:00:101
208789931,1cyclictest0-21swapper/108:00:101
208789931,1cyclictest0-21swapper/107:50:121
208789931,1cyclictest0-21swapper/107:25:111
208789930,3cyclictest0-21swapper/109:01:131
208789930,3cyclictest0-21swapper/107:10:381
208789930,2cyclictest21924-21chrt10:33:011
208789930,2cyclictest18820-21taskset11:36:061
208789930,2cyclictest0-21swapper/111:10:121
208789930,2cyclictest0-21swapper/111:10:121
208789930,2cyclictest0-21swapper/109:05:131
208789930,2cyclictest0-21swapper/108:25:111
208779932,1cyclictest714-21snmpd07:45:110
208779930,3cyclictest4261-21apt-get07:40:130
208779930,3cyclictest0-21swapper/008:50:110
208779930,3cyclictest0-21swapper/008:40:120
208779930,3cyclictest0-21swapper/007:20:110
208779930,3cyclictest0-21swapper/007:15:060
208779930,3cyclictest0-21swapper/007:10:120
17176230,0sleep10-21swapper/109:25:231
208789921,1cyclictest0-21swapper/111:15:121
208789921,1cyclictest0-21swapper/107:45:131
208789921,1cyclictest0-21swapper/107:40:141
208789921,1cyclictest0-21swapper/107:30:111
208789921,1cyclictest0-21swapper/107:20:111
208789921,1cyclictest0-21swapper/107:15:011
208789921,0cyclictest0-21swapper/108:45:131
208789920,1cyclictest26686-21chrt09:30:191
208789920,1cyclictest16626-21chrt08:05:121
208789920,1cyclictest0-21swapper/112:20:121
208789920,1cyclictest0-21swapper/112:05:171
208789920,1cyclictest0-21swapper/111:45:121
208789920,1cyclictest0-21swapper/110:20:131
208789920,1cyclictest0-21swapper/110:10:131
208789920,1cyclictest0-21swapper/108:50:101
208789920,1cyclictest0-21swapper/108:40:121
208789920,1cyclictest0-21swapper/108:35:111
208789920,1cyclictest0-21swapper/108:30:121
208789920,1cyclictest0-21swapper/107:55:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional