You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 07:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Nov 17, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
106592200184,11sleep10-21swapper/119:06:591
108542191172,14sleep00-21swapper/019:09:320
107382188172,11sleep30-21swapper/319:08:013
10697210688,13sleep20-21swapper/219:07:282
89822460,0sleep28981-21memory23:20:172
273942440,0sleep30-21swapper/322:57:013
211722380,0sleep20-21swapper/221:16:242
110719960,6cyclictest12269-21grep23:05:253
110679955,0cyclictest31308-21ssh00:04:332
110679955,0cyclictest0-21swapper/223:19:532
110679950,5cyclictest0-21swapper/223:10:142
110679950,5cyclictest0-21swapper/222:42:302
110679950,5cyclictest0-21swapper/222:15:122
110679950,5cyclictest0-21swapper/200:24:222
110679950,4cyclictest0-21swapper/223:40:122
110679950,4cyclictest0-21swapper/219:40:152
110679950,0cyclictest0-21swapper/222:52:502
110679950,0cyclictest0-21swapper/221:32:572
110659951,3cyclictest0-21swapper/120:40:131
110659951,2cyclictest0-21swapper/123:00:131
110659950,5cyclictest0-21swapper/123:21:111
110659950,5cyclictest0-21swapper/122:29:321
110659950,5cyclictest0-21swapper/121:31:291
110659950,5cyclictest0-21swapper/100:30:281
110659950,3cyclictest0-21swapper/121:25:141
110649955,0cyclictest0-21swapper/023:55:520
110649951,4cyclictest24599-21basename21:35:020
110649951,4cyclictest14361-21munin-run20:20:000
110649951,3cyclictest0-21swapper/019:45:020
110649950,5cyclictest6730-21diskmemload23:32:270
110649950,5cyclictest6730-21diskmemload00:17:510
110649950,5cyclictest0-21swapper/022:16:470
110649950,5cyclictest0-21swapper/021:46:220
110649950,5cyclictest0-21swapper/021:38:140
110649950,0cyclictest6730-21diskmemload22:27:510
23538240,3sleep30-21swapper/300:33:053
13629240,0sleep10-21swapper/121:45:171
110719944,0cyclictest13624-21kworker/3:120:52:553
110719944,0cyclictest13624-21kworker/3:120:41:453
110719944,0cyclictest13624-21kworker/3:120:30:323
110719944,0cyclictest13624-21kworker/3:120:08:113
110719944,0cyclictest13624-21kworker/3:119:45:483
110719944,0cyclictest13624-21kworker/3:119:23:243
110719944,0cyclictest0-21swapper/323:24:083
110719943,1cyclictest20321-21perl19:25:143
110719943,1cyclictest1075-21grep21:55:183
110719942,2cyclictest714-21snmpd20:36:423
110719942,1cyclictest15115-21sh22:35:133
110719940,4cyclictest4494-21/usr/sbin/munin21:05:163
110719940,4cyclictest0-21swapper/323:57:023
110719940,4cyclictest0-21swapper/323:50:123
110719940,4cyclictest0-21swapper/323:15:013
110719940,4cyclictest0-21swapper/322:41:003
110719940,4cyclictest0-21swapper/322:30:153
110719940,4cyclictest0-21swapper/322:01:203
110719940,4cyclictest0-21swapper/321:22:273
110719940,4cyclictest0-21swapper/320:00:143
110719940,4cyclictest0-21swapper/319:10:153
110719940,4cyclictest0-21swapper/300:15:033
110719940,4cyclictest0-21swapper/300:05:133
110719940,3cyclictest7092-21apt-config21:10:013
110719940,3cyclictest29381-21python23:30:223
110719940,3cyclictest28530-21hddtemp_smartct22:25:163
110719940,3cyclictest26628-21ntp_states21:35:213
110719940,3cyclictest21964-21sh21:33:233
110719940,3cyclictest18251-21df_inode23:25:143
110719940,3cyclictest17318-21sed22:20:013
110719940,3cyclictest15711-21ssh21:45:573
110719940,3cyclictest15591-21sh00:29:203
110719940,3cyclictest12954-21rm00:10:533
110719940,3cyclictest0-21swapper/320:15:133
110719940,3cyclictest0-21swapper/319:55:123
110719940,1cyclictest5596-21grep23:35:133
110719940,1cyclictest15327-21cut23:40:123
110719940,0cyclictest0-21swapper/323:00:183
110719940,0cyclictest0-21swapper/300:03:593
110679944,0cyclictest0-21swapper/222:21:502
110679944,0cyclictest0-21swapper/222:04:492
110679943,1cyclictest20757-21needreboot19:25:162
110679941,3cyclictest27818-21ssh23:45:442
110679941,2cyclictest0-21swapper/223:35:122
110679941,2cyclictest0-21swapper/200:35:142
110679941,1cyclictest0-21swapper/219:15:122
110679940,4cyclictest6730-21diskmemload22:25:122
110679940,4cyclictest21486-21ssh23:26:292
110679940,4cyclictest0-21swapper/223:31:002
110679940,4cyclictest0-21swapper/223:02:432
110679940,4cyclictest0-21swapper/222:36:302
110679940,4cyclictest0-21swapper/222:31:452
110679940,4cyclictest0-21swapper/222:10:132
110679940,4cyclictest0-21swapper/222:05:222
110679940,4cyclictest0-21swapper/221:55:162
110679940,4cyclictest0-21swapper/221:49:582
110679940,4cyclictest0-21swapper/221:40:152
110679940,4cyclictest0-21swapper/221:37:392
110679940,4cyclictest0-21swapper/221:21:352
110679940,4cyclictest0-21swapper/220:54:062
110679940,4cyclictest0-21swapper/219:45:132
110679940,4cyclictest0-21swapper/200:05:132
110679940,3cyclictest3186-21df_inode23:50:132
110679940,3cyclictest24403-21wc20:40:002
110679940,3cyclictest23901-21ssh21:50:172
110679940,3cyclictest23241-21tail19:30:202
110679940,3cyclictest12438-21ls22:50:012
110659944,0cyclictest0-21swapper/123:44:021
110659944,0cyclictest0-21swapper/123:07:581
110659944,0cyclictest0-21swapper/122:54:421
110659944,0cyclictest0-21swapper/119:15:171
110659942,1cyclictest0-21swapper/121:15:151
110659942,1cyclictest0-21swapper/120:50:121
110659941,2cyclictest0-21swapper/123:55:131
110659941,2cyclictest0-21swapper/123:30:151
110659941,2cyclictest0-21swapper/122:30:151
110659941,2cyclictest0-21swapper/122:05:151
110659941,2cyclictest0-21swapper/121:40:141
110659941,2cyclictest0-21swapper/121:10:151
110659941,2cyclictest0-21swapper/120:15:121
110659941,2cyclictest0-21swapper/120:00:161
110659941,2cyclictest0-21swapper/119:20:101
110659941,2cyclictest0-21swapper/100:15:131
110659941,2cyclictest0-21swapper/100:10:151
110659940,4cyclictest0-21swapper/122:45:061
110659940,4cyclictest0-21swapper/121:01:301
110659940,4cyclictest0-21swapper/100:39:191
110659940,4cyclictest0-21swapper/100:21:341
110659940,2cyclictest0-21swapper/121:50:131
110659940,2cyclictest0-21swapper/119:25:111
110659940,2cyclictest0-21swapper/100:00:131
110649944,0cyclictest0-21swapper/021:29:210
110649944,0cyclictest0-21swapper/020:22:070
110649942,2cyclictest7340-21ssh22:30:250
110649942,1cyclictest28414-21ssh21:52:390
110649940,4cyclictest6730-21diskmemload23:50:120
110649940,4cyclictest4610-21ssh00:06:540
110649940,4cyclictest30181-21perl20:50:150
110649940,4cyclictest0-21swapper/023:45:570
110649940,4cyclictest0-21swapper/023:35:120
110649940,4cyclictest0-21swapper/023:19:440
110649940,4cyclictest0-21swapper/023:05:160
110649940,4cyclictest0-21swapper/023:01:120
110649940,4cyclictest0-21swapper/022:45:120
110649940,4cyclictest0-21swapper/022:35:130
110649940,4cyclictest0-21swapper/022:22:370
110649940,4cyclictest0-21swapper/022:05:150
110649940,4cyclictest0-21swapper/022:00:150
110649940,4cyclictest0-21swapper/021:40:170
110649940,4cyclictest0-21swapper/021:15:150
110649940,4cyclictest0-21swapper/021:10:150
110649940,4cyclictest0-21swapper/020:10:020
110649940,4cyclictest0-21swapper/020:05:150
110649940,4cyclictest0-21swapper/020:00:000
110649940,4cyclictest0-21swapper/019:55:130
110649940,4cyclictest0-21swapper/000:35:140
110649940,4cyclictest0-21swapper/000:34:300
110649940,4cyclictest0-21swapper/000:25:120
110649940,4cyclictest0-21swapper/000:00:120
110649940,3cyclictest30156-21ssh21:20:430
110649940,3cyclictest20160-21ssh23:10:140
110649940,3cyclictest19026-21ssh23:41:270
110649940,3cyclictest14494-21sh23:23:200
110649940,3cyclictest0-21swapper/019:30:140
110649940,3cyclictest0-21swapper/019:25:120
110649940,0cyclictest0-21swapper/019:15:020
110719932,1cyclictest714-21snmpd22:50:063
110719932,1cyclictest714-21snmpd22:10:013
110719932,1cyclictest714-21snmpd21:50:133
110719932,1cyclictest714-21snmpd20:55:033
110719932,1cyclictest714-21snmpd00:35:053
110719932,1cyclictest20110-21ssh22:05:093
110719931,2cyclictest5162-21aten2_r5power_c21:25:143
110719930,3cyclictest27961-21irqstats20:45:163
110719930,3cyclictest2551-21df_inode21:00:153
110719930,3cyclictest25053-21df_inode19:35:153
110719930,3cyclictest23041-21irqstats19:30:183
110719930,3cyclictest19867-21sh23:10:033
110719930,3cyclictest17048-21date20:25:003
110719930,3cyclictest0-21swapper/323:45:173
110719930,3cyclictest0-21swapper/322:20:113
110719930,3cyclictest0-21swapper/320:20:123
110719930,3cyclictest0-21swapper/320:10:053
110719930,3cyclictest0-21swapper/319:50:063
110719930,3cyclictest0-21swapper/319:40:103
110719930,3cyclictest0-21swapper/319:15:013
110719930,2cyclictest711-21runrttasks22:45:013
110719930,1cyclictest29809-21ssh00:20:113
110719930,1cyclictest2560-21sh21:40:063
110719930,1cyclictest17358-21ssh21:15:073
110679933,0cyclictest23682-21kworker/2:021:00:082
110679933,0cyclictest23682-21kworker/2:000:30:082
110679933,0cyclictest0-21swapper/200:25:052
110679932,1cyclictest23682-21kworker/2:019:55:102
110679931,1cyclictest0-21swapper/220:10:132
110679931,0cyclictest0-21swapper/221:25:142
110679930,3cyclictest9870-21ssh00:10:062
110679930,3cyclictest7373-21ssh21:10:102
110679930,3cyclictest14601-21apt-get20:20:132
110679930,3cyclictest11882-21cut19:10:182
110679930,3cyclictest10168-21rm23:05:122
110679930,3cyclictest0-21swapper/223:55:012
110679930,3cyclictest0-21swapper/222:55:142
110679930,3cyclictest0-21swapper/221:05:132
110679930,3cyclictest0-21swapper/220:55:072
110679930,3cyclictest0-21swapper/220:45:122
110679930,3cyclictest0-21swapper/220:40:132
110679930,3cyclictest0-21swapper/220:30:122
110679930,3cyclictest0-21swapper/220:25:132
110679930,3cyclictest0-21swapper/220:15:122
110679930,3cyclictest0-21swapper/220:05:152
110679930,3cyclictest0-21swapper/220:00:142
110679930,3cyclictest0-21swapper/219:50:142
110679930,3cyclictest0-21swapper/219:35:132
110679930,3cyclictest0-21swapper/219:20:122
110679930,3cyclictest0-21swapper/200:15:062
110659933,0cyclictest0-21swapper/119:51:481
110659933,0cyclictest0-21swapper/119:35:051
110659931,2cyclictest0-21swapper/122:35:131
110659931,1cyclictest0-21swapper/123:10:151
110659931,1cyclictest0-21swapper/122:55:141
110659931,1cyclictest0-21swapper/122:20:111
110659931,1cyclictest0-21swapper/122:10:131
110659931,1cyclictest0-21swapper/121:20:171
110659931,1cyclictest0-21swapper/120:45:111
110659931,1cyclictest0-21swapper/120:25:131
110659931,1cyclictest0-21swapper/120:10:131
110659931,1cyclictest0-21swapper/120:05:151
110659931,1cyclictest0-21swapper/119:40:151
110659931,1cyclictest0-21swapper/100:05:141
110659930,2cyclictest6961-21chrt21:58:171
110659930,2cyclictest0-21swapper/123:45:151
110659930,2cyclictest0-21swapper/121:35:151
110659930,2cyclictest0-21swapper/121:05:141
110659930,2cyclictest0-21swapper/120:55:121
110659930,2cyclictest0-21swapper/120:20:121
110659930,2cyclictest0-21swapper/119:30:131
110659930,2cyclictest0-21swapper/119:10:151
110659930,2cyclictest0-21swapper/100:25:121
110649933,0cyclictest25449-21kworker/0:020:45:000
110649932,1cyclictest17676-21ssh23:25:120
110649932,1cyclictest16910-21apt-get19:20:100
110649931,1cyclictest0-21swapper/000:20:160
110649930,3cyclictest30183-21perl19:45:160
110649930,3cyclictest25240-21perl20:40:170
110649930,3cyclictest20367-21hddtemp_smartct20:30:150
110649930,3cyclictest2029-21dpkg21:00:140
110649930,3cyclictest18097-21expr20:25:180
110649930,3cyclictest11006-21hddtemp_smartct00:10:190
110649930,3cyclictest0-21swapper/022:40:120
110649930,3cyclictest0-21swapper/022:10:130
110649930,3cyclictest0-21swapper/021:55:020
110649930,3cyclictest0-21swapper/021:05:140
110649930,3cyclictest0-21swapper/020:55:110
110649930,3cyclictest0-21swapper/020:35:020
110649930,3cyclictest0-21swapper/019:50:130
110649930,3cyclictest0-21swapper/019:35:130
110649930,3cyclictest0-21swapper/019:15:080
110649930,2cyclictest22736-21chrt22:55:130
110649930,2cyclictest12622-21ssh22:50:060
110659921,1cyclictest0-21swapper/123:50:121
110659921,1cyclictest0-21swapper/123:15:141
110659921,1cyclictest0-21swapper/119:55:131
110659920,1cyclictest0-21swapper/123:35:021
110659920,1cyclictest0-21swapper/123:25:131
110659920,1cyclictest0-21swapper/122:42:121
110659920,1cyclictest0-21swapper/122:15:131
110659920,1cyclictest0-21swapper/122:00:141
110659920,1cyclictest0-21swapper/120:35:131
110659920,1cyclictest0-21swapper/120:30:131
110659920,1cyclictest0-21swapper/119:45:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional