You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 06:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Dec 05, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
49912198182,11sleep10-21swapper/119:09:241
47712193174,14sleep20-21swapper/219:06:322
47102185169,12sleep00-21swapper/019:05:460
47082185168,13sleep30-21swapper/319:05:453
296882470,0sleep30-21swapper/322:27:433
296882470,0sleep30-21swapper/322:27:423
256642470,0sleep10-21swapper/100:02:441
17472450,0sleep30-21swapper/321:25:213
118212450,0sleep20-21swapper/222:02:432
195982420,0sleep20-21swapper/223:27:102
205952390,0sleep30-21swapper/323:44:123
524199102,4cyclictest2007-21munin-run00:40:000
52419982,3cyclictest17639-21munin-run21:50:010
52419981,3cyclictest9369-21munin-run23:55:000
29086280,0sleep10-21swapper/121:23:061
26140280,0sleep10-21swapper/122:10:141
52419970,3cyclictest8922-21munin-run20:20:000
52419970,3cyclictest13510-21awk19:25:010
52529960,5cyclictest0-21swapper/320:00:133
52489961,4cyclictest0-21swapper/223:15:012
52489960,5cyclictest24220-21apt-get19:45:012
52419961,3cyclictest0-21swapper/022:00:120
52419960,3cyclictest3952-21munin-run20:10:000
52419960,3cyclictest25498-21munin-run22:10:010
52419960,3cyclictest19885-21munin-run21:35:010
52529954,1cyclictest0-21swapper/321:20:023
52529950,5cyclictest26655-21cat23:30:213
52529950,5cyclictest0-21swapper/321:32:043
52529950,4cyclictest0-21swapper/300:00:143
52489955,0cyclictest0-21swapper/200:06:202
52489950,5cyclictest0-21swapper/223:05:052
52489950,5cyclictest0-21swapper/221:33:592
52489950,5cyclictest0-21swapper/221:10:332
52489950,5cyclictest0-21swapper/220:01:352
52489950,0cyclictest0-21swapper/223:48:352
52429951,2cyclictest0-21swapper/119:30:121
52429950,5cyclictest0-21swapper/121:28:241
52419951,4cyclictest0-21swapper/021:15:140
52419951,2cyclictest0-21swapper/000:30:130
52419950,5cyclictest0-21swapper/023:37:430
52419950,5cyclictest0-21swapper/023:28:240
52419950,5cyclictest0-21swapper/019:30:210
52419950,5cyclictest0-21swapper/000:20:120
8922240,0sleep30-21swapper/322:50:043
52529944,0cyclictest0-21swapper/323:55:063
52529944,0cyclictest0-21swapper/322:05:413
52529942,1cyclictest0-21swapper/323:05:143
52529941,3cyclictest808-21snmpd22:43:003
52529941,3cyclictest808-21snmpd20:46:023
52529941,1cyclictest0-21swapper/323:15:123
52529941,1cyclictest0-21swapper/319:20:113
52529940,4cyclictest6099-21ssh23:52:583
52529940,4cyclictest21449-21ssh21:35:153
52529940,4cyclictest0-21swapper/323:45:133
52529940,4cyclictest0-21swapper/323:14:473
52529940,4cyclictest0-21swapper/322:46:033
52529940,4cyclictest0-21swapper/322:12:433
52529940,4cyclictest0-21swapper/321:55:333
52529940,4cyclictest0-21swapper/319:45:143
52529940,4cyclictest0-21swapper/300:25:153
52529940,4cyclictest0-21swapper/300:21:083
52529940,4cyclictest0-21swapper/300:15:543
52529940,4cyclictest0-21swapper/300:10:133
52529940,3cyclictest5778-21ssh22:15:243
52529940,3cyclictest5705-21chmod22:00:013
52529940,3cyclictest5173-21irqstats20:10:183
52529940,3cyclictest4224-21sh22:30:463
52529940,3cyclictest3095-21/usr/sbin/munin23:35:153
52529940,3cyclictest29477-21ssh00:05:003
52529940,3cyclictest24964-21ssh00:35:123
52529940,3cyclictest22830-21ntp_states19:40:173
52529940,3cyclictest20873-21ssh21:50:453
52529940,3cyclictest19316-21sh00:31:473
52529940,3cyclictest17078-21rm23:25:353
52529940,3cyclictest15174-21ntpq19:25:173
52529940,3cyclictest12030-21ssh21:46:303
52529940,1cyclictest6655-21/usr/sbin/munin20:15:203
52529940,1cyclictest31205-21fschecks_time21:40:143
52529940,1cyclictest29225-21/usr/sbin/munin23:00:133
52529940,1cyclictest10425-21ntp_states20:20:183
52489944,0cyclictest0-21swapper/222:40:122
52489944,0cyclictest0-21swapper/222:26:582
52489944,0cyclictest0-21swapper/222:26:582
52489944,0cyclictest0-21swapper/222:19:152
52489942,2cyclictest23306-21ssh00:17:522
52489941,3cyclictest808-21snmpd22:30:272
52489941,3cyclictest0-21swapper/219:15:112
52489940,4cyclictest0-21swapper/223:55:142
52489940,4cyclictest0-21swapper/223:35:122
52489940,4cyclictest0-21swapper/222:50:302
52489940,4cyclictest0-21swapper/222:35:142
52489940,4cyclictest0-21swapper/222:22:322
52489940,4cyclictest0-21swapper/222:05:142
52489940,4cyclictest0-21swapper/221:24:192
52489940,4cyclictest0-21swapper/220:10:372
52489940,4cyclictest0-21swapper/219:50:132
52489940,4cyclictest0-21swapper/219:36:342
52489940,4cyclictest0-21swapper/219:10:122
52489940,4cyclictest0-21swapper/200:35:162
52489940,4cyclictest0-21swapper/200:30:362
52489940,3cyclictest7801-21cut21:45:012
52489940,3cyclictest7125-21ssh22:49:042
52489940,3cyclictest4893-21ssh00:25:162
52489940,3cyclictest3608-21ssh00:24:352
52489940,3cyclictest27913-21ssh21:55:012
52489940,3cyclictest0-21swapper/219:30:132
52489940,0cyclictest0-21swapper/223:31:352
52489940,0cyclictest0-21swapper/221:48:242
52429944,0cyclictest0-21swapper/123:57:061
52429944,0cyclictest0-21swapper/122:36:551
52429944,0cyclictest0-21swapper/122:02:001
52429944,0cyclictest0-21swapper/121:39:011
52429944,0cyclictest0-21swapper/120:40:221
52429944,0cyclictest0-21swapper/100:17:101
52429942,1cyclictest0-21swapper/123:35:121
52429941,2cyclictest0-21swapper/120:20:121
52429941,2cyclictest0-21swapper/100:10:131
52429941,1cyclictest0-21swapper/123:40:131
52429941,1cyclictest0-21swapper/122:25:141
52429941,1cyclictest0-21swapper/122:25:141
52429940,4cyclictest0-21swapper/122:45:301
52429940,4cyclictest0-21swapper/121:10:111
52429940,2cyclictest0-21swapper/123:15:121
52429940,2cyclictest0-21swapper/121:00:171
52429940,2cyclictest0-21swapper/119:20:111
52429940,0cyclictest0-21swapper/123:01:051
52429940,0cyclictest0-21swapper/121:57:211
52429940,0cyclictest0-21swapper/100:25:371
52419944,0cyclictest1430-21diskmemload22:40:580
52419944,0cyclictest0-21swapper/023:12:500
52419943,1cyclictest6293-21tr00:25:210
52419942,2cyclictest32647-21kworker/0:122:25:050
52419942,2cyclictest32647-21kworker/0:122:25:050
52419941,2cyclictest0-21swapper/023:05:140
52419941,2cyclictest0-21swapper/020:30:180
52419941,1cyclictest0-21swapper/020:35:120
52419940,4cyclictest3399-21ssh21:58:500
52419940,4cyclictest1430-21diskmemload22:52:300
52419940,4cyclictest0-21swapper/023:40:120
52419940,4cyclictest0-21swapper/023:30:130
52419940,4cyclictest0-21swapper/022:55:140
52419940,4cyclictest0-21swapper/022:45:240
52419940,4cyclictest0-21swapper/022:35:130
52419940,4cyclictest0-21swapper/022:30:160
52419940,4cyclictest0-21swapper/022:15:100
52419940,4cyclictest0-21swapper/022:10:140
52419940,4cyclictest0-21swapper/021:35:110
52419940,4cyclictest0-21swapper/021:25:150
52419940,4cyclictest0-21swapper/021:20:020
52419940,4cyclictest0-21swapper/020:45:120
52419940,4cyclictest0-21swapper/000:15:440
52419940,3cyclictest3536-21ssh23:19:370
52419940,3cyclictest16173-21munin-run19:30:010
52419940,3cyclictest14130-21latency_hist23:25:000
52419940,2cyclictest0-21swapper/000:05:120
52419940,0cyclictest0-21swapper/021:11:190
27339240,0sleep10-21swapper/120:55:161
25345240,0sleep20-21swapper/221:53:352
23520240,0sleep10-21swapper/122:56:461
19856240,0sleep30-21swapper/322:55:163
52529932,1cyclictest808-21snmpd20:35:053
52529932,1cyclictest808-21snmpd20:30:143
52529932,1cyclictest24194-21apt-get20:50:143
52529931,2cyclictest14983-21needreboot22:20:183
52529931,1cyclictest808-21snmpd20:40:113
52529931,1cyclictest0-21swapper/319:10:123
52529930,3cyclictest56750irq/130-eth021:10:083
52529930,3cyclictest4667-21sh23:20:123
52529930,3cyclictest29820-21perl21:00:193
52529930,3cyclictest19600-21diskstats19:35:133
52529930,3cyclictest16166-21apt-get19:30:023
52529930,3cyclictest11289-21ssh22:35:033
52529930,3cyclictest0-21swapper/321:15:053
52529930,3cyclictest0-21swapper/321:05:083
52529930,3cyclictest0-21swapper/320:55:133
52529930,3cyclictest0-21swapper/320:25:033
52529930,3cyclictest0-21swapper/320:05:153
52529930,3cyclictest0-21swapper/319:55:043
52529930,3cyclictest0-21swapper/319:15:123
52529930,2cyclictest26457-21cron19:50:003
52489930,3cyclictest28988-21ssh23:00:032
52489930,3cyclictest19169-21ssh22:55:112
52489930,3cyclictest19144-21hostname20:40:142
52489930,3cyclictest17715-21uname20:35:182
52489930,3cyclictest16829-21ssh23:10:062
52489930,3cyclictest12621-21expr23:40:132
52489930,3cyclictest0-21swapper/223:50:112
52489930,3cyclictest0-21swapper/223:20:122
52489930,3cyclictest0-21swapper/222:10:062
52489930,3cyclictest0-21swapper/221:35:042
52489930,3cyclictest0-21swapper/221:25:162
52489930,3cyclictest0-21swapper/221:15:012
52489930,3cyclictest0-21swapper/221:05:142
52489930,3cyclictest0-21swapper/221:00:172
52489930,3cyclictest0-21swapper/220:55:232
52489930,3cyclictest0-21swapper/220:50:142
52489930,3cyclictest0-21swapper/220:45:012
52489930,3cyclictest0-21swapper/220:20:132
52489930,3cyclictest0-21swapper/220:15:112
52489930,3cyclictest0-21swapper/220:05:042
52489930,3cyclictest0-21swapper/219:55:132
52489930,3cyclictest0-21swapper/219:40:112
52489930,3cyclictest0-21swapper/219:25:022
52489930,3cyclictest0-21swapper/219:20:012
52489930,3cyclictest0-21swapper/200:10:072
52489930,3cyclictest0-21swapper/200:00:142
52489930,2cyclictest14467-21/usr/sbin/munin20:30:192
52489930,2cyclictest12007-21cstates20:25:132
52429933,0cyclictest0-21swapper/123:09:401
52429933,0cyclictest0-21swapper/122:06:401
52429933,0cyclictest0-21swapper/120:30:281
52429931,1cyclictest0-21swapper/123:45:131
52429931,1cyclictest0-21swapper/123:30:131
52429931,1cyclictest0-21swapper/123:20:121
52429931,1cyclictest0-21swapper/122:30:161
52429931,1cyclictest0-21swapper/122:15:111
52429931,1cyclictest0-21swapper/121:50:121
52429931,1cyclictest0-21swapper/121:40:121
52429931,1cyclictest0-21swapper/121:15:141
52429931,1cyclictest0-21swapper/120:45:011
52429931,1cyclictest0-21swapper/120:35:131
52429931,1cyclictest0-21swapper/119:10:121
52429931,1cyclictest0-21swapper/100:35:161
52429930,2cyclictest8981-21chrt22:50:061
52429930,2cyclictest264542sleep119:49:581
52429930,2cyclictest0-21swapper/120:50:141
52429930,2cyclictest0-21swapper/100:05:121
52429930,1cyclictest0-21swapper/100:30:131
52419933,0cyclictest32647-21kworker/0:121:05:100
52419933,0cyclictest32647-21kworker/0:121:00:010
52419931,1cyclictest0-21swapper/023:45:130
52419931,0cyclictest0-21swapper/019:35:110
52419930,3cyclictest8766-21apt-get19:15:110
52419930,3cyclictest4181-21apt20:10:140
52419930,3cyclictest31170-21tune2fs21:40:140
52419930,3cyclictest27370-21perl19:50:140
52419930,3cyclictest25183-21irqstats20:50:180
52419930,3cyclictest13589-21ssh22:20:090
52419930,3cyclictest111rcuc/021:50:120
52419930,3cyclictest0-21swapper/023:00:050
52419930,3cyclictest0-21swapper/020:55:130
52419930,3cyclictest0-21swapper/020:40:080
52419930,3cyclictest0-21swapper/020:25:120
52419930,3cyclictest0-21swapper/020:20:120
52419930,3cyclictest0-21swapper/019:55:130
52419930,3cyclictest0-21swapper/019:45:130
52419930,3cyclictest0-21swapper/019:10:120
52419930,3cyclictest0-21swapper/000:10:100
52419930,3cyclictest0-21swapper/000:00:150
52419930,2cyclictest9797-21ssh23:55:080
52419930,2cyclictest31662-21apt20:00:130
52419930,0cyclictest0-21swapper/019:40:130
52429921,1cyclictest0-21swapper/119:50:121
52429921,1cyclictest0-21swapper/119:40:111
52429921,1cyclictest0-21swapper/119:35:111
52429921,0cyclictest0-21swapper/120:10:131
52429920,1cyclictest170762sleep123:10:161
52429920,1cyclictest0-21swapper/123:50:031
52429920,1cyclictest0-21swapper/123:25:121
52429920,1cyclictest0-21swapper/122:40:441
52429920,1cyclictest0-21swapper/122:20:131
52429920,1cyclictest0-21swapper/121:45:061
52429920,1cyclictest0-21swapper/121:30:181
52429920,1cyclictest0-21swapper/121:05:141
52429920,1cyclictest0-21swapper/120:25:151
52429920,1cyclictest0-21swapper/120:15:121
52429920,1cyclictest0-21swapper/120:05:131
52429920,1cyclictest0-21swapper/120:00:141
52429920,1cyclictest0-21swapper/119:55:131
52429920,1cyclictest0-21swapper/119:25:021
52429920,1cyclictest0-21swapper/119:15:111
52429920,1cyclictest0-21swapper/100:20:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional