You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 03:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Mon Jul 06, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208672236222,10sleep10-21swapper/119:05:101
228382187172,11sleep00-21swapper/019:06:450
208642187171,12sleep30-21swapper/319:05:083
228302183166,13sleep20-21swapper/219:06:402
302242510,0sleep10-21swapper/120:25:171
2325499100,9cyclictest696-21awk22:05:000
232549993,6cyclictest16456-21perf20:00:010
232549992,3cyclictest28840-21munin-run20:25:010
232549990,8cyclictest22332-21lockfile-remove23:20:010
232549981,1cyclictest520-21in:imuxsock20:44:590
232549981,1cyclictest1737-21fschecks_count00:30:130
232549980,1cyclictest28136-21perl21:30:150
232549980,1cyclictest25604-21cron19:15:000
232549980,1cyclictest22714-21memory20:10:170
232549980,1cyclictest22714-21memory20:10:160
232549980,1cyclictest2207-21munin-run23:10:010
232549980,1cyclictest20700-21munin-node23:35:110
232549972,1cyclictest802-21snmpd19:42:120
232549972,1cyclictest21338-21ssh23:50:580
232549972,1cyclictest205-21systemd-journal21:05:010
232549971,1cyclictest802-21snmpd20:06:510
232549971,1cyclictest30497-21ssh00:11:510
232549971,1cyclictest26243-21grep19:15:000
232549971,1cyclictest1406-21awk19:30:010
232549971,1cyclictest12586-21grep00:35:180
232549971,1cyclictest10555-21ssh23:45:270
232549971,1cyclictest0-21swapper/022:15:120
232549970,2cyclictest0-21swapper/019:45:020
232549970,1cyclictest8627-21ls22:25:010
232549970,1cyclictest7810-21ssh23:12:150
232549970,1cyclictest7810-21ntp_states20:45:170
232549970,1cyclictest6295-21ssh22:39:480
232549970,1cyclictest4686-21grep19:35:150
232549970,1cyclictest4298-21perl00:15:130
232549970,1cyclictest4226-21hddtemp_smartct21:50:160
232549970,1cyclictest3873-21awk19:35:010
232549970,1cyclictest32492-21cut23:25:010
232549970,1cyclictest32492-21cut23:25:000
232549970,1cyclictest31335-21diskstats23:40:140
232549970,1cyclictest30766-21ntp_states21:15:190
232549970,1cyclictest30383-21ntp_states19:20:170
232549970,1cyclictest29209-21hddtemp_smartct23:55:140
232549970,1cyclictest26818-21turbostat22:50:010
232549970,1cyclictest24375-21grep00:25:150
232549970,1cyclictest2069-21ntp_states23:25:180
232549970,1cyclictest20099-21hddtemp_smartct21:10:140
232549970,1cyclictest19977-21df22:30:120
232549970,1cyclictest18939-21awk20:05:010
232549970,1cyclictest17082-21irqstats00:05:160
232549970,1cyclictest16770-21ls22:45:010
232549970,1cyclictest11417-21perl23:30:140
232549970,1cyclictest10528-21python20:50:200
3914260,0sleep20-21swapper/221:18:222
232659960,6cyclictest0-21swapper/323:01:313
232609962,3cyclictest14996-21ssh00:36:242
232549961,1cyclictest29961-21nscd00:00:010
232549961,1cyclictest29226-21awk20:25:130
232549961,0cyclictest2336-21cat22:05:170
232549960,2cyclictest0-21swapper/021:05:120
232549960,1cyclictest9725-21df_inode22:25:150
232549960,1cyclictest8362-21memory21:20:180
232549960,1cyclictest5832-21df21:35:130
232549960,1cyclictest5083-21egrep22:55:120
232549960,1cyclictest27902-21df22:50:140
232549960,1cyclictest26419-21perl21:45:150
232549960,1cyclictest24627-21df_inode20:15:130
232549960,1cyclictest17817-21df21:25:140
232549960,1cyclictest16244-21sed23:00:150
232549960,1cyclictest16015-21df21:40:140
232549960,1cyclictest1580-21apt20:35:120
232549960,1cyclictest14179-21perl21:55:140
232549960,1cyclictest14119-21diskstats00:20:140
232549960,1cyclictest12124-21fw_packets22:10:150
232549960,1cyclictest12000-21df_inode20:55:120
232549960,1cyclictest11928-21tr19:50:120
232549960,1cyclictest0-21swapper/020:30:130
15195260,1sleep32326599cyclictest21:24:043
232659950,5cyclictest30222-21perl22:35:113
232659950,5cyclictest0-21swapper/323:31:573
232659950,5cyclictest0-21swapper/321:52:343
232659950,5cyclictest0-21swapper/319:51:033
232659950,4cyclictest0-21swapper/320:15:103
232659950,3cyclictest30548-21memory21:15:173
232659950,3cyclictest19271-21if_eth023:50:143
232609955,0cyclictest0-21swapper/223:54:112
232609955,0cyclictest0-21swapper/223:25:572
232609950,5cyclictest0-21swapper/200:22:242
232569950,5cyclictest0-21swapper/122:33:441
232569950,5cyclictest0-21swapper/119:35:211
232569950,5cyclictest0-21swapper/100:28:591
232659944,0cyclictest28636-21kworker/3:000:06:113
232659944,0cyclictest0-21swapper/322:50:123
232659944,0cyclictest0-21swapper/300:19:573
232659943,1cyclictest0-21swapper/322:30:503
232659942,1cyclictest802-21snmpd00:35:293
232659942,1cyclictest802-21snmpd00:11:323
232659941,2cyclictest29359-21if_eth423:55:153
232659940,4cyclictest8908-21ssh00:00:553
232659940,4cyclictest22284-21sh22:47:113
232659940,4cyclictest186292sleep321:57:193
232659940,4cyclictest0-21swapper/323:37:403
232659940,4cyclictest0-21swapper/323:17:073
232659940,4cyclictest0-21swapper/322:55:123
232659940,4cyclictest0-21swapper/322:40:123
232659940,4cyclictest0-21swapper/322:05:143
232659940,4cyclictest0-21swapper/320:00:493
232659940,4cyclictest0-21swapper/319:40:213
232659940,4cyclictest0-21swapper/300:28:003
232659940,4cyclictest0-21swapper/300:20:123
232659940,3cyclictest9117-21apt-config19:45:013
232659940,3cyclictest833-21sh23:09:113
232659940,3cyclictest7062-21df_inode20:45:133
232659940,3cyclictest32744-21cat23:25:013
232659940,3cyclictest31565-21perl23:40:153
232659940,3cyclictest28978-21grep20:25:013
232659940,3cyclictest2736-21ssh23:10:133
232659940,3cyclictest26844-21memory21:45:173
232659940,3cyclictest23777-21hddtemp_smartct23:20:163
232659940,3cyclictest23777-21hddtemp_smartct23:20:153
232659940,3cyclictest18575-21sh21:40:593
232659940,3cyclictest15285-21cut21:00:193
232659940,3cyclictest14917-21latency_hist21:40:003
232659940,3cyclictest12963-21sh23:47:003
232659940,1cyclictest9151-21/usr/sbin/munin22:25:203
232659940,1cyclictest4067-21/usr/sbin/munin20:40:193
232659940,1cyclictest32371-21hddtemp_smartct22:20:143
232659940,1cyclictest19757-21df_inode21:10:133
232659940,1cyclictest11473-21/usr/sbin/munin20:55:153
232609944,0cyclictest15072-21ssh23:00:122
232609943,1cyclictest28713-21grep22:50:182
232609942,1cyclictest4794-21date21:35:012
232609941,2cyclictest0-21swapper/222:05:152
232609941,2cyclictest0-21swapper/221:25:122
232609941,2cyclictest0-21swapper/221:10:122
232609941,2cyclictest0-21swapper/220:50:122
232609941,2cyclictest0-21swapper/220:45:112
232609941,2cyclictest0-21swapper/220:20:132
232609941,2cyclictest0-21swapper/219:35:132
232609941,2cyclictest0-21swapper/219:10:112
232609941,2cyclictest0-21swapper/200:05:132
232609940,4cyclictest18677-21diskmemload22:10:132
232609940,4cyclictest0-21swapper/223:37:092
232609940,4cyclictest0-21swapper/223:10:062
232609940,4cyclictest0-21swapper/223:05:122
232609940,4cyclictest0-21swapper/222:56:352
232609940,4cyclictest0-21swapper/222:45:122
232609940,4cyclictest0-21swapper/222:40:112
232609940,4cyclictest0-21swapper/222:35:102
232609940,4cyclictest0-21swapper/222:20:442
232609940,4cyclictest0-21swapper/221:40:332
232609940,4cyclictest0-21swapper/221:20:122
232609940,4cyclictest0-21swapper/219:50:122
232609940,4cyclictest0-21swapper/200:25:112
232609940,4cyclictest0-21swapper/200:10:132
232609940,3cyclictest8182-21rm00:16:572
232609940,3cyclictest26410-21diskstats19:15:012
232609940,3cyclictest24098-21/usr/sbin/munin20:15:132
232609940,3cyclictest23420-21ssh22:00:092
232609940,3cyclictest19153-21ssh22:30:022
232609940,3cyclictest16482-21ssh22:28:382
232609940,3cyclictest10618-21ssh21:53:372
232609940,1cyclictest17803-21pmu-power21:05:192
232609940,0cyclictest0-21swapper/223:56:472
232609940,0cyclictest0-21swapper/200:04:392
232569944,0cyclictest0-21swapper/123:28:181
232569944,0cyclictest0-21swapper/122:48:261
232569944,0cyclictest0-21swapper/121:47:201
232569942,1cyclictest0-21swapper/123:15:101
232569941,3cyclictest0-21swapper/100:10:121
232569941,2cyclictest0-21swapper/123:20:131
232569941,2cyclictest0-21swapper/123:20:131
232569941,2cyclictest0-21swapper/123:05:121
232569941,2cyclictest0-21swapper/122:40:121
232569941,2cyclictest0-21swapper/121:25:111
232569941,2cyclictest0-21swapper/120:50:131
232569941,2cyclictest0-21swapper/120:15:111
232569941,2cyclictest0-21swapper/120:05:101
232569941,2cyclictest0-21swapper/119:20:121
232569941,2cyclictest0-21swapper/119:15:111
232569941,2cyclictest0-21swapper/119:10:111
232569940,4cyclictest0-21swapper/122:55:081
232569940,4cyclictest0-21swapper/122:27:031
232569940,4cyclictest0-21swapper/121:56:461
232569940,4cyclictest0-21swapper/100:36:141
232569940,0cyclictest0-21swapper/123:12:271
232569940,0cyclictest0-21swapper/122:04:121
232569940,0cyclictest0-21swapper/121:12:421
19571240,0sleep10-21swapper/123:34:381
232659933,0cyclictest0-21swapper/319:15:013
232659932,1cyclictest9385-21expr20:50:143
232659932,1cyclictest802-21snmpd19:20:023
232659930,3cyclictest4490-21cat19:35:143
232659930,3cyclictest27068-21sh21:30:013
232659930,3cyclictest1800-21cat19:30:133
232659930,3cyclictest14190-21/usr/sbin/munin19:55:113
232659930,3cyclictest11152-21ssh22:10:073
232659930,3cyclictest0-21swapper/322:00:133
232659930,3cyclictest0-21swapper/321:05:123
232659930,3cyclictest0-21swapper/320:35:053
232659930,3cyclictest0-21swapper/320:30:043
232659930,3cyclictest0-21swapper/320:25:123
232659930,3cyclictest0-21swapper/320:10:033
232659930,3cyclictest0-21swapper/320:10:033
232659930,3cyclictest0-21swapper/320:05:053
232659930,3cyclictest0-21swapper/319:25:103
232659930,3cyclictest0-21swapper/319:10:113
232659930,2cyclictest21109-21sh22:15:033
232659930,2cyclictest0-21swapper/300:30:113
232659930,1cyclictest16977-21ssh21:25:023
232609932,1cyclictest802-21snmpd21:55:072
232609931,1cyclictest0-21swapper/220:40:112
232609931,1cyclictest0-21swapper/220:05:112
232609930,3cyclictest8056-21ssh23:45:032
232609930,3cyclictest320-21ntpq20:30:172
232609930,3cyclictest25616-21ssh21:45:102
232609930,3cyclictest23429-21df23:20:152
232609930,3cyclictest23429-21df23:20:152
232609930,3cyclictest21185-21ssh22:15:042
232609930,3cyclictest18677-21diskmemload23:30:032
232609930,3cyclictest12460-21ssh23:15:012
232609930,3cyclictest12258-21gltestperf20:55:132
232609930,3cyclictest1076-21apt-get00:30:112
232609930,3cyclictest0-21swapper/223:40:082
232609930,3cyclictest0-21swapper/221:35:012
232609930,3cyclictest0-21swapper/221:00:122
232609930,3cyclictest0-21swapper/220:35:122
232609930,3cyclictest0-21swapper/220:25:112
232609930,3cyclictest0-21swapper/220:10:132
232609930,3cyclictest0-21swapper/220:10:132
232609930,3cyclictest0-21swapper/220:00:112
232609930,3cyclictest0-21swapper/219:55:112
232609930,3cyclictest0-21swapper/219:45:012
232609930,3cyclictest0-21swapper/219:40:132
232609930,3cyclictest0-21swapper/219:30:112
232609930,3cyclictest0-21swapper/219:25:052
232609930,3cyclictest0-21swapper/219:20:122
232569933,0cyclictest0-21swapper/122:51:461
232569933,0cyclictest0-21swapper/121:33:041
232569933,0cyclictest0-21swapper/120:45:111
232569933,0cyclictest0-21swapper/100:04:321
232569932,0cyclictest0-21swapper/122:05:141
232569931,1cyclictest0-21swapper/123:50:111
232569931,1cyclictest0-21swapper/123:40:121
232569931,1cyclictest0-21swapper/122:35:101
232569931,1cyclictest0-21swapper/122:20:011
232569931,1cyclictest0-21swapper/121:50:121
232569931,1cyclictest0-21swapper/121:15:121
232569931,1cyclictest0-21swapper/121:05:121
232569931,1cyclictest0-21swapper/120:35:001
232569931,1cyclictest0-21swapper/120:20:131
232569931,1cyclictest0-21swapper/120:00:121
232569931,1cyclictest0-21swapper/119:55:111
232569931,1cyclictest0-21swapper/119:30:121
232569931,1cyclictest0-21swapper/119:25:111
232569931,1cyclictest0-21swapper/100:15:111
232569931,1cyclictest0-21swapper/100:04:591
232569930,2cyclictest10635-21taskset23:45:301
232569930,2cyclictest0-21swapper/123:00:111
232569930,2cyclictest0-21swapper/120:10:131
232569930,2cyclictest0-21swapper/120:10:121
232569930,2cyclictest0-21swapper/119:45:101
16286230,0sleep10-21swapper/121:05:001
11156230,0sleep10-21swapper/121:21:341
232569921,1cyclictest0-21swapper/123:55:111
232569921,1cyclictest0-21swapper/100:30:101
232569921,1cyclictest0-21swapper/100:20:121
232569920,1cyclictest15231-21chrt21:40:041
232569920,1cyclictest0-21swapper/123:35:101
232569920,1cyclictest0-21swapper/122:20:121
232569920,1cyclictest0-21swapper/122:10:121
232569920,1cyclictest0-21swapper/121:35:021
232569920,1cyclictest0-21swapper/120:55:101
232569920,1cyclictest0-21swapper/120:40:111
232569920,1cyclictest0-21swapper/120:35:121
232569920,1cyclictest0-21swapper/119:40:121
232569910,1cyclictest0-21swapper/119:50:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional