You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 13:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sat Jan 10, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9492197180,12sleep30-21swapper/319:06:363
10452195178,12sleep00-21swapper/019:07:510
11432187171,11sleep10-21swapper/119:09:071
9432174157,12sleep20-21swapper/219:06:312
78182440,0sleep00-21swapper/022:49:040
290152410,0sleep00-21swapper/000:02:190
255862410,0sleep30-21swapper/300:16:143
45192120,0sleep10-21swapper/122:15:181
279902110,0sleep00-21swapper/023:45:330
211422110,0sleep10-21swapper/121:36:191
13719992,3cyclictest22060-21perf19:50:020
13829982,1cyclictest27570-21needreboot21:55:153
13829980,3cyclictest21398-21apt-config00:15:003
13719986,0cyclictest3-21ksoftirqd/022:55:010
13829972,1cyclictest8145-21ssh22:01:263
13829972,1cyclictest10801-21ssh22:34:553
13829970,3cyclictest16313-21if_err_eth123:40:143
13719976,0cyclictest3-21ksoftirqd/023:30:010
13719975,0cyclictest3-21ksoftirqd/022:30:110
13719975,0cyclictest3-21ksoftirqd/021:40:020
13719975,0cyclictest3-21ksoftirqd/020:00:000
13719971,3cyclictest21989-21munin-run20:55:000
13719970,6cyclictest32509-21head00:35:180
13719970,3cyclictest29421-21apt-get21:10:010
13719970,1cyclictest3-21ksoftirqd/021:30:120
13719970,1cyclictest3-21ksoftirqd/020:15:010
13789960,1cyclictest0-21swapper/222:10:102
13729961,3cyclictest0-21swapper/123:10:111
13719965,0cyclictest3-21ksoftirqd/019:30:010
13719964,2cyclictest3-21ksoftirqd/019:15:020
13719964,1cyclictest3-21ksoftirqd/000:05:110
13719964,0cyclictest3-21ksoftirqd/023:35:100
13719964,0cyclictest3-21ksoftirqd/023:30:000
13719964,0cyclictest3-21ksoftirqd/022:30:010
13719964,0cyclictest3-21ksoftirqd/022:15:200
13719964,0cyclictest3-21ksoftirqd/022:00:100
13719964,0cyclictest3-21ksoftirqd/021:55:150
13719964,0cyclictest3-21ksoftirqd/021:15:130
13719964,0cyclictest3-21ksoftirqd/019:10:110
13719964,0cyclictest3-21ksoftirqd/000:15:000
13719963,1cyclictest3-21ksoftirqd/020:30:000
13719961,2cyclictest3-21ksoftirqd/022:20:150
13719961,1cyclictest3-21ksoftirqd/022:40:110
13719960,1cyclictest3-21ksoftirqd/019:25:010
13719960,1cyclictest29142-21apt-get21:25:110
13829955,0cyclictest0-21swapper/322:15:073
13829950,5cyclictest21465-21ssh21:52:243
13829950,5cyclictest0-21swapper/322:13:393
13829950,5cyclictest0-21swapper/300:21:063
13789954,1cyclictest7842-21/usr/sbin/munin23:20:162
13789950,5cyclictest19495-21ssh22:07:052
13789950,5cyclictest0-21swapper/223:01:212
13789950,5cyclictest0-21swapper/200:25:182
13789950,2cyclictest0-21swapper/219:55:192
13729955,0cyclictest0-21swapper/123:50:531
13729952,2cyclictest0-21swapper/121:05:111
13729952,2cyclictest0-21swapper/119:30:111
13729952,2cyclictest0-21swapper/119:25:121
13729951,3cyclictest0-21swapper/122:00:111
13729951,3cyclictest0-21swapper/120:25:101
13729951,3cyclictest0-21swapper/120:05:111
13729951,3cyclictest0-21swapper/120:00:121
13729951,2cyclictest0-21swapper/121:20:101
13729951,2cyclictest0-21swapper/120:30:121
13729951,2cyclictest0-21swapper/119:45:101
13729951,2cyclictest0-21swapper/119:40:111
13729951,2cyclictest0-21swapper/119:35:111
13729951,2cyclictest0-21swapper/119:15:101
13729951,2cyclictest0-21swapper/119:10:101
13729951,1cyclictest0-21swapper/121:40:111
13729950,5cyclictest0-21swapper/121:13:441
13729950,5cyclictest0-21swapper/100:23:031
13719954,1cyclictest3-21ksoftirqd/023:50:110
13719954,1cyclictest3-21ksoftirqd/020:20:010
13719954,1cyclictest3-21ksoftirqd/000:20:110
13719954,0cyclictest3-21ksoftirqd/023:55:110
13719954,0cyclictest3-21ksoftirqd/023:10:190
13719954,0cyclictest3-21ksoftirqd/022:35:130
13719954,0cyclictest3-21ksoftirqd/022:35:130
13719954,0cyclictest3-21ksoftirqd/020:05:110
13719954,0cyclictest3-21ksoftirqd/019:30:010
13719954,0cyclictest3-21ksoftirqd/000:15:000
13719953,1cyclictest3-21ksoftirqd/000:30:010
13719953,0cyclictest3-21ksoftirqd/023:05:020
13719953,0cyclictest3-21ksoftirqd/022:10:190
13719953,0cyclictest3-21ksoftirqd/022:05:120
13719953,0cyclictest3-21ksoftirqd/021:20:180
13719951,2cyclictest3-21ksoftirqd/023:40:120
13719951,2cyclictest3-21ksoftirqd/020:35:110
13719951,1cyclictest81rcu_preempt23:00:130
13719951,0cyclictest3-21ksoftirqd/019:50:110
13719950,1cyclictest3-21ksoftirqd/023:25:000
13719950,1cyclictest3-21ksoftirqd/020:00:160
13719950,0cyclictest81rcu_preempt19:35:100
13719950,0cyclictest0-21swapper/000:25:100
16136240,0sleep10-21swapper/121:18:541
13829944,0cyclictest0-21swapper/323:51:343
13829944,0cyclictest0-21swapper/323:10:253
13829944,0cyclictest0-21swapper/321:45:093
13829944,0cyclictest0-21swapper/319:45:133
13829942,1cyclictest10856-21ssh00:25:123
13829941,1cyclictest0-21swapper/319:20:103
13829940,4cyclictest5255-21egrep23:35:113
13829940,4cyclictest3748-21munin-run19:15:013
13829940,4cyclictest16917-21chrt19:38:073
13829940,4cyclictest0-21swapper/323:30:113
13829940,4cyclictest0-21swapper/323:25:113
13829940,4cyclictest0-21swapper/323:15:123
13829940,4cyclictest0-21swapper/323:05:073
13829940,4cyclictest0-21swapper/323:00:123
13829940,4cyclictest0-21swapper/322:42:583
13829940,4cyclictest0-21swapper/321:30:123
13829940,4cyclictest0-21swapper/321:25:113
13829940,4cyclictest0-21swapper/321:15:063
13829940,4cyclictest0-21swapper/300:30:013
13829940,3cyclictest98782sleep322:50:113
13829940,3cyclictest7383-21hddtemp_smartct23:20:143
13829940,3cyclictest6342-21ssh00:07:033
13829940,3cyclictest4175-21df_inode19:15:013
13829940,3cyclictest29884-21apt-get20:05:003
13829940,3cyclictest2949-21diskstats20:15:133
13829940,3cyclictest29409-21diskmemload00:35:053
13829940,3cyclictest27750-21ssh21:40:123
13829940,3cyclictest20510-21ssh22:55:123
13829940,3cyclictest20199-21pmu-power21:20:173
13829940,3cyclictest14354-21ssh22:05:043
13829940,3cyclictest13107-21sendmail_mailst22:35:203
13829940,3cyclictest13107-21sendmail_mailst22:35:193
13829940,1cyclictest26943-21latency_hist21:05:013
13829940,0cyclictest0-21swapper/322:45:483
13789944,0cyclictest0-21swapper/223:34:402
13789944,0cyclictest0-21swapper/223:27:062
13789944,0cyclictest0-21swapper/223:05:522
13789944,0cyclictest0-21swapper/221:43:392
13789943,1cyclictest21646-21grep22:55:172
13789943,1cyclictest20326-21apt-get00:30:112
13789942,2cyclictest728-21snmpd22:17:192
13789941,1cyclictest0-21swapper/223:55:102
13789941,1cyclictest0-21swapper/223:45:112
13789941,1cyclictest0-21swapper/221:20:112
13789941,1cyclictest0-21swapper/220:40:092
13789940,4cyclictest24517-21awk19:55:002
13789940,4cyclictest19747-21/usr/sbin/munin20:50:172
13789940,4cyclictest15902-21df_inode23:40:132
13789940,4cyclictest10593-21perl20:30:142
13789940,4cyclictest0-21swapper/222:30:112
13789940,4cyclictest0-21swapper/222:20:102
13789940,4cyclictest0-21swapper/200:36:582
13789940,4cyclictest0-21swapper/200:20:112
13789940,3cyclictest6521-21/usr/sbin/munin21:45:132
13789940,3cyclictest4707-21ntp_states23:50:162
13789940,3cyclictest32399-21/usr/sbin/munin20:10:102
13789940,3cyclictest25798-21cron21:55:012
13789940,3cyclictest19766-21date19:45:012
13789940,3cyclictest17247-21ls19:40:012
13789940,3cyclictest15739-21sh21:50:042
13789940,3cyclictest0-21swapper/219:30:022
13789940,2cyclictest24007-21ssh22:40:262
13789940,2cyclictest0-21swapper/200:00:082
13789940,1cyclictest7751-21fschecks_count21:30:152
13789940,1cyclictest3739-21latency_hist19:15:012
13789940,1cyclictest29410-21dump-pmu-power21:10:012
13789940,1cyclictest27227-21/usr/sbin/munin20:00:132
13789940,1cyclictest24704-21/usr/sbin/munin21:00:172
13789940,1cyclictest12411-21grep00:10:132
13729944,0cyclictest0-21swapper/123:00:321
13729941,2cyclictest0-21swapper/123:55:101
13729941,2cyclictest0-21swapper/123:45:101
13729941,2cyclictest0-21swapper/123:30:121
13729941,2cyclictest0-21swapper/123:25:021
13729941,2cyclictest0-21swapper/123:20:121
13729941,2cyclictest0-21swapper/122:40:111
13729941,2cyclictest0-21swapper/122:30:121
13729941,2cyclictest0-21swapper/122:25:101
13729941,2cyclictest0-21swapper/121:50:111
13729941,2cyclictest0-21swapper/121:45:101
13729941,2cyclictest0-21swapper/120:55:101
13729941,2cyclictest0-21swapper/120:50:101
13729941,2cyclictest0-21swapper/120:15:101
13729941,2cyclictest0-21swapper/120:10:101
13729941,2cyclictest0-21swapper/119:20:091
13729941,2cyclictest0-21swapper/100:35:101
13729941,2cyclictest0-21swapper/100:25:091
13729941,2cyclictest0-21swapper/100:15:011
13729941,2cyclictest0-21swapper/100:05:111
13729941,2cyclictest0-21swapper/100:00:111
13729940,4cyclictest0-21swapper/122:49:201
13729940,4cyclictest0-21swapper/121:55:031
13729940,4cyclictest0-21swapper/100:33:561
13729940,3cyclictest0-21swapper/121:00:121
13729940,2cyclictest0-21swapper/121:25:111
13729940,0cyclictest0-21swapper/122:12:401
13719944,0cyclictest3-21ksoftirqd/021:10:010
13719944,0cyclictest3-21ksoftirqd/019:40:100
13719944,0cyclictest28693-21apt-get23:15:120
13719943,1cyclictest3-21ksoftirqd/022:55:110
13719943,1cyclictest3-21ksoftirqd/021:45:100
13719943,0cyclictest3-21ksoftirqd/021:50:110
13719943,0cyclictest3-21ksoftirqd/021:00:120
13719940,4cyclictest0-21swapper/020:40:100
13719940,1cyclictest3-21ksoftirqd/020:45:150
13719940,1cyclictest0-21swapper/021:40:120
13719940,0cyclictest81rcu_preempt20:20:110
13829931,1cyclictest17316-21date19:40:013
13829930,3cyclictest29182-21chrt21:07:153
13829930,3cyclictest26006-21ntp_states19:55:173
13829930,3cyclictest24299-21ssh00:00:133
13829930,3cyclictest23108-21hddtemp_smartct19:50:153
13829930,3cyclictest18002-21perl20:45:153
13829930,3cyclictest13021-21aten2_r5power_c22:20:103
13829930,3cyclictest0-21swapper/323:55:103
13829930,3cyclictest0-21swapper/321:35:113
13829930,3cyclictest0-21swapper/321:10:113
13829930,3cyclictest0-21swapper/320:55:103
13829930,3cyclictest0-21swapper/320:50:113
13829930,3cyclictest0-21swapper/320:40:093
13829930,3cyclictest0-21swapper/320:35:103
13829930,3cyclictest0-21swapper/320:30:123
13829930,3cyclictest0-21swapper/320:25:043
13829930,3cyclictest0-21swapper/320:20:113
13829930,3cyclictest0-21swapper/320:10:053
13829930,3cyclictest0-21swapper/320:00:123
13829930,3cyclictest0-21swapper/319:30:113
13829930,3cyclictest0-21swapper/319:25:093
13829930,2cyclictest25354-21ssh23:45:033
13829930,2cyclictest23244-21ssh22:25:083
13789933,0cyclictest0-21swapper/222:45:042
13789931,2cyclictest0-21swapper/222:25:092
13789931,1cyclictest0-21swapper/222:50:112
13789931,1cyclictest0-21swapper/220:05:112
13789931,0cyclictest515-21nscd21:10:012
13789930,3cyclictest8674-21rm21:15:122
13789930,3cyclictest7949-21tune2fs19:20:122
13789930,3cyclictest28508-21sh23:15:062
13789930,3cyclictest19875-21cut19:45:112
13789930,3cyclictest18989-21df23:10:122
13789930,3cyclictest1312-21ssh00:05:052
13789930,3cyclictest13039-21grep20:35:122
13789930,3cyclictest0-21swapper/223:35:092
13789930,3cyclictest0-21swapper/221:35:172
13789930,3cyclictest0-21swapper/220:55:112
13789930,3cyclictest0-21swapper/220:45:122
13789930,3cyclictest0-21swapper/220:25:112
13789930,3cyclictest0-21swapper/220:20:112
13789930,3cyclictest0-21swapper/220:15:112
13789930,3cyclictest0-21swapper/219:25:132
13789930,3cyclictest0-21swapper/219:15:102
13789930,3cyclictest0-21swapper/200:15:002
13789930,2cyclictest0-21swapper/221:25:112
13789930,1cyclictest3953-21ssh22:00:012
13789930,1cyclictest12056-21df_inode22:35:132
13789930,1cyclictest12056-21df_inode22:35:132
13729933,0cyclictest0-21swapper/122:50:031
13729931,2cyclictest0-21swapper/122:05:111
13729931,2cyclictest0-21swapper/121:30:131
13729931,1cyclictest0-21swapper/123:40:101
13729931,1cyclictest0-21swapper/123:35:091
13729931,1cyclictest0-21swapper/123:05:101
13729931,1cyclictest0-21swapper/122:55:121
13729931,1cyclictest0-21swapper/122:35:121
13729931,1cyclictest0-21swapper/122:35:121
13729931,1cyclictest0-21swapper/120:45:111
13729931,1cyclictest0-21swapper/120:35:111
13729931,1cyclictest0-21swapper/119:55:111
13729931,1cyclictest0-21swapper/100:10:101
13729930,2cyclictest0-21swapper/123:15:121
13729930,2cyclictest0-21swapper/122:20:101
13729930,1cyclictest0-21swapper/119:50:111
13719932,0cyclictest3-21ksoftirqd/020:30:120
13719930,1cyclictest81rcu_preempt20:55:100
13729921,1cyclictest0-21swapper/120:40:091
13729920,1cyclictest0-21swapper/120:20:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional