You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 06:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Dec 19, 2025 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113382242226,11sleep10-21swapper/119:08:511
114122190157,28sleep30-21swapper/319:09:483
113072188171,12sleep00-21swapper/019:08:250
111662166148,13sleep20-21swapper/219:06:382
116109971,2cyclictest31-21ksoftirqd/222:50:182
116109971,1cyclictest31-21ksoftirqd/200:30:122
116109970,2cyclictest0-21swapper/223:10:142
116109965,0cyclictest31-21ksoftirqd/222:15:142
116109961,2cyclictest31-21ksoftirqd/223:50:022
116109961,2cyclictest31-21ksoftirqd/223:35:212
116109961,2cyclictest31-21ksoftirqd/223:31:132
116109961,2cyclictest31-21ksoftirqd/200:05:192
116109961,2cyclictest0-21swapper/221:30:142
116109961,1cyclictest31-21ksoftirqd/222:05:132
116109961,1cyclictest31-21ksoftirqd/200:10:192
116109961,1cyclictest0-21swapper/219:50:142
116109961,0cyclictest0-21swapper/221:15:162
116109961,0cyclictest0-21swapper/200:25:182
116109960,1cyclictest0-21swapper/223:45:012
116109960,1cyclictest0-21swapper/222:20:142
116109960,1cyclictest0-21swapper/222:00:132
116109960,1cyclictest0-21swapper/200:20:122
116049961,3cyclictest0-21swapper/120:35:131
116009962,4cyclictest22572-21apt-get23:50:010
116009960,3cyclictest27531-21sendmail-msp19:40:000
116149955,0cyclictest27304-21kworker/3:123:05:433
116149955,0cyclictest27304-21kworker/3:100:24:043
116149955,0cyclictest27304-21kworker/3:100:12:533
116149955,0cyclictest26175-21kworker/3:219:10:373
116149955,0cyclictest14169-21kworker/3:022:20:553
116149955,0cyclictest14169-21kworker/3:021:47:233
116149955,0cyclictest14169-21kworker/3:020:06:353
116149954,1cyclictest1445-21tr20:55:183
116149950,4cyclictest2450-21apt-get22:05:143
116149950,0cyclictest0-21swapper/321:55:133
116109953,2cyclictest25479-21apt-get23:55:112
116109953,1cyclictest30172-21sshd20:50:142
116109952,2cyclictest5166-21apt-get21:05:132
116109952,1cyclictest31-21ksoftirqd/220:20:132
116109952,1cyclictest31-21ksoftirqd/220:20:132
116109952,0cyclictest31-21ksoftirqd/221:10:162
116109951,3cyclictest17800-21apt-get20:25:112
116109951,2cyclictest31-21ksoftirqd/223:00:202
116109951,2cyclictest31-21ksoftirqd/221:45:192
116109951,2cyclictest31-21ksoftirqd/221:25:132
116109951,2cyclictest31-21ksoftirqd/220:30:222
116109951,2cyclictest31-21ksoftirqd/219:45:112
116109951,2cyclictest11718-21apt-get19:10:122
116109951,2cyclictest0-21swapper/220:55:172
116109951,1cyclictest31-21ksoftirqd/223:40:112
116109951,1cyclictest31-21ksoftirqd/222:35:142
116109951,1cyclictest31-21ksoftirqd/221:40:142
116109951,1cyclictest31-21ksoftirqd/219:35:132
116109951,1cyclictest31-21ksoftirqd/219:25:142
116109951,1cyclictest31-21ksoftirqd/200:35:152
116109951,1cyclictest0-21swapper/220:40:192
116109951,1cyclictest0-21swapper/220:00:192
116109951,1cyclictest0-21swapper/219:30:182
116109950,2cyclictest31-21ksoftirqd/221:35:172
116109950,2cyclictest0-21swapper/222:10:132
116109950,2cyclictest0-21swapper/220:05:152
116109950,1cyclictest31-21ksoftirqd/222:30:222
116109950,1cyclictest0-21swapper/222:45:122
116109950,1cyclictest0-21swapper/221:20:132
116109950,1cyclictest0-21swapper/221:00:132
116109950,1cyclictest0-21swapper/219:15:112
116109950,0cyclictest0-21swapper/223:20:142
116109950,0cyclictest0-21swapper/220:15:142
116049951,3cyclictest0-21swapper/119:25:111
116049951,2cyclictest0-21swapper/123:45:111
116049951,2cyclictest0-21swapper/121:15:131
116049951,2cyclictest0-21swapper/120:30:121
116049951,2cyclictest0-21swapper/119:50:131
116049951,2cyclictest0-21swapper/119:30:101
116049951,2cyclictest0-21swapper/100:35:111
116049951,2cyclictest0-21swapper/100:15:121
116049951,2cyclictest0-21swapper/100:10:131
116049950,5cyclictest0-21swapper/122:24:571
116009954,1cyclictest31400-21/usr/sbin/munin21:55:190
116009951,3cyclictest774-21snmpd22:45:020
116009951,3cyclictest0-21swapper/020:05:120
116149944,0cyclictest40-21ksoftirqd/321:25:013
116149944,0cyclictest14169-21kworker/3:022:32:073
116149944,0cyclictest14169-21kworker/3:021:02:343
116149944,0cyclictest14169-21kworker/3:019:32:593
116149944,0cyclictest0-21swapper/300:05:283
116149943,1cyclictest20425-21cpuspeed_turbos19:25:133
116149942,1cyclictest774-21snmpd20:30:213
116149942,1cyclictest10980-21fschecks_count20:10:143
116149942,1cyclictest0-21swapper/322:15:113
116149941,2cyclictest0-21swapper/322:40:123
116149941,2cyclictest0-21swapper/322:25:133
116149941,2cyclictest0-21swapper/321:35:133
116149940,4cyclictest0-21swapper/323:45:023
116149940,4cyclictest0-21swapper/323:40:123
116149940,4cyclictest0-21swapper/323:35:123
116149940,4cyclictest0-21swapper/322:50:123
116149940,4cyclictest0-21swapper/322:12:503
116149940,4cyclictest0-21swapper/321:40:133
116149940,4cyclictest0-21swapper/321:05:143
116149940,4cyclictest0-21swapper/320:50:133
116149940,3cyclictest26826-21/usr/sbin/munin20:40:203
116149940,3cyclictest22734-21/usr/sbin/munin20:35:203
116149940,3cyclictest16850-21python20:20:203
116149940,3cyclictest16850-21python20:20:203
116149940,1cyclictest5035-21latency_hist23:15:003
116149940,1cyclictest0-21swapper/300:00:133
116149940,0cyclictest0-21swapper/323:50:013
116109942,1cyclictest0-21swapper/219:55:122
116109941,1cyclictest31-21ksoftirqd/222:55:142
116109941,1cyclictest31-21ksoftirqd/220:10:012
116109941,1cyclictest31-21ksoftirqd/219:40:182
116109941,1cyclictest28176-21cstates20:45:122
116109940,4cyclictest27445-21apt-get21:50:132
116109940,4cyclictest0-21swapper/223:25:112
116109940,4cyclictest0-21swapper/223:05:122
116109940,3cyclictest6072-21tail23:15:142
116109940,3cyclictest27976-21apt-get00:00:132
116109940,2cyclictest0-21swapper/222:40:122
116109940,1cyclictest31-21ksoftirqd/222:25:122
116109940,1cyclictest0-21swapper/221:55:122
116109940,1cyclictest0-21swapper/220:35:032
116109940,1cyclictest0-21swapper/200:15:122
116109940,0cyclictest81rcu_preempt19:20:012
116049944,0cyclictest0-21swapper/122:15:221
116049941,2cyclictest0-21swapper/123:40:131
116049941,2cyclictest0-21swapper/122:50:121
116049941,2cyclictest0-21swapper/121:55:121
116049941,2cyclictest0-21swapper/121:50:121
116049941,2cyclictest0-21swapper/121:40:131
116049941,2cyclictest0-21swapper/121:20:131
116049941,2cyclictest0-21swapper/120:40:131
116049941,2cyclictest0-21swapper/120:20:141
116049941,2cyclictest0-21swapper/120:20:131
116049941,2cyclictest0-21swapper/100:30:111
116049941,1cyclictest0-21swapper/123:10:131
116049941,1cyclictest0-21swapper/123:00:121
116049940,2cyclictest0-21swapper/123:55:111
116049940,2cyclictest0-21swapper/119:40:111
116009943,1cyclictest22782-21/usr/sbin/munin19:30:110
116009943,1cyclictest10228-21/usr/sbin/munin23:25:140
116009941,2cyclictest0-21swapper/020:15:120
116009940,4cyclictest30287-21/usr/sbin/munin23:00:180
116009940,4cyclictest19894-21munin-run19:25:010
116009940,4cyclictest17846-21grep23:40:120
116009940,4cyclictest10344-21apt-get20:10:010
116009940,4cyclictest0-21swapper/022:15:110
116009940,3cyclictest9833-21apt-get22:20:010
116009940,3cyclictest7456-21latency_hist20:05:000
116009940,3cyclictest2952-21/usr/sbin/munin00:15:130
116009940,3cyclictest28469-21perl22:55:150
116009940,3cyclictest25645-21fschecks_time21:45:140
116009940,3cyclictest21106-21hddtemp_smartct20:30:150
116009940,3cyclictest18401-21cut20:25:140
116009940,3cyclictest15881-21grep23:35:140
116009940,3cyclictest15355-21apt-config00:40:000
116009940,3cyclictest14212-21irqstats19:15:000
116009940,3cyclictest12628-21latency_hist00:35:000
116009940,3cyclictest0-21swapper/019:10:120
116009940,1cyclictest7634-21/usr/sbin/munin21:10:210
116009940,1cyclictest32632-21/usr/sbin/munin20:55:150
116009940,1cyclictest27973-21/usr/sbin/munin00:00:220
116009940,1cyclictest25224-21/usr/sbin/munin20:40:130
116009940,1cyclictest13338-21grep21:20:160
116009940,1cyclictest10104-21/usr/sbin/munin21:15:130
116149932,1cyclictest8729-21cut00:25:143
116149932,1cyclictest774-21snmpd22:35:073
116149931,2cyclictest0-21swapper/323:30:113
116149930,3cyclictest14954-21dpkg19:15:103
116149930,3cyclictest13015-21grep00:35:123
116149930,3cyclictest11858-21tr00:30:203
116149930,3cyclictest0-21swapper/323:55:113
116149930,3cyclictest0-21swapper/323:25:123
116149930,3cyclictest0-21swapper/323:20:133
116149930,3cyclictest0-21swapper/323:15:113
116149930,3cyclictest0-21swapper/323:00:123
116149930,3cyclictest0-21swapper/322:55:133
116149930,3cyclictest0-21swapper/322:00:113
116149930,3cyclictest0-21swapper/321:50:013
116149930,3cyclictest0-21swapper/321:30:123
116149930,3cyclictest0-21swapper/321:25:043
116149930,3cyclictest0-21swapper/321:15:113
116149930,3cyclictest0-21swapper/321:10:133
116149930,3cyclictest0-21swapper/320:45:123
116149930,3cyclictest0-21swapper/320:25:123
116149930,3cyclictest0-21swapper/320:15:123
116149930,3cyclictest0-21swapper/320:00:113
116149930,3cyclictest0-21swapper/319:55:123
116149930,3cyclictest0-21swapper/319:50:133
116149930,3cyclictest0-21swapper/319:45:123
116149930,3cyclictest0-21swapper/319:40:113
116149930,3cyclictest0-21swapper/319:35:043
116149930,3cyclictest0-21swapper/319:20:093
116149930,3cyclictest0-21swapper/300:15:123
116149930,0cyclictest0-21swapper/322:45:443
116049931,2cyclictest0-21swapper/122:05:121
116049931,2cyclictest0-21swapper/121:45:121
116049931,2cyclictest0-21swapper/120:00:121
116049931,2cyclictest0-21swapper/119:55:121
116049931,2cyclictest0-21swapper/100:05:151
116049931,1cyclictest0-21swapper/123:50:011
116049931,1cyclictest0-21swapper/123:30:111
116049931,1cyclictest0-21swapper/123:15:121
116049931,1cyclictest0-21swapper/122:45:011
116049931,1cyclictest0-21swapper/122:35:131
116049931,1cyclictest0-21swapper/122:30:131
116049931,1cyclictest0-21swapper/122:25:121
116049931,1cyclictest0-21swapper/121:10:131
116049931,1cyclictest0-21swapper/121:00:121
116049931,1cyclictest0-21swapper/120:55:131
116049931,1cyclictest0-21swapper/120:50:131
116049931,1cyclictest0-21swapper/120:45:111
116049931,1cyclictest0-21swapper/120:25:111
116049931,1cyclictest0-21swapper/120:15:121
116049931,1cyclictest0-21swapper/120:10:011
116049931,1cyclictest0-21swapper/119:35:121
116049931,1cyclictest0-21swapper/119:20:011
116049931,1cyclictest0-21swapper/119:15:111
116049931,1cyclictest0-21swapper/100:00:141
116049930,2cyclictest0-21swapper/123:25:111
116049930,2cyclictest0-21swapper/123:20:131
116049930,2cyclictest0-21swapper/122:55:141
116049930,2cyclictest0-21swapper/122:00:111
116049930,2cyclictest0-21swapper/121:35:141
116049930,2cyclictest0-21swapper/121:05:131
116049930,2cyclictest0-21swapper/120:05:121
116009932,1cyclictest5124-21cpuspeed22:10:130
116009932,1cyclictest279872sleep021:50:140
116009932,1cyclictest22539-21cut21:40:140
116009932,1cyclictest15755-21df_inode22:30:140
116009932,0cyclictest5269-21apt-get23:15:110
116009931,1cyclictest774-21snmpd23:55:010
116009931,1cyclictest448-21/usr/sbin/munin00:10:130
116009931,1cyclictest0-21swapper/022:50:120
116009931,1cyclictest0-21swapper/020:50:130
116009931,1cyclictest0-21swapper/019:40:110
116009931,1cyclictest0-21swapper/000:20:120
116009931,1cyclictest0-21swapper/000:05:160
116009930,3cyclictest30219-21apt-get19:45:120
116009930,3cyclictest2973-21tr19:55:130
116009930,3cyclictest17865-21cut21:30:130
116009930,3cyclictest0-21swapper/023:50:010
116009930,3cyclictest0-21swapper/023:20:010
116009930,3cyclictest0-21swapper/023:10:130
116009930,3cyclictest0-21swapper/023:05:130
116009930,3cyclictest0-21swapper/022:40:120
116009930,3cyclictest0-21swapper/022:35:140
116009930,3cyclictest0-21swapper/022:25:130
116009930,3cyclictest0-21swapper/022:05:120
116009930,3cyclictest0-21swapper/022:00:120
116009930,3cyclictest0-21swapper/021:35:040
116009930,3cyclictest0-21swapper/021:25:130
116009930,3cyclictest0-21swapper/021:05:140
116009930,3cyclictest0-21swapper/021:01:050
116009930,3cyclictest0-21swapper/020:45:120
116009930,3cyclictest0-21swapper/020:35:080
116009930,3cyclictest0-21swapper/020:20:140
116009930,3cyclictest0-21swapper/020:20:130
116009930,3cyclictest0-21swapper/019:50:110
116009930,3cyclictest0-21swapper/019:25:050
116009930,3cyclictest0-21swapper/000:25:110
116009930,0cyclictest0-21swapper/023:30:130
116049921,1cyclictest0-21swapper/123:35:121
116049921,1cyclictest0-21swapper/121:25:131
116049921,1cyclictest0-21swapper/119:10:131
116049921,1cyclictest0-21swapper/100:20:131
116049920,2cyclictest0-21swapper/122:10:121
116049920,1cyclictest20182-21chrt22:40:111
116049920,1cyclictest0-21swapper/121:30:121
116049920,1cyclictest0-21swapper/119:45:111
116049920,1cyclictest0-21swapper/100:25:101
116049920,0cyclictest0-21swapper/123:05:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional