You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 05:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Thu Apr 09, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19812204188,12sleep10-21swapper/119:05:511
325042199183,12sleep00-21swapper/019:05:010
325122186169,12sleep30-21swapper/319:05:093
23022169152,13sleep20-21swapper/219:09:582
104082490,0sleep10-21swapper/123:37:381
110692430,0sleep10-21swapper/122:03:031
119992410,0sleep20-21swapper/200:25:392
205362370,1sleep1211ktimersoftd/123:10:311
248912110,0sleep30-21swapper/323:45:083
79952100,0sleep20-21swapper/200:24:352
247799102,4cyclictest7011-21munin-run21:30:000
181272100,0sleep10-21swapper/121:19:461
8848280,0sleep08849-21aten2_r5power_p21:15:140
24779982,3cyclictest29135-21munin-run00:35:000
24779970,3cyclictest17287-21awk21:35:000
24779960,3cyclictest27873-21perf23:15:000
24779960,3cyclictest13047-21perf19:30:000
7163250,0sleep27165-21latency_hist21:30:012
24879950,5cyclictest0-21swapper/323:09:073
24879950,5cyclictest0-21swapper/322:12:403
24879950,5cyclictest0-21swapper/322:01:353
24879950,5cyclictest0-21swapper/300:28:163
24879950,4cyclictest23522-21ssh22:25:133
24879950,4cyclictest22637-21hddtemp_smartct22:40:143
24879950,1cyclictest28965-21fschecks_count21:40:143
24879950,1cyclictest0-21swapper/323:41:593
24879950,0cyclictest0-21swapper/323:33:083
24829951,2cyclictest0-21swapper/219:50:102
24829951,2cyclictest0-21swapper/200:10:112
24829950,5cyclictest0-21swapper/223:46:112
24829950,5cyclictest0-21swapper/222:27:112
24829950,5cyclictest0-21swapper/221:51:232
24829950,5cyclictest0-21swapper/221:31:362
24829950,4cyclictest12466-21hddtemp_smartct22:35:142
24829950,4cyclictest0-21swapper/222:20:112
24829950,0cyclictest0-21swapper/200:06:592
24789951,2cyclictest0-21swapper/120:15:111
24789950,5cyclictest0-21swapper/123:29:131
24779955,0cyclictest0-21swapper/023:45:490
24779954,1cyclictest9556-21ntpq19:20:160
24779950,5cyclictest0-21swapper/022:18:060
24779950,5cyclictest0-21swapper/000:25:420
24779950,5cyclictest0-21swapper/000:04:190
24779950,5cyclictest0-21swapper/000:04:190
24779950,0cyclictest30318-21diskmemload21:11:190
24779950,0cyclictest0-21swapper/022:14:100
28757240,0sleep30-21swapper/321:24:503
24879944,0cyclictest5034-21kworker/3:020:28:583
24879944,0cyclictest0-21swapper/322:55:253
24879944,0cyclictest0-21swapper/322:07:073
24879944,0cyclictest0-21swapper/321:48:393
24879944,0cyclictest0-21swapper/300:37:433
24879944,0cyclictest0-21swapper/300:14:003
24879943,1cyclictest20684-21/usr/sbin/munin19:45:123
24879941,3cyclictest0-21swapper/300:15:103
24879940,4cyclictest0-21swapper/323:56:513
24879940,4cyclictest0-21swapper/323:35:453
24879940,4cyclictest0-21swapper/323:25:013
24879940,4cyclictest0-21swapper/323:18:373
24879940,4cyclictest0-21swapper/322:35:123
24879940,4cyclictest0-21swapper/322:24:553
24879940,4cyclictest0-21swapper/321:10:393
24879940,4cyclictest0-21swapper/321:05:103
24879940,4cyclictest0-21swapper/320:55:123
24879940,4cyclictest0-21swapper/320:45:093
24879940,4cyclictest0-21swapper/320:00:113
24879940,4cyclictest0-21swapper/319:25:113
24879940,4cyclictest0-21swapper/300:05:003
24879940,3cyclictest5598-21grep19:15:013
24879940,3cyclictest4193-21cat22:00:003
24879940,3cyclictest23083-21sed20:55:013
24879940,3cyclictest23083-21sed20:55:013
24879940,3cyclictest2268-21ssh23:01:513
24879940,3cyclictest20060-21users19:40:203
24879940,3cyclictest17835-21sh21:35:053
24879940,3cyclictest16024-21df_inode20:40:123
24879940,3cyclictest1525-21cpuspeed22:30:133
24879940,3cyclictest10103-21/usr/sbin/munin21:15:193
24879940,3cyclictest0-21swapper/321:00:103
24879940,3cyclictest0-21swapper/320:35:113
24879940,1cyclictest7879-21ssh23:20:193
24879940,1cyclictest20941-21ntp_states00:30:183
24879940,1cyclictest19043-21sh23:10:143
24879940,1cyclictest16457-21/usr/sbin/munin21:50:203
24879940,1cyclictest10878-21memory22:50:153
24829944,0cyclictest31-21ksoftirqd/219:15:012
24829944,0cyclictest0-21swapper/223:32:292
24829944,0cyclictest0-21swapper/223:02:572
24829944,0cyclictest0-21swapper/200:30:422
24829943,1cyclictest9016-21grep19:20:142
24829942,1cyclictest205-21systemd-journal22:55:002
24829942,1cyclictest18682-21ssh23:57:312
24829942,1cyclictest15349-21df22:05:112
24829942,1cyclictest0-21swapper/220:00:102
24829941,2cyclictest0-21swapper/221:55:122
24829941,1cyclictest0-21swapper/221:05:102
24829941,1cyclictest0-21swapper/220:20:112
24829940,4cyclictest0-21swapper/223:35:062
24829940,4cyclictest0-21swapper/223:25:102
24829940,4cyclictest0-21swapper/221:45:122
24829940,4cyclictest0-21swapper/221:44:322
24829940,4cyclictest0-21swapper/221:35:022
24829940,4cyclictest0-21swapper/221:20:032
24829940,4cyclictest0-21swapper/221:15:052
24829940,4cyclictest0-21swapper/220:50:102
24829940,4cyclictest0-21swapper/220:50:102
24829940,4cyclictest0-21swapper/220:25:112
24829940,4cyclictest0-21swapper/200:36:112
24829940,4cyclictest0-21swapper/200:16:402
24829940,4cyclictest0-21swapper/200:02:462
24829940,4cyclictest0-21swapper/200:02:452
24829940,3cyclictest7302-21ssh21:14:282
24829940,3cyclictest4991-21ssh23:50:272
24829940,3cyclictest28075-21ssh23:15:012
24829940,3cyclictest20258-21ssh23:10:222
24829940,3cyclictest13232-21latency_hist19:30:002
24829940,3cyclictest1-21systemd20:40:192
24789944,0cyclictest0-21swapper/122:54:441
24789944,0cyclictest0-21swapper/122:27:411
24789944,0cyclictest0-21swapper/121:00:211
24789944,0cyclictest0-21swapper/100:30:011
24789944,0cyclictest0-21swapper/100:14:111
24789941,2cyclictest0-21swapper/123:55:031
24789941,2cyclictest0-21swapper/123:05:101
24789941,2cyclictest0-21swapper/122:35:111
24789941,2cyclictest0-21swapper/120:30:101
24789941,2cyclictest0-21swapper/120:00:111
24789941,2cyclictest0-21swapper/119:40:101
24789941,2cyclictest0-21swapper/119:25:121
24789941,1cyclictest0-21swapper/123:00:141
24789941,1cyclictest0-21swapper/122:20:101
24789940,4cyclictest0-21swapper/123:51:461
24789940,4cyclictest0-21swapper/122:49:551
24789940,4cyclictest0-21swapper/122:31:361
24789940,2cyclictest0-21swapper/122:15:111
24789940,2cyclictest0-21swapper/121:35:021
24789940,0cyclictest0-21swapper/100:24:311
24779944,0cyclictest0-21swapper/023:00:090
24779944,0cyclictest0-21swapper/022:34:320
24779944,0cyclictest0-21swapper/022:08:380
24779941,3cyclictest4568-21apt22:00:110
24779941,2cyclictest16344-21sh00:12:130
24779941,2cyclictest0-21swapper/020:30:110
24779940,4cyclictest30318-21diskmemload23:53:480
24779940,4cyclictest2592-21apt-get19:10:100
24779940,4cyclictest22878-21latency_hist20:55:010
24779940,4cyclictest22878-21latency_hist20:55:010
24779940,4cyclictest22029-21perl00:15:130
24779940,4cyclictest15716-21sh22:36:380
24779940,4cyclictest11094-21sh23:06:010
24779940,4cyclictest0-21swapper/023:40:090
24779940,4cyclictest0-21swapper/023:30:110
24779940,4cyclictest0-21swapper/023:20:110
24779940,4cyclictest0-21swapper/022:55:190
24779940,4cyclictest0-21swapper/022:26:530
24779940,4cyclictest0-21swapper/021:55:110
24779940,4cyclictest0-21swapper/021:40:120
24779940,4cyclictest0-21swapper/000:35:110
24779940,3cyclictest829-21memory22:45:200
24779940,3cyclictest3806-21perl20:15:120
24779940,3cyclictest29752-21ntp_states23:15:160
24779940,3cyclictest19475-21ssh21:35:160
24779940,3cyclictest19172-21sh21:50:440
24779940,3cyclictest1587-21diskstats00:05:120
24779940,3cyclictest14279-21latency_hist23:40:010
24779940,3cyclictest13808-21perl23:55:130
24779940,3cyclictest0-21swapper/020:50:000
1718240,0sleep00-21swapper/020:10:170
14463240,0sleep30-21swapper/321:33:173
3878230,0sleep10-21swapper/121:43:571
24879933,0cyclictest0-21swapper/320:05:033
24879932,1cyclictest802-21snmpd19:50:023
24879932,1cyclictest3113-21df19:10:123
24879932,1cyclictest2764-21ssh22:15:053
24879931,2cyclictest23033-21sh00:00:043
24879931,2cyclictest23033-21sh00:00:043
24879931,1cyclictest0-21swapper/319:30:093
24879930,3cyclictest3629-21df20:15:123
24879930,3cyclictest31704-21sh22:45:033
24879930,3cyclictest25991-21tr19:55:113
24879930,3cyclictest0-21swapper/321:25:123
24879930,3cyclictest0-21swapper/320:30:023
24879930,3cyclictest0-21swapper/320:20:103
24879930,3cyclictest0-21swapper/320:10:013
24879930,3cyclictest0-21swapper/319:35:123
24879930,3cyclictest0-21swapper/319:20:103
24879930,3cyclictest0-21swapper/300:20:113
24879930,1cyclictest2547-21ssh23:50:043
24829933,0cyclictest0-21swapper/219:40:072
24829931,1cyclictest20442-21cron19:45:012
24829931,1cyclictest0-21swapper/223:40:102
24829930,3cyclictest9487-21ssh22:50:042
24829930,3cyclictest5372-21df_inode19:15:012
24829930,3cyclictest31747-21ssh22:45:052
24829930,3cyclictest26638-21sed21:00:152
24829930,3cyclictest21647-21ssh22:40:082
24829930,3cyclictest16100-21ls19:35:122
24829930,3cyclictest13639-21cstates19:30:112
24829930,3cyclictest0-21swapper/223:20:092
24829930,3cyclictest0-21swapper/223:05:022
24829930,3cyclictest0-21swapper/222:30:062
24829930,3cyclictest0-21swapper/222:15:032
24829930,3cyclictest0-21swapper/222:10:082
24829930,3cyclictest0-21swapper/222:00:072
24829930,3cyclictest0-21swapper/220:55:122
24829930,3cyclictest0-21swapper/220:45:022
24829930,3cyclictest0-21swapper/220:35:052
24829930,3cyclictest0-21swapper/220:30:092
24829930,3cyclictest0-21swapper/220:15:052
24829930,3cyclictest0-21swapper/220:10:112
24829930,3cyclictest0-21swapper/220:05:112
24829930,3cyclictest0-21swapper/219:55:112
24789933,0cyclictest0-21swapper/121:54:471
24789931,2cyclictest0-21swapper/122:05:111
24789931,1cyclictest0-21swapper/123:45:121
24789931,1cyclictest0-21swapper/123:20:121
24789931,1cyclictest0-21swapper/122:55:201
24789931,1cyclictest0-21swapper/122:40:101
24789931,1cyclictest0-21swapper/121:55:121
24789931,1cyclictest0-21swapper/121:30:111
24789931,1cyclictest0-21swapper/121:25:111
24789931,1cyclictest0-21swapper/121:10:121
24789931,1cyclictest0-21swapper/121:05:101
24789931,1cyclictest0-21swapper/120:50:111
24789931,1cyclictest0-21swapper/120:50:101
24789931,1cyclictest0-21swapper/120:45:101
24789931,1cyclictest0-21swapper/120:20:111
24789931,1cyclictest0-21swapper/120:10:101
24789931,1cyclictest0-21swapper/120:05:111
24789931,1cyclictest0-21swapper/119:50:101
24789931,1cyclictest0-21swapper/119:35:111
24789931,1cyclictest0-21swapper/119:10:101
24789931,1cyclictest0-21swapper/100:35:111
24789931,1cyclictest0-21swapper/100:25:111
24789931,1cyclictest0-21swapper/100:05:111
24789930,2cyclictest297602sleep123:30:531
24789930,2cyclictest0-21swapper/123:15:101
24789930,2cyclictest0-21swapper/119:45:101
24789930,2cyclictest0-21swapper/100:15:101
24789930,2cyclictest0-21swapper/100:00:101
24789930,2cyclictest0-21swapper/100:00:101
24789930,1cyclictest0-21swapper/123:40:091
24789930,1cyclictest0-21swapper/122:10:111
24789930,1cyclictest0-21swapper/120:35:101
24789930,1cyclictest0-21swapper/119:15:101
24779932,1cyclictest19001-21ssh21:20:020
24779931,1cyclictest15727-21apt-get19:35:120
24779931,1cyclictest0-21swapper/020:00:110
24779930,3cyclictest5798-21memory19:15:010
24779930,3cyclictest5604-21apt20:20:100
24779930,3cyclictest31910-21expr00:20:120
24779930,3cyclictest30589-21apt-get20:05:120
24779930,3cyclictest28592-21df_inode21:05:120
24779930,3cyclictest23110-21apt20:55:110
24779930,3cyclictest13168-21grep20:35:120
24779930,3cyclictest0-21swapper/023:25:110
24779930,3cyclictest0-21swapper/022:40:120
24779930,3cyclictest0-21swapper/022:20:100
24779930,3cyclictest0-21swapper/021:45:060
24779930,3cyclictest0-21swapper/021:00:100
24779930,3cyclictest0-21swapper/020:40:100
24779930,3cyclictest0-21swapper/020:25:140
24779930,3cyclictest0-21swapper/019:55:100
24779930,3cyclictest0-21swapper/019:50:000
24779930,3cyclictest0-21swapper/019:45:100
24779930,3cyclictest0-21swapper/019:40:110
24779930,3cyclictest0-21swapper/019:30:100
24779930,2cyclictest9697-21ssh22:50:100
22511230,0sleep10-21swapper/121:21:021
24789921,1cyclictest0-21swapper/120:25:131
24789920,2cyclictest0-21swapper/119:20:111
24789920,1cyclictest6070-21chrt21:45:081
24789920,1cyclictest0-21swapper/120:55:111
24789920,1cyclictest0-21swapper/120:40:111
24789920,1cyclictest0-21swapper/119:55:111
24789920,1cyclictest0-21swapper/119:30:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional