You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 04:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Fri Jan 09, 2026 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
183512234219,10sleep10-21swapper/119:05:421
186842192176,11sleep30-21swapper/319:09:583
184342191174,12sleep00-21swapper/019:06:450
186812183167,12sleep20-21swapper/219:09:572
120732450,0sleep30-21swapper/323:28:393
278152420,0sleep10-21swapper/122:49:131
188032420,0sleep10-21swapper/122:45:011
269252390,0sleep00-21swapper/020:30:000
23102380,0sleep10-21swapper/123:55:141
291442100,0sleep30-21swapper/321:16:153
19222100,0sleep30-21swapper/322:36:053
4114290,0sleep20-21swapper/223:09:082
22838280,0sleep00-21swapper/021:13:510
188889970,7cyclictest0-21swapper/323:20:093
188849964,0cyclictest31-21ksoftirqd/221:10:102
188849960,6cyclictest8323-21ntp_states20:55:162
188849960,5cyclictest0-21swapper/220:40:112
188849960,1cyclictest31-21ksoftirqd/222:35:112
188789961,3cyclictest0-21swapper/120:40:101
188789961,3cyclictest0-21swapper/119:40:101
18182260,1sleep00-21swapper/000:35:100
28201250,0sleep30-21swapper/322:49:273
188889951,2cyclictest0-21swapper/320:20:103
188889950,5cyclictest14256-21diskmemload22:20:133
188889950,5cyclictest0-21swapper/321:55:373
188889950,4cyclictest0-21swapper/323:00:103
188849955,0cyclictest0-21swapper/223:03:282
188849954,1cyclictest31-21ksoftirqd/222:05:142
188849954,1cyclictest31-21ksoftirqd/219:35:112
188849951,2cyclictest0-21swapper/219:55:102
188849950,5cyclictest19351-21ssh21:58:122
188849950,5cyclictest0-21swapper/221:26:252
188849950,4cyclictest0-21swapper/223:15:112
188849950,0cyclictest0-21swapper/222:41:552
188789951,2cyclictest0-21swapper/123:25:111
188789951,2cyclictest0-21swapper/121:00:101
188789950,0cyclictest0-21swapper/123:30:111
188749955,0cyclictest1044-21kworker/0:023:02:150
188749955,0cyclictest1044-21kworker/0:022:39:550
188749955,0cyclictest1044-21kworker/0:022:28:410
188749955,0cyclictest1044-21kworker/0:022:06:170
188749955,0cyclictest1044-21kworker/0:020:59:060
188749955,0cyclictest1044-21kworker/0:000:09:260
188749953,1cyclictest2986-21ssh23:40:120
188749950,5cyclictest14256-21diskmemload23:05:120
188749950,0cyclictest0-21swapper/023:52:360
188889944,0cyclictest0-21swapper/319:25:183
188889943,1cyclictest7535-21latency_hist00:30:003
188889943,1cyclictest16240-21grep21:10:163
188889942,1cyclictest30410-21ssh21:47:533
188889941,3cyclictest728-21snmpd19:42:413
188889941,3cyclictest30645-21cat22:50:153
188889941,3cyclictest23508-21cron21:45:013
188889941,2cyclictest0-21swapper/323:35:113
188889941,2cyclictest0-21swapper/320:50:113
188889941,2cyclictest0-21swapper/320:05:113
188889941,2cyclictest0-21swapper/319:35:113
188889941,1cyclictest0-21swapper/321:00:103
188889941,1cyclictest0-21swapper/319:30:103
188889940,4cyclictest32001-21apt-get00:10:133
188889940,4cyclictest2977-21apt-get23:40:123
188889940,4cyclictest28266-21sh21:31:063
188889940,4cyclictest23443-21apt-get23:50:113
188889940,4cyclictest10352-21diskmemload21:38:323
188889940,4cyclictest0-21swapper/323:55:113
188889940,4cyclictest0-21swapper/323:30:113
188889940,4cyclictest0-21swapper/323:13:293
188889940,4cyclictest0-21swapper/322:40:113
188889940,4cyclictest0-21swapper/322:15:123
188889940,4cyclictest0-21swapper/321:50:133
188889940,4cyclictest0-21swapper/321:26:213
188889940,4cyclictest0-21swapper/321:20:123
188889940,4cyclictest0-21swapper/320:55:103
188889940,4cyclictest0-21swapper/320:45:233
188889940,4cyclictest0-21swapper/320:10:113
188889940,4cyclictest0-21swapper/319:10:103
188889940,4cyclictest0-21swapper/300:30:113
188889940,4cyclictest0-21swapper/300:09:003
188889940,3cyclictest30471-21cat22:35:003
188889940,3cyclictest30284-21perl20:35:133
188889940,3cyclictest29424-21memory23:05:153
188889940,3cyclictest22739-21diskstats19:15:133
188889940,3cyclictest22131-21cat20:20:013
188889940,3cyclictest18219-21ssh00:35:093
188889940,3cyclictest14256-21diskmemload00:15:013
188889940,3cyclictest13199-21ssh23:45:113
188889940,3cyclictest11290-21/usr/sbin/munin22:10:193
188849944,0cyclictest0-21swapper/223:46:392
188849944,0cyclictest0-21swapper/223:22:052
188849943,1cyclictest5734-21head21:20:212
188849943,1cyclictest31-21ksoftirqd/223:55:112
188849943,1cyclictest31-21ksoftirqd/220:45:122
188849942,1cyclictest25230-21diskstats19:20:122
188849941,3cyclictest0-21swapper/200:15:172
188849941,2cyclictest0-21swapper/200:10:122
188849940,4cyclictest0-21swapper/223:35:012
188849940,4cyclictest0-21swapper/223:29:572
188849940,4cyclictest0-21swapper/223:10:102
188849940,4cyclictest0-21swapper/222:50:122
188849940,4cyclictest0-21swapper/222:29:422
188849940,4cyclictest0-21swapper/222:00:112
188849940,4cyclictest0-21swapper/221:40:012
188849940,4cyclictest0-21swapper/221:30:122
188849940,4cyclictest0-21swapper/221:15:442
188849940,4cyclictest0-21swapper/200:05:102
188849940,3cyclictest6633-21ssh21:36:172
188849940,3cyclictest32670-21expr22:20:132
188849940,3cyclictest30483-21latency_hist22:35:012
188849940,3cyclictest23447-21ssh23:50:112
188849940,3cyclictest0-21swapper/222:15:122
188849940,2cyclictest31-21ksoftirqd/222:10:102
188849940,1cyclictest8045-21/usr/sbin/munin00:30:122
188849940,1cyclictest7312-21/usr/sbin/munin19:50:202
188849940,1cyclictest4845-21/usr/sbin/munin19:45:192
188849940,1cyclictest21326-21munin-node19:15:012
188849940,1cyclictest11501-21/usr/sbin/munin00:00:122
188849940,1cyclictest0-21swapper/222:55:102
188849940,0cyclictest81rcu_preempt19:15:122
188849940,0cyclictest0-21swapper/200:25:142
188789944,0cyclictest0-21swapper/123:47:561
188789944,0cyclictest0-21swapper/123:43:171
188789944,0cyclictest0-21swapper/122:57:531
188789944,0cyclictest0-21swapper/121:50:041
188789944,0cyclictest0-21swapper/121:41:301
188789944,0cyclictest0-21swapper/121:16:011
188789944,0cyclictest0-21swapper/119:20:471
188789941,2cyclictest0-21swapper/123:50:101
188789941,2cyclictest0-21swapper/122:50:111
188789941,2cyclictest0-21swapper/122:35:021
188789941,2cyclictest0-21swapper/122:25:121
188789941,2cyclictest0-21swapper/122:20:111
188789941,2cyclictest0-21swapper/121:35:131
188789941,2cyclictest0-21swapper/121:10:101
188789941,2cyclictest0-21swapper/121:05:111
188789941,2cyclictest0-21swapper/120:45:121
188789941,2cyclictest0-21swapper/120:10:101
188789941,2cyclictest0-21swapper/119:30:101
188789941,2cyclictest0-21swapper/100:00:111
188789941,1cyclictest0-21swapper/123:20:081
188789941,1cyclictest0-21swapper/121:30:121
188789941,1cyclictest0-21swapper/100:05:111
188789940,4cyclictest0-21swapper/122:04:291
188789940,2cyclictest0-21swapper/120:00:091
188789940,2cyclictest0-21swapper/100:25:101
188789940,1cyclictest0-21swapper/100:10:131
188749944,0cyclictest1044-21kworker/0:023:35:500
188749944,0cyclictest1044-21kworker/0:020:47:540
188749944,0cyclictest1044-21kworker/0:020:36:420
188749944,0cyclictest0-21swapper/021:50:230
188749943,1cyclictest25251-21uniq19:20:130
188749943,1cyclictest12043-21munin-run20:00:010
188749943,1cyclictest10904-21tr21:00:170
188749941,3cyclictest28002-21ssh22:02:060
188749940,4cyclictest6794-21ssh22:54:530
188749940,4cyclictest32004-21ssh00:10:130
188749940,4cyclictest24426-21munin-run20:24:590
188749940,4cyclictest14176-21apt-get21:25:110
188749940,4cyclictest0-21swapper/023:45:570
188749940,4cyclictest0-21swapper/023:25:120
188749940,4cyclictest0-21swapper/023:10:110
188749940,4cyclictest0-21swapper/022:45:130
188749940,4cyclictest0-21swapper/022:30:110
188749940,4cyclictest0-21swapper/022:20:120
188749940,4cyclictest0-21swapper/021:40:020
188749940,4cyclictest0-21swapper/021:35:130
188749940,4cyclictest0-21swapper/021:30:020
188749940,4cyclictest0-21swapper/021:20:110
188749940,4cyclictest0-21swapper/021:15:100
188749940,4cyclictest0-21swapper/000:15:120
188749940,4cyclictest0-21swapper/000:00:100
188749940,3cyclictest8403-21memory19:50:160
188749940,3cyclictest32278-21ssh23:22:290
188749940,3cyclictest32083-21latency_hist19:35:010
188749940,3cyclictest30217-21ssh00:25:110
188749940,3cyclictest25286-21seq22:16:140
188749940,3cyclictest21487-21hddtemp_smartct19:15:010
188749940,3cyclictest19447-21ssh23:31:510
188749940,3cyclictest16139-21ssh23:15:020
188749940,3cyclictest15645-21ssh00:33:430
188749940,3cyclictest0-21swapper/022:55:090
188749940,3cyclictest0-21swapper/021:55:110
188749940,3cyclictest0-21swapper/021:45:120
692230,2sleep314256-21diskmemload22:05:043
188889932,0cyclictest0-21swapper/319:50:113
188889930,3cyclictest8947-21ssh22:55:163
188889930,3cyclictest14256-21diskmemload00:20:043
188889930,3cyclictest11361-21ssh00:00:053
188889930,3cyclictest10617-21hddtemp_smartct19:55:133
188889930,3cyclictest0-21swapper/323:15:053
188889930,3cyclictest0-21swapper/322:25:083
188889930,3cyclictest0-21swapper/322:00:063
188889930,3cyclictest0-21swapper/321:05:113
188889930,3cyclictest0-21swapper/320:40:113
188889930,3cyclictest0-21swapper/320:30:113
188889930,3cyclictest0-21swapper/320:25:093
188889930,3cyclictest0-21swapper/320:00:093
188889930,3cyclictest0-21swapper/319:45:113
188889930,3cyclictest0-21swapper/319:20:103
188849933,0cyclictest0-21swapper/220:00:082
188849932,1cyclictest31-21ksoftirqd/219:30:092
188849931,2cyclictest19057-21sh22:45:032
188849931,1cyclictest0-21swapper/220:25:102
188849930,3cyclictest5109-21df20:50:122
188849930,3cyclictest3645-21ntp_states19:40:162
188849930,3cyclictest2759-21ssh23:40:042
188849930,3cyclictest27356-21apt-get19:25:012
188849930,3cyclictest27114-21/usr/sbin/munin20:30:112
188849930,3cyclictest17735-21df_inode20:10:122
188849930,3cyclictest0-21swapper/223:30:072
188849930,3cyclictest0-21swapper/221:50:122
188849930,3cyclictest0-21swapper/221:45:062
188849930,3cyclictest0-21swapper/221:05:112
188849930,3cyclictest0-21swapper/221:00:102
188849930,3cyclictest0-21swapper/220:35:102
188849930,3cyclictest0-21swapper/220:20:102
188849930,3cyclictest0-21swapper/220:05:112
188849930,3cyclictest0-21swapper/200:35:102
188849930,1cyclictest19766-21ssh00:20:042
188849930,1cyclictest0-21swapper/220:15:122
188789933,0cyclictest0-21swapper/123:14:201
188789933,0cyclictest0-21swapper/119:12:211
188789932,1cyclictest0-21swapper/120:05:101
188789931,2cyclictest0-21swapper/123:15:121
188789931,2cyclictest0-21swapper/100:20:091
188789931,1cyclictest0-21swapper/123:35:121
188789931,1cyclictest0-21swapper/123:00:111
188789931,1cyclictest0-21swapper/122:30:121
188789931,1cyclictest0-21swapper/122:15:121
188789931,1cyclictest0-21swapper/122:05:121
188789931,1cyclictest0-21swapper/121:20:121
188789931,1cyclictest0-21swapper/120:55:101
188789931,1cyclictest0-21swapper/120:35:111
188789931,1cyclictest0-21swapper/120:30:001
188789931,1cyclictest0-21swapper/120:15:121
188789931,1cyclictest0-21swapper/119:35:101
188789931,1cyclictest0-21swapper/119:25:021
188789931,1cyclictest0-21swapper/119:15:121
188789931,1cyclictest0-21swapper/100:30:121
188789931,1cyclictest0-21swapper/100:15:131
188789930,2cyclictest0-21swapper/120:30:111
188789930,2cyclictest0-21swapper/119:55:101
188789930,2cyclictest0-21swapper/119:50:121
188789930,2cyclictest0-21swapper/100:35:101
188749932,1cyclictest9834-21sed22:40:140
188749930,3cyclictest4912-21grep20:50:110
188749930,3cyclictest20954-21ntp_states20:15:170
188749930,3cyclictest19070-21cut19:10:100
188749930,3cyclictest15110-21expr20:05:120
188749930,3cyclictest11142-21ssh22:10:050
188749930,3cyclictest0-21swapper/021:05:120
188749930,3cyclictest0-21swapper/020:43:500
188749930,3cyclictest0-21swapper/020:30:110
188749930,3cyclictest0-21swapper/020:00:090
188749930,3cyclictest0-21swapper/019:45:100
188749930,3cyclictest0-21swapper/019:40:110
188749930,3cyclictest0-21swapper/019:35:050
188749930,3cyclictest0-21swapper/019:25:110
188749930,3cyclictest0-21swapper/000:20:100
188749930,2cyclictest1129-21ssh23:55:060
188749930,1cyclictest0-21swapper/020:10:100
188789920,1cyclictest0-21swapper/123:05:121
188789920,1cyclictest0-21swapper/122:10:121
188789920,1cyclictest0-21swapper/121:55:031
188789920,1cyclictest0-21swapper/121:45:091
188789920,1cyclictest0-21swapper/121:25:121
188789920,1cyclictest0-21swapper/120:50:111
188789920,1cyclictest0-21swapper/120:20:111
188789920,1cyclictest0-21swapper/119:45:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional