You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 09:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Mon Aug 17, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
118992205190,11sleep10-21swapper/119:08:441
119342203185,13sleep00-21swapper/019:09:110
116752177161,11sleep30-21swapper/319:05:503
11704210480,19sleep20-21swapper/219:06:122
285382450,0sleep00-21swapper/000:03:110
180092450,0sleep00-21swapper/000:30:220
123482450,0sleep00-21swapper/000:27:540
105942450,0sleep10-21swapper/100:26:461
233012430,0sleep20-21swapper/221:33:372
120942370,0sleep10-21swapper/123:38:341
194192170,0sleep20-21swapper/223:09:412
215032130,0sleep00-21swapper/023:26:280
306282110,0sleep30-21swapper/300:37:013
1220199113,2cyclictest3972-21perl22:45:153
273222100,0sleep00-21swapper/022:56:380
1220199103,4cyclictest12440-21ssh21:44:403
122019997,1cyclictest10732-21apt-get20:10:123
122019996,2cyclictest18016-21apt-get19:20:133
122019994,4cyclictest22064-21apt-get00:00:133
122019994,4cyclictest16226-21df_inode20:20:143
122019994,2cyclictest2255-21ntp_states20:55:193
122019994,1cyclictest9273-21apt-get00:10:123
122019993,4cyclictest8578-21cut20:05:143
122019993,4cyclictest28996-21ntp_states23:30:213
122019993,4cyclictest1863-21irqstats23:00:183
122019993,2cyclictest8188-21diskmemload23:58:233
122019993,2cyclictest8188-21diskmemload22:28:263
122019993,2cyclictest25149-21users20:35:213
121939990,8cyclictest31810-21ssh23:15:202
121939990,1cyclictest29815-21munin-run23:15:002
122019986,2cyclictest30210-21munin-run22:10:013
122019985,2cyclictest27919-21munin-run22:25:003
122019984,4cyclictest11680-21perl22:00:153
122019984,3cyclictest13821-21df_inode22:50:133
122019983,5cyclictest802-21snmpd21:02:563
122019983,4cyclictest8188-21diskmemload21:22:163
122019983,3cyclictest8188-21diskmemload23:15:083
122019983,3cyclictest8188-21diskmemload22:55:023
122019983,3cyclictest8188-21diskmemload22:13:583
122019983,3cyclictest8188-21diskmemload21:15:483
122019983,3cyclictest7075-21hddtemp_smartct21:25:183
122019983,3cyclictest330-21hddtemp_smartct00:05:163
122019983,3cyclictest32456-21python20:50:193
122019983,3cyclictest24050-21rm21:50:153
122019983,3cyclictest17352-21sed21:30:193
122019983,3cyclictest15518-21/usr/sbin/munin19:15:103
122019983,2cyclictest8188-21diskmemload23:28:273
122019983,2cyclictest8188-21diskmemload23:05:173
122019983,2cyclictest8188-21diskmemload22:35:323
122019983,2cyclictest8188-21diskmemload21:58:523
122019983,2cyclictest8188-21diskmemload00:26:123
122019983,2cyclictest30020-21if_eth400:20:173
122019983,2cyclictest27651-21ssh23:13:373
122019983,2cyclictest27445-21ntp_states21:35:183
122019983,2cyclictest14954-21cut23:40:113
122019983,1cyclictest8188-21diskmemload00:15:183
122019982,4cyclictest8188-21diskmemload23:22:173
122019982,4cyclictest5698-21ssh23:51:103
122019982,3cyclictest28581-21cat19:40:143
122019982,3cyclictest13636-21rm23:39:333
122019982,2cyclictest8188-21diskmemload00:32:323
122019982,1cyclictest10826-21rm21:10:243
121939981,6cyclictest2905-21ssh22:45:022
121939981,1cyclictest4483-21cat21:40:142
121939981,1cyclictest25539-21sh20:40:002
121939980,7cyclictest26013-21cut00:35:132
121939980,7cyclictest17593-21/usr/sbin/munin00:30:192
121939980,1cyclictest977-21/usr/sbin/munin20:55:182
121939980,1cyclictest879-21apt-get21:55:112
121939980,1cyclictest8397-21users00:25:212
121939980,1cyclictest5811-21cat21:25:012
121939980,1cyclictest4068-21sh22:29:102
121939980,1cyclictest350-21apt19:50:002
121939980,1cyclictest32615-21munin-run23:00:002
121939980,1cyclictest30227-21chrt20:46:372
121939980,1cyclictest27893-21sendmail-msp19:40:002
121939980,1cyclictest24239-21idleruntime-cro23:45:012
121939980,1cyclictest21521-21latency_hist00:00:002
121939980,1cyclictest20332-21ls22:05:012
121939980,1cyclictest20276-21memory00:15:172
121939980,1cyclictest18566-21perf00:15:012
121939980,1cyclictest17165-21awk23:25:002
121939980,1cyclictest15584-21ssh21:30:012
121939980,1cyclictest15313-21awk22:35:002
121939980,1cyclictest14669-21ntp_states22:50:182
121939980,1cyclictest14524-21munin-run19:15:002
121939980,1cyclictest0-21swapper/222:24:562
121939980,1cyclictest0-21swapper/221:20:022
121939980,0cyclictest7501-21ssh22:14:472
122019976,1cyclictest5948-21apt-get21:05:133
122019975,2cyclictest25797-21apt-get20:40:123
122019975,2cyclictest12288-21apt-get19:10:143
122019975,1cyclictest5949-21apt-get22:30:133
122019974,2cyclictest6427-21hddtemp_smartct20:00:163
122019974,2cyclictest25693-21sh22:40:103
122019974,2cyclictest24883-21apt23:45:103
122019974,2cyclictest18212-21basename20:25:123
122019974,2cyclictest13206-21apt-get20:15:123
122019974,2cyclictest0-21swapper/320:30:133
122019972,3cyclictest14093-21diskstats21:45:143
122019972,3cyclictest14093-21diskstats21:45:143
122019972,2cyclictest17298-21rm22:19:353
121939971,1cyclictest3096-21/usr/sbin/munin19:55:162
121939971,1cyclictest26791-21grep20:40:162
121939971,1cyclictest14328-21cat20:15:172
121939971,1cyclictest11352-21grep20:10:152
121939971,0cyclictest28114-21apt-get19:40:122
121939970,2cyclictest28022-21expr23:30:152
121939970,1cyclictest9357-21grep22:15:162
121939970,1cyclictest9239-21interrupts20:05:152
121939970,1cyclictest878-21ntp_states00:05:192
121939970,1cyclictest7829-21taskset21:05:392
121939970,1cyclictest759-21ssh23:00:142
121939970,1cyclictest6257-21perl20:00:162
121939970,1cyclictest57150irq/125-eth023:35:132
121939970,1cyclictest499-21systemd-logind19:15:002
121939970,1cyclictest4087-21grep21:00:152
121939970,1cyclictest30504-21apt-get20:50:012
121939970,1cyclictest2854-21cron19:55:002
121939970,1cyclictest26929-21sh21:35:152
121939970,1cyclictest25976-21irqstats23:45:142
121939970,1cyclictest25577-21ssh22:40:062
121939970,1cyclictest24561-21irqstats21:50:172
121939970,1cyclictest22723-21latency_hist19:30:002
121939970,1cyclictest22281-21sort00:00:132
121939970,1cyclictest21377-21perl20:30:152
121939970,1cyclictest20780-21ssh22:05:112
121939970,1cyclictest20250-21dump-pmu-power19:25:012
121939970,1cyclictest19420-21grep20:25:182
121939970,1cyclictest18333-21df23:25:172
121939970,1cyclictest15812-21ssh22:35:122
121939970,1cyclictest14076-21df21:45:152
121939970,1cyclictest14076-21df21:45:142
121939970,1cyclictest0-21swapper/223:50:172
121939970,1cyclictest0-21swapper/221:10:042
121939970,0cyclictest20484-21apt-get19:25:132
121939970,0cyclictest0-21swapper/220:20:132
121939970,0cyclictest0-21swapper/200:20:132
122019965,1cyclictest30585-21apt-get19:45:133
122019964,2cyclictest611-21apt-get19:50:113
122019964,2cyclictest4187-21memory19:55:173
122019964,2cyclictest26406-21grep19:35:133
122019964,2cyclictest20677-21grep19:25:143
122019964,1cyclictest28267-21apt-get20:45:123
122019963,2cyclictest22972-21apt-key19:30:003
121889961,3cyclictest0-21swapper/123:50:141
121889961,2cyclictest0-21swapper/122:10:121
121889955,0cyclictest0-21swapper/120:15:111
121889951,3cyclictest0-21swapper/119:55:131
121889950,0cyclictest0-21swapper/100:36:231
121849950,5cyclictest2845-21awk00:40:000
121849950,5cyclictest0-21swapper/022:41:360
121849950,5cyclictest0-21swapper/022:18:100
121849950,5cyclictest0-21swapper/021:46:190
121849950,5cyclictest0-21swapper/021:46:190
121849950,0cyclictest0-21swapper/021:58:410
12180250,0sleep10-21swapper/123:55:131
121889944,0cyclictest0-21swapper/122:35:281
121889944,0cyclictest0-21swapper/122:00:161
121889944,0cyclictest0-21swapper/121:20:241
121889944,0cyclictest0-21swapper/100:23:081
121889942,1cyclictest0-21swapper/119:20:131
121889941,2cyclictest0-21swapper/123:15:131
121889941,2cyclictest0-21swapper/122:55:141
121889941,2cyclictest0-21swapper/121:55:121
121889941,2cyclictest0-21swapper/121:35:121
121889941,2cyclictest0-21swapper/120:45:121
121889941,2cyclictest0-21swapper/119:25:131
121889941,2cyclictest0-21swapper/100:30:141
121889941,2cyclictest0-21swapper/100:05:131
121889941,2cyclictest0-21swapper/100:00:121
121889941,1cyclictest0-21swapper/123:00:141
121889940,4cyclictest0-21swapper/120:55:121
121889940,3cyclictest0-21swapper/100:10:121
121889940,2cyclictest0-21swapper/121:50:121
121889940,2cyclictest0-21swapper/121:40:111
121889940,0cyclictest0-21swapper/122:16:331
121849944,0cyclictest3-21ksoftirqd/023:45:000
121849944,0cyclictest0-21swapper/021:43:410
121849940,4cyclictest3680-21ssh22:28:550
121849940,4cyclictest27868-21munin-run19:40:010
121849940,4cyclictest22827-21ssh21:16:420
121849940,4cyclictest10178-21hddtemp_smartct00:10:150
121849940,4cyclictest0-21swapper/023:55:130
121849940,4cyclictest0-21swapper/023:35:550
121849940,4cyclictest0-21swapper/023:15:130
121849940,4cyclictest0-21swapper/023:05:090
121849940,4cyclictest0-21swapper/023:00:140
121849940,4cyclictest0-21swapper/022:50:120
121849940,4cyclictest0-21swapper/022:45:120
121849940,4cyclictest0-21swapper/022:35:120
121849940,4cyclictest0-21swapper/022:30:140
121849940,4cyclictest0-21swapper/022:20:120
121849940,4cyclictest0-21swapper/022:10:120
121849940,4cyclictest0-21swapper/022:00:120
121849940,4cyclictest0-21swapper/021:26:380
121849940,4cyclictest0-21swapper/021:20:120
121849940,4cyclictest0-21swapper/021:10:130
121849940,4cyclictest0-21swapper/021:00:130
121849940,4cyclictest0-21swapper/020:45:120
121849940,4cyclictest0-21swapper/020:15:120
121849940,4cyclictest0-21swapper/019:45:130
121849940,3cyclictest9973-21ssh23:53:560
121849940,3cyclictest7248-21ssh00:09:030
121849940,3cyclictest29536-21sh00:20:150
121849940,3cyclictest27253-21/usr/sbin/munin20:40:190
121849940,3cyclictest26569-21ssh21:35:130
121849940,3cyclictest24388-21ssh23:11:320
121849940,3cyclictest1482-21ssh23:49:480
121849940,3cyclictest14751-21munin-node19:15:010
121849940,3cyclictest0-21swapper/021:30:140
121849940,3cyclictest0-21swapper/020:05:000
121889933,0cyclictest0-21swapper/123:40:571
121889933,0cyclictest0-21swapper/123:06:101
121889933,0cyclictest0-21swapper/122:34:101
121889933,0cyclictest0-21swapper/121:19:051
121889931,2cyclictest0-21swapper/120:30:131
121889931,1cyclictest0-21swapper/123:25:151
121889931,1cyclictest0-21swapper/123:20:101
121889931,1cyclictest0-21swapper/123:10:131
121889931,1cyclictest0-21swapper/122:45:121
121889931,1cyclictest0-21swapper/122:40:111
121889931,1cyclictest0-21swapper/122:25:141
121889931,1cyclictest0-21swapper/122:20:121
121889931,1cyclictest0-21swapper/122:05:131
121889931,1cyclictest0-21swapper/121:50:011
121889931,1cyclictest0-21swapper/121:50:011
121889931,1cyclictest0-21swapper/121:30:141
121889931,1cyclictest0-21swapper/121:25:161
121889931,1cyclictest0-21swapper/121:10:131
121889931,1cyclictest0-21swapper/121:05:131
121889931,1cyclictest0-21swapper/120:50:011
121889931,1cyclictest0-21swapper/120:40:121
121889931,1cyclictest0-21swapper/120:10:121
121889931,1cyclictest0-21swapper/120:05:011
121889931,1cyclictest0-21swapper/120:00:141
121889931,1cyclictest0-21swapper/119:10:121
121889931,1cyclictest0-21swapper/100:15:111
121889930,2cyclictest16041-21chrt19:15:121
121889930,2cyclictest0-21swapper/120:25:131
121889930,2cyclictest0-21swapper/119:30:021
121889930,1cyclictest0-21swapper/123:30:141
121849930,3cyclictest27248-21ssh23:30:010
121849930,3cyclictest24569-21uname21:50:170
121849930,3cyclictest22871-21apt-get20:35:020
121849930,3cyclictest20655-21ssh22:05:060
121849930,3cyclictest0-21swapper/023:20:100
121849930,3cyclictest0-21swapper/021:05:060
121849930,3cyclictest0-21swapper/020:55:120
121849930,3cyclictest0-21swapper/020:50:010
121849930,3cyclictest0-21swapper/020:30:120
121849930,3cyclictest0-21swapper/020:25:120
121849930,3cyclictest0-21swapper/020:20:120
121849930,3cyclictest0-21swapper/020:10:120
121849930,3cyclictest0-21swapper/020:05:000
121849930,3cyclictest0-21swapper/019:55:120
121849930,3cyclictest0-21swapper/019:50:110
121849930,3cyclictest0-21swapper/019:40:120
121849930,3cyclictest0-21swapper/019:30:000
121849930,3cyclictest0-21swapper/019:25:130
121849930,3cyclictest0-21swapper/019:20:130
121849930,3cyclictest0-21swapper/019:10:120
121849930,3cyclictest0-21swapper/000:15:100
121889921,1cyclictest0-21swapper/120:20:121
121889921,1cyclictest0-21swapper/119:45:131
121889920,2cyclictest256152sleep119:35:091
121889920,2cyclictest0-21swapper/121:00:131
121889920,2cyclictest0-21swapper/119:50:111
121889920,1cyclictest0-21swapper/123:45:011
121889920,1cyclictest0-21swapper/122:50:011
121889920,1cyclictest0-21swapper/120:35:011
121889920,1cyclictest0-21swapper/119:40:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional