You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 08:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Sat Sep 19, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
321802202186,12sleep10-21swapper/119:07:401
321112201186,11sleep30-21swapper/319:06:443
320962183166,12sleep00-21swapper/019:06:330
32208211699,12sleep20-21swapper/219:08:002
273202480,0sleep10-21swapper/100:10:161
260612470,0sleep30-21swapper/322:46:553
241602470,0sleep10-21swapper/122:13:261
282552440,0sleep228258-21idleruntime22:15:162
267872430,0sleep20-21swapper/221:58:152
3253599100,1cyclictest6882-21irqstats23:10:172
3253599100,1cyclictest0-21swapper/200:35:132
5670290,0sleep10-21swapper/123:42:501
325359990,1cyclictest0-21swapper/220:55:122
325359982,1cyclictest2206-21ls22:35:122
325359981,1cyclictest6073-21sed00:00:002
325359981,1cyclictest13411-21cat19:35:002
325359980,1cyclictest32164-21ssh23:40:122
325359980,1cyclictest26586-21apt22:15:002
325359980,1cyclictest205-21systemd-journal20:19:592
325359980,1cyclictest16809-21munin-run22:10:002
325359980,1cyclictest1216-21apt-get22:35:002
325359980,1cyclictest10876-21munin-run20:35:002
325319980,2cyclictest0-21swapper/120:55:111
325269980,4cyclictest28211-21perf21:10:000
325409970,7cyclictest1587-21ssh22:18:213
325409970,2cyclictest18808-21ssh00:39:433
325359972,1cyclictest13863-21ssh23:46:492
325359972,0cyclictest20508-21rm22:27:532
325359971,1cyclictest500-21cron20:40:002
325359971,1cyclictest26653-21fschecks_time00:10:142
325359971,1cyclictest23051-21basename00:25:122
325359970,1cyclictest9888-21cat19:25:172
325359970,1cyclictest973-21munin-run20:15:002
325359970,1cyclictest9292-21df22:55:122
325359970,1cyclictest8337-21users21:15:202
325359970,1cyclictest6733-21wc00:00:112
325359970,1cyclictest6154-21/usr/sbin/munin19:20:122
325359970,1cyclictest5228-21df_inode22:20:132
325359970,1cyclictest4221-21diskstats20:20:122
325359970,1cyclictest4157-21perl19:15:132
325359970,1cyclictest3529-21fschecks_time23:25:132
325359970,1cyclictest3310-21ssh00:15:132
325359970,1cyclictest326-21ntp_states22:50:182
325359970,1cyclictest30903-21cron20:10:012
325359970,1cyclictest25730-21munin-run21:05:002
325359970,1cyclictest25424-21latency_hist00:10:012
325359970,1cyclictest23481-21irqstats23:35:172
325359970,1cyclictest23292-21munin-run19:55:002
325359970,1cyclictest16897-21sed19:40:142
325359970,1cyclictest1638-21irqstats21:45:162
325359970,1cyclictest16378-21rm21:20:132
325359970,1cyclictest14404-21irqstats21:35:172
325359970,1cyclictest14201-21memory00:20:152
325359970,1cyclictest14143-21diskstats19:35:162
325359970,1cyclictest1195-21hddtemp_smartct00:30:132
325359970,1cyclictest10372-21ssh21:50:122
325359970,0cyclictest0-21swapper/220:45:122
325319971,1cyclictest0-21swapper/123:50:121
325319971,1cyclictest0-21swapper/100:30:101
325319970,1cyclictest0-21swapper/100:35:131
325269973,4cyclictest30921-21munin-run20:10:000
325269973,4cyclictest10885-21perf19:30:010
325409960,6cyclictest0-21swapper/323:39:443
325409960,6cyclictest0-21swapper/321:50:033
325409960,6cyclictest0-21swapper/321:46:043
325409960,6cyclictest0-21swapper/321:40:523
325409960,6cyclictest0-21swapper/321:26:353
325409960,6cyclictest0-21swapper/300:31:393
325409960,6cyclictest0-21swapper/300:20:243
325409960,6cyclictest0-21swapper/300:13:043
325359962,2cyclictest0-21swapper/222:00:112
325359961,1cyclictest18617-21basename19:45:112
325359960,1cyclictest6220-21aten2_r5power_p20:25:102
325359960,1cyclictest489-21cut19:10:122
325359960,1cyclictest3525-21egrep21:30:112
325359960,1cyclictest29485-21perl21:10:132
325359960,1cyclictest28139-21ssh23:05:022
325359960,1cyclictest26202-21/usr/sbin/munin20:00:132
325359960,1cyclictest25953-21/usr/sbin/munin21:05:142
325359960,1cyclictest25827-21ssh21:25:062
325359960,1cyclictest25425-21ssh23:20:132
325359960,1cyclictest23826-21tr19:55:112
325359960,1cyclictest23367-21expr21:40:132
325359960,1cyclictest21362-21ssh22:45:052
325359960,1cyclictest19053-21diskstats20:50:122
325359960,1cyclictest18529-21/usr/sbin/munin23:00:112
325359960,1cyclictest16097-21df_inode23:15:122
325359960,1cyclictest14305-21tune2fs20:40:122
325359960,1cyclictest12457-21ssh23:30:082
325359960,1cyclictest12366-21df_inode22:40:152
325359960,1cyclictest0-21swapper/223:50:112
325319961,1cyclictest265292chrt22:47:131
325319960,2cyclictest0-21swapper/122:05:121
325319960,1cyclictest0-21swapper/122:35:111
325319960,1cyclictest0-21swapper/121:45:001
325319960,1cyclictest0-21swapper/120:45:131
325319960,1cyclictest0-21swapper/119:55:011
325269962,4cyclictest5938-21munin-run20:25:000
325269960,3cyclictest15871-21munin-run19:40:000
325409955,0cyclictest0-21swapper/323:44:373
325409950,5cyclictest15402-21hddtemp_smartct22:25:143
325409950,5cyclictest0-21swapper/323:55:303
325409950,5cyclictest0-21swapper/323:01:033
325409950,5cyclictest0-21swapper/322:58:513
325409950,5cyclictest0-21swapper/322:20:353
325409950,5cyclictest0-21swapper/322:12:323
325409950,5cyclictest0-21swapper/321:55:233
325409950,5cyclictest0-21swapper/321:35:113
325409950,5cyclictest0-21swapper/321:30:073
325409950,5cyclictest0-21swapper/321:20:023
325409950,5cyclictest0-21swapper/321:16:483
325409950,5cyclictest0-21swapper/300:25:023
325409950,5cyclictest0-21swapper/300:15:103
325409950,5cyclictest0-21swapper/300:00:073
325409950,0cyclictest15966-21ssh00:05:033
325319951,2cyclictest0-21swapper/121:00:101
325319950,5cyclictest0-21swapper/121:18:431
325319950,1cyclictest6931-21chrt22:20:271
325319950,1cyclictest6699-21chrt21:31:081
325319950,1cyclictest6238-21chrt00:00:031
325319950,1cyclictest5694-21chrt20:22:081
325319950,1cyclictest5198-21chrt21:14:461
325319950,1cyclictest3215-21chrt00:15:101
325319950,1cyclictest3061-21chrt20:15:251
325319950,1cyclictest30450-21chrt23:22:171
325319950,1cyclictest288482sleep123:55:031
325319950,1cyclictest28056-21chrt21:08:301
325319950,1cyclictest27485-21chrt21:58:411
325319950,1cyclictest27058-21chrt22:15:021
325319950,1cyclictest26388-21chrt22:30:211
325319950,1cyclictest2466-21chrt21:45:201
325319950,1cyclictest22968-21chrt19:51:101
325319950,1cyclictest21372-21chrt21:22:221
325319950,1cyclictest21102-21chrt23:00:381
325319950,1cyclictest2102-21chrt19:10:361
325319950,1cyclictest20717-21chrt20:54:391
325319950,1cyclictest18478-21chrt22:43:211
325319950,1cyclictest18163-21chrt19:42:541
325319950,1cyclictest1724-21chrt23:07:431
325319950,1cyclictest16765-21chrt21:36:161
325319950,1cyclictest16225-21chrt22:58:511
325319950,1cyclictest15535-21chrt19:36:091
325319950,1cyclictest15485-21chrt20:40:511
325319950,1cyclictest135952sleep123:46:391
325319950,1cyclictest130722sleep119:31:481
325319950,1cyclictest13063-21chrt20:36:411
325319950,1cyclictest10772-21chrt20:33:571
325319950,1cyclictest0-21swapper/123:35:131
325319950,1cyclictest0-21swapper/122:25:121
325319950,1cyclictest0-21swapper/121:50:111
325319950,1cyclictest0-21swapper/119:45:121
325319950,1cyclictest0-21swapper/100:05:111
325269955,0cyclictest0-21swapper/023:20:140
325269953,1cyclictest0-21swapper/023:10:120
325269952,3cyclictest14459-21kworker/0:221:28:210
325269952,2cyclictest23965-21kworker/0:123:16:290
325269950,5cyclictest0-21swapper/022:33:500
325269950,5cyclictest0-21swapper/022:27:080
325269950,2cyclictest11098-21/usr/sbin/munin20:35:190
325269950,0cyclictest0-21swapper/023:55:020
325269950,0cyclictest0-21swapper/022:48:230
325409944,0cyclictest0-21swapper/320:05:033
325409944,0cyclictest0-21swapper/319:50:123
325409942,2cyclictest0-21swapper/322:05:473
325409941,3cyclictest0-21swapper/319:10:393
325409941,2cyclictest0-21swapper/319:55:113
325409941,2cyclictest0-21swapper/319:35:133
325409941,2cyclictest0-21swapper/319:15:113
325409940,4cyclictest26206-21apt-get20:00:123
325409940,4cyclictest0-21swapper/323:50:033
325409940,4cyclictest0-21swapper/323:45:233
325409940,4cyclictest0-21swapper/323:30:043
325409940,4cyclictest0-21swapper/323:25:183
325409940,4cyclictest0-21swapper/323:20:113
325409940,4cyclictest0-21swapper/323:15:073
325409940,4cyclictest0-21swapper/323:10:083
325409940,4cyclictest0-21swapper/322:40:043
325409940,4cyclictest0-21swapper/322:35:083
325409940,4cyclictest0-21swapper/322:30:033
325409940,4cyclictest0-21swapper/320:10:113
325409940,4cyclictest0-21swapper/319:31:533
325409940,3cyclictest30080-21ssh22:00:113
325409940,3cyclictest29698-21if_eth021:10:143
325409940,3cyclictest0-21swapper/320:15:103
325409940,1cyclictest9770-21sed20:30:163
325409940,1cyclictest0-21swapper/322:50:033
325409940,0cyclictest0-21swapper/323:05:083
325319941,2cyclictest0-21swapper/123:25:121
325319941,2cyclictest0-21swapper/122:00:121
325319941,1cyclictest0-21swapper/121:25:091
325319940,4cyclictest0-21swapper/123:12:301
325319940,2cyclictest0-21swapper/120:05:101
325319940,1cyclictest8254-21chrt19:23:241
325319940,1cyclictest8097-21chrt20:26:171
325319940,1cyclictest5449-21chrt19:17:001
325319940,1cyclictest282122sleep120:02:151
325319940,1cyclictest27458-21chrt00:26:541
325319940,1cyclictest22163-21chrt23:18:161
325319940,1cyclictest164702sleep100:21:141
325319940,1cyclictest15983-21chrt23:31:131
325319940,1cyclictest10534-21chrt19:25:561
325319940,0cyclictest0-21swapper/122:52:341
325269944,0cyclictest0-21swapper/023:40:370
325269944,0cyclictest0-21swapper/022:39:400
325269943,1cyclictest5709-21sh19:20:010
325269943,1cyclictest14459-21kworker/0:219:48:330
325269943,0cyclictest23798-21cut19:55:120
325269942,2cyclictest0-21swapper/023:50:120
325269942,1cyclictest8821-21aten2_r5power_p22:55:110
325269942,1cyclictest16820-21ssh22:42:180
325269942,1cyclictest16188-21cut19:40:110
325269942,1cyclictest0-21swapper/022:05:130
325269941,1cyclictest0-21swapper/023:35:140
325269941,1cyclictest0-21swapper/020:55:120
325269941,1cyclictest0-21swapper/020:00:110
325269940,4cyclictest7773-21ls21:15:180
325269940,4cyclictest2779-21apt-get23:25:110
325269940,4cyclictest27025-21apt-get22:15:010
325269940,4cyclictest23482-21/usr/sbin/munin21:00:120
325269940,4cyclictest18526-21apt-get20:50:110
325269940,4cyclictest0-21swapper/023:45:330
325269940,4cyclictest0-21swapper/023:30:180
325269940,4cyclictest0-21swapper/021:55:100
325269940,4cyclictest0-21swapper/021:35:130
325269940,4cyclictest0-21swapper/000:20:100
325269940,3cyclictest960-21sh00:13:500
325269940,3cyclictest8692-21sh21:49:170
325269940,3cyclictest6681-21df_inode19:20:130
325269940,3cyclictest32654-21dpkg19:10:110
325269940,3cyclictest28120-21seq23:05:030
325269940,3cyclictest12945-21sh21:50:390
325269940,3cyclictest0-21swapper/000:17:420
325269940,1cyclictest6159-21/usr/sbin/munin20:25:170
325269940,1cyclictest4784-21aten2_r5power_v22:20:110
325269940,1cyclictest31363-21cut22:50:100
325269940,1cyclictest28672-21/usr/sbin/munin21:10:110
325269940,1cyclictest18529-21/usr/sbin/munin23:00:200
325409931,1cyclictest0-21swapper/320:50:113
325409931,1cyclictest0-21swapper/319:20:013
325409930,3cyclictest26797-21/usr/sbin/munin21:05:153
325409930,3cyclictest16433-21seq20:45:133
325409930,3cyclictest14208-21grep20:40:123
325409930,3cyclictest0-21swapper/321:00:093
325409930,3cyclictest0-21swapper/320:55:133
325409930,3cyclictest0-21swapper/320:35:113
325409930,3cyclictest0-21swapper/320:25:063
325409930,3cyclictest0-21swapper/320:20:113
325409930,3cyclictest0-21swapper/319:45:013
325409930,3cyclictest0-21swapper/319:40:103
325409930,3cyclictest0-21swapper/319:25:133
325319931,2cyclictest0-21swapper/120:10:121
325269933,0cyclictest14459-21kworker/0:221:30:010
325269932,1cyclictest23965-21kworker/0:100:35:120
325269932,1cyclictest23965-21kworker/0:100:00:090
325269931,2cyclictest23965-21kworker/0:100:30:030
325269931,1cyclictest0-21swapper/020:40:100
325269931,1cyclictest0-21swapper/020:30:100
325269931,1cyclictest0-21swapper/020:10:110
325269930,3cyclictest16088-21sh21:20:080
325269930,3cyclictest16060-21ssh00:05:060
325269930,3cyclictest0-21swapper/022:10:130
325269930,3cyclictest0-21swapper/021:40:130
325269930,3cyclictest0-21swapper/020:45:120
325269930,3cyclictest0-21swapper/019:50:100
325269930,3cyclictest0-21swapper/019:30:100
325269930,3cyclictest0-21swapper/000:25:010
325269930,1cyclictest29919-21ssh22:00:060
325269930,1cyclictest1190-21/usr/sbin/munin20:15:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional