You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 04:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Fri Dec 12, 2025 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
50582201185,11sleep10-21swapper/119:09:321
47532186168,13sleep30-21swapper/319:05:373
47852183166,13sleep00-21swapper/019:06:020
28702165147,13sleep20-21swapper/219:05:042
153822480,0sleep10-21swapper/121:16:301
241182470,0sleep00-21swapper/023:46:500
317582450,0sleep10-21swapper/121:56:581
119762450,0sleep10-21swapper/122:20:001
236112420,0sleep10-21swapper/123:46:311
73052110,0sleep00-21swapper/021:29:050
125542110,0sleep212557-21aten2_r5power_v23:25:142
524899102,4cyclictest19437-21munin-run22:40:000
524899102,4cyclictest12013-21munin-run22:19:590
52489991,4cyclictest26797-21munin-run23:00:000
2430290,0sleep00-21swapper/020:05:190
52489970,3cyclictest205-21systemd-journal23:35:000
52599961,0cyclictest1566-21awk00:25:003
52549961,4cyclictest0-21swapper/222:30:162
52489960,3cyclictest6565-21munin-run21:45:010
52489960,3cyclictest28369-21sendmail-msp20:59:590
27566260,0sleep20-21swapper/223:15:492
8633250,0sleep00-21swapper/022:01:290
52599951,2cyclictest0-21swapper/323:50:133
52599950,5cyclictest12109-21apt-get23:25:013
52599950,5cyclictest0-21swapper/322:53:413
52599950,1cyclictest22482-21ntp_states19:40:193
52549951,1cyclictest2357-21ssh00:25:152
52549950,0cyclictest0-21swapper/200:10:252
52499952,2cyclictest0-21swapper/120:55:121
52499951,2cyclictest0-21swapper/122:30:161
52499950,5cyclictest0-21swapper/121:42:091
52499950,5cyclictest0-21swapper/100:38:301
52489950,5cyclictest0-21swapper/000:22:030
52489950,1cyclictest6618-21munin-run23:55:000
20341250,0sleep10-21swapper/100:17:421
52599944,0cyclictest0-21swapper/322:41:103
52599944,0cyclictest0-21swapper/321:43:243
52599944,0cyclictest0-21swapper/300:17:383
52599943,1cyclictest7416-21tr21:45:143
52599943,1cyclictest19701-21ssh23:45:123
52599941,2cyclictest0-21swapper/322:55:143
52599941,2cyclictest0-21swapper/300:25:153
52599940,4cyclictest9289-21/usr/sbin/munin21:30:173
52599940,4cyclictest9289-21/usr/sbin/munin21:30:173
52599940,4cyclictest31106-21apt-get20:00:113
52599940,4cyclictest22332-21apt-get23:30:123
52599940,4cyclictest0-21swapper/323:55:143
52599940,4cyclictest0-21swapper/323:41:153
52599940,4cyclictest0-21swapper/323:35:133
52599940,4cyclictest0-21swapper/323:01:363
52599940,4cyclictest0-21swapper/322:35:123
52599940,4cyclictest0-21swapper/322:25:133
52599940,4cyclictest0-21swapper/322:20:123
52599940,4cyclictest0-21swapper/322:00:133
52599940,4cyclictest0-21swapper/320:55:123
52599940,4cyclictest0-21swapper/320:35:153
52599940,4cyclictest0-21swapper/319:17:183
52599940,4cyclictest0-21swapper/300:11:253
52599940,3cyclictest7759-21sed19:15:003
52599940,3cyclictest4701-21ssh23:05:063
52599940,3cyclictest3810-21apt-get20:10:013
52599940,3cyclictest29024-21sed21:40:013
52599940,3cyclictest2896-21sh21:26:213
52599940,3cyclictest2836-21ntp_states21:10:203
52599940,3cyclictest26078-21cat20:55:003
52599940,3cyclictest24442-21rm23:15:013
52599940,3cyclictest23057-21hddtemp_smartct00:35:173
52599940,3cyclictest23018-21vmstat20:45:233
52599940,3cyclictest15723-21ssh00:31:153
52599940,1cyclictest6300-21/usr/sbin/munin20:15:123
52599940,1cyclictest28587-21/usr/sbin/munin21:00:203
52599940,1cyclictest18529-21ntpq00:00:203
52599940,1cyclictest16045-21/usr/sbin/munin19:30:213
52599940,1cyclictest14877-21/usr/sbin/munin23:10:183
52599940,0cyclictest0-21swapper/322:13:313
52549944,0cyclictest0-21swapper/223:00:342
52549944,0cyclictest0-21swapper/221:31:582
52549944,0cyclictest0-21swapper/221:31:582
52549943,1cyclictest205-21systemd-journal20:50:002
52549942,1cyclictest7546-21ssh22:50:162
52549941,3cyclictest808-21snmpd22:00:452
52549941,1cyclictest0-21swapper/220:05:132
52549940,4cyclictest24840-21ssh23:47:182
52549940,4cyclictest14388-21ssh22:36:492
52549940,4cyclictest0-21swapper/223:38:592
52549940,4cyclictest0-21swapper/223:05:132
52549940,4cyclictest0-21swapper/222:20:122
52549940,4cyclictest0-21swapper/222:15:062
52549940,4cyclictest0-21swapper/221:56:092
52549940,4cyclictest0-21swapper/221:15:152
52549940,4cyclictest0-21swapper/221:10:132
52549940,4cyclictest0-21swapper/219:40:132
52549940,4cyclictest0-21swapper/200:00:132
52549940,3cyclictest8264-21ssh23:22:512
52549940,3cyclictest8079-21ssh21:29:352
52549940,3cyclictest7570-21ntp_states20:15:172
52549940,3cyclictest27391-21ssh21:22:412
52549940,3cyclictest24789-21ssh22:10:122
52549940,3cyclictest22044-21ssh23:30:022
52549940,3cyclictest21033-21grep20:45:002
52549940,3cyclictest14535-21ssh23:10:012
52549940,3cyclictest11893-21ssh00:30:012
52549940,3cyclictest1051-21cut21:10:012
52549940,3cyclictest10317-21python20:20:202
52549940,0cyclictest0-21swapper/200:18:512
52499944,0cyclictest0-21swapper/121:52:551
52499944,0cyclictest0-21swapper/121:12:111
52499944,0cyclictest0-21swapper/100:33:511
52499942,1cyclictest0-21swapper/122:55:141
52499941,2cyclictest0-21swapper/121:45:131
52499941,2cyclictest0-21swapper/121:05:171
52499941,2cyclictest0-21swapper/120:30:121
52499941,2cyclictest0-21swapper/120:20:131
52499941,2cyclictest0-21swapper/119:45:111
52499941,2cyclictest0-21swapper/119:20:141
52499941,2cyclictest0-21swapper/119:15:121
52499941,2cyclictest0-21swapper/100:25:151
52499941,2cyclictest0-21swapper/100:20:121
52499941,2cyclictest0-21swapper/100:10:151
52499941,1cyclictest0-21swapper/121:20:151
52499940,4cyclictest0-21swapper/123:57:021
52499940,4cyclictest0-21swapper/100:05:281
52499940,2cyclictest0-21swapper/123:10:141
52499940,2cyclictest0-21swapper/122:25:131
52499940,2cyclictest0-21swapper/122:10:121
52499940,2cyclictest0-21swapper/120:15:111
52499940,2cyclictest0-21swapper/120:05:131
52489944,0cyclictest878-21diskmemload00:25:060
52489944,0cyclictest5265-21kworker/0:022:49:510
52489944,0cyclictest5265-21kworker/0:022:27:280
52489944,0cyclictest28249-21kworker/0:221:20:190
52489944,0cyclictest0-21swapper/022:41:050
52489944,0cyclictest0-21swapper/020:30:140
52489943,1cyclictest22559-21head19:40:190
52489942,2cyclictest28249-21kworker/0:221:52:060
52489942,1cyclictest9298-21ssh21:30:130
52489942,1cyclictest9298-21ssh21:30:130
52489942,1cyclictest6204-21sed19:10:150
52489941,3cyclictest808-21snmpd00:36:450
52489941,2cyclictest0-21swapper/023:20:150
52489941,2cyclictest0-21swapper/021:35:100
52489941,1cyclictest0-21swapper/019:55:120
52489940,4cyclictest0-21swapper/023:27:180
52489940,4cyclictest0-21swapper/023:05:130
52489940,4cyclictest0-21swapper/022:30:160
52489940,4cyclictest0-21swapper/021:55:160
52489940,4cyclictest0-21swapper/021:12:160
52489940,4cyclictest0-21swapper/020:45:140
52489940,4cyclictest0-21swapper/020:25:150
52489940,4cyclictest0-21swapper/020:00:110
52489940,4cyclictest0-21swapper/019:38:190
52489940,4cyclictest0-21swapper/019:19:060
52489940,4cyclictest0-21swapper/000:16:000
52489940,4cyclictest0-21swapper/000:10:150
52489940,3cyclictest9754-21ssh23:40:110
52489940,3cyclictest7744-21df23:55:160
52489940,3cyclictest18444-21latency_hist20:40:000
52489940,3cyclictest0-21swapper/021:00:140
52489940,1cyclictest28616-21memory23:00:200
52489940,1cyclictest24918-21grep22:10:130
52489940,0cyclictest0-21swapper/000:03:520
7142230,0sleep20-21swapper/223:55:132
52599932,1cyclictest56750irq/130-eth021:15:053
52599932,1cyclictest11550-21cat20:25:163
52599931,1cyclictest798-21runrttasks00:05:113
52599930,3cyclictest61-21kswapd023:20:153
52599930,3cyclictest31062-21/usr/sbin/munin21:05:163
52599930,3cyclictest29852-21sh22:45:093
52599930,3cyclictest26994-21sh21:55:073
52599930,3cyclictest26524-21seq19:50:143
52599930,3cyclictest24358-21grep19:45:133
52599930,3cyclictest1902-21gltestperf20:05:143
52599930,3cyclictest1802-21apt-get22:15:013
52599930,3cyclictest14774-21ssh22:05:133
52599930,3cyclictest0-21swapper/322:30:103
52599930,3cyclictest0-21swapper/320:40:113
52599930,3cyclictest0-21swapper/320:30:123
52599930,3cyclictest0-21swapper/320:20:133
52599930,3cyclictest0-21swapper/319:55:123
52599930,3cyclictest0-21swapper/319:35:053
52599930,3cyclictest0-21swapper/319:25:123
52599930,1cyclictest21394-21ssh21:20:053
52599930,1cyclictest0-21swapper/321:50:053
52599930,1cyclictest0-21swapper/319:20:173
52549932,1cyclictest6806-21ssh21:45:032
52549932,1cyclictest26128-21aten2_r5power_c20:55:122
52549931,1cyclictest17191-21ssh21:50:162
52549931,1cyclictest0-21swapper/220:30:122
52549931,1cyclictest0-21swapper/219:25:122
52549930,3cyclictest9953-21ssh23:40:122
52549930,3cyclictest29858-21ntp_states21:00:202
52549930,3cyclictest29572-21ssh23:50:092
52549930,3cyclictest22034-21ssh00:35:092
52549930,3cyclictest17363-21ssh22:55:122
52549930,3cyclictest11555-21expr19:20:152
52549930,3cyclictest0-21swapper/222:45:062
52549930,3cyclictest0-21swapper/222:40:052
52549930,3cyclictest0-21swapper/222:25:132
52549930,3cyclictest0-21swapper/222:05:162
52549930,3cyclictest0-21swapper/221:40:152
52549930,3cyclictest0-21swapper/221:35:102
52549930,3cyclictest0-21swapper/220:50:142
52549930,3cyclictest0-21swapper/220:25:142
52549930,3cyclictest0-21swapper/220:10:122
52549930,3cyclictest0-21swapper/220:00:162
52549930,3cyclictest0-21swapper/219:55:122
52549930,3cyclictest0-21swapper/219:50:132
52549930,3cyclictest0-21swapper/219:45:052
52549930,3cyclictest0-21swapper/219:35:122
52549930,3cyclictest0-21swapper/219:30:122
52549930,3cyclictest0-21swapper/219:15:012
52549930,3cyclictest0-21swapper/219:10:122
52549930,3cyclictest0-21swapper/200:20:022
52549930,3cyclictest0-21swapper/200:05:132
52549930,2cyclictest0-21swapper/220:35:152
52499933,0cyclictest0-21swapper/123:36:401
52499933,0cyclictest0-21swapper/122:48:131
52499933,0cyclictest0-21swapper/121:26:261
52499931,1cyclictest0-21swapper/123:50:131
52499931,1cyclictest0-21swapper/123:25:001
52499931,1cyclictest0-21swapper/123:20:151
52499931,1cyclictest0-21swapper/123:15:121
52499931,1cyclictest0-21swapper/123:05:131
52499931,1cyclictest0-21swapper/122:40:121
52499931,1cyclictest0-21swapper/122:05:161
52499931,1cyclictest0-21swapper/120:50:141
52499931,1cyclictest0-21swapper/120:35:151
52499931,1cyclictest0-21swapper/120:10:011
52499931,1cyclictest0-21swapper/119:35:121
52499931,1cyclictest0-21swapper/119:30:121
52499931,1cyclictest0-21swapper/119:10:131
52499931,1cyclictest0-21swapper/100:00:131
52499930,3cyclictest0-21swapper/123:30:421
52499930,2cyclictest0-21swapper/123:40:111
52499930,2cyclictest0-21swapper/121:00:141
52499930,1cyclictest0-21swapper/122:35:121
52499930,1cyclictest0-21swapper/120:00:111
52489932,1cyclictest24772-21cut23:15:120
52489930,3cyclictest878-21diskmemload22:05:120
52489930,3cyclictest7538-21apt-get22:50:160
52489930,3cyclictest364-21df_inode23:35:140
52489930,3cyclictest26896-21ssh00:05:100
52489930,3cyclictest0-21swapper/023:10:140
52489930,3cyclictest0-21swapper/022:20:110
52489930,3cyclictest0-21swapper/021:45:100
52489930,3cyclictest0-21swapper/021:15:140
52489930,3cyclictest0-21swapper/021:05:170
52489930,3cyclictest0-21swapper/020:50:140
52489930,3cyclictest0-21swapper/020:40:110
52489930,3cyclictest0-21swapper/020:15:130
52489930,3cyclictest0-21swapper/020:10:010
52489930,3cyclictest0-21swapper/019:50:130
52489930,3cyclictest0-21swapper/019:45:110
52489930,3cyclictest0-21swapper/019:30:110
52489930,3cyclictest0-21swapper/019:25:120
52489930,3cyclictest0-21swapper/019:20:140
52489930,3cyclictest0-21swapper/000:30:150
52489930,2cyclictest0-21swapper/020:20:130
29648230,0sleep10-21swapper/123:00:311
52499921,1cyclictest0-21swapper/122:50:161
52499921,1cyclictest0-21swapper/119:50:131
52499920,1cyclictest0-21swapper/122:20:121
52499920,1cyclictest0-21swapper/122:00:131
52499920,1cyclictest0-21swapper/121:37:581
52499920,1cyclictest0-21swapper/121:30:131
52499920,1cyclictest0-21swapper/121:30:131
52499920,1cyclictest0-21swapper/120:45:141
52499920,1cyclictest0-21swapper/120:40:001
52499920,1cyclictest0-21swapper/120:25:141
52499920,1cyclictest0-21swapper/119:55:121
52499920,1cyclictest0-21swapper/119:40:011
52499920,1cyclictest0-21swapper/119:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional