You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 20:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Dec 04, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7492200184,11sleep10-21swapper/107:09:271
5972192175,12sleep30-21swapper/307:07:333
6862190175,11sleep00-21swapper/007:08:420
5962175155,15sleep20-21swapper/207:07:322
258152490,0sleep00-21swapper/009:24:000
278622440,0sleep30-21swapper/309:56:353
324542420,0sleep10-21swapper/109:26:491
268772420,0sleep00-21swapper/012:38:050
307412110,0sleep10-21swapper/109:10:161
120912110,0sleep10-21swapper/112:14:401
9769991,4cyclictest6583-21munin-run07:20:000
9769980,2cyclictest25914-21apt-get09:40:110
9769980,2cyclictest17207-21apt-get10:40:100
9769971,2cyclictest0-21swapper/007:54:220
9769970,5cyclictest22915-21memory10:10:160
9769970,3cyclictest12244-21grep11:25:210
9769970,2cyclictest9566-21grep07:25:140
9769970,2cyclictest6514-21perl09:30:150
9769970,2cyclictest26906-21cut08:00:110
9769970,2cyclictest24495-21grep07:55:120
9779961,3cyclictest0-21swapper/110:30:111
9769961,2cyclictest0-21swapper/012:01:360
9769961,2cyclictest0-21swapper/010:52:480
9769961,2cyclictest0-21swapper/009:19:150
9769960,4cyclictest29211-21diskmemload10:22:320
9769960,4cyclictest12074-21cron11:10:000
9769960,4cyclictest0-21swapper/010:35:320
9769960,4cyclictest0-21swapper/010:06:290
9769960,3cyclictest5234-21cut09:45:200
9769960,3cyclictest28054-21load09:05:170
9769960,3cyclictest25409-21munin-run09:40:010
9769960,3cyclictest2012-21/usr/sbin/munin08:15:200
9769960,3cyclictest19951-21perf12:34:590
9769960,3cyclictest16310-21ntp_states10:55:210
9769960,3cyclictest11923-21wc07:30:130
9769960,3cyclictest0-21swapper/012:12:080
9769960,3cyclictest0-21swapper/011:55:100
9769960,3cyclictest0-21swapper/011:46:320
9769960,3cyclictest0-21swapper/011:39:240
9769960,3cyclictest0-21swapper/011:23:420
9769960,3cyclictest0-21swapper/010:27:460
9769960,3cyclictest0-21swapper/009:57:050
9769960,3cyclictest0-21swapper/009:52:080
9769960,3cyclictest0-21swapper/009:27:080
9769960,3cyclictest0-21swapper/007:45:400
9769960,2cyclictest9788-21chrt10:04:130
9769960,2cyclictest798-21runrttasks08:27:360
9769960,2cyclictest6817-21taskset07:20:090
9769960,2cyclictest6387-21sshd08:20:360
9769960,2cyclictest313172sleep011:03:010
9769960,2cyclictest2954-21chrt07:10:220
9769960,2cyclictest27689-21cstates10:45:140
9769960,2cyclictest26645-21taskset12:21:170
9769960,2cyclictest25648-21/usr/sbin/munin12:05:220
9769960,2cyclictest17793-21cat07:40:180
9769960,2cyclictest1551-21chrt08:12:190
9769960,2cyclictest11331-21chrt08:30:400
9769960,2cyclictest0-21swapper/012:19:350
9769960,2cyclictest0-21swapper/009:10:130
9849954,1cyclictest11196-21ssh11:40:573
9849950,5cyclictest0-21swapper/312:19:313
9849950,5cyclictest0-21swapper/309:29:423
9849950,5cyclictest0-21swapper/308:00:113
9849950,4cyclictest24029-21sh11:15:203
9849950,0cyclictest487-21nscd11:56:493
9849950,0cyclictest0-21swapper/310:20:473
9809950,5cyclictest23204-21df11:15:152
9809950,5cyclictest0-21swapper/212:25:212
9809950,5cyclictest0-21swapper/210:03:292
9809950,4cyclictest0-21swapper/208:35:112
9779952,2cyclictest0-21swapper/109:15:121
9779951,3cyclictest0-21swapper/109:20:111
9779951,3cyclictest0-21swapper/108:25:111
9779951,2cyclictest0-21swapper/111:30:131
9779951,2cyclictest0-21swapper/111:05:131
9779951,2cyclictest0-21swapper/110:20:141
9779951,2cyclictest0-21swapper/109:30:131
9779951,2cyclictest0-21swapper/108:40:131
9779951,2cyclictest0-21swapper/108:30:121
9779951,2cyclictest0-21swapper/108:20:121
9779951,2cyclictest0-21swapper/108:00:111
9779951,2cyclictest0-21swapper/107:20:141
9779951,2cyclictest0-21swapper/107:10:111
9779951,1cyclictest0-21swapper/109:40:121
9779950,5cyclictest0-21swapper/112:18:321
9779950,5cyclictest0-21swapper/109:45:191
9769950,3cyclictest30589-21ssh11:50:360
9769950,3cyclictest29211-21diskmemload11:40:120
9769950,3cyclictest22402-21ssh11:30:220
9769950,2cyclictest798-21runrttasks08:55:060
9769950,2cyclictest31176-21fgrep10:30:190
9769950,2cyclictest30812-21/usr/sbin/munin08:05:220
9769950,2cyclictest29211-21diskmemload10:15:250
9769950,2cyclictest24535-21aten2_r5power_e09:00:120
9769950,2cyclictest19330-21runrttasks08:50:050
9769950,2cyclictest16870-21/usr/sbin/munin08:45:150
9769950,2cyclictest16325-21taskset08:41:100
9769950,2cyclictest14747-21df_inode07:35:130
9769950,2cyclictest13179-21diskstats11:10:140
9769950,2cyclictest0-21swapper/012:25:220
9769950,2cyclictest0-21swapper/011:15:030
9769950,2cyclictest0-21swapper/008:35:530
9849944,0cyclictest0-21swapper/310:32:173
9849944,0cyclictest0-21swapper/309:14:083
9849944,0cyclictest0-21swapper/307:48:173
9849942,2cyclictest4997-21ssh12:26:493
9849942,1cyclictest6940-21date08:25:003
9849941,3cyclictest22065-21cpuspeed07:50:123
9849941,3cyclictest19486-21sh10:08:583
9849941,2cyclictest0-21swapper/312:05:113
9849941,2cyclictest0-21swapper/311:50:113
9849941,2cyclictest0-21swapper/310:45:123
9849940,4cyclictest4426-21ssh10:00:523
9849940,4cyclictest3207-21/usr/sbin/munin12:10:193
9849940,4cyclictest24696-21gzip12:20:183
9849940,4cyclictest21711-21ssh10:10:123
9849940,4cyclictest0-21swapper/312:35:113
9849940,4cyclictest0-21swapper/311:47:543
9849940,4cyclictest0-21swapper/311:37:283
9849940,4cyclictest0-21swapper/311:00:023
9849940,4cyclictest0-21swapper/310:57:563
9849940,4cyclictest0-21swapper/310:50:123
9849940,4cyclictest0-21swapper/310:25:053
9849940,4cyclictest0-21swapper/310:15:123
9849940,4cyclictest0-21swapper/309:46:163
9849940,4cyclictest0-21swapper/309:35:153
9849940,4cyclictest0-21swapper/309:20:113
9849940,4cyclictest0-21swapper/308:35:113
9849940,4cyclictest0-21swapper/308:10:013
9849940,4cyclictest0-21swapper/308:05:133
9849940,4cyclictest0-21swapper/307:25:123
9849940,4cyclictest0-21swapper/307:17:273
9849940,3cyclictest32676-21apt11:20:153
9849940,3cyclictest28573-21ssh11:34:123
9849940,3cyclictest27575-21sh09:40:203
9849940,3cyclictest19253-21ssh11:29:453
9849940,3cyclictest17310-21munin-run09:20:003
9849940,3cyclictest10558-21ssh12:30:123
9849940,1cyclictest16870-21/usr/sbin/munin08:45:203
9809944,0cyclictest0-21swapper/210:21:572
9809944,0cyclictest0-21swapper/209:35:332
9809943,1cyclictest20587-21ntp_kernel_pll_08:50:182
9809942,1cyclictest27263-21ssh10:45:122
9809941,3cyclictest808-21snmpd09:45:162
9809941,3cyclictest3338-21munin-plugin-st07:15:012
9809941,3cyclictest22854-21ssh10:26:082
9809941,2cyclictest0-21swapper/211:30:022
9809941,1cyclictest0-21swapper/211:55:112
9809941,1cyclictest0-21swapper/209:40:122
9809941,1cyclictest0-21swapper/208:10:122
9809940,4cyclictest0-21swapper/212:20:122
9809940,4cyclictest0-21swapper/212:16:092
9809940,4cyclictest0-21swapper/212:12:042
9809940,4cyclictest0-21swapper/212:05:052
9809940,4cyclictest0-21swapper/211:50:282
9809940,4cyclictest0-21swapper/211:40:132
9809940,4cyclictest0-21swapper/211:35:132
9809940,4cyclictest0-21swapper/211:25:122
9809940,4cyclictest0-21swapper/211:22:482
9809940,4cyclictest0-21swapper/210:40:112
9809940,4cyclictest0-21swapper/210:35:142
9809940,4cyclictest0-21swapper/210:30:122
9809940,4cyclictest0-21swapper/210:11:012
9809940,4cyclictest0-21swapper/210:05:042
9809940,4cyclictest0-21swapper/209:55:162
9809940,4cyclictest0-21swapper/209:50:132
9809940,4cyclictest0-21swapper/209:31:392
9809940,4cyclictest0-21swapper/209:27:572
9809940,4cyclictest0-21swapper/209:20:112
9809940,4cyclictest0-21swapper/209:16:172
9809940,4cyclictest0-21swapper/207:30:112
9809940,4cyclictest0-21swapper/207:20:142
9809940,3cyclictest31803-21ssh10:15:132
9809940,3cyclictest20449-21rm12:35:112
9809940,3cyclictest20117-21rm12:01:512
9809940,3cyclictest18734-21rm10:56:312
9809940,3cyclictest17004-21rm12:33:082
9809940,3cyclictest14218-21/usr/sbin/munin11:10:192
9809940,3cyclictest12090-21latency_hist11:10:012
9809940,0cyclictest0-21swapper/211:02:342
9779944,0cyclictest0-21swapper/111:46:401
9779944,0cyclictest0-21swapper/110:43:141
9779941,2cyclictest0-21swapper/112:00:121
9779941,2cyclictest0-21swapper/111:35:131
9779941,2cyclictest0-21swapper/111:20:151
9779941,2cyclictest0-21swapper/111:00:121
9779941,2cyclictest0-21swapper/110:55:141
9779941,2cyclictest0-21swapper/110:35:141
9779941,2cyclictest0-21swapper/108:45:121
9779941,2cyclictest0-21swapper/108:05:121
9779941,2cyclictest0-21swapper/107:55:111
9779941,2cyclictest0-21swapper/107:45:101
9779941,2cyclictest0-21swapper/107:30:121
9779941,2cyclictest0-21swapper/107:25:131
9779941,1cyclictest0-21swapper/110:05:131
9779941,1cyclictest0-21swapper/109:50:131
9779940,3cyclictest0-21swapper/111:40:131
9779940,2cyclictest0-21swapper/112:25:131
9779940,2cyclictest0-21swapper/111:10:121
9779940,2cyclictest0-21swapper/110:15:131
9849932,1cyclictest7253-21ssh10:35:133
9849931,1cyclictest0-21swapper/312:00:123
9849931,1cyclictest0-21swapper/308:25:113
9849931,1cyclictest0-21swapper/308:15:123
9849931,1cyclictest0-21swapper/307:40:023
9849930,3cyclictest9443-21/usr/sbin/munin08:30:133
9849930,3cyclictest6861-21basename07:20:143
9849930,3cyclictest24505-21apt-get09:00:123
9849930,3cyclictest20085-21perl08:50:143
9849930,3cyclictest1617-21df_inode07:10:133
9849930,3cyclictest13410-21ssh09:50:023
9849930,3cyclictest0-21swapper/311:10:083
9849930,3cyclictest0-21swapper/311:05:093
9849930,3cyclictest0-21swapper/309:30:133
9849930,3cyclictest0-21swapper/309:05:133
9849930,3cyclictest0-21swapper/308:55:013
9849930,3cyclictest0-21swapper/308:40:133
9849930,3cyclictest0-21swapper/307:35:033
9849930,3cyclictest0-21swapper/307:30:123
9849930,2cyclictest0-21swapper/307:55:113
9849930,1cyclictest16963-21ssh10:40:013
9809933,0cyclictest18539-21kworker/2:009:05:012
9809933,0cyclictest18539-21kworker/2:007:35:212
9809931,2cyclictest0-21swapper/208:55:142
9809931,2cyclictest0-21swapper/207:45:102
9809931,1cyclictest0-21swapper/208:40:132
9809931,1cyclictest0-21swapper/208:20:122
9809930,3cyclictest4517-21ssh10:50:002
9809930,3cyclictest30030-21fw_packets08:05:152
9809930,3cyclictest2766-21grep08:15:152
9809930,3cyclictest0-21swapper/211:45:122
9809930,3cyclictest0-21swapper/209:00:122
9809930,3cyclictest0-21swapper/208:45:032
9809930,3cyclictest0-21swapper/208:25:102
9809930,3cyclictest0-21swapper/208:00:092
9809930,3cyclictest0-21swapper/207:55:112
9809930,3cyclictest0-21swapper/207:50:122
9809930,3cyclictest0-21swapper/207:40:142
9809930,3cyclictest0-21swapper/207:25:132
9809930,3cyclictest0-21swapper/207:15:132
9809930,2cyclictest29738-21ssh09:10:122
9809930,2cyclictest0-21swapper/208:30:112
9779933,0cyclictest0-21swapper/111:50:271
9779931,2cyclictest0-21swapper/112:30:131
9779931,2cyclictest0-21swapper/107:35:111
9779931,1cyclictest0-21swapper/112:35:121
9779931,1cyclictest0-21swapper/112:20:121
9779931,1cyclictest0-21swapper/112:05:121
9779931,1cyclictest0-21swapper/110:45:121
9779931,1cyclictest0-21swapper/110:25:131
9779931,1cyclictest0-21swapper/110:00:091
9779931,1cyclictest0-21swapper/109:55:131
9779931,1cyclictest0-21swapper/109:05:131
9779931,1cyclictest0-21swapper/108:55:021
9779931,1cyclictest0-21swapper/108:50:131
9779931,1cyclictest0-21swapper/108:35:101
9779931,1cyclictest0-21swapper/107:15:131
9779930,3cyclictest0-21swapper/109:00:381
9779930,2cyclictest0-21swapper/111:55:101
9779930,2cyclictest0-21swapper/111:15:151
9779930,2cyclictest0-21swapper/109:35:151
9779930,2cyclictest0-21swapper/108:10:021
9779930,2cyclictest0-21swapper/107:40:131
9779921,1cyclictest0-21swapper/111:25:151
9779921,1cyclictest0-21swapper/107:50:121
9779920,1cyclictest0-21swapper/110:50:031
9779920,1cyclictest0-21swapper/110:10:121
9779920,1cyclictest0-21swapper/108:15:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional