You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 19:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Aug 21, 2025 12:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
175502203186,12sleep10-21swapper/107:05:311
178472188172,11sleep00-21swapper/007:09:230
175822181165,12sleep30-21swapper/307:05:583
178422174156,13sleep20-21swapper/207:09:212
303842440,0sleep10-21swapper/111:10:211
57742410,0sleep10-21swapper/110:42:011
60332130,0sleep10-21swapper/111:15:121
7112100,0sleep20-21swapper/212:17:432
280272100,0sleep20-21swapper/209:49:062
224712100,0sleep10-21swapper/112:29:061
180919993,3cyclictest8795-21munin-run07:55:000
180919982,3cyclictest6348-21perf08:55:000
180919980,4cyclictest23653-21cron07:20:000
180919972,4cyclictest5525-21awk11:15:000
181029955,0cyclictest20570-21kworker/3:211:47:463
181029955,0cyclictest20570-21kworker/3:211:02:593
181029955,0cyclictest20570-21kworker/3:210:07:013
181029955,0cyclictest20570-21kworker/3:209:11:033
181029950,5cyclictest29052-21apt-get07:30:013
181029950,5cyclictest0-21swapper/312:15:123
181029950,5cyclictest0-21swapper/309:50:223
181029950,4cyclictest13877-21ssh10:30:153
181029950,4cyclictest0-21swapper/307:50:123
180989954,0cyclictest31-21ksoftirqd/207:30:132
180989950,5cyclictest0-21swapper/212:04:092
180989950,5cyclictest0-21swapper/211:45:112
180989950,5cyclictest0-21swapper/211:25:352
180989950,5cyclictest0-21swapper/210:26:482
180989950,5cyclictest0-21swapper/210:09:552
180989950,5cyclictest0-21swapper/209:43:092
180989950,5cyclictest0-21swapper/209:37:112
180989950,5cyclictest0-21swapper/209:27:262
180989950,4cyclictest16021-21sh11:20:122
180929951,3cyclictest0-21swapper/111:35:101
180929951,2cyclictest0-21swapper/112:05:091
180929951,2cyclictest0-21swapper/110:20:121
180929951,2cyclictest0-21swapper/110:00:161
180929951,2cyclictest0-21swapper/108:55:131
180929950,5cyclictest0-21swapper/112:35:231
180929950,5cyclictest0-21swapper/109:57:041
180929950,5cyclictest0-21swapper/109:27:491
180929950,5cyclictest0-21swapper/107:20:121
180929950,1cyclictest0-21swapper/111:50:161
180929950,0cyclictest0-21swapper/107:50:191
180919950,5cyclictest0-21swapper/011:38:320
180919950,5cyclictest0-21swapper/010:54:190
180919950,5cyclictest0-21swapper/009:56:490
180919950,5cyclictest0-21swapper/008:35:160
180919950,4cyclictest31414-21latency_hist07:35:000
180919950,3cyclictest699-21ssh12:17:420
180919950,1cyclictest4750-21munin-run10:10:010
26672240,0sleep10-21swapper/109:15:301
181029943,1cyclictest24008-21grep10:35:153
181029942,1cyclictest31339-21sendmail08:40:013
181029940,4cyclictest9772-21ssh11:32:583
181029940,4cyclictest21008-21sshd12:11:103
181029940,4cyclictest0-21swapper/312:37:383
181029940,4cyclictest0-21swapper/312:30:023
181029940,4cyclictest0-21swapper/312:21:243
181029940,4cyclictest0-21swapper/312:05:053
181029940,4cyclictest0-21swapper/311:40:123
181029940,4cyclictest0-21swapper/311:25:163
181029940,4cyclictest0-21swapper/311:20:123
181029940,4cyclictest0-21swapper/311:15:133
181029940,4cyclictest0-21swapper/311:10:433
181029940,4cyclictest0-21swapper/311:06:323
181029940,4cyclictest0-21swapper/310:52:543
181029940,4cyclictest0-21swapper/310:45:123
181029940,4cyclictest0-21swapper/310:40:123
181029940,4cyclictest0-21swapper/310:29:093
181029940,4cyclictest0-21swapper/310:20:043
181029940,4cyclictest0-21swapper/310:16:553
181029940,4cyclictest0-21swapper/310:10:503
181029940,4cyclictest0-21swapper/310:00:163
181029940,4cyclictest0-21swapper/309:58:383
181029940,4cyclictest0-21swapper/309:46:193
181029940,4cyclictest0-21swapper/309:40:123
181029940,4cyclictest0-21swapper/309:35:143
181029940,4cyclictest0-21swapper/308:55:163
181029940,4cyclictest0-21swapper/308:50:123
181029940,4cyclictest0-21swapper/308:15:203
181029940,3cyclictest5455-21ssh10:58:223
181029940,3cyclictest32196-21cut07:35:163
181029940,3cyclictest30453-21ssh12:00:093
181029940,3cyclictest28981-21ssh09:33:173
181029940,3cyclictest265862sleep308:30:043
181029940,3cyclictest24356-21ssh09:15:133
181029940,3cyclictest12412-21systemctl11:50:203
181029940,1cyclictest16020-21ntpq12:25:193
181029940,1cyclictest14037-21diskstats11:35:123
180989944,0cyclictest0-21swapper/207:40:022
180989942,1cyclictest32003-21ssh12:33:592
180989941,1cyclictest0-21swapper/212:05:092
180989941,1cyclictest0-21swapper/208:35:112
180989940,4cyclictest24464-21diskmemload10:03:202
180989940,4cyclictest20427-21ntp_states08:15:202
180989940,4cyclictest0-21swapper/212:12:332
180989940,4cyclictest0-21swapper/211:50:132
180989940,4cyclictest0-21swapper/211:40:022
180989940,4cyclictest0-21swapper/211:35:102
180989940,4cyclictest0-21swapper/211:10:122
180989940,4cyclictest0-21swapper/211:05:132
180989940,4cyclictest0-21swapper/211:00:132
180989940,4cyclictest0-21swapper/210:50:132
180989940,4cyclictest0-21swapper/210:45:122
180989940,4cyclictest0-21swapper/210:40:012
180989940,4cyclictest0-21swapper/210:35:132
180989940,4cyclictest0-21swapper/210:32:212
180989940,4cyclictest0-21swapper/209:30:122
180989940,4cyclictest0-21swapper/209:20:132
180989940,4cyclictest0-21swapper/209:05:132
180989940,4cyclictest0-21swapper/208:20:112
180989940,4cyclictest0-21swapper/208:10:122
180989940,4cyclictest0-21swapper/207:35:142
180989940,4cyclictest0-21swapper/207:25:132
180989940,3cyclictest7089-21latency_hist09:55:012
180989940,3cyclictest5094-21sed10:10:022
180989940,3cyclictest27574-21if_eth408:30:162
180989940,3cyclictest25771-21ntp_states09:15:182
180989940,3cyclictest25401-21ntp_states08:25:202
180989940,3cyclictest2276-21diskstats12:35:142
180989940,3cyclictest21138-21diskstats07:15:012
180989940,3cyclictest15167-21df12:25:142
180989940,3cyclictest14181-21runrttasks08:05:012
180989940,3cyclictest12052-21diskstats08:00:162
180989940,3cyclictest11501-21date09:05:012
180989940,2cyclictest0-21swapper/210:20:122
180989940,1cyclictest10666-21ssh12:22:482
180989940,1cyclictest0-21swapper/209:55:132
180929944,0cyclictest0-21swapper/109:40:371
180929944,0cyclictest0-21swapper/109:36:071
180929944,0cyclictest0-21swapper/108:10:411
180929943,1cyclictest0-21swapper/111:06:101
180929941,2cyclictest0-21swapper/112:10:121
180929941,2cyclictest0-21swapper/111:20:121
180929941,2cyclictest0-21swapper/110:35:121
180929941,2cyclictest0-21swapper/110:25:121
180929941,2cyclictest0-21swapper/110:15:121
180929941,2cyclictest0-21swapper/110:05:131
180929941,2cyclictest0-21swapper/107:15:131
180929941,1cyclictest0-21swapper/108:35:111
180929940,4cyclictest0-21swapper/108:34:501
180929940,4cyclictest0-21swapper/107:36:471
180929940,2cyclictest0-21swapper/107:10:121
180929940,0cyclictest0-21swapper/110:30:231
180919944,0cyclictest0-21swapper/012:03:250
180919944,0cyclictest0-21swapper/010:32:200
180919944,0cyclictest0-21swapper/009:35:090
180919943,1cyclictest18463-21gltestperf12:10:140
180919943,1cyclictest15451-21/usr/sbin/munin10:15:150
180919942,1cyclictest20500-21/usr/sbin/munin11:55:190
180919941,2cyclictest0-21swapper/011:30:110
180919940,4cyclictest24187-21ssh12:30:050
180919940,4cyclictest16671-21/usr/sbin/munin08:10:160
180919940,4cyclictest14182-21apt-get08:05:020
180919940,4cyclictest0-21swapper/012:35:120
180919940,4cyclictest0-21swapper/010:20:130
180919940,4cyclictest0-21swapper/009:42:190
180919940,4cyclictest0-21swapper/009:34:500
180919940,4cyclictest0-21swapper/007:55:120
180919940,4cyclictest0-21swapper/007:40:130
180919940,3cyclictest3860-21df_inode10:25:150
180919940,3cyclictest25882-21sh11:25:120
180919940,3cyclictest2256-21memory10:40:170
180919940,3cyclictest1612-21/usr/sbin/munin08:45:200
180919940,3cyclictest15420-21ssh09:10:180
180919940,3cyclictest12458-21sh10:13:270
180919940,3cyclictest0-21swapper/009:45:120
180919940,2cyclictest32194-21uptime09:50:260
180919940,1cyclictest9054-21/usr/sbin/munin09:00:140
180919940,1cyclictest8636-21/usr/sbin/munin11:00:180
180919940,1cyclictest4068-21/usr/sbin/munin07:45:170
180919940,1cyclictest2976-21hddtemp_smartct09:20:160
180919940,1cyclictest26376-21munin-run08:30:000
180919940,1cyclictest24345-21/usr/sbin/munin09:15:150
180919940,1cyclictest24008-21tr07:20:130
180919940,1cyclictest23441-21wc10:35:130
180919940,1cyclictest23385-21/usr/sbin/munin11:40:140
24395230,0sleep10-21swapper/110:51:101
181029931,1cyclictest27238-21smartctl07:25:163
181029931,1cyclictest0-21swapper/308:00:143
181029930,3cyclictest90412sleep309:00:023
181029930,3cyclictest21715-21basename08:20:123
181029930,3cyclictest20252-21ssh11:55:013
181029930,3cyclictest1804-21ssh09:20:033
181029930,3cyclictest17513-21smartctl08:10:153
181029930,3cyclictest0-21swapper/309:25:103
181029930,3cyclictest0-21swapper/308:45:123
181029930,3cyclictest0-21swapper/308:40:193
181029930,3cyclictest0-21swapper/308:25:013
181029930,3cyclictest0-21swapper/308:05:133
181029930,3cyclictest0-21swapper/307:55:123
181029930,3cyclictest0-21swapper/307:45:143
181029930,3cyclictest0-21swapper/307:40:143
181029930,3cyclictest0-21swapper/307:20:123
181029930,3cyclictest0-21swapper/307:15:003
181029930,3cyclictest0-21swapper/307:10:123
181029930,0cyclictest11535-21apt-get09:05:133
180989933,0cyclictest20651-21kworker/2:210:55:062
180989932,1cyclictest3381-21ssh11:30:032
180989932,1cyclictest30997-21snmpd07:45:252
180989931,2cyclictest20651-21kworker/2:207:51:372
180989931,1cyclictest0-21swapper/211:15:132
180989931,1cyclictest0-21swapper/210:15:122
180989931,1cyclictest0-21swapper/207:20:132
180989930,3cyclictest9297-21grep07:55:132
180989930,3cyclictest4086-21apt-get08:50:122
180989930,3cyclictest2144-21diskstats08:45:142
180989930,3cyclictest0-21swapper/211:55:112
180989930,3cyclictest0-21swapper/209:10:162
180989930,3cyclictest0-21swapper/208:55:132
180989930,3cyclictest0-21swapper/208:40:122
180989930,3cyclictest0-21swapper/207:10:122
180929933,0cyclictest0-21swapper/112:31:521
180929933,0cyclictest0-21swapper/111:44:361
180929933,0cyclictest0-21swapper/109:51:501
180929933,0cyclictest0-21swapper/107:45:481
180929931,1cyclictest0-21swapper/112:20:131
180929931,1cyclictest0-21swapper/111:55:121
180929931,1cyclictest0-21swapper/111:45:111
180929931,1cyclictest0-21swapper/111:30:011
180929931,1cyclictest0-21swapper/111:00:131
180929931,1cyclictest0-21swapper/110:55:131
180929931,1cyclictest0-21swapper/110:10:021
180929931,1cyclictest0-21swapper/109:10:151
180929931,1cyclictest0-21swapper/109:00:121
180929931,1cyclictest0-21swapper/108:45:121
180929931,1cyclictest0-21swapper/108:00:141
180929931,1cyclictest0-21swapper/107:30:141
180929931,1cyclictest0-21swapper/107:25:141
180929930,2cyclictest0-21swapper/109:20:141
180929930,2cyclictest0-21swapper/109:05:131
180929930,2cyclictest0-21swapper/108:05:011
180929930,1cyclictest0-21swapper/112:15:121
180919932,1cyclictest30834-21ssh10:55:040
180919932,1cyclictest27194-21fschecks_count08:30:150
180919932,1cyclictest11226-21ls11:50:150
180919931,1cyclictest17732-21apt-get10:00:150
180919931,1cyclictest0-21swapper/008:55:130
180919931,1cyclictest0-21swapper/007:25:140
180919930,3cyclictest8850-21if_eth412:05:120
180919930,3cyclictest5390-21df_inode12:20:150
180919930,3cyclictest31890-21grep08:40:140
180919930,3cyclictest31534-21dpkg07:35:140
180919930,3cyclictest19156-21apt-get08:15:130
180919930,3cyclictest18703-21df07:10:130
180919930,3cyclictest18658-21apt11:05:130
180919930,3cyclictest16579-21df_inode11:20:150
180919930,3cyclictest145382sleep012:25:090
180919930,3cyclictest11106-21cut10:45:120
180919930,3cyclictest0-21swapper/011:45:110
180919930,3cyclictest0-21swapper/011:15:020
180919930,3cyclictest0-21swapper/009:25:120
180919930,3cyclictest0-21swapper/009:05:040
180919930,3cyclictest0-21swapper/008:00:030
180919930,1cyclictest0-21swapper/008:20:110
14947230,0sleep10-21swapper/110:46:311
180929921,1cyclictest0-21swapper/112:00:011
180929921,1cyclictest0-21swapper/108:50:131
180929921,1cyclictest0-21swapper/108:15:131
180929920,1cyclictest10476-21taskset07:55:191
180929920,1cyclictest0-21swapper/111:25:111
180929920,1cyclictest0-21swapper/109:45:121
180929920,1cyclictest0-21swapper/109:30:121
180929920,1cyclictest0-21swapper/108:40:131
180929920,1cyclictest0-21swapper/108:25:151
180929920,1cyclictest0-21swapper/108:20:111
180929920,1cyclictest0-21swapper/107:40:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional