You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-01 - 20:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Wed May 01, 2024 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
108542200184,11sleep10-21swapper/107:09:481
105932193174,14sleep00-21swapper/007:06:250
106932185168,12sleep30-21swapper/307:07:453
99452175158,13sleep20-21swapper/207:05:322
264912500,0sleep20-21swapper/210:55:322
306562480,0sleep10-21swapper/109:22:551
272422450,0sleep20-21swapper/210:16:522
207232440,0sleep10-21swapper/109:54:301
43872430,0sleep20-21swapper/211:42:592
252492410,0sleep00-21swapper/011:15:190
23542410,0sleep20-21swapper/210:02:062
148622110,0sleep10-21swapper/109:14:131
110529992,3cyclictest30952-21sendmail-msp12:19:590
110529992,3cyclictest19155-21perf07:25:010
110529991,4cyclictest23627-21munin-run11:15:000
20692270,0sleep10-21swapper/112:13:121
110559960,5cyclictest0-21swapper/211:00:112
110529960,3cyclictest30072-21perf10:00:010
110529960,3cyclictest14412-21cron12:29:590
30100250,4sleep030124-21ssh09:40:270
12582250,0sleep10-21swapper/111:07:321
110599955,0cyclictest0-21swapper/311:31:253
110599955,0cyclictest0-21swapper/310:16:123
110599955,0cyclictest0-21swapper/307:40:303
110599950,5cyclictest0-21swapper/311:17:543
110599950,5cyclictest0-21swapper/310:31:123
110599950,5cyclictest0-21swapper/309:22:133
110599950,4cyclictest0-21swapper/308:00:133
110559955,0cyclictest0-21swapper/211:10:342
110559955,0cyclictest0-21swapper/209:30:272
110559954,1cyclictest0-21swapper/212:33:122
110559954,1cyclictest0-21swapper/207:20:132
110559953,2cyclictest301ktimersoftd/209:40:462
110559953,2cyclictest301ktimersoftd/209:21:032
110559953,1cyclictest21833-21apt-get07:30:102
110559952,2cyclictest31937-21apt-get07:50:102
110559951,3cyclictest7473-21apt-get10:25:012
110559951,3cyclictest24104-21apt-get10:35:132
110559951,2cyclictest0-21swapper/212:20:112
110559950,5cyclictest0-21swapper/210:10:292
110559950,4cyclictest6692-21cut10:05:122
110559950,4cyclictest13047-21apt-get09:50:102
110559950,4cyclictest0-21swapper/212:10:092
110559950,4cyclictest0-21swapper/212:00:002
110559950,4cyclictest0-21swapper/207:55:012
110539950,5cyclictest0-21swapper/112:26:161
110539950,5cyclictest0-21swapper/112:05:011
110539950,5cyclictest0-21swapper/111:58:371
110529955,0cyclictest0-21swapper/011:52:180
110529955,0cyclictest0-21swapper/010:15:590
110529954,1cyclictest3-21ksoftirqd/011:40:000
110529952,1cyclictest15626-21munin-plugin-st11:10:000
110529951,3cyclictest0-21swapper/009:35:120
110529950,5cyclictest0-21swapper/012:09:030
110529950,5cyclictest0-21swapper/011:49:070
110529950,5cyclictest0-21swapper/009:53:080
7818240,0sleep00-21swapper/009:46:270
4739240,0sleep10-21swapper/110:23:121
28706240,0sleep00-21swapper/010:57:220
110599944,0cyclictest13601-21kworker/3:209:55:113
110599944,0cyclictest0-21swapper/312:36:203
110599944,0cyclictest0-21swapper/312:25:243
110599944,0cyclictest0-21swapper/312:05:023
110599944,0cyclictest0-21swapper/310:35:073
110599944,0cyclictest0-21swapper/310:02:503
110599943,1cyclictest19280-21unixbench_singl08:25:263
110599943,1cyclictest15277-21cut10:10:123
110599941,1cyclictest0-21swapper/310:40:093
110599940,4cyclictest6359-21python09:05:283
110599940,4cyclictest18965-21ssh12:32:073
110599940,4cyclictest0-21swapper/312:20:523
110599940,4cyclictest0-21swapper/312:17:153
110599940,4cyclictest0-21swapper/311:36:323
110599940,4cyclictest0-21swapper/311:25:113
110599940,4cyclictest0-21swapper/311:20:113
110599940,4cyclictest0-21swapper/311:12:443
110599940,4cyclictest0-21swapper/310:58:413
110599940,4cyclictest0-21swapper/310:52:273
110599940,4cyclictest0-21swapper/310:45:093
110599940,4cyclictest0-21swapper/310:20:103
110599940,4cyclictest0-21swapper/310:09:483
110599940,4cyclictest0-21swapper/309:50:103
110599940,4cyclictest0-21swapper/309:10:223
110599940,4cyclictest0-21swapper/307:55:303
110599940,4cyclictest0-21swapper/307:45:103
110599940,4cyclictest0-21swapper/307:25:113
110599940,3cyclictest9358-21ssh11:45:273
110599940,3cyclictest7072-21diskmemload11:40:453
110599940,3cyclictest32297-21apt08:55:093
110599940,3cyclictest27756-21sh09:40:033
110599940,3cyclictest19928-21/usr/sbin/munin08:30:123
110599940,3cyclictest18972-21ssh09:35:023
110599940,3cyclictest15113-21ssh12:10:013
110599940,3cyclictest14828-21sed08:20:013
110599940,3cyclictest13610-21munin-node07:15:013
110599940,3cyclictest10249-21ssh09:30:063
110599940,3cyclictest1016-21irqstats11:00:163
110559944,0cyclictest31-21ksoftirqd/207:45:162
110559944,0cyclictest301ktimersoftd/211:55:122
110559944,0cyclictest301ktimersoftd/209:55:312
110559943,1cyclictest31-21ksoftirqd/208:15:222
110559943,1cyclictest15707-21apt-get11:30:122
110559942,2cyclictest7029-21taskset12:05:022
110559942,2cyclictest31-21ksoftirqd/211:08:462
110559942,2cyclictest301ktimersoftd/210:21:132
110559942,2cyclictest301ktimersoftd/209:11:142
110559942,2cyclictest301ktimersoftd/208:43:132
110559942,2cyclictest16119-21apt-get10:50:102
110559941,3cyclictest301ktimersoftd/209:28:012
110559941,2cyclictest23315-21apt-get12:15:122
110559941,2cyclictest0-21swapper/209:35:132
110559940,4cyclictest9576-21ssh11:45:382
110559940,4cyclictest25178-21irqstats11:15:182
110559940,4cyclictest16959-21df_inode09:15:142
110559940,4cyclictest0-21swapper/212:39:282
110559940,4cyclictest0-21swapper/211:50:112
110559940,4cyclictest0-21swapper/211:27:382
110559940,4cyclictest0-21swapper/211:22:072
110559940,4cyclictest0-21swapper/210:46:422
110559940,4cyclictest0-21swapper/209:50:002
110559940,4cyclictest0-21swapper/208:50:122
110559940,4cyclictest0-21swapper/208:30:102
110559940,4cyclictest0-21swapper/207:40:112
110559940,3cyclictest7241-21cat09:10:002
110559940,3cyclictest15883-21apt-get10:30:112
110559940,1cyclictest32210-21/usr/sbin/munin10:40:172
110559940,1cyclictest24299-21/usr/sbin/munin07:35:162
110559940,1cyclictest2363-21/usr/sbin/munin09:00:262
110559940,1cyclictest14989-21/usr/sbin/munin08:20:132
110539944,0cyclictest0-21swapper/112:32:311
110539944,0cyclictest0-21swapper/112:00:131
110539944,0cyclictest0-21swapper/110:45:431
110539944,0cyclictest0-21swapper/110:36:151
110539944,0cyclictest0-21swapper/110:16:291
110539944,0cyclictest0-21swapper/108:30:231
110539941,2cyclictest0-21swapper/110:05:101
110539941,2cyclictest0-21swapper/110:00:071
110539941,2cyclictest0-21swapper/109:15:111
110539941,2cyclictest0-21swapper/108:40:101
110539941,2cyclictest0-21swapper/108:35:091
110539941,2cyclictest0-21swapper/108:25:131
110539940,4cyclictest0-21swapper/109:43:171
110539940,2cyclictest0-21swapper/108:05:131
110539940,2cyclictest0-21swapper/108:05:131
110539940,0cyclictest0-21swapper/111:43:201
110539940,0cyclictest0-21swapper/110:30:431
110539940,0cyclictest0-21swapper/109:26:071
110529944,0cyclictest0-21swapper/012:12:590
110529944,0cyclictest0-21swapper/010:53:490
110529944,0cyclictest0-21swapper/010:01:000
110529944,0cyclictest0-21swapper/008:49:150
110529940,4cyclictest5995-21ssh12:04:210
110529940,4cyclictest0-21swapper/012:20:100
110529940,4cyclictest0-21swapper/010:46:440
110529940,4cyclictest0-21swapper/010:12:050
110529940,4cyclictest0-21swapper/009:24:330
110529940,4cyclictest0-21swapper/008:24:220
110529940,4cyclictest0-21swapper/008:00:130
110529940,4cyclictest0-21swapper/007:51:040
110529940,3cyclictest8087-21ssh09:28:400
110529940,3cyclictest7935-21grep09:10:140
110529940,3cyclictest7419-21cut10:05:140
110529940,3cyclictest3637-21ssh11:42:230
110529940,3cyclictest32631-21/usr/sbin/munin11:20:130
110529940,3cyclictest27538-21perl07:40:150
110529940,3cyclictest25881-21ssh10:35:260
110529940,3cyclictest23149-21rm11:55:020
110529940,3cyclictest14888-21expr07:15:160
110529940,3cyclictest12660-21expr08:15:150
110529940,3cyclictest10564-21ssh10:26:050
110529940,3cyclictest10224-21ssh09:30:050
110529940,3cyclictest0-21swapper/010:20:220
110529940,3cyclictest0-21swapper/008:10:090
110529940,1cyclictest13404-21idleruntime-cro07:15:000
110529940,0cyclictest0-21swapper/007:36:560
28212230,0sleep10-21swapper/112:38:061
1132230,0sleep10-21swapper/111:20:201
110599932,1cyclictest31281-21readlink12:00:003
110599932,1cyclictest15093-21ssh11:50:023
110599931,1cyclictest7024-21cron10:25:013
110599931,1cyclictest11044-21cyclictest08:50:113
110599931,1cyclictest0-21swapper/308:10:103
110599931,1cyclictest0-21swapper/307:10:113
110599930,3cyclictest7144-21apt-get08:05:113
110599930,3cyclictest7144-21apt-get08:05:113
110599930,3cyclictest7072-21diskmemload09:45:013
110599930,3cyclictest7072-21diskmemload09:15:063
110599930,3cyclictest23243-21sh11:55:083
110599930,3cyclictest0-21swapper/311:05:073
110599930,3cyclictest0-21swapper/309:25:043
110599930,3cyclictest0-21swapper/309:00:123
110599930,3cyclictest0-21swapper/308:45:103
110599930,3cyclictest0-21swapper/308:40:113
110599930,3cyclictest0-21swapper/308:35:103
110599930,3cyclictest0-21swapper/308:20:013
110599930,3cyclictest0-21swapper/307:50:023
110599930,3cyclictest0-21swapper/307:35:003
110599930,3cyclictest0-21swapper/307:30:093
110599930,3cyclictest0-21swapper/307:20:143
110559933,0cyclictest31-21ksoftirqd/207:15:012
110559933,0cyclictest301ktimersoftd/212:25:022
110559933,0cyclictest301ktimersoftd/208:55:092
110559932,1cyclictest17467-21apt-get08:25:132
110559931,2cyclictest19366-21apt-get07:25:102
110559931,1cyclictest0-21swapper/208:05:122
110559931,1cyclictest0-21swapper/208:05:112
110559930,3cyclictest0-21swapper/211:35:092
110559930,3cyclictest0-21swapper/208:45:092
110559930,3cyclictest0-21swapper/208:35:012
110559930,3cyclictest0-21swapper/208:10:082
110559930,3cyclictest0-21swapper/208:00:092
110559930,3cyclictest0-21swapper/207:10:102
110539933,0cyclictest0-21swapper/110:10:561
110539931,1cyclictest0-21swapper/112:20:101
110539931,1cyclictest0-21swapper/112:15:121
110539931,1cyclictest0-21swapper/111:35:111
110539931,1cyclictest0-21swapper/111:25:111
110539931,1cyclictest0-21swapper/111:10:091
110539931,1cyclictest0-21swapper/110:50:101
110539931,1cyclictest0-21swapper/110:25:011
110539931,1cyclictest0-21swapper/109:55:121
110539931,1cyclictest0-21swapper/109:45:111
110539931,1cyclictest0-21swapper/109:30:131
110539931,1cyclictest0-21swapper/109:05:121
110539931,1cyclictest0-21swapper/109:00:141
110539931,1cyclictest0-21swapper/108:55:101
110539931,1cyclictest0-21swapper/108:50:121
110539931,1cyclictest0-21swapper/108:45:101
110539931,1cyclictest0-21swapper/108:15:011
110539931,1cyclictest0-21swapper/107:45:111
110539931,1cyclictest0-21swapper/107:35:081
110539931,1cyclictest0-21swapper/107:15:141
110539930,2cyclictest0-21swapper/108:20:101
110539930,2cyclictest0-21swapper/107:50:101
110539930,1cyclictest0-21swapper/107:40:121
110529933,0cyclictest3-21ksoftirqd/008:05:110
110529933,0cyclictest3-21ksoftirqd/008:05:110
110529931,1cyclictest24975-21aten2_r5power_v08:40:110
110529931,1cyclictest22401-21apt-get08:35:090
110529931,1cyclictest0-21swapper/008:30:100
110529930,3cyclictest7072-21diskmemload11:30:110
110529930,3cyclictest0-21swapper/012:35:030
110529930,3cyclictest0-21swapper/012:30:120
110529930,3cyclictest0-21swapper/011:25:020
110529930,3cyclictest0-21swapper/011:00:100
110529930,3cyclictest0-21swapper/010:40:090
110529930,3cyclictest0-21swapper/010:30:110
110529930,3cyclictest0-21swapper/009:15:030
110529930,3cyclictest0-21swapper/009:05:130
110529930,3cyclictest0-21swapper/009:00:140
110529930,3cyclictest0-21swapper/008:55:090
110529930,3cyclictest0-21swapper/008:50:010
110529930,3cyclictest0-21swapper/008:25:120
110529930,3cyclictest0-21swapper/007:55:020
110529930,3cyclictest0-21swapper/007:45:110
110529930,3cyclictest0-21swapper/007:30:090
110529930,3cyclictest0-21swapper/007:25:010
110539921,1cyclictest0-21swapper/110:55:101
110539921,1cyclictest0-21swapper/107:55:101
110539921,1cyclictest0-21swapper/107:20:131
110539920,1cyclictest24020-21chrt07:34:321
110539920,1cyclictest15097-21chrt11:50:021
110539920,1cyclictest11697-21chrt08:13:071
110539920,1cyclictest0-21swapper/111:45:111
110539920,1cyclictest0-21swapper/111:30:121
110539920,1cyclictest0-21swapper/111:15:111
110539920,1cyclictest0-21swapper/111:00:101
110539920,1cyclictest0-21swapper/110:40:101
110539920,1cyclictest0-21swapper/109:35:121
110539920,1cyclictest0-21swapper/108:00:161
110539920,1cyclictest0-21swapper/107:25:101
110539920,1cyclictest0-21swapper/107:10:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional