You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-20 - 15:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Tue May 20, 2025 12:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
140547221280,2sleep30-21swapper/311:45:223
12854452970,1sleep20-21swapper/210:35:272
989613993120,6cyclictest1208453-21/usr/sbin/munin09:50:011
14012862290,1sleep00-21swapper/011:40:300
989612992617,5cyclictest1378286-21/usr/sbin/munin11:30:030
25010912518,2phc2sys0-21swapper/310:35:223
25010912518,2phc2sys0-21swapper/310:16:093
25010912418,2phc2sys0-21swapper/312:35:173
25010912418,2phc2sys0-21swapper/312:34:403
25010912418,2phc2sys0-21swapper/311:14:333
25010912418,2phc2sys0-21swapper/311:05:593
25010912418,2phc2sys0-21swapper/311:04:043
25010912418,2phc2sys0-21swapper/311:04:033
25010912418,2phc2sys0-21swapper/310:55:063
25010912418,2phc2sys0-21swapper/310:47:243
25010912418,2phc2sys0-21swapper/310:34:253
25010912418,2phc2sys0-21swapper/310:24:113
25010912418,2phc2sys0-21swapper/310:14:583
25010912418,2phc2sys0-21swapper/309:45:153
25010912418,2phc2sys0-21swapper/309:35:103
25010912418,2phc2sys0-21swapper/309:35:093
25010912418,2phc2sys0-21swapper/309:33:573
25010912418,2phc2sys0-21swapper/309:23:353
25010912418,2phc2sys0-21swapper/309:14:093
25010912417,2phc2sys0-21swapper/312:01:143
25010912417,2phc2sys0-21swapper/311:50:163
25010912417,2phc2sys0-21swapper/311:40:223
25010912417,2phc2sys0-21swapper/307:45:213
9837552230,6sleep20-21swapper/207:05:202
25010912318,3phc2sys0-21swapper/312:16:093
25010912318,3phc2sys0-21swapper/311:22:333
25010912318,3phc2sys0-21swapper/310:52:033
25010912318,3phc2sys0-21swapper/310:00:103
25010912318,3phc2sys0-21swapper/309:58:573
25010912318,3phc2sys0-21swapper/309:16:543
25010912317,3phc2sys0-21swapper/311:26:553
25010912317,2phc2sys0-21swapper/312:13:283
25010912317,2phc2sys0-21swapper/311:30:443
25010912317,2phc2sys0-21swapper/309:00:313
25010912317,2phc2sys0-21swapper/308:51:293
25010912317,2phc2sys0-21swapper/308:43:073
25010912317,2phc2sys0-21swapper/308:40:003
25010912317,2phc2sys0-21swapper/308:31:413
25010912317,2phc2sys0-21swapper/308:08:133
25010912317,2phc2sys0-21swapper/307:26:013
25010912317,2phc2sys0-21swapper/307:22:583
989613992219,2cyclictest1492491-21dump-pmu-power12:34:591
989612992211,6cyclictest0-21swapper/011:00:020
989612992211,6cyclictest0-21swapper/009:45:030
25010912217,3phc2sys0-21swapper/312:27:113
25010912217,3phc2sys0-21swapper/312:07:353
25010912217,3phc2sys0-21swapper/311:58:533
25010912217,3phc2sys0-21swapper/311:36:253
25010912217,3phc2sys0-21swapper/311:19:503
25010912217,3phc2sys0-21swapper/308:55:463
25010912217,3phc2sys0-21swapper/308:46:563
25010912217,3phc2sys0-21swapper/308:25:563
25010912217,3phc2sys0-21swapper/308:22:233
25010912217,3phc2sys0-21swapper/308:16:023
25010912217,3phc2sys0-21swapper/308:16:013
25010912217,3phc2sys0-21swapper/308:00:523
25010912217,3phc2sys0-21swapper/307:51:103
25010912217,3phc2sys0-21swapper/307:32:463
25010912217,2phc2sys0-21swapper/312:20:503
25010912217,2phc2sys0-21swapper/307:36:433
141058522218,2sleep20-21swapper/211:45:592
137536522218,2sleep20-21swapper/211:25:392
132384122218,2sleep20-21swapper/210:57:202
129873122217,3sleep30-21swapper/310:44:223
123788022218,2sleep20-21swapper/210:09:552
116432222218,2sleep30-21swapper/309:25:043
103404522218,2sleep30-21swapper/307:40:323
989613992118,2cyclictest1107177-21latency_hist08:45:001
989612992117,3cyclictest1-21systemd11:50:000
989612992112,5cyclictest1334815-21/usr/sbin/munin11:05:220
989612992112,5cyclictest1290550-21unin-run10:40:010
25010912117,2phc2sys0-21swapper/310:27:583
25010912117,2phc2sys0-21swapper/308:10:243
149888622117,2sleep20-21swapper/212:36:132
148193722117,2sleep20-21swapper/212:26:552
145559622117,2sleep20-21swapper/212:12:392
144510822117,2sleep20-21swapper/212:05:302
140181822117,2sleep20-21swapper/211:40:572
139387122117,2sleep20-21swapper/211:37:252
136825122117,2sleep20-21swapper/211:23:132
135874122117,2sleep20-21swapper/211:17:052
135073322117,2sleep20-21swapper/211:13:152
133564822118,2sleep20-21swapper/211:05:232
133306222117,2sleep20-21swapper/211:03:022
133306222117,2sleep20-21swapper/211:03:012
129706722117,2sleep20-21swapper/210:41:382
126973022117,2sleep20-21swapper/210:25:302
126244322117,2sleep20-21swapper/210:22:182
125305422117,2sleep20-21swapper/210:16:122
124417022117,2sleep20-21swapper/210:10:522
121987422117,2sleep20-21swapper/209:59:082
120698722118,2sleep20-21swapper/209:47:582
119913522118,2sleep30-21swapper/309:44:483
119853722117,2sleep20-21swapper/209:43:502
118800222117,2sleep20-21swapper/209:36:052
118800222117,2sleep20-21swapper/209:36:042
114492822117,2sleep20-21swapper/209:13:032
101011922117,2sleep20-21swapper/207:25:002
99543922017,2sleep20-21swapper/207:13:302
989613992017,2cyclictest1404306-21awk11:44:591
989613992017,2cyclictest1334570-21/usr/sbin/munin11:05:021
989613992017,2cyclictest1334570-21/usr/sbin/munin11:05:011
989613992017,2cyclictest1181651-21cron09:35:001
98961299209,6cyclictest0-21swapper/010:10:270
989612992017,2cyclictest1695-21dbus-daemon08:10:010
989612992017,2cyclictest1125542-21grep09:00:020
989612992017,2cyclictest1028358-21sendmail07:40:000
989612992012,4cyclictest1451642-21kthreadcore12:10:250
25010912017,2phc2sys0-21swapper/310:05:293
25010912017,2phc2sys0-21swapper/307:57:053
25010912017,2phc2sys0-21swapper/307:17:013
147369122017,2sleep20-21swapper/212:23:052
142242822017,2sleep20-21swapper/211:55:082
131568022017,2sleep20-21swapper/210:53:202
121017922017,2sleep20-21swapper/209:52:402
117204122017,2sleep20-21swapper/209:28:432
113707822017,2sleep20-21swapper/209:05:512
111912422017,2sleep20-21swapper/208:54:042
110695422017,2sleep20-21swapper/208:42:382
110079522017,2sleep20-21swapper/208:36:542
108927022017,2sleep20-21swapper/208:30:072
108868122017,2sleep20-21swapper/208:26:362
108264422017,2sleep20-21swapper/208:21:222
107151422017,2sleep20-21swapper/208:15:222
107151422017,2sleep20-21swapper/208:15:212
107080222017,2sleep20-21swapper/208:14:542
105845722017,2sleep20-21swapper/208:02:112
104624522017,2sleep20-21swapper/207:51:292
104025222017,2sleep20-21swapper/207:47:072
103437222017,2sleep20-21swapper/207:44:362
101586422017,2sleep20-21swapper/207:25:512
100402822017,2sleep20-21swapper/207:18:582
98961399194,8cyclictest1695-21dbus-daemon08:40:021
989612991911,7cyclictest1252394-21switchtime10:15:320
989614991816,1cyclictest0-21swapper/209:35:022
989614991815,1cyclictest0-21swapper/211:30:152
989613991815,2cyclictest1695-21dbus-daemon11:30:031
989613991815,2cyclictest1478471-21kthreadcore12:25:281
989613991815,2cyclictest1199500-21apt-config09:45:011
989613991815,2cyclictest1164059-21latency_hist09:25:001
989613991815,2cyclictest1070818-21cron08:15:001
989613991815,2cyclictest0-21swapper/112:25:001
98961299189,4cyclictest0-21swapper/012:24:590
98961299186,7cyclictest0-21swapper/010:40:240
98961299182,8cyclictest0-21swapper/010:08:080
989612991815,2cyclictest1700-21gmain10:29:540
989612991815,2cyclictest1352008-21cut11:15:010
989612991815,2cyclictest1131362-21cat09:04:590
989612991814,3cyclictest1174857-21kthreadcore09:30:260
989612991814,2cyclictest1040697-21sh07:50:010
989612991812,5cyclictest1273767-21cstates10:30:200
98961299180,16cyclictest1992-21runrttasks11:58:560
989614991715,1cyclictest0-21swapper/212:05:012
989614991714,1cyclictest0-21swapper/210:30:262
989613991714,2cyclictest996244-21munin-run07:15:031
989613991714,2cyclictest989610-21cyclictest09:28:221
989613991714,2cyclictest1498086-21mailstats12:35:281
989613991714,2cyclictest1308218-21systemd-run10:50:021
989613991714,2cyclictest1190532-21sh09:40:011
989613991714,2cyclictest1190532-21sh09:40:001
989613991714,2cyclictest0-21swapper/110:19:591
989613991713,3cyclictest1146188-21systemd-run09:15:001
989613991713,1cyclictest178850irq/121-eno110:55:271
989613991711,2cyclictest178850irq/121-eno110:10:261
989613991711,2cyclictest1423932-21kthreadcore11:55:251
98961399170,7cyclictest1229400-21cat10:05:021
98961299179,7cyclictest1380494-21kthreadcore11:30:230
98961299178,5cyclictest0-21swapper/009:21:520
98961299177,6cyclictest0-21swapper/011:50:210
98961299177,5cyclictest0-21swapper/012:40:000
98961299174,6cyclictest0-21swapper/011:00:170
98961299174,6cyclictest0-21swapper/011:00:160
989612991714,2cyclictest995604-21grep07:15:020
989612991714,2cyclictest1357371-21rt-features11:15:280
989612991714,2cyclictest1227896-21rm10:02:510
989612991714,2cyclictest1119481-21systemd08:55:020
989612991713,3cyclictest1031707-21kthreadcore07:40:250
989612991713,3cyclictest0-21swapper/008:05:030
989612991711,5cyclictest1200761-21fschecks_time09:45:220
25010911711,2phc2sys0-21swapper/309:51:573
989614991614,1cyclictest0-21swapper/211:50:262
989614991613,1cyclictest0-21swapper/208:50:012
989613991613,2cyclictest8799-21cron09:04:591
989613991613,2cyclictest1458477-21fschecks_time12:15:211
989613991613,2cyclictest1414961-21tr11:50:211
989613991613,2cyclictest1388102-21if_eno111:35:211
989613991613,2cyclictest1264255-21latency_hist10:25:011
989613991613,2cyclictest0-21swapper/107:30:001
989613991612,3cyclictest1325543-21kworker/u16:0+nfsiod11:46:591
989613991611,4cyclictest1695-21dbus-daemon08:30:021
98961299169,2cyclictest0-21swapper/012:01:040
98961299168,2cyclictest1100898-21kworker/u16:3-rpciod09:15:190
98961299167,2cyclictest0-21swapper/012:30:170
98961299163,8cyclictest1310045-21cat10:50:250
98961299161,7cyclictest1083205-21munin-run08:25:010
989612991614,1cyclictest0-21swapper/009:10:010
989612991613,2cyclictest171ktimers/009:27:340
989612991612,3cyclictest1119420-21kworker/u16:0+nfsiod09:35:210
989612991612,3cyclictest1119420-21kworker/u16:0+nfsiod09:35:200
989614991513,1cyclictest0-21swapper/212:30:292
989614991513,1cyclictest0-21swapper/209:00:022
989614991512,1cyclictest0-21swapper/212:20:022
989614991512,1cyclictest0-21swapper/210:45:212
98961399151,7cyclictest1695-21dbus-daemon09:00:011
989613991513,1cyclictest1152321-21runrttasks09:15:531
989613991512,2cyclictest9311-21sendmail-mta07:45:021
989613991512,2cyclictest1761-21gdbus11:25:001
989613991512,2cyclictest1761-21gdbus07:25:031
989613991512,2cyclictest1453801-21sh12:10:281
989613991512,2cyclictest1246742-21kworker/u16:1-rpciod10:25:281
989613991512,2cyclictest1211665-21dump-pmu-power09:59:551
989613991512,2cyclictest1023327-21gltestperf07:35:201
989613991512,2cyclictest0-21swapper/110:45:011
98961299151,6cyclictest1137414-21diskmemload09:55:010
989612991513,1cyclictest1246742-21kworker/u16:1-events_power_efficient10:50:010
989612991512,2cyclictest995780-21munin-node12:05:580
989612991512,2cyclictest1146420-21sh09:15:010
989612991512,2cyclictest1083546-21cpuspeed_turbos08:25:200
989612991512,2cyclictest1052706-21latency_hist08:00:010
989612991512,2cyclictest1010156-21perf07:25:010
989612991512,2cyclictest0-21swapper/010:00:010
989612991511,3cyclictest1098164-21kthreadcore08:35:460
2501091159,2phc2sys0-21swapper/309:09:413
12822252150,2sleep11282270-21aten_repower_po10:35:191
989614991411,1cyclictest0-21swapper/210:01:222
989614991411,1cyclictest0-21swapper/209:15:252
989614991411,1cyclictest0-21swapper/207:55:202
989614991411,1cyclictest0-21swapper/207:35:252
989614991411,1cyclictest0-21swapper/207:35:012
98961399141,7cyclictest1113395-21unin-run08:50:021
98961399141,3cyclictest1352275-21apt-get11:15:171
989613991411,2cyclictest2240602-1atopacctd08:20:011
989613991411,2cyclictest1387089-21latency_hist11:35:021
989613991411,2cyclictest1335829-21irqcore11:05:231
989613991411,2cyclictest1230287-21sh10:05:171
989613991411,2cyclictest1-21systemd07:10:011
989613991410,3cyclictest1440352-21cpuspeed_turbos12:05:201
989613991410,3cyclictest1345344-21kthreadcore11:10:241
989613991410,3cyclictest1114828-21kthreadcore08:50:241
989613991410,3cyclictest1044722-21kthreadcore07:50:451
98961299144,5cyclictest0-21swapper/011:20:230
98961299143,5cyclictest1101520-21aten2.4-expect08:40:180
989612991411,2cyclictest999488-21tr07:15:210
989612991411,2cyclictest1041945-21irqrtprio07:50:430
989612991411,2cyclictest0-21swapper/008:10:300
989612991410,3cyclictest2240602-1atopacctd12:25:260
989612991410,3cyclictest1257524-21kthreadcore10:20:250
98961299140,9cyclictest1457765-21/usr/sbin/munin12:15:160
98961299140,4cyclictest0-21swapper/008:45:190
989614991310,1cyclictest0-21swapper/209:20:252
989614991310,1cyclictest0-21swapper/208:10:012
98961399139,3cyclictest1036085-21kthreadcore07:45:241
98961399139,3cyclictest1019330-21kthreadcore07:30:251
989613991310,2cyclictest1309560-21irqcore10:50:241
989613991310,2cyclictest1273490-21aten_repower_fr10:30:191
989613991310,2cyclictest1132986-21kernelversion09:05:271
989613991310,2cyclictest1072265-21tr08:15:241
989613991310,2cyclictest1072265-21tr08:15:231
989613991310,2cyclictest1001164-21kthreadcore07:15:221
989612991310,2cyclictest1388707-21kthreadcore11:35:230
989612991310,2cyclictest1074077-21kthreadcore08:15:260
989612991310,2cyclictest1074077-21kthreadcore08:15:250
989612991310,2cyclictest1022291-21perf07:35:010
989612991310,2cyclictest1011142-21gltestperf07:25:200
989614991210,1cyclictest0-21swapper/209:00:462
98961399129,2cyclictest2240602-1atopacctd08:00:221
98961399129,2cyclictest1432134-21idleruntime12:00:211
98961399129,2cyclictest1089473-21aten2.4-expect08:30:201
98961399129,2cyclictest1048407-21kthreadcore07:55:251
98961399127,4cyclictest3863153-21avahi-daemon08:05:041
98961399126,4cyclictest178850irq/121-eno109:50:351
98961299129,2cyclictest0-21swapper/007:10:010
98961299123,4cyclictest1089735-21expr08:30:200
9954052118,2sleep30-21swapper/307:13:023
2501091111,5phc2sys0-21swapper/307:05:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional