You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-26 - 18:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Tue Aug 26, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1089524994126,13cyclictest1204672-21sh10:44:452
108952399404,7cyclictest1304739-21/usr/sbin/munin12:42:241
1089522994022,5cyclictest1130481-21apt-get09:14:430
1089522993815,6cyclictest1235471-21ssh11:22:540
1089522993725,5cyclictest1114091-21cpuspeed08:27:140
1089522993530,1cyclictest0-21swapper/012:42:240
108952399333,4cyclictest1259712-21tune2fs11:52:161
108952299330,5cyclictest1189549-21/usr/sbin/munin10:27:160
108952399322,9cyclictest1194471-21ssh10:32:261
108952399321,8cyclictest1264846-21ssh11:57:211
1089522993223,6cyclictest1204096-21sendmail-msp10:44:450
108952399311,4cyclictest1160894-21grep09:52:151
1089522993123,5cyclictest1272885-21gltestperf12:07:160
1089524993023,6cyclictest1304145-21cut12:42:192
108952399303,6cyclictest0-21swapper/109:59:441
108952399301,9cyclictest1256281-21/usr/sbin/munin11:47:301
108952299301,21cyclictest1126721-21grep09:02:260
108952499295,5cyclictest171rcu_preempt09:59:442
108952399292,7cyclictest111788-21systemd-journal12:24:451
108952399292,4cyclictest1156834-21cut09:47:161
108952299294,19cyclictest1247179-21open_files11:37:240
1089522992914,3cyclictest0-21swapper/010:37:260
108952399285,7cyclictest1109862-21base6408:14:421
108952399283,24cyclictest1244652-21grep11:34:421
108952399281,7cyclictest1153077-21grep09:42:181
108952399281,7cyclictest1140875-21cut09:27:161
1089523992812,4cyclictest11050irq/107-eth%d10:47:211
1089522992816,2cyclictest0-21swapper/010:19:440
108952299281,21cyclictest0-21swapper/010:07:190
108952299280,4cyclictest1142987-21latency_hist09:29:420
108952299280,20cyclictest0-21swapper/009:37:200
108952499274,19cyclictest1250601-21find11:42:142
108952399274,4cyclictest0-21swapper/107:32:151
108952399273,5cyclictest1214231-21cut10:57:171
108952399273,3cyclictest1222751-21/usr/sbin/munin11:07:231
108952399272,7cyclictest1234057-21fschecks_count11:22:161
108952399272,6cyclictest1177825-21cut10:12:171
108952399272,6cyclictest1126815-21apt09:04:421
1089523992723,3cyclictest1130707-21latency_hist09:14:411
108952399271,4cyclictest1230730-21grep11:17:231
108952299275,21cyclictest0-21swapper/010:15:370
108952299274,15cyclictest11050irq/107-eth%d09:57:230
1089522992715,2cyclictest0-21swapper/011:52:210
108952299271,25cyclictest1089541-21latency_hist07:14:410
108952399266,3cyclictest1269318-21rm12:02:231
108952399264,4cyclictest1295067-21aten2.4-expect12:32:181
108952399263,5cyclictest1136744-21fschecks_time09:22:171
108952399263,5cyclictest1130476-21diskmemload10:05:071
108952399262,9cyclictest0-21swapper/110:37:261
108952399262,8cyclictest1134844-21grep09:19:421
108952399261,6cyclictest1119904-21cat08:42:291
1089523992611,14cyclictest1102435-21ntp_kernel_pll_07:52:191
1089522992623,2cyclictest1222332-21latency11:07:170
108952299261,5cyclictest1264493-21kernelversion11:57:180
108952299261,20cyclictest0-21swapper/012:12:270
108952299261,17cyclictest0-21swapper/009:50:240
108952299260,23cyclictest0-21swapper/011:42:140
1089524992510,11cyclictest1146654-21kworker/u8:2+nfsiod09:37:222
108952399253,8cyclictest0-21swapper/107:22:291
108952399252,9cyclictest1148480-21/usr/sbin/munin09:37:231
108952399252,7cyclictest1167355-21latency_hist09:59:421
108952399252,5cyclictest0-21swapper/111:02:241
108952399252,4cyclictest1111816-21grep08:19:411
108952399252,3cyclictest1277398-21sed12:12:211
108952399251,8cyclictest0-21swapper/108:52:261
108952399251,5cyclictest1285878-21fschecks_count12:22:171
108952399251,5cyclictest1127552-21grep09:07:211
108952399250,6cyclictest1188304-21latency_hist10:24:411
108952399250,10cyclictest1094648-21latency_hist07:29:421
1089522992521,3cyclictest1220302-21latency_hist11:04:410
108952499244,15cyclictest1008-21mta-sts-daemon09:49:442
108952499243,16cyclictest605-21avahi-daemon10:54:262
108952499243,15cyclictest1288401-21sendmail-msp12:24:452
108952499242,9cyclictest1286565-21/usr/sbin/munin12:22:232
108952399244,5cyclictest1282101-21/usr/sbin/munin12:17:201
108952399243,5cyclictest0-21swapper/110:17:181
108952399242,4cyclictest1237920-21cpuspeed11:27:151
108952399241,9cyclictest1300770-21grep12:37:271
108952399241,7cyclictest1120817-21grep08:47:151
108952399241,5cyclictest1145643-21ssh09:32:301
108952399240,6cyclictest1097102-21/usr/sbin/munin07:37:281
1089522992417,4cyclictest0-21swapper/010:52:210
108952299240,11cyclictest1202523-21ntpq10:42:220
108952499236,11cyclictest1008-21mta-sts-daemon11:22:222
1089524992315,4cyclictest1130476-21diskmemload09:15:082
108952399237,2cyclictest0-21swapper/112:07:261
108952399233,4cyclictest1114133-21/usr/sbin/munin08:27:151
108952399232,7cyclictest1124049-21fschecks_count08:57:181
108952399232,4cyclictest1246525-21grep11:37:181
108952399232,3cyclictest1105187-21fschecks_count08:02:171
108952399231,9cyclictest1189901-21grep10:27:161
108952399231,6cyclictest1100021-21tune2fs07:47:161
108952399231,5cyclictest1118031-21ntpq08:37:211
1089522992323,0cyclictest0-21swapper/012:16:490
1089522992314,2cyclictest0-21swapper/010:59:190
108952299231,21cyclictest1169194-21fschecks_count10:02:170
108952299230,12cyclictest0-21swapper/010:14:140
1089524992219,2cyclictest1140937-21fschecks_time09:27:162
1089524992218,3cyclictest0-21swapper/209:09:452
108952399227,3cyclictest1210212-21fschecks_count10:52:171
108952399224,3cyclictest1112663-21grep08:22:161
108952399223,5cyclictest0-21swapper/108:32:251
108952399222,4cyclictest1226701-21/usr/sbin/munin11:12:241
108952399222,3cyclictest1106938-21fschecks_time08:07:181
108952399221,4cyclictest1201961-21fschecks_time10:42:171
108952299222,19cyclictest1288401-21sendmail-msp12:25:020
1089522992215,2cyclictest0-21swapper/010:32:270
108952499214,10cyclictest11050irq/107-eth%d10:19:442
1089524992113,7cyclictest1091852-21gltestperf07:22:192
108952499211,17cyclictest1200228-21cat10:39:422
108952399213,6cyclictest11050irq/107-eth%d11:44:411
108952399213,4cyclictest1090475-21/usr/sbin/munin07:17:211
108952399211,6cyclictest1098448-21grep07:42:161
108952399211,5cyclictest1089699-21latency_hist07:14:411
108952299219,9cyclictest11050irq/107-eth%d12:32:200
108952299215,12cyclictest762-21in:imuxsock09:45:110
108952299213,5cyclictest1255547-21grep11:47:210
108952299213,1cyclictest1144514-21/usr/sbin/munin09:32:230
108952299210,18cyclictest0-21swapper/011:12:230
108952399203,7cyclictest1104204-21/usr/sbin/munin07:57:231
108952299206,1cyclictest0-21swapper/011:27:130
108952299200,9cyclictest1110203-21/usr/sbin/munin08:17:180
108952299200,11cyclictest0-21swapper/012:39:380
108952299200,10cyclictest0-21swapper/011:17:220
112699190,1rtkit-daemon0-21swapper/007:35:580
108952499199,3cyclictest171rcu_preempt12:04:442
108952499193,11cyclictest1194349-21/usr/sbin/munin10:32:242
108952499192,12cyclictest1302079-21munin-run12:39:422
108952499192,10cyclictest1172148-21apt-get10:04:452
108952299194,3cyclictest0-21swapper/012:22:160
108952299191,9cyclictest1096206-21cat07:34:420
1089522991910,2cyclictest1136722-21fschecks_count09:22:170
108952499186,10cyclictest1246196-21/usr/sbin/munin11:37:242
108952499185,10cyclictest111788-21systemd-journal11:05:112
108952499182,14cyclictest1182448-21ntpq10:17:232
108952499181,4cyclictest1259892-21gltestperf11:52:172
108952299185,9cyclictest1090561-21ntpq07:17:220
108952299184,13cyclictest1127933-21/usr/sbin/munin09:07:250
108952299182,12cyclictest1098275-21fschecks_count07:42:160
1089522991815,2cyclictest1091679-21fschecks_count07:22:190
1089522991812,4cyclictest1094371-21unixbench_multi07:27:260
108952599174,7cyclictest0-21swapper/311:37:243
108952499176,10cyclictest0-21swapper/211:12:162
108952499175,9cyclictest111788-21systemd-journal08:04:482
108952499175,8cyclictest1269138-21ssh12:02:202
108952499174,11cyclictest1253358-21sendmail-msp11:44:552
108952499173,9cyclictest1241074-21ssh11:30:572
108952499172,12cyclictest1178290-21cut10:12:202
1089524991713,3cyclictest1110537-21grep08:17:192
108952299179,1cyclictest0-21swapper/009:43:070
108952299175,5cyclictest1109917-21gpg-connect-age08:14:420
108952299174,10cyclictest1101359-21gpg-connect-age07:49:420
108952299170,10cyclictest1119644-21ntpq08:42:240
112699160,2rtkit-daemon1125-21rtkit-daemon08:57:000
112699160,2rtkit-daemon1125-21rtkit-daemon08:04:142
108952599163,6cyclictest0-21swapper/310:02:203
108952499166,7cyclictest11050irq/107-eth%d10:25:162
108952499164,9cyclictest111788-21systemd-journal09:45:152
108952499164,9cyclictest1116025-21/usr/sbin/munin08:32:172
108952499164,7cyclictest1118067-21/usr/sbin/munin08:37:222
108952499163,6cyclictest1094688-21/usr/sbin/munin07:32:162
108952499162,12cyclictest1127776-21/usr/sbin/munin09:07:222
108952499161,7cyclictest1237806-21/usr/sbin/munin11:27:152
108952499161,12cyclictest1295260-21cut12:32:202
108952299163,2cyclictest0-21swapper/011:30:570
108952599153,6cyclictest0-21swapper/310:42:213
108952599153,4cyclictest0-21swapper/309:57:223
108952599152,7cyclictest0-21swapper/310:57:203
108952499155,6cyclictest1282267-21/usr/sbin/munin12:17:232
108952499153,5cyclictest1218724-21/usr/sbin/munin11:02:242
108952499152,8cyclictest1230709-21ntpq11:17:232
108952499152,8cyclictest1167301-21apt-config09:59:422
108952499152,11cyclictest1153560-21/usr/sbin/munin09:42:252
108952499152,11cyclictest1090562-21grep07:17:222
1089524991511,3cyclictest1008-21mta-sts-daemon07:52:152
108952499150,11cyclictest1126870-21latency_hist09:04:422
108952299152,11cyclictest967-21snmpd07:57:160
1089522991511,3cyclictest1115870-21grep08:32:160
108952299150,10cyclictest1268246-21find12:02:130
108952299150,10cyclictest1105593-21missed_timers08:02:190
108952599146,4cyclictest0-21swapper/312:22:233
108952599145,4cyclictest0-21swapper/309:52:243
108952599142,7cyclictest0-21swapper/308:14:463
108952599142,6cyclictest0-21swapper/312:12:183
108952599141,7cyclictest0-21swapper/309:37:223
108952599140,7cyclictest0-21swapper/310:27:153
108952499143,9cyclictest1112933-21/usr/sbin/munin08:22:182
108952499143,9cyclictest1099629-21/usr/sbin/munin07:47:132
108952499142,8cyclictest1214484-21/usr/sbin/munin10:57:182
108952499142,8cyclictest1109377-21/usr/sbin/munin08:12:292
108952499142,7cyclictest1264184-21grep11:57:162
108952499142,10cyclictest1122518-21grep08:52:172
108952499141,9cyclictest1144886-21fschecks_time09:32:212
108952499141,2cyclictest11050irq/107-eth%d12:14:422
108952499141,10cyclictest1136742-21fschecks_time09:22:172
108952299146,2cyclictest0-21swapper/008:22:140
108952299144,7cyclictest1117772-21/usr/sbin/munin08:37:180
108952299142,7cyclictest1130127-21/usr/sbin/munin09:12:290
1089522991413,1cyclictest0-21swapper/008:07:270
1089522991411,2cyclictest1122532-21gltestperf08:52:170
108952599136,4cyclictest0-21swapper/311:06:383
108952599135,2cyclictest0-21swapper/310:44:443
108952599134,7cyclictest0-21swapper/311:25:033
108952599134,5cyclictest0-21swapper/311:52:223
108952599133,5cyclictest0-21swapper/312:32:303
108952599133,2cyclictest0-21swapper/309:21:353
108952599132,6cyclictest0-21swapper/312:42:243
108952599131,6cyclictest0-21swapper/311:02:243
108952599131,5cyclictest0-21swapper/308:12:153
108952499138,2cyclictest0-21swapper/207:37:282
108952499136,5cyclictest1201667-21/usr/sbin/munin10:42:152
108952499134,6cyclictest0-21swapper/207:42:252
108952499133,7cyclictest1104458-21/usr/sbin/munin07:57:262
108952299137,3cyclictest1102686-21/usr/sbin/munin07:52:240
108952299131,7cyclictest1121748-21sed08:47:250
108952599126,4cyclictest0-21swapper/307:57:163
108952599126,3cyclictest0-21swapper/308:57:273
108952599124,4cyclictest0-21swapper/312:24:443
108952599124,4cyclictest0-21swapper/310:04:453
108952599124,4cyclictest0-21swapper/309:26:263
108952599124,3cyclictest0-21swapper/308:22:193
108952599123,6cyclictest0-21swapper/311:12:233
108952599123,5cyclictest0-21swapper/308:37:213
108952599123,4cyclictest0-21swapper/311:47:043
108952599123,4cyclictest0-21swapper/309:09:453
108952599123,3cyclictest0-21swapper/308:26:043
108952599123,3cyclictest0-21swapper/308:02:203
108952599121,8cyclictest0-21swapper/310:30:303
108952599121,6cyclictest0-21swapper/312:07:203
108952499128,2cyclictest1008-21mta-sts-daemon08:27:142
108952499125,5cyclictest1120489-21/usr/sbin/munin08:47:122
108952499125,5cyclictest1119110-21fschecks_count08:42:192
108952499122,7cyclictest111788-21systemd-journal07:25:592
108952499121,10cyclictest1124712-21grep08:57:242
108952599115,4cyclictest0-21swapper/312:18:063
108952599115,3cyclictest0-21swapper/309:47:193
108952599113,5cyclictest0-21swapper/310:19:443
108952599113,4cyclictest0-21swapper/310:16:573
108952599112,6cyclictest0-21swapper/307:32:153
108952599112,5cyclictest0-21swapper/310:34:483
108952599112,5cyclictest0-21swapper/309:02:253
108952599112,4cyclictest0-21swapper/308:42:133
108952599112,4cyclictest0-21swapper/308:06:573
108952599111,7cyclictest0-21swapper/308:52:153
108952599111,5cyclictest0-21swapper/312:37:153
108952599111,5cyclictest0-21swapper/310:52:133
108952599111,4cyclictest0-21swapper/311:15:463
108952599105,3cyclictest0-21swapper/309:05:053
108952599104,5cyclictest0-21swapper/307:22:203
108952599104,4cyclictest0-21swapper/309:14:433
108952599104,3cyclictest0-21swapper/307:27:143
108952599103,4cyclictest0-21swapper/312:02:133
108952599103,4cyclictest0-21swapper/309:42:193
108952599103,4cyclictest0-21swapper/307:42:163
108952599102,6cyclictest0-21swapper/311:42:143
108952599102,5cyclictest0-21swapper/311:57:203
108952599102,5cyclictest0-21swapper/307:49:443
108952599102,4cyclictest0-21swapper/307:37:163
108952599101,6cyclictest0-21swapper/311:22:543
108952599101,5cyclictest0-21swapper/309:34:303
108952599101,5cyclictest0-21swapper/307:47:263
108952599101,4cyclictest0-21swapper/310:11:023
108952599101,3cyclictest0-21swapper/308:32:143
10895259993,4cyclictest0-21swapper/311:29:533
10895259993,4cyclictest0-21swapper/307:17:223
10895259991,5cyclictest0-21swapper/308:47:153
10895249980,7cyclictest1089650-21latency_hist07:14:412
10895259972,2cyclictest0-21swapper/307:14:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional