You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 13:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Thu Sep 18, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1240335995532,7cyclictest1360312-21ssh22:40:040
1240335995532,7cyclictest1360312-21ssh22:40:040
124033599462,29cyclictest0-21swapper/000:15:050
1240335994026,1cyclictest0-21swapper/019:17:380
124033599402,37cyclictest0-21swapper/023:02:330
124033799369,22cyclictest633-21gpm21:10:262
124033599354,30cyclictest1433405-21ntpq23:57:330
124033599342,31cyclictest1409981-21ntpq23:32:300
124033599331,25cyclictest1376517-21grep22:57:300
124033799313,7cyclictest11050irq/107-eth%d23:17:322
1240336992920,4cyclictest1345641-21sendmail-msp22:26:471
1240335992922,2cyclictest0-21swapper/021:15:010
124033599292,19cyclictest1339077-21/usr/sbin/munin22:17:360
124033599291,9cyclictest1371986-21latency22:52:290
124033599291,22cyclictest0-21swapper/022:22:380
124033599284,23cyclictest0-21swapper/021:27:310
1240335992821,2cyclictest1453732-21sed00:22:390
124033599282,10cyclictest1421613-21sed23:45:010
124033599281,24cyclictest0-21swapper/022:00:010
1240335992715,0cyclictest0-21swapper/023:52:320
124033599271,25cyclictest0-21swapper/000:32:550
124033799266,17cyclictest1419409-21ld23:42:322
124033699265,14cyclictest967-21snmpd21:45:041
124033699262,6cyclictest0-21swapper/122:12:331
1240335992625,1cyclictest0-21swapper/000:27:320
1240335992621,2cyclictest0-21swapper/019:57:300
1240335992617,2cyclictest1391357-21/usr/sbin/munin23:12:320
1240335992615,5cyclictest1440871-21aten_r2power_fr00:07:280
124033599254,13cyclictest11050irq/107-eth%d00:37:340
1240335992521,3cyclictest1324340-21awk22:02:280
124033599252,12cyclictest1305543-21/usr/sbin/munin21:42:370
124033599250,3cyclictest111788-21systemd-journal23:50:010
124033599250,17cyclictest1399768-21/usr/sbin/munin23:22:270
124033799246,13cyclictest619-21mta-sts-daemon00:36:412
124033699242,18cyclictest1372288-21open_files22:52:331
1240335992412,2cyclictest0-21swapper/023:07:300
124033799232,6cyclictest171rcu_preempt22:52:332
1240337992312,9cyclictest259-21jbd2/mmcblk0p2-819:26:512
1240335992320,2cyclictest0-21swapper/022:47:360
1240335992317,2cyclictest1287101-21gltestperf21:22:280
124033599231,13cyclictest1352523-21gltestperf22:32:290
124033599230,2cyclictest1359711-21latency_hist22:40:010
124033599230,17cyclictest0-21swapper/021:17:310
124033799228,9cyclictest1007-21mta-sts-daemon19:30:372
124033799222,2cyclictest171rcu_preempt22:32:322
1240337992210,10cyclictest1391400-21ntp_kernel_pll_23:12:332
1240336992219,2cyclictest1358185-21unixbench_singl22:37:391
124033599223,14cyclictest1335007-21ssh22:13:060
1240335992217,1cyclictest0-21swapper/023:17:380
1240335992211,9cyclictest1247264-21apt-get19:35:020
124033599220,21cyclictest259-21jbd2/mmcblk0p2-821:37:300
124033699219,7cyclictest1276859-21fschecks_time21:02:271
124033599216,10cyclictest0-21swapper/022:27:330
124033599215,12cyclictest1270685-21sendmail-msp20:45:100
124033599211,8cyclictest0-21swapper/000:12:330
1240335992117,0cyclictest0-21swapper/023:37:340
1240335992117,0cyclictest0-21swapper/023:37:340
124033599210,17cyclictest1329371-21sed22:07:330
124033599210,11cyclictest0-21swapper/021:47:230
124033799205,8cyclictest1240365-21latency_hist19:15:012
124033799202,11cyclictest1437905-21ssh00:02:312
1240337992016,3cyclictest1005-21mta-sts-daemon22:39:412
1240337992016,2cyclictest0-21swapper/223:00:022
1240337992014,4cyclictest1242621-21gltestperf19:22:282
124033699206,12cyclictest1441634-21ntpq00:07:351
124033599204,11cyclictest111788-21systemd-journal23:26:080
124033599200,18cyclictest0-21swapper/019:32:260
1240337991912,5cyclictest0-21swapper/221:57:262
1240337991911,3cyclictest0-21swapper/221:47:232
124033699193,15cyclictest1419403-21ntpq23:42:321
124033699193,10cyclictest1376911-21ssh22:57:331
124033699193,10cyclictest1367384-21ntpq22:47:311
124033699192,3cyclictest0-21swapper/100:37:341
124033699192,12cyclictest1280056-21sed21:12:341
124033699191,14cyclictest1456893-21ld00:27:321
124033599195,9cyclictest111788-21systemd-journal21:05:360
124033599192,11cyclictest111788-21systemd-journal00:05:000
1240335991915,3cyclictest1007-21mta-sts-daemon21:02:310
124033799184,4cyclictest0-21swapper/223:32:222
1240337991815,2cyclictest0-21swapper/200:07:312
1240337991814,2cyclictest1457496-21unixbench_singl00:27:392
1240337991814,2cyclictest0-21swapper/222:27:172
1240337991813,3cyclictest0-21swapper/220:17:322
124033799181,14cyclictest1328938-21tail22:07:292
124033799181,10cyclictest1336232-21cat22:15:012
1240337991810,3cyclictest1306986-21grep21:42:382
124033699185,9cyclictest1414468-21ssh23:37:311
124033699185,9cyclictest1414468-21ssh23:37:311
124033699184,11cyclictest1274672-21latency_hist20:55:021
124033699184,10cyclictest1292842-21/usr/sbin/munin21:27:381
124033699183,11cyclictest1396124-21/usr/sbin/munin23:17:331
124033699182,10cyclictest1328785-21cut22:07:291
124033899175,5cyclictest0-21swapper/322:47:313
124033799174,10cyclictest1426575-21ssh23:50:112
124033799173,9cyclictest1282867-21ssh21:17:332
124033799173,8cyclictest619-21mta-sts-daemon19:57:322
1240337991714,2cyclictest1405849-21unixbench_singl23:27:392
124033699176,7cyclictest1240290-21munin-run19:15:011
124033699172,9cyclictest1391082-21/usr/sbin/munin23:12:301
1240336991713,3cyclictest1008-21mta-sts-daemon23:23:351
124033699171,12cyclictest1362109-21fschecks_count22:42:281
124033699171,12cyclictest1362109-21fschecks_count22:42:281
1240336991711,2cyclictest0-21swapper/123:47:291
124033699171,11cyclictest1320682-21ssh21:58:021
124033699171,11cyclictest1282825-21ssh21:17:321
1240336991710,3cyclictest1384172-21sendmail-msp23:06:201
124033599176,10cyclictest1264102-21sendmail-msp20:26:530
124033599174,10cyclictest0-21swapper/020:55:030
124033599173,11cyclictest1250900-21munin-plugin-st19:45:010
124033599173,11cyclictest1240364-21sed19:15:010
124033599172,10cyclictest1296917-21netstat21:32:320
124033899165,6cyclictest0-21swapper/322:52:333
124033799167,5cyclictest11050irq/107-eth%d23:45:262
124033799163,4cyclictest607-21dbus-daemon22:05:012
124033799162,12cyclictest1460028-21fschecks_time00:32:292
124033799162,10cyclictest1294407-21munin-run21:30:012
1240337991612,3cyclictest0-21swapper/221:37:292
1240337991612,1cyclictest0-21swapper/223:05:172
1240337991611,4cyclictest1268940-21grep20:37:372
124033699162,7cyclictest1453410-21ssh00:22:381
1240336991613,2cyclictest1255739-21unixbench_multi19:57:361
124033699161,12cyclictest1324294-21if_end022:02:281
124033699161,10cyclictest1261293-21cut20:17:281
1240336991610,3cyclictest0-21swapper/121:37:331
124033599167,3cyclictest0-21swapper/000:42:240
124033599163,9cyclictest1256763-21/usr/sbin/munin20:02:270
1240335991613,2cyclictest1245337-21apt-key19:30:010
1240335991612,3cyclictest1253256-21gltestperf19:52:290
124033899152,6cyclictest0-21swapper/319:27:223
124033899152,5cyclictest0-21swapper/300:22:343
124033899151,6cyclictest0-21swapper/300:07:353
124033799154,9cyclictest1381115-21/usr/sbin/munin23:02:292
124033799153,10cyclictest0-21swapper/219:35:032
124033799152,9cyclictest1400044-21ssh23:22:282
124033799152,1cyclictest0-21swapper/221:22:372
124033799152,11cyclictest1264706-21tune2fs20:27:282
124033799152,10cyclictest1252241-21/usr/sbin/munin19:47:372
124033799151,9cyclictest1433940-21/usr/sbin/munin23:57:392
124033799151,8cyclictest1266292-21fschecks_time20:32:262
124033799151,12cyclictest122792-21ntpd20:45:032
124033699155,5cyclictest0-21swapper/123:26:081
124033699154,9cyclictest764-21rs:main1
124033699154,9cyclictest1257769-21aten_r2power_cu20:07:261
124033699153,9cyclictest1466720-21aten_r2power_po00:42:261
124033699153,8cyclictest1409810-21needreboot23:32:271
124033699152,9cyclictest1428512-21grep23:52:291
124033699152,9cyclictest1355052-21cat22:35:011
1240336991513,1cyclictest0-21swapper/121:42:271
1240336991512,2cyclictest1243618-21basename19:25:011
124033599155,6cyclictest1273259-21grep20:52:310
124033599153,7cyclictest1258565-21/usr/sbin/munin20:07:320
124033599152,9cyclictest111788-21systemd-journal21:55:020
1240335991512,2cyclictest1264020-21unixbench_singl20:22:370
124033599151,12cyclictest1259674-21tune2fs20:12:270
1240335991510,2cyclictest1268377-21nfs_client20:37:300
112699150,2rtkit-daemon1125-21rtkit-daemon19:43:342
124033899143,6cyclictest0-21swapper/320:37:313
124033899142,7cyclictest0-21swapper/323:27:363
124033799145,6cyclictest1277937-21munin-run21:05:012
124033799144,9cyclictest1362134-21grep22:42:282
124033799144,9cyclictest1362134-21grep22:42:282
124033799144,7cyclictest1342811-21/usr/sbin/munin22:22:292
124033799143,3cyclictest1338242-21fschecks_count22:17:272
124033799142,9cyclictest1444594-21ssh00:12:312
124033799141,9cyclictest1257285-21/usr/sbin/munin20:02:352
1240337991411,3cyclictest1270021-21ntp_kernel_err20:42:302
1240337991411,2cyclictest1296589-21gltestperf21:32:302
1240337991411,2cyclictest0-21swapper/220:57:282
1240337991410,3cyclictest1125-21rtkit-daemon00:24:532
124033699146,6cyclictest1244930-21/usr/sbin/munin19:27:331
124033699144,7cyclictest1250051-21/usr/sbin/munin19:42:291
124033699144,7cyclictest0-21swapper/120:57:351
124033699143,5cyclictest1262444-21kworker/1:1+events20:40:011
124033699142,9cyclictest762-21in:imuxsock19:47:261
124033699142,9cyclictest1449250-21/usr/sbin/munin00:17:361
124033699142,9cyclictest1433782-21ssh23:57:391
124033699142,8cyclictest1444066-21/usr/sbin/munin00:12:311
124033699142,8cyclictest1437818-21ntpq00:02:291
124033699142,8cyclictest1381451-21cut23:02:291
124033699142,10cyclictest1247835-21apt-get19:35:031
124033699141,9cyclictest1256435-21fschecks_time20:02:251
124033699141,7cyclictest1240558-21/usr/sbin/munin19:17:271
1240336991411,2cyclictest1254155-21unixbench_singl19:52:391
1240336991411,1cyclictest0-21swapper/121:22:331
124033699141,10cyclictest1263992-21grep20:22:371
124033699140,10cyclictest1343656-21/usr/sbin/munin22:22:361
124033599141,10cyclictest1242560-21tune2fs19:22:280
1240335991410,3cyclictest111788-21systemd-journal20:20:010
112699140,1rtkit-daemon0-21swapper/220:13:192
124033899135,3cyclictest0-21swapper/322:17:353
124033899134,4cyclictest0-21swapper/320:52:323
124033899134,2cyclictest0-21swapper/323:00:033
124033899133,7cyclictest0-21swapper/321:45:043
124033899133,5cyclictest0-21swapper/323:37:293
124033899133,5cyclictest0-21swapper/323:37:293
124033899133,5cyclictest0-21swapper/322:12:333
124033899133,5cyclictest0-21swapper/319:22:373
124033899133,4cyclictest0-21swapper/321:17:283
124033899132,6cyclictest0-21swapper/320:50:013
124033899132,5cyclictest0-21swapper/320:27:343
124033899132,4cyclictest0-21swapper/321:57:233
124033799135,5cyclictest1466959-21tune2fs00:42:282
124033799134,7cyclictest1263230-21/usr/sbin/munin20:22:282
124033799132,9cyclictest1259058-21/usr/sbin/munin20:07:382
124033799132,7cyclictest1416776-21munin-run23:40:012
124033799132,7cyclictest1416776-21munin-run23:40:012
124033799132,6cyclictest69-21kswapd000:15:052
124033799131,9cyclictest1367342-21/usr/sbin/munin22:47:302
124033799131,10cyclictest1240613-21aten_r2power_en19:17:282
124033699139,3cyclictest1338344-21grep22:17:271
124033699135,5cyclictest1459693-21/usr/sbin/munin00:32:271
124033699133,8cyclictest1260627-21/usr/sbin/munin20:12:371
124033699132,8cyclictest1264684-21fschecks_time20:27:281
124033599136,5cyclictest0-21swapper/019:47:310
124033599133,6cyclictest1267019-21/usr/sbin/munin20:32:350
124033599131,12cyclictest0-21swapper/020:42:240
124033899124,6cyclictest0-21swapper/323:42:383
124033899124,5cyclictest0-21swapper/300:02:343
124033899124,4cyclictest0-21swapper/323:12:283
124033899124,4cyclictest0-21swapper/322:27:313
124033899124,3cyclictest0-21swapper/322:22:313
124033899123,6cyclictest0-21swapper/322:57:293
124033899123,6cyclictest0-21swapper/300:15:053
124033899123,5cyclictest0-21swapper/320:57:293
124033899123,4cyclictest0-21swapper/321:21:113
124033899123,4cyclictest0-21swapper/321:12:233
124033899122,6cyclictest0-21swapper/323:57:323
124033899122,5cyclictest0-21swapper/323:47:293
124033899122,5cyclictest0-21swapper/322:37:293
124033899122,5cyclictest0-21swapper/300:32:263
124033799123,7cyclictest1254381-21cat19:55:012
124033799123,5cyclictest1272894-21/usr/sbin/munin20:52:302
124033699123,7cyclictest0-21swapper/119:32:261
124033699122,4cyclictest11050irq/107-eth%d20:47:311
124033699121,9cyclictest1269255-21aten_r2power_cu20:42:241
124033699121,9cyclictest1265959-21/usr/sbin/munin20:32:261
124033899114,5cyclictest0-21swapper/319:47:293
124033899113,6cyclictest0-21swapper/322:02:273
124033899113,4cyclictest0-21swapper/323:51:153
124033899113,4cyclictest0-21swapper/323:06:483
124033899113,4cyclictest0-21swapper/320:17:293
124033899113,4cyclictest0-21swapper/300:42:293
124033899112,5cyclictest0-21swapper/323:17:273
124033899112,5cyclictest0-21swapper/322:40:043
124033899112,5cyclictest0-21swapper/322:40:043
124033899112,5cyclictest0-21swapper/322:06:313
124033899111,6cyclictest0-21swapper/300:35:043
124033899111,4cyclictest0-21swapper/323:20:133
124033799117,3cyclictest111788-21systemd-journal21:53:252
124033799110,9cyclictest1277972-21sendmail-msp21:05:032
124033699112,7cyclictest1317161-21unin-run21:55:021
124033699112,7cyclictest1296094-21/usr/sbin/munin21:32:301
124033899104,5cyclictest0-21swapper/320:07:303
124033899104,3cyclictest0-21swapper/321:05:033
124033899102,5cyclictest0-21swapper/300:26:523
124033899102,4cyclictest0-21swapper/321:02:263
124033899102,4cyclictest0-21swapper/319:30:033
124033899102,4cyclictest0-21swapper/319:15:013
124033899102,3cyclictest0-21swapper/319:57:243
124033899101,6cyclictest0-21swapper/320:22:343
124033899101,6cyclictest0-21swapper/319:37:323
124033899101,5cyclictest0-21swapper/323:31:443
124033899101,5cyclictest0-21swapper/321:51:093
124033899101,5cyclictest0-21swapper/321:42:383
124033899101,4cyclictest0-21swapper/321:37:293
124033899100,6cyclictest0-21swapper/320:02:283
12403389995,3cyclictest0-21swapper/320:12:313
12403389994,3cyclictest0-21swapper/322:32:323
12403389993,4cyclictest0-21swapper/319:42:373
12403389993,3cyclictest0-21swapper/320:32:243
12403389992,5cyclictest0-21swapper/320:42:293
12403389992,3cyclictest0-21swapper/300:12:283
12403389991,5cyclictest0-21swapper/321:27:333
12403389990,4cyclictest0-21swapper/319:17:303
12403389983,3cyclictest0-21swapper/319:52:383
12403389982,2cyclictest0-21swapper/321:31:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional