You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Fri May 02, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1318794994920,3cyclictest11050irq/107-eth%d23:06:312
131879299484,31cyclictest0-21swapper/022:26:180
1318792993921,4cyclictest0-21swapper/023:22:550
131879399362,17cyclictest0-21swapper/121:41:221
131879399356,13cyclictest1431192-21awk22:31:181
1318792993515,2cyclictest1345344-21grep20:31:210
131879299331,26cyclictest0-21swapper/023:01:180
131879299331,26cyclictest0-21swapper/023:01:180
131879299330,18cyclictest11050irq/107-eth%d22:01:170
131879299328,17cyclictest2243333-21munin-node19:28:070
1318792993221,2cyclictest0-21swapper/021:16:160
1318792993213,7cyclictest0-21swapper/022:46:190
131879299321,2cyclictest1408387-21ntpq22:06:190
131879299321,16cyclictest0-21swapper/000:21:210
131879299312,20cyclictest0-21swapper/000:31:120
131879299311,29cyclictest1498963-21sed23:46:190
131879299311,24cyclictest1394250-21ntpq21:51:180
131879299310,19cyclictest1365681-21aten_r2power_cu21:21:160
131879299310,16cyclictest0-21swapper/023:53:240
112699310,3rtkit-daemon1125-21rtkit-daemon23:59:202
131879499305,12cyclictest0-21swapper/221:26:202
1318794993027,2cyclictest1341049-21fschecks_time20:21:152
1318794993026,3cyclictest1346959-21unixbench_multi20:36:202
131879299304,5cyclictest1517827-21ssh00:06:220
131879299301,22cyclictest0-21swapper/022:51:050
131879299300,6cyclictest1435766-21ntp_states22:36:180
1318792992918,7cyclictest1354180-21fschecks_time21:01:170
1318792992918,7cyclictest1354180-21fschecks_time21:01:170
1318792992916,1cyclictest1541655-21sed00:36:140
131879299281,26cyclictest1421573-21fschecks_time22:21:130
131879299281,17cyclictest0-21swapper/021:56:170
131879499274,21cyclictest1444843-21/usr/sbin/munin22:46:192
1318792992721,4cyclictest1379661-21head21:36:140
131879299272,13cyclictest0-21swapper/022:31:230
1318792992721,0cyclictest0-21swapper/023:28:290
131879399261,8cyclictest11050irq/107-eth%d00:06:141
131879299260,5cyclictest1502621-21ssh23:51:130
131879299260,21cyclictest0-21swapper/000:11:170
1318794992521,2cyclictest1421501-21cut22:21:132
131879399258,4cyclictest11050irq/107-eth%d22:41:201
1318793992518,4cyclictest1008-21mta-sts-daemon22:11:161
131879299253,19cyclictest0-21swapper/021:33:000
131879299251,16cyclictest0-21swapper/021:39:410
131879299248,4cyclictest1341157-21gltestperf20:21:160
131879299240,6cyclictest1452825-21/usr/sbin/munin22:56:210
131879499232,17cyclictest1389779-21/usr/sbin/munin21:46:202
1318794992320,2cyclictest1366054-21fschecks_time21:21:182
1318794992319,3cyclictest1375333-21gltestperf21:31:182
131879399233,15cyclictest1319415-21head19:16:141
1318792992318,4cyclictest1328876-21unixbench_multi19:41:270
131879299230,17cyclictest1468873-21true23:13:000
1318794992219,2cyclictest1459783-21munin-plugin-st23:03:002
1318794992219,2cyclictest1459783-21munin-plugin-st23:03:002
131879399223,12cyclictest11050irq/107-eth%d22:16:201
1318793992221,1cyclictest1006-21mta-sts-daemon21:53:031
1318793992215,5cyclictest1389102-21fschecks_count21:46:141
131879299228,10cyclictest0-21swapper/021:46:200
131879299220,20cyclictest0-21swapper/000:01:170
131879599215,7cyclictest0-21swapper/323:01:153
131879599215,7cyclictest0-21swapper/323:01:153
131879499211,9cyclictest1315850-1kworker/2:0H+kblockd21:03:002
1318794992118,2cyclictest1380926-21unixbench_multi21:36:242
1318794992117,1cyclictest1496122-21sendmail-msp23:43:172
1318794992110,9cyclictest0-21swapper/223:21:122
131879399213,11cyclictest1489475-21grep23:36:141
131879399213,10cyclictest11050irq/107-eth%d23:22:551
1318793992116,3cyclictest1453180-21fschecks_time22:56:131
131879299211,9cyclictest1489368-21/usr/sbin/munin23:36:130
131879299211,2cyclictest0-21swapper/022:41:170
1318792992112,2cyclictest0-21swapper/021:28:010
112699210,0rtkit-daemon0-21swapper/120:26:430
131879499206,12cyclictest122792-21ntpd23:39:312
131879499203,5cyclictest1485025-21gltestperf23:31:162
1318793992016,3cyclictest1379854-21fschecks_count21:36:161
1318793992016,3cyclictest1350859-21fschecks_count20:51:151
131879399201,1cyclictest1526333-21/usr/sbin/munin00:16:191
131879299202,10cyclictest1416644-21/usr/sbin/munin22:16:240
1318792992016,3cyclictest1495049-21unixbench_multi23:41:210
1318792992016,3cyclictest1326248-21fschecks_count19:36:120
1318792992016,3cyclictest1319383-21fschecks_time19:16:130
1318792992013,6cyclictest0-21swapper/019:46:180
131879299200,12cyclictest1470856-21/usr/sbin/munin23:16:120
112699200,1rtkit-daemon1008-21mta-sts-daemon22:04:311
1318794991916,2cyclictest0-21swapper/223:53:022
1318794991914,4cyclictest1530812-21unixbench_multi00:21:242
131879499191,12cyclictest1467834-21sed23:11:212
131879499191,11cyclictest1385614-21sed21:41:232
131879399197,6cyclictest619-21mta-sts-daemon00:27:221
131879399196,3cyclictest1472203-21unixbench_singl23:16:221
131879399192,8cyclictest11050irq/107-eth%d00:41:181
1318793991910,7cyclictest1457688-21fschecks_count23:01:141
1318793991910,7cyclictest1457688-21fschecks_count23:01:141
131879299192,11cyclictest0-21swapper/022:11:100
1318792991915,3cyclictest1350907-21cut20:51:150
131879499185,10cyclictest1487302-21ssh23:33:092
131879499183,11cyclictest1318751-21munin-run19:12:592
1318794991814,3cyclictest1535567-21cron00:28:002
1318794991811,4cyclictest0-21swapper/200:36:212
131879399189,7cyclictest1358546-21diskmemload21:31:241
131879399189,7cyclictest0-21swapper/123:56:161
131879399182,13cyclictest1359147-21apt-get21:13:021
1318793991815,2cyclictest1466689-21fschecks_count23:11:131
1318793991814,2cyclictest1486015-21unixbench_singl23:31:241
1318793991812,3cyclictest1337800-21fschecks_time20:11:161
131879399181,13cyclictest1428259-21grep22:28:011
1318792991817,1cyclictest0-21swapper/023:23:070
1318792991813,4cyclictest1527635-21cron00:18:000
1318792991812,5cyclictest1335440-21unixbench_multi20:01:230
112699180,0rtkit-daemon0-21swapper/200:39:392
131879499179,6cyclictest1526718-21grep00:16:212
131879499179,6cyclictest0-21swapper/222:41:152
131879499173,10cyclictest1416927-21ssh22:16:132
131879499171,4cyclictest1480674-21uname23:26:162
1318794991713,3cyclictest1347649-21grep20:41:182
1318794991712,4cyclictest1325652-21unixbench_singl19:31:212
1318794991711,4cyclictest0-21swapper/222:11:142
131879499170,16cyclictest1448830-21grep22:51:152
131879399177,9cyclictest1437347-21grep22:38:011
131879399174,9cyclictest1366635-21ssh21:21:241
131879399172,4cyclictest1462988-21ssh23:06:201
131879399172,13cyclictest1480172-21grep23:26:131
1318793991713,2cyclictest0-21swapper/119:21:191
131879399171,1cyclictest11050irq/107-eth%d21:48:461
1318793991710,6cyclictest0-21swapper/123:41:121
112699170,0rtkit-daemon0-21swapper/020:33:560
112699170,0rtkit-daemon0-21swapper/020:12:560
131879599165,5cyclictest0-21swapper/321:38:423
131879599164,8cyclictest0-21swapper/300:21:223
131879599164,6cyclictest0-21swapper/322:01:173
131879599164,6cyclictest0-21swapper/321:46:203
131879599163,8cyclictest0-21swapper/322:31:183
131879599163,6cyclictest0-21swapper/322:51:213
131879599162,8cyclictest0-21swapper/321:31:243
131879499166,8cyclictest0-21swapper/223:51:162
131879499165,8cyclictest1338820-21/usr/sbin/munin20:11:242
131879499163,9cyclictest1430379-21aten_r2power_en22:31:122
131879499163,10cyclictest1453548-21cat22:56:162
131879499162,11cyclictest1537261-21aten_r2power_cu00:31:112
131879499162,10cyclictest1518229-21ssh00:07:022
1318794991612,2cyclictest1355254-21sendmail21:03:002
1318794991611,4cyclictest0-21swapper/222:36:212
131879499161,10cyclictest1350634-21aten_r2power_en20:51:132
1318794991610,5cyclictest1327329-21cron19:38:002
1318794991610,3cyclictest0-21swapper/222:06:202
131879499160,10cyclictest1403217-21grep22:01:132
131879399163,2cyclictest11050irq/107-eth%d22:21:171
131879399162,11cyclictest1503021-21grep23:51:161
1318793991612,3cyclictest1521076-21cpuspeed00:11:121
1318793991611,4cyclictest0-21swapper/119:51:141
131879299166,8cyclictest0-21swapper/019:12:590
131879299163,7cyclictest1355956-21sed21:06:150
131879299163,1cyclictest11050irq/107-eth%d23:06:190
131879299160,15cyclictest1353194-21wc20:56:230
112699160,1rtkit-daemon1005-21mta-sts-daemon20:43:422
131879599152,7cyclictest0-21swapper/321:16:173
131879599150,6cyclictest0-21swapper/323:26:143
131879499157,5cyclictest0-21swapper/219:16:142
131879499153,7cyclictest1426075-21tune2fs22:26:142
131879499153,10cyclictest1322034-21/usr/sbin/munin19:21:212
131879499152,8cyclictest1520954-21/usr/sbin/munin00:11:122
131879499152,7cyclictest1352598-21/usr/sbin/munin20:56:172
131879499152,11cyclictest1393867-21sed21:51:152
1318794991512,3cyclictest1343179-21ntp_kernel_pll_20:26:182
131879499151,13cyclictest1359218-21ssh21:13:092
131879499151,10cyclictest1332455-21latency_hist19:53:002
1318794991510,4cyclictest1330744-21grep19:48:002
1318794991510,4cyclictest1323679-21grep19:26:212
1318794991510,3cyclictest1357754-21grep21:11:182
1318794991510,3cyclictest1333815-21grep19:56:232
131879399154,9cyclictest271ktimers/100:21:211
131879399153,8cyclictest1445264-21grep22:46:211
131879399153,10cyclictest1498698-21/usr/sbin/munin23:46:171
131879399152,9cyclictest1347791-21if_end020:41:191
131879399152,8cyclictest1448930-21if_end022:51:151
131879399152,11cyclictest1368138-21sendmail-msp21:23:221
131879399151,9cyclictest1346031-21fschecks_time20:36:131
1318793991512,2cyclictest1355921-21gltestperf21:06:151
1318793991512,2cyclictest0-21swapper/120:56:251
1318793991511,3cyclictest1328875-21grep19:41:271
1318793991511,3cyclictest0-21swapper/120:26:221
131879399151,11cyclictest1326448-21if_end019:36:121
131879399151,10cyclictest1403108-21cpu22:01:121
131879399151,10cyclictest0-21swapper/100:36:111
131879399150,14cyclictest1125-21rtkit-daemon23:59:201
131879299152,3cyclictest1545463-21ssh00:41:140
1318792991511,3cyclictest1347706-21gltestperf20:41:190
131879299151,12cyclictest1339403-21fschecks_time20:16:150
1318792991511,2cyclictest1333068-21/usr/sbin/munin19:56:170
131879599142,7cyclictest0-21swapper/322:46:193
131879599142,7cyclictest0-21swapper/322:23:003
131879599142,6cyclictest0-21swapper/323:53:023
131879599142,5cyclictest0-21swapper/321:26:213
131879499146,4cyclictest1471086-21tune2fs23:16:142
131879499145,7cyclictest1339068-21/usr/sbin/munin20:16:242
131879499143,10cyclictest1335497-21grep20:01:232
131879499142,5cyclictest1328979-21munin-run19:43:002
131879499142,10cyclictest967-21snmpd21:06:132
131879399143,9cyclictest1344489-21gltestperf20:31:131
131879399143,9cyclictest1335851-21aten_r2power_en20:06:131
131879399141,9cyclictest1358540-21cron21:13:001
131879399141,8cyclictest1324070-21apt-config19:28:001
1318793991411,2cyclictest1340464-21cron20:17:591
131879299149,3cyclictest0-21swapper/019:51:140
131879299144,7cyclictest1533744-21fschecks_count00:26:130
131879299144,6cyclictest1349779-21ntp_kernel_pll_20:46:210
131879299142,9cyclictest1357160-21aten_r2power_cu21:11:130
112699140,3rtkit-daemon1005-21mta-sts-daemon21:53:192
131879599135,5cyclictest0-21swapper/322:16:203
131879599135,4cyclictest0-21swapper/323:21:183
131879599134,5cyclictest0-21swapper/300:11:123
131879599134,4cyclictest0-21swapper/323:06:313
131879599133,5cyclictest0-21swapper/319:36:203
131879599133,5cyclictest0-21swapper/300:31:193
131879599133,4cyclictest0-21swapper/323:51:203
131879599133,4cyclictest0-21swapper/323:28:193
131879599132,8cyclictest0-21swapper/321:51:143
131879499132,9cyclictest1345277-21unixbench-2d20:31:212
131879499132,8cyclictest111788-21systemd-journal20:08:002
131879399136,4cyclictest1334653-21/usr/sbin/munin20:01:151
131879399134,5cyclictest0-21swapper/120:46:251
131879399133,9cyclictest1333168-21/usr/sbin/munin19:56:171
131879399133,7cyclictest1342171-21latency_hist20:23:001
131879399131,6cyclictest1354304-21head21:01:171
131879399131,6cyclictest1354304-21head21:01:171
131879399130,3cyclictest1538402-21switchtime00:31:211
131879399130,10cyclictest1329230-21/usr/sbin/munin19:46:151
131879299132,10cyclictest1335839-21aten2.4-expect20:06:130
131879299132,10cyclictest1323439-21/usr/sbin/munin19:26:200
131879299131,9cyclictest1321825-21grep19:21:210
131879599124,4cyclictest0-21swapper/320:31:193
131879599123,6cyclictest0-21swapper/322:26:153
131879599123,6cyclictest0-21swapper/300:03:163
131879599123,5cyclictest0-21swapper/321:56:163
131879599123,5cyclictest0-21swapper/321:36:143
131879599123,5cyclictest0-21swapper/319:26:133
131879599123,4cyclictest0-21swapper/319:46:233
131879599122,5cyclictest0-21swapper/323:11:133
131879599122,5cyclictest0-21swapper/322:56:153
131879599122,5cyclictest0-21swapper/300:01:103
131879599121,6cyclictest0-21swapper/323:46:203
131879599121,5cyclictest0-21swapper/300:26:173
131879599120,7cyclictest0-21swapper/300:16:143
131879399123,7cyclictest1324632-21cut19:31:131
131879599114,4cyclictest0-21swapper/322:11:093
131879599113,5cyclictest0-21swapper/321:03:003
131879599113,5cyclictest0-21swapper/321:03:003
131879599113,5cyclictest0-21swapper/320:11:183
131879599113,5cyclictest0-21swapper/319:51:173
131879599113,4cyclictest0-21swapper/323:39:313
131879599113,4cyclictest0-21swapper/322:41:153
131879599113,4cyclictest0-21swapper/322:36:133
131879599113,3cyclictest0-21swapper/300:36:133
131879599112,5cyclictest0-21swapper/320:06:173
131879599112,4cyclictest0-21swapper/320:46:163
131879599111,7cyclictest0-21swapper/321:11:183
131879599111,6cyclictest0-21swapper/323:36:143
131879599111,5cyclictest0-21swapper/321:06:183
131879599111,5cyclictest0-21swapper/320:56:213
131879599111,5cyclictest0-21swapper/319:56:133
131879599110,5cyclictest0-21swapper/319:16:173
131879599103,3cyclictest0-21swapper/320:51:153
131879599103,3cyclictest0-21swapper/319:28:023
131879599102,6cyclictest0-21swapper/322:06:153
131879599102,5cyclictest0-21swapper/319:21:213
131879599102,4cyclictest0-21swapper/320:41:183
131879599101,6cyclictest0-21swapper/320:21:163
131879599101,5cyclictest0-21swapper/320:01:213
131879399102,6cyclictest1318891-21grep19:13:001
13187959995,3cyclictest0-21swapper/319:41:203
13187959995,3cyclictest0-21swapper/300:41:163
13187959993,5cyclictest0-21swapper/320:36:123
13187959992,5cyclictest0-21swapper/323:16:233
13187959992,4cyclictest0-21swapper/320:16:173
13187959991,5cyclictest0-21swapper/321:21:163
13187959991,4cyclictest0-21swapper/320:26:123
13187959972,4cyclictest0-21swapper/319:12:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional