You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 00:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Tue Nov 25, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
147598260,10rtkit-daemon729-21lldpd10:13:470
1241239992320,1cyclictest0-21swapper/311:05:003
1241239992320,1cyclictest0-21swapper/309:40:003
1241239992320,1cyclictest0-21swapper/307:15:013
1241239992118,1cyclictest0-21swapper/312:00:203
1241239992017,1cyclictest0-21swapper/311:30:003
1241239992017,1cyclictest0-21swapper/308:20:003
124123999201,5cyclictest1350340-21turbostat08:35:003
16707322191,9sleep21671879-21cut12:00:192
124123999191,14cyclictest1717626-21turbostat12:30:003
124123999191,14cyclictest1319220-21taskset08:10:123
124123999191,13cyclictest1612709-21taskset11:25:003
124123999191,13cyclictest1465390-21taskset09:51:273
13557082181,12sleep01355785-21/usr/sbin/munin08:35:230
1241239991815,1cyclictest0-21swapper/310:30:173
1241239991815,1cyclictest0-21swapper/310:05:013
1241239991815,1cyclictest0-21swapper/309:00:203
124123999181,14cyclictest1732256-21taskset12:36:303
124123999181,13cyclictest1693407-21turbostat12:15:003
124123999181,13cyclictest1300390-21taskset07:55:133
124123999181,12cyclictest1402227-21taskset09:14:563
16909932170,3sleep00-21swapper/012:10:230
147598170,3rtkit-daemon1247742-21munin-node08:01:222
1241239991714,1cyclictest0-21swapper/311:15:193
1241239991714,1cyclictest0-21swapper/311:15:183
1241239991714,1cyclictest0-21swapper/310:50:173
1241239991714,1cyclictest0-21swapper/309:25:163
1241239991714,1cyclictest0-21swapper/309:25:003
1241239991714,1cyclictest0-21swapper/309:05:203
1241239991714,1cyclictest0-21swapper/309:05:203
1241239991714,1cyclictest0-21swapper/308:02:033
1241239991714,1cyclictest0-21swapper/307:30:183
1241239991714,1cyclictest0-21swapper/307:25:023
124123999171,13cyclictest1540302-21chrt10:40:083
124123999171,13cyclictest1381313-21chrt08:56:003
124123999171,12cyclictest1707976-21taskset12:21:193
124123999171,12cyclictest1432793-21taskset09:30:393
124123999171,12cyclictest1268260-21taskset07:25:243
124123999166,7cyclictest15220432sleep310:26:343
1241239991613,1cyclictest0-21swapper/312:05:183
1241239991613,1cyclictest0-21swapper/311:30:173
1241239991613,1cyclictest0-21swapper/310:45:173
124123999161,12cyclictest1725255-21taskset12:34:013
124123999161,12cyclictest1699682-21taskset12:15:463
124123999161,12cyclictest1651858-21taskset11:47:043
124123999161,12cyclictest1564431-21taskset10:55:033
124123999161,12cyclictest1499636-21taskset10:15:073
124123999161,12cyclictest1490073-21taskset10:07:143
124123999161,12cyclictest1473290-21taskset09:55:563
124123999161,12cyclictest1458423-21taskset09:48:543
124123999161,12cyclictest1448913-21taskset09:40:343
124123999161,12cyclictest1403752-21taskset09:15:163
124123999161,12cyclictest1356298-21chrt08:36:453
124123999161,12cyclictest1343834-21taskset08:27:393
124123999161,12cyclictest1331711-21taskset08:20:023
124123999161,12cyclictest1313194-21taskset08:05:153
124123999161,12cyclictest1297415-21taskset07:50:163
124123999161,12cyclictest1281255-21taskset07:39:223
124123999161,12cyclictest1255984-21taskset07:18:383
124123999161,11cyclictest1509310-21chrt10:20:163
124123999161,11cyclictest1497384-21taskset10:10:303
1241239991610,3cyclictest16355642sleep311:36:353
124123999160,13cyclictest1588361-21chrt11:09:573
124123999160,13cyclictest1539460-21chrt10:38:483
13840842151,4sleep11386135-21grep09:00:201
1241239991513,1cyclictest0-21swapper/308:50:163
1241239991512,1cyclictest0-21swapper/311:10:173
124123999151,12cyclictest1284586-21taskset07:40:183
124123999151,11cyclictest1661484-21taskset11:55:063
124123999151,11cyclictest1363087-21chrt08:45:063
124123999151,11cyclictest1293487-21taskset07:45:523
124123999150,11cyclictest1362540-21taskset08:41:143
17098992141,10sleep00-21swapper/012:25:140
16615002141,5sleep11661533-21apt-get11:55:131
124123999141,10cyclictest1653437-21taskset11:50:093
124123999140,12cyclictest1643552-21chrt11:41:273
16109442131,3sleep11610952-21ssh11:21:111
15390952130,9sleep11539103-21ssh10:37:541
13885662131,9sleep00-21swapper/009:05:160
13885662131,9sleep00-21swapper/009:05:160
16357742120,9sleep01635778-21ssh11:37:090
15071462121,8sleep0214-21plymouthd10:19:260
147598120,8rtkit-daemon1733239-21taskset12:38:480
147598120,4rtkit-daemon720-21snmpd12:24:132
14562212120,10sleep11456373-21ntp_kernel_err09:45:211
14440242120,9sleep21444903-21cut09:40:172
14252342120,9sleep11425241-21sh09:26:491
14145382121,8sleep01415902-21memory09:20:190
17260132111,3sleep11726050-21apt-get12:35:121
15242322110,8sleep21524301-21ls10:30:142
15059462110,8sleep11505954-21ssh10:16:381
147598110,7rtkit-daemon1563268-21ssh10:52:510
147598110,6rtkit-daemon22110-21packagekitd09:38:130
14116522111,8sleep20-21swapper/209:20:172
13996952111,7sleep01399780-21ntp_states09:10:210
13304222111,7sleep11325450-21/usr/sbin/munin08:15:201
17113342100,7sleep11712507-21kthreadcore12:25:191
16700372100,3sleep11670731-21cut12:00:181
16672972100,7sleep21667303-21ssh11:55:342
16277232100,3sleep21627731-21ssh11:32:102
16131192101,6sleep21394205-21diskmemload11:25:042
15716002100,7sleep01571610-21ssh10:58:330
147598100,6rtkit-daemon474-21systemd-logind12:16:421
147598100,5rtkit-daemon214-21plymouthd10:45:130
147598100,5rtkit-daemon214-21plymouthd08:35:482
147598100,4rtkit-daemon1612451-21ssh11:24:420
147598100,3rtkit-daemon1540-21sendmail-mta10:00:402
147598100,2rtkit-daemon214-21plymouthd09:10:552
147598100,2rtkit-daemon214-21plymouthd08:33:492
14329642101,7sleep11432971-21sh09:31:021
13461992100,7sleep01348232-21tr08:30:180
13251902100,7sleep11325230-21true08:15:001
13218942100,7sleep01324007-21kthreadcore08:10:180
12815852102,4sleep11281618-21apt-get07:40:131
1643450290,6sleep21643456-21ssh11:41:152
1642607291,5sleep01642655-21/usr/sbin/munin11:40:210
1579403292,5sleep21394205-21diskmemload11:02:562
1508405290,6sleep21509198-21kthreadcore10:20:162
1501496290,6sleep21503422-21grep10:15:192
1497752291,6sleep21497759-21sh10:11:182
14759890,6rtkit-daemon730-21ntpd10:29:150
14759890,6rtkit-daemon515-21gmain09:18:011
14759890,6rtkit-daemon515-21gmain07:51:132
14759890,5rtkit-daemon214-21plymouthd11:13:371
14759890,5rtkit-daemon1256554-21df07:20:131
14759890,4rtkit-daemon1602993-21ssh11:16:351
14759890,4rtkit-daemon1602993-21ssh11:16:351
14759890,4rtkit-daemon1547987-21kworker/u16:2-rpciod11:53:492
14759890,4rtkit-daemon1418613-21grep09:25:011
14759890,4rtkit-daemon1250684-21cut07:15:191
14759890,3rtkit-daemon1247742-21munin-node10:39:260
14759890,1rtkit-daemon0-21swapper/208:26:282
14759890,1rtkit-daemon0-21swapper/107:10:151
1443463290,6sleep11444020-21irqcore09:40:161
1293800290,2sleep0214-21plymouthd07:49:540
1616753280,6sleep10-21swapper/111:25:191
1605057280,5sleep21605207-21gltestperf11:20:152
1586095280,1sleep20-21swapper/211:05:252
1572641280,1sleep00-21swapper/011:00:140
1532482283,2sleep21532686-21hddtemp_smartct10:35:152
1481585280,1sleep10-21swapper/110:01:241
14759880,5rtkit-daemon1540-21sendmail-mta12:18:492
14759880,4rtkit-daemon720-21snmpd08:12:242
14759880,4rtkit-daemon476-21wpa_supplicant07:48:382
14759880,4rtkit-daemon474-21systemd-logind07:56:422
14759880,4rtkit-daemon214-21plymouthd09:47:050
14759880,4rtkit-daemon214-21plymouthd09:32:370
14759880,4rtkit-daemon214-21plymouthd08:16:592
14759880,4rtkit-daemon214-21plymouthd07:25:471
14759880,4rtkit-daemon214-21plymouthd07:07:141
14759880,4rtkit-daemon1247742-21munin-node11:02:341
14759880,4rtkit-daemon1247742-21munin-node09:19:392
14759880,4rtkit-daemon1-21systemd10:05:142
14759880,4rtkit-daemon0-21swapper/208:58:192
14759880,3rtkit-daemon1718107-21df_inode12:30:130
14759880,3rtkit-daemon1680648-21kthreadcore12:05:172
14759880,3rtkit-daemon1443524-21if_eno209:40:150
14759880,2rtkit-daemon214-21plymouthd09:09:432
14759880,2rtkit-daemon214-21plymouthd09:09:432
14759880,1rtkit-daemon0-21swapper/209:02:142
14759880,1rtkit-daemon0-21swapper/208:23:492
1466880281,1sleep00-21swapper/009:54:490
1460482281,4sleep21461548-21cut09:50:192
1364918280,5sleep11366938-21cut08:45:171
1318926280,1sleep10-21swapper/108:09:591
1274926281,4sleep11274962-21awk07:35:011
1274690281,4sleep2720-21snmpd07:32:012
1723905270,1sleep10-21swapper/112:30:561
1708891270,1sleep10-21swapper/112:23:301
1673878270,5sleep01674671-21sed12:00:210
1653485270,4sleep11653518-21grep11:50:121
1644678270,1sleep10-21swapper/111:44:071
1580661270,4sleep01580821-21df_inode11:05:150
1540286270,1sleep10-21swapper/110:40:071
1499249270,1sleep10-21swapper/110:14:501
14759870,4rtkit-daemon720-21snmpd11:25:580
14759870,3rtkit-daemon730-21ntpd08:40:072
14759870,3rtkit-daemon720-21snmpd08:06:082
14759870,3rtkit-daemon214-21plymouthd12:15:011
14759870,3rtkit-daemon214-21plymouthd10:31:000
14759870,3rtkit-daemon214-21plymouthd08:45:022
14759870,3rtkit-daemon1650722-21mailstats11:45:212
14759870,3rtkit-daemon1626948-21vmstat11:30:250
14759870,3rtkit-daemon1580825-21diskstats11:05:151
14759870,3rtkit-daemon1241233-21cyclictest09:11:361
14759870,3rtkit-daemon1-21systemd12:11:172
14759870,3rtkit-daemon1-21systemd10:40:290
14759870,3rtkit-daemon1-21systemd09:57:282
14759870,3rtkit-daemon1-21systemd08:50:182
14759870,3rtkit-daemon1-21systemd07:35:171
14759870,1rtkit-daemon0-21swapper/010:20:470
1473787270,1sleep00-21swapper/009:57:070
1464313270,4sleep11464421-21ntpq09:50:221
1441428270,1sleep20-21swapper/209:36:562
1434372270,4sleep21434380-21ssh09:34:292
1418933270,4sleep21419067-21grep09:25:142
1404782270,4sleep01312539-21kworker/0:0+events09:15:180
1358347270,4sleep01360326-21grep08:40:200
1343167270,4sleep11343211-21proc_pri08:25:221
1330751270,4sleep01330905-21sed08:15:230
1305568270,4sleep01305693-21python307:55:230
1281296273,2sleep0386-21hwrng07:39:520
1247812271,3sleep21247468-21apt-get07:15:022
1247421270,1sleep20-21swapper/207:14:352
12412399976,1cyclictest0-21swapper/307:10:013
1240341270,3sleep20-21swapper/207:05:242
1732220260,1sleep20-21swapper/212:36:262
1717008260,4sleep20-21swapper/212:28:362
1700740260,1sleep00-21swapper/012:18:160
1678008261,3sleep11394205-21diskmemload12:05:151
1668033260,1sleep00-21swapper/011:57:120
1653874261,2sleep00-21swapper/011:50:150
1652184260,1sleep00-21swapper/011:47:470
1603110260,1sleep20-21swapper/211:16:512
1603110260,1sleep20-21swapper/211:16:512
1594582260,1sleep00-21swapper/011:10:440
1590754260,4sleep21592706-21cut11:10:192
1566107260,3sleep21568018-21kthreadcore10:55:192
1565222260,3sleep11566105-21cut10:55:181
1558292261,3sleep21560227-21grep10:50:182
1557457260,3sleep11558291-21cut10:50:171
1549817261,2sleep20-21swapper/210:45:172
1524188260,3sleep1214-21plymouthd10:30:131
1522980261,2sleep20-21swapper/210:28:462
1515858260,3sleep1214-21plymouthd10:25:121
1489352260,1sleep00-21swapper/010:05:350
1483471260,1sleep10-21swapper/110:05:121
14759860,3rtkit-daemon720-21snmpd11:35:072
1437786261,3sleep11439834-21cut09:35:191
1423104260,4sleep01423926-21memory09:25:200
1381494260,1sleep00-21swapper/008:58:230
1368823260,1sleep00-21swapper/008:46:490
1356209260,1sleep10-21swapper/108:35:361
1350068260,1sleep10-21swapper/108:31:591
1343934260,1sleep00-21swapper/008:28:570
1337534260,1sleep00-21swapper/008:22:320
1337413260,1sleep10-21swapper/108:20:571
1312499260,1sleep00-21swapper/008:02:370
1306382260,3sleep11306601-21sed08:00:011
1287801260,2sleep11287834-21apt-get07:45:101
1287443260,1sleep20-21swapper/207:43:432
1268957260,3sleep01269106-21df_inode07:30:150
1268304260,1sleep00-21swapper/007:25:260
1262162260,1sleep20-21swapper/207:22:192
1262110260,1sleep00-21swapper/007:21:370
1256006260,1sleep00-21swapper/007:18:570
1240983260,1sleep00-21swapper/007:08:230
1708620251,2sleep00-21swapper/012:22:490
1681921250,3sleep01682671-21sed12:05:180
1636624250,2sleep10-21swapper/111:39:061
1597166251,2sleep00-21swapper/011:15:160
1597166251,2sleep00-21swapper/011:15:160
1555204250,3sleep10-21swapper/110:47:521
1514249250,3sleep10-21swapper/110:22:071
1481187250,3sleep00-21swapper/010:00:260
1467227250,2sleep1214-21plymouthd09:55:101
1458668250,3sleep21458676-21ssh09:49:262
1388199250,2sleep10-21swapper/109:05:131
1388199250,2sleep10-21swapper/109:05:131
1369515250,3sleep01369630-21perl08:50:130
1294063250,2sleep10-21swapper/107:50:111
1287434250,3sleep00-21swapper/007:43:370
1268009251,2sleep21268246-21unixbench_singl07:25:242
1247225250,1sleep00-21swapper/007:12:030
1650777240,2sleep11651025-21grep11:45:231
1622627240,1sleep10-21swapper/111:30:161
1545043240,1sleep20-21swapper/210:40:202
1381622240,1sleep10-21swapper/109:00:001
1362111240,1sleep10-21swapper/108:40:251
1312948240,2sleep00-21swapper/008:05:130
1312391240,2sleep10-21swapper/108:01:131
1294410240,2sleep01294540-21ps07:50:140
1275187240,1sleep20-21swapper/207:35:142
1717610230,1sleep20-21swapper/212:30:012
1381889230,1sleep00-21swapper/009:00:030
1369327230,1sleep10-21swapper/108:50:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional