You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 06:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackeslot2.osadl.org (updated Mon Nov 03, 2025 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133540921730,2sleep30-21swapper/319:16:003
176310321110,2sleep0241rcuc/023:55:580
153607421050,2sleep30-21swapper/321:46:003
16490312800,0sleep11649035-21sed22:50:581
15820742750,1sleep01582080-21ssh22:11:010
18296392360,2sleep30-21swapper/300:31:123
1323513992724,2cyclictest1770291-40install00:00:001
1323512992419,4cyclictest0-21swapper/000:30:010
835298230,2rtkit-daemon8351-21rtkit-daemon21:48:450
132351399231,2cyclictest1787934-21awk00:10:001
132351399230,22cyclictest1715194-21unixbench_multi23:26:081
1323514992219,1cyclictest0-21swapper/223:45:012
302487291210,2phc2sys0-21swapper/300:37:513
1323513992118,2cyclictest1603328-21dump-pmu-power22:25:011
1323512992112,8cyclictest0-21swapper/022:25:550
835298200,3rtkit-daemon1323510-21cyclictest22:38:171
16643742200,1sleep00-21swapper/022:59:270
1323514992018,1cyclictest0-21swapper/222:55:022
1323513992017,2cyclictest0-21swapper/119:26:051
1323513992015,3cyclictest1774064-21kthreadcore00:01:001
1323512992017,2cyclictest1374306-21apt-key19:50:000
1323514991916,1cyclictest0-21swapper/223:20:002
1323514991916,1cyclictest0-21swapper/222:30:012
1323514991916,1cyclictest0-21swapper/222:00:002
1323514991916,1cyclictest0-21swapper/200:30:012
132351399194,4cyclictest0-21swapper/122:06:001
1323513991916,2cyclictest1814622-21systemd-run00:25:011
1323513991916,2cyclictest1673766-21gpgconf23:05:011
1323513991916,2cyclictest1631-21gmain20:00:011
1323513991916,2cyclictest1559560-21grep22:00:001
1323513991915,2cyclictest835298rtkit-daemon23:05:031
1323513991913,4cyclictest0-21swapper/121:45:021
1323512991917,1cyclictest1735184-21ssh23:40:000
1323512991916,2cyclictest1787899-21latency_hist00:10:020
302487291180,3phc2sys0-21swapper/321:36:383
302487291180,2phc2sys0-21swapper/322:32:023
302487291180,2phc2sys0-21swapper/321:11:383
132351499189,6cyclictest1636715-21chrt22:42:142
1323514991814,2cyclictest0-21swapper/223:25:582
1323513991815,2cyclictest1635-21dbus-daemon19:15:011
1323513991814,3cyclictest1436913-21kthreadcore20:40:581
132351299189,8cyclictest0-21swapper/023:45:540
132351299189,8cyclictest0-21swapper/022:00:520
1323512991815,2cyclictest1550732-21munin-run21:55:000
1323512991815,2cyclictest1480514-21apt-key21:15:000
1323512991815,2cyclictest0-21swapper/000:20:010
1323512991810,7cyclictest1491223-21irqcore21:21:010
1323512991810,7cyclictest0-21swapper/022:44:550
132351299180,2cyclictest1718526-21/usr/sbin/munin23:31:010
302487291171,3phc2sys0-21swapper/319:36:003
302487291170,3phc2sys0-21swapper/321:26:283
302487291170,2phc2sys0-21swapper/322:24:053
132351499171,8cyclictest0-21swapper/223:45:552
1323514991714,1cyclictest0-21swapper/223:32:012
1323514991714,1cyclictest0-21swapper/222:49:522
1323514991714,1cyclictest0-21swapper/222:16:292
1323514991714,1cyclictest0-21swapper/221:15:012
1323514991714,1cyclictest0-21swapper/219:10:022
1323514991714,1cyclictest0-21swapper/200:25:012
1323514991713,2cyclictest0-21swapper/220:30:012
132351399178,4cyclictest1435489-21kworker/u16:3+nfsiod21:10:081
1323513991714,2cyclictest1635-21dbus-daemon00:15:021
1323513991714,2cyclictest0-21swapper/123:40:581
1323513991713,3cyclictest1351685-21kthreadcore19:30:581
1323513991713,3cyclictest1351685-21kthreadcore19:30:581
132351299179,3cyclictest1521553-21processes21:36:030
132351299178,2cyclictest0-21swapper/023:07:570
132351299177,5cyclictest0-21swapper/023:30:000
132351299176,7cyclictest1732849-21kworker/u16:0-xprtiod00:03:550
132351299175,6cyclictest0-21swapper/000:30:530
132351299173,9cyclictest1806670-21aten2.4-expect00:20:520
1323512991714,2cyclictest1655945-21munin-run22:55:000
1323512991714,2cyclictest1452640-21processes20:51:030
1323512991713,2cyclictest1621022-21munin-plugin-st22:35:010
1323512991713,2cyclictest0-21swapper/020:40:010
132351299171,15cyclictest0-21swapper/022:35:050
1323512991711,5cyclictest0-21swapper/021:45:010
1323512991711,2cyclictest16-21ksoftirqd/023:04:430
302487291160,2phc2sys0-21swapper/322:16:073
132351499162,6cyclictest0-21swapper/221:40:012
132351499161,8cyclictest0-21swapper/200:00:522
1323514991613,1cyclictest0-21swapper/219:55:562
1323514991613,1cyclictest0-21swapper/219:25:012
1323514991613,1cyclictest0-21swapper/200:38:252
1323514991613,1cyclictest0-21swapper/200:11:082
1323514991613,1cyclictest0-21swapper/200:10:012
1323514991613,1cyclictest0-21swapper/200:00:022
132351399167,3cyclictest170550irq/121-eno122:00:361
132351399163,5cyclictest491rcuog/222:15:411
1323513991614,1cyclictest1435477-21cut20:40:021
1323513991613,2cyclictest1700-21systemd-logind23:50:021
1323513991613,2cyclictest1544144-21kthreadcore21:50:581
1323513991613,2cyclictest1542006-21grep21:50:001
1323513991613,2cyclictest1490389-21aten2.4-expect21:20:561
1323513991613,2cyclictest1-21systemd21:16:331
1323513991613,2cyclictest0-21swapper/119:50:011
1323513991612,3cyclictest1816706-21kthreadcore00:26:001
1323513991612,3cyclictest1659175-21kthreadcore22:56:021
1323513991612,2cyclictest170550irq/121-eno100:35:551
132351299169,6cyclictest0-21swapper/021:31:050
132351299167,2cyclictest0-21swapper/022:05:590
132351299162,9cyclictest171ktimers/022:16:060
1323512991613,2cyclictest1652-1atopacctd23:20:580
1323512991613,2cyclictest1652-1atopacctd20:21:330
1323512991613,2cyclictest1481661-21cpu21:15:550
1323512991613,2cyclictest1442017-21tr20:45:570
1323512991613,2cyclictest1356585-21aten_repower_vo19:35:520
1323512991613,2cyclictest1343996-21latency_hist19:25:000
1323512991613,2cyclictest1332223-21aten_repower_fr19:15:530
1323512991613,2cyclictest1329983-21kthreadcore19:15:020
1323512991612,3cyclictest1426244-21kthreadcore20:31:010
302487291152,3phc2sys0-21swapper/323:40:193
302487291151,6phc2sys0-21swapper/322:35:523
302487291150,4phc2sys0-21swapper/323:35:093
302487291150,2phc2sys0-21swapper/322:53:503
132351499151,5cyclictest0-21swapper/221:10:012
1323514991513,1cyclictest0-21swapper/223:20:562
1323514991513,1cyclictest0-21swapper/221:30:022
1323514991513,1cyclictest0-21swapper/219:15:022
1323514991512,1cyclictest0-21swapper/223:01:042
1323514991512,1cyclictest0-21swapper/221:55:012
1323514991512,1cyclictest0-21swapper/220:40:022
1323514991512,1cyclictest0-21swapper/220:10:012
1323514991511,2cyclictest0-21swapper/221:45:362
1323514991510,2cyclictest0-21swapper/223:08:092
132351399158,5cyclictest0-21swapper/119:41:051
132351399157,3cyclictest1106-21hwrng22:45:071
132351399155,5cyclictest1514009-1ssh21:32:121
132351399155,2cyclictest170550irq/121-eno121:40:011
132351399153,7cyclictest1498685-21kworker/u16:3+xprtiod22:25:571
1323513991513,1cyclictest1106-21hwrng23:51:411
1323513991512,2cyclictest191rcu_preempt23:16:271
1323513991512,2cyclictest1709056-21sh23:25:011
1323513991512,2cyclictest1700-21systemd-logind20:30:001
1323513991512,2cyclictest1687289-21kthreadcore23:11:021
1323513991512,2cyclictest1661-21polkitd19:36:021
1323513991512,2cyclictest1632179-21kthreadcore22:41:001
1323513991512,2cyclictest1619440-21runrttasks22:32:461
1323513991512,2cyclictest1408724-21kthreadcore20:15:591
1323513991512,2cyclictest1408724-21kthreadcore20:15:591
1323513991511,3cyclictest1827040-21kthreadcore00:31:021
1323513991511,3cyclictest1424573-21tr20:30:591
132351399150,9cyclictest1417043-21cat20:25:001
132351299156,5cyclictest0-21swapper/023:40:270
132351299155,5cyclictest1595342-21/usr/sbin/munin22:21:050
132351299153,5cyclictest1552774-21cut21:55:590
1323512991512,2cyclictest7602-21cron21:05:000
1323512991512,2cyclictest1796760-21systemd-run00:15:010
1323512991512,2cyclictest1418040-21cut20:25:550
1323512991512,2cyclictest1406847-21kthreadcore20:15:580
1323512991512,2cyclictest1406847-21kthreadcore20:15:580
1323512991512,2cyclictest1350463-21aten_repower_fr19:30:520
1323512991512,2cyclictest1350463-21aten_repower_fr19:30:520
1323512991511,3cyclictest1754002-21cstates23:50:550
302487291140,4phc2sys0-21swapper/319:30:523
302487291140,4phc2sys0-21swapper/319:30:523
302487291140,3phc2sys0-21swapper/300:03:163
302487291140,2phc2sys0-21swapper/323:17:083
302487291140,2phc2sys0-21swapper/323:03:183
1323514991412,1cyclictest0-21swapper/223:11:022
1323514991412,1cyclictest0-21swapper/222:05:022
1323514991412,1cyclictest0-21swapper/220:55:012
1323514991412,1cyclictest0-21swapper/219:26:052
1323514991411,1cyclictest0-21swapper/223:51:002
1323514991411,1cyclictest0-21swapper/223:35:272
1323514991411,1cyclictest0-21swapper/222:21:032
1323514991411,1cyclictest0-21swapper/221:20:572
1323514991411,1cyclictest0-21swapper/220:15:522
1323514991411,1cyclictest0-21swapper/220:15:522
1323514991411,1cyclictest0-21swapper/220:15:002
1323514991411,1cyclictest0-21swapper/219:46:002
1323513991411,2cyclictest1805991-21systemd-run00:20:021
1323513991411,2cyclictest1718578-21aten_repower_cu23:30:531
1323513991411,2cyclictest1577846-21/usr/sbin/munin22:10:541
1323513991411,2cyclictest1459761-21cut21:00:021
1323513991411,2cyclictest1446430-21head20:46:041
1323513991410,3cyclictest1732849-21kworker/u16:0+nfsiod23:39:461
1323513991410,3cyclictest1502606-21kthreadcore21:26:011
1323513991410,3cyclictest1470092-21kthreadcore21:06:021
1323513991410,3cyclictest1399842-21fschecks_time20:10:551
1323513991410,3cyclictest1375606-21gltestperf19:50:561
132351299148,2cyclictest1471645-21diskmemload23:15:530
132351299148,1cyclictest191rcu_preempt22:45:510
132351299147,1cyclictest170550irq/121-eno121:25:550
132351299142,7cyclictest0-21swapper/019:40:530
132351299141,8cyclictest2025-21snmpd19:55:570
132351299141,8cyclictest0-21swapper/023:10:140
1323512991411,2cyclictest1468744-21kthreadcore21:06:020
1323512991411,2cyclictest1391865-21pmu-power20:01:020
1323512991411,2cyclictest1376199-21kthreadcore19:50:580
1323512991410,3cyclictest1835722-21kthreadcore00:36:020
1323512991410,3cyclictest1435939-21cpuspeed_turbos20:40:540
1323512991410,3cyclictest1401966-21kthreadcore20:10:590
1323512991410,3cyclictest1395897-21kthreadcore20:06:000
1323512991410,3cyclictest1346697-21kthreadcore19:26:000
302487291133,3phc2sys0-21swapper/319:26:073
302487291131,3phc2sys0-21swapper/323:11:023
302487291130,2phc2sys0-21swapper/321:32:103
302487291130,2phc2sys0-21swapper/321:15:353
302487291130,2phc2sys0-21swapper/320:00:333
1323514991311,1cyclictest0-21swapper/222:38:382
1323514991311,1cyclictest0-21swapper/222:35:022
1323514991311,1cyclictest0-21swapper/222:10:022
1323514991311,1cyclictest0-21swapper/221:45:022
1323514991311,1cyclictest0-21swapper/220:42:232
1323514991310,2cyclictest0-21swapper/222:56:302
1323514991310,2cyclictest0-21swapper/200:16:032
1323514991310,1cyclictest0-21swapper/221:16:582
1323514991310,1cyclictest0-21swapper/221:00:012
1323514991310,1cyclictest0-21swapper/220:05:012
1323514991310,1cyclictest0-21swapper/219:50:592
1323514991310,1cyclictest0-21swapper/219:40:592
1323514991310,1cyclictest0-21swapper/219:35:002
1323514991310,1cyclictest0-21swapper/219:35:002
132351499130,11cyclictest0-21swapper/221:32:522
132351399136,2cyclictest501rcuop/220:05:521
1323513991310,2cyclictest1341305-21kthreadcore19:21:011
1323513991310,2cyclictest1335478-21kthreadcore19:16:001
1323513991310,2cyclictest1311234-21kworker/u16:0-events_unbound20:55:021
132351399130,2cyclictest36-21ksoftirqd/121:01:041
132351299133,1cyclictest0-21swapper/020:56:020
302487291123,2phc2sys0-21swapper/323:51:013
302487291121,2phc2sys0-21swapper/322:40:523
302487291120,3phc2sys0-21swapper/323:05:453
302487291120,3phc2sys0-21swapper/300:14:243
302487291120,2phc2sys0-21swapper/321:00:353
302487291120,2phc2sys0-21swapper/320:42:493
302487291120,2phc2sys0-21swapper/319:20:343
132351499129,1cyclictest0-21swapper/220:45:562
132351499129,1cyclictest0-21swapper/220:30:532
132351499129,1cyclictest0-21swapper/220:23:482
132351499129,1cyclictest0-21swapper/219:36:422
132351499127,3cyclictest1823718-21chrt00:30:192
1323514991210,1cyclictest0-21swapper/222:11:422
132351399129,2cyclictest1700-21systemd-logind19:10:011
132351399129,2cyclictest1388871-21kthreadcore20:00:581
302487291114,3phc2sys0-21swapper/320:05:533
302487291113,2phc2sys0-21swapper/322:11:023
302487291111,3phc2sys0-21swapper/320:55:593
302487291111,2phc2sys0-21swapper/322:55:113
302487291111,2phc2sys0-21swapper/322:01:003
302487291110,3phc2sys0-21swapper/320:22:393
302487291110,2phc2sys0-21swapper/320:35:523
302487291110,2phc2sys0-21swapper/320:30:353
302487291110,2phc2sys0-21swapper/320:25:183
302487291110,2phc2sys0-21swapper/319:56:533
302487291110,2phc2sys0-21swapper/300:20:123
132351499119,1cyclictest0-21swapper/221:00:402
132351499119,1cyclictest0-21swapper/219:15:592
132351299118,2cyclictest0-21swapper/019:10:010
302487291103,3phc2sys0-21swapper/319:50:013
302487291103,2phc2sys0-21swapper/300:05:153
302487291101,3phc2sys0-21swapper/321:42:213
302487291101,3phc2sys0-21swapper/320:50:583
302487291101,2phc2sys0-21swapper/323:33:223
302487291101,2phc2sys0-21swapper/322:26:053
302487291101,2phc2sys0-21swapper/321:55:513
302487291101,2phc2sys0-21swapper/320:16:003
302487291101,2phc2sys0-21swapper/320:16:003
302487291100,3phc2sys0-21swapper/323:56:143
302487291100,3phc2sys0-21swapper/322:48:253
302487291100,2phc2sys0-21swapper/323:27:253
302487291100,2phc2sys0-21swapper/323:22:083
302487291100,2phc2sys0-21swapper/321:51:353
302487291100,2phc2sys0-21swapper/321:22:283
302487291100,2phc2sys0-21swapper/321:08:423
302487291100,2phc2sys0-21swapper/320:46:053
302487291100,2phc2sys0-21swapper/319:50:523
302487291100,2phc2sys0-21swapper/319:05:283
302487291100,2phc2sys0-21swapper/300:26:093
302487291100,2phc2sys0-21swapper/300:16:223
30248729190,3phc2sys0-21swapper/323:45:563
30248729190,2phc2sys0-21swapper/322:05:253
30248729190,2phc2sys0-21swapper/320:11:073
30248729190,2phc2sys0-21swapper/319:40:583
30248729190,2phc2sys0-21swapper/319:11:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional