You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-10 - 20:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Sun Nov 10, 2024 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131023224946,1sleep70-21swapper/708:13:497
131023224946,1sleep70-21swapper/708:13:497
182169024846,1sleep70-21swapper/712:24:107
180145124846,1sleep70-21swapper/712:17:297
156624924846,1sleep70-21swapper/710:20:087
153555124846,1sleep70-21swapper/710:04:307
148480424846,1sleep70-21swapper/709:42:587
128022824846,1sleep70-21swapper/707:59:077
124976324846,1sleep70-21swapper/707:46:497
119795224845,1sleep70-21swapper/707:18:537
1164517992723,3cyclictest1597474-21latency_hist10:38:266
1164517992723,3cyclictest1597474-21latency_hist10:38:266
146409622523,1sleep70-21swapper/709:30:177
1164517992422,2cyclictest1555479-21kworker/u16:4+events_unbound12:13:396
1164512992319,3cyclictest1628149-21latency_hist10:53:265
1164517992118,2cyclictest1608107-21kworker/u16:2+flush-8:011:48:516
116451299200,19cyclictest0-21swapper/512:15:425
1164512991911,3cyclictest1525733-21latency_hist10:03:255
116452499180,16cyclictest0-21swapper/709:13:477
116452499170,1cyclictest0-21swapper/707:23:487
116450699170,1cyclictest0-21swapper/412:15:084
116450699170,16cyclictest1357156-21kthreadcore08:38:444
1164517991613,2cyclictest1189310-21kworker/u16:1+events_unbound07:33:406
116451799160,15cyclictest0-21swapper/608:40:416
116450699160,1cyclictest0-21swapper/412:24:214
116450699160,1cyclictest0-21swapper/412:08:594
116450699160,1cyclictest0-21swapper/411:58:454
116450699160,1cyclictest0-21swapper/411:48:314
116450699160,1cyclictest0-21swapper/411:44:254
1164524991514,0cyclictest0-21swapper/707:08:397
116452499150,7cyclictest0-21swapper/708:38:537
1164517991511,3cyclictest1392766-21kworker/u16:0+flush-8:009:03:266
116450699157,8cyclictest0-21swapper/407:59:434
116452499140,6cyclictest0-21swapper/712:12:087
116452499140,12cyclictest1229454-21turbostat07:38:257
1164517991412,2cyclictest28041-21gmain07:08:586
116451299140,1cyclictest0-21swapper/509:43:255
116451299140,13cyclictest0-21swapper/507:58:515
116450699146,8cyclictest0-21swapper/408:17:464
116450699146,8cyclictest0-21swapper/408:17:464
1164506991410,2cyclictest27119-21goa-identity-se07:10:594
116450699140,14cyclictest0-21swapper/411:00:574
1164524991312,0cyclictest0-21swapper/711:47:317
116452499130,6cyclictest0-21swapper/709:54:467
116452499130,12cyclictest1260076-21turbostat07:53:257
116452499130,12cyclictest0-21swapper/712:03:057
116452499130,11cyclictest0-21swapper/709:23:427
1164517991312,1cyclictest0-21swapper/609:23:426
1164517991311,2cyclictest1536573-21kworker/u16:1+events_unbound10:18:546
116451299136,7cyclictest0-21swapper/510:04:285
1164512991312,1cyclictest0-21swapper/508:38:475
116450699139,3cyclictest1321587-21latency_hist08:23:264
1164506991312,1cyclictest0-21swapper/409:51:444
1164506991312,1cyclictest0-21swapper/409:27:274
116450699130,1cyclictest0-21swapper/407:34:434
116452499120,1cyclictest0-21swapper/709:51:317
116452499120,10cyclictest0-21swapper/711:51:167
116451799129,2cyclictest1166-21snmpd07:48:516
1164517991211,1cyclictest0-21swapper/611:03:216
1164517991211,1cyclictest0-21swapper/609:49:056
116451799120,1cyclictest0-21swapper/612:03:166
116451799120,1cyclictest0-21swapper/607:28:086
116451799120,12cyclictest0-21swapper/612:25:566
116451299126,5cyclictest28032-21pool-gsd-smartc10:18:545
1164512991211,1cyclictest0-21swapper/511:33:485
1164512991211,1cyclictest0-21swapper/510:58:385
116451299120,1cyclictest0-21swapper/511:52:055
116451299120,12cyclictest0-21swapper/509:24:315
1164506991211,1cyclictest0-21swapper/409:40:514
116450699120,1cyclictest0-21swapper/411:35:574
116450699120,12cyclictest0-21swapper/410:07:494
116450699120,12cyclictest0-21swapper/409:57:154
116452499119,1cyclictest0-21swapper/708:33:267
116451799119,2cyclictest1679596-21kworker/u16:1+flush-8:012:08:446
116451799118,2cyclictest1506847-21irqcore09:53:426
116451799118,2cyclictest1352756-21kworker/u16:1+flush-8:008:48:266
116451799118,2cyclictest1197101-21cut07:18:476
1164517991110,1cyclictest0-21swapper/609:40:356
116451799110,1cyclictest0-21swapper/609:18:116
116451799110,11cyclictest0-21swapper/611:35:406
116451799110,11cyclictest0-21swapper/607:45:386
116451299119,1cyclictest0-21swapper/507:49:125
116451299118,2cyclictest1166-21snmpd12:11:205
1164512991110,1cyclictest0-21swapper/511:45:475
1164512991110,1cyclictest0-21swapper/507:34:185
116451299110,11cyclictest0-21swapper/512:25:405
116451299110,11cyclictest0-21swapper/512:01:235
116451299110,11cyclictest0-21swapper/509:33:015
116451299110,11cyclictest0-21swapper/508:15:565
116451299110,11cyclictest0-21swapper/508:15:565
116451299110,11cyclictest0-21swapper/507:46:085
1164506991110,1cyclictest0-21swapper/407:48:364
116452499109,0cyclictest0-21swapper/711:33:297
116452499109,0cyclictest0-21swapper/710:58:407
116451799108,2cyclictest86-21ksoftirqd/611:43:496
116451799108,1cyclictest1166-21snmpd08:02:016
116451299109,1cyclictest0-21swapper/509:15:275
116451299109,1cyclictest0-21swapper/507:08:365
116451299107,2cyclictest1166-21snmpd09:52:495
116451299105,4cyclictest1198799-21latency_hist07:23:265
116450699108,1cyclictest0-21swapper/410:33:264
116450699108,1cyclictest0-21swapper/409:14:514
116450699108,1cyclictest0-21swapper/407:28:264
116450699108,1cyclictest0-21swapper/407:18:454
116450699107,2cyclictest1166-21snmpd07:45:004
116450699106,3cyclictest1138-21rs:main4
116450699100,7cyclictest0-21swapper/409:31:184
11645249998,0cyclictest0-21swapper/709:08:267
11645179995,3cyclictest1455630-21cat09:28:406
11645179990,2cyclictest1308266-21cut08:13:446
11645179990,2cyclictest1308266-21cut08:13:446
11645129995,3cyclictest1689573-21cat11:23:265
11645069997,1cyclictest0-21swapper/411:23:264
11645069997,1cyclictest0-21swapper/410:43:264
11645069995,3cyclictest1638151-21latency_hist10:58:264
11645069994,4cyclictest1565457-21cat10:18:494
11645069990,5cyclictest1342136-21munin-run08:33:264
11645249986,1cyclictest0-21swapper/712:33:257
11645249986,1cyclictest0-21swapper/710:13:257
11645179984,3cyclictest1700090-21sed11:28:266
11645179980,7cyclictest0-21swapper/610:18:266
11645179980,3cyclictest1529769-21cat10:03:426
11645129986,1cyclictest0-21swapper/509:08:265
11645129985,2cyclictest751ktimers/512:33:255
11645129984,2cyclictest14250irq/27-ahci[0000:00:1f.2]09:53:395
11645069986,1cyclictest0-21swapper/408:38:264
11645069986,1cyclictest0-21swapper/407:58:264
11645069984,3cyclictest1812293-21cat12:23:254
11645249976,0cyclictest0-21swapper/711:43:257
11645249976,0cyclictest0-21swapper/711:18:267
11645249976,0cyclictest0-21swapper/710:33:267
11645249975,1cyclictest0-21swapper/711:08:257
11645249975,1cyclictest0-21swapper/710:28:267
11645249975,1cyclictest0-21swapper/708:38:267
11645249975,1cyclictest0-21swapper/707:18:267
11645249974,1cyclictest0-21swapper/708:48:267
11645179975,2cyclictest1392766-21kworker/u16:0+flush-8:009:13:266
11645179975,1cyclictest28024-21abrt-dbus11:33:266
11645179975,1cyclictest0-21swapper/608:33:266
11645179973,3cyclictest1679244-21crond11:18:256
11645179973,3cyclictest1659008-21cat11:08:266
11645179973,3cyclictest1608060-21cat10:43:266
11645179970,6cyclictest1638698-21latency_hist10:58:266
11645179970,6cyclictest0-21swapper/612:38:256
11645129975,1cyclictest0-21swapper/510:58:265
11645129975,1cyclictest0-21swapper/510:13:255
11645129970,4cyclictest1403400-21idleruntime-cro09:03:265
11645069975,1cyclictest0-21swapper/410:38:264
11645069975,1cyclictest0-21swapper/410:38:264
11645069975,1cyclictest0-21swapper/409:03:264
11645069975,1cyclictest0-21swapper/408:08:264
11645069974,2cyclictest1189278-21latency_hist07:18:264
11645069973,3cyclictest1546543-21sed10:13:254
11645069973,3cyclictest1526254-21date10:03:254
11645069973,3cyclictest1424100-21date09:13:264
11645069972,4cyclictest639-21systemd-journal12:38:254
11645069970,3cyclictest1628166-21sleep10:53:254
11645069970,2cyclictest1679254-21munin-run11:18:254
11645249965,0cyclictest0-21swapper/711:33:257
11645249965,0cyclictest0-21swapper/710:53:267
11645249965,0cyclictest0-21swapper/709:48:257
11645249965,0cyclictest0-21swapper/707:33:267
11645249964,1cyclictest0-21swapper/709:23:257
11645179963,2cyclictest1689811-21sed11:23:266
11645179963,2cyclictest1475280-21latency_hist09:38:256
11645179963,2cyclictest1443895-21latency_hist09:23:256
11645179963,2cyclictest1413993-21latency_hist09:08:266
11645179963,2cyclictest1352484-21latency_hist08:38:266
11645179962,3cyclictest1577102-21systemd-run10:28:256
11645179962,3cyclictest1546656-21date10:13:256
11645179962,3cyclictest1526264-21sort10:03:256
11645179962,3cyclictest1495730-21cat09:48:256
11645179960,5cyclictest0-21swapper/611:13:266
11645129964,1cyclictest0-21swapper/508:08:265
11645129963,2cyclictest1781248-21latency_hist12:08:255
11645129963,2cyclictest1239841-21latency_hist07:43:265
11645129963,2cyclictest1199585-21cpuspeed07:23:375
11645129963,2cyclictest0-21swapper/510:38:265
11645129963,2cyclictest0-21swapper/510:38:265
11645129962,3cyclictest1812326-21latency_hist12:23:255
11645129962,3cyclictest1658824-21ls11:08:255
11645129962,3cyclictest1607777-21cut10:43:255
11645129962,3cyclictest1393281-21date08:58:265
11645129962,3cyclictest1301633-21cat08:13:265
11645129962,3cyclictest1301633-21cat08:13:265
11645129961,2cyclictest0-21swapper/511:43:255
11645129960,5cyclictest1709928-21munin-run11:33:255
11645129960,5cyclictest1372834-21munin-run08:48:265
11645129960,5cyclictest1342278-21cat08:33:265
11645129960,3cyclictest1423861-21awk09:13:265
11645069965,1cyclictest0-21swapper/407:08:264
11645069964,1cyclictest0-21swapper/411:33:264
11645069964,1cyclictest0-21swapper/411:08:254
11645069963,2cyclictest1577444-21latency_hist10:28:264
11645069962,3cyclictest1781648-21cat12:08:254
11645069962,3cyclictest1393348-21date08:58:264
11645069962,3cyclictest1372469-21cron08:48:264
11645069962,3cyclictest1240115-21cut07:43:264
11645069962,3cyclictest1138-21rs:main4
11645249954,0cyclictest0-21swapper/710:38:257
11645249954,0cyclictest0-21swapper/710:38:257
11645249954,0cyclictest0-21swapper/710:03:267
11645249954,0cyclictest0-21swapper/709:03:267
11645249954,0cyclictest0-21swapper/708:58:267
11645249953,1cyclictest0-21swapper/712:23:257
11645179953,2cyclictest86-21ksoftirqd/607:58:266
11645179953,1cyclictest1761385-21exim411:58:256
11645179953,1cyclictest0-21swapper/612:33:256
11645179950,4cyclictest1812322-21latency_hist12:23:256
11645179950,4cyclictest1781602-21cat12:08:256
11645179950,4cyclictest1730675-21date11:43:256
11645179950,4cyclictest1628156-21/usr/sbin/munin10:53:256
11645179950,4cyclictest1393191-21exim408:58:256
11645179950,4cyclictest1383213-21sed08:53:266
11645179950,4cyclictest1321755-21latency_hist08:23:266
11645179950,4cyclictest1291285-21latency_hist08:08:266
11645179950,4cyclictest1239841-21latency_hist07:43:266
11645129954,1cyclictest751ktimers/511:18:255
11645129951,3cyclictest1475292-21date09:38:255
11645129950,4cyclictest1843089-21cat12:38:255
11645129950,4cyclictest1761351-21cron11:58:255
11645129950,4cyclictest1699958-21exim411:28:265
11645129950,4cyclictest1668661-21cron11:13:265
11645129950,4cyclictest1587571-21cron10:33:265
11645129950,4cyclictest1587571-21cron10:33:265
11645129950,4cyclictest1577100-21cron10:28:255
11645129950,4cyclictest1556310-21sh10:18:255
11645129950,4cyclictest1495504-21sendmail09:48:255
11645129950,4cyclictest1444537-21cat09:23:255
11645129950,4cyclictest1382669-21cron08:53:265
11645129950,4cyclictest1352465-21sendmail08:38:265
11645129950,4cyclictest1321587-21latency_hist08:23:265
11645129950,4cyclictest1270342-21latency_hist07:58:265
11645129950,4cyclictest1219893-21latency_hist07:33:265
11645129950,4cyclictest1189194-21sendmail07:18:265
11645069953,1cyclictest0-21swapper/409:48:254
11645069953,1cyclictest0-21swapper/407:33:264
11645069952,2cyclictest1761350-21latency_hist11:58:254
11645069952,2cyclictest1730596-21latency_hist11:43:254
11645069950,4cyclictest1832550-21idleruntime-cro12:33:254
11645069950,4cyclictest1699925-21latency_hist11:28:264
11645069950,4cyclictest1669171-21sendmail11:13:264
11645069950,4cyclictest1587588-21sed10:33:264
11645069950,4cyclictest1475296-21sed09:38:254
11645069950,4cyclictest1444524-21cron09:23:254
11645069950,4cyclictest1383235-21sed08:53:264
11645069950,4cyclictest1332264-21date08:28:264
11645069950,4cyclictest1301618-21latency_hist08:13:264
11645069950,4cyclictest1301618-21latency_hist08:13:264
11645249944,0cyclictest0-21swapper/712:08:257
11645249943,0cyclictest0-21swapper/710:18:267
11645249942,1cyclictest0-21swapper/711:23:257
11645249942,1cyclictest0-21swapper/711:13:267
11645249942,1cyclictest0-21swapper/708:13:267
11645249942,1cyclictest0-21swapper/708:13:267
11645249942,1cyclictest0-21swapper/708:08:267
11645249940,3cyclictest1423867-21sleep09:13:267
11645249940,3cyclictest1321779-21chrt08:23:267
11645179940,3cyclictest1618309-21sed10:48:266
11645179940,3cyclictest1587582-21latency_hist10:33:266
11645179940,3cyclictest1587582-21latency_hist10:33:266
11645179940,3cyclictest1332263-21cat08:28:266
11645179940,3cyclictest1300970-21latency_hist08:13:266
11645179940,3cyclictest1300970-21latency_hist08:13:266
11645179940,3cyclictest1219241-21sh07:33:266
11645179940,3cyclictest1189162-21latency_hist07:18:266
11645179940,3cyclictest1164930-21date07:08:266
11645129940,3cyclictest1618310-21date10:48:265
11645129940,3cyclictest1332265-21sendmail08:28:265
11645129940,3cyclictest1164932-21latency_hist07:08:265
11645069940,3cyclictest1617597-21latency_hist10:48:264
11645249930,2cyclictest16993612sleep711:28:267
11645249930,2cyclictest0-21swapper/712:38:257
11645249930,2cyclictest0-21swapper/711:58:257
11645249930,2cyclictest0-21swapper/710:58:267
11645249930,2cyclictest0-21swapper/710:43:257
11645249930,2cyclictest0-21swapper/710:33:267
11645249930,2cyclictest0-21swapper/708:28:267
11645249930,2cyclictest0-21swapper/707:58:267
11645249930,2cyclictest0-21swapper/707:43:267
11645249920,1cyclictest0-21swapper/710:48:267
11645249920,1cyclictest0-21swapper/709:38:257
11645249920,1cyclictest0-21swapper/708:53:267
11645249920,1cyclictest0-21swapper/707:08:267
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional