You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-15 - 20:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Mon Apr 15, 2024 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
138647321100,2sleep30-21swapper/309:10:163
14228572990,3sleep00-21swapper/009:35:020
13020422490,0sleep11302046-21grep08:00:011
12727852360,2sleep30-21swapper/307:30:253
2358491280,6ptp4l164790irq/127-enp1s0-TxRx-008:35:023
2358491280,2ptp4l0-21swapper/312:22:563
2358491270,1ptp4l0-21swapper/310:00:403
2358491260,3ptp4l0-21swapper/311:25:063
2358491260,2ptp4l0-21swapper/312:36:273
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-011:44:033
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-010:56:473
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-009:24:033
2358491250,3ptp4l0-21swapper/311:59:553
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-012:17:223
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-011:17:383
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-010:27:163
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-009:48:323
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-009:32:053
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-011:53:303
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-010:37:543
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-009:58:463
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-009:18:223
2358491240,3ptp4l164790irq/127-enp1s0-TxRx-012:29:043
2358491240,2ptp4l0-21swapper/311:40:013
1242583992421,2cyclictest254-21systemd-journal11:20:001
1242583992421,2cyclictest1686868-21cron12:20:001
1242583992416,1cyclictest191rcu_preempt12:05:111
1242582992421,2cyclictest1-21systemd11:05:000
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:34:093
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-008:50:243
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-011:23:123
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-010:09:493
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-008:15:273
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-007:44:323
2358491230,3ptp4l0-21swapper/312:10:103
2358491230,1ptp4l0-21swapper/309:40:273
2358491230,1ptp4l0-21swapper/309:40:273
171857622319,2sleep20-21swapper/212:39:342
170131122319,2sleep20-21swapper/212:27:002
154873422319,2sleep20-21swapper/210:51:202
153254122319,2sleep20-21swapper/210:40:462
148450622319,2sleep20-21swapper/210:11:002
147834722319,2sleep20-21swapper/210:09:322
146145322319,2sleep20-21swapper/209:57:462
145231022319,2sleep20-21swapper/209:50:522
142900922319,2sleep20-21swapper/209:37:012
142164022319,2sleep20-21swapper/209:33:132
139660422319,2sleep20-21swapper/209:16:012
137785622319,2sleep20-21swapper/209:05:112
137147722319,2sleep20-21swapper/209:00:022
137147722319,2sleep20-21swapper/209:00:022
136527622319,2sleep20-21swapper/208:52:022
134153922319,2sleep20-21swapper/208:30:282
129608322319,2sleep20-21swapper/207:52:372
127832122319,2sleep20-21swapper/207:35:262
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-012:08:413
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-011:30:243
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-010:40:103
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-009:52:343
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-007:35:153
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-010:15:223
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-007:06:113
2358491220,2ptp4l0-21swapper/309:25:433
23582912216,2phc2sys0-21swapper/309:01:523
23582912216,2phc2sys0-21swapper/309:01:523
170921122218,2sleep20-21swapper/212:31:522
169459822218,2sleep20-21swapper/212:24:272
167737022218,2sleep20-21swapper/212:12:102
166915222218,2sleep20-21swapper/212:07:162
166117322218,2sleep20-21swapper/212:02:192
164445122218,2sleep20-21swapper/211:50:482
161319422218,2sleep20-21swapper/211:32:042
160652522218,2sleep20-21swapper/211:29:402
154205022218,2sleep20-21swapper/210:48:522
152485422219,2sleep20-21swapper/210:36:252
151694522218,2sleep20-21swapper/210:32:042
141243822219,2sleep20-21swapper/209:25:512
135943222219,2sleep20-21swapper/208:45:432
133626022219,2sleep20-21swapper/208:27:042
133040822219,2sleep20-21swapper/208:20:432
132471922219,2sleep20-21swapper/208:16:462
131383522219,2sleep20-21swapper/208:10:052
131347922219,2sleep20-21swapper/208:09:282
130764422219,2sleep20-21swapper/208:03:112
129018422219,2sleep20-21swapper/207:45:362
128475722219,2sleep20-21swapper/207:44:482
126211522219,2sleep20-21swapper/207:25:042
125594422219,2sleep20-21swapper/207:18:552
1242583992219,2cyclictest1464-21dbus-daemon07:30:011
1242582992219,2cyclictest1526835-21grep10:40:010
1242582992217,3cyclictest254-21systemd-journal10:10:000
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-010:13:213
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-011:00:593
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-010:50:383
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-010:48:543
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-007:19:503
2358491210,2ptp4l0-21swapper/312:01:163
156657922118,2sleep20-21swapper/211:04:592
124258499211,10cyclictest0-21swapper/212:00:012
1242583992118,2cyclictest1273304-21cron07:35:001
1242583992116,3cyclictest0-21swapper/109:50:011
1242582992118,2cyclictest1342673-21latency_hist08:35:010
1242582992118,2cyclictest1256069-21ls07:20:000
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:37:463
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:24:523
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:07:123
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-011:14:553
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-009:36:183
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-011:45:283
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-008:55:153
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-008:41:363
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-008:25:223
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-007:12:483
2358491200,2ptp4l0-21swapper/312:31:143
2358491200,2ptp4l0-21swapper/311:06:593
2358491200,2ptp4l0-21swapper/308:10:253
23582912015,3phc2sys0-21swapper/309:07:453
1242584992017,1cyclictest0-21swapper/211:00:012
1242584992017,1cyclictest0-21swapper/207:35:002
1242583992016,3cyclictest1592394-21kthreadcore11:20:141
1242583992016,3cyclictest1412033-21timerwakeupswit09:25:211
1242583992014,5cyclictest1652581-21runrttasks11:56:051
1242583992014,5cyclictest1551769-21irqcore10:55:111
1242582992017,2cyclictest1464-21dbus-daemon12:05:010
2358491190,5ptp4l164790irq/127-enp1s0-TxRx-008:45:063
2358491190,5ptp4l164790irq/127-enp1s0-TxRx-007:50:063
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-007:55:103
2358491190,2ptp4l164790irq/127-enp1s0-TxRx-007:20:223
2358491190,2ptp4l0-21swapper/310:20:093
124258499191,9cyclictest0-21swapper/211:10:012
1242583991915,3cyclictest1579815-21phc2sys11:10:161
1242583991914,4cyclictest1423078-21cpuspeed_turbos09:35:071
1242583991913,5cyclictest0-21swapper/110:35:201
1242582991916,2cyclictest1518476-21latency_hist10:35:000
1242582991916,2cyclictest1464-21dbus-daemon10:05:020
1242582991916,2cyclictest1454-1atopacctd09:50:110
1242582991916,2cyclictest1383360-21cstates09:10:080
2358491180,3ptp4l164790irq/127-enp1s0-TxRx-007:25:193
2358491180,2ptp4l0-21swapper/308:04:283
12565472180,1sleep10-21swapper/107:20:091
124258499181,9cyclictest0-21swapper/211:50:012
1242584991815,1cyclictest0-21swapper/208:40:012
1242583991815,2cyclictest1438535-21munin-plugin-st09:45:001
1242583991815,2cyclictest1438535-21munin-plugin-st09:45:001
1242583991815,2cyclictest1248362-21missed_timers07:15:011
1242583991815,2cyclictest1248351-21munin-node10:03:381
1242583991815,2cyclictest1242418-21latency_hist07:10:021
1242583991814,3cyclictest1559608-21idleruntime11:00:101
1242583991814,3cyclictest1475480-21missed_timers10:05:161
1242583991814,3cyclictest1361249-21kthreadcore08:50:191
1242583991814,3cyclictest1332228-21kthreadcore08:25:181
1242583991814,3cyclictest1330224-21timerwakeupswit08:20:281
1242583991814,3cyclictest1322111-21kthreadcore08:15:161
1242583991811,6cyclictest0-21swapper/112:05:011
1242582991815,2cyclictest1672034-21tr12:10:100
1242582991815,2cyclictest1622775-21systemd11:40:010
1242582991815,2cyclictest1610214-21kthreadcore11:30:160
1242582991815,2cyclictest1502-21systemd-logind07:55:020
1242582991815,2cyclictest1464-21dbus-daemon10:50:170
1242582991815,2cyclictest0-21swapper/009:30:010
2358491170,5ptp4l164790irq/127-enp1s0-TxRx-007:45:323
124258499170,11cyclictest0-21swapper/211:40:012
1242583991714,2cyclictest1671723-21fschecks_time12:10:081
1242583991714,2cyclictest1454-1atopacctd09:56:221
1242583991714,2cyclictest1351145-21kthreadcore08:40:171
1242583991713,3cyclictest1617703-21kthreadcore11:35:141
1242583991713,3cyclictest1535195-21cpuspeed_turbos10:45:061
1242583991713,3cyclictest1454-1atopacctd07:45:141
1242583991713,3cyclictest1372117-21gltestperf09:00:111
1242583991713,3cyclictest1372117-21gltestperf09:00:111
1242583991713,3cyclictest1318674-21timerandwakeup08:10:321
1242583991712,4cyclictest1358618-21kthreadcore08:45:201
1242583991711,5cyclictest1611443-21kthreadcore11:30:171
1242583991711,2cyclictest1689304-21kthreadcore12:20:121
1242583991710,6cyclictest1518832-21gpgconf10:35:011
1242582991715,1cyclictest1313564-21cut08:10:000
1242582991714,2cyclictest1502-21systemd-logind07:25:010
1242582991714,2cyclictest1357867-21kthreadcore08:45:190
1242582991714,2cyclictest1325271-21systemd-run08:20:020
1242582991714,2cyclictest1273461-21systemd-run07:35:010
1242582991714,2cyclictest1249259-21kthreadcore07:15:020
1242582991714,2cyclictest1-21systemd12:20:020
1242582991713,3cyclictest1404135-21unixbench-2d09:20:210
1242582991713,3cyclictest1372493-21irqcore09:00:210
1242582991713,3cyclictest1372493-21irqcore09:00:210
124258299170,3cyclictest0-21swapper/010:55:580
1242584991614,1cyclictest0-21swapper/209:25:022
1242584991613,1cyclictest0-21swapper/212:16:022
1242584991613,1cyclictest0-21swapper/210:15:132
1242584991613,1cyclictest0-21swapper/210:05:012
1242584991613,1cyclictest0-21swapper/209:11:072
124258399164,6cyclictest1568419-21kthreadcore11:05:121
124258399163,9cyclictest34-21ksoftirqd/111:48:251
1242583991613,2cyclictest1696045-21grep12:25:131
1242583991613,2cyclictest1644135-21unixbench_multi11:50:191
1242583991613,2cyclictest1502-21systemd-logind10:55:021
1242583991613,2cyclictest1464-21dbus-daemon09:15:011
1242583991613,2cyclictest1419225-21kthreadcore09:30:141
1242583991613,2cyclictest1380107-21kthreadcore09:05:171
1242583991613,2cyclictest1278297-21systemctl07:35:251
1242583991612,3cyclictest1715385-21ssh12:35:141
1242583991612,3cyclictest1623286-21cpuspeed_turbos11:40:071
1242583991612,3cyclictest1454-1atopacctd08:00:101
1242583991612,3cyclictest1401901-21kthreadcore09:20:131
1242583991612,3cyclictest1366996-21kthreadcore08:55:171
1242583991612,3cyclictest1345645-21kthreadcore08:35:171
1242583991612,3cyclictest1339368-21kthreadcore08:30:191
1242583991612,3cyclictest1293397-21kthreadcore07:50:181
1242583991612,3cyclictest1251599-21irqrtprio07:15:141
1242583991611,4cyclictest1600145-21irqrtprio11:25:131
1242583991611,4cyclictest1454-1atopacctd09:50:061
1242583991611,4cyclictest1308236-21cpuspeed_turbos08:05:091
1242583991610,5cyclictest0-21swapper/110:20:091
1242583991610,5cyclictest0-21swapper/110:15:011
1242582991614,1cyclictest1242580-21cyclictest12:35:000
1242582991613,2cyclictest1665546-21kthreadcore12:05:120
1242582991613,2cyclictest1634513-21kthreadcore11:45:140
1242582991613,2cyclictest1569253-21kthreadcore11:05:120
1242582991613,2cyclictest1542873-21cut10:50:020
1242582991613,2cyclictest1485-21polkitd08:20:240
1242582991613,2cyclictest1441463-21kthreadcore09:45:130
1242582991613,2cyclictest1307850-21latency_hist08:05:010
1242582991613,2cyclictest1299156-21grep07:55:220
1242582991613,2cyclictest1242580-21cyclictest11:25:200
1242582991612,3cyclictest1162604-21kworker/u8:0+nfsiod09:18:430
1242582991612,3cyclictest1144269-21kworker/u8:1+nfsiod09:42:090
1242582991612,3cyclictest1144269-21kworker/u8:1+nfsiod09:42:090
124258299161,1cyclictest471rcuog/211:50:410
124258299160,3cyclictest0-21swapper/011:19:580
124258499151,6cyclictest0-21swapper/210:30:022
1242584991513,1cyclictest0-21swapper/211:21:072
1242584991513,1cyclictest0-21swapper/208:58:202
1242584991513,1cyclictest0-21swapper/207:15:022
1242584991512,1cyclictest0-21swapper/211:12:062
1242584991512,1cyclictest0-21swapper/209:45:102
1242584991512,1cyclictest0-21swapper/209:42:162
1242584991512,1cyclictest0-21swapper/209:42:162
1242583991513,1cyclictest1703636-21ssh12:30:081
1242583991512,2cyclictest1527708-21gltestperf10:40:091
1242583991512,2cyclictest1504750-21kthreadcore10:25:131
1242583991512,2cyclictest1489661-21kthreadcore10:15:141
1242583991511,3cyclictest1391259-21cpuspeed_turbos09:15:071
1242583991511,3cyclictest1280350-21irqrtprio07:40:201
1242582991512,2cyclictest1696470-21kthreadcore12:25:150
1242582991512,2cyclictest1575375-21cpuspeed_turbos11:10:060
1242582991512,2cyclictest1528898-21kthreadcore10:40:130
1242582991512,2cyclictest1505100-21runrttasks10:25:130
1242582991512,2cyclictest1481559-21kthreadcore10:10:120
1242582991512,2cyclictest1454-1atopacctd08:45:010
1242582991512,2cyclictest1425106-21kthreadcore09:35:130
1242582991511,3cyclictest1624055-21irqcore11:40:140
1242582991511,3cyclictest1592394-21kthreadcore11:20:130
1242582991511,3cyclictest1460359-21kworker/u8:0+nfsiod10:16:340
1242582991511,3cyclictest1438564-21kworker/u8:2+nfsiod12:24:040
1242582991511,3cyclictest1378146-21irqcore09:05:150
1242584991412,1cyclictest0-21swapper/211:43:052
124258299149,3cyclictest1368591-21kthreadcore08:55:180
1242582991412,1cyclictest1279719-21cstates07:40:130
1242582991411,2cyclictest1649591-21kthreadcore11:55:130
1242582991411,2cyclictest1457898-21kthreadcore09:55:140
1242582991410,3cyclictest1496161-21kthreadcore10:20:140
1242582991410,3cyclictest1333621-21kthreadcore08:25:190
1242582991410,3cyclictest1315009-21kthreadcore08:10:200
124258299140,13cyclictest1711217-21ssh12:35:050
1242584991311,1cyclictest0-21swapper/207:10:022
1242584991310,1cyclictest0-21swapper/211:20:002
124258299136,5cyclictest1559-21gdbus07:25:260
124258299131,6cyclictest0-21swapper/008:54:140
1242582991310,2cyclictest1287658-21kthreadcore07:45:190
1242582991310,2cyclictest1275053-21kthreadcore07:35:170
1242582991310,2cyclictest1242641-21true07:10:020
1242584991210,1cyclictest0-21swapper/210:20:122
1242584991210,1cyclictest0-21swapper/207:20:192
124258299129,2cyclictest1344858-21kthreadcore08:35:160
124258499119,1cyclictest0-21swapper/208:40:172
124258499119,1cyclictest0-21swapper/207:55:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional