You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 20:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackeslot2.osadl.org (updated Wed Apr 24, 2024 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131120821100,2sleep30-21swapper/308:05:173
138957621000,1sleep10-21swapper/109:10:271
14360532420,2sleep30-21swapper/309:40:193
16426832330,2chrt0-21swapper/311:52:343
1258750992926,2cyclictest1715905-21turbostat12:40:001
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-011:44:083
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-010:21:563
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-009:30:183
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-012:37:403
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-010:43:043
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-010:36:323
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-010:01:043
2358491240,2ptp4l0-21swapper/309:40:013
168195922420,2sleep20-21swapper/212:16:272
166684322420,2sleep20-21swapper/212:07:542
125875399249,9cyclictest1416017-21taskset09:30:012
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-011:22:253
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-011:15:273
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:56:323
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:56:313
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:54:443
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:26:593
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-009:53:103
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-007:10:203
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-012:19:013
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-009:58:083
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-009:48:073
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-009:28:223
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-009:11:123
2358491230,3ptp4l164790irq/127-enp1s0-TxRx-011:33:123
2358491230,3ptp4l164790irq/127-enp1s0-TxRx-010:45:473
2358491230,3ptp4l164790irq/127-enp1s0-TxRx-010:45:463
171520022319,2sleep20-21swapper/212:38:432
170720122319,2sleep20-21swapper/212:33:462
169802322319,2sleep20-21swapper/212:26:332
167369922320,2sleep20-21swapper/212:10:452
147091322319,2sleep20-21swapper/210:02:162
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-012:05:423
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-008:25:173
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-012:20:253
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-011:13:393
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-012:32:063
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-011:55:133
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-011:38:593
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-011:38:583
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-009:22:193
2358491220,11ptp4l164790irq/127-enp1s0-TxRx-010:34:003
163463222218,2sleep20-21swapper/211:47:262
162092022218,2sleep20-21swapper/211:40:152
161997222218,2sleep20-21swapper/211:39:562
161997222218,2sleep20-21swapper/211:39:552
160101422218,2sleep20-21swapper/211:25:202
157788822218,2sleep20-21swapper/211:10:382
156984422218,2sleep20-21swapper/211:06:002
155519722218,2sleep20-21swapper/210:58:442
155519722218,2sleep20-21swapper/210:58:432
152227822218,2sleep20-21swapper/210:37:162
151518822218,2sleep20-21swapper/210:33:582
150396322218,2sleep20-21swapper/210:23:522
149551722218,2sleep20-21swapper/210:18:362
147890122218,2sleep20-21swapper/210:07:182
146255922218,2sleep20-21swapper/209:56:352
143851722218,2sleep20-21swapper/209:41:312
143005922218,2sleep20-21swapper/209:35:472
142193722218,2sleep20-21swapper/209:30:572
140767622218,2sleep20-21swapper/209:24:202
139341922218,2sleep20-21swapper/209:15:192
138991622218,2sleep20-21swapper/209:10:572
130336222218,2sleep20-21swapper/207:55:352
129268822218,2sleep20-21swapper/207:50:152
1258750992216,5cyclictest1636152-21latency_hist11:50:021
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-011:26:413
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-007:50:153
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-007:42:383
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-010:16:543
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-010:12:583
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-009:16:373
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-008:00:003
2358491210,2ptp4l0-21swapper/312:10:483
165061622118,2sleep20-21swapper/211:57:282
144553622118,2sleep20-21swapper/209:45:292
138371722118,2sleep20-21swapper/209:05:492
137821722118,2sleep20-21swapper/209:03:442
136653622118,2sleep20-21swapper/208:51:012
136090422118,2sleep20-21swapper/208:47:292
135510822118,2sleep20-21swapper/208:41:442
133238122118,2sleep20-21swapper/208:24:542
132647922118,2sleep20-21swapper/208:17:312
132060022118,2sleep20-21swapper/208:10:552
131493222118,2sleep20-21swapper/208:06:532
130923922118,2sleep20-21swapper/208:02:372
127933322118,2sleep20-21swapper/207:33:282
127858122118,2sleep20-21swapper/207:27:462
127298022118,2sleep20-21swapper/207:24:142
126723522118,2sleep20-21swapper/207:19:482
126433522118,2sleep20-21swapper/207:13:362
125875099215,10cyclictest1-21systemd12:35:011
1258750992118,2cyclictest1504566-21ls10:25:001
1258750992114,6cyclictest0-21swapper/111:10:021
1258749992118,2cyclictest1258747-21cyclictest07:45:010
1258749992117,2cyclictest1265016-21/usr/sbin/munin07:15:030
2577798200,3rtkit-daemon1406586-21GUsbEventThread10:07:480
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:34:483
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:00:103
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-009:02:333
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-012:01:593
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-011:45:033
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-011:05:333
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-011:00:253
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-010:05:573
2358491200,2ptp4l164790irq/127-enp1s0-TxRx-008:15:123
2358491200,1ptp4l0-21swapper/307:21:543
125875399203,10cyclictest0-21swapper/209:00:012
125875099204,7cyclictest1611444-21taskset11:33:461
125875099204,11cyclictest1302993-21tr07:55:241
1258750992015,4cyclictest1264895-21switchtime07:15:021
1258750992010,5cyclictest1534983-21kthreadcore10:45:231
1258750992010,5cyclictest1534983-21kthreadcore10:45:221
1258749992017,2cyclictest1416073-21sh09:30:010
2577798190,5rtkit-daemon0-21swapper/008:49:210
2358491190,6ptp4l164790irq/127-enp1s0-TxRx-007:05:113
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-008:55:223
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-008:43:423
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-007:26:033
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-012:29:563
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-009:05:213
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-008:13:523
2358491190,2ptp4l0-21swapper/308:20:183
2358491190,2ptp4l0-21swapper/307:35:193
1258753991916,1cyclictest0-21swapper/211:30:242
1258753991916,1cyclictest0-21swapper/207:40:002
125875099195,5cyclictest1311818-21cut08:05:171
125875099195,10cyclictest1345876-21kthreadcore08:35:211
125875099193,11cyclictest1476321-21kthreadcore10:05:221
125875099192,8cyclictest1644825-21fschecks_time11:55:131
125875099192,12cyclictest1674226-21rm12:11:471
125875099192,12cyclictest1588935-21expr11:20:141
125875099192,12cyclictest1563382-21rm11:03:591
125875099192,12cyclictest1528975-21tr10:40:271
125875099192,12cyclictest1424698-21cat09:35:111
125875099192,12cyclictest1413543-21cat09:25:291
125875099192,12cyclictest1361698-21cstates08:50:131
125875099192,12cyclictest1355939-21expr08:45:191
125875099192,12cyclictest1352142-21cut08:40:171
125875099192,12cyclictest1327673-21cat08:20:191
125875099191,13cyclictest1575094-21grep11:10:201
125875099191,10cyclictest1559-21gdbus12:10:001
1258750991910,4cyclictest1691950-21latency_hist12:25:011
1258749991916,2cyclictest25776-21rtkit-daemon12:24:590
1258749991916,2cyclictest25776-21rtkit-daemon09:37:240
2577798180,3rtkit-daemon1264568-21munin-node10:24:550
2358491180,6ptp4l164790irq/127-enp1s0-TxRx-008:45:173
2358491180,6ptp4l164790irq/127-enp1s0-TxRx-008:35:113
2358491180,2ptp4l0-21swapper/307:45:143
2358491180,2ptp4l0-21swapper/307:35:013
23582911813,3phc2sys0-21swapper/308:54:283
1258753991816,1cyclictest0-21swapper/210:50:022
1258753991816,1cyclictest0-21swapper/210:50:012
125875099188,2cyclictest0-21swapper/111:55:011
125875099184,9cyclictest1276805-21kthreadcore07:25:191
125875099183,5cyclictest1392448-21http09:15:111
125875099183,10cyclictest1484164-21cut10:10:191
125875099182,6cyclictest0-21swapper/110:25:271
125875099182,11cyclictest1652488-21cat12:00:121
125875099182,11cyclictest1471029-21ssh10:02:281
125875099182,11cyclictest1451804-21cut09:50:191
125875099182,11cyclictest1321601-21cat08:15:111
125875099182,11cyclictest1-21systemd09:05:001
1258750991815,2cyclictest1440423-21systemd-run09:45:001
1258750991814,3cyclictest1-21systemd09:33:111
125875099181,12cyclictest1596836-21expr11:25:111
125875099181,12cyclictest1400788-21cstates09:20:141
125875099181,12cyclictest1379301-21basename09:05:181
125875099181,12cyclictest1258858-21/usr/sbin/munin07:10:011
125875099181,11cyclictest1292217-21munin-run07:50:011
1258749991816,1cyclictest1571993-21apt-key11:10:000
1258749991815,2cyclictest254-21systemd-journal08:35:000
1258749991815,2cyclictest1697071-21mailstats12:25:230
1258749991815,2cyclictest1507997-21kthreadcore10:25:200
2358491170,5ptp4l164790irq/127-enp1s0-TxRx-007:20:023
125875099178,5cyclictest0-21swapper/110:34:121
125875099173,5cyclictest1441107-21cstates09:45:151
125875099172,10cyclictest1628129-21date11:45:001
125875099172,10cyclictest1612644-21cat11:35:161
125875099172,10cyclictest1612644-21cat11:35:151
125875099172,10cyclictest1580761-21cat11:15:101
125875099172,10cyclictest1549794-21cat10:55:231
125875099172,10cyclictest1549794-21cat10:55:221
125875099172,10cyclictest1540602-21expr10:50:161
125875099172,10cyclictest1488976-21expr10:15:131
125875099172,10cyclictest1304967-21cut08:00:161
125875099172,10cyclictest1280011-21ls07:35:071
125875099172,10cyclictest1267897-21cat07:20:091
125875099171,11cyclictest1681621-21ssh12:15:461
125875099171,11cyclictest1516740-21hddtemp_smartct10:35:091
125875099171,11cyclictest1461294-21sed09:55:201
125875099171,11cyclictest1332757-21apt08:25:151
125875099171,10cyclictest1464-21dbus-daemon12:30:001
125875099171,10cyclictest1464-21dbus-daemon07:20:021
1258749991715,1cyclictest1464348-21latency_hist10:00:010
1258749991715,1cyclictest1278887-21latency_hist07:30:000
1258749991714,2cyclictest1588371-21cut11:20:010
1258749991714,2cyclictest1548470-21tr10:55:160
1258749991714,2cyclictest1548470-21tr10:55:150
1258749991714,2cyclictest1502-21systemd-logind11:25:020
1258749991714,2cyclictest1372624-21tr09:00:010
1258753991612,2cyclictest0-21swapper/210:53:322
1258753991612,2cyclictest0-21swapper/210:13:132
125875099163,5cyclictest1372544-21runrttasks08:59:411
125875099161,10cyclictest1341634-21grep08:30:211
1258749991614,1cyclictest1464-21dbus-daemon08:10:020
1258749991613,2cyclictest25693-21cron12:19:590
1258749991613,2cyclictest1523806-21latency_hist10:40:000
1258749991613,2cyclictest1493449-21grep10:15:230
1258749991613,2cyclictest1309485-21systemd-run08:05:000
1258749991613,2cyclictest1285779-21sh07:40:020
1258749991613,2cyclictest1265070-21kthreadcore07:15:020
1258749991612,3cyclictest1488492-21kworker/u8:2+nfsiod11:45:470
1258749991612,3cyclictest1488492-21kworker/u8:2+nfsiod11:37:030
1258749991612,3cyclictest1488492-21kworker/u8:2+nfsiod11:37:030
1258749991612,3cyclictest1439132-21kworker/u8:2+nfsiod09:54:490
1258749991612,3cyclictest1439132-21kworker/u8:2+nfsiod09:48:130
1258749991612,3cyclictest1416198-21kworker/u8:3+nfsiod10:47:400
1258749991612,3cyclictest1416198-21kworker/u8:3+nfsiod10:47:390
125874999160,4cyclictest1326700-21wc08:20:010
1258753991512,1cyclictest0-21swapper/212:00:502
1258753991512,1cyclictest0-21swapper/210:43:492
1258753991512,1cyclictest0-21swapper/208:40:002
1258753991512,1cyclictest0-21swapper/208:25:312
1258753991511,2cyclictest0-21swapper/212:21:452
1258753991511,2cyclictest0-21swapper/211:50:302
1258753991511,2cyclictest0-21swapper/211:22:302
125875099150,10cyclictest1315531-21apt08:10:141
125874999159,5cyclictest1404659-21cut09:20:220
125874999156,5cyclictest0-21swapper/011:50:390
125874999156,5cyclictest0-21swapper/007:33:130
125874999155,6cyclictest0-21swapper/009:11:020
125874999155,6cyclictest0-21swapper/008:21:330
125874999152,2cyclictest471rcuog/211:29:140
1258749991512,2cyclictest1709823-21kthreadcore12:35:180
1258749991512,2cyclictest1670751-21kthreadcore12:10:200
1258749991512,2cyclictest1654585-21kthreadcore12:00:200
1258749991512,2cyclictest1620684-21cstates11:40:130
1258749991512,2cyclictest1573169-21gltestperf11:10:160
1258749991512,2cyclictest1418453-21kthreadcore09:30:190
1258749991512,2cyclictest1397006-21head09:15:220
1258749991512,2cyclictest1338151-21cron08:30:010
1258749991512,2cyclictest1297773-21apt-key07:55:010
1258749991512,2cyclictest1258916-21systemd-run07:10:020
1258749991512,1cyclictest1367062-21systemd-run08:55:010
1258749991511,3cyclictest1628282-21kworker/u8:3+nfsiod11:57:510
1258749991511,3cyclictest1488492-21kworker/u8:2+nfsiod10:30:100
1258749991511,3cyclictest1448413-21kworker/u8:0+nfsiod10:11:070
1258749991511,3cyclictest1448413-21kworker/u8:0+nfsiod10:04:170
1258749991511,3cyclictest1416198-21kworker/u8:3+nfsiod11:03:270
1258749991511,3cyclictest1071391-21kworker/u8:0+nfsiod09:41:420
1258753991411,1cyclictest0-21swapper/208:30:182
1258753991411,1cyclictest0-21swapper/207:50:002
1258753991410,2cyclictest0-21swapper/210:26:172
125875099143,3cyclictest1286293-21date07:45:011
1258750991410,1cyclictest191rcu_preempt07:50:451
1258749991411,2cyclictest1701410-21irqrtprio12:30:210
1258749991411,2cyclictest1662198-21kthreadcore12:05:200
1258749991411,2cyclictest1604979-21fschecks_count11:30:120
1258749991411,2cyclictest1527652-21kthreadcore10:40:220
1258749991411,2cyclictest1378778-21cpuspeed_turbos09:05:150
1258749991411,2cyclictest1377857-21unixbench-2d09:00:300
1258749991411,2cyclictest1316067-21gltestperf08:10:180
1258749991411,2cyclictest1300312-21kthreadcore07:55:190
1258749991410,3cyclictest1488492-21kworker/u8:2+nfsiod10:50:130
125874999140,3cyclictest0-21swapper/008:35:040
125874999140,2cyclictest1273075-21grep07:25:010
1258753991311,1cyclictest0-21swapper/211:00:202
1258753991311,1cyclictest0-21swapper/207:45:022
125875099133,3cyclictest1279263-21runrttasks07:32:331
125874999134,5cyclictest0-21swapper/007:46:060
1258749991310,2cyclictest1350751-21tr08:40:160
1258753991210,1cyclictest0-21swapper/211:15:152
1258753991210,1cyclictest0-21swapper/209:50:172
125875399119,1cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional